You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-07 - 23:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Sun Sep 07, 2025 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
220873699464,9cyclictest2291502-21if_end010:07:300
220873699441,37cyclictest2354231-21ssh11:22:270
220873799406,8cyclictest11050irq/107-eth%d09:47:271
220873899391,20cyclictest0-21swapper/209:44:552
2208737993716,3cyclictest2243965-21unixbench_singl08:57:321
220873699374,6cyclictest211irq_work/011:52:280
2208736993727,8cyclictest0-21swapper/007:34:540
220873699364,16cyclictest0-21swapper/010:02:280
220873699363,25cyclictest2356206-21sendmail-msp11:26:350
2208736993624,3cyclictest11050irq/107-eth%d12:19:540
2208737993419,3cyclictest2429097-21unixbench_multi12:37:321
220873799336,12cyclictest2332149-21ntpq10:57:261
220873699331,31cyclictest0-21swapper/010:57:260
220873699323,1cyclictest0-21swapper/012:42:180
2208736993219,5cyclictest2212309-21aten_r2power_cu07:27:190
2208736993214,4cyclictest2258933-21awk09:27:280
220873699320,31cyclictest2418799-21ntpq12:27:260
220873899312,7cyclictest171rcu_preempt11:44:002
220873799311,10cyclictest2256936-21basename09:24:521
2208736993115,7cyclictest967-21snmpd11:32:240
220873699310,17cyclictest2272854-21apt-get09:44:530
2208738993019,6cyclictest0-21swapper/210:27:262
2208737993017,12cyclictest0-21swapper/107:47:201
2208736993026,3cyclictest2388984-21ntp_states11:57:290
2208736993026,3cyclictest2388984-21ntp_states11:57:290
2208736993025,3cyclictest1007-21mta-sts-daemon07:22:280
2208736993023,5cyclictest1007-21mta-sts-daemon10:42:270
220873699302,26cyclictest0-21swapper/012:07:170
220873699300,24cyclictest0-21swapper/010:22:200
2208736992923,2cyclictest0-21swapper/010:46:590
220873699291,2cyclictest0-21swapper/011:44:530
2208738992825,2cyclictest2262943-21ssh09:32:242
220873799284,9cyclictest2295811-21/usr/sbin/munin10:12:271
220873799284,4cyclictest0-21swapper/112:40:071
220873799283,10cyclictest2383905-21ntpq11:52:281
220873699283,19cyclictest2428844-21cat12:37:310
220873699280,19cyclictest0-21swapper/009:59:360
2208736992720,1cyclictest2328359-21xargs10:52:330
2208736992615,8cyclictest2338018-21sendmail-msp11:04:550
220873799252,10cyclictest2291767-21ssh10:07:321
2208736992524,1cyclictest0-21swapper/009:42:270
220873699251,6cyclictest2348909-21/usr/sbin/munin11:17:250
220873699250,20cyclictest0-21swapper/011:37:280
220873899249,9cyclictest0-21swapper/211:04:552
220873799241,19cyclictest2222850-21fschecks_time07:57:221
220873799232,12cyclictest2308657-21/usr/sbin/munin10:27:331
2208737992313,7cyclictest0-21swapper/112:19:541
2208736992321,1cyclictest2312452-21cat10:32:330
220873699231,14cyclictest2308611-21grep10:27:330
220873899223,16cyclictest2255170-21ntpq09:22:262
220873799225,5cyclictest11050irq/107-eth%d07:37:261
2208737992219,2cyclictest2237337-21grep08:37:331
220873699224,12cyclictest2299374-21grep10:17:240
220873699223,1cyclictest0-21swapper/012:17:280
220873699223,15cyclictest2208694-21munin-run07:14:520
2208736992218,2cyclictest0-21swapper/009:20:020
220873699221,1cyclictest0-21swapper/011:47:240
220873899213,15cyclictest2431257-21apt-get12:39:542
220873799214,3cyclictest11050irq/107-eth%d09:57:301
220873699210,4cyclictest2403141-21fschecks_time12:12:220
220873899204,14cyclictest2396009-21sendmail-msp12:07:172
220873899204,12cyclictest619-21mta-sts-daemon09:59:542
220873899204,12cyclictest2408708-21/usr/sbin/munin12:17:282
2208738992017,2cyclictest1007-21mta-sts-daemon10:12:232
2208738992016,2cyclictest0-21swapper/209:42:262
220873799206,11cyclictest2357994-21ssh11:27:141
220873799203,14cyclictest2258124-21aten_r2power_en09:27:221
220873699202,4cyclictest11050irq/107-eth%d08:47:270
220873699202,17cyclictest0-21swapper/009:52:050
2208736992018,1cyclictest607-21dbus-daemon08:09:530
2208736992018,1cyclictest0-21swapper/011:12:280
2208736992016,3cyclictest2215542-21latency_hist07:34:520
2208736992016,3cyclictest0-21swapper/012:02:210
220873699200,19cyclictest619-21mta-sts-daemon08:34:520
112699200,1rtkit-daemon0-21swapper/211:04:492
220873899195,9cyclictest2212222-21latency_hist07:24:522
2208738991916,2cyclictest2394399-21unixbench_singl12:02:312
220873799192,15cyclictest2408172-21/usr/sbin/munin12:17:231
2208737991915,3cyclictest607-21dbus-daemon07:34:521
220873799191,13cyclictest2278757-21fschecks_count09:52:241
2208736991914,4cyclictest2241291-21fschecks_time08:52:240
2208736991912,5cyclictest2243892-21grep08:57:320
2208736991910,4cyclictest0-21swapper/009:34:520
220873899187,6cyclictest2246265-21grep09:07:242
220873899186,9cyclictest2323567-21/usr/sbin/munin10:47:232
220873899184,8cyclictest2364070-21rm11:32:282
220873899183,5cyclictest171rcu_preempt08:52:292
220873899183,11cyclictest2353691-21fschecks_time11:22:232
220873899182,5cyclictest2428715-21/usr/sbin/munin12:37:292
220873899182,12cyclictest2388324-21fschecks_count11:57:242
220873899182,12cyclictest2388324-21fschecks_count11:57:242
220873899182,11cyclictest2368864-21ssh11:37:252
220873899181,4cyclictest171rcu_preempt11:52:242
220873899181,4cyclictest0-21swapper/212:27:282
2208738991814,3cyclictest2214312-21grep07:32:232
2208738991812,5cyclictest2243333-21munin-node10:16:482
2208738991811,4cyclictest0-21swapper/210:37:322
220873899181,11cyclictest2411387-21ssh12:19:542
2208738991810,7cyclictest0-21swapper/208:07:532
220873899180,3cyclictest171rcu_preempt09:39:522
220873799183,8cyclictest2349916-21ssh11:17:291
220873799183,11cyclictest2212725-21grep07:27:221
220873799182,3cyclictest11050irq/107-eth%d11:12:281
220873799182,13cyclictest967-21snmpd07:17:301
220873699183,13cyclictest2250899-21/usr/sbin/munin09:17:250
220873699182,8cyclictest0-21swapper/012:32:260
2208736991816,1cyclictest0-21swapper/007:57:250
220873699180,2cyclictest0-21swapper/009:37:250
112699180,1rtkit-daemon1007-21mta-sts-daemon11:14:372
220873999175,5cyclictest0-21swapper/310:02:253
220873899172,4cyclictest171rcu_preempt11:49:522
220873899172,3cyclictest171rcu_preempt11:27:242
220873899172,12cyclictest2234097-21unixbench_singl08:27:332
220873899172,11cyclictest2228069-21fschecks_count08:12:232
2208738991713,2cyclictest2279819-21unixbench_multi09:52:342
2208738991711,3cyclictest0-21swapper/210:22:332
220873799176,8cyclictest2315602-21/usr/sbin/munin10:37:321
220873799176,5cyclictest11050irq/107-eth%d10:32:271
220873799173,9cyclictest2226304-21if_end008:07:411
220873799172,10cyclictest2323821-21/usr/sbin/munin10:47:261
2208737991714,1cyclictest0-21swapper/111:37:211
220873799171,12cyclictest2399364-21sed12:07:321
220873799171,12cyclictest2341338-21ssh11:07:321
220873799171,10cyclictest2327514-21fschecks_time10:52:241
2208736991713,4cyclictest2220038-21ntp_kernel_pll_07:47:270
2208736991712,2cyclictest0-21swapper/010:13:080
220873699171,10cyclictest2238926-21sed08:42:340
2208736991710,5cyclictest0-21swapper/007:17:300
112699170,2rtkit-daemon2320069-21ntpq10:42:262
220873999163,8cyclictest0-21swapper/310:27:253
220873899162,10cyclictest2312107-21/usr/sbin/munin10:32:272
220873899162,10cyclictest2236794-21/usr/sbin/munin08:37:252
2208738991613,2cyclictest2221132-21fschecks_count07:52:452
220873899161,12cyclictest2289464-21sendmail-msp10:06:382
2208738991611,2cyclictest0-21swapper/210:52:342
220873799167,6cyclictest2251164-21ntpq09:17:291
220873799165,9cyclictest2243333-21munin-node12:11:121
220873799165,8cyclictest2285665-21ssh09:59:541
220873799164,8cyclictest2353585-21/usr/sbin/munin11:22:221
220873799163,10cyclictest2364007-21ssh11:32:271
220873799161,9cyclictest2388345-21fschecks_time11:57:241
220873799161,9cyclictest2388345-21fschecks_time11:57:241
220873799161,9cyclictest2211005-21grep07:22:231
220873799161,10cyclictest11050irq/107-eth%d11:02:211
220873799160,15cyclictest2266515-21cut09:37:261
220873799160,14cyclictest2423192-21tune2fs12:32:231
220873699162,11cyclictest2337989-21latency_hist11:04:520
2208736991612,2cyclictest0-21swapper/008:37:230
2208736991612,2cyclictest0-21swapper/007:52:490
220873699161,11cyclictest2315609-21/usr/sbin/munin10:37:320
220873699161,10cyclictest2248988-21sort09:14:520
220873699160,4cyclictest2224968-21ntpq08:02:270
220873699160,4cyclictest2224968-21ntpq08:02:270
220873699160,1cyclictest2232329-21unixbench-2d08:22:320
220873899158,5cyclictest2219536-21grep07:47:232
220873899155,7cyclictest629-21thd08:22:232
220873899154,10cyclictest2222842-21fschecks_time07:57:222
220873899153,9cyclictest2350300-21/usr/sbin/munin11:17:332
220873899153,7cyclictest2403624-21ssh12:12:262
220873899152,1cyclictest2238015-21grep08:42:242
2208738991511,2cyclictest0-21swapper/210:57:242
220873899150,8cyclictest2217191-21sed07:37:332
220873899150,3cyclictest171rcu_preempt08:57:222
220873799157,7cyclictest0-21swapper/109:32:241
220873799155,8cyclictest2247854-21cut09:12:231
220873799154,6cyclictest2303693-21/usr/sbin/munin10:22:251
220873799153,10cyclictest2224229-21aten2.4-expect08:02:211
220873799153,10cyclictest2224229-21aten2.4-expect08:02:211
220873799152,10cyclictest2217827-21cut07:42:231
220873799151,7cyclictest2299522-21/usr/sbin/munin10:17:241
2208737991511,3cyclictest2239600-21grep08:47:231
220873799150,9cyclictest2419323-21sed12:27:321
220873699152,8cyclictest2219000-21latency_hist07:44:520
2208736991512,2cyclictest0-21swapper/008:09:520
220873699151,11cyclictest2233063-21fschecks_count08:27:230
112699150,2rtkit-daemon1125-21rtkit-daemon10:40:081
112699150,1rtkit-daemon0-21swapper/108:23:401
112699150,1rtkit-daemon0-21swapper/008:16:550
220873999145,5cyclictest0-21swapper/311:04:553
220873999143,6cyclictest0-21swapper/311:22:213
220873999143,6cyclictest0-21swapper/310:37:323
220873999143,6cyclictest0-21swapper/309:22:263
220873999143,5cyclictest0-21swapper/308:12:283
220873899148,5cyclictest0-21swapper/207:27:202
220873899146,7cyclictest0-21swapper/207:42:212
220873899142,9cyclictest2285225-21awk09:59:522
220873899142,7cyclictest2247815-21/usr/sbin/munin09:12:222
220873899142,10cyclictest2258285-21/usr/sbin/munin09:27:232
220873899141,7cyclictest2251212-21processes09:17:292
220873899141,4cyclictest171rcu_preempt09:04:522
220873899141,11cyclictest2423142-21fschecks_count12:32:232
220873799149,4cyclictest271ktimers/111:42:231
220873799145,6cyclictest2221258-21grep07:52:451
220873799143,7cyclictest2270578-21cut09:42:231
220873799142,9cyclictest2241127-21aten_r2power_vo08:52:221
220873799142,8cyclictest2229741-21fschecks_count08:17:231
220873799141,9cyclictest2237749-21aten_r2power_fr08:42:221
220873799141,6cyclictest11050irq/107-eth%d11:45:561
220873799140,13cyclictest2393276-21tune2fs12:02:211
220873699145,6cyclictest0-21swapper/009:07:220
220873699141,9cyclictest0-21swapper/009:02:290
220873999134,5cyclictest0-21swapper/312:17:283
220873999133,6cyclictest0-21swapper/312:12:313
220873999133,6cyclictest0-21swapper/309:37:233
220873999133,5cyclictest0-21swapper/311:27:243
220873999132,7cyclictest0-21swapper/309:44:553
220873999132,6cyclictest0-21swapper/310:46:123
220873999132,6cyclictest0-21swapper/309:17:293
220873999132,6cyclictest0-21swapper/308:27:293
220873999132,5cyclictest0-21swapper/309:57:263
220873999131,8cyclictest0-21swapper/307:22:253
220873999131,7cyclictest0-21swapper/311:32:273
220873999131,7cyclictest0-21swapper/310:42:263
220873899138,3cyclictest0-21swapper/208:17:242
220873899135,5cyclictest2209073-21/usr/sbin/munin07:17:232
220873899131,9cyclictest2239650-21cut08:47:232
220873899131,7cyclictest2234661-21grep08:32:272
220873899131,7cyclictest2224428-21grep08:02:232
220873899131,7cyclictest2224428-21grep08:02:232
220873799134,7cyclictest0-21swapper/108:32:281
220873799134,5cyclictest2233868-21/usr/sbin/munin08:27:321
220873799132,9cyclictest111788-21systemd-journal09:04:521
220873799131,9cyclictest2246189-21fschecks_count09:07:241
220873999126,4cyclictest0-21swapper/311:42:273
220873999124,5cyclictest0-21swapper/312:07:283
220873999124,4cyclictest0-21swapper/310:57:263
220873999124,4cyclictest0-21swapper/309:25:083
220873999123,5cyclictest0-21swapper/312:32:493
220873999123,5cyclictest0-21swapper/311:57:263
220873999123,5cyclictest0-21swapper/311:57:263
220873999123,5cyclictest0-21swapper/308:17:243
220873999123,5cyclictest0-21swapper/307:17:293
220873999123,4cyclictest0-21swapper/310:12:223
220873999122,7cyclictest0-21swapper/309:02:343
220873999122,6cyclictest0-21swapper/310:52:333
220873999122,6cyclictest0-21swapper/307:37:313
220873999122,5cyclictest0-21swapper/309:42:213
220873999121,6cyclictest0-21swapper/312:40:073
220873999121,6cyclictest0-21swapper/312:27:233
220873999121,6cyclictest0-21swapper/311:47:313
220873999121,3cyclictest0-21swapper/308:52:213
220873799126,5cyclictest2227933-21/usr/sbin/munin08:12:221
220873999114,5cyclictest0-21swapper/307:42:293
220873999113,4cyclictest0-21swapper/312:35:463
220873999113,4cyclictest0-21swapper/312:02:203
220873999113,4cyclictest0-21swapper/309:05:473
220873999112,7cyclictest0-21swapper/310:32:303
220873999111,6cyclictest0-21swapper/307:34:523
220873999110,7cyclictest0-21swapper/310:22:313
220873999110,5cyclictest0-21swapper/312:19:543
220873999110,5cyclictest0-21swapper/311:52:253
220873799113,6cyclictest0-21swapper/107:14:521
220873999105,4cyclictest0-21swapper/310:07:323
220873999105,4cyclictest0-21swapper/309:32:243
220873999105,2cyclictest0-21swapper/307:47:293
220873999104,4cyclictest0-21swapper/311:12:233
220873999103,4cyclictest0-21swapper/308:47:233
220873999103,3cyclictest0-21swapper/308:06:063
220873999102,6cyclictest0-21swapper/311:02:183
220873999102,5cyclictest0-21swapper/311:17:323
220873999102,5cyclictest0-21swapper/308:56:073
220873999102,4cyclictest0-21swapper/311:37:203
220873999102,4cyclictest0-21swapper/309:52:253
220873999102,4cyclictest0-21swapper/308:42:213
220873999101,5cyclictest0-21swapper/310:17:203
220873999101,5cyclictest0-21swapper/308:32:273
220873999101,5cyclictest0-21swapper/308:22:223
220873999100,5cyclictest0-21swapper/307:57:283
220873899102,5cyclictest2208911-21cat07:14:532
22087399993,4cyclictest0-21swapper/307:14:523
22087399992,5cyclictest0-21swapper/309:14:523
22087399992,4cyclictest0-21swapper/308:02:213
22087399992,4cyclictest0-21swapper/308:02:213
22087399992,3cyclictest0-21swapper/307:52:203
22087399991,5cyclictest0-21swapper/308:37:223
22087399990,4cyclictest0-21swapper/307:27:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional