You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 21:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat May 09, 2026 12:44:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2775213915,83sleep22795-21apt-get07:01:322
2835211411,74sleep02869-21unin-run07:01:340
30369910045,49cyclictest23256-21timerandwakeup09:22:082
303699983,51cyclictest6522-21apt-get11:36:432
3036999654,35cyclictest30061-21ssh12:16:312
3036999654,35cyclictest30061-21ssh12:16:312
3036999649,40cyclictest9030-21acpi10:46:412
3036999649,40cyclictest9030-21acpi10:46:412
3036999649,40cyclictest9030-21acpi10:46:412
3036999649,40cyclictest9030-21acpi10:46:412
3036999568,21cyclictest3253-21cstates10:37:202
3036999548,40cyclictest0-21swapper/212:02:072
3036999548,40cyclictest0-21swapper/212:02:072
3036999366,18cyclictest4154-21fschecks_count12:26:532
3036999231,50cyclictest0-21swapper/209:16:522
3028999137,48cyclictest26732-21latency_hist11:16:331
302899913,27cyclictest4513-21ntp_offset12:27:001
3036999049,33cyclictest0-21swapper/210:32:592
3036999049,33cyclictest0-21swapper/210:32:592
3036999047,36cyclictest10085-21diskmemload11:44:442
3028999041,42cyclictest352-21runrttasks10:20:521
302899902,34cyclictest19571-21ssh11:03:131
3028998939,43cyclictest20341-21ssh10:11:541
3028998939,43cyclictest20341-21ssh10:11:541
302899893,28cyclictest16656-21latency_hist07:41:341
302899893,28cyclictest16656-21latency_hist07:41:341
302899892,32cyclictest12384-21latency_hist11:46:341
3016998971,12cyclictest1-21systemd11:51:310
3036998848,33cyclictest0-21swapper/209:57:092
302899886,70cyclictest28265-21apt-get08:17:011
3028998835,43cyclictest0-21swapper/108:01:341
302899883,29cyclictest30132-21fschecks_time08:21:551
302899882,32cyclictest7002-21unixbench_singl10:42:081
302899882,32cyclictest7002-21unixbench_singl10:42:081
302899882,32cyclictest7002-21unixbench_singl10:42:081
302899882,32cyclictest7002-21unixbench_singl10:42:081
305099872,67cyclictest2970-21chrt10:36:493
3036998740,42cyclictest0-21swapper/208:24:552
302899872,34cyclictest28143-21cat09:31:341
302899872,34cyclictest28143-21cat09:31:341
3016998768,13cyclictest9769-21fschecks_count11:41:540
303699864,23cyclictest507-21/usr/sbin/munin11:27:072
303699864,23cyclictest507-21/usr/sbin/munin11:27:072
3036998641,36cyclictest0-21swapper/211:06:332
303699862,38cyclictest12418-21fschecks_time10:51:532
3028998639,40cyclictest30302-21fschecks_time11:21:541
3028998634,43cyclictest0-21swapper/111:40:101
3028998634,43cyclictest0-21swapper/107:06:521
302899863,29cyclictest8711-21/usr/sbin/munin08:57:041
302899863,29cyclictest8711-21/usr/sbin/munin08:57:041
3028998632,46cyclictest0-21swapper/112:06:311
3028998632,46cyclictest0-21swapper/112:06:311
302899862,63cyclictest3002-21ssh10:36:531
287528612,49sleep12878-21munin-run07:01:351
3036998548,30cyclictest0-21swapper/208:06:532
3036998536,43cyclictest0-21swapper/208:16:332
3036998536,43cyclictest0-21swapper/208:16:332
3036998532,45cyclictest0-21swapper/210:48:102
303699852,31cyclictest25351-21sh09:26:472
303699852,31cyclictest25351-21sh09:26:472
3028998534,43cyclictest0-21swapper/110:33:041
3028998534,43cyclictest0-21swapper/110:33:041
302899853,31cyclictest13771-21/usr/sbin/munin10:02:071
302899853,31cyclictest13771-21/usr/sbin/munin10:02:071
3028998529,48cyclictest0-21swapper/108:36:311
302899852,33cyclictest23069-21mailstats09:22:051
302899852,23cyclictest8671-21latency_hist08:56:351
303699847,21cyclictest30027-21apt-get11:21:472
3036998448,31cyclictest13801-21kworker/u18:0-rpciod12:17:162
3036998442,35cyclictest0-21swapper/207:52:082
3036998440,38cyclictest15214-21cpuspeed10:56:472
3036998439,38cyclictest0-21swapper/208:36:562
3036998439,38cyclictest0-21swapper/208:36:562
3036998437,41cyclictest0-21swapper/210:31:362
303699843,38cyclictest26089-21cstates10:21:482
3036998427,47cyclictest0-21swapper/208:17:482
302899843,34cyclictest30404-21seq10:28:101
302899843,33cyclictest15110-21ssh11:51:291
302899843,29cyclictest21303-21idleruntime-cro07:56:311
302899843,28cyclictest8533-21latency_hist07:16:341
3028998430,47cyclictest0-21swapper/110:56:591
302899842,32cyclictest2908-21grep09:42:081
3028998413,28cyclictest7006-21latency_hist08:51:341
3036998342,33cyclictest0-21swapper/207:31:342
3036998341,34cyclictest0-21swapper/209:12:052
3036998341,34cyclictest0-21swapper/209:12:052
3036998340,35cyclictest0-21swapper/209:56:342
3036998334,40cyclictest0-21swapper/210:11:492
3036998334,40cyclictest0-21swapper/210:11:492
303699833,28cyclictest352-21runrttasks11:16:392
303699833,28cyclictest352-21runrttasks11:16:392
303699833,23cyclictest21046-21/usr/sbin/munin11:06:422
303699833,21cyclictest23375-21grep08:01:532
3036998330,46cyclictest0-21swapper/209:46:432
3036998330,46cyclictest0-21swapper/209:46:432
302899834,23cyclictest30365-21/usr/sbin/munin12:17:041
302899833,62cyclictest10168-21ssh10:48:151
302899833,24cyclictest18378-21cpuspeed07:46:491
3028998329,46cyclictest0-21swapper/109:32:011
3028998327,48cyclictest0-21swapper/110:07:441
302899832,35cyclictest13661-21fschecks_time09:06:551
303699823,25cyclictest5591-21fschecks_count07:06:562
303699823,25cyclictest15350-21latency_hist11:51:342
303699823,24cyclictest9275-21/usr/sbin/munin08:57:042
303699823,24cyclictest9275-21/usr/sbin/munin08:57:042
303699823,24cyclictest16449-21apt-get10:06:472
303699822,30cyclictest2098-21grep09:41:532
3028998260,14cyclictest0-21swapper/108:37:071
3028998260,14cyclictest0-21swapper/108:37:071
302899824,30cyclictest27378-21/usr/sbin/munin12:11:441
302899824,30cyclictest27378-21/usr/sbin/munin12:11:441
3028998236,38cyclictest0-21swapper/110:54:541
302899823,32cyclictest17065-21kernelversion07:41:571
302899823,31cyclictest9556-21unixbench_multi07:17:081
302899823,29cyclictest18141-21latency_hist11:56:341
302899823,28cyclictest1589-21/usr/sbin/munin11:27:071
302899823,28cyclictest1589-21/usr/sbin/munin11:27:071
3028998231,43cyclictest0-21swapper/111:11:111
3028998226,50cyclictest0-21swapper/108:16:351
3028998226,50cyclictest0-21swapper/108:16:351
302899822,33cyclictest22083-21ssh09:21:331
302899822,33cyclictest13689-21fschecks_count07:31:531
302899822,33cyclictest13689-21fschecks_count07:31:531
302899822,33cyclictest10375-21/usr/sbin/munin09:02:091
302899822,32cyclictest11575-21cron07:26:311
3028998221,9cyclictest0-21swapper/112:06:561
3028998219,56cyclictest352-21runrttasks11:16:571
3028998219,56cyclictest352-21runrttasks11:16:571
3028998218,23cyclictest12098-21seq09:57:411
3036998141,32cyclictest0-21swapper/212:07:072
303699813,37cyclictest17079-21kernelversion07:41:572
303699813,26cyclictest13922-21ssh10:01:502
303699813,26cyclictest13922-21ssh10:01:502
303699813,24cyclictest7806-21/usr/sbin/munin08:52:062
303699813,24cyclictest23544-21/usr/sbin/munin10:17:012
303699812,25cyclictest28274-21latency_hist09:31:352
302899817,26cyclictest4170-21ntp_states11:32:011
302899813,31cyclictest3598-21basename12:26:301
302899813,31cyclictest3598-21basename12:26:301
302899813,25cyclictest25695-21grep08:07:081
3028998124,8cyclictest0-21swapper/109:55:281
302899812,32cyclictest31877-21ntpq09:36:591
302899812,32cyclictest31877-21ntpq09:36:591
3036998040,33cyclictest0-21swapper/207:26:342
3036998035,37cyclictest0-21swapper/211:51:542
303699803,30cyclictest4148-21ntp_offset11:32:002
303699803,22cyclictest3336-21/usr/sbin/munin07:01:422
3036998029,45cyclictest0-21swapper/208:31:312
3036998026,46cyclictest0-21swapper/212:22:072
3036998026,46cyclictest0-21swapper/212:22:072
303699802,25cyclictest25453-21runrttasks11:12:542
303699802,25cyclictest22467-21tail07:57:092
303699802,24cyclictest7564-21/usr/sbin/munin07:11:592
303699802,24cyclictest19832-21runrttasks11:57:542
302899804,25cyclictest352-21runrttasks07:02:341
302899803,31cyclictest27029-21grep10:22:081
302899802,26cyclictest32385-21grep08:27:091
303699797,17cyclictest0-21swapper/207:31:582
303699797,17cyclictest0-21swapper/207:31:582
3036997937,34cyclictest659-21cpu08:31:472
303699793,24cyclictest18498-21fschecks_count07:46:532
303699793,24cyclictest15388-21/usr/sbin/munin07:36:542
303699793,24cyclictest15388-21/usr/sbin/munin07:36:542
303699793,23cyclictest14168-21/usr/sbin/munin09:07:072
303699793,22cyclictest31898-21/usr/sbin/munin09:37:002
303699793,22cyclictest31898-21/usr/sbin/munin09:37:002
303699792,32cyclictest352-21runrttasks09:05:262
302899793,28cyclictest5273-21/usr/sbin/munin09:46:581
302899793,28cyclictest5273-21/usr/sbin/munin09:46:581
302899793,22cyclictest16766-21ssh09:11:561
302899793,22cyclictest16766-21ssh09:11:561
21902799,44sleep30-21swapper/306:57:173
303699782,27cyclictest4401-21grep08:41:592
303699782,27cyclictest4401-21grep08:41:592
3036997818,50cyclictest6040-21awk08:47:012
302899782,30cyclictest18589-21cstates11:56:491
3016997856,15cyclictest6361-21sh11:36:340
303699772,23cyclictest9961-21seq07:21:262
302899772,23cyclictest12270-21/usr/sbin/munin07:26:571
3016997761,9cyclictest30515-21kworker/u17:1+rpciod10:42:070
3016997761,9cyclictest30515-21kworker/u17:1+rpciod10:42:070
3016997761,9cyclictest30515-21kworker/u17:1+rpciod10:42:070
3016997761,9cyclictest30515-21kworker/u17:1+rpciod10:42:070
3016997759,13cyclictest14915-21kworker/u17:2+nfsiod10:15:340
3016997759,13cyclictest14915-21kworker/u17:2+nfsiod10:15:340
3016997756,15cyclictest25221-21latency_hist09:26:340
301699774,43cyclictest23863-21latency_hist11:11:340
3016997743,25cyclictest11441-21grep09:02:090
186262773,8sleep00-21swapper/009:15:210
186262773,8sleep00-21swapper/009:15:210
302899763,25cyclictest4299-21latency08:41:561
302899763,25cyclictest4299-21latency08:41:561
3016997662,9cyclictest3575-21kworker/u17:112:26:300
3016997662,9cyclictest3575-21kworker/u17:112:26:300
3016997662,10cyclictest3001-21cyclictest11:29:030
3016997662,10cyclictest3001-21cyclictest11:29:030
305099753,28cyclictest17005-21taskset10:06:443
302899753,20cyclictest24068-21unixbench_multi08:02:081
3016997457,11cyclictest10085-21diskmemload10:19:120
3016997449,17cyclictest544-21cron07:51:310
305099732,28cyclictest9050-21taskset10:46:423
305099732,28cyclictest9050-21taskset10:46:423
305099732,28cyclictest9050-21taskset10:46:423
305099732,28cyclictest9050-21taskset10:46:423
3016997357,10cyclictest3247-21systemd-tmpfile10:37:200
3016997355,12cyclictest26750-21ssh10:22:050
3016997354,10cyclictest21982-21latency07:56:590
301699734,37cyclictest6982-21sort11:36:560
305099723,27cyclictest28359-21taskset09:31:453
3016997256,10cyclictest29584-21ssh12:15:090
3016997256,10cyclictest29584-21ssh12:15:090
3016997253,11cyclictest27132-21systemd-run12:11:310
301699724,38cyclictest25299-21/usr/sbin/munin09:26:590
301699724,38cyclictest25299-21/usr/sbin/munin09:26:590
3016997213,31cyclictest6786-21sendmail-msp07:11:310
305099712,26cyclictest24139-21chrt12:06:333
305099712,26cyclictest24139-21chrt12:06:333
3016997155,11cyclictest3001-21cyclictest12:27:080
3016997154,11cyclictest2307-21cpu08:36:470
3016997154,11cyclictest2307-21cpu08:36:470
3016997152,13cyclictest28600-21tune2fs08:17:410
301699714,40cyclictest352-21runrttasks10:58:260
301699713,57cyclictest16631-21ssh10:06:340
301699713,57cyclictest16631-21ssh10:06:340
3016997055,10cyclictest13801-21kworker/u18:0-rpciod11:03:560
301699705,31cyclictest16990-21apt-get10:07:010
3016997052,8cyclictest181rcu_preempt11:21:420
301699704,36cyclictest9961-21uname10:48:100
301699703,38cyclictest16961-21fschecks_time07:41:540
301699703,36cyclictest19983-21ntp_states09:17:020
301699702,38cyclictest2167-21grep09:41:540
305099693,27cyclictest550-21taskset11:26:433
305099693,27cyclictest550-21taskset11:26:433
301699695,34cyclictest31613-21apt-get10:31:440
301699695,34cyclictest31613-21apt-get10:31:440
3016996953,10cyclictest10085-21diskmemload10:56:330
3016996952,11cyclictest16155-21latency_hist09:11:330
3016996952,10cyclictest5168-21ssh09:46:560
3016996952,10cyclictest5168-21ssh09:46:560
3016996951,12cyclictest17210-21ssh11:53:550
3016996941,10cyclictest181rcu_preempt11:56:420
3016996938,22cyclictest13244-21lockfile-create07:31:320
305099682,27cyclictest26915-21taskset11:16:343
301699685,52cyclictest31787-21apt-config10:31:340
3016996849,11cyclictest277-21dbus-daemon07:41:320
3016996849,11cyclictest277-21dbus-daemon07:41:320
305099672,26cyclictest13648-21chrt11:47:193
301699678,29cyclictest8377-21idleruntime-cro07:16:310
301699675,51cyclictest352-21runrttasks11:15:500
3016996751,10cyclictest58-21kcompactd008:46:530
3016996750,12cyclictest87-21kswapd012:01:410
3016996750,12cyclictest87-21kswapd012:01:410
3016996747,14cyclictest1-21systemd08:16:320
3016996747,14cyclictest1-21systemd08:16:320
301699674,31cyclictest28580-21fschecks_count09:31:540
301699673,42cyclictest8563-21awk09:52:030
301699673,38cyclictest352-21runrttasks09:38:130
301699673,38cyclictest352-21runrttasks09:38:130
158172670,7sleep30-21swapper/310:57:043
305099664,25cyclictest7325-21chrt11:37:053
305099663,45cyclictest0-21swapper/310:48:133
301699665,34cyclictest21297-21idleruntime-cro07:56:310
3016996651,9cyclictest29929-21cpuspeed08:21:480
301699664,46cyclictest10233-21/usr/sbin/munin07:22:040
301699664,37cyclictest590-21latency_hist12:21:330
3016996639,19cyclictest30515-21kworker/u17:1+nfsiod10:00:150
301699653,46cyclictest9556-21timerwakeupswit08:57:080
301699653,46cyclictest9556-21timerwakeupswit08:57:080
3016996526,13cyclictest0-21swapper/008:42:070
3016996526,13cyclictest0-21swapper/008:42:070
3016996445,14cyclictest0-21swapper/008:51:550
3016996425,28cyclictest3329-21/usr/sbin/munin07:02:410
305099632,28cyclictest14889-21chrt09:08:183
301699635,31cyclictest352-21runrttasks11:18:000
301699635,31cyclictest352-21runrttasks11:18:000
3016996349,8cyclictest0-21swapper/008:36:340
305099624,25cyclictest18480-21chrt11:01:543
3016996245,9cyclictest0-21swapper/007:16:540
301699614,40cyclictest23150-21/usr/sbin/munin08:01:590
3016996120,30cyclictest359-21munin-run08:31:310
301699603,49cyclictest25555-21timerandwakeup08:07:060
301699602,31cyclictest13594-21cstates07:31:490
301699602,31cyclictest13594-21cstates07:31:490
305099593,24cyclictest4577-21chrt08:42:053
305099593,24cyclictest4577-21chrt08:42:053
305099593,23cyclictest0-21swapper/308:17:023
305099532,34cyclictest26207-21chrt10:21:523
305099513,34cyclictest32622-21taskset12:20:193
305099512,35cyclictest10744-21taskset11:42:323
305099512,32cyclictest16413-21taskset10:06:273
305099512,32cyclictest16413-21taskset10:06:273
305099512,30cyclictest6821-21chrt12:31:343
305099502,34cyclictest23492-21taskset09:22:163
305099502,30cyclictest10834-21chrt09:56:463
305099493,32cyclictest21679-21chrt11:07:013
305099493,30cyclictest8610-21taskset09:52:043
305099483,32cyclictest16576-21chrt11:52:103
305099483,30cyclictest23006-21chrt10:16:453
305099482,32cyclictest32195-21taskset10:31:463
305099482,32cyclictest32195-21taskset10:31:463
305099482,31cyclictest27055-21taskset11:16:423
305099482,31cyclictest27055-21taskset11:16:423
305099482,31cyclictest25785-21taskset12:07:553
305099482,29cyclictest1333-21taskset08:32:043
305099473,32cyclictest29279-21taskset10:26:553
305099473,30cyclictest31516-21taskset09:36:523
305099473,30cyclictest31516-21taskset09:36:523
305099473,29cyclictest19516-21chrt09:16:493
305099472,30cyclictest30460-21taskset11:21:573
305099463,30cyclictest22867-21taskset08:01:143
305099463,30cyclictest1842-21chrt09:41:423
305099463,30cyclictest14832-21chrt07:36:313
305099463,30cyclictest14832-21chrt07:36:313
305099463,30cyclictest10912-21taskset07:22:063
305099463,29cyclictest4093-21taskset11:31:583
305099463,26cyclictest10853-21chrt09:01:573
305099462,31cyclictest25507-21taskset09:26:503
305099462,31cyclictest25507-21taskset09:26:503
305099462,30cyclictest6804-21taskset07:11:333
305099462,29cyclictest6705-21taskset08:50:113
305099453,30cyclictest2265-21taskset08:36:463
305099453,30cyclictest2265-21taskset08:36:463
305099453,29cyclictest5026-21chrt09:46:533
305099453,29cyclictest5026-21chrt09:46:533
305099453,29cyclictest24980-21taskset08:06:533
305099453,29cyclictest19952-21taskset07:51:423
305099452,30cyclictest18662-21taskset11:56:523
3050994512,22cyclictest13286-21chrt10:52:183
305099444,27cyclictest27431-21taskset12:11:443
305099444,27cyclictest27431-21taskset12:11:443
305099443,28cyclictest10019-21taskset07:21:333
305099442,29cyclictest401-21taskset08:31:323
305099433,28cyclictest23177-21chrt08:01:473
305099433,27cyclictest8736-21chrt08:56:473
305099433,27cyclictest8736-21chrt08:56:473
305099433,27cyclictest18841-21taskset07:47:013
305099433,26cyclictest7486-21taskset07:11:573
305099432,28cyclictest27006-21taskset08:12:043
305099432,28cyclictest27006-21taskset08:12:043
305099432,28cyclictest2633-21taskset12:23:523
305099432,28cyclictest2633-21taskset12:23:523
305099432,28cyclictest16918-21taskset09:11:593
305099432,28cyclictest16918-21taskset09:11:593
305099423,29cyclictest18083-21taskset07:46:323
305099423,27cyclictest3352-21taskset07:01:443
305099423,27cyclictest29881-21chrt08:21:483
305099422,28cyclictest15261-21taskset07:36:523
305099422,28cyclictest15261-21taskset07:36:523
305099422,28cyclictest12490-21chrt07:27:043
305099422,27cyclictest20034-21taskset10:11:473
305099422,27cyclictest20034-21taskset10:11:473
305099412,27cyclictest7119-21chrt08:51:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional