You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 01:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri Jan 02, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
703523828,0sleep30-21swapper/319:09:043
706523324,0sleep10-21swapper/119:09:261
703723127,0sleep00-21swapper/019:09:050
718322824,0sleep20-21swapper/219:10:472
73469980,0cyclictest0-21swapper/222:10:492
73469973,0cyclictest3524-21snmpd20:55:542
73469973,0cyclictest3524-21snmpd19:21:092
73469973,0cyclictest21666-21grep22:22:022
73469972,0cyclictest11234-21awk22:37:002
73469971,0cyclictest4083-21crond21:01:412
73469970,0cyclictest0-21swapper/223:15:452
73469970,0cyclictest0-21swapper/223:03:572
73469965,0cyclictest12826-21cut20:21:582
73469965,0cyclictest0-21swapper/200:02:352
73469962,0cyclictest9420-21munin-node00:07:002
73469962,0cyclictest8635-21awk19:11:572
73469962,0cyclictest5742-21uname20:17:002
73469962,0cyclictest379-21wc20:36:412
73469962,0cyclictest3524-21snmpd20:48:242
73469962,0cyclictest29165-21awk22:46:582
73469962,0cyclictest11495-21kthreadcore22:17:012
73469961,0cyclictest5722-21munin-node22:51:592
73469960,0cyclictest9065-21kthreadcore21:02:042
73469960,0cyclictest8095-21ssh22:32:292
73469960,0cyclictest688-21cut22:12:002
73469960,0cyclictest32699-21grep23:07:012
73469960,0cyclictest32591-21grep23:42:002
73469960,0cyclictest30143-21sensors23:57:082
73469960,0cyclictest28174-21fschecks_count21:16:542
73469960,0cyclictest27753-21grep19:47:012
73469960,0cyclictest27669-21gltestperf21:51:562
73469960,0cyclictest26121-21ssh00:14:362
73469960,0cyclictest26017-21ssh21:13:562
73469960,0cyclictest25983-21munin-node23:21:562
73469960,0cyclictest25566-21ssh21:49:382
73469960,0cyclictest25387-21chrt20:29:402
73469960,0cyclictest22976-21if_eth1.300:32:002
73469960,0cyclictest22723-21cat21:31:412
73469960,0cyclictest20757-21missed_timers20:02:012
73469960,0cyclictest20430-21munin-node23:36:582
73469960,0cyclictest19163-21aten_r1power_fr22:41:542
73469960,0cyclictest17709-21kthreadcore22:02:012
73469960,0cyclictest17034-21munin-node23:16:562
73469960,0cyclictest1557-21ps19:51:592
73469960,0cyclictest15260-21ssh23:51:542
73469960,0cyclictest14334-21fschecks_count21:26:562
73469960,0cyclictest12441-21perl23:31:562
73469960,0cyclictest11233-21crond23:31:422
73469960,0cyclictest0-21swapper/221:22:532
73469960,0cyclictest0-21swapper/200:22:042
73459966,0cyclictest0-21swapper/123:36:571
4160,0ktimersoftd/011561-21ssh22:52:310
339960,0migration/38077-21sh22:32:273
339960,0migration/326961-21gltestperf23:21:573
339960,0migration/326158-21sh21:14:133
339960,0migration/325988-21sh22:42:283
29815060,0irq/29-eth0-tx-7556-21munin-node19:12:080
29815060,0irq/29-eth0-tx-3945-21munin-node19:31:570
29815060,0irq/29-eth0-tx-29454-21munin-node20:57:080
29805060,0irq/28-eth0-rx-18233-21forks21:46:563
29805060,0irq/28-eth0-rx-16830-21tr00:27:013
29805060,0irq/28-eth0-rx-10983-21perl22:36:583
149960,0migration/04378-21sh21:21:440
149960,0migration/02158-21sh21:54:540
149960,0migration/021281-21sh00:31:130
149960,0migration/019564-21sh23:35:220
149960,0migration/017397-21smart_nvme0n119:37:060
149960,0migration/017355-21sh21:46:220
8305050,0irq/26-0000:00:213122sleep319:17:353
73469952,0cyclictest5955-21aten_r1power_en23:46:542
73469951,0cyclictest8761-21latency_hist21:41:412
73469951,0cyclictest8100-21cpuspeed_turbos20:41:532
73469950,0cyclictest7760-21aten_r1power_po19:56:542
73469950,0cyclictest536-21aten2.4-expect20:36:562
73469950,0cyclictest4384-21forks19:31:542
73469950,0cyclictest32120-21sh21:36:472
73469950,0cyclictest3133-21grep21:56:422
73469950,0cyclictest29399-21aten_r1power_po20:11:532
73469950,0cyclictest29071-21chrt19:26:472
73469950,0cyclictest27536-21sort00:16:552
73469950,0cyclictest27536-21sort00:16:552
73469950,0cyclictest24627-21cut22:26:542
73469950,0cyclictest22216-21aten2.4-expect20:06:532
73469950,0cyclictest21861-21latency_hist19:21:412
73469950,0cyclictest18440-21aten2.4-expect19:41:522
73469950,0cyclictest14023-21sed22:56:562
73469950,0cyclictest12922-21aten_r1power_en00:26:542
73469950,0cyclictest11571-21chrt21:06:512
73469950,0cyclictest11134-21latency_hist19:36:412
73469950,0cyclictest0-21swapper/200:36:512
73459955,0cyclictest18535-21diskmemload00:00:071
73459955,0cyclictest0-21swapper/123:55:141
73459955,0cyclictest0-21swapper/122:28:501
73459950,0cyclictest0-21swapper/123:00:511
73449950,0cyclictest0-21swapper/023:31:270
73449950,0cyclictest0-21swapper/000:37:500
6401250,0sleep06563-21ls22:16:420
4150,0ktimersoftd/00-21swapper/023:03:570
4150,0ktimersoftd/00-21swapper/022:24:540
339950,0migration/37676-21kthreadcore23:47:003
339950,0migration/35576-21switchtime23:07:113
339950,0migration/32968-21kthreadcore00:02:033
339950,0migration/328806-21taskset20:08:443
339950,0migration/326709-21kthreadcore23:02:003
339950,0migration/324293-21kthreadcore19:21:583
339950,0migration/323416-21munin-node23:17:083
339950,0migration/32325-21kthreadcore20:37:033
339950,0migration/321482-21munin-node23:36:583
339950,0migration/31521-21kthreadcore20:12:003
339950,0migration/314847-21latency_hist20:01:413
339950,0migration/313711-21aten_r1power_cu21:26:543
339950,0migration/313588-21kthreadcore20:42:013
339950,0migration/31130-21fschecks_time19:51:563
339950,0migration/311259-21taskset21:22:153
339950,0migration/311125-21taskset21:04:173
339950,0migration/310961-21kthreadcore19:12:003
339950,0migration/310863-21munin-node00:07:003
339950,0migration/310133-21munin-node20:17:033
329950,0watchdog/3880-21cut20:57:003
329950,0watchdog/34905-21kthreadcore21:57:013
329950,0watchdog/331626-21grep21:52:013
329950,0watchdog/30-21swapper/323:27:053
29815050,0irq/29-eth0-tx-7880-21munin-node20:41:580
29815050,0irq/29-eth0-tx-7662-21munin-node19:56:570
29815050,0irq/29-eth0-tx-0-21swapper/021:11:470
29815050,0irq/29-eth0-tx-0-21swapper/020:13:280
29805050,0irq/28-eth0-rx-9842-21kthreadcore19:57:003
29805050,0irq/28-eth0-rx-29994-21awk23:57:073
29805050,0irq/28-eth0-rx-28045-21taskset22:46:523
29805050,0irq/28-eth0-rx-28020-21diskstats21:16:533
29805050,0irq/28-eth0-rx-26674-21kthreadcore20:52:003
29805050,0irq/28-eth0-rx-24347-21cut00:32:023
29805050,0irq/28-eth0-rx-23715-21kthreadcore19:41:593
29805050,0irq/28-eth0-rx-23579-21perl21:31:553
29805050,0irq/28-eth0-rx-1922-21kthreadcore00:37:033
29805050,0irq/28-eth0-rx-17364-21cat22:22:003
29805050,0irq/28-eth0-rx-1506-21unixbench_multi00:17:093
29805050,0irq/28-eth0-rx-1506-21unixbench_multi00:17:093
29805050,0irq/28-eth0-rx-0-21swapper/323:52:033
29805050,0irq/28-eth0-rx-0-21swapper/323:33:363
29805050,0irq/28-eth0-rx-0-21swapper/323:01:293
29805050,0irq/28-eth0-rx-0-21swapper/322:52:003
29805050,0irq/28-eth0-rx-0-21swapper/322:18:433
29805050,0irq/28-eth0-rx-0-21swapper/322:13:303
29805050,0irq/28-eth0-rx-0-21swapper/322:07:043
29805050,0irq/28-eth0-rx-0-21swapper/321:37:023
29805050,0irq/28-eth0-rx-0-21swapper/319:47:013
29805050,0irq/28-eth0-rx-0-21swapper/300:26:173
29805050,0irq/28-eth0-rx-0-21swapper/300:11:463
19150,0ktimersoftd/10-21swapper/122:24:541
179950,0migration/19943-21sh23:28:371
179950,0migration/17101-21kthreadcore22:52:021
179950,0migration/1426-21pmu-power21:52:041
179950,0migration/13617-21unixbench_singl23:42:091
179950,0migration/130193-21fschecks_time20:11:551
179950,0migration/129537-21irqrtprio22:47:001
179950,0migration/127509-21sh22:46:071
179950,0migration/124060-21sh21:31:581
179950,0migration/118969-21ntp_kernel_pll_00:27:031
179950,0migration/115495-21unixbench_multi21:42:091
179950,0migration/111369-21kthreadcore00:07:011
149950,0migration/08781-21kthreadcore21:02:040
149950,0migration/07007-21kthreadcore00:22:020
149950,0migration/04979-21kthreadcore19:52:010
149950,0migration/04900-21kthreadcore20:37:040
149950,0migration/032759-21kthreadcore22:12:000
149950,0migration/031654-21proc_pri19:47:050
149950,0migration/030715-21kthreadcore21:17:000
149950,0migration/028515-21taskset22:08:370
149950,0migration/027974-21fschecks_time00:16:560
149950,0migration/027974-21fschecks_time00:16:560
149950,0migration/027666-21kthreadcore22:27:010
149950,0migration/025634-21sh00:13:270
149950,0migration/02491-21kthreadcore23:07:030
149950,0migration/023810-21kthreadcore19:41:590
149950,0migration/022859-21kthreadcore22:42:000
149950,0migration/021417-21munin-node23:36:570
149950,0migration/019546-21kthreadcore21:47:010
149950,0migration/018254-21runrttasks23:17:000
149950,0migration/017476-21kthreadcore23:52:000
149950,0migration/014795-21kthreadcore20:21:590
149950,0migration/012476-21gltestperf21:06:570
149950,0migration/011918-21missed_timers23:47:020
8305040,0irq/26-0000:00:0-21swapper/319:27:023
73459944,0cyclictest0-21swapper/121:29:241
73459944,0cyclictest0-21swapper/120:57:051
73459944,0cyclictest0-21swapper/120:51:431
73459943,0cyclictest7551-21sort22:16:571
73459943,0cyclictest3524-21snmpd21:47:101
73459943,0cyclictest3524-21snmpd21:13:241
73459943,0cyclictest3524-21snmpd21:08:541
73459943,0cyclictest3524-21snmpd21:03:241
73459943,0cyclictest3524-21snmpd20:10:541
73459943,0cyclictest28428-21awk00:16:581
73459943,0cyclictest28428-21awk00:16:581
73459943,0cyclictest27045-21awk23:21:581
73459943,0cyclictest26958-21awk20:32:011
73449944,0cyclictest0-21swapper/023:43:450
73449944,0cyclictest0-21swapper/022:41:000
73449944,0cyclictest0-21swapper/021:28:570
73449944,0cyclictest0-21swapper/000:00:560
73449943,0cyclictest984-21awk21:37:000
73449943,0cyclictest29266-21awk22:46:590
73449943,0cyclictest27167-21awk23:21:590
73449943,0cyclictest24029-21awk21:31:570
73449943,0cyclictest22967-21awk19:21:560
73449943,0cyclictest2178-21awk22:31:590
73449943,0cyclictest19077-21cut20:26:580
73449943,0cyclictest18079-21sadc00:11:420
73449943,0cyclictest1408-21awk00:02:010
73449943,0cyclictest13492-21awk22:01:590
339940,0migration/325312-21taskset20:28:473
339940,0migration/316542-21kthreadcore19:37:013
329940,0watchdog/36314-21runrttasks20:22:163
329940,0watchdog/316006-21kthreadcore22:02:013
329940,0watchdog/313718-21cut21:07:003
329940,0watchdog/30-21swapper/322:27:013
329940,0watchdog/30-21swapper/321:41:573
329940,0watchdog/30-21swapper/320:46:563
29815040,0irq/29-eth0-tx-3534-21sshd20:48:200
29815040,0irq/29-eth0-tx-0-21swapper/020:52:070
29805040,0irq/28-eth0-rx-0-21swapper/323:41:583
29805040,0irq/28-eth0-rx-0-21swapper/323:11:503
179940,0migration/16635-21kthreadcore19:31:581
179940,0migration/13933-21kthreadcore20:37:041
179940,0migration/13086-21kthreadcore21:37:021
179940,0migration/130443-21kthreadcore19:47:011
179940,0migration/130049-21munin-node19:26:561
179940,0migration/128397-21latency23:02:011
179940,0migration/128338-21runrttasks22:08:121
179940,0migration/124038-21kthreadcore19:21:581
179940,0migration/12087-21kthreadcore00:37:031
179940,0migration/117006-21taskset23:16:501
179940,0migration/113714-21kthreadcore22:37:031
179940,0migration/110826-21kthreadcore19:57:001
179940,0migration/110722-21munin-node20:17:091
169940,0watchdog/125736-21ssh00:13:411
169940,0watchdog/121759-21ssh00:31:491
169940,0watchdog/12103-21kthreadcore22:12:011
169940,0watchdog/118006-21taskset20:22:161
169940,0watchdog/116005-21kthreadcore22:02:011
169940,0watchdog/111799-21kthreadcore19:12:001
169940,0watchdog/10-21swapper/123:47:011
169940,0watchdog/10-21swapper/122:01:291
169940,0watchdog/10-21swapper/121:17:081
169940,0watchdog/10-21swapper/119:51:561
169940,0watchdog/10-21swapper/100:02:011
149940,0migration/030691-21kthreadcore20:32:040
149940,0migration/030456-21irqcore19:26:580
149940,0migration/017622-21kthreadcore22:57:030
73459932,0cyclictest7880-21munin-node20:41:521
73459932,0cyclictest5642-21awk21:21:571
73459932,0cyclictest3571-21lldpd20:50:101
73459932,0cyclictest3524-21snmpd20:06:361
73459932,0cyclictest3524-21snmpd19:37:241
73459932,0cyclictest3524-21snmpd19:19:091
73459932,0cyclictest12713-21awk23:31:591
73459932,0cyclictest10293-21sensors00:22:081
73459930,0cyclictest1823-21tune2fs22:31:571
73449933,0cyclictest10403-21kworker/0:220:16:500
73449933,0cyclictest10403-21kworker/0:220:06:460
73449933,0cyclictest10403-21kworker/0:220:01:480
73449932,0cyclictest3524-21snmpd21:56:550
73449932,0cyclictest0-21swapper/000:31:570
73449931,0cyclictest11877-21tr23:12:010
329930,0watchdog/30-21swapper/320:32:043
29815030,0irq/29-eth0-tx-14879-21aten2.4-expect19:16:520
29805030,0irq/28-eth0-rx-0-21swapper/319:31:523
169930,0watchdog/10-21swapper/123:11:491
169930,0watchdog/10-21swapper/123:06:451
169930,0watchdog/10-21swapper/120:27:001
73459921,0cyclictest18363-21latency_hist19:41:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional