You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 10:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat May 02, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2323723928,0sleep20-21swapper/219:20:152
2300323525,0sleep10-21swapper/119:17:341
2330223430,0sleep30-21swapper/319:21:043
2302023228,0sleep00-21swapper/019:17:450
8305060,0irq/26-0000:00:3206-17auditd22:01:382
35160,0ktimersoftd/30-21swapper/322:40:173
339960,0migration/39493-21latency_hist20:41:383
339960,0migration/38956-21sh22:19:293
339960,0migration/37920-21kthreadcore20:16:553
339960,0migration/331369-21sh23:11:413
339960,0migration/328693-21munin-node21:16:513
339960,0migration/325358-21fschecks_count23:26:523
29815060,0irq/29-eth0-tx-23847-21munin-node20:06:500
29805060,0irq/28-eth0-rx-29778-21diskstats22:51:513
29805060,0irq/28-eth0-rx-22067-21cut22:46:543
29805060,0irq/28-eth0-rx-11803-21python00:12:013
234289966,0cyclictest0-21swapper/200:27:552
234289960,0cyclictest0-21swapper/221:44:062
234269960,0cyclictest0-21swapper/019:51:480
149960,0migration/030958-21sh23:11:090
149960,0migration/021508-21sh23:03:410
149960,0migration/012224-21unixbench-2d19:31:590
35150,0ktimersoftd/30-21swapper/322:07:203
339950,0migration/34002-21kthreadcore00:46:553
339950,0migration/332008-21fschecks_time20:56:523
339950,0migration/33147-21gltestperf19:51:503
339950,0migration/330268-21sendmail_mailst20:52:053
339950,0migration/329833-21kthreadcore20:31:553
339950,0migration/322348-21kthreadcore20:01:563
339950,0migration/318342-21irqrtprio20:46:533
339950,0migration/317941-21missed_timers23:56:583
339950,0migration/311935-21kthreadcore20:41:553
339950,0migration/311445-21irqrtprio22:21:563
339950,0migration/310379-21gltestperf19:56:593
339950,0migration/310033-21cpu23:36:513
329950,0watchdog/37527-21python23:32:023
329950,0watchdog/3600-21ssh23:46:583
329950,0watchdog/327967-21kthreadcore19:21:573
329950,0watchdog/32205-21kthreadcore00:26:583
329950,0watchdog/30-21swapper/323:06:573
29815050,0irq/29-eth0-tx-30784-21munin-node23:26:582
29815050,0irq/29-eth0-tx-28890-21ls21:36:382
29815050,0irq/29-eth0-tx-13404-21munin-node21:06:510
29815050,0irq/29-eth0-tx-0-21swapper/223:56:002
29815050,0irq/29-eth0-tx-0-21swapper/223:40:572
29815050,0irq/29-eth0-tx-0-21swapper/222:18:312
29815050,0irq/29-eth0-tx-0-21swapper/200:06:062
29815050,0irq/29-eth0-tx-0-21swapper/020:01:530
29815050,0irq/29-eth0-tx-0-21swapper/019:37:340
29805050,0irq/28-eth0-rx-7991-21aten_r1power_fr22:01:493
29805050,0irq/28-eth0-rx-5597-21ssh22:56:483
29805050,0irq/28-eth0-rx-5554-21cat21:41:383
29805050,0irq/28-eth0-rx-4253-21munin-node23:51:533
29805050,0irq/28-eth0-rx-31591-21grep00:06:563
29805050,0irq/28-eth0-rx-29177-21unixbench-2d00:22:043
29805050,0irq/28-eth0-rx-21544-21ps21:31:533
29805050,0irq/28-eth0-rx-20955-21diskstats00:01:503
29805050,0irq/28-eth0-rx-20007-21kthreadcore23:41:553
29805050,0irq/28-eth0-rx-16651-21kthreadcore22:41:553
29805050,0irq/28-eth0-rx-0-21swapper/322:13:373
29805050,0irq/28-eth0-rx-0-21swapper/321:36:513
29805050,0irq/28-eth0-rx-0-21swapper/321:26:553
29805050,0irq/28-eth0-rx-0-21swapper/319:46:533
29805050,0irq/28-eth0-rx-0-21swapper/300:43:453
29805050,0irq/28-eth0-rx-0-21swapper/300:36:503
29805050,0irq/28-eth0-rx-0-21swapper/300:34:433
259950,0migration/29489-21dump-pmu-power23:36:342
259950,0migration/25581-21timerandwakeup23:12:052
259950,0migration/24948-21munin-node20:56:592
259950,0migration/229667-21kthreadcore21:16:552
259950,0migration/226005-21kthreadcore21:51:552
259950,0migration/223338-21sh22:07:242
259950,0migration/221220-21sh21:47:242
259950,0migration/210954-21kthreadcore20:16:562
234289955,0cyclictest0-21swapper/223:57:482
234289955,0cyclictest0-21swapper/222:56:092
234289955,0cyclictest0-21swapper/222:46:142
234289955,0cyclictest0-21swapper/221:36:422
234289955,0cyclictest0-21swapper/221:28:302
234289955,0cyclictest0-21swapper/200:49:122
234289955,0cyclictest0-21swapper/200:09:562
234269955,0cyclictest0-21swapper/023:41:490
234269955,0cyclictest0-21swapper/023:16:450
234269955,0cyclictest0-21swapper/022:58:470
234269955,0cyclictest0-21swapper/022:46:570
234269955,0cyclictest0-21swapper/021:48:470
234269953,0cyclictest9054-21kworker/0:221:57:470
234269953,0cyclictest8901-21kworker/0:122:02:510
234269953,0cyclictest30116-21kworker/0:200:24:140
234269950,0cyclictest30612-21munin-run19:26:370
234269950,0cyclictest0-21swapper/023:38:020
234269950,0cyclictest0-21swapper/022:13:410
234269950,0cyclictest0-21swapper/021:26:330
234269950,0cyclictest0-21swapper/000:44:340
179950,0migration/14002-21kthreadcore19:51:541
179950,0migration/131156-21runrttasks21:56:051
179950,0migration/126162-21kthreadcore21:31:551
179950,0migration/126144-21idleruntime22:11:521
179950,0migration/124980-21cpuspeed_turbos00:41:511
179950,0migration/117043-21kthreadcore22:41:561
179950,0migration/115942-21latency_hist00:36:391
149950,0migration/08836-21sh23:34:430
149950,0migration/07348-21kthreadcore00:11:550
149950,0migration/06549-21kthreadcore20:36:550
149950,0migration/05845-21latency_hist20:16:370
149950,0migration/05320-21munin-node23:12:010
149950,0migration/05172-21munin-run00:11:390
149950,0migration/03587-21munin-node22:36:490
149950,0migration/03433-21timerandwakeup22:52:030
149950,0migration/032634-21irqcore20:56:550
149950,0migration/031026-21kthreadcore20:31:550
149950,0migration/030787-21taskset21:55:030
149950,0migration/02965-21kthreadcore19:26:540
149950,0migration/029372-21kthreadcore22:31:550
149950,0migration/028077-21fschecks_time19:46:500
149950,0migration/025818-21kthreadcore19:41:560
149950,0migration/025185-21cpuspeed_turbos23:26:510
149950,0migration/024978-21kthreadcore00:01:550
149950,0migration/024694-21latency_hist23:26:390
149950,0migration/022736-21proc_pri22:06:590
149950,0migration/021148-21kthreadcore20:46:550
149950,0migration/020586-21munin-node20:26:490
149950,0migration/020558-21kthreadcore22:26:550
149950,0migration/020155-21kthreadcore00:36:560
149950,0migration/015747-21kthreadcore00:17:020
149950,0migration/013081-21taskset21:43:530
149950,0migration/013079-21latency_hist20:21:380
149950,0migration/012683-21kthreadcore00:31:580
149950,0migration/012648-21munin-node21:26:540
149950,0migration/012216-21cpuspeed_turbos23:56:510
149950,0migration/010200-21fschecks_time19:56:590
8305040,0irq/26-0000:00:0-21swapper/219:41:372
339940,0migration/39726-21sh21:23:003
339940,0migration/323576-21fschecks_count21:51:503
339940,0migration/320236-21kthreadcore23:21:553
339940,0migration/319810-21runrttasks19:40:073
339940,0migration/31844-21kthreadcore19:26:543
339940,0migration/317356-21kthreadcore21:06:563
329940,0watchdog/30-21swapper/322:26:493
329940,0watchdog/30-21swapper/320:27:013
29815040,0irq/29-eth0-tx-27861-21fschecks_time23:46:512
29815040,0irq/29-eth0-tx-22620-21ssh00:21:472
29815040,0irq/29-eth0-tx-20720-21ssh22:46:432
29815040,0irq/29-eth0-tx-17511-21ps23:21:542
29815040,0irq/29-eth0-tx-0-21swapper/223:16:412
29815040,0irq/29-eth0-tx-0-21swapper/223:06:522
29815040,0irq/29-eth0-tx-0-21swapper/223:01:542
29815040,0irq/29-eth0-tx-0-21swapper/222:58:032
29815040,0irq/29-eth0-tx-0-21swapper/222:31:552
29815040,0irq/29-eth0-tx-0-21swapper/222:21:462
29815040,0irq/29-eth0-tx-0-21swapper/222:11:452
29815040,0irq/29-eth0-tx-0-21swapper/222:01:522
29815040,0irq/29-eth0-tx-0-21swapper/200:31:582
29815040,0irq/29-eth0-tx-0-21swapper/200:12:102
29815040,0irq/29-eth0-tx-0-21swapper/021:01:480
29805040,0irq/28-eth0-rx-7994-21cut21:01:533
29805040,0irq/28-eth0-rx-0-21swapper/323:17:183
29805040,0irq/28-eth0-rx-0-21swapper/323:01:393
29805040,0irq/28-eth0-rx-0-21swapper/322:32:233
29805040,0irq/28-eth0-rx-0-21swapper/321:56:513
29805040,0irq/28-eth0-rx-0-21swapper/321:46:483
29805040,0irq/28-eth0-rx-0-21swapper/300:18:463
259940,0migration/25923-21kthreadcore21:21:542
259940,0migration/25096-21kthreadcore22:36:552
259940,0migration/2494-21kthreadcore19:46:552
259940,0migration/24196-21kthreadcore20:11:562
259940,0migration/231249-21munin-node19:26:492
259940,0migration/226346-21kthreadcore19:21:562
259940,0migration/222601-21kthreadcore21:11:552
259940,0migration/213716-21kthreadcore19:57:032
249940,0watchdog/230990-21chrt20:56:092
249940,0watchdog/2246282sleep200:41:422
249940,0watchdog/20-21swapper/220:01:492
249940,0watchdog/20-21swapper/219:51:492
234289943,0cyclictest9419-21sadc20:41:382
234289943,0cyclictest83050irq/26-0000:00:20:11:372
234289943,0cyclictest6881-21awk19:31:502
234289943,0cyclictest28651-21awk20:31:532
234289943,0cyclictest21377-21awk20:26:522
234289943,0cyclictest20345-21sadc21:11:382
234289943,0cyclictest19778-21awk22:26:532
234289943,0cyclictest17250-21awk00:36:542
234289943,0cyclictest0-21swapper/223:41:492
234289941,0cyclictest0-21swapper/200:16:562
234279943,0cyclictest6821-21awk21:41:531
234279943,0cyclictest6555-21awk00:11:541
234279943,0cyclictest3571-21lldpd21:17:021
234279943,0cyclictest3571-21lldpd00:17:051
234279943,0cyclictest3524-21snmpd23:42:011
234279943,0cyclictest3524-21snmpd23:00:011
234279943,0cyclictest3524-21snmpd00:24:021
234279943,0cyclictest3524-21snmpd00:07:161
234279943,0cyclictest32359-21awk20:56:541
234279943,0cyclictest32278-21awk00:26:551
234279943,0cyclictest30427-21awk22:51:531
234279943,0cyclictest2415-21awk22:16:531
234279943,0cyclictest2019-21awk00:46:531
234279943,0cyclictest17366-21awk23:21:531
234279943,0cyclictest15303-21awk23:01:521
234279943,0cyclictest14213-21awk20:21:521
234279940,0cyclictest0-21swapper/122:08:231
234269944,0cyclictest8243-21kworker/0:021:20:330
234269944,0cyclictest8243-21kworker/0:021:14:130
234269944,0cyclictest8243-21kworker/0:020:42:570
234269944,0cyclictest0-21swapper/022:17:570
234269944,0cyclictest0-21swapper/021:34:450
234269943,0cyclictest7085-21awk20:16:540
234269942,0cyclictest9054-21kworker/0:221:38:030
234269942,0cyclictest30116-21kworker/0:200:28:380
234269941,0cyclictest8901-21kworker/0:123:51:560
234269941,0cyclictest8901-21kworker/0:123:46:580
179940,0migration/13865-21kthreadcore20:11:561
179940,0migration/131804-21hddtemp_smartct19:26:511
179940,0migration/129703-21kthreadcore22:31:551
179940,0migration/128668-21kthreadcore20:52:021
179940,0migration/126082-21kthreadcore22:46:561
179940,0migration/124749-21kthreadcore20:26:551
179940,0migration/123250-21sshd20:02:331
179940,0migration/121182-21idleruntime19:41:511
179940,0migration/119796-21taskset19:39:561
179940,0migration/116694-21kthreadcore21:26:561
179940,0migration/116398-21kthreadcore21:06:561
179940,0migration/112696-21kthreadcore19:57:031
179940,0migration/11140-21kthreadcore21:56:541
179940,0migration/110559-21runrttasks22:37:581
169940,0watchdog/18151-21munin-node23:16:491
169940,0watchdog/127549-21cpu19:46:491
169940,0watchdog/125880-21ssh23:26:541
169940,0watchdog/116939-21ssh23:38:181
169940,0watchdog/115635-21ssh22:04:531
169940,0watchdog/10-21swapper/123:31:581
169940,0watchdog/10-21swapper/123:11:531
169940,0watchdog/10-21swapper/123:06:571
169940,0watchdog/10-21swapper/122:26:491
169940,0watchdog/10-21swapper/119:21:531
149940,0migration/04681-21kthreadcore00:46:550
149940,0migration/024718-21fschecks_count20:51:570
149940,0migration/018322-21sh22:26:380
329930,0watchdog/30-21swapper/321:14:533
29805030,0irq/28-eth0-rx-0-21swapper/320:21:493
29805030,0irq/28-eth0-rx-0-21swapper/320:11:543
29805030,0irq/28-eth0-rx-0-21swapper/320:06:523
29805030,0irq/28-eth0-rx-0-21swapper/319:41:523
29805030,0irq/28-eth0-rx-0-21swapper/319:31:533
259930,0migration/26869-21fschecks_time21:01:492
249930,0watchdog/20-21swapper/220:41:532
234289932,0cyclictest16984-21munin-node20:46:482
234289932,0cyclictest16200-21tr19:36:542
234289932,0cyclictest14300-21awk20:21:532
234279932,0cyclictest3524-21snmpd23:48:011
234279932,0cyclictest3524-21snmpd20:17:281
234279932,0cyclictest3524-21snmpd20:07:281
234279932,0cyclictest30244-21awk21:36:531
234279932,0cyclictest28597-21awk20:31:531
234279932,0cyclictest26557-21awk21:11:581
234279932,0cyclictest2489-21aten2.4-expect20:36:491
234279932,0cyclictest17953-21awk20:46:521
234269930,0cyclictest12917-21perl22:41:510
179930,0migration/19948-21kthreadcore19:31:521
179930,0migration/116164-21aten_r1power_en00:36:491
169930,0watchdog/115101-21kthreadcore22:21:571
169930,0watchdog/10-21swapper/123:56:541
169930,0watchdog/10-21swapper/123:52:021
169930,0watchdog/10-21swapper/121:46:531
169930,0watchdog/10-21swapper/121:25:291
169930,0watchdog/10-21swapper/121:01:531
169930,0watchdog/10-21swapper/100:02:501
169920,0watchdog/10-21swapper/120:41:411
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional