You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-26 - 01:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Tue May 26, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3218125041,0sleep20-21swapper/219:23:252
3203223624,0sleep00-21swapper/019:21:430
3210123425,0sleep10-21swapper/119:22:281
3187423430,0sleep30-21swapper/319:19:503
29805070,0irq/28-eth0-rx-0-21swapper/300:03:383
35160,0ktimersoftd/30-21swapper/323:05:063
339960,0migration/34021-21sh23:47:213
339960,0migration/326797-21munin-node21:29:033
339960,0migration/323860-21sh23:03:333
339960,0migration/322470-21sh21:46:593
339960,0migration/313976-21fschecks_time22:38:513
322789960,0cyclictest0-21swapper/022:09:050
329960,0watchdog/327505-21awk23:23:523
29805060,0irq/28-eth0-rx-8098-21iostat22:53:543
29805060,0irq/28-eth0-rx-787-21diskstats23:08:493
29805060,0irq/28-eth0-rx-17421-21grep23:53:553
339950,0migration/39689-21fschecks_count23:13:503
339950,0migration/37861-21kthreadcore21:18:553
339950,0migration/332696-21latency_hist20:53:363
339950,0migration/331188-21fschecks_time22:48:493
339950,0migration/328470-21kthreadcore20:03:543
339950,0migration/326661-21kthreadcore00:18:553
339950,0migration/32663-21aten_r1power_fr23:28:493
339950,0migration/323129-21irqcore20:23:533
339950,0migration/322167-21cpuspeed_turbos22:43:493
339950,0migration/320111-21cpuspeed_turbos23:38:503
339950,0migration/319877-21kthreadcore19:58:533
339950,0migration/319819-21cpuspeed_turbos22:23:493
339950,0migration/318775-21taskset21:25:483
339950,0migration/317706-21munin-node22:03:493
339950,0migration/317662-21latency_hist23:18:373
339950,0migration/31699-21kthreadcore19:23:533
339950,0migration/315797-21irqcore19:33:523
339950,0migration/310812-21latency_hist22:18:373
322909950,0cyclictest0-21swapper/221:46:032
322789950,0cyclictest28835-21munin-run21:33:360
329950,0watchdog/328588-21kthreadcore00:38:563
329950,0watchdog/326509-21cut22:08:523
329950,0watchdog/310486-21ssh00:47:363
329950,0watchdog/30-21swapper/320:18:553
29815050,0irq/29-eth0-tx-32227-21munin-node21:53:522
29815050,0irq/29-eth0-tx-31113-21ssh00:03:512
29815050,0irq/29-eth0-tx-29051-21ssh00:00:112
29815050,0irq/29-eth0-tx-20471-21fschecks_count23:38:512
29815050,0irq/29-eth0-tx-0-21swapper/222:28:482
29815050,0irq/29-eth0-tx-0-21swapper/222:15:032
29815050,0irq/29-eth0-tx-0-21swapper/221:48:512
29815050,0irq/29-eth0-tx-0-21swapper/221:26:582
29815050,0irq/29-eth0-tx-0-21swapper/200:37:242
29815050,0irq/29-eth0-tx-0-21swapper/200:37:242
29815050,0irq/29-eth0-tx-0-21swapper/200:28:532
29805050,0irq/28-eth0-rx-9606-21kthreadcore23:48:553
29805050,0irq/28-eth0-rx-5449-21tr00:23:543
29805050,0irq/28-eth0-rx-32172-21taskset21:53:393
29805050,0irq/28-eth0-rx-30814-21ssh21:50:463
29805050,0irq/28-eth0-rx-30143-21ssh21:33:523
29805050,0irq/28-eth0-rx-29694-21tune2fs21:13:503
29805050,0irq/28-eth0-rx-13765-21switchtime20:14:023
29805050,0irq/28-eth0-rx-0-21swapper/323:35:163
29805050,0irq/28-eth0-rx-0-21swapper/322:33:553
29805050,0irq/28-eth0-rx-0-21swapper/322:13:543
29805050,0irq/28-eth0-rx-0-21swapper/321:58:543
29805050,0irq/28-eth0-rx-0-21swapper/321:38:513
29805050,0irq/28-eth0-rx-0-21swapper/300:48:383
29805050,0irq/28-eth0-rx-0-21swapper/300:35:383
29805050,0irq/28-eth0-rx-0-21swapper/300:35:383
29805050,0irq/28-eth0-rx-0-21swapper/300:13:493
29805050,0irq/28-eth0-rx-0-21swapper/300:00:173
27150,0ktimersoftd/20-21swapper/222:35:152
259950,0migration/28542-21missed_timers00:43:562
259950,0migration/27870-21sh00:26:082
259950,0migration/24395-21kthreadcore20:08:542
259950,0migration/23510-21sh23:45:562
259950,0migration/23020-21munin-node23:28:502
259950,0migration/229837-21fschecks_time20:28:512
259950,0migration/226001-21kthreadcore23:03:542
259950,0migration/22423-21kthreadcore21:13:562
259950,0migration/223628-21latency23:18:552
259950,0migration/219756-21kernelversion19:58:532
259950,0migration/213923-21kthreadcore00:48:552
249950,0watchdog/226986-21fschecks_time00:38:522
249950,0watchdog/214329-21tr21:58:562
179950,0migration/18765-21munin-node19:28:541
179950,0migration/16265-21sh00:23:541
179950,0migration/16248-21ntp_kernel_err20:08:561
179950,0migration/15037-21cpuspeed_turbos23:48:491
179950,0migration/1461-21fschecks_count19:23:491
179950,0migration/131231-21kthreadcore21:13:551
179950,0migration/125879-21kthreadcore21:28:561
179950,0migration/120296-21kthreadcore19:58:531
179950,0migration/119832-21cpuspeed_turbos22:23:491
179950,0migration/117147-21sh00:32:571
179950,0migration/112538-21kthreadcore22:18:531
179950,0migration/111160-21latency_hist21:23:361
169950,0watchdog/130226-21kthreadcore20:48:551
149950,0migration/09125-21kthreadcore21:38:560
149950,0migration/06913-21aten_r1power_en00:08:490
149950,0migration/026881-21kthreadcore20:23:550
149950,0migration/025706-21kthreadcore23:38:560
149950,0migration/024981-21munin-node00:18:510
149950,0migration/02398-21missed_timers19:43:550
149950,0migration/018956-21kthreadcore19:33:540
149950,0migration/016903-21kthreadcore23:33:550
149950,0migration/013960-21sh22:55:030
149950,0migration/013743-21df_abs23:53:490
149950,0migration/011690-21kthreadcore23:13:540
149950,0migration/010100-21sh23:31:090
339940,0migration/39113-21sh00:28:493
339940,0migration/3776-21fschecks_count20:08:493
339940,0migration/35204-21irqcore20:33:533
339940,0migration/331248-21kthreadcore22:28:533
339940,0migration/326578-21kthreadcore21:08:553
339940,0migration/322493-21fschecks_time19:38:513
339940,0migration/322493-21fschecks_time19:38:513
339940,0migration/320482-21kthreadcore20:43:543
339940,0migration/317657-21kthreadcore21:03:553
322909944,0cyclictest0-21swapper/222:59:032
322909943,0cyclictest4913-21awk19:48:512
322909943,0cyclictest3571-21lldpd22:04:352
322909943,0cyclictest3524-21snmpd22:48:482
322909943,0cyclictest3524-21snmpd21:11:322
322909943,0cyclictest3524-21snmpd20:51:022
322909943,0cyclictest3524-21snmpd20:43:472
322909943,0cyclictest3524-21snmpd20:39:322
322909943,0cyclictest3524-21snmpd20:33:462
322909943,0cyclictest3524-21snmpd20:24:312
322909943,0cyclictest3524-21snmpd19:34:462
322909943,0cyclictest22742-21awk19:38:532
322909943,0cyclictest22742-21awk19:38:532
322909943,0cyclictest15785-21awk20:18:532
322909943,0cyclictest1539-21awk23:08:522
322909943,0cyclictest1174-21awk19:23:512
322859944,0cyclictest0-21swapper/121:48:581
322859943,0cyclictest5040-21awk20:33:521
322859943,0cyclictest3524-21snmpd23:39:481
322859943,0cyclictest3524-21snmpd23:21:181
322859943,0cyclictest3524-21snmpd22:50:331
322859943,0cyclictest3524-21snmpd22:38:481
322859943,0cyclictest3524-21snmpd22:17:031
322859943,0cyclictest3524-21snmpd21:57:331
322859943,0cyclictest3524-21snmpd20:38:471
322859943,0cyclictest31730-21awk00:03:531
322859943,0cyclictest23085-21awk22:43:531
322859943,0cyclictest23033-21awk20:23:521
322859943,0cyclictest18856-21awk00:33:531
322859943,0cyclictest18856-21awk00:33:531
322859943,0cyclictest1589-21awk23:08:521
322859943,0cyclictest12314-21awk23:33:521
322859943,0cyclictest10319-21awk23:13:531
322859940,0cyclictest0-21swapper/100:23:371
322789943,0cyclictest9686-21awk21:58:520
322789943,0cyclictest3668-21awk00:43:530
322789943,0cyclictest3571-21lldpd21:44:360
322789943,0cyclictest3571-21lldpd21:00:050
322789943,0cyclictest3251-21awk22:13:520
322789943,0cyclictest3250-21irqbalance23:25:330
322789943,0cyclictest3250-21irqbalance22:43:430
322789943,0cyclictest3250-21irqbalance22:33:430
322789943,0cyclictest3250-21irqbalance22:28:430
322789943,0cyclictest3250-21irqbalance22:24:330
322789943,0cyclictest3250-21irqbalance20:13:430
322789943,0cyclictest3250-21irqbalance20:04:230
322789943,0cyclictest3250-21irqbalance20:02:030
322789943,0cyclictest31756-21awk00:03:530
322789943,0cyclictest30146-21awk20:28:530
322789943,0cyclictest27449-21awk00:38:550
322789943,0cyclictest24456-21awk21:48:520
322789943,0cyclictest23890-21sadc23:03:370
322789943,0cyclictest22886-21awk19:38:530
322789943,0cyclictest22886-21awk19:38:530
322789943,0cyclictest18143-21sadc20:43:360
322789943,0cyclictest16529-21awk00:13:530
322789943,0cyclictest1324-21awk00:23:510
322789943,0cyclictest11960-21awk22:18:510
322789941,0cyclictest0-21swapper/021:08:360
322789940,0cyclictest4481-21munin-run23:48:370
322789940,0cyclictest3958-21munin-node20:33:500
329940,0watchdog/33987-21cpu19:48:473
329940,0watchdog/310767-21kthreadcore19:28:553
329940,0watchdog/30-21swapper/320:48:553
329940,0watchdog/30-21swapper/320:28:553
29815040,0irq/29-eth0-tx-9078-21ssh23:13:382
29815040,0irq/29-eth0-tx-30002-21ssh00:18:562
29815040,0irq/29-eth0-tx-25914-21munin-node22:08:542
29815040,0irq/29-eth0-tx-17997-21cut00:13:562
29815040,0irq/29-eth0-tx-14248-21kthreadcore22:18:542
29815040,0irq/29-eth0-tx-0-21swapper/223:53:372
29815040,0irq/29-eth0-tx-0-21swapper/223:48:472
29815040,0irq/29-eth0-tx-0-21swapper/222:44:382
29815040,0irq/29-eth0-tx-0-21swapper/222:38:562
29815040,0irq/29-eth0-tx-0-21swapper/222:24:242
29815040,0irq/29-eth0-tx-0-21swapper/221:40:312
29815040,0irq/29-eth0-tx-0-21swapper/221:33:512
29815040,0irq/29-eth0-tx-0-21swapper/221:29:022
29815040,0irq/29-eth0-tx-0-21swapper/200:08:412
29815040,0irq/29-eth0-tx-0-21swapper/021:23:490
29815040,0irq/29-eth0-tx-0-21swapper/021:13:520
29815040,0irq/29-eth0-tx-0-21swapper/020:08:500
29815040,0irq/29-eth0-tx-0-21swapper/019:48:500
29815040,0irq/29-eth0-tx-0-21swapper/019:28:510
29805040,0irq/28-eth0-rx-0-21swapper/320:39:043
29805040,0irq/28-eth0-rx-0-21swapper/300:08:493
259940,0migration/2516-21kthreadcore19:43:532
259940,0migration/215396-21kthreadcore19:53:532
259940,0migration/212974-21kthreadcore23:33:542
259940,0migration/210886-21kthreadcore22:53:552
249940,0watchdog/227504-21rm23:23:522
249940,0watchdog/215596-21perl21:03:512
249940,0watchdog/210768-21kthreadcore19:28:552
249940,0watchdog/210325-21python21:19:002
249940,0watchdog/20-21swapper/220:13:552
179940,0migration/17084-21runrttasks00:08:501
179940,0migration/15840-21kthreadcore20:53:531
179940,0migration/15809-21kthreadcore19:48:521
179940,0migration/132600-21kthreadcore23:43:541
179940,0migration/132450-21ntp_kernel_pll_23:23:561
179940,0migration/128712-21taskset21:10:251
179940,0migration/12328-21latency19:43:541
179940,0migration/120912-21kthreadcore00:13:571
179940,0migration/118050-21fschecks_time22:03:501
179940,0migration/117110-21kthreadcore23:53:551
179940,0migration/117001-21irqrtprio22:58:541
179940,0migration/114869-21cpu20:18:491
179940,0migration/112650-21kthreadcore19:53:521
179940,0migration/112073-21kthreadcore20:58:551
179940,0migration/111582-21sh22:34:491
179940,0migration/111222-21kthreadcore20:13:551
169940,0watchdog/16129-21sh21:38:521
169940,0watchdog/128589-21kthreadcore00:38:561
169940,0watchdog/128451-21cut22:08:561
169940,0watchdog/125349-21kthreadcore19:38:551
169940,0watchdog/125349-21kthreadcore19:38:551
169940,0watchdog/125284-21if_eth023:03:521
169940,0watchdog/121286-21ssh21:44:121
169940,0watchdog/10-21swapper/123:58:561
169940,0watchdog/10-21swapper/122:30:201
169940,0watchdog/10-21swapper/121:58:561
169940,0watchdog/10-21swapper/121:33:561
169940,0watchdog/10-21swapper/120:28:551
149940,0migration/05295-21kthreadcore21:53:550
149940,0migration/05048-21kthreadcore23:08:540
149940,0migration/05006-21taskset22:49:190
149940,0migration/04817-21fschecks_time21:18:510
149940,0migration/03014-21kthreadcore19:23:530
149940,0migration/02884-21kthreadcore20:53:520
149940,0migration/027967-21needreboot21:08:560
149940,0migration/025463-21kthreadcore23:58:560
149940,0migration/02249-21kthreadcore21:33:560
149940,0migration/018941-21irqcore00:33:540
149940,0migration/018941-21irqcore00:33:540
149940,0migration/016997-21runrttasks00:32:320
149940,0migration/014876-21kthreadcore22:38:540
149940,0migration/014761-21kthreadcore00:48:560
8305030,0irq/26-0000:00:0-21swapper/319:53:373
322909933,0cyclictest1412-21awk20:53:502
322859933,0cyclictest3592-21awk00:43:521
322859932,0cyclictest3571-21lldpd20:08:041
322859932,0cyclictest3524-21snmpd19:34:011
322859932,0cyclictest11340-21munin-node21:24:011
322859930,0cyclictest0-21swapper/123:29:031
322789933,0cyclictest3571-21lldpd19:58:040
322789933,0cyclictest2743-21kworker/0:220:49:100
322789932,0cyclictest3524-21snmpd23:18:530
322789932,0cyclictest3250-21irqbalance20:18:530
322789932,0cyclictest12800-21sh23:52:490
322789931,0cyclictest0-21swapper/023:03:490
322789930,0cyclictest0-21swapper/022:03:570
329930,0watchdog/30-21swapper/320:58:593
29815030,0irq/29-eth0-tx-0-21swapper/020:43:480
29805030,0irq/28-eth0-rx-0-21swapper/319:43:473
259930,0migration/29531-21kthreadcore20:58:542
179930,0migration/122037-21kthreadcore20:43:541
169930,0watchdog/112640-21cut22:53:561
169930,0watchdog/10-21swapper/121:03:511
169930,0watchdog/10-21swapper/100:48:481
322909920,0cyclictest0-21swapper/220:03:372
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional