You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 21:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Fri May 15, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2943024635,0sleep00-21swapper/007:21:580
2948224435,0sleep10-21swapper/107:22:351
2945924030,0sleep30-21swapper/307:22:173
2932523626,0sleep20-21swapper/207:20:442
35170,0ktimersoftd/30-21swapper/310:38:043
4160,0ktimersoftd/00-21swapper/010:38:040
35160,0ktimersoftd/30-21swapper/311:58:103
339960,0migration/39816-21gltestperf09:22:583
339960,0migration/39816-21gltestperf09:22:583
339960,0migration/35221-21sh11:10:163
339960,0migration/34051-21sh10:52:473
339960,0migration/331216-21sh11:25:233
339960,0migration/317744-21mdstat07:33:043
339960,0migration/317697-21sh11:53:393
339960,0migration/31529-21munin-node07:47:583
29815060,0irq/29-eth0-tx-22800-21munin-node08:03:090
29815060,0irq/29-eth0-tx-1311-21munin-node08:33:100
29805060,0irq/28-eth0-rx-32068-21munin-node10:12:573
29805060,0irq/28-eth0-rx-15510-21kthreadcore10:58:033
29805060,0irq/28-eth0-rx-14354-21ntpq10:18:053
29805060,0irq/28-eth0-rx-11324-21kthreadcore09:58:033
295699963,0cyclictest0-21swapper/012:27:450
149960,0migration/05158-21sh11:10:060
149960,0migration/022148-21sh11:19:100
149960,0migration/021918-21kthreadcore08:23:000
149960,0migration/021884-21kthreadcore10:43:020
149960,0migration/012323-21sh10:57:140
8305050,0irq/26-0000:00:22736-21crond08:47:452
8305050,0irq/26-0000:00:19010-21latency_hist07:37:453
8305050,0irq/26-0000:00:18852-21sadc10:42:452
8305050,0irq/26-0000:00:15538-21crond08:42:452
8305050,0irq/26-0000:00:0-21swapper/212:28:022
339950,0migration/37926-21kthreadcore12:08:033
339950,0migration/35397-21munin-node08:57:583
339950,0migration/332561-21munin-node08:28:063
339950,0migration/327608-21gltestperf09:12:593
339950,0migration/327574-21irqcore07:43:023
339950,0migration/325544-21switchtime10:43:093
339950,0migration/325541-21pmu-power09:08:043
339950,0migration/324910-21kthreadcore12:18:033
339950,0migration/323440-21unixbench-2d10:23:123
339950,0migration/323152-21kthreadcore11:03:033
339950,0migration/322178-21kthreadcore08:23:003
339950,0migration/319650-21unixbench-2d12:13:113
339950,0migration/318599-21sh09:27:593
339950,0migration/318348-21kthreadcore12:33:053
339950,0migration/317945-21mdstat09:43:033
339950,0migration/317845-21kthreadcore08:43:013
329950,0watchdog/37620-21python08:33:083
329950,0watchdog/331136-21ssh12:39:163
329950,0watchdog/30-21swapper/311:28:043
29815050,0irq/29-eth0-tx-8867-21munin-node09:23:030
29815050,0irq/29-eth0-tx-8867-21munin-node09:23:030
29815050,0irq/29-eth0-tx-6415-21munin-node11:13:002
29815050,0irq/29-eth0-tx-5977-21munin-node09:58:002
29815050,0irq/29-eth0-tx-30208-21grep09:33:042
29815050,0irq/29-eth0-tx-30029-21munin-node08:08:010
29815050,0irq/29-eth0-tx-25853-21ssh11:42:522
29815050,0irq/29-eth0-tx-1528-21munin-node09:18:130
29815050,0irq/29-eth0-tx-14965-21cut12:13:022
29815050,0irq/29-eth0-tx-12399-21tail09:02:560
29815050,0irq/29-eth0-tx-0-21swapper/211:17:582
29815050,0irq/29-eth0-tx-0-21swapper/210:49:072
29815050,0irq/29-eth0-tx-0-21swapper/210:08:182
29815050,0irq/29-eth0-tx-0-21swapper/008:53:040
29815050,0irq/29-eth0-tx-0-21swapper/008:48:050
29805050,0irq/28-eth0-rx-9620-21taskset11:50:043
29805050,0irq/28-eth0-rx-9437-21diskstats12:47:563
29805050,0irq/28-eth0-rx-5522-21ssh09:57:173
29805050,0irq/28-eth0-rx-31901-21kthreadcore09:33:043
29805050,0irq/28-eth0-rx-29853-21cut10:48:033
29805050,0irq/28-eth0-rx-27247-21irqcore11:43:023
29805050,0irq/28-eth0-rx-18215-21kthreadcore10:03:023
29805050,0irq/28-eth0-rx-16012-21gltestperf11:17:583
29805050,0irq/28-eth0-rx-11516-21taskset08:13:253
29805050,0irq/28-eth0-rx-0-21swapper/312:28:463
29805050,0irq/28-eth0-rx-0-21swapper/312:23:403
29805050,0irq/28-eth0-rx-0-21swapper/311:39:333
29805050,0irq/28-eth0-rx-0-21swapper/311:34:013
29805050,0irq/28-eth0-rx-0-21swapper/310:33:023
29805050,0irq/28-eth0-rx-0-21swapper/310:29:363
29805050,0irq/28-eth0-rx-0-21swapper/310:08:013
295719955,0cyclictest0-21swapper/212:44:392
295719955,0cyclictest0-21swapper/211:23:472
295719955,0cyclictest0-21swapper/208:03:052
295719954,0cyclictest3524-21snmpd09:44:482
295719950,0cyclictest0-21swapper/211:51:412
295719950,0cyclictest0-21swapper/210:42:472
295709955,0cyclictest0-21swapper/112:38:191
295709955,0cyclictest0-21swapper/111:15:041
295709955,0cyclictest0-21swapper/110:41:011
295709950,0cyclictest0-21swapper/110:52:321
295699955,0cyclictest0-21swapper/008:43:060
259950,0migration/29282-21sh10:17:592
259950,0migration/26662-21munin-node08:58:022
259950,0migration/24226-21sh09:53:442
259950,0migration/24018-21latency_hist10:52:452
259950,0migration/23609-21kthreadcore09:18:032
259950,0migration/232647-21taskset07:43:102
259950,0migration/23131-21kthreadcore11:28:042
259950,0migration/230429-21df_abs08:07:572
259950,0migration/230078-21sh11:07:472
259950,0migration/227709-21sh12:02:302
259950,0migration/226117-21latency_hist07:42:452
259950,0migration/225444-21munin-node12:38:012
259950,0migration/221973-21munin-node08:43:062
259950,0migration/219304-21kthreadcore09:28:022
259950,0migration/214587-21latency_hist10:02:442
259950,0migration/214584-21sendmail_mailqu07:53:052
249950,0watchdog/217058-21ssh12:33:042
179950,0migration/1946-21kthreadcore12:23:031
179950,0migration/132329-21munin-node07:43:061
179950,0migration/129806-21munin-run08:07:451
179950,0migration/129153-21kthreadcore09:13:031
179950,0migration/125883-21aten_r1power_cu11:42:561
179950,0migration/118236-21kthreadcore07:58:021
169950,0watchdog/11600-21sed12:43:001
149950,0migration/09453-21fschecks_time08:37:590
149950,0migration/09292-21taskset11:49:090
149950,0migration/08433-21kthreadcore12:08:030
149950,0migration/07723-21kthreadcore09:38:020
149950,0migration/07628-21fschecks_time12:28:000
149950,0migration/07618-21kthreadcore07:28:030
149950,0migration/07091-21munin-node09:58:000
149950,0migration/05120-21aten_r1power_en08:57:560
149950,0migration/03653-21kthreadcore10:33:010
149950,0migration/03641-21munin-node07:23:060
149950,0migration/032508-21taskset10:12:590
149950,0migration/031844-21sh12:41:140
149950,0migration/030035-21taskset12:22:360
149950,0migration/028308-21kthreadcore11:23:020
149950,0migration/025741-21latency_hist11:42:450
149950,0migration/02545-21sh12:03:310
149950,0migration/024068-21kthreadcore11:58:040
149950,0migration/023223-21sh10:23:090
149950,0migration/022241-21runrttasks09:28:030
149950,0migration/021582-21sh10:03:500
149950,0migration/02004-21kthreadcore11:28:040
149950,0migration/019279-21taskset09:44:330
149950,0migration/016415-21kthreadcore12:13:030
149950,0migration/011184-21kthreadcore11:33:020
8305040,0irq/26-0000:00:0-21swapper/307:22:443
8305040,0irq/26-0000:00:0-21swapper/208:12:452
339940,0migration/37770-21kthreadcore07:28:033
339940,0migration/322772-21latency_hist08:02:453
339940,0migration/312133-21runrttasks08:17:473
339940,0migration/310623-21kthreadcore08:38:023
329940,0watchdog/3298050irq/28-eth0-rx-12:05:403
329940,0watchdog/3298050irq/28-eth0-rx-09:02:563
329940,0watchdog/30-21swapper/311:13:003
329940,0watchdog/30-21swapper/309:38:123
329940,0watchdog/30-21swapper/309:18:043
329940,0watchdog/30-21swapper/307:57:153
29815040,0irq/29-eth0-tx-6247-21cut09:38:012
29815040,0irq/29-eth0-tx-28039-21ssh12:02:482
29815040,0irq/29-eth0-tx-27877-21ssh09:48:462
29815040,0irq/29-eth0-tx-20155-21ssh10:59:582
29815040,0irq/29-eth0-tx-17274-21munin-node11:38:022
29815040,0irq/29-eth0-tx-0-21swapper/211:52:522
29815040,0irq/29-eth0-tx-0-21swapper/211:35:212
29815040,0irq/29-eth0-tx-0-21swapper/210:32:552
29815040,0irq/29-eth0-tx-0-21swapper/210:29:072
29815040,0irq/29-eth0-tx-0-21swapper/210:22:562
29805040,0irq/28-eth0-rx-0-21swapper/312:42:583
29805040,0irq/28-eth0-rx-0-21swapper/309:48:013
29805040,0irq/28-eth0-rx-0-21swapper/307:57:563
295719943,0cyclictest3571-21lldpd08:52:502
295719943,0cyclictest3571-21lldpd08:34:502
295719943,0cyclictest3524-21snmpd12:22:492
295719943,0cyclictest3524-21snmpd09:23:472
295719943,0cyclictest3524-21snmpd09:23:472
295719943,0cyclictest3524-21snmpd09:03:172
295719943,0cyclictest3524-21snmpd08:27:472
295719943,0cyclictest3524-21snmpd07:47:472
295719943,0cyclictest22528-21awk11:03:002
295719943,0cyclictest16665-21awk07:58:002
295719943,0cyclictest12969-21awk07:33:002
295709943,0cyclictest5995-21awk08:12:591
295709943,0cyclictest3571-21lldpd11:19:231
295709943,0cyclictest3571-21lldpd11:09:231
295709943,0cyclictest3571-21lldpd10:34:221
295709943,0cyclictest3571-21lldpd10:12:521
295709943,0cyclictest3571-21lldpd09:42:511
295709943,0cyclictest3571-21lldpd08:48:211
295709943,0cyclictest3571-21lldpd08:45:501
295709943,0cyclictest3571-21lldpd08:21:201
295709943,0cyclictest3571-21lldpd07:47:501
295709943,0cyclictest3524-21snmpd09:12:171
295709943,0cyclictest3524-21snmpd08:42:171
295709943,0cyclictest3250-21irqbalance11:58:221
295709943,0cyclictest3250-21irqbalance10:03:211
295709943,0cyclictest26624-21awk10:28:001
295709943,0cyclictest2505-21awk08:33:011
295709943,0cyclictest24374-21awk10:08:001
295699943,0cyclictest9453-21awk07:52:590
295699943,0cyclictest3524-21snmpd07:48:020
295699943,0cyclictest27608-21awk09:33:010
295699943,0cyclictest16635-21awk07:58:000
295699943,0cyclictest1430-21awk12:43:000
295699943,0cyclictest13277-21awk08:18:000
295699941,0cyclictest0-21swapper/008:12:560
259940,0migration/26157-21timerwakeupswit10:13:112
259940,0migration/26064-21kthreadcore12:08:032
259940,0migration/23725-21switchtime07:23:092
259940,0migration/228358-21kthreadcore09:13:032
259940,0migration/226435-21kthreadcore12:18:042
259940,0migration/219047-21runrttasks08:22:052
249940,0watchdog/25521-21perl07:27:592
249940,0watchdog/221908-21kthreadcore08:23:002
249940,0watchdog/220787-21irqcore09:08:002
249940,0watchdog/20-21swapper/212:47:562
179940,0migration/19561-21fschecks_time09:22:571
179940,0migration/19561-21fschecks_time09:22:571
179940,0migration/19136-21aten_r1power_po12:47:551
179940,0migration/18987-21kthreadcore09:58:021
179940,0migration/15956-21kthreadcore10:53:031
179940,0migration/15677-21kthreadcore09:18:041
179940,0migration/14137-21taskset07:24:161
179940,0migration/127985-21latency_hist12:02:451
179940,0migration/126012-21kthreadcore12:18:041
179940,0migration/124877-21if_eth1.211:23:001
179940,0migration/122989-21munin-node10:23:061
179940,0migration/122580-21sh12:34:331
179940,0migration/121053-21aten_r1power_vo09:47:571
179940,0migration/118123-21fschecks_time11:38:001
179940,0migration/116578-21kthreadcore07:33:031
179940,0migration/115296-21unixbench_singl11:33:101
179940,0migration/114003-21kthreadcore11:53:031
179940,0migration/112076-21latency_hist09:02:451
179940,0migration/111670-21sh12:09:351
179940,0migration/111439-21taskset07:29:531
169940,0watchdog/13804-21kthreadcore11:28:041
169940,0watchdog/125478-21python10:43:081
169940,0watchdog/123510-21latency09:28:041
169940,0watchdog/121907-21kthreadcore08:23:001
169940,0watchdog/10-21swapper/111:50:161
169940,0watchdog/10-21swapper/109:33:041
149940,0migration/07571-21if_eth111:13:000
149940,0migration/027631-21users09:48:110
149940,0migration/017383-21aten_r1power_po11:37:580
149940,0migration/012860-21kthreadcore11:53:030
329930,0watchdog/30-21swapper/308:52:563
329930,0watchdog/30-21swapper/308:47:563
329930,0watchdog/30-21swapper/308:07:563
295709933,0cyclictest3571-21lldpd09:04:511
295709933,0cyclictest3571-21lldpd07:39:201
295709932,0cyclictest8418-21grep09:38:021
295709932,0cyclictest3571-21lldpd11:04:531
295709932,0cyclictest31330-21awk08:53:001
295709932,0cyclictest31163-21awk08:08:001
295709932,0cyclictest15134-21kthreadcore10:58:031
295709931,0cyclictest13849-21kthreadcore10:18:021
295709930,0cyclictest26962-21diskstats08:27:581
295699933,0cyclictest0-21swapper/012:49:120
295699932,0cyclictest3571-21lldpd11:06:530
295699932,0cyclictest3571-21lldpd11:02:230
295699932,0cyclictest3524-21snmpd10:20:060
295699932,0cyclictest29800-21tail09:52:560
295699932,0cyclictest27589-21awk08:28:000
295699932,0cyclictest26710-21basename09:12:560
295699932,0cyclictest24328-21awk10:08:000
295699932,0cyclictest20556-21awk09:07:590
295699932,0cyclictest15587-21cut07:33:030
295699930,0cyclictest26349-21perl10:27:580
295699930,0cyclictest0-21swapper/007:43:080
295699930,0cyclictest0-21swapper/007:38:040
179930,0migration/113118-21aten_r1power_cu12:12:561
169930,0watchdog/18616-21diskmemload09:53:241
169930,0watchdog/10-21swapper/112:28:041
169930,0watchdog/10-21swapper/107:52:591
295699921,0cyclictest6314-21runrttasks10:47:520
295699920,0cyclictest0-21swapper/012:32:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional