You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 04:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Tue Jun 09, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1177326766,0sleep10-21swapper/119:24:141
1169224434,0sleep30-21swapper/319:23:203
1165123924,0sleep00-21swapper/019:22:490
1174122723,0sleep20-21swapper/219:23:512
339960,0migration/39849-21sh22:49:573
339960,0migration/36167-21sh23:42:003
339960,0migration/324333-21sh23:54:353
339960,0migration/323328-21sh22:19:583
339960,0migration/312076-21sh23:25:313
339960,0migration/31041-21sh23:00:173
329960,0watchdog/36917-21tr19:40:043
29805060,0irq/28-eth0-rx-9997-21iostat_ios21:35:013
29805060,0irq/28-eth0-rx-6314-21runrttasks23:06:483
29805060,0irq/28-eth0-rx-20036-21sendmail_mailqu22:15:073
29805060,0irq/28-eth0-rx-19649-21ssh00:28:163
29805060,0irq/28-eth0-rx-15917-21cut20:10:033
179960,0migration/19726-21sh23:05:151
149960,0migration/019990-21sh23:14:440
339950,0migration/3798-21switchtime21:05:103
339950,0migration/37494-21timerandwakeup00:00:113
339950,0migration/327786-21irqcore21:45:023
339950,0migration/326855-21munin-node20:19:593
339950,0migration/325200-21runrttasks21:42:273
339950,0migration/323382-21kthreadcore19:30:033
339950,0migration/322608-21kthreadcore22:00:033
339950,0migration/31958-21kthreadcore22:25:023
339950,0migration/319309-21kthreadcore19:50:033
339950,0migration/318684-21kthreadcore21:20:033
339950,0migration/318341-21munin-node21:55:123
339950,0migration/31825-21aten_r1power_en21:09:563
339950,0migration/315904-21aten_r1power_en22:34:583
339950,0migration/314695-21fschecks_time00:44:593
339950,0migration/311584-21kthreadcore23:45:033
339950,0migration/311022-21munin-node20:05:033
339950,0migration/310042-21kthreadcore20:50:043
329950,0watchdog/36348-21irqcore22:10:003
329950,0watchdog/33650-21tune2fs00:20:013
329950,0watchdog/3298050irq/28-eth0-rx-22:30:013
329950,0watchdog/315154-21python20:30:083
329950,0watchdog/314599-21fschecks_time23:29:573
29815050,0irq/29-eth0-tx-24692-21munin-node23:54:582
29815050,0irq/29-eth0-tx-0-21swapper/222:35:082
29815050,0irq/29-eth0-tx-0-21swapper/200:27:322
29805050,0irq/28-eth0-rx-9053-21sed21:14:463
29805050,0irq/28-eth0-rx-4886-21cut22:45:033
29805050,0irq/28-eth0-rx-4527-40yum-updatesd-he23:23:403
29805050,0irq/28-eth0-rx-30808-21sensors22:40:063
29805050,0irq/28-eth0-rx-2836-21awk21:49:463
29805050,0irq/28-eth0-rx-27679-21grep21:25:033
29805050,0irq/28-eth0-rx-22728-21ssh00:49:583
29805050,0irq/28-eth0-rx-21893-21kthreadcore23:15:033
29805050,0irq/28-eth0-rx-18272sleep300:17:043
29805050,0irq/28-eth0-rx-0-21swapper/322:54:593
29805050,0irq/28-eth0-rx-0-21swapper/322:08:293
29805050,0irq/28-eth0-rx-0-21swapper/321:30:303
29805050,0irq/28-eth0-rx-0-21swapper/300:37:143
249950,0watchdog/211511-21sh22:10:082
249950,0watchdog/210478-21kthreadcore22:30:012
19150,0ktimersoftd/10-21swapper/123:36:271
179950,0migration/122367-21kthreadcore00:30:041
179950,0migration/119168-21sh00:26:561
179950,0migration/117336-21kthreadcore00:45:031
179950,0migration/111327-21munin-node22:10:051
169950,0watchdog/19748-21awk00:04:571
169950,0watchdog/16362-21grep20:25:041
149950,0migration/09216-21latency_hist22:49:450
149950,0migration/0855-21sh23:59:530
149950,0migration/07023-21kthreadcore23:05:020
149950,0migration/031158-21munin-node23:39:570
149950,0migration/030509-21cpuspeed_turbos19:59:590
149950,0migration/028229-21kthreadcore23:35:040
149950,0migration/027637-21gltestperf22:59:590
149950,0migration/025290-21fschecks_count23:54:590
149950,0migration/02442-21kthreadcore00:35:040
149950,0migration/023197-21kthreadcore23:15:030
149950,0migration/022402-21munin-node23:50:080
149950,0migration/021025-21sh00:46:200
149950,0migration/020828-21sh22:16:170
149950,0migration/020219-21kthreadcore22:55:030
149950,0migration/015444-21kernelversion23:30:000
149950,0migration/014162-21kthreadcore21:35:030
149950,0migration/01225-21latency_hist19:39:450
149950,0migration/011055-21sh21:53:480
149950,0migration/011013-21latency22:10:020
149950,0migration/010413-21fschecks_time00:04:590
118919955,0cyclictest0-21swapper/123:42:361
118919955,0cyclictest0-21swapper/100:52:171
118919955,0cyclictest0-21swapper/100:14:081
118919950,0cyclictest0-21swapper/122:18:061
118919950,0cyclictest0-21swapper/121:40:151
118909955,0cyclictest23881-21kworker/0:221:24:550
118909955,0cyclictest23881-21kworker/0:221:19:460
118909955,0cyclictest23881-21kworker/0:221:14:580
118909955,0cyclictest23881-21kworker/0:221:09:560
118909955,0cyclictest23881-21kworker/0:221:04:460
118909955,0cyclictest23881-21kworker/0:220:59:520
118909955,0cyclictest23881-21kworker/0:220:55:060
118909955,0cyclictest23881-21kworker/0:220:44:460
118909955,0cyclictest23881-21kworker/0:220:39:460
118909955,0cyclictest23881-21kworker/0:220:35:060
118909955,0cyclictest23881-21kworker/0:220:30:000
118909955,0cyclictest23881-21kworker/0:220:24:460
118909955,0cyclictest23881-21kworker/0:220:20:120
118909955,0cyclictest23881-21kworker/0:220:14:460
118909955,0cyclictest23881-21kworker/0:220:09:460
118909955,0cyclictest23881-21kworker/0:220:04:560
118909955,0cyclictest23881-21kworker/0:219:55:020
118909955,0cyclictest23881-21kworker/0:219:49:460
118909955,0cyclictest23881-21kworker/0:219:44:580
118909955,0cyclictest23881-21kworker/0:219:35:040
118909955,0cyclictest23881-21kworker/0:219:30:040
118909955,0cyclictest23881-21kworker/0:219:25:040
118909955,0cyclictest14839-21kworker/0:200:09:550
118909950,0cyclictest0-21swapper/023:26:420
118909950,0cyclictest0-21swapper/022:23:190
118909950,0cyclictest0-21swapper/021:44:230
8305040,0irq/26-0000:00:0-21swapper/219:34:452
339940,0migration/34719-21kthreadcore20:25:043
339940,0migration/331616-21irqcore20:00:033
339940,0migration/327904-21kthreadcore19:55:043
339940,0migration/319727-21latency_hist20:59:453
339940,0migration/318252-21kthreadcore20:55:043
339940,0migration/317733-21kthreadcore20:35:003
339940,0migration/312439-21fschecks_time23:10:003
329940,0watchdog/39691-21munin-node19:45:003
329940,0watchdog/30-21swapper/300:10:053
29815040,0irq/29-eth0-tx-9937-21ssh23:05:512
29815040,0irq/29-eth0-tx-9937-21ssh21:50:432
29815040,0irq/29-eth0-tx-4910-21kthreadcore21:30:032
29815040,0irq/29-eth0-tx-31600-21tune2fs23:39:592
29815040,0irq/29-eth0-tx-29375-21diskstats23:20:002
29815040,0irq/29-eth0-tx-27833-21gltestperf00:14:592
29815040,0irq/29-eth0-tx-27687-21ssh22:59:592
29815040,0irq/29-eth0-tx-25169-21ssh00:10:502
29815040,0irq/29-eth0-tx-14341-21ssh23:45:462
29815040,0irq/29-eth0-tx-11628-21ssh23:09:572
29815040,0irq/29-eth0-tx-0-21swapper/223:15:212
29815040,0irq/29-eth0-tx-0-21swapper/222:54:522
29815040,0irq/29-eth0-tx-0-21swapper/222:25:272
29815040,0irq/29-eth0-tx-0-21swapper/222:15:132
29815040,0irq/29-eth0-tx-0-21swapper/222:05:472
29815040,0irq/29-eth0-tx-0-21swapper/221:44:582
29815040,0irq/29-eth0-tx-0-21swapper/200:39:462
29815040,0irq/29-eth0-tx-0-21swapper/200:29:592
29815040,0irq/29-eth0-tx-0-21swapper/200:19:492
29815040,0irq/29-eth0-tx-0-21swapper/200:05:062
29805040,0irq/28-eth0-rx-6314-21runrttasks19:34:483
29805040,0irq/28-eth0-rx-0-21swapper/323:54:593
29805040,0irq/28-eth0-rx-0-21swapper/323:34:593
29805040,0irq/28-eth0-rx-0-21swapper/320:15:043
29805040,0irq/28-eth0-rx-0-21swapper/300:39:593
29805040,0irq/28-eth0-rx-0-21swapper/300:29:503
29805040,0irq/28-eth0-rx-0-21swapper/300:05:053
259940,0migration/230134-21runrttasks20:42:542
259940,0migration/229886-21fschecks_time00:34:592
259940,0migration/228202-21kthreadcore21:25:032
259940,0migration/223424-21kthreadcore20:15:022
259940,0migration/218061-21kthreadcore23:50:032
259940,0migration/216529-21kthreadcore21:55:032
259940,0migration/215192-21kthreadcore20:10:032
259940,0migration/214619-21munin-node19:45:042
249940,0watchdog/25160-21munin-node20:05:042
249940,0watchdog/232738-21grep20:00:042
249940,0watchdog/224596-21ssh22:39:572
249940,0watchdog/20-21swapper/223:25:172
249940,0watchdog/20-21swapper/222:44:572
249940,0watchdog/20-21swapper/221:40:002
179940,0migration/18915-21aten_r1power_vo21:34:561
179940,0migration/18439-21kthreadcore21:50:041
179940,0migration/18018-21fschecks_count23:44:581
179940,0migration/16648-21irqcore20:50:021
179940,0migration/1583-21switchtime20:20:131
179940,0migration/132740-21kthreadcore00:35:031
179940,0migration/132029-21kthreadcore23:00:041
179940,0migration/129283-21kthreadcore22:40:031
179940,0migration/128565-21kthreadcore23:55:041
179940,0migration/127993-21kthreadcore19:55:041
179940,0migration/127797-21irqcore19:35:001
179940,0migration/124852-21irqcore21:25:011
179940,0migration/121383-21kthreadcore21:20:031
179940,0migration/120533-21fschecks_time20:59:591
179940,0migration/116636-21fschecks_time22:35:001
179940,0migration/116610-21fschecks_count20:34:571
179940,0migration/115144-21kthreadcore23:10:041
179940,0migration/114167-21kthreadcore20:30:041
179940,0migration/110444-21kthreadcore00:40:041
169940,0watchdog/1891-21if_eth121:30:001
169940,0watchdog/17650-21python19:40:081
169940,0watchdog/15474-21ssh22:25:411
169940,0watchdog/14909-21kthreadcore00:20:051
169940,0watchdog/11817-21if_err_eth1.322:45:011
169940,0watchdog/116905-21kthreadcore23:30:011
169940,0watchdog/113811-21unixbench_multi22:30:091
169940,0watchdog/10-21swapper/123:25:051
169940,0watchdog/10-21swapper/122:21:441
169940,0watchdog/10-21swapper/122:05:041
169940,0watchdog/10-21swapper/120:05:041
169940,0watchdog/10-21swapper/120:00:041
149940,0migration/031001-21timerwakeupswit22:40:090
149940,0migration/029789-21fschecks_time23:20:010
149940,0migration/015874-21kthreadcore00:25:040
118929944,0cyclictest0-21swapper/219:30:052
118929943,0cyclictest3571-21lldpd21:14:122
118929943,0cyclictest3571-21lldpd20:46:122
118929943,0cyclictest3571-21lldpd20:39:422
118929943,0cyclictest3524-21snmpd21:14:532
118929943,0cyclictest3524-21snmpd21:05:382
118929943,0cyclictest3524-21snmpd21:04:382
118929943,0cyclictest3524-21snmpd20:29:522
118929943,0cyclictest3524-21snmpd19:57:522
118929943,0cyclictest3250-21irqbalance23:30:022
118929943,0cyclictest3250-21irqbalance22:49:522
118929943,0cyclictest3250-21irqbalance21:35:322
118929943,0cyclictest3250-21irqbalance20:50:022
118929943,0cyclictest3250-21irqbalance00:51:022
118929943,0cyclictest2419-21awk19:40:012
118929943,0cyclictest23693-21awk23:35:022
118929943,0cyclictest22345-21munin-node22:19:572
118929943,0cyclictest21370-21awk22:00:012
118929943,0cyclictest2062-21awk00:00:022
118929943,0cyclictest16926-21awk19:50:012
118929943,0cyclictest13741-21awk20:55:022
118929940,0cyclictest13967-21munin-node00:44:592
118919944,0cyclictest0-21swapper/122:55:271
118919944,0cyclictest0-21swapper/122:04:321
118919944,0cyclictest0-21swapper/100:18:421
118919944,0cyclictest0-21swapper/100:03:431
118919943,0cyclictest9720-21awk19:45:001
118919943,0cyclictest8841-21sadc21:14:451
118919943,0cyclictest3571-21lldpd23:54:131
118919943,0cyclictest3571-21lldpd21:55:131
118919943,0cyclictest3571-21lldpd21:06:421
118919943,0cyclictest3571-21lldpd20:41:421
118919943,0cyclictest30020-21awk23:20:021
118919943,0cyclictest22787-21sadc19:54:451
118919943,0cyclictest21357-21awk23:15:001
118919943,0cyclictest13527-21awk20:10:011
118919943,0cyclictest10626-21awk22:50:001
118919940,0cyclictest0-21swapper/120:46:011
118909944,0cyclictest23881-21kworker/0:220:49:500
118909944,0cyclictest0-21swapper/022:52:580
118909944,0cyclictest0-21swapper/022:30:340
118909943,0cyclictest3524-21snmpd00:32:560
118909943,0cyclictest3250-21irqbalance22:27:220
118909943,0cyclictest3250-21irqbalance22:04:520
118909943,0cyclictest3250-21irqbalance22:00:320
118909943,0cyclictest3250-21irqbalance21:44:520
118909943,0cyclictest3250-21irqbalance00:40:220
118909943,0cyclictest3250-21irqbalance00:21:120
118909943,0cyclictest3250-21irqbalance00:15:420
118909943,0cyclictest23602-21awk00:50:010
118909943,0cyclictest12874-21awk21:55:010
29805030,0irq/28-eth0-rx-0-21swapper/320:44:583
29805030,0irq/28-eth0-rx-0-21swapper/320:39:563
27130,0ktimersoftd/22783-21if_eth1.220:25:022
249930,0watchdog/20-21swapper/220:20:042
169930,0watchdog/118146-21kthreadcore20:55:041
169930,0watchdog/10-21swapper/121:48:001
169930,0watchdog/10-21swapper/119:34:121
118929932,0cyclictest18340-21cat19:25:102
118929930,0cyclictest16728-21munin-node21:19:582
118919932,0cyclictest25787-21sensors20:15:061
118919932,0cyclictest15290-21sensors21:15:071
118909933,0cyclictest23881-21kworker/0:222:35:010
118909932,0cyclictest8547-21awk23:45:000
118909932,0cyclictest3524-21snmpd21:29:530
329920,0watchdog/30-21swapper/319:24:483
118919920,0cyclictest0-21swapper/119:24:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional