You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 04:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Sat Jul 04, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1447424839,0sleep20-21swapper/219:23:472
1443223526,0sleep30-21swapper/319:23:203
1467023425,0sleep10-21swapper/119:26:061
1462823423,0sleep00-21swapper/019:25:370
339960,0migration/327694-21aten_r1power_cu22:41:583
339960,0migration/318029-21sh22:34:403
339960,0migration/310341-21munin-node22:47:083
29815060,0irq/29-eth0-tx-18937-21munin-node20:37:040
148979960,0cyclictest0-21swapper/020:46:580
149960,0migration/031829-21sh23:21:050
149960,0migration/031256-21sh00:52:050
149960,0migration/024900-21kthreadcore22:57:070
149960,0migration/024182-21kthreadcore00:12:040
149960,0migration/014525-21sh00:24:140
149960,0migration/010893-21pmu-power00:02:090
4150,0ktimersoftd/00-21swapper/022:37:320
4150,0ktimersoftd/00-21swapper/021:35:220
339950,0migration/37796-21kthreadcore21:32:053
339950,0migration/36221-21irqrtprio21:12:053
339950,0migration/34123-21taskset21:07:373
339950,0migration/330496-21fschecks_time20:22:003
339950,0migration/330215-21kthreadcore19:57:053
339950,0migration/330032-21kthreadcore00:52:043
339950,0migration/327812-21kthreadcore00:32:063
339950,0migration/327106-21munin-node20:42:023
339950,0migration/323086-21kthreadcore19:52:053
339950,0migration/322678-21kthreadcore21:22:063
339950,0migration/318721-21taskset21:18:573
339950,0migration/316863-21aten_r1power_cu22:16:583
339950,0migration/31664-21kthreadcore19:37:053
339950,0migration/315854-21fschecks_time23:11:593
339950,0migration/312507-21idleruntime19:47:003
339950,0migration/311745-21kthreadcore00:42:063
339950,0migration/311053-21aten_r1power_cu23:46:583
329950,0watchdog/38564-21sh22:27:153
329950,0watchdog/33883-21ssh00:00:193
329950,0watchdog/327707-21cut21:02:063
329950,0watchdog/326891-21python21:42:143
329950,0watchdog/325760-21wc22:21:593
329950,0watchdog/30-21swapper/323:17:033
329950,0watchdog/30-21swapper/322:12:033
329950,0watchdog/30-21swapper/321:27:023
29815050,0irq/29-eth0-tx-3948-21ssh00:00:312
29815050,0irq/29-eth0-tx-26862-21perl23:37:012
29815050,0irq/29-eth0-tx-24414-21perl23:16:592
29815050,0irq/29-eth0-tx-17783-21gltestperf22:17:002
29815050,0irq/29-eth0-tx-17031-21kthreadcore20:12:030
29815050,0irq/29-eth0-tx-13891-21ssh00:22:292
29815050,0irq/29-eth0-tx-11981-21munin-node21:17:090
29815050,0irq/29-eth0-tx-10446-21munin-node22:32:032
29815050,0irq/29-eth0-tx-0-21swapper/223:30:212
29815050,0irq/29-eth0-tx-0-21swapper/223:11:592
29815050,0irq/29-eth0-tx-0-21swapper/222:43:312
29815050,0irq/29-eth0-tx-0-21swapper/222:40:182
29815050,0irq/29-eth0-tx-0-21swapper/221:57:152
29815050,0irq/29-eth0-tx-0-21swapper/200:21:172
29815050,0irq/29-eth0-tx-0-21swapper/021:27:200
29815050,0irq/29-eth0-tx-0-21swapper/021:22:130
29815050,0irq/29-eth0-tx-0-21swapper/020:27:010
29815050,0irq/29-eth0-tx-0-21swapper/020:02:060
29805050,0irq/28-eth0-rx-946-21kthreadcore00:17:043
29805050,0irq/28-eth0-rx-5695-21cut23:42:053
29805050,0irq/28-eth0-rx-3276-21kthreadcore23:02:053
29805050,0irq/28-eth0-rx-30879-21runrttasks22:04:543
29805050,0irq/28-eth0-rx-28104-21ssh23:37:053
29805050,0irq/28-eth0-rx-23969-21ssh00:31:243
29805050,0irq/28-eth0-rx-23963-21munin-node20:17:043
29805050,0irq/28-eth0-rx-20574-21ssh22:55:323
29805050,0irq/28-eth0-rx-18978-21sed23:32:063
29805050,0irq/28-eth0-rx-18073-21aten_r1power_en00:46:573
29805050,0irq/28-eth0-rx-13175-21munin-node00:22:083
29805050,0irq/28-eth0-rx-0-21swapper/323:09:163
29805050,0irq/28-eth0-rx-0-21swapper/322:57:433
29805050,0irq/28-eth0-rx-0-21swapper/322:37:043
29805050,0irq/28-eth0-rx-0-21swapper/321:52:563
29805050,0irq/28-eth0-rx-0-21swapper/321:37:323
29805050,0irq/28-eth0-rx-0-21swapper/300:37:053
29805050,0irq/28-eth0-rx-0-21swapper/300:15:203
29805050,0irq/28-eth0-rx-0-21swapper/300:02:063
259950,0migration/24041-21idleruntime-cro19:41:472
259950,0migration/23563-21munin-node21:47:122
259950,0migration/224777-21kthreadcore22:57:072
259950,0migration/220464-21sh21:41:482
259950,0migration/219097-21latency_hist21:21:472
259950,0migration/215672-21sh22:14:192
19150,0ktimersoftd/10-21swapper/122:37:321
179950,0migration/15936-21munin-node00:02:041
179950,0migration/14999-21sh23:03:511
179950,0migration/131343-21kthreadcore20:42:051
179950,0migration/131134-21kthreadcore21:27:071
179950,0migration/128573-21kthreadcore00:52:041
179950,0migration/128245-21mdstat20:17:061
179950,0migration/114695-21sh00:24:431
179950,0migration/114161-21mdstat22:12:081
179950,0migration/110139-21kthreadcore20:52:041
169950,0watchdog/120432-21cut19:27:061
169950,0watchdog/111068-21ssh21:36:101
149079955,0cyclictest0-21swapper/223:54:192
149079955,0cyclictest0-21swapper/223:42:112
149079955,0cyclictest0-21swapper/221:27:142
149079955,0cyclictest0-21swapper/200:43:022
149079955,0cyclictest0-21swapper/200:03:372
149079950,0cyclictest0-21swapper/223:25:192
149079950,0cyclictest0-21swapper/223:25:192
149079950,0cyclictest0-21swapper/200:54:142
149079950,0cyclictest0-21swapper/200:12:552
149049950,0cyclictest0-21swapper/123:43:181
149049950,0cyclictest0-21swapper/123:16:591
148979955,0cyclictest0-21swapper/000:45:580
148979955,0cyclictest0-21swapper/000:17:070
148979955,0cyclictest0-21swapper/000:01:210
148979950,0cyclictest0-21swapper/022:46:190
148979950,0cyclictest0-21swapper/022:06:440
148979950,0cyclictest0-21swapper/000:10:390
149950,0migration/07616-21kthreadcore22:27:050
149950,0migration/06967-21sh23:22:490
149950,0migration/06967-21sh23:22:490
149950,0migration/06617-21kthreadcore23:42:050
149950,0migration/03593-21munin-node19:37:130
149950,0migration/032054-21needreboot20:42:060
149950,0migration/031953-21mdstat23:37:060
149950,0migration/030553-21fschecks_time21:07:010
149950,0migration/026567-21idleruntime22:22:010
149950,0migration/024064-21irqrtprio21:02:050
149950,0migration/023393-21sh00:29:480
149950,0migration/022533-21aten_r1power_vo20:16:590
149950,0migration/020648-21sh21:41:590
149950,0migration/02021-21kthreadcore23:02:050
149950,0migration/018492-21kthreadcore23:12:030
149950,0migration/018224-21fschecks_time23:32:020
149950,0migration/014424-21sh23:10:510
149950,0migration/013559-21kthreadcore20:32:040
149950,0migration/013225-21kthreadcore23:47:040
149950,0migration/012524-21idleruntime19:47:010
149950,0migration/011730-21latency21:52:060
149950,0migration/011511-21kthreadcore20:07:040
149950,0migration/011155-21sh22:48:180
149950,0migration/010118-21irqcore23:27:040
8305040,0irq/26-0000:00:0-21swapper/222:02:072
8305040,0irq/26-0000:00:0-21swapper/219:51:472
339940,0migration/33370-21kthreadcore20:47:043
339940,0migration/329573-21cpuspeed_turbos21:46:593
339940,0migration/314970-21latency_hist19:26:473
339940,0migration/311783-21kthreadcore20:52:043
339940,0migration/31143-21kthreadcore22:07:053
329940,0watchdog/30-21swapper/323:27:073
329940,0watchdog/30-21swapper/319:42:023
29815040,0irq/29-eth0-tx-9088-21munin-node21:32:092
29815040,0irq/29-eth0-tx-26196-21diskmemload23:01:572
29815040,0irq/29-eth0-tx-26196-21diskmemload00:38:162
29815040,0irq/29-eth0-tx-19455-21ssh22:52:232
29815040,0irq/29-eth0-tx-10428-21tr21:52:062
29815040,0irq/29-eth0-tx-0-21swapper/223:47:052
29815040,0irq/29-eth0-tx-0-21swapper/223:07:002
29815040,0irq/29-eth0-tx-0-21swapper/222:46:532
29815040,0irq/29-eth0-tx-0-21swapper/222:23:042
29815040,0irq/29-eth0-tx-0-21swapper/221:36:592
29815040,0irq/29-eth0-tx-0-21swapper/200:32:022
29815040,0irq/29-eth0-tx-0-21swapper/200:28:422
29815040,0irq/29-eth0-tx-0-21swapper/019:52:040
29805040,0irq/28-eth0-rx-11292-21sshd20:29:313
29805040,0irq/28-eth0-rx-0-21swapper/323:52:093
29805040,0irq/28-eth0-rx-0-21swapper/323:21:523
29805040,0irq/28-eth0-rx-0-21swapper/323:21:523
29805040,0irq/28-eth0-rx-0-21swapper/321:58:123
29805040,0irq/28-eth0-rx-0-21swapper/320:12:033
29805040,0irq/28-eth0-rx-0-21swapper/320:07:083
29805040,0irq/28-eth0-rx-0-21swapper/320:02:033
29805040,0irq/28-eth0-rx-0-21swapper/300:07:063
259940,0migration/24184-21kthreadcore20:02:052
259940,0migration/2370-21kthreadcore21:07:062
259940,0migration/232466-21kthreadcore20:22:042
259940,0migration/231753-21latency_hist22:06:482
259940,0migration/220415-21kthreadcore00:47:042
259940,0migration/219108-21kthreadcore23:32:062
259940,0migration/218881-21kthreadcore19:27:062
259940,0migration/211838-21kthreadcore20:07:042
259940,0migration/211101-21runrttasks19:44:502
259940,0migration/210298-21kthreadcore20:52:042
249940,0watchdog/20-21swapper/221:02:062
179940,0migration/19723-21kthreadcore20:07:031
179940,0migration/18816-21kthreadcore20:27:051
179940,0migration/15885-21kthreadcore00:37:051
179940,0migration/1341-21kthreadcore21:07:061
179940,0migration/130647-21idleruntime20:22:011
179940,0migration/13000-21munin-node22:27:031
179940,0migration/129977-21fschecks_count19:37:001
179940,0migration/129849-21fschecks_count21:47:001
179940,0migration/127920-21kthreadcore19:57:051
179940,0migration/12743-21kthreadcore20:47:041
179940,0migration/126402-21kthreadcore00:32:061
179940,0migration/126357-21kthreadcore19:32:051
179940,0migration/123738-21kthreadcore00:12:041
179940,0migration/123277-21sh22:01:581
179940,0migration/123105-21kthreadcore23:52:051
179940,0migration/120012-21kthreadcore21:57:061
179940,0migration/116124-21kthreadcore21:37:061
179940,0migration/115284-21sh20:11:581
179940,0migration/114762-21kthreadcore19:47:031
169940,0watchdog/126109-21aten_r1power_po23:36:591
169940,0watchdog/124798-21kthreadcore22:57:071
169940,0watchdog/124167-21open_inodes00:47:071
169940,0watchdog/122685-21ssh00:27:511
169940,0watchdog/122207-21kthreadcore23:32:071
169940,0watchdog/115299-21kthreadcore22:32:031
169940,0watchdog/112748-21aten2.4-expect22:51:591
169940,0watchdog/10-21swapper/122:41:511
169940,0watchdog/10-21swapper/100:16:591
149079944,0cyclictest0-21swapper/220:12:112
149079943,0cyclictest3571-21lldpd20:36:522
149079943,0cyclictest3524-21snmpd19:52:072
149079943,0cyclictest2945-21awk22:27:032
149079943,0cyclictest23364-21awk19:32:022
149079943,0cyclictest20286-21awk21:22:032
149079943,0cyclictest16487-21awk20:57:032
149079943,0cyclictest14417-21awk00:07:032
149049944,0cyclictest0-21swapper/121:44:071
149049944,0cyclictest0-21swapper/100:42:071
149049943,0cyclictest6946-21awk21:52:031
149049943,0cyclictest3571-21lldpd21:01:521
149049943,0cyclictest3571-21lldpd20:56:521
149049943,0cyclictest3524-21snmpd21:22:091
149049943,0cyclictest3524-21snmpd21:16:531
149049943,0cyclictest3524-21snmpd19:41:511
149049943,0cyclictest3250-21irqbalance23:11:541
149049943,0cyclictest3250-21irqbalance23:07:041
149049943,0cyclictest3250-21irqbalance22:48:341
149049943,0cyclictest3250-21irqbalance22:23:341
149049943,0cyclictest3250-21irqbalance22:18:241
149049943,0cyclictest3250-21irqbalance20:36:541
149049943,0cyclictest3250-21irqbalance20:36:141
149049943,0cyclictest3250-21irqbalance20:02:141
149049943,0cyclictest29420-21awk23:57:031
149049943,0cyclictest19795-21awk19:52:031
148979944,0cyclictest0-21swapper/000:51:100
148979943,0cyclictest3571-21lldpd22:32:530
148979943,0cyclictest3524-21snmpd22:20:550
148979943,0cyclictest3524-21snmpd20:54:080
148979943,0cyclictest25484-21awk00:32:040
148979943,0cyclictest16118-21awk19:27:030
149940,0migration/08960-21diskmemload00:41:300
149940,0migration/028828-21kthreadcore19:57:050
149940,0migration/014261-21kernelversion22:52:040
149940,0migration/012107-21kthreadcore22:12:070
329930,0watchdog/30-21swapper/320:58:463
329930,0watchdog/30-21swapper/320:36:503
329930,0watchdog/30-21swapper/320:32:583
29815030,0irq/29-eth0-tx-0-21swapper/021:12:090
29815030,0irq/29-eth0-tx-0-21swapper/019:32:000
29805030,0irq/28-eth0-rx-0-21swapper/319:31:563
249930,0watchdog/232006-21missed_timers20:42:062
169930,0watchdog/10-21swapper/123:27:071
149079933,0cyclictest3571-21lldpd20:31:522
149079932,0cyclictest5813-21awk21:12:032
149079932,0cyclictest3571-21lldpd20:26:522
149079932,0cyclictest31290-21kthreadcore19:57:062
149079932,0cyclictest2050-21awk20:47:022
149079931,0cyclictest24591-21kthreadcore20:17:042
149049932,0cyclictest3524-21snmpd21:11:531
149049932,0cyclictest19709-21sensors00:07:101
149049932,0cyclictest14608-21grep23:47:051
149049930,0cyclictest338-21df_inode23:22:011
149049930,0cyclictest338-21df_inode23:22:011
149049930,0cyclictest32751-21perl22:07:011
148979932,0cyclictest5409-21awk19:42:020
148979932,0cyclictest4186-21cut22:07:060
148979932,0cyclictest18746-21cut21:57:050
148979932,0cyclictest16567-21awk20:57:030
148979930,0cyclictest29975-21tune2fs21:47:000
148979930,0cyclictest0-21swapper/020:24:250
149930,0migration/019707-21sh21:40:340
148979921,0cyclictest19966-21expr23:51:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional