You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 23:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Fri Apr 10, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1079525040,0sleep20-21swapper/207:17:502
1011824938,0sleep30-21swapper/307:15:153
401924334,0sleep10-21swapper/107:14:571
1072223127,0sleep00-21swapper/007:17:000
339960,0migration/328617-21kthreadcore12:10:073
339960,0migration/326365-21sh12:26:473
339960,0migration/320933-21kthreadcore09:35:103
29805060,0irq/28-eth0-rx-2948-21sh11:18:353
29805060,0irq/28-eth0-rx-20797-21sensors_fan10:30:133
29805060,0irq/28-eth0-rx-19912-21if_err_eth1.308:55:073
29805060,0irq/28-eth0-rx-14898-21crond08:29:513
149960,0migration/029251-21sh12:48:330
149960,0migration/025433-21kthreadcore10:15:080
149960,0migration/018802-21sh12:24:470
149960,0migration/010695-21kthreadcore12:00:080
110429965,0cyclictest3250-21irqbalance11:59:382
110419960,0cyclictest0-21swapper/112:37:341
110419960,0cyclictest0-21swapper/110:21:491
110409960,0cyclictest16253-21kthreadcore08:05:090
8305050,0irq/26-0000:00:3207-17auditd07:19:512
8305050,0irq/26-0000:00:12701-21diskstats10:10:042
339950,0migration/39459-21kthreadcore10:25:083
339950,0migration/39117-21kthreadcore12:35:123
339950,0migration/38622-21sh09:46:423
339950,0migration/3742-21kthreadcore11:35:123
339950,0migration/37144-21kthreadcore11:20:103
339950,0migration/332056-21unixbench-2d07:30:163
339950,0migration/329522-21aten_r1power_cu10:20:013
339950,0migration/329356-21kthreadcore08:15:083
339950,0migration/328463-21if_eth1.310:00:073
339950,0migration/327684-21latency_hist12:29:533
339950,0migration/326161-21sh11:12:003
339950,0migration/326034-21taskset08:59:543
339950,0migration/323877-21munin-node08:35:093
339950,0migration/321154-21latency_hist12:44:523
339950,0migration/317512-21munin-node08:05:123
339950,0migration/313835-21munin-node10:10:083
339950,0migration/313630-21kthreadcore07:20:073
339950,0migration/312106-21kthreadcore12:20:093
339950,0migration/31155-21munin-node09:05:043
339950,0migration/311524-21kthreadcore07:40:073
339950,0migration/310810-21timerandwakeup08:45:163
329950,0watchdog/39420-21if_eth1.312:00:073
329950,0watchdog/39032-21hwlatdetect10:45:073
329950,0watchdog/35602-21ssh09:25:223
329950,0watchdog/33328-21irqstats12:15:073
329950,0watchdog/329489-21kthreadcore09:40:113
329950,0watchdog/322859-21grep09:20:023
329950,0watchdog/318476-21munin-node11:25:113
329950,0watchdog/317509-21perl12:05:033
329950,0watchdog/317509-21perl12:05:033
329950,0watchdog/312864-21iostat08:50:063
29815050,0irq/29-eth0-tx-798-21munin-node09:05:110
29815050,0irq/29-eth0-tx-5552-21users09:25:172
29815050,0irq/29-eth0-tx-22340-21munin-node08:35:180
29815050,0irq/29-eth0-tx-20605-21tr09:35:102
29815050,0irq/29-eth0-tx-12454-21kthreadcore12:20:092
29815050,0irq/29-eth0-tx-12013-21pmu-power10:25:112
29815050,0irq/29-eth0-tx-0-21swapper/211:35:152
29815050,0irq/29-eth0-tx-0-21swapper/008:55:040
29815050,0irq/29-eth0-tx-0-21swapper/008:00:040
29805050,0irq/28-eth0-rx-7896-21python11:00:143
29805050,0irq/28-eth0-rx-6422-21missed_timers07:35:113
29805050,0irq/28-eth0-rx-4792-21cut11:55:103
29805050,0irq/28-eth0-rx-31950-21uptime10:55:173
29805050,0irq/28-eth0-rx-29586-21sensors11:50:133
29805050,0irq/28-eth0-rx-19692-21kthreadcore10:50:103
29805050,0irq/28-eth0-rx-10157-21aten_r1power_po09:50:023
29805050,0irq/28-eth0-rx-10051-21switchtime10:05:173
29805050,0irq/28-eth0-rx-0-21swapper/311:48:273
29805050,0irq/28-eth0-rx-0-21swapper/310:15:263
29805050,0irq/28-eth0-rx-0-21swapper/309:55:033
29805050,0irq/28-eth0-rx-0-21swapper/308:20:053
259950,0migration/28969-21idleruntime08:25:072
259950,0migration/25018-21kthreadcore11:00:092
259950,0migration/224794-21sh10:54:202
259950,0migration/22334-21irqrtprio09:05:082
249950,0watchdog/28824-21irqcore09:30:072
249950,0watchdog/222858-21cpuspeed_turbos09:20:022
249950,0watchdog/214015-21cat07:40:142
179950,0migration/1919-21missed_timers10:00:101
179950,0migration/18637-21taskset11:01:191
179950,0migration/14380-21kthreadcore11:55:101
179950,0migration/130340-21idleruntime07:55:051
179950,0migration/129595-21latency_hist11:34:521
179950,0migration/126860-21fschecks_time09:00:041
179950,0migration/124431-21kthreadcore10:15:081
179950,0migration/121810-21unixbench_multi09:15:161
169950,0watchdog/15976-21kthreadcore07:35:101
149950,0migration/09427-21irqrtprio08:25:090
149950,0migration/09263-21kthreadcore09:30:070
149950,0migration/06952-21kthreadcore08:45:090
149950,0migration/05854-21kthreadcore11:20:090
149950,0migration/04774-21kthreadcore11:00:090
149950,0migration/03352-21kernelversion12:15:070
149950,0migration/031731-21kthreadcore10:00:090
149950,0migration/023652-21sh09:36:360
149950,0migration/023253-21aten_r1power_cu11:50:020
149950,0migration/021889-21kthreadcore07:25:080
149950,0migration/021678-21taskset07:47:350
149950,0migration/021522-21timerwakeupswit08:30:170
149950,0migration/021412-21kthreadcore12:25:090
149950,0migration/021067-21kthreadcore09:55:080
149950,0migration/019281-21taskset10:11:040
149950,0migration/014362-21latency_hist10:29:520
149950,0migration/013160-21kthreadcore07:20:070
149950,0migration/011996-21kthreadcore09:50:070
110419955,0cyclictest0-21swapper/111:48:511
110419954,0cyclictest0-21swapper/110:14:431
110419950,0cyclictest0-21swapper/111:24:341
110419950,0cyclictest0-21swapper/109:24:261
110419950,0cyclictest0-21swapper/109:14:111
110409955,0cyclictest22315-21diskmemload11:14:300
110409955,0cyclictest0-21swapper/010:57:000
110409955,0cyclictest0-21swapper/009:48:350
110409950,0cyclictest0-21swapper/012:36:100
110409950,0cyclictest0-21swapper/012:30:490
110409950,0cyclictest0-21swapper/009:22:060
339940,0migration/323041-21kthreadcore07:25:083
339940,0migration/314011-21missed_timers09:10:103
339940,0migration/31355-21kthreadcore08:40:083
329940,0watchdog/324823-21python08:10:143
329940,0watchdog/30-21swapper/310:40:073
329940,0watchdog/30-21swapper/307:50:023
29815040,0irq/29-eth0-tx-29838-21ssh10:35:232
29815040,0irq/29-eth0-tx-22315-21diskmemload11:21:042
29815040,0irq/29-eth0-tx-22315-21diskmemload10:05:362
29815040,0irq/29-eth0-tx-18683-21munin-node09:55:162
29815040,0irq/29-eth0-tx-12960-21ssh12:40:042
29815040,0irq/29-eth0-tx-0-21swapper/212:44:582
29815040,0irq/29-eth0-tx-0-21swapper/212:30:002
29815040,0irq/29-eth0-tx-0-21swapper/212:15:102
29815040,0irq/29-eth0-tx-0-21swapper/212:10:062
29815040,0irq/29-eth0-tx-0-21swapper/211:30:042
29815040,0irq/29-eth0-tx-0-21swapper/211:25:002
29815040,0irq/29-eth0-tx-0-21swapper/210:55:172
29815040,0irq/29-eth0-tx-0-21swapper/210:19:572
29815040,0irq/29-eth0-tx-0-21swapper/209:59:592
29815040,0irq/29-eth0-tx-0-21swapper/209:50:002
29815040,0irq/29-eth0-tx-0-21swapper/008:10:030
29805040,0irq/28-eth0-rx-10526-21cpuspeed_turbos11:05:063
29805040,0irq/28-eth0-rx-0-21swapper/312:46:153
29805040,0irq/28-eth0-rx-0-21swapper/311:40:333
29805040,0irq/28-eth0-rx-0-21swapper/311:29:583
29805040,0irq/28-eth0-rx-0-21swapper/310:35:103
29805040,0irq/28-eth0-rx-0-21swapper/309:30:053
29805040,0irq/28-eth0-rx-0-21swapper/309:15:043
29805040,0irq/28-eth0-rx-0-21swapper/307:45:093
259940,0migration/28105-21latency_hist11:59:522
259940,0migration/25754-21kthreadcore07:35:102
259940,0migration/232514-21fschecks_time10:40:032
259940,0migration/231283-21kthreadcore08:15:092
259940,0migration/225008-21timerwakeupswit08:10:172
259940,0migration/224621-21latency08:55:102
259940,0migration/222288-21latency_hist08:34:512
259940,0migration/221124-21kthreadcore11:10:082
259940,0migration/21898-21runrttasks11:15:452
259940,0migration/213809-21kthreadcore10:45:102
249940,0watchdog/231915-21missed_timers09:00:102
249940,0watchdog/222265-21aten_r1power_vo07:50:022
249940,0watchdog/218564-21kthreadcore12:05:072
249940,0watchdog/218564-21kthreadcore12:05:072
179940,0migration/19144-21kthreadcore08:00:101
179940,0migration/18535-21fschecks_count08:25:061
179940,0migration/18235-21switchtime12:15:151
179940,0migration/127639-21kthreadcore12:10:061
179940,0migration/127490-21kthreadcore07:50:101
179940,0migration/125410-21aten_r1power_po10:55:031
179940,0migration/125389-21ksmtuned08:12:301
179940,0migration/12137-21kthreadcore10:40:071
179940,0migration/120672-21kthreadcore09:35:101
179940,0migration/115566-21kthreadcore12:40:091
179940,0migration/114821-21runrttasks09:31:331
179940,0migration/114283-21kthreadcore09:50:081
179940,0migration/112482-21kthreadcore12:20:091
179940,0migration/112126-21kthreadcore10:45:101
179940,0migration/111489-21latency_hist08:49:511
169940,0watchdog/16150-21df10:25:031
169940,0watchdog/132311-21if_eth109:25:061
169940,0watchdog/124405-21ntp_kernel_pll_07:25:101
169940,0watchdog/122315-21diskmemload11:05:071
169940,0watchdog/116374-21ssh12:04:231
169940,0watchdog/1116132sleep110:08:511
169940,0watchdog/10-21swapper/112:05:071
169940,0watchdog/10-21swapper/112:05:071
169940,0watchdog/10-21swapper/108:40:021
169940,0watchdog/10-21swapper/108:35:101
149940,0migration/06716-21nfs_client08:20:110
149940,0migration/032020-21ntp_kernel_err09:00:110
149940,0migration/026798-21kthreadcore11:30:090
149940,0migration/019292-21kthreadcore12:05:070
149940,0migration/019292-21kthreadcore12:05:070
149940,0migration/017548-21kthreadcore09:15:080
149940,0migration/010054-21kthreadcore10:25:080
110429943,0cyclictest9202-21awk09:10:062
110429943,0cyclictest7216-21awk11:40:072
110429943,0cyclictest5216-21awk12:35:102
110429943,0cyclictest3571-21lldpd10:15:212
110429943,0cyclictest3524-21snmpd07:34:022
110429943,0cyclictest3250-21irqbalance12:25:082
110429943,0cyclictest3250-21irqbalance11:49:582
110429943,0cyclictest3250-21irqbalance11:05:282
110429943,0cyclictest3250-21irqbalance09:44:582
110429943,0cyclictest3250-21irqbalance09:39:582
110429943,0cyclictest3250-21irqbalance09:15:182
110429943,0cyclictest3250-21irqbalance08:39:582
110429943,0cyclictest3250-21irqbalance08:30:082
110429943,0cyclictest3250-21irqbalance08:21:182
110429943,0cyclictest3250-21irqbalance08:04:582
110429943,0cyclictest3250-21irqbalance08:00:082
110429943,0cyclictest3250-21irqbalance07:54:582
110429943,0cyclictest3250-21irqbalance07:45:482
110429943,0cyclictest3250-21irqbalance07:26:372
110429943,0cyclictest15713-21awk11:45:072
110429943,0cyclictest15603-21awk10:30:072
110429943,0cyclictest12821-21awk08:50:062
110419944,0cyclictest0-21swapper/111:28:021
110419944,0cyclictest0-21swapper/111:09:541
110419944,0cyclictest0-21swapper/110:53:121
110419943,0cyclictest3571-21lldpd11:43:221
110419943,0cyclictest3571-21lldpd07:41:191
110419943,0cyclictest3524-21snmpd09:45:031
110419943,0cyclictest31447-21sadc10:39:521
110419943,0cyclictest28572-21awk11:15:071
110419943,0cyclictest27009-21awk08:15:061
110419943,0cyclictest26193-21awk09:40:081
110419943,0cyclictest24401-21awk11:50:071
110419943,0cyclictest16203-21awk08:30:071
110419943,0cyclictest16084-21awk07:45:071
110409944,0cyclictest0-21swapper/011:36:250
110409944,0cyclictest0-21swapper/011:17:580
110409944,0cyclictest0-21swapper/010:36:300
110409943,0cyclictest9320-21awk09:10:070
110409943,0cyclictest9088-21awk10:45:070
110409943,0cyclictest8819-21awk07:40:050
110409943,0cyclictest7192-21awk11:40:070
110409943,0cyclictest3571-21lldpd12:12:520
110409943,0cyclictest3571-21lldpd11:58:220
110409943,0cyclictest3524-21snmpd12:40:050
110409943,0cyclictest3524-21snmpd07:59:470
110409943,0cyclictest334-21sadc08:19:510
110409943,0cyclictest3250-21irqbalance08:40:080
110409943,0cyclictest26734-21awk07:30:060
110409943,0cyclictest26224-21awk09:40:080
110409943,0cyclictest23165-21awk07:50:070
110409943,0cyclictest1497-21awk07:35:070
110409943,0cyclictest12797-21awk08:50:060
110409943,0cyclictest11298-21awk11:05:090
29805030,0irq/28-eth0-rx-0-21swapper/308:00:033
29805030,0irq/28-eth0-rx-0-21swapper/307:55:023
179930,0migration/1562-21kthreadcore12:30:091
169930,0watchdog/10-21swapper/112:44:591
169930,0watchdog/10-21swapper/111:30:071
169930,0watchdog/10-21swapper/109:55:111
169930,0watchdog/10-21swapper/108:50:021
149930,0migration/012418-21sh11:24:560
110429932,0cyclictest3571-21lldpd08:46:502
110419933,0cyclictest0-21swapper/107:20:501
110419932,0cyclictest19911-21awk08:55:071
110419932,0cyclictest15563-21awk10:30:071
110419932,0cyclictest12520-21awk08:05:071
110419931,0cyclictest20014-21fschecks_time12:25:051
110419930,0cyclictest26045-21df_inode07:30:041
110419930,0cyclictest0-21swapper/108:20:541
110409933,0cyclictest16159-21kworker/0:110:49:590
110409933,0cyclictest16159-21kworker/0:110:40:190
110409933,0cyclictest16159-21kworker/0:110:20:090
110409933,0cyclictest16159-21kworker/0:110:04:530
110409932,0cyclictest31076-21date09:24:510
110409930,0cyclictest15044-21diskstats11:45:040
329920,0watchdog/30-21swapper/308:29:543
110419920,0cyclictest546-21latency_hist09:04:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional