You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 21:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2.osadl.org (updated Thu Apr 23, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3236723728,0sleep30-21swapper/307:17:163
2573623423,0sleep10-21swapper/107:16:021
3231123127,0sleep00-21swapper/007:16:370
3230822723,0sleep20-21swapper/207:16:352
32749991313,0cyclictest15200-21sensors11:11:180
327519999,0cyclictest0-21swapper/209:21:532
327499970,0cyclictest6314-21runrttasks10:06:460
339960,0migration/36008-21sh12:05:093
339960,0migration/330958-21taskset11:02:183
339960,0migration/326380-21munin-node08:46:073
339960,0migration/322169-21latency_hist07:35:553
339960,0migration/316246-21irqcore07:31:123
339960,0migration/314039-21sh12:08:263
339960,0migration/31318-21sh10:09:483
327499960,0cyclictest0-21swapper/009:27:030
29815060,0irq/29-eth0-tx-29620-21munin-node08:26:230
29805060,0irq/28-eth0-rx-20359-21perl11:36:093
29805060,0irq/28-eth0-rx-15288-21grep12:26:233
149960,0migration/07297-21unixbench_singl08:06:210
149960,0migration/020776-21needreboot09:41:160
149960,0migration/020107-21fschecks_time10:21:090
149960,0migration/017624-21unixbench-2d11:31:220
149960,0migration/013598-21sh10:52:030
149960,0migration/013424-21sh09:38:100
8305050,0irq/26-0000:00:27789-21crond10:25:562
4150,0ktimersoftd/00-21swapper/009:57:190
339950,0migration/3995-21idleruntime12:21:103
339950,0migration/39210-21kthreadcore10:51:133
339950,0migration/38356-21mdstat11:26:153
339950,0migration/38210-21latency_hist08:55:563
339950,0migration/36472-21kthreadcore11:46:133
339950,0migration/35554-21kthreadcore09:51:143
339950,0migration/33674-21irqcore12:41:133
339950,0migration/33275-21kthreadcore10:46:143
339950,0migration/331615-21runrttasks12:19:343
339950,0migration/32834-21fschecks_time10:11:103
339950,0migration/327597-21sh09:26:323
339950,0migration/325780-21munin-node10:21:183
339950,0migration/323776-21kthreadcore07:56:113
339950,0migration/323643-21timerandwakeup10:01:213
339950,0migration/321818-21taskset08:16:493
339950,0migration/321038-21rt-features09:41:183
339950,0migration/316794-21taskset12:46:153
339950,0migration/315072-21latency_hist12:10:563
339950,0migration/313780-21kthreadcore09:56:163
339950,0migration/313691-21kthreadcore11:31:143
339950,0migration/312730-21munin-node08:36:113
339950,0migration/31260-21kthreadcore08:26:153
339950,0migration/312356-21fschecks_time07:51:093
339950,0migration/310787-21kthreadcore08:11:133
327519955,0cyclictest0-21swapper/212:06:102
327519950,0cyclictest0-21swapper/210:31:152
327499955,0cyclictest0-21swapper/012:43:010
327499955,0cyclictest0-21swapper/012:08:010
327499955,0cyclictest0-21swapper/010:44:460
327499950,0cyclictest0-21swapper/010:58:100
329950,0watchdog/34253-21sh09:31:593
329950,0watchdog/332088-21python08:01:193
329950,0watchdog/329982-21ssh12:00:553
29815050,0irq/29-eth0-tx-8353-21latency_hist09:55:562
29815050,0irq/29-eth0-tx-7565-21cut11:46:132
29815050,0irq/29-eth0-tx-3815-21sed12:41:132
29815050,0irq/29-eth0-tx-14959-21nfs4_client11:11:152
29815050,0irq/29-eth0-tx-13072-21munin-node11:51:172
29815050,0irq/29-eth0-tx-0-21swapper/211:44:102
29815050,0irq/29-eth0-tx-0-21swapper/211:26:142
29815050,0irq/29-eth0-tx-0-21swapper/210:56:002
29815050,0irq/29-eth0-tx-0-21swapper/210:12:282
29815050,0irq/29-eth0-tx-0-21swapper/209:50:082
29815050,0irq/29-eth0-tx-0-21swapper/009:21:050
29815050,0irq/29-eth0-tx-0-21swapper/009:03:440
29815050,0irq/29-eth0-tx-0-21swapper/008:03:330
29805050,0irq/28-eth0-rx-27335-21iostat11:21:123
29805050,0irq/28-eth0-rx-26248-21cut09:46:133
29805050,0irq/28-eth0-rx-25795-21kthreadcore10:41:133
29805050,0irq/28-eth0-rx-2153-21python11:41:183
29805050,0irq/28-eth0-rx-16558-21kthreadcore11:51:143
29805050,0irq/28-eth0-rx-14875-21ls07:30:553
29805050,0irq/28-eth0-rx-11199-21ssh10:31:323
29805050,0irq/28-eth0-rx-10922-21munin-node10:16:073
29805050,0irq/28-eth0-rx-10922-21munin-node10:16:073
29805050,0irq/28-eth0-rx-0-21swapper/312:36:083
29805050,0irq/28-eth0-rx-0-21swapper/311:19:243
29805050,0irq/28-eth0-rx-0-21swapper/311:11:153
29805050,0irq/28-eth0-rx-0-21swapper/311:06:183
259950,0migration/231889-21munin-node10:46:122
259950,0migration/228301-21kthreadcore11:21:142
259950,0migration/226197-21kthreadcore11:01:122
259950,0migration/221802-21taskset08:16:362
259950,0migration/217234-21aten_r1power_fr10:01:082
259950,0migration/217076-21kthreadcore09:41:142
179950,0migration/128084-21switchtime10:41:201
179950,0migration/125379-21sh11:19:361
179950,0migration/121474-21sendmail_mailqu12:11:181
179950,0migration/120610-21sh11:53:421
179950,0migration/117635-21taskset12:46:281
179950,0migration/117603-21cpuspeed_turbos12:31:081
179950,0migration/110686-21latency_hist12:45:561
149950,0migration/0902-21kthreadcore12:01:140
149950,0migration/08559-21kthreadcore10:31:130
149950,0migration/08092-21kthreadcore11:26:140
149950,0migration/07521-21kthreadcore11:46:130
149950,0migration/05738-21ksmtuned10:49:100
149950,0migration/05695-21irqcore08:31:120
149950,0migration/0541-21munin-node11:06:100
149950,0migration/0427-21taskset11:21:380
149950,0migration/029808-21latency_hist09:10:560
149950,0migration/026511-21kthreadcore11:01:120
149950,0migration/025522-21sh12:35:350
149950,0migration/025406-21kthreadcore12:16:130
149950,0migration/024842-21kthreadcore07:36:120
149950,0migration/02428-21kthreadcore12:21:120
149950,0migration/023438-21latency11:16:150
149950,0migration/021720-21kthreadcore08:41:120
149950,0migration/021679-21sh11:56:070
149950,0migration/021251-21netstat12:11:150
149950,0migration/019802-21kthreadcore07:31:140
149950,0migration/019338-21runrttasks10:36:180
149950,0migration/018833-21kthreadcore08:16:140
149950,0migration/016083-21kthreadcore12:46:140
149950,0migration/013663-21kthreadcore07:51:130
149950,0migration/012792-21kthreadcore07:26:150
149950,0migration/011067-21kthreadcore12:26:150
149950,0migration/011051-21kthreadcore08:11:130
8305040,0irq/26-0000:00:0-21swapper/212:30:562
339940,0migration/325051-21processes08:41:163
339940,0migration/317795-21kthreadcore09:01:133
339940,0migration/313644-21kernelversion09:21:103
339940,0migration/311246-21taskset07:50:313
327519943,0cyclictest5370-21awk07:46:102
327519943,0cyclictest3524-21snmpd07:36:202
327519943,0cyclictest25934-21munin-node12:36:142
327519943,0cyclictest12855-21awk08:36:112
327509944,0cyclictest0-21swapper/110:48:531
327509944,0cyclictest0-21swapper/108:51:161
327509943,0cyclictest5637-21awk08:31:121
327509943,0cyclictest3571-21lldpd12:08:231
327509943,0cyclictest3571-21lldpd11:02:531
327509943,0cyclictest3571-21lldpd07:30:491
327509943,0cyclictest3524-21snmpd10:16:521
327509943,0cyclictest3524-21snmpd10:16:521
327509943,0cyclictest29422-21awk11:41:111
327509943,0cyclictest27094-21awk12:36:131
327509943,0cyclictest22772-21awk11:56:131
327509943,0cyclictest21943-21awk09:26:121
327509943,0cyclictest18320-21awk10:01:121
327509943,0cyclictest17864-21sort07:51:211
327509943,0cyclictest16275-21awk08:16:111
327509943,0cyclictest13133-21awk09:21:081
327509940,0cyclictest0-21swapper/112:02:491
327499944,0cyclictest0-21swapper/010:11:110
327499944,0cyclictest0-21swapper/009:52:350
327499944,0cyclictest0-21swapper/009:19:100
327499943,0cyclictest3571-21lldpd11:45:230
327499943,0cyclictest3524-21snmpd11:51:080
327499943,0cyclictest3524-21snmpd10:05:370
327499943,0cyclictest3524-21snmpd07:56:500
327499943,0cyclictest23702-21awk09:06:100
327499943,0cyclictest1659-21awk07:21:100
327499940,0cyclictest4312-21munin-node07:46:070
329940,0watchdog/331162-21kthreadcore07:41:153
329940,0watchdog/316088-21fschecks_time10:56:113
329940,0watchdog/30-21swapper/308:34:193
29815040,0irq/29-eth0-tx-2091-21ssh10:26:212
29815040,0irq/29-eth0-tx-15832-21tune2fs12:11:092
29815040,0irq/29-eth0-tx-13280-21ssh10:36:082
29815040,0irq/29-eth0-tx-0-21swapper/212:46:022
29815040,0irq/29-eth0-tx-0-21swapper/212:26:092
29815040,0irq/29-eth0-tx-0-21swapper/212:21:062
29815040,0irq/29-eth0-tx-0-21swapper/212:16:152
29815040,0irq/29-eth0-tx-0-21swapper/211:36:132
29815040,0irq/29-eth0-tx-0-21swapper/211:16:012
29815040,0irq/29-eth0-tx-0-21swapper/210:50:592
29815040,0irq/29-eth0-tx-0-21swapper/210:16:122
29815040,0irq/29-eth0-tx-0-21swapper/210:16:122
29815040,0irq/29-eth0-tx-0-21swapper/209:57:532
29815040,0irq/29-eth0-tx-0-21swapper/209:36:352
29815040,0irq/29-eth0-tx-0-21swapper/209:31:032
29815040,0irq/29-eth0-tx-0-21swapper/209:26:562
29815040,0irq/29-eth0-tx-0-21swapper/008:36:100
29815040,0irq/29-eth0-tx-0-21swapper/008:21:110
29805040,0irq/28-eth0-rx-0-21swapper/312:31:033
29805040,0irq/28-eth0-rx-0-21swapper/310:35:593
29805040,0irq/28-eth0-rx-0-21swapper/310:26:143
29805040,0irq/28-eth0-rx-0-21swapper/309:36:033
29805040,0irq/28-eth0-rx-0-21swapper/309:16:073
259940,0migration/26541-21kthreadcore09:16:122
259940,0migration/2444-21kthreadcore07:41:152
259940,0migration/23205-21kthreadcore08:51:132
259940,0migration/230633-21fschecks_time09:11:092
259940,0migration/228379-21kthreadcore10:06:142
259940,0migration/227012-21fschecks_time08:46:092
259940,0migration/226070-21kthreadcore09:06:122
259940,0migration/225961-21kthreadcore11:56:152
259940,0migration/225854-21latency_hist08:00:562
259940,0migration/224909-21taskset08:41:142
259940,0migration/216919-21irqrtprio09:01:132
249940,0watchdog/26175-21load11:06:152
249940,0watchdog/231869-21kthreadcore08:26:152
249940,0watchdog/230231-21ssh12:00:592
249940,0watchdog/219449-21perl07:56:072
249940,0watchdog/213164-21kthreadcore08:56:152
249940,0watchdog/211603-21grep07:26:142
249940,0watchdog/211050-21ssh11:31:072
249940,0watchdog/20-21swapper/210:41:072
179940,0migration/19038-21kthreadcore11:46:141
179940,0migration/15723-21kthreadcore11:06:151
179940,0migration/14106-21kthreadcore12:21:131
179940,0migration/132417-21kthreadcore07:41:151
179940,0migration/131792-21kthreadcore08:26:151
179940,0migration/128494-21missed_timers09:06:141
179940,0migration/127927-21kthreadcore08:01:121
179940,0migration/127060-21kthreadcore12:16:141
179940,0migration/12424-21aten2.4-expect11:26:081
179940,0migration/12388-21kthreadcore09:51:141
179940,0migration/12342-21kthreadcore07:21:111
179940,0migration/12160-21runrttasks10:11:081
179940,0migration/120425-21fschecks_time11:36:091
179940,0migration/120333-21irqcore08:41:111
179940,0migration/118999-21cpuspeed_turbos07:56:051
179940,0migration/118822-21kthreadcore10:56:151
179940,0migration/117706-21kthreadcore09:41:141
179940,0migration/116134-21kthreadcore10:36:141
179940,0migration/115035-21taskset07:31:041
179940,0migration/114053-21kthreadcore12:26:161
179940,0migration/111846-21kthreadcore08:11:131
169940,0watchdog/1872-21ssh10:08:351
169940,0watchdog/16145-21ssh09:36:071
169940,0watchdog/126096-21ssh11:21:031
169940,0watchdog/117391-21python11:31:191
169940,0watchdog/110134-21kthreadcore09:56:151
169940,0watchdog/10-21swapper/108:56:151
149940,0migration/031287-21kthreadcore08:46:130
149940,0migration/029372-21kthreadcore12:36:150
327519932,0cyclictest9085-21awk08:11:112
327519932,0cyclictest5548-21awk08:31:112
327519932,0cyclictest3524-21snmpd07:51:202
327519932,0cyclictest3524-21snmpd07:33:342
327519932,0cyclictest28616-21sensors08:21:182
327519932,0cyclictest1589-21awk07:21:092
327509933,0cyclictest0-21swapper/109:45:581
327509933,0cyclictest0-21swapper/109:12:141
327509932,0cyclictest7747-21awk10:51:111
327509932,0cyclictest5355-21awk07:46:101
327509932,0cyclictest5304-21tune2fs09:16:081
327509932,0cyclictest29556-21cat09:30:561
327509932,0cyclictest28614-21sensors08:21:181
327509932,0cyclictest26114-21sed08:45:561
327509932,0cyclictest23321-21awk07:36:101
327509932,0cyclictest1744-21awk08:06:121
327509932,0cyclictest16578-21awk09:01:111
327499933,0cyclictest0-21swapper/011:40:440
327499933,0cyclictest0-21swapper/007:44:340
327499932,0cyclictest3610-21sensors09:31:190
327499932,0cyclictest29179-21awk10:26:120
327499932,0cyclictest12026-21ssh10:16:120
327499932,0cyclictest12026-21ssh10:16:120
327499930,0cyclictest931-21munin-node08:51:090
327499930,0cyclictest3250-21irqbalance09:46:320
329930,0watchdog/30-21swapper/308:51:073
329930,0watchdog/30-21swapper/308:21:073
329930,0watchdog/30-21swapper/307:21:143
29815030,0irq/29-eth0-tx-8394-21aten2.4-expect08:56:080
29805030,0irq/28-eth0-rx-0-21swapper/309:12:483
29805030,0irq/28-eth0-rx-0-21swapper/309:06:063
29805030,0irq/28-eth0-rx-0-21swapper/308:06:123
169930,0watchdog/10-21swapper/111:11:071
169930,0watchdog/10-21swapper/110:32:431
169930,0watchdog/10-21swapper/110:26:111
169930,0watchdog/10-21swapper/110:21:071
249920,0watchdog/20-21swapper/208:06:072
169920,0watchdog/10-21swapper/108:36:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional