You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 17:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Mon May 18, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1132524738,0sleep10-21swapper/107:19:361
1155424132,0sleep20-21swapper/207:22:132
1147923121,0sleep30-21swapper/307:21:223
1123423026,0sleep00-21swapper/007:18:310
35160,0ktimersoftd/30-21swapper/311:24:563
339960,0migration/38151-21taskset11:58:223
339960,0migration/317720-21sh12:04:513
339960,0migration/31702-21sh09:45:453
29815060,0irq/29-eth0-tx-5131-21munin-node08:48:160
29805060,0irq/28-eth0-rx-7164-21perl12:38:143
149960,0migration/02685-21latency_hist09:48:000
116899960,0cyclictest0-21swapper/212:13:272
116889965,0cyclictest0-21swapper/112:36:061
116879960,0cyclictest0-21swapper/012:10:130
116879960,0cyclictest0-21swapper/010:51:240
116879960,0cyclictest0-21swapper/009:21:030
339950,0migration/39521-21gltestperf08:28:133
339950,0migration/3449-21sh11:38:133
339950,0migration/331683-21munin-node12:33:203
339950,0migration/330141-21kthreadcore09:03:143
339950,0migration/325914-21kthreadcore07:53:183
339950,0migration/325263-21kthreadcore12:28:183
339950,0migration/325169-21munin-node10:38:133
339950,0migration/32025-21fschecks_time08:23:143
339950,0migration/319520-21munin-node07:28:133
339950,0migration/316623-21unixbench_singl10:48:263
339950,0migration/315320-21cpuspeed_turbos12:43:133
339950,0migration/315286-21kthreadcore07:23:183
339950,0migration/315269-21taskset11:44:173
339950,0migration/314511-21kthreadcore11:08:223
339950,0migration/312644-21kthreadcore07:43:173
339950,0migration/311432-21munin-node08:48:263
339950,0migration/310820-21kthreadcore09:13:173
329950,0watchdog/37215-21ssh09:30:113
329950,0watchdog/329984-21processes12:48:233
329950,0watchdog/325313-21yum10:53:273
329950,0watchdog/317244-21ssh09:37:513
329950,0watchdog/311728-21sh09:53:113
329950,0watchdog/30-21swapper/310:14:593
329950,0watchdog/30-21swapper/309:23:193
29815050,0irq/29-eth0-tx-8448-21munin-node07:43:190
29815050,0irq/29-eth0-tx-19755-21ssh11:10:432
29805050,0irq/28-eth0-rx-32337-21ssh11:53:453
29805050,0irq/28-eth0-rx-30326-21perl11:18:153
29805050,0irq/28-eth0-rx-30131-21chrt11:33:493
29805050,0irq/28-eth0-rx-29464-21fschecks_count10:03:133
29805050,0irq/28-eth0-rx-18532-21kthreadcore12:23:193
29805050,0irq/28-eth0-rx-17438-21if_err_eth1.310:33:163
29805050,0irq/28-eth0-rx-0-21swapper/312:19:133
29805050,0irq/28-eth0-rx-0-21swapper/312:13:173
29805050,0irq/28-eth0-rx-0-21swapper/311:49:533
29805050,0irq/28-eth0-rx-0-21swapper/311:30:203
29805050,0irq/28-eth0-rx-0-21swapper/311:13:233
29805050,0irq/28-eth0-rx-0-21swapper/311:00:173
29805050,0irq/28-eth0-rx-0-21swapper/310:28:443
29805050,0irq/28-eth0-rx-0-21swapper/310:23:123
29805050,0irq/28-eth0-rx-0-21swapper/310:18:193
29805050,0irq/28-eth0-rx-0-21swapper/309:38:063
29805050,0irq/28-eth0-rx-0-21swapper/307:58:173
27150,0ktimersoftd/20-21swapper/211:23:382
27150,0ktimersoftd/20-21swapper/210:58:432
259950,0migration/229580-21kthreadcore10:38:192
259950,0migration/226404-21kthreadcore09:23:192
259950,0migration/215140-21aten2.4-expect12:43:122
249950,0watchdog/2590-21hwlatdetect09:28:152
19150,0ktimersoftd/10-21swapper/111:58:261
19150,0ktimersoftd/10-21swapper/111:21:231
179950,0migration/17147-21kthreadcore10:08:161
179950,0migration/15031-21aten_r1power_vo08:03:121
179950,0migration/131877-21kthreadcore07:58:171
179950,0migration/131327-21munin-node10:23:121
179950,0migration/130071-21latency_hist08:43:001
179950,0migration/128030-21cpuspeed_turbos12:13:121
179950,0migration/121587-21sh10:15:491
179950,0migration/121554-21kthreadcore07:28:171
179950,0migration/117735-21munin-node07:23:191
179950,0migration/115515-21kthreadcore08:08:171
149950,0migration/07395-21sh11:41:250
149950,0migration/06062-21kthreadcore11:58:170
149950,0migration/05803-21netstat09:28:190
149950,0migration/05689-21kthreadcore09:48:180
149950,0migration/04375-21kthreadcore09:08:180
149950,0migration/04220-21kthreadcore10:23:190
149950,0migration/03337-21kthreadcore08:23:190
149950,0migration/032350-21kthreadcore11:18:180
149950,0migration/031410-21irqcore12:33:200
149950,0migration/031266-21sh12:50:490
149950,0migration/030538-21kthreadcore08:18:180
149950,0migration/029889-21kthreadcore09:03:140
149950,0migration/027171-21latency_hist10:58:000
149950,0migration/026791-21kthreadcore10:38:180
149950,0migration/025584-21taskset10:54:120
149950,0migration/025571-21aten_r1power_en11:53:090
149950,0migration/025395-21ksmtuned09:41:050
149950,0migration/023030-21latency_hist08:38:000
149950,0migration/023005-21kthreadcore08:13:170
149950,0migration/021557-21munin-node09:58:160
149950,0migration/020572-21kthreadcore11:48:190
149950,0migration/019225-21kthreadcore08:33:170
149950,0migration/018660-21taskset12:07:280
149950,0migration/018532-21kthreadcore12:43:180
149950,0migration/018430-21sh09:53:270
149950,0migration/017349-21idleruntime-cro09:38:000
149950,0migration/017164-21fschecks_time10:33:140
149950,0migration/011652-21runrttasks11:07:110
149950,0migration/011045-21kthreadcore09:13:170
116899955,0cyclictest0-21swapper/211:40:302
116899955,0cyclictest0-21swapper/211:30:432
116899954,0cyclictest4623-21crond08:02:592
116899954,0cyclictest3524-21snmpd11:50:452
116899950,0cyclictest0-21swapper/212:35:502
116899950,0cyclictest0-21swapper/211:20:102
116889955,0cyclictest0-21swapper/109:38:071
116889950,0cyclictest0-21swapper/110:04:261
116889950,0cyclictest0-21swapper/108:53:011
116879955,0cyclictest23207-21ssh11:33:010
116879955,0cyclictest0-21swapper/012:13:220
116879950,0cyclictest0-21swapper/007:38:060
8305040,0irq/26-0000:00:5453-21sed10:23:252
329940,0watchdog/35454-21kthreadcore09:08:193
329940,0watchdog/324088-21munin-node08:38:143
329940,0watchdog/320026-21tr09:18:193
329940,0watchdog/30-21swapper/308:58:193
329940,0watchdog/30-21swapper/308:53:193
329940,0watchdog/30-21swapper/308:43:273
329940,0watchdog/30-21swapper/308:13:223
329940,0watchdog/30-21swapper/308:08:103
329940,0watchdog/30-21swapper/307:33:103
29815040,0irq/29-eth0-tx-3524-21snmpd08:10:390
29815040,0irq/29-eth0-tx-27222-21ssh09:58:542
29815040,0irq/29-eth0-tx-23769-21proc_pri09:38:202
29815040,0irq/29-eth0-tx-23070-21diskmemload10:53:332
29815040,0irq/29-eth0-tx-21430-21munin-node12:28:132
29815040,0irq/29-eth0-tx-15529-21ssh10:31:352
29815040,0irq/29-eth0-tx-10591-21ssh11:04:172
29815040,0irq/29-eth0-tx-0-21swapper/212:40:062
29815040,0irq/29-eth0-tx-0-21swapper/212:18:212
29815040,0irq/29-eth0-tx-0-21swapper/211:43:342
29815040,0irq/29-eth0-tx-0-21swapper/211:33:032
29815040,0irq/29-eth0-tx-0-21swapper/210:50:162
29815040,0irq/29-eth0-tx-0-21swapper/210:33:122
29815040,0irq/29-eth0-tx-0-21swapper/210:07:492
29815040,0irq/29-eth0-tx-0-21swapper/209:43:172
29815040,0irq/29-eth0-tx-0-21swapper/009:23:080
29815040,0irq/29-eth0-tx-0-21swapper/008:03:110
29815040,0irq/29-eth0-tx-0-21swapper/007:58:160
29805040,0irq/28-eth0-rx-4186-21kthreadcore10:43:183
29805040,0irq/28-eth0-rx-0-21swapper/312:10:153
29805040,0irq/28-eth0-rx-0-21swapper/311:03:203
29805040,0irq/28-eth0-rx-0-21swapper/310:08:033
29805040,0irq/28-eth0-rx-0-21swapper/309:58:533
29805040,0irq/28-eth0-rx-0-21swapper/309:48:183
29805040,0irq/28-eth0-rx-0-21swapper/308:33:413
29805040,0irq/28-eth0-rx-0-21swapper/307:48:183
29805040,0irq/28-eth0-rx-0-21swapper/307:40:333
259940,0migration/26793-21kthreadcore08:03:172
259940,0migration/226277-21fschecks_time11:53:112
259940,0migration/225987-21sh12:08:572
259940,0migration/22528-21kthreadcore08:43:192
259940,0migration/223548-21kthreadcore08:58:182
259940,0migration/218839-21kthreadcore08:33:172
259940,0migration/215827-21kthreadcore09:53:192
249940,0watchdog/27638-21kthreadcore09:48:192
249940,0watchdog/25455-21kthreadcore09:08:192
249940,0watchdog/219883-21latency10:13:192
249940,0watchdog/216145-21tr07:23:182
249940,0watchdog/211525-21if_err_eth1.212:03:152
249940,0watchdog/20-21swapper/208:08:102
179940,0migration/19686-21kthreadcore10:28:171
179940,0migration/14644-21kthreadcore09:48:181
179940,0migration/1454-21kthreadcore08:43:181
179940,0migration/1332-21switchtime08:18:251
179940,0migration/127690-21hwlatdetect09:03:121
179940,0migration/126287-21kthreadcore11:33:171
179940,0migration/122245-21fschecks_time12:28:141
179940,0migration/121551-21kthreadcore10:33:191
179940,0migration/121536-21kthreadcore08:58:181
179940,0migration/121197-21fschecks_time09:58:141
179940,0migration/121033-21aten_r1power_vo11:13:121
179940,0migration/120752-21irqrtprio08:13:161
179940,0migration/119262-21timerandwakeup12:23:261
179940,0migration/117798-21runrttasks12:05:041
179940,0migration/117648-21ksmtuned10:51:061
179940,0migration/117142-21runrttasks11:48:131
179940,0migration/117094-21kthreadcore11:08:231
179940,0migration/113876-21kthreadcore07:43:181
169940,0watchdog/18861-21munin-node09:13:231
169940,0watchdog/15456-21kthreadcore09:08:191
169940,0watchdog/14724-21ssh11:03:151
169940,0watchdog/132724-21rm10:41:231
169940,0watchdog/127617-21grep11:53:151
169940,0watchdog/126491-21cut09:23:191
169940,0watchdog/124548-21perl12:48:151
169940,0watchdog/115856-21ssh11:45:551
169940,0watchdog/10-21swapper/110:19:031
169940,0watchdog/10-21swapper/109:53:111
169940,0watchdog/10-21swapper/109:28:151
169940,0watchdog/10-21swapper/108:48:151
169940,0watchdog/10-21swapper/108:23:181
149940,0migration/09922-21kthreadcore12:18:210
149940,0migration/029755-21kthreadcore07:33:170
149940,0migration/018578-21kthreadcore11:28:180
149940,0migration/017809-21kthreadcore12:23:190
149940,0migration/01128-21kthreadcore10:03:170
116899944,0cyclictest0-21swapper/211:15:352
116899943,0cyclictest9809-21awk09:33:142
116899943,0cyclictest9575-21awk07:43:152
116899943,0cyclictest6205-21awk08:48:172
116899943,0cyclictest3571-21lldpd10:18:052
116899943,0cyclictest3571-21lldpd10:09:052
116899943,0cyclictest3524-21snmpd12:48:002
116899943,0cyclictest3524-21snmpd12:24:152
116899943,0cyclictest3524-21snmpd10:43:592
116899943,0cyclictest3524-21snmpd09:13:432
116899943,0cyclictest3524-21snmpd08:53:282
116899943,0cyclictest3524-21snmpd08:39:432
116899943,0cyclictest3524-21snmpd08:24:432
116899943,0cyclictest3524-21snmpd08:14:432
116899943,0cyclictest3524-21snmpd07:55:122
116899943,0cyclictest3524-21snmpd07:49:572
116899943,0cyclictest3524-21snmpd07:41:422
116899943,0cyclictest3524-21snmpd07:34:122
116899943,0cyclictest2898-21awk11:58:152
116899943,0cyclictest27859-21awk09:03:132
116899943,0cyclictest27644-21awk08:18:152
116899943,0cyclictest23076-21sadc09:23:002
116899943,0cyclictest20137-21awk07:28:152
116889944,0cyclictest23070-21diskmemload12:08:411
116889943,0cyclictest7005-21awk11:23:151
116889943,0cyclictest3524-21snmpd08:30:581
116889943,0cyclictest27617-21awk09:43:141
116889943,0cyclictest27378-21awk07:33:151
116889943,0cyclictest2375-21awk10:43:161
116889943,0cyclictest2152-21awk07:38:151
116889943,0cyclictest19729-21awk10:53:161
116889943,0cyclictest17155-21awk09:18:161
116889943,0cyclictest16898-21awk08:33:151
116889943,0cyclictest16137-21awk12:43:151
116879944,0cyclictest0-21swapper/012:32:370
116879943,0cyclictest7151-21awk11:23:160
116879943,0cyclictest31359-21awk08:43:160
116879943,0cyclictest23977-21awk07:53:160
116879943,0cyclictest23850-21awk10:18:170
116879940,0cyclictest8619-21munin-node08:28:130
116879940,0cyclictest29296-21munin-run11:17:590
329930,0watchdog/30-21swapper/308:22:543
329930,0watchdog/30-21swapper/308:03:223
29815030,0irq/29-eth0-tx-0-21swapper/007:48:220
169930,0watchdog/10-21swapper/110:58:191
169930,0watchdog/10-21swapper/107:53:181
149930,0migration/018659-21runrttasks07:25:420
116899930,0cyclictest0-21swapper/208:28:132
116889932,0cyclictest9824-21awk09:33:141
116889932,0cyclictest7581-21awk12:38:161
116889932,0cyclictest5304-21irqcore12:18:191
116889932,0cyclictest3524-21snmpd07:48:421
116889932,0cyclictest32152-21awk11:38:111
116889932,0cyclictest20954-21sensors11:28:221
116879933,0cyclictest0-21swapper/010:45:150
116879932,0cyclictest9460-21awk11:43:160
116879932,0cyclictest3524-21snmpd07:28:120
116879932,0cyclictest15762-21kthreadcore11:08:220
116879932,0cyclictest14005-21sensors10:28:220
116879932,0cyclictest12341-21munin-node08:53:100
116879930,0cyclictest6179-21perl10:08:130
116879921,0cyclictest6282-21latency_hist12:38:000
116879920,0cyclictest19556-21aten_r1power_cu08:58:110
116879920,0cyclictest0-21swapper/010:13:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional