You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 22:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Tue Sep 22, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
595827170,0sleep00-21swapper/007:32:030
581925150,0sleep20-21swapper/207:30:292
583823727,0sleep30-21swapper/307:30:423
6152993434,0cyclictest83050irq/26-0000:00:10:00:342
3108623324,0sleep10-21swapper/107:28:241
6150991313,0cyclictest41ktimersoftd/010:00:340
6152991212,0cyclictest83050irq/26-0000:00:09:38:382
6152991111,0cyclictest83050irq/26-0000:00:09:36:572
61529988,0cyclictest83050irq/26-0000:00:12:45:522
61529977,0cyclictest83050irq/26-0000:00:11:12:542
61529977,0cyclictest83050irq/26-0000:00:10:43:572
61509970,0cyclictest21959-21kthreadcore09:08:420
8305060,0irq/26-0000:00:32718-21munin-node08:13:433
8305060,0irq/26-0000:00:27381-21python09:33:473
8305060,0irq/26-0000:00:27351-21python07:43:463
8305060,0irq/26-0000:00:24434-21munin-run12:03:252
8305060,0irq/26-0000:00:24246-21diskstats09:13:383
8305060,0irq/26-0000:00:21377-21sensors_temp08:23:473
8305060,0irq/26-0000:00:15900-21chrt09:04:313
8305060,0irq/26-0000:00:11585-21kthreadcore09:23:433
8305060,0irq/26-0000:00:10076-21users07:53:493
61529966,0cyclictest83050irq/26-0000:00:12:51:302
61519960,0cyclictest0-21swapper/112:29:471
61519960,0cyclictest0-21swapper/112:10:521
61519960,0cyclictest0-21swapper/110:03:481
339960,0migration/332752-21munin-node09:18:413
339960,0migration/332460-21sh12:06:383
339960,0migration/33036-21sh10:18:223
339960,0migration/322237-21sh10:45:383
29805060,0irq/28-eth0-rx-19012-21perl10:08:403
29805060,0irq/28-eth0-rx-0-21swapper/311:29:563
149960,0migration/026359-21sh12:22:110
149960,0migration/022230-21sh09:49:010
149960,0migration/019265-21gltestperf10:08:400
149960,0migration/01867-21sh10:15:050
149960,0migration/016792-21sh12:14:390
8305050,0irq/26-0000:00:7787-21aten_r1power_en08:18:363
8305050,0irq/26-0000:00:6314-21runrttasks10:14:382
8305050,0irq/26-0000:00:6017-21irqcore08:38:413
8305050,0irq/26-0000:00:52952chrt10:37:092
8305050,0irq/26-0000:00:30924-21ssh11:48:282
8305050,0irq/26-0000:00:30924-21ssh11:48:282
8305050,0irq/26-0000:00:30418-21ssh12:59:592
8305050,0irq/26-0000:00:29509-21latency_hist08:33:243
8305050,0irq/26-0000:00:28604-21port_sshpriv08:28:463
8305050,0irq/26-0000:00:25942-21kthreadcore09:53:452
8305050,0irq/26-0000:00:23980-21grep10:28:422
8305050,0irq/26-0000:00:21289-21fschecks_count12:38:372
8305050,0irq/26-0000:00:20845-21port_sshpriv12:53:452
8305050,0irq/26-0000:00:17706-21kthreadcore11:38:412
8305050,0irq/26-0000:00:16287-21cut07:38:433
8305050,0irq/26-0000:00:13329-21ssh10:23:402
8305050,0irq/26-0000:00:12071-21ssh12:33:292
8305050,0irq/26-0000:00:11849-21cut11:18:372
8305050,0irq/26-0000:00:0-21swapper/309:28:363
8305050,0irq/26-0000:00:0-21swapper/309:08:363
8305050,0irq/26-0000:00:0-21swapper/308:53:423
8305050,0irq/26-0000:00:0-21swapper/308:44:103
8305050,0irq/26-0000:00:0-21swapper/308:03:433
8305050,0irq/26-0000:00:0-21swapper/307:58:393
8305050,0irq/26-0000:00:0-21swapper/307:48:373
8305050,0irq/26-0000:00:0-21swapper/212:23:432
8305050,0irq/26-0000:00:0-21swapper/210:03:442
61529955,0cyclictest83050irq/26-0000:00:12:10:392
61529954,0cyclictest3524-21snmpd09:13:292
61529950,0cyclictest0-21swapper/211:36:002
61529950,0cyclictest0-21swapper/211:14:242
61519955,0cyclictest0-21swapper/112:42:431
61519955,0cyclictest0-21swapper/112:27:251
61519955,0cyclictest0-21swapper/110:53:181
61519955,0cyclictest0-21swapper/108:53:481
61519950,0cyclictest0-21swapper/111:47:321
61519950,0cyclictest0-21swapper/110:00:201
61519950,0cyclictest0-21swapper/109:53:231
61509955,0cyclictest0-21swapper/013:01:240
61509955,0cyclictest0-21swapper/011:28:420
61509955,0cyclictest0-21swapper/011:01:540
61509950,0cyclictest2028-21md1_raid107:46:150
339950,0migration/38990-21kthreadcore11:53:413
339950,0migration/38249-21timerandwakeup08:58:493
339950,0migration/36645-21cpuspeed_turbos09:43:383
339950,0migration/33903-21fschecks_count10:18:393
339950,0migration/332737-21kthreadcore10:33:453
339950,0migration/329948-21kthreadcore08:08:433
339950,0migration/326984-21munin-node11:08:403
339950,0migration/325941-21needreboot11:23:433
339950,0migration/319774-21kthreadcore11:58:423
339950,0migration/315665-21df_abs09:48:363
339950,0migration/314023-21taskset12:52:403
339950,0migration/313477-21latency_hist11:38:243
339950,0migration/311028-21aten_r1power_cu11:18:343
329950,0watchdog/39750-21cut10:03:353
329950,0watchdog/35699-21sh11:49:393
329950,0watchdog/35699-21sh11:49:393
329950,0watchdog/331059-21kthreadcore12:23:433
29815050,0irq/29-eth0-tx-6372-21munin-node07:33:390
29815050,0irq/29-eth0-tx-6369-21munin-node09:43:382
29815050,0irq/29-eth0-tx-3358-21munin-node10:18:452
29815050,0irq/29-eth0-tx-31214-21munin-node09:18:500
29815050,0irq/29-eth0-tx-25515-21kthreadcore09:33:430
29815050,0irq/29-eth0-tx-23411-21kthreadcore11:23:422
29815050,0irq/29-eth0-tx-18266-21hwlatdetect11:03:372
29815050,0irq/29-eth0-tx-15078-21munin-node08:23:450
29815050,0irq/29-eth0-tx-14050-21unixbench_multi11:53:492
29815050,0irq/29-eth0-tx-0-21swapper/212:14:512
29815050,0irq/29-eth0-tx-0-21swapper/212:03:432
29815050,0irq/29-eth0-tx-0-21swapper/210:40:052
29815050,0irq/29-eth0-tx-0-21swapper/210:08:312
29815050,0irq/29-eth0-tx-0-21swapper/008:50:340
29815050,0irq/29-eth0-tx-0-21swapper/008:03:330
29805050,0irq/28-eth0-rx-9345-21fschecks_time10:58:373
29805050,0irq/28-eth0-rx-6314-21runrttasks12:09:503
29805050,0irq/28-eth0-rx-606-21sh09:58:253
29805050,0irq/28-eth0-rx-3353-21open_inodes12:43:443
29805050,0irq/28-eth0-rx-30367-21tune2fs09:38:393
29805050,0irq/28-eth0-rx-27310-21kthreadcore12:58:423
29805050,0irq/28-eth0-rx-24227-21munin-node09:53:453
29805050,0irq/28-eth0-rx-22832-21ssh12:38:423
29805050,0irq/28-eth0-rx-13796-21kthreadcore10:23:413
29805050,0irq/28-eth0-rx-12957-21ssh10:38:583
29805050,0irq/28-eth0-rx-12547-21diskstats12:33:383
29805050,0irq/28-eth0-rx-0-21swapper/312:20:173
29805050,0irq/28-eth0-rx-0-21swapper/311:34:523
29805050,0irq/28-eth0-rx-0-21swapper/311:13:443
29805050,0irq/28-eth0-rx-0-21swapper/311:03:403
29805050,0irq/28-eth0-rx-0-21swapper/310:53:463
29805050,0irq/28-eth0-rx-0-21swapper/310:48:423
29805050,0irq/28-eth0-rx-0-21swapper/310:29:593
29805050,0irq/28-eth0-rx-0-21swapper/308:48:413
259950,0migration/226134-21fschecks_time08:08:382
259950,0migration/225953-21kthreadcore10:48:422
259950,0migration/223263-21kthreadcore12:18:432
259950,0migration/223157-21fschecks_time11:43:382
259950,0migration/215730-21df_abs09:48:362
249950,0watchdog/216036-21sh11:00:352
19150,0ktimersoftd/10-21swapper/111:22:371
179950,0migration/18989-21latency_hist09:03:231
179950,0migration/18517-21kthreadcore07:33:411
179950,0migration/128619-21kthreadcore12:58:421
179950,0migration/115110-21kthreadcore10:23:421
179950,0migration/115023-21sh11:56:221
179950,0migration/113994-21df_abs09:28:361
169950,0watchdog/130168-21diskstats08:33:381
149950,0migration/09325-21kthreadcore10:38:440
149950,0migration/05070-21kthreadcore12:28:430
149950,0migration/0479-21kthreadcore07:48:420
149950,0migration/04666-21kthreadcore10:53:470
149950,0migration/031227-21kernelversion10:33:440
149950,0migration/030490-21ntp_kernel_pll_09:53:470
149950,0migration/029760-21kthreadcore12:23:430
149950,0migration/029423-21kthreadcore08:53:420
149950,0migration/02854-21kthreadcore09:38:440
149950,0migration/027052-21kthreadcore08:08:420
149950,0migration/026836-21kthreadcore10:48:420
149950,0migration/025852-21latency_hist11:08:240
149950,0migration/025469-21fschecks_time12:03:380
149950,0migration/02531-21cpuspeed_turbos11:13:400
149950,0migration/021445-21sh11:41:470
149950,0migration/020740-21munin-node12:53:440
149950,0migration/017405-21taskset10:06:410
149950,0migration/016159-21kthreadcore09:28:410
149950,0migration/013332-21kthreadcore11:18:410
149950,0migration/013051-21gltestperf10:23:380
149950,0migration/012504-21kthreadcore09:03:430
149950,0migration/010102-21kthreadcore08:18:420
8305040,0irq/26-0000:00:0-21swapper/212:28:432
8305040,0irq/26-0000:00:0-21swapper/210:53:322
61529943,0cyclictest7494-21awk07:33:392
61529943,0cyclictest3524-21snmpd08:45:142
61529943,0cyclictest29550-21munin-node07:48:402
61529943,0cyclictest22051-21awk07:43:392
61529940,0cyclictest0-21swapper/209:09:142
61519944,0cyclictest17410-21kthreadcore12:33:441
61519944,0cyclictest0-21swapper/110:22:051
61519943,0cyclictest3524-21snmpd12:54:471
61519943,0cyclictest3524-21snmpd12:49:021
61519943,0cyclictest3524-21snmpd12:22:021
61519943,0cyclictest3524-21snmpd11:49:021
61519943,0cyclictest3524-21snmpd11:49:021
61519943,0cyclictest3524-21snmpd11:36:011
61519943,0cyclictest3524-21snmpd10:38:311
61519943,0cyclictest3524-21snmpd08:28:281
61519943,0cyclictest23586-21sadc09:13:231
61519943,0cyclictest19231-21awk08:03:371
61519940,0cyclictest0-21swapper/111:10:571
61509944,0cyclictest0-21swapper/011:47:470
61509943,0cyclictest7503-21awk09:43:410
61509943,0cyclictest3524-21snmpd12:08:320
61509943,0cyclictest3524-21snmpd11:35:460
61509943,0cyclictest3524-21snmpd10:32:460
61509943,0cyclictest3524-21snmpd08:33:430
61509943,0cyclictest3524-21snmpd07:39:420
61509943,0cyclictest13310-21awk08:43:380
61509940,0cyclictest0-21swapper/012:47:230
339940,0migration/38475-21kthreadcore12:28:443
29815040,0irq/29-eth0-tx-0-21swapper/009:23:380
29815040,0irq/29-eth0-tx-0-21swapper/009:14:570
29815040,0irq/29-eth0-tx-0-21swapper/008:28:430
29815040,0irq/29-eth0-tx-0-21swapper/007:58:350
29805040,0irq/28-eth0-rx-9917-21kthreadcore07:33:423
29805040,0irq/28-eth0-rx-10142-21df_abs12:13:403
29805040,0irq/28-eth0-rx-0-21swapper/312:53:373
29805040,0irq/28-eth0-rx-0-21swapper/311:43:413
259940,0migration/24435-21kthreadcore08:13:422
259940,0migration/232249-21if_err_eth009:18:402
259940,0migration/229748-21irqcore11:28:422
259940,0migration/226973-21cpu08:53:372
259940,0migration/215044-21irqrtprio09:28:402
259940,0migration/211763-21kthreadcore09:23:432
249940,0watchdog/29311-21kthreadcore08:18:422
249940,0watchdog/23552-21lldpd08:48:272
249940,0watchdog/223979-21kthreadcore08:28:422
249940,0watchdog/219590-21irqstats08:03:382
249940,0watchdog/216392-21kthreadcore07:58:422
249940,0watchdog/215933-21perl08:23:382
249940,0watchdog/210470-21kthreadcore08:38:422
249940,0watchdog/20-21swapper/209:03:432
179940,0migration/19901-21kthreadcore09:23:431
179940,0migration/19719-21taskset11:15:251
179940,0migration/18942-21kthreadcore07:53:421
179940,0migration/13771-21munin-node10:33:491
179940,0migration/132425-21runrttasks08:12:551
179940,0migration/132401-21kthreadcore10:13:461
179940,0migration/123867-21kthreadcore11:23:421
179940,0migration/123439-21kthreadcore08:48:421
179940,0migration/122567-21switchtime11:58:491
179940,0migration/121758-21fschecks_time07:43:371
179940,0migration/120968-21latency08:23:431
179940,0migration/120181-21kthreadcore10:43:441
179940,0migration/11556-21irqcore08:13:411
179940,0migration/11337-21kthreadcore12:43:421
169940,0watchdog/18665-21kthreadcore09:43:431
169940,0watchdog/18379-21fschecks_time08:18:381
169940,0watchdog/17746-21ssh10:56:551
169940,0watchdog/131438-21ssh09:54:431
169940,0watchdog/126003-21ssh10:11:311
169940,0watchdog/125420-21kthreadcore09:13:431
169940,0watchdog/124696-21ssh12:03:351
169940,0watchdog/120865-21ssh10:28:351
169940,0watchdog/12028-21md1_raid109:41:151
169940,0watchdog/119070-21grep11:03:391
169940,0watchdog/11891-21load07:48:421
169940,0watchdog/116393-21kthreadcore07:58:421
169940,0watchdog/10-21swapper/111:38:391
169940,0watchdog/10-21swapper/111:28:431
169940,0watchdog/10-21swapper/110:58:351
169940,0watchdog/10-21swapper/109:33:471
149940,0migration/08418-21kthreadcore08:38:420
149940,0migration/05751-21latency_hist12:48:240
149940,0migration/022498-21kthreadcore11:23:410
61529932,0cyclictest3571-21lldpd08:33:262
61529932,0cyclictest3524-21snmpd07:38:272
61519932,0cyclictest3524-21snmpd08:38:291
61519932,0cyclictest32319-21awk09:18:401
61519932,0cyclictest10803-21awk12:13:431
61519930,0cyclictest9945-21perl09:03:381
61519930,0cyclictest13032-21perl08:43:361
61509933,0cyclictest7032-21kworker/0:110:43:250
61509933,0cyclictest32388-21kworker/0:010:18:390
61509933,0cyclictest30316-21kworker/0:008:58:250
61509933,0cyclictest30316-21kworker/0:008:13:270
61509933,0cyclictest30316-21kworker/0:007:53:310
61509933,0cyclictest15756-21kworker/0:012:38:380
61509933,0cyclictest15756-21kworker/0:012:33:280
61509933,0cyclictest15756-21kworker/0:011:58:250
61509933,0cyclictest15756-21kworker/0:011:53:410
61509933,0cyclictest15756-21kworker/0:011:48:250
61509933,0cyclictest15756-21kworker/0:011:48:250
61509933,0cyclictest15756-21kworker/0:011:03:250
259930,0migration/24595-21kthreadcore08:58:412
249930,0watchdog/20-21swapper/207:54:062
169930,0watchdog/10-21swapper/107:38:421
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional