You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 19:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Mon Jun 29, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
651424939,0sleep30-21swapper/307:24:393
660424029,0sleep00-21swapper/007:25:400
642223626,0sleep20-21swapper/207:23:342
642623424,0sleep10-21swapper/107:23:371
67499973,0cyclictest8508-21awk08:56:392
67489970,0cyclictest15745-21kthreadcore10:36:461
339970,0migration/3690-21munin-node10:11:413
67499965,0cyclictest0-21swapper/210:00:232
67499963,0cyclictest3571-21lldpd07:54:262
67479960,0cyclictest0-21swapper/010:22:050
35160,0ktimersoftd/30-21swapper/311:35:013
339960,0migration/35497-21sh09:55:393
339960,0migration/33044-21munin-node12:01:553
339960,0migration/323344-21sh12:33:423
339960,0migration/321141-21sh12:13:513
339960,0migration/317799-21aten_r1power_en11:36:373
339960,0migration/315008-21sh12:29:303
339960,0migration/313346-21sh09:58:203
339960,0migration/312448-21kernelversion08:36:423
339960,0migration/311053-21sh09:39:213
29815060,0irq/29-eth0-tx-3657-21munin-node08:31:400
29805060,0irq/28-eth0-rx-0-21swapper/312:20:163
29805060,0irq/28-eth0-rx-0-21swapper/310:55:363
149960,0migration/021259-21sh12:14:080
149960,0migration/019741-21sh11:56:220
149960,0migration/012049-21sh12:07:400
8305050,0irq/26-0000:00:0-21swapper/308:01:253
67499950,0cyclictest0-21swapper/212:26:032
67499950,0cyclictest0-21swapper/212:18:012
67499950,0cyclictest0-21swapper/211:51:502
67499950,0cyclictest0-21swapper/211:05:202
67499950,0cyclictest0-21swapper/209:31:032
67489955,0cyclictest0-21swapper/112:36:541
67489955,0cyclictest0-21swapper/108:16:371
67489950,0cyclictest0-21swapper/111:50:241
67489950,0cyclictest0-21swapper/111:41:431
67489950,0cyclictest0-21swapper/111:23:361
67489950,0cyclictest0-21swapper/110:44:111
67479955,0cyclictest8469-21kworker/0:110:46:370
67479955,0cyclictest8469-21kworker/0:110:41:590
67479955,0cyclictest8469-21kworker/0:110:36:390
67479955,0cyclictest8469-21kworker/0:110:32:130
67479955,0cyclictest5412-21kworker/0:011:26:410
67479955,0cyclictest5412-21kworker/0:011:22:050
67479955,0cyclictest5412-21kworker/0:011:16:430
67479955,0cyclictest5412-21kworker/0:010:56:290
67479955,0cyclictest5412-21kworker/0:010:53:250
67479955,0cyclictest29651-21kworker/0:210:26:410
67479955,0cyclictest29651-21kworker/0:210:06:590
67479955,0cyclictest29651-21kworker/0:210:03:370
67479955,0cyclictest29651-21kworker/0:209:51:370
67479955,0cyclictest28745-21kworker/0:012:51:510
67479955,0cyclictest28745-21kworker/0:012:47:090
67479955,0cyclictest28745-21kworker/0:012:39:370
67479955,0cyclictest28745-21kworker/0:012:27:090
67479955,0cyclictest28745-21kworker/0:012:21:470
67479955,0cyclictest28745-21kworker/0:012:17:270
67479955,0cyclictest27631-21kworker/0:109:45:110
67479955,0cyclictest27631-21kworker/0:109:32:110
67479955,0cyclictest27631-21kworker/0:109:21:450
67479955,0cyclictest15457-21kworker/0:111:42:490
67479955,0cyclictest15457-21kworker/0:111:37:130
67479955,0cyclictest0-21swapper/010:16:530
67479955,0cyclictest0-21swapper/008:26:400
67479954,0cyclictest13967-21ls07:31:250
67479953,0cyclictest27631-21kworker/0:109:46:450
67479950,0cyclictest0-21swapper/012:31:400
67479950,0cyclictest0-21swapper/011:56:400
67479950,0cyclictest0-21swapper/011:06:510
67479950,0cyclictest0-21swapper/010:11:400
4150,0ktimersoftd/00-21swapper/011:12:030
339950,0migration/39167-21kthreadcore12:06:433
339950,0migration/38340-21kthreadcore09:16:423
339950,0migration/37417-21cpuspeed_turbos08:11:383
339950,0migration/332288-21aten_r1power_en08:06:353
339950,0migration/330570-21aten_r1power_po11:06:383
339950,0migration/329999-21munin-node09:11:423
339950,0migration/32814-21taskset10:47:543
339950,0migration/327468-21kthreadcore08:46:423
339950,0migration/326709-21kthreadcore10:06:433
339950,0migration/323525-21taskset11:20:343
339950,0migration/323473-21kthreadcore12:51:463
339950,0migration/322394-21fschecks_time08:21:393
339950,0migration/322210-21munin-node11:01:393
339950,0migration/322003-21cpuspeed_turbos09:06:363
339950,0migration/321837-21munin-node07:36:403
339950,0migration/318040-21latency_hist08:41:253
339950,0migration/317706-21fschecks_count10:21:403
339950,0migration/314262-21taskset11:14:023
339950,0migration/31212-21taskset09:32:053
339950,0migration/311216-21kthreadcore10:16:443
329950,0watchdog/33456-21kthreadcore08:51:443
329950,0watchdog/332072-21if_err_eth012:21:413
329950,0watchdog/316992-21cut07:31:443
329950,0watchdog/316192-21kthreadcore07:51:443
329950,0watchdog/30-21swapper/312:46:373
29815050,0irq/29-eth0-tx-10902-21munin-node08:36:450
29815050,0irq/29-eth0-tx-0-21swapper/009:16:450
29805050,0irq/28-eth0-rx-9363-21latency_hist12:46:273
29805050,0irq/28-eth0-rx-32756-21munin-node11:41:493
29805050,0irq/28-eth0-rx-20582-21if_eth110:41:423
29805050,0irq/28-eth0-rx-19766-21kthreadcore09:01:443
29805050,0irq/28-eth0-rx-16570-21cat10:01:423
29805050,0irq/28-eth0-rx-0-21swapper/312:38:573
29805050,0irq/28-eth0-rx-0-21swapper/311:58:063
29805050,0irq/28-eth0-rx-0-21swapper/311:46:413
29805050,0irq/28-eth0-rx-0-21swapper/311:26:403
29805050,0irq/28-eth0-rx-0-21swapper/311:22:203
29805050,0irq/28-eth0-rx-0-21swapper/310:56:353
29805050,0irq/28-eth0-rx-0-21swapper/310:36:453
29805050,0irq/28-eth0-rx-0-21swapper/310:34:443
29805050,0irq/28-eth0-rx-0-21swapper/309:47:033
29805050,0irq/28-eth0-rx-0-21swapper/309:42:263
19150,0ktimersoftd/10-21swapper/111:35:011
19150,0ktimersoftd/10-21swapper/111:10:131
179950,0migration/16118-21kthreadcore10:51:441
179950,0migration/14536-21kthreadcore08:06:421
179950,0migration/132020-21kthreadcore07:41:411
179950,0migration/130183-21fschecks_count09:51:391
179950,0migration/128196-21kthreadcore08:46:421
179950,0migration/117511-21timerwakeupswit09:21:521
179950,0migration/116713-21kthreadcore07:31:441
179950,0migration/115527-21kthreadcore09:41:431
179950,0migration/113940-21taskset08:14:091
179950,0migration/111705-21idleruntime07:51:411
179950,0migration/111622-21kthreadcore11:11:451
149950,0migration/09875-21fschecks_time11:31:410
149950,0migration/07109-21munin-node12:41:460
149950,0migration/04864-21irqrtprio09:36:430
149950,0migration/030541-21kthreadcore07:41:400
149950,0migration/029327-21fschecks_count12:01:410
149950,0migration/027618-21kthreadcore08:01:400
149950,0migration/02666-21taskset11:46:370
149950,0migration/025325-21aten_r1power_en08:46:350
149950,0migration/023086-21irqcore11:01:430
149950,0migration/023019-21kthreadcore08:41:430
149950,0migration/022181-21fschecks_time07:36:410
149950,0migration/020274-21kthreadcore09:26:440
149950,0migration/018829-21munin-node07:56:400
149950,0migration/012582-21timerwakeupswit09:56:490
8305040,0irq/26-0000:00:0-21swapper/211:56:402
67499944,0cyclictest0-21swapper/212:27:282
67499944,0cyclictest0-21swapper/209:37:312
67499943,0cyclictest9477-21awk10:16:422
67499943,0cyclictest691-21awk10:11:412
67499943,0cyclictest4843-21awk08:31:412
67499943,0cyclictest3571-21lldpd10:56:272
67499943,0cyclictest3571-21lldpd10:47:282
67499943,0cyclictest3571-21lldpd10:37:582
67499943,0cyclictest3571-21lldpd10:34:582
67499943,0cyclictest3571-21lldpd10:29:282
67499943,0cyclictest3571-21lldpd10:06:272
67499943,0cyclictest3571-21lldpd09:02:262
67499943,0cyclictest3571-21lldpd07:29:252
67499943,0cyclictest3524-21snmpd10:51:552
67499943,0cyclictest3524-21snmpd09:11:552
67499943,0cyclictest3524-21snmpd08:41:092
67499943,0cyclictest29739-21awk07:41:392
67499943,0cyclictest27931-21awk09:31:422
67499943,0cyclictest26686-21sadc12:56:272
67499943,0cyclictest26422-21awk08:46:402
67499943,0cyclictest25274-21awk11:21:422
67499943,0cyclictest18900-21awk11:36:412
67499943,0cyclictest13731-21tail09:41:422
67499943,0cyclictest12190-21awk09:21:422
67499943,0cyclictest10293-21awk11:31:432
67499943,0cyclictest0-21swapper/212:11:262
67489944,0cyclictest0-21swapper/111:58:071
67489944,0cyclictest0-21swapper/110:10:451
67489943,0cyclictest4954-21awk09:16:391
67489943,0cyclictest3571-21lldpd11:36:281
67489943,0cyclictest3571-21lldpd10:16:271
67489943,0cyclictest3571-21lldpd10:14:281
67489943,0cyclictest3571-21lldpd09:46:261
67489943,0cyclictest3524-21snmpd12:46:261
67489943,0cyclictest3524-21snmpd08:58:091
67489943,0cyclictest29844-21awk08:26:421
67489943,0cyclictest23440-21awk12:16:421
67489943,0cyclictest19310-21tail12:51:421
67489943,0cyclictest16508-21awk11:16:391
67479944,0cyclictest27631-21kworker/0:109:01:410
67479944,0cyclictest27631-21kworker/0:108:56:410
67479944,0cyclictest27631-21kworker/0:108:51:450
67479943,0cyclictest8228-21awk08:11:410
67479943,0cyclictest3571-21lldpd08:06:260
67479943,0cyclictest3250-21irqbalance09:12:520
67479943,0cyclictest3250-21irqbalance08:22:220
67479943,0cyclictest3250-21irqbalance08:16:320
339940,0migration/319057-21kthreadcore08:16:433
339940,0migration/31711-21kthreadcore07:41:413
339940,0migration/313749-21taskset07:29:033
329940,0watchdog/30-21swapper/310:26:373
329940,0watchdog/30-21swapper/309:28:003
329940,0watchdog/30-21swapper/308:56:403
329940,0watchdog/30-21swapper/307:56:443
329940,0watchdog/30-21swapper/307:46:443
29815040,0irq/29-eth0-tx-0-21swapper/211:28:472
29815040,0irq/29-eth0-tx-0-21swapper/211:07:542
29815040,0irq/29-eth0-tx-0-21swapper/210:46:052
29815040,0irq/29-eth0-tx-0-21swapper/209:46:422
29815040,0irq/29-eth0-tx-0-21swapper/007:31:460
29805040,0irq/28-eth0-rx-0-21swapper/311:51:443
29805040,0irq/28-eth0-rx-0-21swapper/309:21:423
249940,0watchdog/24802-21ssh09:53:452
249940,0watchdog/231532-21ssh12:37:252
249940,0watchdog/20-21swapper/211:11:292
249940,0watchdog/20-21swapper/208:51:442
179940,0migration/17373-21irqcore09:56:401
179940,0migration/16877-21kthreadcore08:31:421
179940,0migration/15630-21fschecks_count12:06:391
179940,0migration/14268-21kthreadcore12:21:441
179940,0migration/131985-21kthreadcore12:01:451
179940,0migration/131351-21kthreadcore10:46:441
179940,0migration/129200-21kthreadcore08:01:411
179940,0migration/124176-21timerandwakeup07:56:521
179940,0migration/124155-21kthreadcore07:36:451
179940,0migration/122762-21kthreadcore10:21:461
179940,0migration/122706-21kthreadcore09:26:451
179940,0migration/117359-21irqcore12:31:431
179940,0migration/116777-21kthreadcore10:01:421
179940,0migration/115556-21kthreadcore08:36:431
179940,0migration/115197-21fschecks_count09:01:391
179940,0migration/114410-21irqcore10:56:441
179940,0migration/111830-21df_abs11:51:401
169940,0watchdog/19595-21ps07:46:481
169940,0watchdog/18848-21kthreadcore09:36:441
169940,0watchdog/132510-21ssh10:26:571
169940,0watchdog/127156-21grep11:01:451
169940,0watchdog/122092-21cpuspeed_turbos09:06:361
169940,0watchdog/111779-21cut07:26:441
169940,0watchdog/110322-21cut12:46:371
149940,0migration/023266-21irqrtprio09:06:410
149940,0migration/013637-21kthreadcore07:51:430
8305030,0irq/26-0000:00:0-21swapper/308:26:353
67499932,0cyclictest9486-21kthreadcore08:11:432
67499932,0cyclictest6092-21awk12:06:412
67499932,0cyclictest3571-21lldpd11:46:272
67499932,0cyclictest3571-21lldpd10:21:272
67499932,0cyclictest29971-21awk08:26:432
67499932,0cyclictest17196-21awk12:31:432
67499932,0cyclictest15485-21hostname11:16:352
67499932,0cyclictest1010-21awk08:06:402
67499930,0cyclictest6946-21cut09:16:422
67499930,0cyclictest3820-21sed07:46:402
67499930,0cyclictest25000-21cat09:06:422
67499930,0cyclictest15192-21perl08:16:382
67499930,0cyclictest0-21swapper/212:41:332
67499930,0cyclictest0-21swapper/212:01:372
67489932,0cyclictest3571-21lldpd12:11:291
67489932,0cyclictest3571-21lldpd08:51:261
67489932,0cyclictest3250-21irqbalance10:31:321
67489932,0cyclictest1487-21awk11:26:421
67479932,0cyclictest4567-21awk07:46:420
29815030,0irq/29-eth0-tx-0-21swapper/211:41:422
249930,0watchdog/226614-21ps08:01:402
249930,0watchdog/20-21swapper/212:46:372
249930,0watchdog/20-21swapper/210:01:412
249930,0watchdog/20-21swapper/208:41:282
249930,0watchdog/20-21swapper/208:23:002
249930,0watchdog/20-21swapper/207:40:242
249930,0watchdog/20-21swapper/207:31:522
179930,0migration/122945-21irqcore08:21:421
179930,0migration/118837-21fschecks_time08:41:381
169930,0watchdog/10-21swapper/112:26:371
169930,0watchdog/10-21swapper/109:31:441
67499920,0cyclictest0-21swapper/207:56:262
329920,0watchdog/30-21swapper/308:31:323
169920,0watchdog/10-21swapper/109:11:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional