You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 02:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2.osadl.org (updated Fri Mar 13, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2593024130,0sleep10-21swapper/119:13:261
2624323627,0sleep20-21swapper/219:17:072
2604023626,0sleep30-21swapper/319:14:443
2593423625,0sleep00-21swapper/019:13:290
29805070,0irq/28-eth0-rx-0-21swapper/322:16:333
4160,0ktimersoftd/00-21swapper/000:13:240
339960,0migration/328822-21sh23:38:023
339960,0migration/32326-21sh22:07:543
339960,0migration/31128-21sh21:49:383
339960,0migration/310059-21sh00:24:543
29815060,0irq/29-eth0-tx-8902-21munin-node20:12:500
29815060,0irq/29-eth0-tx-30770-21munin-node21:12:460
29815060,0irq/29-eth0-tx-1545-21munin-node20:07:500
29805060,0irq/28-eth0-rx-26712-21df_abs23:02:433
29805060,0irq/28-eth0-rx-23883-21idleruntime-cro22:42:303
29805060,0irq/28-eth0-rx-19770-21ssh22:02:423
263499963,0cyclictest27264-21awk21:47:451
149960,0migration/07683-21sh22:49:210
149960,0migration/0627-21sh00:17:590
149960,0migration/030590-21sh21:29:160
149960,0migration/025946-21kthreadcore20:22:470
149960,0migration/01882-21sh21:51:450
149960,0migration/017472-21latency_hist22:57:300
8305050,0irq/26-0000:00:26819-21sh20:47:292
339950,0migration/39302-21aten_r1power_vo00:07:423
339950,0migration/37797-21munin-node20:52:483
339950,0migration/37559-21runrttasks00:03:483
339950,0migration/34722-21taskset23:27:323
339950,0migration/330576-21taskset22:27:373
339950,0migration/322725-21fschecks_time22:22:423
339950,0migration/32263-21pmu-power23:22:513
339950,0migration/321490-21taskset23:36:463
339950,0migration/321381-21diskmemload00:32:513
339950,0migration/316884-21taskset21:41:333
339950,0migration/316494-21munin-node20:17:413
339950,0migration/315191-21kthreadcore20:37:483
339950,0migration/315036-21kthreadcore00:27:473
339950,0migration/312259-21idleruntime23:12:453
339950,0migration/312057-21taskset19:51:483
339950,0migration/311568-21kthreadcore22:32:493
329950,0watchdog/37116-21aten_r1power_po23:47:413
329950,0watchdog/331775-21idleruntime21:12:453
329950,0watchdog/327706-21kthreadcore22:42:493
329950,0watchdog/327509-21tr21:07:493
329950,0watchdog/313991-21grep20:57:493
329950,0watchdog/311163-21cut20:32:493
329950,0watchdog/30-21swapper/320:27:493
329950,0watchdog/30-21swapper/320:07:443
329950,0watchdog/30-21swapper/300:12:493
29815050,0irq/29-eth0-tx-919-21ssh23:03:542
29815050,0irq/29-eth0-tx-385-21munin-node00:02:472
29815050,0irq/29-eth0-tx-30281-21munin-node19:42:500
29815050,0irq/29-eth0-tx-23527-21munin-node21:07:530
29815050,0irq/29-eth0-tx-22455-21ssh22:38:322
29815050,0irq/29-eth0-tx-16104-21munin-node20:17:410
29815050,0irq/29-eth0-tx-14322-21ssh22:34:512
29815050,0irq/29-eth0-tx-11153-21munin-node21:57:432
29815050,0irq/29-eth0-tx-0-21swapper/223:31:152
29815050,0irq/29-eth0-tx-0-21swapper/222:57:512
29815050,0irq/29-eth0-tx-0-21swapper/222:54:372
29815050,0irq/29-eth0-tx-0-21swapper/221:42:552
29815050,0irq/29-eth0-tx-0-21swapper/200:41:182
29815050,0irq/29-eth0-tx-0-21swapper/200:12:502
29815050,0irq/29-eth0-tx-0-21swapper/200:08:302
29815050,0irq/29-eth0-tx-0-21swapper/021:17:480
29805050,0irq/28-eth0-rx-9977-21ssh23:09:493
29805050,0irq/28-eth0-rx-6314-21runrttasks00:44:303
29805050,0irq/28-eth0-rx-28511-21kthreadcore21:27:493
29805050,0irq/28-eth0-rx-20554-21kthreadcore22:57:473
29805050,0irq/28-eth0-rx-1779-21cut22:47:463
29805050,0irq/28-eth0-rx-14346-21smartctl22:17:433
29805050,0irq/28-eth0-rx-0-21swapper/323:53:063
29805050,0irq/28-eth0-rx-0-21swapper/323:42:413
29805050,0irq/28-eth0-rx-0-21swapper/322:55:513
29805050,0irq/28-eth0-rx-0-21swapper/321:53:493
29805050,0irq/28-eth0-rx-0-21swapper/321:42:483
29805050,0irq/28-eth0-rx-0-21swapper/321:33:523
29805050,0irq/28-eth0-rx-0-21swapper/300:37:463
29805050,0irq/28-eth0-rx-0-21swapper/300:01:083
263509955,0cyclictest0-21swapper/222:15:522
263509950,0cyclictest0-21swapper/221:24:192
263509950,0cyclictest0-21swapper/200:36:202
263499950,0cyclictest0-21swapper/123:35:371
263499950,0cyclictest0-21swapper/122:51:281
263499950,0cyclictest0-21swapper/121:25:041
263499950,0cyclictest0-21swapper/100:27:011
263489955,0cyclictest0-21swapper/000:10:240
263489950,0cyclictest0-21swapper/023:36:490
263489950,0cyclictest0-21swapper/022:27:270
263489950,0cyclictest0-21swapper/021:36:410
259950,0migration/223316-21aten_r1power_cu21:27:412
259950,0migration/217244-21kthreadcore23:52:472
259950,0migration/214446-21hddtemp_smartct23:32:452
259950,0migration/213792-21kthreadcore20:12:482
259950,0migration/211512-21kthreadcore23:47:482
259950,0migration/210870-21kthreadcore19:47:492
259950,0migration/210751-21sh00:26:512
259950,0migration/210201-21kthreadcore20:32:482
249950,0watchdog/227508-21cut21:07:492
179950,0migration/19335-21kthreadcore00:42:501
179950,0migration/15975-21munin-node21:32:521
179950,0migration/130786-21unixbench-2d23:57:561
179950,0migration/130561-21latency_hist23:42:311
179950,0migration/125414-21munin-node19:57:481
179950,0migration/122533-21kthreadcore22:02:491
179950,0migration/115395-21latency_hist23:52:311
179950,0migration/110072-21munin-node19:27:441
149950,0migration/08703-21kthreadcore00:42:500
149950,0migration/08679-21netstat23:07:500
149950,0migration/07700-21smart_sdb19:22:530
149950,0migration/07319-21kthreadcore23:27:480
149950,0migration/05619-21gltestperf22:12:430
149950,0migration/05119-21taskset19:47:290
149950,0migration/04947-21kthreadcore00:02:490
149950,0migration/03886-21taskset00:40:380
149950,0migration/031294-21fschecks_count23:42:430
149950,0migration/03129-21irqcore20:52:460
149950,0migration/030725-21kthreadcore20:47:460
149950,0migration/030663-21kthreadcore20:02:480
149950,0migration/028484-21kthreadcore22:42:490
149950,0migration/027760-21munin-node19:17:450
149950,0migration/026977-21kthreadcore23:57:480
149950,0migration/02632-21sh00:22:430
149950,0migration/026248-21kthreadcore23:37:480
149950,0migration/025749-21sh21:47:040
149950,0migration/025109-21kthreadcore22:02:500
149950,0migration/024391-21kthreadcore00:32:530
149950,0migration/024083-21munin-node22:57:560
149950,0migration/023685-21fschecks_count19:37:430
149950,0migration/020183-21kthreadcore21:02:480
149950,0migration/019774-21kthreadcore23:52:470
149950,0migration/016258-21kthreadcore21:22:460
149950,0migration/016127-21kthreadcore22:17:470
149950,0migration/016051-21taskset21:01:500
149950,0migration/015438-21latency_hist22:37:300
149950,0migration/014898-21kthreadcore20:37:480
149950,0migration/011325-21kthreadcore23:47:480
8305040,0irq/26-0000:00:0-21swapper/221:17:302
339940,0migration/3709-21taskset19:18:133
339940,0migration/330437-21kthreadcore20:47:463
339940,0migration/31181-21kthreadcore19:42:463
339940,0migration/311412-21kthreadcore20:12:473
329940,0watchdog/30-21swapper/321:17:453
329940,0watchdog/30-21swapper/320:03:203
329940,0watchdog/30-21swapper/319:37:483
329940,0watchdog/30-21swapper/319:27:403
29815040,0irq/29-eth0-tx-32600-21ssh21:32:442
29815040,0irq/29-eth0-tx-2560-21cut22:27:482
29815040,0irq/29-eth0-tx-2534-21aten2.4-expect21:52:412
29815040,0irq/29-eth0-tx-12248-21kthreadcore21:37:482
29815040,0irq/29-eth0-tx-0-21swapper/223:57:322
29815040,0irq/29-eth0-tx-0-21swapper/223:37:362
29815040,0irq/29-eth0-tx-0-21swapper/223:22:472
29815040,0irq/29-eth0-tx-0-21swapper/223:17:482
29815040,0irq/29-eth0-tx-0-21swapper/223:12:452
29815040,0irq/29-eth0-tx-0-21swapper/222:47:492
29815040,0irq/29-eth0-tx-0-21swapper/222:17:462
29815040,0irq/29-eth0-tx-0-21swapper/222:02:382
29815040,0irq/29-eth0-tx-0-21swapper/221:47:352
29815040,0irq/29-eth0-tx-0-21swapper/200:42:392
29815040,0irq/29-eth0-tx-0-21swapper/200:17:442
29805040,0irq/28-eth0-rx-20765-21kthreadcore19:32:483
29805040,0irq/28-eth0-rx-20720-21fschecks_time23:17:433
29805040,0irq/28-eth0-rx-0-21swapper/321:58:123
29805040,0irq/28-eth0-rx-0-21swapper/321:22:303
29805040,0irq/28-eth0-rx-0-21swapper/321:02:303
29805040,0irq/28-eth0-rx-0-21swapper/320:42:503
29805040,0irq/28-eth0-rx-0-21swapper/300:17:483
263509943,0cyclictest3524-21snmpd19:39:432
263509943,0cyclictest24154-21munin-node22:42:422
263509940,0cyclictest0-21swapper/219:32:292
263499944,0cyclictest0-21swapper/122:33:391
263499944,0cyclictest0-21swapper/100:32:511
263499943,0cyclictest3571-21lldpd21:46:561
263499943,0cyclictest3524-21snmpd20:29:431
263499943,0cyclictest31791-21awk22:27:461
263499943,0cyclictest27504-21awk00:17:461
263499943,0cyclictest23039-21awk22:22:431
263499943,0cyclictest18797-21awk22:57:451
263499943,0cyclictest12310-21awk23:12:451
263489943,0cyclictest9786-21awk21:37:450
263489943,0cyclictest3571-21lldpd20:27:550
263489943,0cyclictest3524-21snmpd20:42:430
263489943,0cyclictest2203-21sadc23:07:300
263489941,0cyclictest0-21swapper/019:27:390
259940,0migration/29288-21runrttasks23:07:572
259940,0migration/2868-21kthreadcore23:42:472
259940,0migration/24549-21kthreadcore20:07:462
259940,0migration/24034-21latency20:27:512
259940,0migration/231950-21kthreadcore20:47:472
259940,0migration/231477-21kthreadcore22:07:482
259940,0migration/230560-21cpuspeed_turbos19:42:412
259940,0migration/229766-21kthreadcore20:02:482
259940,0migration/223649-21df20:22:422
259940,0migration/221728-21kthreadcore19:57:462
259940,0migration/212504-21irqcore00:27:462
259940,0migration/210344-21munin-node20:57:462
249940,0watchdog/29095-21sed19:27:402
249940,0watchdog/231776-21idleruntime21:12:452
249940,0watchdog/222535-21python21:02:532
249940,0watchdog/222319-21df22:22:412
249940,0watchdog/20-21swapper/220:17:452
249940,0watchdog/20-21swapper/219:52:442
179940,0migration/17696-21kthreadcore22:12:471
179940,0migration/15414-21kthreadcore20:52:471
179940,0migration/15093-21kthreadcore00:02:491
179940,0migration/14948-21latency_hist19:47:291
179940,0migration/131089-21kthreadcore22:07:481
179940,0migration/131045-21kthreadcore19:17:471
179940,0migration/129458-21kthreadcore20:02:481
179940,0migration/127648-21irqcore23:02:471
179940,0migration/126851-21kthreadcore19:37:471
179940,0migration/124614-21kthreadcore23:37:471
179940,0migration/122579-21taskset23:53:351
179940,0migration/118767-21sh22:00:371
179940,0migration/118583-21runrttasks20:37:501
179940,0migration/11791-21cpuspeed_turbos20:07:411
179940,0migration/116065-21taskset21:01:591
179940,0migration/115974-21latency_hist20:17:291
179940,0migration/115370-21kthreadcore22:17:471
179940,0migration/114537-21kthreadcore00:27:471
169940,0watchdog/19929-21ssh21:54:531
169940,0watchdog/13734-21ssh00:40:131
169940,0watchdog/115861-21ssh21:39:011
169940,0watchdog/110076-21grep19:47:481
169940,0watchdog/10-21swapper/121:27:531
169940,0watchdog/10-21swapper/121:17:451
169940,0watchdog/10-21swapper/121:12:451
169940,0watchdog/10-21swapper/120:32:491
169940,0watchdog/10-21swapper/120:17:451
169940,0watchdog/10-21swapper/119:52:441
149940,0migration/05143-21kthreadcore21:52:470
149940,0migration/025205-21kthreadcore19:57:470
149940,0migration/023107-21kthreadcore23:17:470
4130,0ktimersoftd/00-21swapper/019:55:370
329930,0watchdog/30-21swapper/319:22:483
29805030,0irq/28-eth0-rx-0-21swapper/320:22:393
29805030,0irq/28-eth0-rx-0-21swapper/320:01:493
29805030,0irq/28-eth0-rx-0-21swapper/319:52:353
263509932,0cyclictest3606-21kthreadcore20:52:462
263509932,0cyclictest3524-21snmpd19:19:432
263509932,0cyclictest2568-21awk19:22:462
263509930,0cyclictest18417-21grep20:37:492
263499932,0cyclictest4496-21sadc23:27:301
263499932,0cyclictest3571-21lldpd23:08:261
263499932,0cyclictest3524-21snmpd22:39:001
263499932,0cyclictest25241-21awk22:42:451
263499932,0cyclictest21003-21awk20:42:471
263499932,0cyclictest16986-21awk19:32:451
263499931,0cyclictest8514-21kthreadcore23:27:491
263499930,0cyclictest26173-21sensors_fan23:17:521
263499930,0cyclictest22467-21kthreadcore00:12:501
263489932,0cyclictest3524-21snmpd23:23:020
263489932,0cyclictest2338-21cut22:27:480
263489932,0cyclictest12328-21awk00:27:450
263489932,0cyclictest12218-21awk21:57:450
263489932,0cyclictest0-21swapper/020:32:300
263489930,0cyclictest31686-21grep22:07:480
263489930,0cyclictest16775-21perl19:32:430
263489930,0cyclictest11602-21df_abs23:12:420
169930,0watchdog/10-21swapper/122:52:331
169930,0watchdog/10-21swapper/121:07:491
169930,0watchdog/10-21swapper/121:02:491
169930,0watchdog/10-21swapper/120:22:571
169930,0watchdog/10-21swapper/100:07:371
263489920,0cyclictest0-21swapper/022:32:310
169920,0watchdog/10-21swapper/120:47:331
169920,0watchdog/10-21swapper/119:22:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional