You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 09:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2.osadl.org (updated Mon Jan 12, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2224225039,0sleep00-21swapper/019:10:410
2228323626,0sleep30-21swapper/319:11:083
2208423625,0sleep20-21swapper/219:08:512
2215723425,0sleep10-21swapper/119:09:421
339960,0migration/38744-21sh21:13:463
339960,0migration/38592-21sh00:42:183
339960,0migration/323294-21munin-node20:42:453
339960,0migration/320787-21sh22:55:283
339960,0migration/317877-21sh21:19:553
339960,0migration/315034-21kthreadcore22:32:513
339960,0migration/314468-21sh23:10:553
29815060,0irq/29-eth0-tx-30410-21munin-node20:47:500
29805060,0irq/28-eth0-rx-9255-21ksmtuned22:28:043
29805060,0irq/28-eth0-rx-24287-21df23:17:443
29805060,0irq/28-eth0-rx-19690-21diskstats21:22:453
29805060,0irq/28-eth0-rx-16083-21fschecks_count00:27:453
149960,0migration/06749-21kthreadcore22:47:510
149960,0migration/028278-21timerandwakeup22:57:560
149960,0migration/028269-21kthreadcore19:57:490
149960,0migration/019040-21sh23:51:280
149960,0migration/017839-21cpuspeed_turbos23:32:440
8305050,0irq/26-0000:00:4561-21munin-node00:17:572
8305050,0irq/26-0000:00:2039-21perf23:42:322
4150,0ktimersoftd/00-21swapper/019:22:360
339950,0migration/37559-21munin-node20:27:523
339950,0migration/36409-21kthreadcore21:32:483
339950,0migration/35205-21fschecks_count00:02:463
339950,0migration/33622-21pmu-power19:18:063
339950,0migration/326815-21latency_hist21:07:313
339950,0migration/326392-21latency_hist19:37:313
339950,0migration/325529-21kthreadcore19:57:493
339950,0migration/325208-21kthreadcore22:37:533
339950,0migration/32339-21timerandwakeup22:42:573
339950,0migration/321753-21sh19:52:523
339950,0migration/321459-21taskset21:41:503
339950,0migration/315257-21latency_hist23:12:313
339950,0migration/315126-21kthreadcore23:47:503
339950,0migration/313469-21irqrtprio19:27:473
339950,0migration/312006-21taskset20:12:253
339950,0migration/311380-21pmu-power20:52:523
329950,0watchdog/37256-21kthreadcore19:22:503
329950,0watchdog/34231-21tr00:17:513
329950,0watchdog/34124-21munin-node23:02:513
329950,0watchdog/325810-21grep00:32:513
329950,0watchdog/30-21swapper/322:17:513
329950,0watchdog/30-21swapper/321:52:463
329950,0watchdog/30-21swapper/300:12:433
29815050,0irq/29-eth0-tx-8864-21ssh23:27:322
29815050,0irq/29-eth0-tx-5886-21ssh23:05:562
29815050,0irq/29-eth0-tx-4189-21ssh22:47:272
29815050,0irq/29-eth0-tx-25469-21kthreadcore21:42:502
29815050,0irq/29-eth0-tx-19412-21ssh22:37:292
29815050,0irq/29-eth0-tx-0-21swapper/222:52:532
29815050,0irq/29-eth0-tx-0-21swapper/222:20:082
29815050,0irq/29-eth0-tx-0-21swapper/221:58:522
29815050,0irq/29-eth0-tx-0-21swapper/200:10:592
29815050,0irq/29-eth0-tx-0-21swapper/200:05:322
29815050,0irq/29-eth0-tx-0-21swapper/021:02:410
29815050,0irq/29-eth0-tx-0-21swapper/020:42:560
29815050,0irq/29-eth0-tx-0-21swapper/020:27:520
29815050,0irq/29-eth0-tx-0-21swapper/020:26:550
29815050,0irq/29-eth0-tx-0-21swapper/019:17:560
29805050,0irq/28-eth0-rx-9696-21grep22:12:453
29805050,0irq/28-eth0-rx-3979-21kthreadcore22:07:493
29805050,0irq/28-eth0-rx-31592-21awk22:05:043
29805050,0irq/28-eth0-rx-25876-21cut22:57:483
29805050,0irq/28-eth0-rx-20044-21ssh00:08:113
29805050,0irq/28-eth0-rx-13627-21ssh00:23:123
29805050,0irq/28-eth0-rx-0-21swapper/323:42:503
29805050,0irq/28-eth0-rx-0-21swapper/323:37:543
29805050,0irq/28-eth0-rx-0-21swapper/323:32:513
29805050,0irq/28-eth0-rx-0-21swapper/322:48:353
29805050,0irq/28-eth0-rx-0-21swapper/321:58:453
29805050,0irq/28-eth0-rx-0-21swapper/321:42:493
29805050,0irq/28-eth0-rx-0-21swapper/320:22:483
259950,0migration/27889-21idleruntime21:52:442
259950,0migration/27203-21sh00:38:232
259950,0migration/26208-21gltestperf20:52:452
259950,0migration/225650-21missed_timers22:37:542
259950,0migration/224383-21cpuspeed_turbos00:32:462
259950,0migration/223948-21sh23:17:412
259950,0migration/215556-21aten_r1power_po00:27:442
259950,0migration/215111-21netstat22:12:522
259950,0migration/210399-21kthreadcore00:22:502
249950,0watchdog/29060-21kthreadcore20:07:502
224739955,0cyclictest1514-21diskmemload23:27:092
224739950,0cyclictest0-21swapper/222:09:442
224739950,0cyclictest0-21swapper/221:27:382
224739950,0cyclictest0-21swapper/221:18:302
224739950,0cyclictest0-21swapper/220:42:522
224729955,0cyclictest0-21swapper/123:12:501
224729955,0cyclictest0-21swapper/119:12:431
224719955,0cyclictest0-21swapper/023:22:430
224719955,0cyclictest0-21swapper/000:01:110
224719950,0cyclictest0-21swapper/022:16:020
224719950,0cyclictest0-21swapper/022:02:470
224719950,0cyclictest0-21swapper/021:27:380
19150,0ktimersoftd/10-21swapper/121:25:091
179950,0migration/19679-21taskset21:16:201
179950,0migration/13942-21timerwakeupswit19:18:101
179950,0migration/128732-21kthreadcore23:37:501
179950,0migration/128633-21kthreadcore20:22:471
179950,0migration/124718-21fschecks_count22:02:461
179950,0migration/123862-21fschecks_time20:42:471
179950,0migration/123324-21taskset22:01:051
179950,0migration/121610-21kthreadcore19:32:481
179950,0migration/11346-21kthreadcore23:57:511
179950,0migration/110268-21kthreadcore20:52:501
169950,0watchdog/18443-21kernelversion21:52:461
169950,0watchdog/16117-21ssh00:21:191
169950,0watchdog/123969-21idleruntime19:57:461
149950,0migration/08539-21needreboot22:27:520
149950,0migration/06756-21switchtime00:37:570
149950,0migration/06017-21gltestperf20:07:460
149950,0migration/05551-21cpuspeed_turbos20:52:440
149950,0migration/04666-21taskset20:05:540
149950,0migration/04166-21kthreadcore21:12:470
149950,0migration/031809-21taskset00:35:510
149950,0migration/027441-21kthreadcore21:42:500
149950,0migration/02549-21cpuspeed_turbos23:42:440
149950,0migration/024296-21kthreadcore22:37:530
149950,0migration/024184-21kthreadcore21:22:510
149950,0migration/02183-21latency_hist22:27:320
149950,0migration/020076-21kthreadcore20:37:510
149950,0migration/018228-21fschecks_count22:17:460
149950,0migration/018078-21kthreadcore20:57:510
149950,0migration/017751-21kthreadcore22:52:500
149950,0migration/016810-21kthreadcore20:12:510
149950,0migration/016734-21idleruntime19:52:460
149950,0migration/01575-21latency_hist21:12:310
149950,0migration/015222-21kthreadcore21:37:490
149950,0migration/013918-21kthreadcore19:27:480
149950,0migration/011139-21aten_r1power_cu22:32:440
149950,0migration/011110-21kthreadcore00:22:500
4140,0ktimersoftd/00-21swapper/020:18:350
339940,0migration/326288-21aten_r1power_en22:22:423
339940,0migration/320442-21kthreadcore20:37:513
339940,0migration/314581-21pmu-power19:47:513
339940,0migration/31418-21taskset21:11:343
329940,0watchdog/31733-21cat21:27:503
329940,0watchdog/30-21swapper/321:47:503
329940,0watchdog/30-21swapper/320:47:423
329940,0watchdog/30-21swapper/320:02:503
29815040,0irq/29-eth0-tx-22839-21telnet19:12:420
29815040,0irq/29-eth0-tx-0-21swapper/223:47:372
29815040,0irq/29-eth0-tx-0-21swapper/223:42:462
29815040,0irq/29-eth0-tx-0-21swapper/223:32:592
29815040,0irq/29-eth0-tx-0-21swapper/223:12:452
29815040,0irq/29-eth0-tx-0-21swapper/222:58:112
29815040,0irq/29-eth0-tx-0-21swapper/222:22:462
29815040,0irq/29-eth0-tx-0-21swapper/221:37:512
29815040,0irq/29-eth0-tx-0-21swapper/221:32:362
29805040,0irq/28-eth0-rx-0-21swapper/323:57:503
29805040,0irq/28-eth0-rx-0-21swapper/323:52:393
29805040,0irq/28-eth0-rx-0-21swapper/323:27:453
29805040,0irq/28-eth0-rx-0-21swapper/323:22:483
29805040,0irq/28-eth0-rx-0-21swapper/319:42:443
259940,0migration/25998-21irqcore19:22:492
259940,0migration/23396-21kthreadcore20:27:502
259940,0migration/231156-21fschecks_count21:47:452
259940,0migration/221831-21kthreadcore21:02:482
259940,0migration/219159-21runrttasks20:58:362
249940,0watchdog/20-21swapper/223:07:512
249940,0watchdog/20-21swapper/220:02:502
249940,0watchdog/20-21swapper/219:18:022
224739943,0cyclictest5725-21awk22:47:502
224739943,0cyclictest3524-21snmpd23:57:342
224739943,0cyclictest3524-21snmpd23:52:342
224739943,0cyclictest3524-21snmpd22:27:332
224739943,0cyclictest3524-21snmpd22:02:332
224739943,0cyclictest3524-21snmpd21:22:332
224739943,0cyclictest3524-21snmpd20:48:482
224739943,0cyclictest3524-21snmpd20:37:482
224739943,0cyclictest3524-21snmpd20:35:482
224739943,0cyclictest3524-21snmpd20:24:332
224739943,0cyclictest3524-21snmpd20:17:322
224739943,0cyclictest3524-21snmpd20:15:322
224739943,0cyclictest3524-21snmpd19:52:472
224739943,0cyclictest3524-21snmpd19:47:322
224739943,0cyclictest3524-21snmpd19:38:322
224739943,0cyclictest3524-21snmpd19:16:022
224739943,0cyclictest3524-21snmpd00:12:352
224739943,0cyclictest2837-21awk21:12:452
224739943,0cyclictest24024-21awk19:57:462
224739943,0cyclictest13158-21awk19:27:472
224729944,0cyclictest0-21swapper/123:54:461
224729944,0cyclictest0-21swapper/122:19:141
224729943,0cyclictest6167-21awk20:07:481
224729943,0cyclictest3524-21snmpd21:48:031
224729943,0cyclictest3524-21snmpd21:34:331
224729943,0cyclictest3524-21snmpd21:07:331
224729943,0cyclictest3524-21snmpd21:02:331
224729943,0cyclictest3524-21snmpd21:01:331
224729943,0cyclictest31538-21awk20:47:461
224729943,0cyclictest18722-21awk23:32:481
224729943,0cyclictest14326-21awk00:07:471
224729943,0cyclictest12174-21awk22:32:481
224729943,0cyclictest11479-21awk21:17:471
224729943,0cyclictest10029-21awk23:27:491
224729940,0cyclictest0-21swapper/123:49:341
224719944,0cyclictest0-21swapper/000:10:290
224719943,0cyclictest3571-21lldpd23:54:030
224719943,0cyclictest3571-21lldpd21:57:590
224719943,0cyclictest3524-21snmpd22:43:040
224719943,0cyclictest1384-21awk22:07:460
19140,0ktimersoftd/10-21swapper/100:26:561
179940,0migration/17458-21kthreadcore19:22:501
179940,0migration/16552-21kthreadcore23:42:501
179940,0migration/1573-21runrttasks22:23:171
179940,0migration/13044-21fschecks_count22:27:461
179940,0migration/129510-21kthreadcore19:37:491
179940,0migration/128885-21kthreadcore00:32:521
179940,0migration/128566-21munin-node21:27:441
179940,0migration/128514-21cpuspeed_turbos22:42:431
179940,0migration/128116-21latency_hist22:42:321
179940,0migration/126483-21kthreadcore23:17:491
179940,0migration/122578-21kthreadcore20:17:481
179940,0migration/121955-21aten_r1power_vo22:57:421
179940,0migration/121193-21kthreadcore00:27:521
179940,0migration/120536-21kthreadcore20:37:511
179940,0migration/118538-21kthreadcore21:37:501
169940,0watchdog/132649-21ssh00:37:351
169940,0watchdog/128846-21rm00:13:431
169940,0watchdog/10-21swapper/122:47:471
169940,0watchdog/10-21swapper/122:09:071
169940,0watchdog/10-21swapper/121:46:541
169940,0watchdog/10-21swapper/120:27:541
169940,0watchdog/10-21swapper/119:52:461
169940,0watchdog/10-21swapper/100:02:551
149940,0migration/09950-21runrttasks23:27:480
149940,0migration/09906-21kthreadcore00:02:520
149940,0migration/031671-21irqcore23:02:480
149940,0migration/010618-21kthreadcore19:47:480
8305030,0irq/26-0000:00:0-21swapper/221:07:362
339930,0migration/318461-21needreboot20:57:523
329930,0watchdog/325357-21strings20:17:503
329930,0watchdog/30-21swapper/319:32:423
329930,0watchdog/30-21swapper/319:12:423
29805030,0irq/28-eth0-rx-0-21swapper/320:32:363
224739930,0cyclictest2423-21iostat_ios19:42:462
224739930,0cyclictest0-21swapper/219:33:022
224729932,0cyclictest3524-21snmpd23:04:341
224729932,0cyclictest31084-21gltestperf20:02:461
224729932,0cyclictest2081-21fschecks_time19:42:431
224729932,0cyclictest14215-21awk22:52:471
224729932,0cyclictest1363-21awk23:22:481
224729932,0cyclictest13228-21irqcore19:27:471
224729932,0cyclictest11168-21kthreadcore19:47:481
224719933,0cyclictest6804-21kworker/0:221:52:350
224719933,0cyclictest22968-21awk00:12:470
224719933,0cyclictest21812-21kworker/0:200:28:050
224719933,0cyclictest20255-21kworker/0:121:32:370
224719933,0cyclictest16463-21kworker/0:123:37:550
224719933,0cyclictest16463-21kworker/0:123:17:330
224719933,0cyclictest16463-21kworker/0:123:12:330
224719933,0cyclictest16463-21kworker/0:123:07:410
224719933,0cyclictest16463-21kworker/0:100:17:450
224719933,0cyclictest14466-21kworker/0:120:32:320
224719933,0cyclictest14466-21kworker/0:119:42:320
224719933,0cyclictest14466-21kworker/0:119:37:340
224719933,0cyclictest14466-21kworker/0:119:32:340
224719933,0cyclictest11530-21kworker/0:021:18:110
224719932,0cyclictest30941-21df_abs21:47:440
169930,0watchdog/10-21swapper/123:07:511
169930,0watchdog/10-21swapper/122:14:591
169930,0watchdog/10-21swapper/120:12:501
29805020,0irq/28-eth0-rx-0-21swapper/320:12:323
224729920,0cyclictest0-21swapper/120:32:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional