You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 19:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Tue Aug 18, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450630,0irq/25-eth10-21swapper/306:43:353
2169924231,0sleep00-21swapper/006:41:330
2790923526,0sleep20-21swapper/206:44:192
2795523424,0sleep10-21swapper/106:44:501
339960,0migration/332715-21sh09:51:173
339960,0migration/327609-21sh12:07:503
339960,0migration/324167-21sh09:22:403
339960,0migration/315204-21sh10:41:193
339960,0migration/312973-21sh11:18:143
29715060,0irq/26-eth0-rx-5611-21cut07:16:473
29715060,0irq/26-eth0-rx-0-21swapper/311:50:453
281749966,0cyclictest0-21swapper/210:56:432
149960,0migration/01544-21latency_hist09:11:300
8215050,0irq/24-0000:00:22564-21munin-run11:06:302
339950,0migration/39765-21kthreadcore11:36:473
339950,0migration/38962-21taskset06:54:343
339950,0migration/3786-21kthreadcore11:11:473
339950,0migration/36327-21taskset10:33:373
339950,0migration/330351-21aten_r1power_en07:36:423
339950,0migration/329445-21munin-node07:11:423
339950,0migration/325336-21kthreadcore11:26:473
339950,0migration/325123-21munin-node10:06:443
339950,0migration/324921-21kthreadcore11:06:473
339950,0migration/323441-21taskset09:42:183
339950,0migration/322387-21munin-node10:01:523
339950,0migration/32189-21if_eth1.209:31:463
339950,0migration/320874-21latency10:41:473
339950,0migration/320043-21munin-node07:26:473
339950,0migration/315237-21munin-node09:36:553
339950,0migration/313356-21cpu08:36:413
339950,0migration/311544-21sh11:57:043
339950,0migration/311028-21kthreadcore08:31:493
339950,0migration/31094-21kthreadcore10:51:473
29725050,0irq/27-eth0-tx-5761-21munin-node11:36:422
29725050,0irq/27-eth0-tx-526-21iostat_ios10:31:472
29725050,0irq/27-eth0-tx-13273-21munin-node12:01:532
29725050,0irq/27-eth0-tx-11258-21munin-node07:46:420
29725050,0irq/27-eth0-tx-0-21swapper/209:11:482
29725050,0irq/27-eth0-tx-0-21swapper/008:47:430
29725050,0irq/27-eth0-tx-0-21swapper/008:36:410
29715050,0irq/26-eth0-rx-6956-21sh10:13:453
29715050,0irq/26-eth0-rx-4525-21swap08:01:553
29715050,0irq/26-eth0-rx-31451-21sed08:21:543
29715050,0irq/26-eth0-rx-23726-21cpuspeed_turbos10:46:423
29715050,0irq/26-eth0-rx-23333-21ssh10:25:133
29715050,0irq/26-eth0-rx-1909-21aten_r1power_po09:11:423
29715050,0irq/26-eth0-rx-13173-21kthreadcore08:56:473
29715050,0irq/26-eth0-rx-10439-21munin-node07:41:533
29715050,0irq/26-eth0-rx-0-21swapper/312:16:143
29715050,0irq/26-eth0-rx-0-21swapper/311:03:483
29715050,0irq/26-eth0-rx-0-21swapper/310:17:193
29715050,0irq/26-eth0-rx-0-21swapper/309:56:473
29715050,0irq/26-eth0-rx-0-21swapper/309:51:443
29715050,0irq/26-eth0-rx-0-21swapper/309:06:473
29715050,0irq/26-eth0-rx-0-21swapper/309:01:493
29715050,0irq/26-eth0-rx-0-21swapper/308:14:293
281749955,0cyclictest0-21swapper/212:08:552
281749955,0cyclictest0-21swapper/210:18:522
281749955,0cyclictest0-21swapper/209:46:432
281749950,0cyclictest0-21swapper/211:12:382
281749950,0cyclictest0-21swapper/211:07:262
281749950,0cyclictest0-21swapper/209:00:402
281729950,0cyclictest0-21swapper/008:17:270
259950,0migration/25543-21aten_r1power_en08:06:412
259950,0migration/224789-21gltestperf10:26:432
249950,0watchdog/219774-21kthreadcore07:01:492
179950,0migration/12749-21needreboot11:51:491
179950,0migration/126785-21kthreadcore10:06:481
179950,0migration/114598-21timerandwakeup09:56:531
169950,0watchdog/131549-21sed08:01:451
169950,0watchdog/110811-21grep11:56:481
149950,0migration/09574-21kthreadcore10:36:470
149950,0migration/07930-21kthreadcore07:16:480
149950,0migration/07520-21kthreadcore11:36:460
149950,0migration/06527-21cpuspeed_turbos11:16:410
149950,0migration/06308-21kthreadcore06:51:470
149950,0migration/05903-21kthreadcore09:31:480
149950,0migration/04122-21munin-node11:11:510
149950,0migration/031939-21crond08:26:300
149950,0migration/029415-21aten_r1power_po07:11:420
149950,0migration/028924-21taskset07:09:480
149950,0migration/026993-21kthreadcore07:56:480
149950,0migration/026224-21fschecks_count09:26:410
149950,0migration/02572-21fschecks_time08:51:460
149950,0migration/025206-21kthreadcore07:31:480
149950,0migration/025146-21kthreadcore10:46:460
149950,0migration/024192-21taskset07:54:470
149950,0migration/022580-21rt-features07:26:510
149950,0migration/02239-21sh12:11:500
149950,0migration/021747-21kthreadcore08:41:480
149950,0migration/019263-21kthreadcore11:21:470
149950,0migration/018926-21kthreadcore10:21:470
149950,0migration/018682-21kthreadcore09:41:470
149950,0migration/017979-21cpuspeed_turbos09:21:420
149950,0migration/016841-21latency_hist07:26:300
149950,0migration/015921-21latency_hist10:21:300
149950,0migration/015039-21irqrtprio11:41:450
149950,0migration/014246-21kthreadcore08:11:450
149950,0migration/014065-21latency09:56:480
149950,0migration/013512-21kthreadcore09:36:480
149950,0migration/01311-21kthreadcore10:31:480
149950,0migration/013023-21kthreadcore08:56:470
149950,0migration/012823-21kthreadcore06:56:470
149950,0migration/012595-21taskset08:32:250
8215040,0irq/24-0000:00:19654-21latency_hist08:41:302
339940,0migration/328315-21kthreadcore09:26:453
339940,0migration/32436-21kthreadcore08:26:473
339940,0migration/323429-21runrttasks07:06:453
339940,0migration/321331-21kthreadcore08:16:483
339940,0migration/317390-21taskset07:48:173
339940,0migration/310778-21if_eth1.309:16:463
29725040,0irq/27-eth0-tx-32016-21ssh09:27:272
29725040,0irq/27-eth0-tx-21552-21unixbench_multi10:41:532
29725040,0irq/27-eth0-tx-20321-21kthreadcore09:41:482
29725040,0irq/27-eth0-tx-20290-21ssh11:42:592
29725040,0irq/27-eth0-tx-0-21swapper/211:32:072
29725040,0irq/27-eth0-tx-0-21swapper/211:26:322
29725040,0irq/27-eth0-tx-0-21swapper/211:17:132
29725040,0irq/27-eth0-tx-0-21swapper/210:37:252
29725040,0irq/27-eth0-tx-0-21swapper/210:22:082
29725040,0irq/27-eth0-tx-0-21swapper/210:12:322
29725040,0irq/27-eth0-tx-0-21swapper/210:06:452
29725040,0irq/27-eth0-tx-0-21swapper/209:18:162
29725040,0irq/27-eth0-tx-0-21swapper/209:07:232
29725040,0irq/27-eth0-tx-0-21swapper/208:51:312
29715040,0irq/26-eth0-rx-30052-21kthreadcore08:46:473
29715040,0irq/26-eth0-rx-0-21swapper/312:03:593
29715040,0irq/26-eth0-rx-0-21swapper/311:51:563
29715040,0irq/26-eth0-rx-0-21swapper/311:42:433
29715040,0irq/26-eth0-rx-0-21swapper/311:31:473
29715040,0irq/26-eth0-rx-0-21swapper/311:21:523
29715040,0irq/26-eth0-rx-0-21swapper/310:56:533
29715040,0irq/26-eth0-rx-0-21swapper/310:26:453
29715040,0irq/26-eth0-rx-0-21swapper/308:51:393
29715040,0irq/26-eth0-rx-0-21swapper/307:51:473
29715040,0irq/26-eth0-rx-0-21swapper/307:21:473
281749943,0cyclictest691-21awk08:26:452
281749943,0cyclictest3556-21lldpd07:38:582
281749943,0cyclictest3556-21lldpd07:26:282
281749943,0cyclictest3556-21lldpd06:57:272
281749943,0cyclictest3514-21snmpd09:57:062
281749943,0cyclictest3514-21snmpd08:25:212
281749943,0cyclictest3514-21snmpd08:11:362
281749943,0cyclictest3514-21snmpd07:43:212
281749943,0cyclictest3241-21irqbalance10:51:382
281749943,0cyclictest3241-21irqbalance10:01:582
281749943,0cyclictest3241-21irqbalance09:36:582
281749943,0cyclictest3241-21irqbalance09:32:082
281749943,0cyclictest3241-21irqbalance08:32:192
281749943,0cyclictest3241-21irqbalance07:17:192
281749943,0cyclictest3241-21irqbalance07:12:192
281749943,0cyclictest3241-21irqbalance07:06:492
281749943,0cyclictest3241-21irqbalance06:46:392
281749943,0cyclictest30572-21awk11:51:452
281749943,0cyclictest24386-21awk10:46:452
281749943,0cyclictest20816-21awk08:41:462
281749943,0cyclictest19820-21awk08:16:462
281749943,0cyclictest18764-21awk07:51:452
281749943,0cyclictest0-21swapper/209:51:452
281739943,0cyclictest6739-21awk11:36:451
281739943,0cyclictest6679-21sadc10:56:301
281739943,0cyclictest3556-21lldpd11:49:291
281739943,0cyclictest3556-21lldpd11:06:591
281739943,0cyclictest3556-21lldpd10:41:591
281739943,0cyclictest3556-21lldpd09:22:591
281739943,0cyclictest3556-21lldpd08:58:291
281739943,0cyclictest3556-21lldpd08:16:281
281739943,0cyclictest3514-21snmpd08:31:361
281739943,0cyclictest3514-21snmpd08:07:061
281739943,0cyclictest3514-21snmpd07:42:061
281739943,0cyclictest3241-21irqbalance09:07:281
281739943,0cyclictest30220-21awk07:11:451
281739943,0cyclictest27506-21awk08:46:451
281739943,0cyclictest26013-21awk09:46:461
281739943,0cyclictest1532-21awk09:51:431
281739943,0cyclictest14677-21awk11:41:441
281739943,0cyclictest11134-21awk07:21:451
281729944,0cyclictest0-21swapper/010:43:170
281729943,0cyclictest7874-21sadc10:16:300
281729943,0cyclictest3556-21lldpd11:53:590
281729943,0cyclictest3556-21lldpd09:50:290
281729943,0cyclictest3514-21snmpd11:46:520
281729943,0cyclictest3514-21snmpd08:01:360
281729943,0cyclictest22553-21sadc11:06:300
281729943,0cyclictest10752-21awk09:16:450
259940,0migration/230007-21if_eth012:11:442
259940,0migration/227168-21kthreadcore07:56:482
259940,0migration/221669-21latency_hist11:46:302
259940,0migration/220677-21kthreadcore09:21:472
259940,0migration/216767-21taskset11:21:462
249940,0watchdog/231219-21munin-node08:01:492
249940,0watchdog/220048-21kthreadcore09:01:482
249940,0watchdog/211151-21wc11:56:522
249940,0watchdog/20-21swapper/208:46:402
249940,0watchdog/20-21swapper/206:51:532
179940,0migration/18106-21irqcore10:56:471
179940,0migration/15758-21kthreadcore08:51:501
179940,0migration/14103-21fschecks_count07:16:431
179940,0migration/128867-21latency_hist12:11:301
179940,0migration/128515-21timerwakeupswit07:06:541
179940,0migration/127389-21kthreadcore10:46:471
179940,0migration/125036-21fschecks_count07:56:441
179940,0migration/122981-21kthreadcore07:51:481
179940,0migration/121998-21kthreadcore07:26:481
179940,0migration/118147-21kthreadcore10:01:481
179940,0migration/117119-21kthreadcore11:21:461
179940,0migration/11664-21latency_hist09:11:301
179940,0migration/116274-21kthreadcore12:01:461
179940,0migration/115695-21kthreadcore08:36:461
179940,0migration/111830-21kthreadcore10:16:491
179940,0migration/110356-21fschecks_time09:16:431
169940,0watchdog/16293-21munin-node11:16:481
169940,0watchdog/15941-21ssh11:16:201
169940,0watchdog/14732-21chrt11:34:121
169940,0watchdog/14206-21cut10:11:481
169940,0watchdog/12963-21kthreadcore07:36:491
169940,0watchdog/128009-21sensors11:26:521
169940,0watchdog/126856-21cut07:31:491
169940,0watchdog/125998-21grep08:21:441
169940,0watchdog/123994-21ssh10:26:321
169940,0watchdog/122959-21kthreadcore08:41:481
169940,0watchdog/120775-21kthreadcore10:21:481
169940,0watchdog/120049-21kthreadcore09:01:481
169940,0watchdog/118951-21kthreadcore11:01:481
169940,0watchdog/117185-21ssh09:41:401
169940,0watchdog/112652-21kthreadcore10:36:481
169940,0watchdog/10-21swapper/112:11:481
169940,0watchdog/10-21swapper/110:31:441
169940,0watchdog/10-21swapper/109:31:481
169940,0watchdog/10-21swapper/108:16:481
169940,0watchdog/10-21swapper/106:51:451
149940,0migration/04504-21kthreadcore09:11:480
149940,0migration/032335-21kthreadcore07:36:480
149940,0migration/031316-21kthreadcore06:46:470
149940,0migration/028422-21pmu-power11:06:500
149940,0migration/025824-21kthreadcore10:26:460
149940,0migration/021615-21kthreadcore10:01:490
149940,0migration/021057-21kthreadcore09:01:490
149940,0migration/018847-21kthreadcore07:01:480
149940,0migration/01469-21kthreadcore08:26:460
149940,0migration/012747-21sh12:00:440
339930,0migration/312916-21kthreadcore06:56:473
29715030,0irq/26-eth0-rx-0-21swapper/308:41:433
29715030,0irq/26-eth0-rx-0-21swapper/307:56:433
29715030,0irq/26-eth0-rx-0-21swapper/307:33:503
29715030,0irq/26-eth0-rx-0-21swapper/307:03:383
29715030,0irq/26-eth0-rx-0-21swapper/306:48:433
281749931,0cyclictest16678-21netstat07:46:492
281739933,0cyclictest3556-21lldpd07:47:581
281739932,0cyclictest576-21awk08:26:451
281739932,0cyclictest29237-21awk06:46:451
281739932,0cyclictest10255-21awk06:56:451
281729933,0cyclictest29631-21kworker/0:212:06:370
281729933,0cyclictest29631-21kworker/0:212:01:310
281729933,0cyclictest22487-21kworker/0:011:31:310
281729933,0cyclictest22487-21kworker/0:011:26:390
281729933,0cyclictest22487-21kworker/0:010:56:330
281729933,0cyclictest22487-21kworker/0:010:51:350
281729933,0cyclictest22487-21kworker/0:010:06:350
281729933,0cyclictest22487-21kworker/0:009:51:350
281729933,0cyclictest22487-21kworker/0:008:06:320
281729930,0cyclictest0-21swapper/007:41:420
259930,0migration/226991-21kthreadcore07:31:492
249930,0watchdog/20-21swapper/207:26:492
169930,0watchdog/116801-21smartctl07:01:451
169930,0watchdog/10-21swapper/109:36:481
169930,0watchdog/10-21swapper/109:26:401
339920,0migration/35893-21diskstats08:06:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional