You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 23:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Tue May 05, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450960,0irq/25-eth10-21swapper/306:51:513
2909524536,0sleep20-21swapper/206:52:052
2915723524,0sleep10-21swapper/106:52:481
2913023221,0sleep00-21swapper/006:52:270
295529970,0cyclictest12960-21kthreadcore10:41:462
295509976,0cyclictest0-21swapper/109:54:251
339960,0migration/39238-21sh12:20:333
339960,0migration/326434-21munin-node12:11:423
339960,0migration/32043-21sh10:12:183
339960,0migration/318249-21sh11:04:133
29725060,0irq/27-eth0-tx-4112-21munin-node07:01:500
29715060,0irq/26-eth0-rx-3215-21gltestperf11:36:443
29715060,0irq/26-eth0-rx-3026-21munin-node11:56:443
29715060,0irq/26-eth0-rx-3026-21munin-node11:56:443
29715060,0irq/26-eth0-rx-19945-21cat10:06:303
29715060,0irq/26-eth0-rx-19180-21iostat12:06:453
295509960,0cyclictest0-21swapper/108:57:401
149960,0migration/026461-21sh10:28:090
149960,0migration/02340-21sh10:54:320
149960,0migration/023093-21kthreadcore08:01:480
149960,0migration/018354-21sh07:56:530
149960,0migration/017953-21sh11:24:340
149960,0migration/01758-21sh10:32:160
149960,0migration/01173-21sh11:12:160
149960,0migration/010649-21sh11:21:240
339950,0migration/36944-21kthreadcore11:16:473
339950,0migration/329648-21kthreadcore10:31:463
339950,0migration/326749-21kthreadcore09:41:483
339950,0migration/324244-21timerwakeupswit07:36:533
339950,0migration/323740-21kthreadcore10:06:453
339950,0migration/318822-21ksmtuned07:58:173
339950,0migration/318560-21kthreadcore09:31:473
339950,0migration/316179-21diskmemload12:22:293
339950,0migration/315917-21kthreadcore07:06:493
339950,0migration/314361-21kthreadcore10:41:473
339950,0migration/312241-21munin-node11:21:443
339950,0migration/310997-21taskset09:23:023
339950,0migration/310489-21taskset07:05:593
29725050,0irq/27-eth0-tx-28058-21cut11:31:462
29725050,0irq/27-eth0-tx-27321-21munin-node11:11:492
29725050,0irq/27-eth0-tx-2023-21munin-node09:51:442
29725050,0irq/27-eth0-tx-19293-21munin-node11:06:452
29725050,0irq/27-eth0-tx-18830-21perl12:06:432
29725050,0irq/27-eth0-tx-12757-21ssh09:27:232
29725050,0irq/27-eth0-tx-10779-21munin-node07:06:470
29725050,0irq/27-eth0-tx-0-21swapper/008:56:320
29725050,0irq/27-eth0-tx-0-21swapper/007:33:130
29725050,0irq/27-eth0-tx-0-21swapper/007:21:430
29715050,0irq/26-eth0-rx-712-21grep08:56:483
29715050,0irq/26-eth0-rx-26037-21ssh11:08:333
29715050,0irq/26-eth0-rx-25292-21ssh11:27:403
29715050,0irq/26-eth0-rx-2274-21cpuspeed_turbos09:51:433
29715050,0irq/26-eth0-rx-22496-21cut09:11:493
29715050,0irq/26-eth0-rx-17505-21ssh11:44:163
29715050,0irq/26-eth0-rx-17505-21ssh11:44:163
29715050,0irq/26-eth0-rx-14099-21ssh09:31:183
29715050,0irq/26-eth0-rx-13284-21kthreadcore12:01:463
29715050,0irq/26-eth0-rx-0-21swapper/311:47:563
29715050,0irq/26-eth0-rx-0-21swapper/310:47:063
29715050,0irq/26-eth0-rx-0-21swapper/310:36:413
29715050,0irq/26-eth0-rx-0-21swapper/310:28:513
29715050,0irq/26-eth0-rx-0-21swapper/310:16:493
29715050,0irq/26-eth0-rx-0-21swapper/309:16:433
295529954,0cyclictest3514-21snmpd07:51:422
295509955,0cyclictest0-21swapper/109:15:291
295509954,0cyclictest3514-21snmpd09:50:571
295509950,0cyclictest0-21swapper/108:01:421
295509950,0cyclictest0-21swapper/107:16:461
295499955,0cyclictest0-21swapper/012:16:330
295499955,0cyclictest0-21swapper/012:03:370
295499955,0cyclictest0-21swapper/010:26:210
295499950,0cyclictest0-21swapper/011:47:230
259950,0migration/24482-21if_err_eth1.310:36:452
259950,0migration/23609-21latency_hist10:16:302
259950,0migration/230634-21kthreadcore08:31:472
259950,0migration/230251-21kthreadcore09:16:472
259950,0migration/227616-21latency_hist10:51:302
259950,0migration/218972-21sh10:24:412
259950,0migration/218303-21processes07:56:522
259950,0migration/210749-21latency_hist11:21:302
249950,0watchdog/220430-21cut10:26:442
179950,0migration/16165-21kthreadcore10:36:471
169950,0watchdog/17218-21kthreadcore07:01:491
169950,0watchdog/14184-21kthreadcore08:11:491
149950,0migration/06222-21kthreadcore11:36:470
149950,0migration/03332-21kthreadcore07:46:490
149950,0migration/030710-21kthreadcore10:11:470
149950,0migration/029368-21kthreadcore12:11:470
149950,0migration/029340-21kthreadcore09:41:490
149950,0migration/026840-21taskset09:12:490
149950,0migration/026791-21diskmemload10:08:260
149950,0migration/023550-21kthreadcore08:51:480
149950,0migration/022368-21kthreadcore11:06:460
149950,0migration/019142-21hwlatdetect07:36:450
149950,0migration/017590-21taskset11:44:310
149950,0migration/017590-21taskset11:44:310
149950,0migration/015798-21kthreadcore09:31:460
149950,0migration/013762-21kthreadcore09:06:480
149950,0migration/011047-21sh10:19:550
149950,0migration/010343-21sh09:02:510
149950,0migration/010250-21kthreadcore07:26:470
339940,0migration/34860-21kthreadcore08:36:483
339940,0migration/3450-21runrttasks09:47:573
339940,0migration/330786-21kthreadcore11:31:473
339940,0migration/328980-21irqrtprio10:51:473
339940,0migration/322878-21kthreadcore08:51:473
339940,0migration/320976-21kthreadcore08:01:473
29725040,0irq/27-eth0-tx-7862-21kthreadcore11:36:482
29725040,0irq/27-eth0-tx-4450-21ssh09:21:422
29725040,0irq/27-eth0-tx-369-21ssh09:47:432
29725040,0irq/27-eth0-tx-25887-21python10:06:502
29725040,0irq/27-eth0-tx-2102-21munin-node11:56:402
29725040,0irq/27-eth0-tx-2102-21munin-node11:56:402
29725040,0irq/27-eth0-tx-18891-21ssh11:26:402
29725040,0irq/27-eth0-tx-0-21swapper/212:22:252
29725040,0irq/27-eth0-tx-0-21swapper/212:12:122
29725040,0irq/27-eth0-tx-0-21swapper/212:02:032
29725040,0irq/27-eth0-tx-0-21swapper/211:54:512
29725040,0irq/27-eth0-tx-0-21swapper/211:41:422
29725040,0irq/27-eth0-tx-0-21swapper/211:41:422
29725040,0irq/27-eth0-tx-0-21swapper/211:01:452
29725040,0irq/27-eth0-tx-0-21swapper/210:01:392
29725040,0irq/27-eth0-tx-0-21swapper/209:56:532
29725040,0irq/27-eth0-tx-0-21swapper/209:36:422
29725040,0irq/27-eth0-tx-0-21swapper/209:11:412
29725040,0irq/27-eth0-tx-0-21swapper/209:06:372
29725040,0irq/27-eth0-tx-0-21swapper/208:57:302
29725040,0irq/27-eth0-tx-0-21swapper/008:46:500
29725040,0irq/27-eth0-tx-0-21swapper/008:06:470
29715040,0irq/26-eth0-rx-6559-21runrttasks08:26:483
29715040,0irq/26-eth0-rx-0-21swapper/311:52:513
29715040,0irq/26-eth0-rx-0-21swapper/311:11:543
29715040,0irq/26-eth0-rx-0-21swapper/310:59:063
29715040,0irq/26-eth0-rx-0-21swapper/310:22:393
29715040,0irq/26-eth0-rx-0-21swapper/309:56:573
29715040,0irq/26-eth0-rx-0-21swapper/309:37:263
29715040,0irq/26-eth0-rx-0-21swapper/309:06:393
29715040,0irq/26-eth0-rx-0-21swapper/309:01:373
29715040,0irq/26-eth0-rx-0-21swapper/308:21:033
295529943,0cyclictest7900-21awk08:16:462
295529943,0cyclictest6023-21awk07:26:452
295529943,0cyclictest3556-21lldpd10:31:462
295529943,0cyclictest3556-21lldpd07:11:442
295529943,0cyclictest3514-21snmpd08:55:122
295529943,0cyclictest3514-21snmpd08:31:272
295529943,0cyclictest3514-21snmpd08:11:422
295529943,0cyclictest3514-21snmpd07:18:422
295529943,0cyclictest3514-21snmpd07:10:422
295529943,0cyclictest31645-21awk07:21:452
295529943,0cyclictest25877-21awk07:41:482
295529943,0cyclictest25738-21sadc08:06:302
295529943,0cyclictest25371-21awk09:41:462
295509944,0cyclictest0-21swapper/112:21:311
295509943,0cyclictest3556-21lldpd09:38:161
295509943,0cyclictest3514-21snmpd10:19:571
295509943,0cyclictest3514-21snmpd09:59:271
295509943,0cyclictest3241-21irqbalance12:11:381
295509943,0cyclictest3241-21irqbalance12:07:581
295509943,0cyclictest3241-21irqbalance11:49:381
295509943,0cyclictest3241-21irqbalance11:31:481
295509943,0cyclictest3241-21irqbalance10:01:491
295509943,0cyclictest3241-21irqbalance09:28:491
295509943,0cyclictest3241-21irqbalance08:51:391
295509943,0cyclictest3241-21irqbalance08:46:591
295509943,0cyclictest3241-21irqbalance08:41:391
295509943,0cyclictest3241-21irqbalance08:32:091
295509943,0cyclictest3241-21irqbalance08:26:391
295509943,0cyclictest3241-21irqbalance08:21:391
295509943,0cyclictest3241-21irqbalance08:16:391
295509943,0cyclictest3241-21irqbalance07:56:491
295509943,0cyclictest3241-21irqbalance07:47:091
295509943,0cyclictest3241-21irqbalance07:38:591
295509943,0cyclictest3241-21irqbalance07:31:391
295509943,0cyclictest3241-21irqbalance07:26:391
295509943,0cyclictest3241-21irqbalance07:22:191
295509943,0cyclictest3241-21irqbalance07:07:091
295509943,0cyclictest32198-21sadc09:46:301
295509943,0cyclictest2738-21awk12:16:471
295509943,0cyclictest12779-21awk10:21:441
295509943,0cyclictest12583-21awk10:41:451
295509943,0cyclictest12318-21awk11:01:441
295509943,0cyclictest11840-21awk11:21:431
295509943,0cyclictest11083-21awk12:01:431
295499944,0cyclictest3556-21lldpd09:48:160
295499944,0cyclictest0-21swapper/012:21:450
295499944,0cyclictest0-21swapper/010:47:190
295499943,0cyclictest949-21sadc08:36:300
295499943,0cyclictest3556-21lldpd09:39:460
295499943,0cyclictest3514-21snmpd08:14:570
295499943,0cyclictest3241-21irqbalance12:07:380
295499943,0cyclictest3241-21irqbalance11:26:480
295499943,0cyclictest3241-21irqbalance09:27:190
295499943,0cyclictest3241-21irqbalance09:23:090
295499943,0cyclictest3241-21irqbalance09:18:490
295499943,0cyclictest27721-21awk11:31:440
295499943,0cyclictest24965-21awk07:16:450
295499943,0cyclictest12519-21awk10:41:440
295499943,0cyclictest12243-21awk11:01:430
259940,0migration/26394-21kthreadcore10:56:472
259940,0migration/25896-21kthreadcore10:16:462
259940,0migration/24085-21kthreadcore12:16:482
259940,0migration/23202-21kthreadcore08:36:472
259940,0migration/220920-21kthreadcore11:46:462
259940,0migration/219669-21kthreadcore08:46:482
259940,0migration/218815-21kthreadcore09:31:472
259940,0migration/217822-21kthreadcore08:21:462
259940,0migration/213833-21kthreadcore07:31:482
249940,0watchdog/23793-21chrt09:01:372
249940,0watchdog/231298-21missed_timers08:06:492
249940,0watchdog/220502-21if_err_eth010:46:442
249940,0watchdog/20-21swapper/211:21:442
249940,0watchdog/20-21swapper/207:01:492
249940,0watchdog/20-21swapper/206:56:492
179940,0migration/13957-21munin-node11:16:451
179940,0migration/13364-21kthreadcore08:36:471
179940,0migration/130667-21kthreadcore10:11:471
179940,0migration/130337-21missed_timers07:41:521
179940,0migration/129601-21irqcore09:16:461
179940,0migration/128932-21kthreadcore08:06:481
179940,0migration/127140-21taskset10:50:451
179940,0migration/123462-21kthreadcore11:26:471
179940,0migration/114482-21aten2.4-expect09:31:411
169940,0watchdog/18139-21cut07:51:491
169940,0watchdog/15088-21perl09:21:451
169940,0watchdog/14227-21if_err_eth1.210:56:441
169940,0watchdog/13909-21telnet09:01:411
169940,0watchdog/131517-21cut10:51:481
169940,0watchdog/127690-21ssh10:11:041
169940,0watchdog/120429-21grep10:26:441
169940,0watchdog/119048-21kthreadcore07:11:491
169940,0watchdog/115528-21grep09:06:491
169940,0watchdog/10-21swapper/111:56:521
169940,0watchdog/10-21swapper/111:56:521
169940,0watchdog/10-21swapper/111:51:481
169940,0watchdog/10-21swapper/111:11:561
169940,0watchdog/10-21swapper/111:06:521
169940,0watchdog/10-21swapper/110:34:401
169940,0watchdog/10-21swapper/106:56:451
149940,0migration/03406-21kthreadcore09:51:470
149940,0migration/027466-21kthreadcore07:41:500
339930,0migration/35994-21runrttasks07:51:403
339930,0migration/320528-21unixbench_singl08:46:543
29725030,0irq/27-eth0-tx-0-21swapper/008:26:430
29715030,0irq/26-eth0-rx-0-21swapper/308:41:423
29715030,0irq/26-eth0-rx-0-21swapper/308:11:433
29715030,0irq/26-eth0-rx-0-21swapper/307:47:163
29715030,0irq/26-eth0-rx-0-21swapper/307:31:423
29715030,0irq/26-eth0-rx-0-21swapper/307:16:423
29715030,0irq/26-eth0-rx-0-21swapper/307:11:423
295529932,0cyclictest8784-21awk08:41:452
295529932,0cyclictest3556-21lldpd07:36:442
295529930,0cyclictest0-21swapper/207:46:372
295509932,0cyclictest3241-21irqbalance11:36:481
295499933,0cyclictest30128-21kworker/0:011:56:470
295499933,0cyclictest30128-21kworker/0:011:56:470
295499933,0cyclictest30128-21kworker/0:011:51:370
295499933,0cyclictest30128-21kworker/0:009:56:360
295499933,0cyclictest30128-21kworker/0:008:41:360
295499933,0cyclictest30128-21kworker/0:008:36:400
295499933,0cyclictest30128-21kworker/0:008:21:360
295499933,0cyclictest30128-21kworker/0:007:51:340
295499933,0cyclictest30128-21kworker/0:007:12:060
295499932,0cyclictest7876-21awk08:16:460
295499932,0cyclictest4875-21grep10:56:460
295499930,0cyclictest4272-21perl10:36:430
295499930,0cyclictest0-21swapper/006:56:460
169930,0watchdog/10-21swapper/111:41:481
169930,0watchdog/10-21swapper/111:41:481
149930,0migration/018289-21sh10:02:080
29715020,0irq/26-eth0-rx-0-21swapper/308:31:413
29715020,0irq/26-eth0-rx-0-21swapper/308:22:433
29715020,0irq/26-eth0-rx-0-21swapper/308:06:313
29715020,0irq/26-eth0-rx-0-21swapper/307:41:473
29715020,0irq/26-eth0-rx-0-21swapper/307:26:413
29715020,0irq/26-eth0-rx-0-21swapper/307:22:163
29715020,0irq/26-eth0-rx-0-21swapper/306:56:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional