You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 13:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Jun 16, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
271610,0ktimersoftd/218384-21perf06:52:212
304450550,0irq/25-eth10-21swapper/306:47:583
2476623322,0sleep00-21swapper/006:50:270
1860423324,0sleep10-21swapper/106:47:401
339960,0migration/36546-21sh10:22:033
339960,0migration/320707-21sh11:08:283
339960,0migration/314575-21irqcore12:07:473
29725060,0irq/27-eth0-tx-9013-21kthreadcore09:22:482
29725060,0irq/27-eth0-tx-3441-21munin-node08:37:540
29715060,0irq/26-eth0-rx-29103-21load09:32:493
29715060,0irq/26-eth0-rx-20260-21tr09:07:483
250179965,0cyclictest660-21cut10:37:472
250169960,0cyclictest0-21swapper/110:54:371
259960,0migration/220227-21sh11:48:412
149960,0migration/031486-21gltestperf10:57:440
149960,0migration/021779-21sh10:08:560
149960,0migration/013022-21sh11:04:200
149960,0migration/012860-21mdstat09:42:490
8215050,0irq/24-0000:00:30087-21latency_hist11:17:312
8215050,0irq/24-0000:00:14897-21cat07:57:312
8215050,0irq/24-0000:00:14394-21idleruntime-cro10:47:312
339950,0migration/38982-21munin-node09:22:483
339950,0migration/38717-21kthreadcore09:02:503
339950,0migration/37966-21taskset07:52:083
339950,0migration/35232-21sh11:00:063
339950,0migration/33442-21kthreadcore09:57:473
339950,0migration/3333-21if_eth006:57:453
339950,0migration/331952-21switchtime07:17:553
339950,0migration/329871-21latency_hist11:37:313
339950,0migration/329871-21latency_hist11:37:313
339950,0migration/329012-21latency_hist08:32:313
339950,0migration/326347-21timerandwakeup07:37:543
339950,0migration/322665-21idleruntime11:52:453
339950,0migration/315073-21munin-node07:32:483
339950,0migration/314567-21sh11:47:463
339950,0migration/313919-21munin-node07:52:533
339950,0migration/312084-21kthreadcore08:17:503
339950,0migration/310921-21kthreadcore07:27:483
29725050,0irq/27-eth0-tx-30536-21cpu11:17:422
29725050,0irq/27-eth0-tx-29609-21ssh10:34:182
29725050,0irq/27-eth0-tx-23898-21perl10:12:432
29725050,0irq/27-eth0-tx-13905-21munin-node07:32:450
29725050,0irq/27-eth0-tx-0-21swapper/212:13:542
29725050,0irq/27-eth0-tx-0-21swapper/211:38:552
29725050,0irq/27-eth0-tx-0-21swapper/210:18:592
29725050,0irq/27-eth0-tx-0-21swapper/209:51:542
29725050,0irq/27-eth0-tx-0-21swapper/209:42:512
29725050,0irq/27-eth0-tx-0-21swapper/209:36:102
29725050,0irq/27-eth0-tx-0-21swapper/209:28:172
29725050,0irq/27-eth0-tx-0-21swapper/008:53:000
29725050,0irq/27-eth0-tx-0-21swapper/008:18:490
29725050,0irq/27-eth0-tx-0-21swapper/008:07:450
29725050,0irq/27-eth0-tx-0-21swapper/007:13:470
29715050,0irq/26-eth0-rx-6870-21ssh09:41:373
29715050,0irq/26-eth0-rx-28943-21cut09:12:483
29715050,0irq/26-eth0-rx-18483-21kthreadcore08:47:483
29715050,0irq/26-eth0-rx-17837-21kthreadcore07:07:503
29715050,0irq/26-eth0-rx-11829-21python11:22:543
29715050,0irq/26-eth0-rx-0-21swapper/312:16:183
29715050,0irq/26-eth0-rx-0-21swapper/312:02:473
29715050,0irq/26-eth0-rx-0-21swapper/311:58:133
29715050,0irq/26-eth0-rx-0-21swapper/311:38:223
29715050,0irq/26-eth0-rx-0-21swapper/311:28:433
29715050,0irq/26-eth0-rx-0-21swapper/311:17:543
29715050,0irq/26-eth0-rx-0-21swapper/311:02:493
29715050,0irq/26-eth0-rx-0-21swapper/310:47:423
29715050,0irq/26-eth0-rx-0-21swapper/310:42:483
29715050,0irq/26-eth0-rx-0-21swapper/310:32:453
29715050,0irq/26-eth0-rx-0-21swapper/310:10:323
29715050,0irq/26-eth0-rx-0-21swapper/310:02:483
29715050,0irq/26-eth0-rx-0-21swapper/309:52:493
29715050,0irq/26-eth0-rx-0-21swapper/309:48:503
29715050,0irq/26-eth0-rx-0-21swapper/309:43:303
29715050,0irq/26-eth0-rx-0-21swapper/309:18:053
29715050,0irq/26-eth0-rx-0-21swapper/308:52:493
250179955,0cyclictest0-21swapper/211:54:532
250179955,0cyclictest0-21swapper/211:33:172
250179955,0cyclictest0-21swapper/211:33:172
250179955,0cyclictest0-21swapper/207:52:432
250179954,0cyclictest3556-21lldpd12:22:232
250179950,0cyclictest0-21swapper/212:12:132
250179950,0cyclictest0-21swapper/211:02:422
250169955,0cyclictest0-21swapper/110:33:201
250169955,0cyclictest0-21swapper/110:12:411
250169955,0cyclictest0-21swapper/108:54:291
250169955,0cyclictest0-21swapper/107:42:541
250169950,0cyclictest0-21swapper/111:13:041
250169950,0cyclictest0-21swapper/111:11:391
250169950,0cyclictest0-21swapper/106:57:491
250159955,0cyclictest0-21swapper/012:17:520
250159955,0cyclictest0-21swapper/008:27:420
250159955,0cyclictest0-21swapper/007:42:460
250159950,0cyclictest0-21swapper/011:26:570
259950,0migration/25184-21timerwakeupswit09:57:522
259950,0migration/25056-21proc_pri09:37:522
259950,0migration/23234-21kthreadcore07:47:492
259950,0migration/232149-21kthreadcore10:57:472
259950,0migration/222304-21latency_hist08:27:312
259950,0migration/221330-21gltestperf07:37:452
259950,0migration/217235-21kthreadcore10:27:482
249950,0watchdog/226307-21kthreadcore09:52:492
179950,0migration/131915-21munin-node10:37:451
179950,0migration/116282-21idleruntime09:07:441
149950,0migration/08318-21irqcore07:27:470
149950,0migration/07910-21fschecks_time10:02:450
149950,0migration/06753-21fschecks_count07:02:450
149950,0migration/05865-21taskset10:20:070
149950,0migration/05586-21kthreadcore08:12:480
149950,0migration/05304-21timerandwakeup06:57:520
149950,0migration/03654-21kthreadcore08:57:480
149950,0migration/030392-21aten_r1power_cu11:17:410
149950,0migration/028798-21sh11:13:450
149950,0migration/026050-21kthreadcore10:52:470
149950,0migration/022859-21taskset08:48:400
149950,0migration/022695-21irqcore08:02:470
149950,0migration/021917-21latency_hist11:32:310
149950,0migration/021917-21latency_hist11:32:310
149950,0migration/020276-21kthreadcore10:27:490
149950,0migration/019364-21kthreadcore07:57:500
149950,0migration/014891-21kthreadcore08:42:490
149950,0migration/014674-21kthreadcore07:07:490
149950,0migration/013949-21taskset11:47:440
149950,0migration/012258-21kthreadcore10:22:490
149950,0migration/011537-21munin-node11:42:520
339940,0migration/316416-21kthreadcore10:27:483
339940,0migration/312647-21runrttasks07:07:103
29725040,0irq/27-eth0-tx-29838-21ssh11:57:392
29725040,0irq/27-eth0-tx-23208-21diskmemload09:08:042
29725040,0irq/27-eth0-tx-22828-21ssh10:52:412
29725040,0irq/27-eth0-tx-0-21swapper/212:02:442
29725040,0irq/27-eth0-tx-0-21swapper/211:07:402
29725040,0irq/27-eth0-tx-0-21swapper/210:48:412
29725040,0irq/27-eth0-tx-0-21swapper/210:23:562
29725040,0irq/27-eth0-tx-0-21swapper/210:02:462
29725040,0irq/27-eth0-tx-0-21swapper/209:17:442
29725040,0irq/27-eth0-tx-0-21swapper/209:12:422
29725040,0irq/27-eth0-tx-0-21swapper/208:57:392
29725040,0irq/27-eth0-tx-0-21swapper/208:55:102
29715040,0irq/26-eth0-rx-0-21swapper/312:18:533
29715040,0irq/26-eth0-rx-0-21swapper/311:43:293
29715040,0irq/26-eth0-rx-0-21swapper/311:12:523
29715040,0irq/26-eth0-rx-0-21swapper/310:53:483
29715040,0irq/26-eth0-rx-0-21swapper/310:37:423
29715040,0irq/26-eth0-rx-0-21swapper/310:22:413
29715040,0irq/26-eth0-rx-0-21swapper/310:12:423
29715040,0irq/26-eth0-rx-0-21swapper/309:27:473
29715040,0irq/26-eth0-rx-0-21swapper/308:57:423
29715040,0irq/26-eth0-rx-0-21swapper/308:42:423
250179943,0cyclictest3556-21lldpd08:41:202
250179943,0cyclictest3556-21lldpd07:47:182
250179943,0cyclictest3514-21snmpd07:26:092
250179943,0cyclictest27068-21awk07:17:472
250179943,0cyclictest17713-21awk08:47:472
250169944,0cyclictest0-21swapper/111:53:251
250169944,0cyclictest0-21swapper/111:50:541
250169943,0cyclictest8152-21awk07:27:461
250169943,0cyclictest7887-21awk10:22:461
250169943,0cyclictest4319-21awk08:37:451
250169943,0cyclictest3556-21lldpd10:21:521
250169943,0cyclictest3556-21lldpd09:49:221
250169943,0cyclictest3556-21lldpd09:05:211
250169943,0cyclictest3556-21lldpd08:36:201
250169943,0cyclictest3556-21lldpd08:12:491
250169943,0cyclictest3556-21lldpd08:04:491
250169943,0cyclictest3556-21lldpd07:49:191
250169943,0cyclictest3556-21lldpd07:25:481
250169943,0cyclictest3556-21lldpd07:10:171
250169943,0cyclictest3514-21snmpd07:55:091
250169943,0cyclictest32736-21awk09:37:461
250169943,0cyclictest3241-21irqbalance12:02:491
250169943,0cyclictest3241-21irqbalance08:25:001
250169943,0cyclictest3241-21irqbalance08:18:201
250169943,0cyclictest3241-21irqbalance07:38:401
250169943,0cyclictest32370-21awk08:57:461
250169943,0cyclictest29208-21awk08:07:461
250169943,0cyclictest26988-21gltestperf07:17:461
250169943,0cyclictest26187-21awk06:52:461
250169943,0cyclictest24693-21awk09:32:461
250169943,0cyclictest17672-21awk08:47:461
250169943,0cyclictest16640-21awk09:27:451
250159944,0cyclictest24467-21kworker/0:109:18:180
250159944,0cyclictest0-21swapper/010:15:130
250159944,0cyclictest0-21swapper/009:56:560
250159944,0cyclictest0-21swapper/009:37:420
250159944,0cyclictest0-21swapper/009:08:030
250159943,0cyclictest8179-21awk09:02:480
250159943,0cyclictest3241-21irqbalance12:16:590
250159943,0cyclictest3241-21irqbalance12:09:190
250159943,0cyclictest3241-21irqbalance09:29:190
250159943,0cyclictest31011-21awk11:37:460
250159943,0cyclictest30008-21awk08:32:460
250159943,0cyclictest27098-21awk07:17:470
259940,0migration/28619-21runrttasks08:13:202
259940,0migration/24549-21kthreadcore06:57:482
259940,0migration/229284-21aten_r1power_vo08:32:442
259940,0migration/226300-21kthreadcore08:02:492
259940,0migration/225825-21kthreadcore08:27:482
259940,0migration/22231-21crond08:12:312
259940,0migration/217200-21kthreadcore07:32:492
259940,0migration/215582-21ntp_offset08:42:512
259940,0migration/215256-21ksmtuned10:07:352
259940,0migration/214314-21cpuspeed_turbos11:27:422
259940,0migration/213377-21fschecks_count07:07:462
259940,0migration/213263-21runrttasks07:27:572
259940,0migration/211925-21runrttasks11:42:582
259940,0migration/211559-21kthreadcore09:02:502
249940,0watchdog/20-21swapper/211:22:492
179940,0migration/132363-21sh09:17:451
179940,0migration/131952-21irqrtprio10:57:471
179940,0migration/131374-21kthreadcore11:57:481
179940,0migration/124483-21kthreadcore12:12:471
179940,0migration/121407-21taskset10:28:411
179940,0migration/119169-21kthreadcore11:27:471
179940,0migration/115154-21latency_hist10:07:311
179940,0migration/114579-21latency_hist10:47:311
179940,0migration/114470-21latency_hist10:47:311
179940,0migration/112517-21taskset07:05:381
169940,0watchdog/18788-21cut11:02:491
169940,0watchdog/13786-21python11:17:531
169940,0watchdog/129153-21missed_timers09:12:491
169940,0watchdog/12688-21kthreadcore11:37:491
169940,0watchdog/126309-21kthreadcore09:52:491
169940,0watchdog/120046-21ssh12:09:051
169940,0watchdog/112862-21memory09:42:491
169940,0watchdog/112315-21ssh11:44:051
169940,0watchdog/112289-21kthreadcore10:02:491
169940,0watchdog/11009-21kthreadcore12:17:491
169940,0watchdog/10-21swapper/111:22:491
169940,0watchdog/10-21swapper/110:00:211
169940,0watchdog/10-21swapper/109:22:331
169940,0watchdog/10-21swapper/107:32:501
149940,0migration/04189-21ntp_offset10:37:500
149940,0migration/023669-21runrttasks09:32:340
149940,0migration/021016-21kthreadcore08:22:490
149940,0migration/018723-21kthreadcore10:47:480
149940,0migration/015752-21kthreadcore11:27:460
149940,0migration/010609-21kthreadcore10:42:480
29715030,0irq/26-eth0-rx-0-21swapper/308:37:413
29715030,0irq/26-eth0-rx-0-21swapper/308:33:583
29715030,0irq/26-eth0-rx-0-21swapper/308:07:423
29715030,0irq/26-eth0-rx-0-21swapper/308:06:203
29715030,0irq/26-eth0-rx-0-21swapper/307:59:323
29715030,0irq/26-eth0-rx-0-21swapper/307:42:503
29715030,0irq/26-eth0-rx-0-21swapper/307:22:433
29715030,0irq/26-eth0-rx-0-21swapper/307:12:423
250179932,0cyclictest9650-21fschecks_count08:17:452
250179932,0cyclictest7082-21awk07:02:462
250179932,0cyclictest3556-21lldpd06:55:182
250169932,0cyclictest28909-21perf08:32:311
250169932,0cyclictest10972-21awk08:42:461
250159933,0cyclictest3493-21kworker/0:212:02:340
250159933,0cyclictest3493-21kworker/0:211:57:320
250159933,0cyclictest3493-21kworker/0:211:52:320
250159933,0cyclictest25246-21kworker/0:206:52:430
250159933,0cyclictest24467-21kworker/0:109:57:380
250159933,0cyclictest24467-21kworker/0:109:47:340
250159933,0cyclictest24467-21kworker/0:109:22:360
250159933,0cyclictest15813-21kworker/0:010:32:380
250159933,0cyclictest15464-21kworker/0:111:07:320
250159933,0cyclictest13699-21kworker/0:009:12:340
250159933,0cyclictest13699-21kworker/0:007:52:390
250159933,0cyclictest13699-21kworker/0:007:37:430
250159933,0cyclictest13699-21kworker/0:007:22:430
250159930,0cyclictest2097-21perl07:47:460
249930,0watchdog/20-21swapper/207:12:502
169930,0watchdog/124988-21netstat07:12:501
169930,0watchdog/10-21swapper/111:32:491
169930,0watchdog/10-21swapper/111:32:491
169930,0watchdog/10-21swapper/107:57:501
329920,0watchdog/321606-21expr08:22:543
29715020,0irq/26-eth0-rx-0-21swapper/308:12:443
29715020,0irq/26-eth0-rx-0-21swapper/306:52:463
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional