You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 17:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Apr 14, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2473423727,0sleep30-21swapper/306:57:093
2455023324,0sleep10-21swapper/106:54:591
2481723127,0sleep00-21swapper/006:58:060
2483023026,0sleep20-21swapper/206:58:162
249189970,0cyclictest0-21swapper/008:53:470
339960,0migration/35445-21sh09:04:243
29725060,0irq/27-eth0-tx-3243-21munin-node08:43:540
29715060,0irq/26-eth0-rx-15278-21df10:13:423
29715060,0irq/26-eth0-rx-12698-21grep09:08:483
29715060,0irq/26-eth0-rx-10261-21tr10:08:453
149960,0migration/028881-21kthreadcore07:23:480
149960,0migration/021432-21sh10:36:070
149960,0migration/020963-21sh11:16:510
149960,0migration/018520-21kthreadcore10:13:470
149960,0migration/014854-21sh09:12:130
149960,0migration/014420-21sh09:30:340
149960,0migration/013247-21sh11:12:390
149960,0migration/013062-21sh12:13:340
149960,0migration/012718-21kthreadcore08:48:460
8215050,0irq/24-0000:00:31704-21latency_hist09:23:302
4150,0ktimersoftd/00-21swapper/010:31:420
339950,0migration/39697-21munin-node08:23:443
339950,0migration/39584-21taskset08:46:483
339950,0migration/39168-21kthreadcore10:28:473
339950,0migration/37182-21irqcore07:08:463
339950,0migration/36169-21switchtime07:28:523
339950,0migration/35665-21fschecks_time12:08:423
339950,0migration/35556-21aten2.4-expect11:28:433
339950,0migration/3391-21kthreadcore10:43:463
339950,0migration/33836-21kthreadcore07:53:463
339950,0migration/330954-21kthreadcore12:03:463
339950,0migration/330372-21kthreadcore07:23:483
339950,0migration/328973-21taskset11:01:033
339950,0migration/32761-21taskset08:40:533
339950,0migration/323176-21kthreadcore11:18:443
339950,0migration/318664-21kthreadcore11:33:473
339950,0migration/316522-21kthreadcore08:03:483
339950,0migration/314874-21kthreadcore11:53:463
339950,0migration/313275-21taskset07:35:413
339950,0migration/31133-21kthreadcore09:23:483
29725050,0irq/27-eth0-tx-32611-21interrupts09:43:452
29725050,0irq/27-eth0-tx-32014-21ssh09:03:432
29725050,0irq/27-eth0-tx-26766-21kthreadcore09:38:472
29725050,0irq/27-eth0-tx-215432sleep211:38:382
29725050,0irq/27-eth0-tx-18376-21grep10:33:472
29725050,0irq/27-eth0-tx-14762-21munin-node08:03:520
29725050,0irq/27-eth0-tx-12903-21open_files09:48:512
29725050,0irq/27-eth0-tx-12903-21open_files09:48:512
29725050,0irq/27-eth0-tx-12806-21munin-node07:13:450
29725050,0irq/27-eth0-tx-11653-21unixbench_singl11:28:562
29725050,0irq/27-eth0-tx-0-21swapper/212:27:272
29725050,0irq/27-eth0-tx-0-21swapper/212:17:182
29725050,0irq/27-eth0-tx-0-21swapper/211:36:132
29725050,0irq/27-eth0-tx-0-21swapper/210:58:352
29725050,0irq/27-eth0-tx-0-21swapper/210:44:522
29725050,0irq/27-eth0-tx-0-21swapper/008:58:410
29725050,0irq/27-eth0-tx-0-21swapper/008:13:460
29715050,0irq/26-eth0-rx-8893-21hwlatdetect07:58:453
29715050,0irq/26-eth0-rx-3661-21ssh12:26:063
29715050,0irq/26-eth0-rx-26104-21grep09:18:453
29715050,0irq/26-eth0-rx-25371-21kthreadcore11:58:453
29715050,0irq/26-eth0-rx-24523-21irqrtprio08:58:453
29715050,0irq/26-eth0-rx-19901-21python10:53:503
29715050,0irq/26-eth0-rx-15847-21kthreadcore10:33:463
29715050,0irq/26-eth0-rx-13870-21munin-node12:13:423
29715050,0irq/26-eth0-rx-13758-21ssh09:49:433
29715050,0irq/26-eth0-rx-13758-21ssh09:49:433
29715050,0irq/26-eth0-rx-0-21swapper/311:23:483
29715050,0irq/26-eth0-rx-0-21swapper/311:10:073
29715050,0irq/26-eth0-rx-0-21swapper/310:42:543
29715050,0irq/26-eth0-rx-0-21swapper/310:19:403
29715050,0irq/26-eth0-rx-0-21swapper/309:57:403
29715050,0irq/26-eth0-rx-0-21swapper/309:38:473
29715050,0irq/26-eth0-rx-0-21swapper/309:13:513
27150,0ktimersoftd/20-21swapper/207:43:412
259950,0migration/26040-21sh10:06:462
259950,0migration/25729-21fschecks_time12:08:432
259950,0migration/222750-21latency_hist10:18:302
259950,0migration/222420-21sh09:15:352
259950,0migration/222325-21kthreadcore07:18:472
259950,0migration/221475-21switchtime09:33:532
259950,0migration/221475-21switchtime09:33:532
259950,0migration/221086-21sh12:18:382
259950,0migration/220779-21sh10:55:242
259950,0migration/218165-21needreboot07:13:482
259950,0migration/213950-21fschecks_time11:53:432
259950,0migration/213732-21latency_hist07:38:302
249199955,0cyclictest23086-21diskmemload10:49:421
249199955,0cyclictest0-21swapper/112:24:271
249199955,0cyclictest0-21swapper/109:34:301
249199955,0cyclictest0-21swapper/109:34:301
249199955,0cyclictest0-21swapper/107:43:501
249199954,0cyclictest0-21swapper/112:18:471
249199950,0cyclictest0-21swapper/112:00:201
249189955,0cyclictest0-21swapper/011:44:040
249189955,0cyclictest0-21swapper/010:05:320
249189955,0cyclictest0-21swapper/007:34:390
249189955,0cyclictest0-21swapper/006:58:520
249189950,0cyclictest0-21swapper/011:04:480
249189950,0cyclictest0-21swapper/009:57:200
249189950,0cyclictest0-21swapper/009:49:080
249189950,0cyclictest0-21swapper/009:49:080
249950,0watchdog/2791-21kthreadcore11:03:472
249950,0watchdog/226568-21fschecks_count07:23:442
249950,0watchdog/21384-21kthreadcore08:38:482
179950,0migration/16982-21latency_hist07:33:301
179950,0migration/130507-21sh09:20:181
179950,0migration/118876-21munin-node12:13:501
179950,0migration/116261-21kthreadcore11:53:471
179950,0migration/113129-21munin-node09:48:531
179950,0migration/113129-21munin-node09:48:531
169950,0watchdog/129561-21cut07:23:481
169950,0watchdog/121897-21sed08:53:481
169950,0watchdog/116690-21tr08:03:481
169950,0watchdog/116421-21kthreadcore11:13:471
169950,0watchdog/112880-21tr07:58:481
169950,0watchdog/111896-21ssh11:50:111
149950,0migration/06531-21taskset07:29:490
149950,0migration/05080-21rt-features07:03:480
149950,0migration/03313-21timerandwakeup11:23:540
149950,0migration/030205-21taskset09:19:290
149950,0migration/026177-21switchtime07:43:520
149950,0migration/025626-21kthreadcore11:18:450
149950,0migration/025315-21kthreadcore11:58:450
149950,0migration/023296-21munin-node08:33:440
149950,0migration/019937-21kthreadcore09:33:480
149950,0migration/019937-21kthreadcore09:33:480
149950,0migration/018118-21kthreadcore09:13:470
149950,0migration/017106-21kthreadcore11:33:460
149950,0migration/01313-21latency_hist07:53:300
149950,0migration/012805-21sh11:52:460
149950,0migration/012727-21kthreadcore08:23:480
149950,0migration/011971-21kthreadcore10:08:460
8215040,0irq/24-0000:00:31546-21latency_hist07:03:302
339940,0migration/3816-21kthreadcore09:43:463
339940,0migration/3626-21kthreadcore10:03:463
339940,0migration/332234-21kthreadcore11:03:473
339940,0migration/331582-21kthreadcore08:13:453
339940,0migration/328835-21kthreadcore07:48:463
339940,0migration/327966-21ksmtuned11:39:383
339940,0migration/319082-21taskset07:17:153
339940,0migration/316513-21idleruntime09:33:453
339940,0migration/316513-21idleruntime09:33:453
339940,0migration/315621-21kthreadcore07:38:463
339940,0migration/312062-21timerandwakeup10:48:513
29725040,0irq/27-eth0-tx-29086-21aten2.4-expect08:38:410
29725040,0irq/27-eth0-tx-28446-21kthreadcore09:18:462
29725040,0irq/27-eth0-tx-14850-21munin-node11:13:462
29725040,0irq/27-eth0-tx-0-21swapper/211:59:142
29725040,0irq/27-eth0-tx-0-21swapper/211:49:172
29725040,0irq/27-eth0-tx-0-21swapper/211:43:292
29725040,0irq/27-eth0-tx-0-21swapper/211:18:472
29725040,0irq/27-eth0-tx-0-21swapper/210:48:312
29725040,0irq/27-eth0-tx-0-21swapper/210:10:362
29725040,0irq/27-eth0-tx-0-21swapper/209:58:422
29725040,0irq/27-eth0-tx-0-21swapper/209:29:322
29725040,0irq/27-eth0-tx-0-21swapper/008:08:450
29715040,0irq/26-eth0-rx-0-21swapper/312:18:423
29715040,0irq/26-eth0-rx-0-21swapper/311:49:183
29715040,0irq/26-eth0-rx-0-21swapper/311:43:443
29715040,0irq/26-eth0-rx-0-21swapper/311:13:503
29715040,0irq/26-eth0-rx-0-21swapper/310:25:273
29715040,0irq/26-eth0-rx-0-21swapper/309:58:543
29715040,0irq/26-eth0-rx-0-21swapper/309:31:493
29715040,0irq/26-eth0-rx-0-21swapper/308:28:413
29715040,0irq/26-eth0-rx-0-21swapper/306:58:413
259940,0migration/28539-21taskset08:20:192
259940,0migration/23945-21fschecks_time08:43:442
259940,0migration/23893-21latency10:23:482
259940,0migration/232102-21kthreadcore11:23:482
259940,0migration/232091-21kthreadcore12:03:462
259940,0migration/211675-21kthreadcore07:33:472
249209944,0cyclictest0-21swapper/209:53:362
249209943,0cyclictest6813-21awk11:08:462
249209943,0cyclictest3514-21snmpd08:58:432
249209943,0cyclictest3514-21snmpd08:34:432
249209943,0cyclictest3514-21snmpd08:32:282
249209943,0cyclictest3514-21snmpd08:27:282
249209943,0cyclictest3514-21snmpd08:03:432
249209943,0cyclictest3514-21snmpd07:53:432
249209943,0cyclictest3514-21snmpd07:51:432
249209943,0cyclictest3514-21snmpd07:13:282
249209943,0cyclictest23513-21awk10:38:442
249209941,0cyclictest0-21swapper/210:18:422
249199944,0cyclictest0-21swapper/111:30:511
249199944,0cyclictest0-21swapper/110:09:021
249199944,0cyclictest0-21swapper/109:53:441
249199944,0cyclictest0-21swapper/109:09:451
249199943,0cyclictest4163-21awk08:43:461
249199943,0cyclictest3514-21snmpd11:37:591
249199943,0cyclictest3514-21snmpd09:41:581
249199943,0cyclictest3514-21snmpd09:17:281
249199943,0cyclictest3514-21snmpd08:23:281
249199943,0cyclictest32692-21awk07:03:431
249199943,0cyclictest32609-21awk09:43:451
249199943,0cyclictest3241-21irqbalance11:43:471
249199943,0cyclictest3241-21irqbalance10:20:081
249199943,0cyclictest2257-21awk07:53:441
249199943,0cyclictest15519-21awk10:33:451
249189944,0cyclictest0-21swapper/012:05:490
249189944,0cyclictest0-21swapper/010:42:530
249189944,0cyclictest0-21swapper/009:40:270
249189943,0cyclictest8956-21awk07:58:450
249189943,0cyclictest7006-21awk07:08:450
249189943,0cyclictest6379-21awk11:28:470
249189943,0cyclictest3556-21lldpd12:25:230
249189943,0cyclictest3241-21irqbalance10:23:570
249189943,0cyclictest3241-21irqbalance10:18:380
249189943,0cyclictest32393-21awk09:03:450
249189943,0cyclictest16717-21awk08:28:440
249189940,0cyclictest0-21swapper/010:44:080
249940,0watchdog/221987-21perl08:08:442
249940,0watchdog/215941-21unixbench_singl08:48:522
249940,0watchdog/211848-21grep09:08:482
249940,0watchdog/21130-21tr07:03:442
249940,0watchdog/20-21swapper/210:28:472
249940,0watchdog/20-21swapper/208:53:482
249940,0watchdog/20-21swapper/207:58:482
179940,0migration/19771-21kthreadcore11:08:481
179940,0migration/19003-21kthreadcore12:08:461
179940,0migration/18043-21kthreadcore10:28:471
179940,0migration/132471-21kthreadcore11:03:471
179940,0migration/131981-21irqcore10:23:461
179940,0migration/131871-21munin-node09:03:421
179940,0migration/130448-21latency_hist10:43:291
179940,0migration/130367-21fschecks_count11:23:451
179940,0migration/130356-21latency_hist10:43:291
179940,0migration/129482-21kthreadcore07:48:471
179940,0migration/128111-21aten_r1power_en08:13:391
179940,0migration/127418-21kthreadcore06:58:461
179940,0migration/125903-21kthreadcore09:58:461
179940,0migration/123806-21kthreadcore08:08:481
179940,0migration/122701-21irqcore11:38:441
179940,0migration/120695-21irqrtprio07:18:461
179940,0migration/117478-21kthreadcore08:28:461
179940,0migration/117275-21kthreadcore10:13:471
179940,0migration/115185-21kthreadcore07:13:471
179940,0migration/111796-21sendmail_mailst07:08:511
169940,0watchdog/19972-21munin-node08:48:521
169940,0watchdog/19040-21chrt08:23:321
169940,0watchdog/15396-21ssh10:04:511
169940,0watchdog/131928-21ssh09:23:321
169940,0watchdog/129338-21ssh12:03:391
169940,0watchdog/128417-21ssh11:20:111
169940,0watchdog/122813-21ssh10:58:431
169940,0watchdog/120734-21ssh10:55:151
169940,0watchdog/10-21swapper/108:58:441
149940,0migration/05553-21timerandwakeup09:23:540
149940,0migration/028375-21kthreadcore09:58:470
149940,0migration/026398-21kthreadcore11:38:460
149940,0migration/019996-21runrttasks11:55:290
29725030,0irq/27-eth0-tx-0-21swapper/007:48:430
29715030,0irq/26-eth0-rx-0-21swapper/308:48:523
29715030,0irq/26-eth0-rx-0-21swapper/308:18:443
29715030,0irq/26-eth0-rx-0-21swapper/308:08:423
29715030,0irq/26-eth0-rx-0-21swapper/307:18:423
29715030,0irq/26-eth0-rx-0-21swapper/307:03:383
249199933,0cyclictest14670-21awk07:38:441
249199932,0cyclictest7973-21awk07:33:441
249199932,0cyclictest29716-21head08:38:441
249199930,0cyclictest8117-21diskstats09:28:441
249189933,0cyclictest5487-21kworker/0:108:18:370
249189933,0cyclictest5487-21kworker/0:107:38:430
249189933,0cyclictest23698-21kworker/0:012:22:500
249189933,0cyclictest23698-21kworker/0:012:08:460
249189932,0cyclictest7105-21awk10:48:440
249189932,0cyclictest32464-21awk09:43:440
249189932,0cyclictest23117-21awk10:58:450
249189932,0cyclictest19934-21grep07:18:430
249189932,0cyclictest15063-21awk10:53:430
249930,0watchdog/20-21swapper/208:13:402
249930,0watchdog/20-21swapper/207:28:522
339920,0migration/320857-21diskstats07:43:423
29715020,0irq/26-eth0-rx-0-21swapper/308:53:423
29715020,0irq/26-eth0-rx-0-21swapper/308:33:403
249199921,0cyclictest22126-21latency_hist08:33:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional