You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 15:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Fri May 15, 2026 12:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450360,0irq/25-eth10-21swapper/306:55:093
857723423,0sleep00-21swapper/006:53:310
846923329,0sleep10-21swapper/106:52:161
310423329,0sleep20-21swapper/206:50:492
88269980,0cyclictest0-21swapper/211:41:332
88269980,0cyclictest0-21swapper/211:08:082
29715070,0irq/26-eth0-rx-19675-21kthreadcore11:20:503
88269966,0cyclictest7134-21diskmemload09:26:272
88269966,0cyclictest0-21swapper/209:37:102
35160,0ktimersoftd/30-21swapper/310:41:063
339960,0migration/36556-21sh10:13:283
339960,0migration/36261-21sh11:35:273
339960,0migration/331389-21sh09:09:573
339960,0migration/322038-21sh10:01:033
339960,0migration/315459-21sh09:19:323
339960,0migration/315121-21sh09:00:133
339960,0migration/314294-21sh10:38:163
339960,0migration/313822-21sh10:16:073
29725060,0irq/27-eth0-tx-4321-21munin-node07:40:520
29725060,0irq/27-eth0-tx-31041-21munin-node08:00:500
29725060,0irq/27-eth0-tx-15712-21munin-node07:00:520
29715060,0irq/26-eth0-rx-3740-21kthreadcore09:30:503
29715060,0irq/26-eth0-rx-32496-21cut11:10:503
29715060,0irq/26-eth0-rx-21083-21unixbench-2d11:00:573
149960,0migration/03929-21sh09:10:500
149960,0migration/030867-21sh09:47:460
149960,0migration/021864-21sh10:00:550
149960,0migration/014235-21sh10:17:200
88269955,0cyclictest0-21swapper/211:45:392
88269955,0cyclictest0-21swapper/211:28:092
88269955,0cyclictest0-21swapper/210:27:082
88269955,0cyclictest0-21swapper/209:22:582
88269950,0cyclictest0-21swapper/212:03:572
88269950,0cyclictest0-21swapper/210:49:222
88269950,0cyclictest0-21swapper/210:23:032
88269950,0cyclictest0-21swapper/210:04:262
88269950,0cyclictest0-21swapper/209:45:122
88269950,0cyclictest0-21swapper/209:32:352
88259955,0cyclictest0-21swapper/110:28:491
88259954,0cyclictest16410-21awk09:00:491
88249955,0cyclictest0-21swapper/009:02:170
88249950,0cyclictest7134-21diskmemload09:59:210
4150,0ktimersoftd/00-21swapper/010:21:560
35150,0ktimersoftd/30-21swapper/310:21:563
339950,0migration/36659-21kthreadcore07:40:513
339950,0migration/33448-21munin-node12:10:493
339950,0migration/332753-21munin-node08:25:483
339950,0migration/329701-21runrttasks10:46:193
339950,0migration/324991-21fschecks_time09:25:463
339950,0migration/323071-21taskset07:30:133
339950,0migration/323018-21sh09:43:243
339950,0migration/322825-21df_abs12:05:483
339950,0migration/320378-21kthreadcore09:20:513
339950,0migration/319626-21latency_hist08:40:343
339950,0migration/317709-21taskset07:50:423
339950,0migration/315111-21munin-node12:20:463
339950,0migration/31378-21kthreadcore11:50:503
339950,0migration/313287-21cpuspeed_turbos08:35:463
339950,0migration/312803-21taskset11:36:023
339950,0migration/312531-21sh11:56:013
339950,0migration/310775-21gltestperf07:20:483
29725050,0irq/27-eth0-tx-552-21munin-node08:50:490
29725050,0irq/27-eth0-tx-12017-21munin-node08:10:490
29725050,0irq/27-eth0-tx-0-21swapper/007:05:480
29715050,0irq/26-eth0-rx-32752-21hwlatdetect09:10:473
29715050,0irq/26-eth0-rx-30331-21ssh10:06:493
29715050,0irq/26-eth0-rx-22696-21cat11:25:333
29715050,0irq/26-eth0-rx-1354-21kthreadcore10:50:503
29715050,0irq/26-eth0-rx-0-21swapper/312:17:483
29715050,0irq/26-eth0-rx-0-21swapper/311:42:573
29715050,0irq/26-eth0-rx-0-21swapper/311:07:043
29715050,0irq/26-eth0-rx-0-21swapper/310:58:083
29715050,0irq/26-eth0-rx-0-21swapper/310:30:513
29715050,0irq/26-eth0-rx-0-21swapper/310:26:503
29715050,0irq/26-eth0-rx-0-21swapper/309:46:293
29715050,0irq/26-eth0-rx-0-21swapper/309:00:453
29715050,0irq/26-eth0-rx-0-21swapper/307:05:523
179950,0migration/18011-21fschecks_time10:35:451
179950,0migration/132012-21aten_r1power_en08:25:451
179950,0migration/116689-21idleruntime10:00:461
179950,0migration/115884-21kthreadcore12:00:511
169950,0watchdog/17118-21ssh09:33:561
169950,0watchdog/11205-21fschecks_time08:50:481
149950,0migration/09954-21kthreadcore09:35:490
149950,0migration/09486-21kthreadcore09:15:500
149950,0migration/07463-21kernelversion12:15:480
149950,0migration/07139-21idleruntime08:30:480
149950,0migration/07052-21taskset09:54:070
149950,0migration/06005-21taskset08:29:580
149950,0migration/05755-21switchtime09:30:560
149950,0migration/04230-21kthreadcore10:10:500
149950,0migration/04161-21switchtime11:50:560
149950,0migration/032281-21kthreadcore12:10:480
149950,0migration/031648-21taskset09:29:310
149950,0migration/031172-21turbostat10:50:330
149950,0migration/029855-21timerwakeupswit10:05:560
149950,0migration/026416-21kthreadcore11:05:500
149950,0migration/026207-21kthreadcore11:25:500
149950,0migration/022114-21kthreadcore07:50:510
149950,0migration/022031-21switchtime09:20:560
149950,0migration/020872-21kthreadcore08:15:500
149950,0migration/019943-21kthreadcore11:40:500
149950,0migration/016597-21kthreadcore08:35:500
149950,0migration/016175-21taskset07:22:420
149950,0migration/015078-21fschecks_time12:00:480
149950,0migration/013517-21kthreadcore06:55:510
88269944,0cyclictest0-21swapper/211:16:392
88269943,0cyclictest8295-21awk10:35:472
88269943,0cyclictest7239-21awk08:30:492
88269943,0cyclictest548-21awk09:50:472
88269943,0cyclictest4228-21awk07:15:502
88269943,0cyclictest3556-21lldpd11:00:092
88269943,0cyclictest3556-21lldpd09:45:382
88269943,0cyclictest3556-21lldpd09:16:072
88269943,0cyclictest3556-21lldpd09:11:082
88269943,0cyclictest3556-21lldpd08:45:382
88269943,0cyclictest3556-21lldpd08:37:382
88269943,0cyclictest3556-21lldpd06:58:062
88269943,0cyclictest3514-21snmpd08:03:322
88269943,0cyclictest3514-21snmpd07:25:472
88269943,0cyclictest3241-21irqbalance12:21:212
88269943,0cyclictest3241-21irqbalance09:06:422
88269943,0cyclictest3241-21irqbalance07:06:332
88269943,0cyclictest32124-21awk11:10:492
88269943,0cyclictest31897-21awk11:30:492
88269943,0cyclictest31739-21sadc08:25:342
88269943,0cyclictest31739-21sadc08:25:342
88269943,0cyclictest29895-21awk07:10:482
88269943,0cyclictest24796-21awk10:05:472
88269943,0cyclictest23399-21awk12:05:512
88269943,0cyclictest1457-21awk08:50:492
88269943,0cyclictest12973-21awk08:10:492
88269940,0cyclictest0-21swapper/207:42:282
88259944,0cyclictest3556-21lldpd08:45:081
88259944,0cyclictest0-21swapper/111:07:361
88259943,0cyclictest3556-21lldpd11:43:091
88259943,0cyclictest3556-21lldpd10:50:391
88259943,0cyclictest3556-21lldpd10:20:071
88259943,0cyclictest3556-21lldpd09:35:371
88259943,0cyclictest3556-21lldpd09:20:081
88259943,0cyclictest3556-21lldpd08:20:381
88259943,0cyclictest3556-21lldpd08:20:381
88259943,0cyclictest3556-21lldpd07:25:371
88259943,0cyclictest25345-21awk07:55:471
88259943,0cyclictest24192-21awk07:30:481
88259943,0cyclictest23111-21sadc10:45:331
88259943,0cyclictest17086-21awk09:20:481
88259943,0cyclictest16511-21awk10:20:491
88249944,0cyclictest0-21swapper/009:09:130
88249943,0cyclictest3514-21snmpd07:50:320
88249943,0cyclictest3241-21irqbalance10:50:520
88249943,0cyclictest31782-21awk11:30:480
88249943,0cyclictest25217-21awk07:55:460
88249943,0cyclictest23342-21munin-node07:30:470
88249943,0cyclictest20577-21awk08:40:470
88249943,0cyclictest15696-21awk11:20:470
88249943,0cyclictest10373-21kworker/0:011:57:180
88249943,0cyclictest10373-21kworker/0:011:19:320
88249940,0cyclictest0-21swapper/009:41:130
339940,0migration/326916-21kthreadcore08:20:503
339940,0migration/326916-21kthreadcore08:20:503
29725040,0irq/27-eth0-tx-18288-21kthreadcore11:00:512
29725040,0irq/27-eth0-tx-0-21swapper/212:10:542
29725040,0irq/27-eth0-tx-0-21swapper/211:35:552
29725040,0irq/27-eth0-tx-0-21swapper/210:15:462
29725040,0irq/27-eth0-tx-0-21swapper/208:56:472
29725040,0irq/27-eth0-tx-0-21swapper/008:55:360
29725040,0irq/27-eth0-tx-0-21swapper/007:35:440
29725040,0irq/27-eth0-tx-0-21swapper/007:15:560
29725040,0irq/27-eth0-tx-0-21swapper/007:10:440
29715040,0irq/26-eth0-rx-20214-21kthreadcore07:00:523
29715040,0irq/26-eth0-rx-0-21swapper/312:00:523
29715040,0irq/26-eth0-rx-0-21swapper/311:45:343
29715040,0irq/26-eth0-rx-0-21swapper/311:15:443
29715040,0irq/26-eth0-rx-0-21swapper/309:55:523
29715040,0irq/26-eth0-rx-0-21swapper/309:50:523
29715040,0irq/26-eth0-rx-0-21swapper/309:37:533
29715040,0irq/26-eth0-rx-0-21swapper/308:51:003
29715040,0irq/26-eth0-rx-0-21swapper/307:15:513
249940,0watchdog/25829-21ssh11:54:552
249940,0watchdog/214871-21aten_r1power_fr11:20:432
249940,0watchdog/212150-21python11:55:552
249940,0watchdog/20-21swapper/210:50:432
249940,0watchdog/20-21swapper/209:55:522
249940,0watchdog/20-21swapper/207:20:562
249940,0watchdog/20-21swapper/207:00:522
179940,0migration/17560-21kthreadcore07:40:511
179940,0migration/17166-21kthreadcore07:15:521
179940,0migration/1355-21kthreadcore11:30:501
179940,0migration/131321-21fschecks_time11:50:461
179940,0migration/12922-21taskset07:14:381
179940,0migration/128415-21kthreadcore10:05:501
179940,0migration/126051-21kthreadcore12:05:531
179940,0migration/124441-21aten2.4-expect09:25:441
179940,0migration/122712-21munin-node11:45:441
179940,0migration/121718-21munin-node07:00:581
179940,0migration/11967-21kthreadcore10:10:491
179940,0migration/117952-21cpuspeed_turbos07:50:451
179940,0migration/116876-21timerwakeupswit07:45:561
179940,0migration/116528-21kthreadcore12:20:471
179940,0migration/115689-21fschecks_time11:00:471
179940,0migration/113723-21runrttasks12:20:061
179940,0migration/112943-21latency_hist08:35:341
179940,0migration/112474-21mdstat10:55:511
179940,0migration/111374-21kthreadcore11:35:501
179940,0migration/11101-21kthreadcore07:35:501
179940,0migration/110317-21kthreadcore09:55:511
169940,0watchdog/130645-21grep12:10:431
169940,0watchdog/130357-21ssh10:48:111
169940,0watchdog/12818-21cut11:10:511
169940,0watchdog/121074-21runrttasks11:21:191
169940,0watchdog/10-21swapper/109:50:441
169940,0watchdog/10-21swapper/109:10:521
149940,0migration/09153-21kthreadcore10:35:490
149940,0migration/027788-21kthreadcore11:45:510
149940,0migration/027421-21kthreadcore08:20:500
149940,0migration/027421-21kthreadcore08:20:500
149940,0migration/019826-21kthreadcore11:00:520
149940,0migration/011465-21kthreadcore11:35:500
88269932,0cyclictest7083-21awk12:15:472
88269932,0cyclictest3556-21lldpd09:00:372
88269932,0cyclictest3556-21lldpd08:25:372
88269932,0cyclictest3556-21lldpd08:16:372
88269932,0cyclictest3556-21lldpd08:09:082
88269932,0cyclictest24210-21if_err_eth1.307:30:482
88269932,0cyclictest12002-21awk07:45:492
88269931,0cyclictest19584-21cut08:40:342
88269930,0cyclictest0-21swapper/210:30:462
88269930,0cyclictest0-21swapper/210:10:462
88259933,0cyclictest0-21swapper/109:05:441
88259932,0cyclictest8345-21awk08:55:481
88259932,0cyclictest7185-21awk08:30:491
88259932,0cyclictest6209-21cat11:55:331
88259932,0cyclictest32551-21awk10:30:481
88259932,0cyclictest32006-21sensors08:45:551
88259932,0cyclictest23671-21awk11:25:471
88259932,0cyclictest22911-21cut08:15:501
88259932,0cyclictest10968-21awk07:20:491
88259930,0cyclictest29718-21ssh09:45:551
88259930,0cyclictest0-21swapper/108:01:521
88249933,0cyclictest10373-21kworker/0:012:20:460
88249933,0cyclictest10373-21kworker/0:012:05:480
88249933,0cyclictest10373-21kworker/0:010:55:450
88249933,0cyclictest10373-21kworker/0:010:40:450
88249933,0cyclictest10373-21kworker/0:010:31:310
88249933,0cyclictest10373-21kworker/0:010:25:570
88249933,0cyclictest10373-21kworker/0:008:45:390
88249933,0cyclictest10373-21kworker/0:008:05:370
88249933,0cyclictest10373-21kworker/0:007:25:410
88249932,0cyclictest32048-21awk11:10:490
29725030,0irq/27-eth0-tx-0-21swapper/210:40:582
29715030,0irq/26-eth0-rx-12050-21runrttasks08:10:453
29715030,0irq/26-eth0-rx-0-21swapper/308:45:453
29715030,0irq/26-eth0-rx-0-21swapper/308:08:413
29715030,0irq/26-eth0-rx-0-21swapper/308:00:563
29715030,0irq/26-eth0-rx-0-21swapper/307:55:423
29715030,0irq/26-eth0-rx-0-21swapper/307:45:463
29715030,0irq/26-eth0-rx-0-21swapper/307:30:503
29715030,0irq/26-eth0-rx-0-21swapper/307:10:453
29715030,0irq/26-eth0-rx-0-21swapper/306:56:583
249930,0watchdog/20-21swapper/207:55:362
179930,0migration/124183-21kthreadcore07:05:511
169930,0watchdog/17134-21diskmemload11:17:271
169930,0watchdog/10-21swapper/109:40:561
169930,0watchdog/10-21swapper/108:05:481
169930,0watchdog/10-21swapper/106:55:361
88269920,0cyclictest29963-21date07:35:342
29715020,0irq/26-eth0-rx-0-21swapper/308:30:403
29715020,0irq/26-eth0-rx-0-21swapper/308:15:363
29715020,0irq/26-eth0-rx-0-21swapper/307:35:483
249920,0watchdog/20-21swapper/207:50:362
169920,0watchdog/10-21swapper/108:10:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional