You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 13:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Jul 22, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2721026463,0sleep00-21swapper/018:45:490
304450620,0irq/25-eth10-21swapper/318:44:123
2743723425,0sleep20-21swapper/218:48:312
2715323324,0sleep10-21swapper/118:45:091
339960,0migration/36436-21sh22:17:493
339960,0migration/329436-21sh22:30:203
339960,0migration/328939-21sh23:12:433
339960,0migration/325338-21sh00:09:333
339960,0migration/314474-21sh22:01:073
29715060,0irq/26-eth0-rx-8068-40yum-updatesd-he21:38:433
29715060,0irq/26-eth0-rx-30978-21ssh21:51:113
29715060,0irq/26-eth0-rx-13153-21perl23:24:233
275639966,0cyclictest25630-21diskmemload23:26:352
275629960,0cyclictest0-21swapper/121:39:261
275619966,0cyclictest0-21swapper/020:44:230
149960,0migration/07775-21sh21:15:430
149960,0migration/024069-21sh21:05:210
149960,0migration/016765-21turbostat.cron21:24:020
149960,0migration/012925-21run-parts22:40:060
149960,0migration/011843-21sh23:22:460
149960,0migration/011755-21switchtime22:59:300
8215050,0irq/24-0000:00:4655-21awk20:09:072
339950,0migration/3953-21kthreadcore20:29:243
339950,0migration/38095-21kthreadcore23:19:243
339950,0migration/38077-21kthreadcore19:44:253
339950,0migration/3524-21taskset21:13:043
339950,0migration/35008-21munin-node20:09:193
339950,0migration/34208-21taskset23:16:563
339950,0migration/34089-21kthreadcore20:54:243
339950,0migration/329523-21kthreadcore00:14:243
339950,0migration/328470-21fschecks_time18:49:213
339950,0migration/325490-21fschecks_time20:24:213
339950,0migration/325387-21taskset20:46:323
339950,0migration/325256-21missed_timers23:49:253
339950,0migration/322645-21missed_timers19:54:273
339950,0migration/322083-21kthreadcore21:24:263
339950,0migration/319867-21kthreadcore20:19:273
339950,0migration/317831-21munin-node21:04:213
339950,0migration/317471-21kthreadcore22:24:243
339950,0migration/316854-21irqcore22:04:243
339950,0migration/315796-21munin-node19:04:223
339950,0migration/315127-21fschecks_time22:44:203
339950,0migration/315127-21fschecks_time22:44:203
339950,0migration/315013-21munin-node23:04:223
339950,0migration/314537-21kthreadcore20:14:233
339950,0migration/313791-21kthreadcore21:19:263
339950,0migration/311293-21munin-node20:34:293
339950,0migration/311119-21fschecks_count19:49:223
339950,0migration/31077-21latency_hist21:14:073
29725050,0irq/27-eth0-tx-2959-21munin-node19:19:220
29725050,0irq/27-eth0-tx-22070-21munin-node19:09:230
29725050,0irq/27-eth0-tx-18077-21munin-node21:04:222
29725050,0irq/27-eth0-tx-14945-21cat22:24:072
29725050,0irq/27-eth0-tx-1092-21munin-node21:54:232
29725050,0irq/27-eth0-tx-0-21swapper/223:49:232
29725050,0irq/27-eth0-tx-0-21swapper/221:21:052
29725050,0irq/27-eth0-tx-0-21swapper/220:52:332
29725050,0irq/27-eth0-tx-0-21swapper/200:19:062
29725050,0irq/27-eth0-tx-0-21swapper/019:44:190
29715050,0irq/26-eth0-rx-9829-21kthreadcore21:39:253
29715050,0irq/26-eth0-rx-3168-21ssh23:37:393
29715050,0irq/26-eth0-rx-27910-21netstat22:49:273
29715050,0irq/26-eth0-rx-2245-21cut22:54:263
29715050,0irq/26-eth0-rx-17740-21munin-node21:44:273
29715050,0irq/26-eth0-rx-17126-21kthreadcore23:44:253
29715050,0irq/26-eth0-rx-11169-21kthreadcore18:59:243
29715050,0irq/26-eth0-rx-0-21swapper/323:59:243
29715050,0irq/26-eth0-rx-0-21swapper/323:39:193
29715050,0irq/26-eth0-rx-0-21swapper/323:29:283
29715050,0irq/26-eth0-rx-0-21swapper/323:03:403
29715050,0irq/26-eth0-rx-0-21swapper/322:20:123
29715050,0irq/26-eth0-rx-0-21swapper/322:10:583
29715050,0irq/26-eth0-rx-0-21swapper/321:55:583
29715050,0irq/26-eth0-rx-0-21swapper/321:29:563
29715050,0irq/26-eth0-rx-0-21swapper/321:02:433
29715050,0irq/26-eth0-rx-0-21swapper/320:51:093
275639955,0cyclictest0-21swapper/223:54:102
275639955,0cyclictest0-21swapper/223:37:562
275639955,0cyclictest0-21swapper/223:30:222
275639955,0cyclictest0-21swapper/223:20:362
275639955,0cyclictest0-21swapper/223:10:302
275639955,0cyclictest0-21swapper/222:54:252
275639955,0cyclictest0-21swapper/222:47:202
275639955,0cyclictest0-21swapper/222:47:202
275639950,0cyclictest0-21swapper/222:20:322
275639950,0cyclictest0-21swapper/222:15:192
275639950,0cyclictest0-21swapper/221:59:432
275639950,0cyclictest0-21swapper/221:45:132
275639950,0cyclictest0-21swapper/220:17:432
275629955,0cyclictest0-21swapper/123:53:461
275629955,0cyclictest0-21swapper/121:56:561
275629954,0cyclictest3514-21snmpd22:41:401
275629950,0cyclictest0-21swapper/123:29:101
275629950,0cyclictest0-21swapper/123:22:231
275629950,0cyclictest0-21swapper/122:57:191
275629950,0cyclictest0-21swapper/122:20:451
275629950,0cyclictest0-21swapper/121:24:561
275629950,0cyclictest0-21swapper/120:52:081
275619955,0cyclictest0-21swapper/020:59:030
275619950,0cyclictest0-21swapper/023:41:350
275619950,0cyclictest0-21swapper/021:42:050
259950,0migration/27364-21sh21:36:302
259950,0migration/26619-21gltestperf22:59:212
259950,0migration/231533-21sh21:52:522
259950,0migration/230711-21timerwakeupswit20:24:312
259950,0migration/23031-21aten_r1power_fr19:19:192
259950,0migration/225760-21sh21:29:212
249950,0watchdog/20-21swapper/221:14:212
19150,0ktimersoftd/10-21swapper/123:59:451
19150,0ktimersoftd/10-21swapper/119:44:301
179950,0migration/19401-21latency_hist20:59:071
179950,0migration/18498-21kthreadcore22:59:241
179950,0migration/15504-21kthreadcore21:14:261
179950,0migration/128748-21processes22:29:271
179950,0migration/125130-21cpuspeed_turbos20:24:201
179950,0migration/124156-21unixbench_singl20:19:341
179950,0migration/123575-21latency_hist22:09:071
179950,0migration/122860-21latency_hist19:34:071
179950,0migration/117196-21kthreadcore19:04:251
179950,0migration/117175-21timerwakeupswit00:04:301
149950,0migration/0993-21kthreadcore22:54:260
149950,0migration/0915-21turbostat21:14:070
149950,0migration/06880-21taskset21:57:180
149950,0migration/04940-21munin-node22:14:290
149950,0migration/03819-21kthreadcore20:29:250
149950,0migration/032520-21missed_timers00:14:250
149950,0migration/032166-21kthreadcore23:14:230
149950,0migration/030210-21fschecks_count19:39:200
149950,0migration/029516-21hwlatdetect19:14:220
149950,0migration/029155-21kthreadcore18:49:240
149950,0migration/028755-21kthreadcore19:59:250
149950,0migration/027874-21kthreadcore20:49:260
149950,0migration/025847-21kthreadcore22:09:250
149950,0migration/024926-21munin-node20:24:190
149950,0migration/024588-21kthreadcore23:09:230
149950,0migration/020317-21runrttasks23:05:350
149950,0migration/018926-21kthreadcore19:54:260
149950,0migration/018389-21sh21:24:240
149950,0migration/017407-21kthreadcore22:04:250
149950,0migration/017116-21fschecks_time21:44:240
149950,0migration/016993-21kthreadcore19:04:250
149950,0migration/012476-21latency22:19:250
149950,0migration/012446-21kthreadcore21:59:240
149950,0migration/010211-21taskset00:01:460
339940,0migration/39317-21taskset19:22:153
339940,0migration/34438-21taskset20:06:463
339940,0migration/32595-21kthreadcore22:34:253
29725040,0irq/27-eth0-tx-29813-21ssh22:09:362
29725040,0irq/27-eth0-tx-25603-21ssh21:09:102
29725040,0irq/27-eth0-tx-0-21swapper/223:59:172
29725040,0irq/27-eth0-tx-0-21swapper/223:14:192
29725040,0irq/27-eth0-tx-0-21swapper/223:04:182
29725040,0irq/27-eth0-tx-0-21swapper/222:29:152
29725040,0irq/27-eth0-tx-0-21swapper/220:54:442
29725040,0irq/27-eth0-tx-0-21swapper/020:39:200
29715040,0irq/26-eth0-rx-0-21swapper/323:54:563
29715040,0irq/26-eth0-rx-0-21swapper/322:39:203
29715040,0irq/26-eth0-rx-0-21swapper/319:14:243
29715040,0irq/26-eth0-rx-0-21swapper/300:04:253
275639944,0cyclictest0-21swapper/222:39:082
275639943,0cyclictest3514-21snmpd20:31:242
275639943,0cyclictest3514-21snmpd20:13:392
275639943,0cyclictest3514-21snmpd19:59:392
275639943,0cyclictest3514-21snmpd00:09:542
275639943,0cyclictest20183-21awk20:44:252
275639943,0cyclictest19038-21awk20:19:242
275639943,0cyclictest17955-21awk21:24:232
275639943,0cyclictest12850-21awk23:44:222
275639943,0cyclictest11096-21tune2fs19:49:222
275639942,0cyclictest3514-21snmpd21:39:092
275629943,0cyclictest4852-21awk23:39:221
275629943,0cyclictest3556-21lldpd00:13:091
275629943,0cyclictest3514-21snmpd23:27:241
275629943,0cyclictest3514-21snmpd22:24:391
275629943,0cyclictest3514-21snmpd22:08:241
275629943,0cyclictest3514-21snmpd22:01:541
275629943,0cyclictest3514-21snmpd19:50:241
275629943,0cyclictest3514-21snmpd19:19:241
275629943,0cyclictest32446-21awk22:14:231
275629943,0cyclictest31830-21awk22:34:221
275629943,0cyclictest25898-21awk21:29:221
275629943,0cyclictest25307-21awk21:49:231
275629943,0cyclictest22937-21awk19:09:221
275629943,0cyclictest10536-21awk20:59:251
275619944,0cyclictest0-21swapper/023:37:010
275619943,0cyclictest5858-21awk20:09:230
275619943,0cyclictest3556-21lldpd23:53:390
275619943,0cyclictest3556-21lldpd21:35:360
275619943,0cyclictest2896-21awk18:54:250
275619943,0cyclictest23872-21awk22:29:210
275619943,0cyclictest20188-21sadc23:29:060
275619943,0cyclictest19556-21sadc23:49:060
275619943,0cyclictest18862-21sadc00:09:060
275619942,0cyclictest9720-21munin-node19:24:270
275619942,0cyclictest17891-21cut19:29:220
275619940,0cyclictest0-21swapper/021:49:290
259940,0migration/25220-21irqrtprio23:39:242
259940,0migration/23948-21latency_hist19:44:072
259940,0migration/232463-21kthreadcore22:34:242
259940,0migration/230275-21fschecks_time19:39:202
259940,0migration/227579-21kthreadcore19:34:272
259940,0migration/220823-21kthreadcore19:29:232
259940,0migration/216672-21kernelversion19:04:252
259940,0migration/212144-21kthreadcore18:59:252
249940,0watchdog/29846-21cut20:59:212
249940,0watchdog/229535-21ls19:14:222
249940,0watchdog/22205-21cpu18:54:222
249940,0watchdog/221926-21ssh22:04:412
249940,0watchdog/219326-21kthreadcore19:54:262
249940,0watchdog/20-21swapper/222:49:252
249940,0watchdog/20-21swapper/200:04:252
179940,0migration/19817-21aten_r1power_fr19:24:201
179940,0migration/13874-21kthreadcore18:54:271
179940,0migration/131960-21kthreadcore00:14:241
179940,0migration/129554-21latency_hist23:14:071
179940,0migration/129239-21kthreadcore18:49:241
179940,0migration/128818-21munin-node23:34:191
179940,0migration/122977-21latency_hist19:34:081
179940,0migration/121351-21runrttasks23:08:431
179940,0migration/119916-21kthreadcore19:54:261
179940,0migration/118422-21unixbench-2d20:39:311
179940,0migration/116864-21kthreadcore22:44:231
179940,0migration/116864-21kthreadcore22:44:231
179940,0migration/116768-21latency20:14:231
179940,0migration/111920-21kthreadcore21:19:251
179940,0migration/11141-21kthreadcore19:14:251
169940,0watchdog/18045-21grep20:34:261
169940,0watchdog/126421-21munin-node21:09:211
169940,0watchdog/125526-21kthreadcore22:49:251
169940,0watchdog/125039-21wc20:44:331
169940,0watchdog/122601-21munin-node23:09:211
169940,0watchdog/117959-21grep21:04:211
15925240,0sleep00-21swapper/020:59:540
149940,0migration/031675-21irqcore20:04:260
149940,0migration/031109-21kthreadcore23:54:250
149940,0migration/026886-21kthreadcore19:34:260
149940,0migration/026011-21runrttasks00:11:370
149940,0migration/024889-21latency_hist21:29:070
149940,0migration/019781-21kthreadcore22:44:240
149940,0migration/019781-21kthreadcore22:44:240
149940,0migration/016930-21ksmtuned19:52:410
29725030,0irq/27-eth0-tx-0-21swapper/020:14:170
29715030,0irq/26-eth0-rx-0-21swapper/319:59:263
29715030,0irq/26-eth0-rx-0-21swapper/319:34:093
29715030,0irq/26-eth0-rx-0-21swapper/319:29:173
29715030,0irq/26-eth0-rx-0-21swapper/319:24:223
29715030,0irq/26-eth0-rx-0-21swapper/319:09:133
275639933,0cyclictest3556-21lldpd19:10:372
275639932,0cyclictest28729-21awk18:49:232
275629933,0cyclictest3556-21lldpd21:36:061
275629933,0cyclictest0-21swapper/119:03:501
275629932,0cyclictest32390-21awk20:29:221
275629932,0cyclictest30582-21awk19:39:221
275629932,0cyclictest24780-21awk19:59:221
275629930,0cyclictest28477-21perl23:54:211
275629930,0cyclictest0-21swapper/120:07:331
275619933,0cyclictest8349-21kworker/0:022:34:240
275619933,0cyclictest8349-21kworker/0:020:34:110
275619933,0cyclictest8349-21kworker/0:020:19:150
275619933,0cyclictest8349-21kworker/0:018:59:170
275619932,0cyclictest15823-21grep22:24:210
275619930,0cyclictest21084-21perl23:29:210
275619930,0cyclictest0-21swapper/022:50:310
249930,0watchdog/26220-21munin-node20:34:222
249930,0watchdog/20-21swapper/220:39:262
249930,0watchdog/20-21swapper/219:24:262
179930,0migration/15293-21forks20:09:211
169930,0watchdog/10-21swapper/123:44:211
169930,0watchdog/10-21swapper/121:46:371
29715020,0irq/26-eth0-rx-0-21swapper/320:39:133
29715020,0irq/26-eth0-rx-0-21swapper/319:39:283
29715020,0irq/26-eth0-rx-0-21swapper/318:54:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional