You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 03:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Sat Aug 01, 2026 00:43:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3044501060,0irq/25-eth10-21swapper/318:45:013
3073725251,0sleep10-21swapper/118:45:321
3080923425,0sleep20-21swapper/218:46:252
3074123322,0sleep00-21swapper/018:45:350
310309976,0cyclictest28055-21sh21:05:352
310309975,0cyclictest0-21swapper/223:27:282
310309975,0cyclictest0-21swapper/222:03:362
310309973,0cyclictest612-21awk19:13:252
310309973,0cyclictest5325-21awk21:33:252
310309973,0cyclictest3514-21snmpd20:12:262
310309973,0cyclictest27326-21awk19:33:242
310309973,0cyclictest26685-21sadc22:28:102
310309972,0cyclictest22642-21awk20:18:252
310309972,0cyclictest1191-21sadc00:18:092
310309971,0cyclictest20984-21cut19:28:322
310309970,0cyclictest0-21swapper/221:20:432
339960,0migration/37984-21sh23:15:023
339960,0migration/33605-21sh21:09:563
339960,0migration/326805-21sh22:06:373
339960,0migration/317489-21sh23:02:543
310309963,0cyclictest3556-21lldpd19:49:312
310309962,0cyclictest4041-21awk22:13:232
310309962,0cyclictest31996-21tail18:48:242
310309962,0cyclictest28100-21kthreadcore23:28:262
310309962,0cyclictest23889-21kthreadcore19:03:292
310309961,0cyclictest7818-21tr19:43:242
310309961,0cyclictest29244-21sadc20:48:102
310309961,0cyclictest27715-21gltestperf22:28:242
310309960,0cyclictest9300-21fschecks_time23:38:232
310309960,0cyclictest8830-21vmstat20:28:342
310309960,0cyclictest6086-21kthreadcore23:13:272
310309960,0cyclictest6016-21cut23:33:282
310309960,0cyclictest5870-21df18:53:232
310309960,0cyclictest5145-21munin-node21:53:272
310309960,0cyclictest4911-21ssh20:53:132
310309960,0cyclictest440-21expr22:08:272
310309960,0cyclictest4300-21kthreadcore23:58:292
310309960,0cyclictest3349-21if_err_eth022:33:242
310309960,0cyclictest32455-21ssh23:10:142
310309960,0cyclictest30161-21perl20:48:242
310309960,0cyclictest29841-21if_eth121:28:272
310309960,0cyclictest29568-21cut21:08:222
310309960,0cyclictest28764-21taskset19:58:232
310309960,0cyclictest26347-21munin-node22:48:292
310309960,0cyclictest23574-21munin-node00:08:292
310309960,0cyclictest21258-21if_eth021:43:252
310309960,0cyclictest21124-21cpu21:23:222
310309960,0cyclictest21019-21cut22:43:262
310309960,0cyclictest17846-21munin-node23:03:242
310309960,0cyclictest16855-21ssh23:44:002
310309960,0cyclictest16447-21kthreadcore20:13:282
310309960,0cyclictest16124-21port_sshpriv22:38:302
310309960,0cyclictest15811-21kthreadcore21:38:282
310309960,0cyclictest13666-21tune2fs20:58:242
310309960,0cyclictest13531-21df19:23:232
310309960,0cyclictest13408-21sed18:58:282
310309960,0cyclictest12604-21kthreadcore22:18:262
310309960,0cyclictest12530-21cut22:58:262
310309960,0cyclictest11390-21irqstats00:03:262
310309960,0cyclictest0-21swapper/223:53:202
310309960,0cyclictest0-21swapper/223:50:382
310309960,0cyclictest0-21swapper/223:19:442
310309960,0cyclictest0-21swapper/222:53:162
310309960,0cyclictest0-21swapper/221:58:262
310309960,0cyclictest0-21swapper/221:48:222
310309960,0cyclictest0-21swapper/219:18:232
29715060,0irq/26-eth0-rx-24608-21ntp_states22:23:283
149960,0migration/07059-21sh23:34:060
149960,0migration/027603-21sh21:47:020
149960,0migration/024444-21sh23:04:580
149960,0migration/021997-21munin-node21:23:260
339950,0migration/36849-21kthreadcore22:13:263
339950,0migration/34280-21fschecks_count21:53:243
339950,0migration/331143-21kthreadcore19:58:243
339950,0migration/329050-21cpu21:28:233
339950,0migration/328800-21kthreadcore19:33:263
339950,0migration/328402-21idleruntime22:08:233
339950,0migration/32713-21munin-node20:03:273
339950,0migration/32677-21latency_hist20:28:103
339950,0migration/326500-21kthreadcore23:28:263
339950,0migration/326381-21kthreadcore20:43:293
339950,0migration/325817-21kthreadcore21:03:273
339950,0migration/325117-21latency19:28:343
339950,0migration/324880-21runrttasks23:06:183
339950,0migration/317697-21munin-node23:23:233
339950,0migration/317421-21kthreadcore19:48:343
339950,0migration/31703-21sh22:31:393
339950,0migration/315860-21taskset20:37:553
339950,0migration/313849-21munin-node19:23:253
339950,0migration/312381-21kthreadcore19:43:303
339950,0migration/311044-21runrttasks21:34:483
339950,0migration/310803-21kthreadcore20:08:273
339950,0migration/310464-21munin-node20:53:303
310309950,0cyclictest9612-21basename20:33:222
310309950,0cyclictest678-21latency_hist19:38:112
310309950,0cyclictest4777-21latency_hist21:13:102
310309950,0cyclictest28445-21cat20:23:102
310309950,0cyclictest25585-21sh19:08:202
310309950,0cyclictest20725-21cat19:53:112
310309950,0cyclictest1625-21latency_hist20:03:102
310309950,0cyclictest16100-21sed20:38:102
310299950,0cyclictest0-21swapper/122:19:041
310299950,0cyclictest0-21swapper/122:13:331
310299950,0cyclictest0-21swapper/121:05:171
310289954,0cyclictest3514-21snmpd21:31:110
29725050,0irq/27-eth0-tx-31238-21munin-node18:48:310
29725050,0irq/27-eth0-tx-0-21swapper/020:49:430
29725050,0irq/27-eth0-tx-0-21swapper/020:28:270
29715050,0irq/26-eth0-rx-8557-21ssh23:59:213
29715050,0irq/26-eth0-rx-5060-21cut19:38:293
29715050,0irq/26-eth0-rx-30301-21hwlatdetect20:48:253
29715050,0irq/26-eth0-rx-29948-21kthreadcore23:53:263
29715050,0irq/26-eth0-rx-19764-21irqstats23:48:223
29715050,0irq/26-eth0-rx-19470-21sh21:19:283
29715050,0irq/26-eth0-rx-11453-21df_abs22:18:213
29715050,0irq/26-eth0-rx-10833-21df_abs22:38:223
29715050,0irq/26-eth0-rx-0-21swapper/323:46:223
29715050,0irq/26-eth0-rx-0-21swapper/323:34:093
29715050,0irq/26-eth0-rx-0-21swapper/323:18:263
29715050,0irq/26-eth0-rx-0-21swapper/323:10:463
29715050,0irq/26-eth0-rx-0-21swapper/322:43:213
29715050,0irq/26-eth0-rx-0-21swapper/322:33:433
29715050,0irq/26-eth0-rx-0-21swapper/321:59:453
29715050,0irq/26-eth0-rx-0-21swapper/321:43:563
29715050,0irq/26-eth0-rx-0-21swapper/321:23:313
29715050,0irq/26-eth0-rx-0-21swapper/321:13:463
29715050,0irq/26-eth0-rx-0-21swapper/321:01:253
29715050,0irq/26-eth0-rx-0-21swapper/300:13:263
29715050,0irq/26-eth0-rx-0-21swapper/300:12:233
29715050,0irq/26-eth0-rx-0-21swapper/300:03:283
179950,0migration/19648-21turbostat22:58:101
179950,0migration/19165-21fschecks_count23:38:221
179950,0migration/15752-21irqrtprio21:33:271
179950,0migration/1495-21kthreadcore20:23:291
179950,0migration/132458-21kthreadcore20:48:271
179950,0migration/129827-21fschecks_count21:08:231
179950,0migration/128586-21kthreadcore22:28:271
179950,0migration/12498-21munin-node21:28:351
179950,0migration/124350-21kthreadcore19:28:331
179950,0migration/124336-21kthreadcore20:43:281
179950,0migration/123995-21kthreadcore22:03:261
179950,0migration/120918-21taskset21:23:141
179950,0migration/119859-21kthreadcore20:38:281
179950,0migration/118062-21aten_r1power_fr00:08:201
149950,0migration/08114-21kthreadcore22:13:260
149950,0migration/06921-21kthreadcore21:13:260
149950,0migration/04439-21taskset21:33:160
149950,0migration/04218-21kthreadcore20:03:280
149950,0migration/030484-21kthreadcore00:13:260
149950,0migration/029897-21fschecks_time21:08:230
149950,0migration/028365-21kthreadcore19:08:260
149950,0migration/027151-21hwlatdetect22:48:250
149950,0migration/027079-21kthreadcore23:28:260
149950,0migration/02673-21fschecks_time23:58:260
149950,0migration/02620-21sh22:12:340
149950,0migration/022245-21kthreadcore19:28:330
149950,0migration/017867-21fschecks_time23:23:230
149950,0migration/014230-21kthreadcore18:58:280
149950,0migration/013578-21fschecks_count21:18:240
149950,0migration/013319-21kthreadcore22:58:260
149950,0migration/011742-21kthreadcore23:18:260
149950,0migration/010085-21kthreadcore20:08:260
339940,0migration/320473-21kthreadcore19:03:283
339940,0migration/318751-21latency_hist19:03:113
310299944,0cyclictest0-21swapper/122:45:521
310299943,0cyclictest9344-21awk20:08:241
310299943,0cyclictest7467-21awk19:18:251
310299943,0cyclictest3556-21lldpd21:38:321
310299943,0cyclictest3514-21snmpd19:39:261
310299943,0cyclictest3514-21snmpd19:15:561
310299943,0cyclictest3514-21snmpd18:49:561
310299943,0cyclictest27450-21awk19:33:251
310299943,0cyclictest26463-21awk19:08:241
310299943,0cyclictest24830-21sadc23:28:091
310299943,0cyclictest22681-21awk20:18:251
310299943,0cyclictest21534-21sadc20:18:101
310299943,0cyclictest19987-21awk22:23:231
310299943,0cyclictest18793-21awk23:03:241
310299943,0cyclictest1719-21sadc23:58:091
310299943,0cyclictest12631-21awk21:58:241
310299943,0cyclictest10357-21awk20:33:251
310289944,0cyclictest0-21swapper/021:02:080
310289943,0cyclictest5913-21awk20:53:260
310289943,0cyclictest3514-21snmpd22:29:270
310289943,0cyclictest3514-21snmpd21:57:270
310289943,0cyclictest3514-21snmpd20:35:110
310289943,0cyclictest3514-21snmpd19:41:260
310289943,0cyclictest29244-21sadc20:48:100
310289943,0cyclictest26625-21awk23:08:240
310289943,0cyclictest14051-21awk19:23:260
310289943,0cyclictest11362-21awk22:38:250
310289940,0cyclictest0-21swapper/000:05:390
29725040,0irq/27-eth0-tx-21893-21telnet20:18:220
29725040,0irq/27-eth0-tx-20810-21munin-node19:53:210
29725040,0irq/27-eth0-tx-0-21swapper/020:13:220
29725040,0irq/27-eth0-tx-0-21swapper/019:58:210
29715040,0irq/26-eth0-rx-6559-21runrttasks19:53:223
29715040,0irq/26-eth0-rx-0-21swapper/323:38:133
29715040,0irq/26-eth0-rx-0-21swapper/322:53:463
29715040,0irq/26-eth0-rx-0-21swapper/322:48:203
29715040,0irq/26-eth0-rx-0-21swapper/321:48:513
29715040,0irq/26-eth0-rx-0-21swapper/321:38:183
29715040,0irq/26-eth0-rx-0-21swapper/320:38:333
29715040,0irq/26-eth0-rx-0-21swapper/320:23:293
29715040,0irq/26-eth0-rx-0-21swapper/318:48:263
179940,0migration/18523-21timerwakeupswit22:33:321
179940,0migration/18345-21idleruntime19:43:261
179940,0migration/14952-21irqcore21:53:271
179940,0migration/13509-21munin-node20:28:241
179940,0migration/131602-21kthreadcore22:08:261
179940,0migration/130618-21kthreadcore19:58:241
179940,0migration/129843-21kthreadcore21:48:261
179940,0migration/123091-21kthreadcore21:43:271
179940,0migration/120921-21kthreadcore23:48:221
179940,0migration/11578-21cpuspeed_turbos23:13:221
179940,0migration/113422-21df_abs21:18:231
179940,0migration/111702-21taskset18:54:461
179940,0migration/110225-21kthreadcore21:13:271
179940,0migration/110044-21gltestperf23:18:221
169940,0watchdog/17640-21kthreadcore20:53:281
169940,0watchdog/15629-21kthreadcore20:03:291
169940,0watchdog/127039-21fschecks_time22:48:241
169940,0watchdog/117612-21kthreadcore20:58:281
169940,0watchdog/117455-21ssh23:45:521
169940,0watchdog/114220-21grep00:03:281
169940,0watchdog/10-21swapper/123:29:121
169940,0watchdog/10-21swapper/122:38:121
169940,0watchdog/10-21swapper/118:58:291
149940,0migration/04628-21kthreadcore22:53:280
149940,0migration/028044-21kthreadcore23:53:250
149940,0migration/018991-21sh19:03:230
149940,0migration/017131-21iostat20:38:260
149940,0migration/015783-21kthreadcore22:18:270
149940,0migration/01334-21aten_r1power_en23:13:210
310299932,0cyclictest3514-21snmpd00:14:221
310299930,0cyclictest6288-21ntp_states23:33:301
310299930,0cyclictest26373-21fschecks_time23:08:231
310299930,0cyclictest21011-21grep19:03:281
310299930,0cyclictest0-21swapper/123:58:301
310289933,0cyclictest16969-21kworker/0:022:45:050
310289933,0cyclictest16969-21kworker/0:022:03:130
310289933,0cyclictest16969-21kworker/0:021:38:150
310289933,0cyclictest16969-21kworker/0:021:03:110
310289933,0cyclictest16969-21kworker/0:019:48:400
310289933,0cyclictest16969-21kworker/0:019:43:140
310289933,0cyclictest16969-21kworker/0:019:33:140
310289933,0cyclictest16969-21kworker/0:018:53:140
310289932,0cyclictest3556-21lldpd00:09:330
310289932,0cyclictest3514-21snmpd23:44:170
310289932,0cyclictest3514-21snmpd22:23:260
310289932,0cyclictest3514-21snmpd21:48:200
310289932,0cyclictest3514-21snmpd20:23:260
310289932,0cyclictest3491-21awk22:33:250
310289932,0cyclictest19028-21grep23:48:190
310289932,0cyclictest12163-21df_abs21:58:220
310289932,0cyclictest11283-21grep19:18:270
310289930,0cyclictest0-21swapper/023:39:040
310289930,0cyclictest0-21swapper/019:13:240
29715030,0irq/26-eth0-rx-0-21swapper/320:18:213
29715030,0irq/26-eth0-rx-0-21swapper/319:22:043
29715030,0irq/26-eth0-rx-0-21swapper/319:13:223
29715030,0irq/26-eth0-rx-0-21swapper/319:10:183
29715030,0irq/26-eth0-rx-0-21swapper/318:53:353
179930,0migration/19903-21sh22:58:181
169930,0watchdog/10-21swapper/119:23:251
310299921,0cyclictest14070-21latency_hist19:48:111
310299920,0cyclictest0-21swapper/119:53:141
29715020,0irq/26-eth0-rx-0-21swapper/320:13:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional