You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-27 - 06:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Wed May 27, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
150239911611152,6cyclictest0-21swapper/119:27:321
148122608526,32sleep00-21swapper/019:23:190
145832542446,31sleep10-21swapper/119:20:591
150229911784,20cyclictest0-21swapper/019:27:330
15023994619,4cyclictest22-21ksoftirqd/121:07:341
209192441,4sleep021011-21cat21:05:000
269762401,5sleep127059-21memory22:45:211
15023994017,12cyclictest22-21ksoftirqd/100:35:191
82862380,8sleep01502299cyclictest21:55:230
1502399381,7cyclictest22-21ksoftirqd/123:00:121
1502399381,7cyclictest22-21ksoftirqd/122:15:221
1502399381,7cyclictest22-21ksoftirqd/120:00:261
1502399381,7cyclictest22-21ksoftirqd/100:20:241
15023993815,19cyclictest22-21ksoftirqd/121:15:181
1502299382,13cyclictest10467-21munin-run00:55:000
15023993721,4cyclictest22-21ksoftirqd/121:13:521
1502399371,7cyclictest22-21ksoftirqd/123:45:111
1502399371,7cyclictest22-21ksoftirqd/122:40:171
1502399371,7cyclictest22-21ksoftirqd/120:35:251
1502399371,7cyclictest22-21ksoftirqd/120:10:191
1502399371,7cyclictest22-21ksoftirqd/100:45:221
1502399371,6cyclictest8500-21iostat20:30:181
1502399371,6cyclictest22-21ksoftirqd/123:50:121
1502399371,6cyclictest22-21ksoftirqd/123:20:131
1502399371,6cyclictest22-21ksoftirqd/123:05:151
1502399371,6cyclictest22-21ksoftirqd/122:25:131
1502399371,6cyclictest22-21ksoftirqd/122:10:111
1502399371,6cyclictest22-21ksoftirqd/121:40:171
1502399371,6cyclictest22-21ksoftirqd/121:25:141
1502399371,6cyclictest22-21ksoftirqd/121:20:221
1502399371,6cyclictest22-21ksoftirqd/121:20:211
1502399371,6cyclictest22-21ksoftirqd/100:25:191
15023993714,4cyclictest81rcu_preempt23:30:171
1502299372,21cyclictest23463-21hddtemp_smartct21:10:180
15022993711,13cyclictest16113-21taskset23:41:320
20722361,31sleep02119-21/usr/sbin/munin00:30:280
1502399367,4cyclictest81rcu_preempt22:57:341
1502399361,7cyclictest22-21ksoftirqd/100:30:141
1502399361,6cyclictest22-21ksoftirqd/123:55:261
1502399361,6cyclictest22-21ksoftirqd/123:35:151
1502399361,6cyclictest22-21ksoftirqd/119:40:211
1502399361,6cyclictest22-21ksoftirqd/100:00:171
1502399361,5cyclictest22-21ksoftirqd/123:10:131
1502399361,14cyclictest287422sh22:50:171
1502299362,21cyclictest11920-21irqstats22:05:180
29992351,5sleep00-21swapper/023:07:200
15023993520,4cyclictest22-21ksoftirqd/121:02:581
1502399351,5cyclictest22-21ksoftirqd/122:20:151
1502399351,4cyclictest81rcu_preempt19:35:221
15022993525,6cyclictest32514-21hddtemp_smartct23:00:150
15022993510,14cyclictest24726-21iostat00:05:220
50862341,29sleep15170-21sensors_temp20:20:281
1502399344,6cyclictest22-21ksoftirqd/119:50:181
1502399344,6cyclictest22-21ksoftirqd/119:50:171
1502399341,7cyclictest22-21ksoftirqd/120:40:121
15023993413,6cyclictest22-21ksoftirqd/123:20:001
15022993412,7cyclictest5970-21diskstats21:50:150
116162340,9sleep11502399cyclictest22:05:121
323712331,5sleep132424-21wget21:35:121
266162331,28sleep011565-21gdbus19:51:540
266162331,28sleep011565-21gdbus19:51:530
1502399336,3cyclictest81rcu_preempt21:45:141
15023993317,5cyclictest22-21ksoftirqd/123:40:171
1502399331,6cyclictest22-21ksoftirqd/122:30:101
1502399331,5cyclictest22-21ksoftirqd/123:25:101
15023993311,4cyclictest81rcu_preempt19:30:261
1502299331,13cyclictest0-21swapper/020:23:330
303262321,27sleep030346-21munin-run21:30:000
170152321,5sleep10-21swapper/120:53:381
1502399321,4cyclictest81rcu_preempt00:05:201
15023993211,4cyclictest81rcu_preempt20:05:231
1502299325,14cyclictest23976-21latency_hist00:05:010
1502299322,15cyclictest27387-21python22:45:270
15022993212,6cyclictest31143-21df_inode20:05:140
15022993211,7cyclictest7468-21irqstats00:45:200
1502399319,5cyclictest81rcu_preempt20:45:231
1502399313,4cyclictest81rcu_preempt21:51:371
1502399312,4cyclictest22-21ksoftirqd/120:15:121
1502399311,7cyclictest22-21ksoftirqd/122:35:151
15023993110,4cyclictest81rcu_preempt20:55:221
1502299313,4cyclictest81rcu_preempt19:57:170
1502299313,14cyclictest7490-21df23:20:130
1502299312,16cyclictest0-21swapper/023:57:390
1502299312,14cyclictest16817-21munin-run22:20:000
1502299311,4cyclictest81rcu_preempt22:54:090
15022993111,7cyclictest26099-21grep21:15:290
15022993111,16cyclictest284002chrt21:24:260
15022993111,16cyclictest284002chrt21:24:260
65242301,6sleep00-21swapper/020:25:180
220082301,5sleep00-21swapper/022:30:320
208782301,5sleep00-21swapper/019:35:590
1502399309,4cyclictest81rcu_preempt20:25:221
1502399302,3cyclictest22-21ksoftirqd/121:33:221
1502399301,4cyclictest81rcu_preempt22:00:121
1502399301,4cyclictest81rcu_preempt00:15:221
1502299308,17cyclictest111172chrt22:04:360
1502299301,4cyclictest81rcu_preempt21:42:020
1502299301,4cyclictest81rcu_preempt20:45:570
15022993012,5cyclictest30073-21diskstats00:20:140
1502299301,19cyclictest12507-21sshd23:33:180
15022993011,6cyclictest11622-21cat20:40:010
1502299301,14cyclictest13822-21awk23:35:260
1502299301,13cyclictest5506-21grep23:15:120
46272291,5sleep00-21swapper/000:38:260
300722291,5sleep00-21swapper/022:55:020
230952291,5sleep00-21swapper/022:35:180
199382291,5sleep00-21swapper/023:52:200
169512291,5sleep00-21swapper/020:52:580
15023992915,11cyclictest22-21ksoftirqd/119:55:181
1502399291,4cyclictest81rcu_preempt19:45:481
1502299298,4cyclictest0-21swapper/021:30:220
1502299297,12cyclictest1581-21runrttasks20:10:480
1502299293,4cyclictest81rcu_preempt19:35:000
1502299293,14cyclictest0-21swapper/000:10:020
1502299292,14cyclictest13798-21iostat_ios22:10:200
15022992919,5cyclictest4837-21wc21:45:270
15022992910,6cyclictest6161-21grep00:40:290
15022992910,6cyclictest26217-21ls22:45:010
104202291,5sleep00-21swapper/023:26:080
274192281,5sleep10-21swapper/100:11:591
249342281,5sleep00-21swapper/019:48:560
214482281,5sleep00-21swapper/019:40:080
185702281,5sleep00-21swapper/022:23:460
1502399281,15cyclictest8040-21smartctl21:55:161
1502299287,5cyclictest9617-21cron20:35:000
131642281,5sleep00-21swapper/020:42:360
12322281,5sleep00-21swapper/021:35:590
48752271,5sleep00-21swapper/023:12:120
181832271,3sleep00-21swapper/023:48:340
1502399278,4cyclictest22-21ksoftirqd/100:50:191
1502399271,13cyclictest0-21swapper/100:44:001
1502299279,6cyclictest3283-21taskset20:15:280
1502299278,6cyclictest21459-21tune2fs21:05:160
1502299271,13cyclictest412-21unixbench_singl00:25:270
1502299271,13cyclictest28707-21/usr/sbin/munin00:15:250
1502299269,15cyclictest0-21swapper/020:02:440
1502299262,5cyclictest11565-21gdbus22:25:120
15022992515,6cyclictest19045-21cron21:00:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional