You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 09:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Sep 08, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313579912791,1247cyclictest871-21munin-node19:30:011
312742592547,29sleep00-21swapper/019:24:430
312742592547,29sleep00-21swapper/019:24:420
302802504457,29sleep10-21swapper/119:20:221
302802504457,29sleep10-21swapper/119:20:211
3135699235210,18cyclictest760-21latency_hist19:30:000
76102890,9sleep03135699cyclictest19:45:140
245052790,7sleep03135699cyclictest20:30:130
70032590,8sleep03135699cyclictest21:10:120
300432450,8sleep03135699cyclictest22:10:200
91292430,7sleep03135699cyclictest21:15:140
31357993814,12cyclictest22-21ksoftirqd/119:50:301
3135699381,13cyclictest11717-21cron00:15:000
190742381,33sleep019092-21ntp_states21:40:250
177042381,5sleep117751-21/usr/sbin/munin20:10:281
31357993722,4cyclictest22-21ksoftirqd/121:39:591
87342361,6sleep18781-21df_inode22:40:141
39432361,6sleep14038-21hddtemp_smartct19:35:171
3135799365,4cyclictest81rcu_preempt00:30:251
3135799355,4cyclictest81rcu_preempt20:05:001
3135799351,6cyclictest22-21ksoftirqd/100:00:271
31357993416,4cyclictest81rcu_preempt20:05:241
31357993410,11cyclictest22-21ksoftirqd/120:45:211
3135699341,21cyclictest6567-21ls22:35:000
210992341,28sleep121182-21memory20:20:211
95282336,5sleep122-21ksoftirqd/100:06:501
3135699336,4cyclictest81rcu_preempt19:50:140
3135699332,16cyclictest25274-21munin-run23:25:010
55142321,27sleep15552-21ntp_states22:30:251
3135799322,4cyclictest81rcu_preempt23:25:171
3135699322,17cyclictest3450-21iostat_ios22:25:200
3135699321,19cyclictest15461-21tr21:30:300
71962311,26sleep17201-21irqstats22:35:211
3135799318,4cyclictest81rcu_preempt21:20:281
3135799315,4cyclictest81rcu_preempt22:53:021
3135799315,4cyclictest81rcu_preempt22:08:161
31357993117,8cyclictest16619-21iostat_ios23:00:191
31357993116,12cyclictest22-21ksoftirqd/120:41:171
31357993115,4cyclictest40250irq/92-i91522:55:151
3135799311,4cyclictest81rcu_preempt23:34:271
3135799311,16cyclictest2419-21ntp_states19:30:261
3135799311,16cyclictest23633-21users20:25:301
3135799311,16cyclictest22244-21iostat_ios23:15:211
3135699314,21cyclictest26611-21ntp_states22:00:220
3135699313,13cyclictest11565-21gdbus23:32:000
3135699312,4cyclictest81rcu_preempt22:45:310
3135699311,4cyclictest81rcu_preempt19:37:460
25962310,2sleep12598-21grep23:50:161
25692311,9sleep10-21swapper/120:56:121
234902311,5sleep10-21swapper/121:52:321
144062310,9sleep03135699cyclictest22:55:130
140002311,5sleep10-21swapper/121:26:381
56382301,5sleep00-21swapper/023:55:330
3135799306,4cyclictest81rcu_preempt23:39:121
3135799304,4cyclictest81rcu_preempt00:20:121
31357993018,9cyclictest22-21ksoftirqd/122:20:111
3135799301,4cyclictest81rcu_preempt20:32:231
3135799301,4cyclictest81rcu_preempt00:54:151
3135799301,4cyclictest81rcu_preempt00:45:291
31357993014,12cyclictest22-21ksoftirqd/121:48:171
3135799301,16cyclictest5084-21/usr/sbin/munin21:05:141
3135799300,4cyclictest81rcu_preempt00:39:151
31356993020,6cyclictest3-21ksoftirqd/023:15:120
3135699301,25cyclictest13934-21egrep00:20:130
3135699301,18cyclictest17890-21runrttasks23:05:070
3135699301,15cyclictest27690-21taskset20:38:310
3135699301,14cyclictest18080-21cron21:39:590
212252301,9sleep10-21swapper/123:12:191
123832301,5sleep00-21swapper/021:24:170
85832291,5sleep10-21swapper/121:14:061
64982291,5sleep00-21swapper/021:06:590
46332291,5sleep10-21swapper/121:02:031
3135799291,4cyclictest81rcu_preempt23:46:071
3135799291,12cyclictest11716-21cron00:15:011
31357992910,14cyclictest308862chrt22:11:151
31357992910,14cyclictest12061-21mailstats19:55:271
3135699299,6cyclictest1855-21/usr/sbin/munin19:30:150
3135699293,12cyclictest20075-21diskstats23:10:190
31356992921,5cyclictest2144-21gzip20:55:260
3135699292,14cyclictest28612-21/usr/sbin/munin20:40:190
3135699292,13cyclictest21594-21diskstats00:40:160
3135699292,12cyclictest11564-21packagekitd00:49:130
3135699291,4cyclictest81rcu_preempt00:28:350
3135699291,4cyclictest81rcu_preempt00:06:350
3135699291,18cyclictest0-21swapper/021:03:480
3135699291,16cyclictest20910-21grep20:20:150
31356992911,6cyclictest0-21swapper/020:17:340
3135699291,15cyclictest31994-21/usr/sbin/munin22:15:180
3135699291,14cyclictest13879-21/usr/sbin/munin21:25:290
31356992911,14cyclictest307202chrt23:38:190
261092291,4sleep10-21swapper/120:35:051
174662291,5sleep00-21swapper/023:02:150
126842291,5sleep00-21swapper/019:58:590
100702291,5sleep00-21swapper/022:43:360
71412281,4sleep00-21swapper/019:44:550
67772281,5sleep10-21swapper/119:41:061
3135799285,4cyclictest81rcu_preempt23:24:471
3135799285,4cyclictest81rcu_preempt20:15:401
3135799285,3cyclictest81rcu_preempt19:49:011
3135799282,5cyclictest12596-21missed_timers00:15:221
3135799282,4cyclictest81rcu_preempt22:27:061
3135799281,4cyclictest81rcu_preempt00:43:461
31357992811,5cyclictest40250irq/92-i91521:55:141
31357992811,5cyclictest22-21ksoftirqd/122:15:181
31357992810,4cyclictest81rcu_preempt21:30:261
3135699289,5cyclictest14870-21aten_r4power_cu20:05:120
3135699289,5cyclictest11565-21gdbus21:52:550
3135699282,14cyclictest25390-21diskstats00:50:190
3135699282,14cyclictest0-21swapper/020:48:350
3135699282,13cyclictest31904-21ntp_states23:40:260
3135699282,13cyclictest20830-21/usr/sbin/munin21:45:220
3135699281,4cyclictest81rcu_preempt21:57:290
3135699281,4cyclictest81rcu_preempt00:15:110
31356992813,11cyclictest7383-21ls00:00:280
31356992812,4cyclictest81rcu_preempt20:25:250
3135699281,18cyclictest0-21swapper/022:07:460
3135699281,14cyclictest17002-21df20:10:130
3135699281,14cyclictest13719-21grep20:00:210
3135699281,12cyclictest3805-21cron23:50:590
31356992810,6cyclictest18917-21taskset00:31:400
274542281,5sleep10-21swapper/122:04:341
208862281,5sleep00-21swapper/000:37:400
197052281,5sleep10-21swapper/121:42:131
18982281,5sleep00-21swapper/023:46:510
170652281,5sleep10-21swapper/100:26:591
136952281,5sleep00-21swapper/022:52:160
119282281,5sleep10-21swapper/122:48:211
3135799279,6cyclictest0-21swapper/120:50:111
31357992712,11cyclictest22-21ksoftirqd/123:55:111
3135699279,6cyclictest1457-21/usr/sbin/munin22:20:190
3135699271,14cyclictest31955-21cpuspeed_turbos20:50:110
323622261,4sleep10-21swapper/123:40:391
3135799261,7cyclictest0-21swapper/123:05:391
3135699269,5cyclictest26086-21cat23:25:220
3135699261,13cyclictest6601-21munin-node22:35:120
31357992517,4cyclictest22-21ksoftirqd/121:15:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional