You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 14:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Fri Sep 11, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
276059911791169,7cyclictest0-21swapper/121:45:291
276059911461133,10cyclictest0-21swapper/119:25:101
272702642598,30sleep00-21swapper/019:22:020
267302480431,32sleep10-21swapper/119:20:261
2760499158134,20cyclictest0-21swapper/021:45:290
2760499127101,23cyclictest0-21swapper/019:25:100
231752910,2sleep10-21swapper/122:00:301
231752910,2sleep10-21swapper/122:00:291
174872660,5sleep017486-21grep20:20:210
118392550,7sleep02760499cyclictest21:30:290
109602460,7sleep0111rcuc/022:55:200
2760499391,15cyclictest1406-21turbostat.cron19:40:000
36782381,33sleep13682-21ntp_states22:35:251
2760499383,16cyclictest23220-21grep22:00:310
2760499383,16cyclictest23220-21grep22:00:300
2760499362,22cyclictest20144-21/usr/sbin/munin23:20:150
2760499361,9cyclictest9068-21grep21:25:130
27604993619,6cyclictest3-21ksoftirqd/020:04:230
2760499352,18cyclictest0-21swapper/000:30:300
27604993519,5cyclictest3-21ksoftirqd/021:17:530
2760499351,22cyclictest14003-21taskset21:36:400
27605993424,6cyclictest26679-21/usr/sbin/munin23:35:291
27604993418,5cyclictest3-21ksoftirqd/021:00:590
27604993418,5cyclictest3-21ksoftirqd/020:44:350
27604993418,5cyclictest3-21ksoftirqd/020:12:010
97242331,28sleep19798-21iostat20:00:191
77202331,4sleep17782-21ntpq21:20:251
2760499339,12cyclictest12927-21python00:25:280
2760499338,11cyclictest25939-21hwlatdetect23:35:190
2760499332,20cyclictest2225-21dbus-daemon19:41:590
27604993317,6cyclictest3-21ksoftirqd/019:46:580
27604993317,6cyclictest3-21ksoftirqd/000:48:450
2760499321,7cyclictest2891-21wget22:35:120
27604993215,6cyclictest3-21ksoftirqd/000:15:330
27604993212,7cyclictest30915-21python20:55:270
27604993212,6cyclictest31678-21iostat_ios23:50:210
318292311,5sleep10-21swapper/119:33:311
2760599315,4cyclictest81rcu_preempt00:08:081
27605993122,6cyclictest24079-21cron20:40:001
2760599311,4cyclictest81rcu_preempt23:41:521
2760499312,14cyclictest15343-21ntp_states21:40:260
27604993116,5cyclictest3-21ksoftirqd/023:49:360
27604993116,5cyclictest3-21ksoftirqd/000:22:020
27604993115,6cyclictest3-21ksoftirqd/000:41:290
27604993112,7cyclictest5211-21ntp_states00:05:240
27604993112,6cyclictest27758-21cron20:49:000
2760499311,25cyclictest14143-21munin-node23:05:120
2760499311,18cyclictest13988-21latency_hist23:05:000
172672311,5sleep10-21swapper/100:39:001
161272311,5sleep10-21swapper/120:15:371
64492301,25sleep06460-21munin-run22:45:000
2760599306,4cyclictest81rcu_preempt23:51:191
27604993015,5cyclictest3-21ksoftirqd/019:57:220
27604993014,5cyclictest3-21ksoftirqd/020:31:530
27604993013,5cyclictest3-21ksoftirqd/020:51:350
27604993012,4cyclictest0-21swapper/023:15:140
27604993011,6cyclictest6267-21ntp_states19:50:240
27604993010,4cyclictest1811-21wc22:30:250
272672301,6sleep00-21swapper/022:12:380
271732301,5sleep10-21swapper/122:11:401
204502301,4sleep120498-21awk00:45:281
123812301,5sleep10-21swapper/120:05:391
77432291,5sleep00-21swapper/000:12:410
312342291,5sleep10-21swapper/122:24:341
3122291,4sleep00-21swapper/022:26:070
304832291,5sleep10-21swapper/123:45:331
2760599295,4cyclictest81rcu_preempt22:52:171
2760599295,4cyclictest81rcu_preempt22:06:361
2760599295,4cyclictest81rcu_preempt00:40:411
2760599294,9cyclictest7912-21iostat_ios19:55:181
2760599294,18cyclictest3804-21iostat_ios21:10:181
2760599292,12cyclictest12091-21munin-run23:00:001
27605992918,6cyclictest13226-21uname21:35:221
2760599291,3cyclictest81rcu_preempt19:35:341
2760599291,3cyclictest81rcu_preempt00:29:331
27605992911,6cyclictest21182chrt23:58:571
2760499292,14cyclictest7113-21hddtemp_smartct22:45:180
2760499292,14cyclictest7113-21hddtemp_smartct22:45:180
2760499292,14cyclictest2401-21NetworkManager20:25:210
2760499292,14cyclictest2401-21NetworkManager20:25:210
2760499292,14cyclictest20730-21iostat_ios21:55:190
27604992916,4cyclictest3-21ksoftirqd/000:38:360
27604992913,4cyclictest27946-21df22:15:120
27604992912,5cyclictest22684-21python23:25:260
2760499291,15cyclictest19808-21runrttasks21:53:190
254402291,5sleep00-21swapper/022:08:080
250692291,5sleep10-21swapper/123:33:021
250692291,5sleep10-21swapper/123:33:021
248392291,5sleep00-21swapper/023:30:410
248392291,5sleep00-21swapper/023:30:400
161462291,4sleep10-21swapper/121:44:151
122052291,5sleep10-21swapper/121:32:281
9532281,5sleep10-21swapper/121:04:031
84532281,5sleep00-21swapper/021:22:290
67382281,5sleep10-21swapper/119:50:441
47422281,5sleep10-21swapper/122:40:101
318862281,4sleep131937-21hddtemp_smartct22:25:181
2760599286,10cyclictest1773-21cat21:05:191
2760599285,4cyclictest81rcu_preempt00:04:571
2760599284,9cyclictest9152-21diskstats21:25:141
2760599282,21cyclictest29751-21munin-run20:55:011
27605992818,6cyclictest18087-21cpuspeed_turbos23:15:091
2760599281,6cyclictest81rcu_preempt22:18:221
2760599281,13cyclictest19342-21timerandwakeup21:50:281
2760599280,3cyclictest81rcu_preempt20:46:061
2760499282,5cyclictest0-21swapper/023:56:590
2760499282,13cyclictest0-21swapper/020:35:120
27604992811,5cyclictest30393-21ntp_states22:20:230
27604992811,5cyclictest2401-21NetworkManager20:05:490
27604992810,6cyclictest30867-21kernelversion19:30:200
27604992810,6cyclictest2590-21wc00:00:120
143832281,4sleep10-21swapper/100:30:211
135962281,5sleep10-21swapper/123:01:031
50842271,5sleep10-21swapper/121:15:111
29752271,5sleep10-21swapper/119:40:421
2760599276,4cyclictest81rcu_preempt20:13:451
2760599274,4cyclictest81rcu_preempt00:51:551
2760599273,17cyclictest3566-21/usr/sbin/munin19:45:301
27605992714,10cyclictest2062-21grep22:30:291
2760499273,12cyclictest2433-21sed21:05:290
2760499271,14cyclictest28773-21seq23:42:170
2760499271,13cyclictest9431-21/usr/sbin/munin22:50:300
2760499271,13cyclictest16015-21sed20:15:290
2760499271,12cyclictest3892-21/usr/sbin/munin21:10:200
27604992710,6cyclictest16844-21ntp_states23:10:230
216462271,5sleep00-21swapper/000:50:190
200542271,5sleep10-21swapper/120:27:121
200542271,5sleep10-21swapper/120:27:111
175412271,5sleep10-21swapper/123:13:041
154842271,5sleep10-21swapper/123:06:121
2760599265,4cyclictest81rcu_preempt00:16:561
2760599265,4cyclictest81rcu_preempt00:13:271
2760599264,7cyclictest2225-21dbus-daemon00:22:151
2760599264,4cyclictest81rcu_preempt23:22:581
2760599261,4cyclictest81rcu_preempt20:41:161
233322261,4sleep10-21swapper/123:29:301
27605992517,5cyclictest22-21ksoftirqd/122:47:271
27605992517,5cyclictest22-21ksoftirqd/122:47:271
2760599251,3cyclictest81rcu_preempt20:20:021
2760599251,12cyclictest0-21swapper/120:55:271
2760599241,9cyclictest20549-21basename20:30:111
2760599241,11cyclictest20730-21iostat_ios21:55:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional