You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-15 - 05:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Nov 15, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
277729911571119,21cyclictest29961-21irqstats19:30:020
277739911491124,19cyclictest29645-21munin-node19:30:001
275612619518,31sleep00-21swapper/019:23:170
276992459371,73sleep10-21swapper/119:24:491
2777399177171,3cyclictest0-21swapper/119:30:031
277729910381,18cyclictest29631-21munin-run19:30:010
90232460,4sleep1201rcuc/122:50:221
97682440,7sleep00-21swapper/020:00:150
97682440,7sleep00-21swapper/020:00:150
2777299361,20cyclictest32286-21taskset23:53:330
2777399353,5cyclictest3548-21latency_hist19:45:001
2777299359,13cyclictest3299-21runrttasks22:40:270
249292351,11sleep125020-21latency_hist23:35:011
62872340,2sleep06285-21awk21:15:290
278742341,5sleep127986-21hddtemp_smartct22:15:171
2777399345,4cyclictest81rcu_preempt19:56:421
2777399345,4cyclictest81rcu_preempt19:46:381
27772993413,7cyclictest3768-21iostat_ios21:10:190
27772993410,13cyclictest12646-21seq23:00:210
27772993410,13cyclictest12646-21seq23:00:200
259832341,29sleep126004-21munin-run20:45:001
80112331,5sleep00-21swapper/022:49:050
63882331,28sleep16410-21awk19:50:261
29342332,27sleep03077-21fschecks_time22:35:150
2777399337,4cyclictest81rcu_preempt23:07:131
2777399335,4cyclictest81rcu_preempt20:20:391
192432331,28sleep013239-21gdbus23:19:130
93502321,26sleep19385-21iostat21:25:201
2777399325,4cyclictest81rcu_preempt20:01:391
2777399325,4cyclictest81rcu_preempt20:01:391
2777399325,20cyclictest6460-21iostat_ios00:10:201
2777399324,4cyclictest81rcu_preempt22:34:041
2777399321,18cyclictest6983-21iostat22:45:181
27772993216,13cyclictest3-21ksoftirqd/000:02:310
2777399316,4cyclictest81rcu_preempt00:21:391
2777399314,4cyclictest81rcu_preempt21:50:551
2777399314,4cyclictest81rcu_preempt00:40:391
2777399312,4cyclictest81rcu_preempt21:09:451
27773993112,5cyclictest6924-21/usr/sbin/munin21:20:211
2777299315,13cyclictest1971-21cat00:00:010
27772993113,5cyclictest19158-21/usr/sbin/munin21:50:270
27772993112,7cyclictest8650-21munin-plugin-st21:25:000
2777299311,17cyclictest3612-21wc19:45:020
2777299311,14cyclictest2311-21ls21:05:280
142222311,4sleep114264-21awk21:40:001
2777399307,12cyclictest40650irq/92-i91520:55:151
2777399305,4cyclictest81rcu_preempt00:52:361
2777399304,4cyclictest81rcu_preempt23:03:411
2777399304,4cyclictest81rcu_preempt23:03:411
2777399303,4cyclictest81rcu_preempt22:05:361
27773993020,6cyclictest23612-21awk22:05:011
2777399301,4cyclictest81rcu_preempt22:28:471
27773993010,7cyclictest16020-21runrttasks21:44:011
2777299308,4cyclictest81rcu_preempt22:15:010
2777299306,12cyclictest11575-21fschecks_time20:05:160
2777299305,11cyclictest28111-21timerwakeupswit23:40:290
2777299302,15cyclictest12025-21/usr/sbin/munin00:25:170
2777299302,14cyclictest24995-21/usr/sbin/munin20:40:230
2777299301,24cyclictest27507-21basename22:15:110
2777299301,17cyclictest0-21swapper/021:40:250
27772993011,6cyclictest632-21ntpdc19:35:200
151662301,5sleep00-21swapper/023:05:360
73582291,5sleep00-21swapper/000:12:500
54772291,5sleep10-21swapper/100:07:401
53072291,5sleep00-21swapper/000:05:530
3542291,5sleep00-21swapper/022:28:370
305312291,5sleep10-21swapper/123:49:471
2777399295,4cyclictest81rcu_preempt21:10:511
2777399294,4cyclictest81rcu_preempt22:10:051
2777399294,4cyclictest81rcu_preempt21:15:121
2777399293,4cyclictest81rcu_preempt21:01:291
2777399293,4cyclictest81rcu_preempt00:15:071
2777399292,4cyclictest81rcu_preempt23:20:361
2777399292,4cyclictest81rcu_preempt20:37:241
2777399291,4cyclictest81rcu_preempt00:45:261
2777299293,14cyclictest14154-21timerandwakeup20:10:280
2777299292,14cyclictest30775-21/usr/sbin/munin20:55:270
2777299292,12cyclictest8653-21/usr/sbin/munin00:15:250
2777299292,12cyclictest11461-21ntpdc21:30:230
2777299292,12cyclictest11461-21ntpdc21:30:230
2777299291,4cyclictest81rcu_preempt23:46:280
2777299291,4cyclictest81rcu_preempt22:31:040
2777299291,4cyclictest81rcu_preempt20:27:580
27772992914,11cyclictest10232-21sed00:20:200
2777299291,24cyclictest5407-21watchsnmpd19:50:000
27772992911,5cyclictest15474-21if_eth020:15:180
27772992911,5cyclictest10780-21/usr/sbin/munin22:55:200
2777299291,14cyclictest14607-21head00:30:290
27772992910,6cyclictest22412-21/usr/sbin/munin23:25:260
27772992910,5cyclictest23155-21needreboot20:35:220
2777299290,4cyclictest81rcu_preempt20:20:430
230632291,4sleep123078-21awk23:30:001
217072291,5sleep00-21swapper/021:59:590
215712291,5sleep10-21swapper/121:58:311
127722291,5sleep10-21swapper/100:25:381
296202281,5sleep10-21swapper/120:53:571
283482281,5sleep10-21swapper/123:41:241
2777399285,4cyclictest81rcu_preempt22:40:031
2777399283,3cyclictest81rcu_preempt00:37:171
2777399282,5cyclictest81rcu_preempt22:21:151
2777399282,4cyclictest81rcu_preempt00:01:061
2777399281,4cyclictest81rcu_preempt23:54:101
2777399281,4cyclictest81rcu_preempt20:07:141
2777399281,13cyclictest13042-21/usr/sbin/munin20:10:281
2777399281,13cyclictest0-21swapper/123:39:131
2777399281,12cyclictest11454-21awk21:30:231
2777399281,12cyclictest11454-21awk21:30:221
2777299283,13cyclictest23082-21unixbench_multi22:00:290
2777299282,12cyclictest20683-21/usr/sbin/munin20:30:110
2777299281,4cyclictest81rcu_preempt19:56:140
27772992814,5cyclictest0-21swapper/023:10:230
2777299281,23cyclictest20359-21chrt00:46:150
2777299281,14cyclictest23698-21fschecks_time23:30:160
27772992810,10cyclictest0-21swapper/021:39:320
210762281,5sleep00-21swapper/023:23:400
189042281,5sleep10-21swapper/123:15:421
40722271,5sleep10-21swapper/122:37:041
27773992711,4cyclictest0-21swapper/121:46:191
2777299272,13cyclictest81rcu_preempt21:45:110
2777299272,13cyclictest15818-21irqstats00:35:190
2777299272,12cyclictest457-21wc21:00:270
2777299271,4cyclictest81rcu_preempt00:54:040
2777299271,13cyclictest9429-21/usr/sbin/munin21:25:220
2777299271,13cyclictest5782-21/usr/sbin/munin19:50:120
276032271,5sleep00-21swapper/020:47:240
221712271,5sleep10-21swapper/120:34:211
18052271,5sleep10-21swapper/123:59:451
162192271,5sleep10-21swapper/120:15:501
147872271,5sleep10-21swapper/100:32:091
13172271,5sleep10-21swapper/119:37:491
2777399268,5cyclictest40650irq/92-i91523:10:221
2777399261,12cyclictest26437-21df_inode20:45:141
2777299269,5cyclictest9668-21taskset22:51:560
2777299263,17cyclictest18120-21python00:40:280
2777299261,4cyclictest81rcu_preempt22:08:340
2777299261,13cyclictest26138-21switchtime23:35:280
2777299261,12cyclictest28871-21/usr/sbin/munin20:50:250
27772992610,8cyclictest0-21swapper/022:20:010
198912261,3sleep10-21swapper/120:25:311
118052261,5sleep10-21swapper/122:59:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional