You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 14:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Aug 11, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
270189911871153,31cyclictest19548-21kworker/0:319:29:340
265402577530,32sleep00-21swapper/019:20:330
259902523474,33sleep10-21swapper/119:20:251
2701999224215,6cyclictest0-21swapper/119:29:331
112321040,8sleep02701899cyclictest21:05:180
74872730,5sleep17482-21strings19:55:221
2701899614,16cyclictest2110-21diskstats00:00:170
2701899593,19cyclictest29975-21diskstats19:30:170
40902560,10sleep02701899cyclictest22:40:010
167492540,9sleep12701999cyclictest20:20:201
2701999422,13cyclictest3286-21runrttasks21:56:511
140372420,4sleep1211ktimersoftd/121:40:121
115632420,2sleep011566-21cstates00:25:110
277452401,3sleep127911-21fschecks_time20:50:171
203882380,10sleep02701899cyclictest00:47:580
2701999371,13cyclictest122882grep00:25:251
2701999361,13cyclictest153362awk20:15:301
27018993610,14cyclictest14813-21taskset23:05:290
27018993414,6cyclictest11865-21munin-run21:35:000
239372341,30sleep023966-21df_inode20:40:140
314902331,28sleep131499-21diskstats21:00:141
2701899334,13cyclictest32622-21latency_hist22:30:010
216182331,28sleep121726-21df22:00:141
134682331,5sleep113477-21df_inode00:30:141
51972321,27sleep15356-21unixbench_multi22:40:301
2701899325,3cyclictest0-21swapper/020:20:260
2701899323,8cyclictest4805-21python00:05:320
27018993214,5cyclictest8735-21ntp_states22:50:270
27018993214,5cyclictest8735-21ntp_states22:50:260
2701899321,14cyclictest7523-21seq22:47:450
2701999316,5cyclictest183762cat21:50:221
2701899316,12cyclictest31669-21unixbench_multi23:50:290
2701899312,4cyclictest81rcu_preempt22:31:590
2701899311,11cyclictest0-21swapper/021:46:270
73492301,5sleep10-21swapper/122:45:581
271192301,5sleep00-21swapper/020:48:270
2701999309,7cyclictest8753-21cpu20:00:121
2701999306,4cyclictest81rcu_preempt22:35:051
2701999304,10cyclictest491-21iostat_ios23:55:191
2701999301,4cyclictest81rcu_preempt23:14:541
2701999301,4cyclictest81rcu_preempt20:55:381
2701899306,15cyclictest0-21swapper/021:00:140
27018993023,4cyclictest25026-21cron22:10:000
2701899302,14cyclictest16025-21iostat_ios23:10:200
2701899301,8cyclictest0-21swapper/021:55:150
27018993012,5cyclictest5456-21irqstats19:50:210
2701899301,18cyclictest1577-21runrttasks23:59:370
27018993011,6cyclictest15086-21ntp_states20:15:260
267292301,5sleep10-21swapper/122:13:141
206832301,5sleep10-21swapper/123:22:381
150162301,5sleep10-21swapper/123:07:271
92942291,5sleep10-21swapper/122:51:421
92942291,5sleep10-21swapper/122:51:421
6152291,5sleep10-21swapper/119:38:041
321292291,5sleep10-21swapper/123:54:201
284122291,5sleep10-21swapper/122:16:081
2701999294,9cyclictest25850-21diskstats20:45:161
2701999294,4cyclictest81rcu_preempt23:46:061
2701999293,4cyclictest81rcu_preempt23:33:311
2701999293,19cyclictest21374-21diskstats23:25:151
2701999291,7cyclictest11679-21/usr/sbin/munin23:00:181
2701999291,5cyclictest81rcu_preempt23:38:371
27019992910,5cyclictest3286-21runrttasks20:38:551
27019992910,5cyclictest3286-21runrttasks20:38:541
2701899299,10cyclictest11565-21gdbus00:20:240
2701899293,20cyclictest6488-21ntp_states00:10:240
2701899292,14cyclictest8742-21/usr/sbin/munin20:00:120
2701899292,14cyclictest23776-21/usr/sbin/munin23:30:240
2701899291,13cyclictest11417-21taskset22:59:140
27018992911,14cyclictest234512chrt20:39:350
27018992911,14cyclictest234512chrt20:39:340
27018992910,6cyclictest2199-21unixbench_multi19:40:300
2701899290,4cyclictest81rcu_preempt22:42:420
20112291,5sleep10-21swapper/121:06:351
19322291,5sleep10-21swapper/122:34:301
182732291,5sleep00-21swapper/000:40:550
87642281,5sleep10-21swapper/121:25:161
79272281,5sleep00-21swapper/021:23:070
69752281,5sleep10-21swapper/100:10:561
32492281,5sleep10-21swapper/100:01:141
281812281,5sleep00-21swapper/023:42:200
274332281,5sleep00-21swapper/020:50:090
2701999287,8cyclictest0-21swapper/121:46:281
2701999284,4cyclictest81rcu_preempt00:16:051
2701999283,9cyclictest5331-21ntp_states21:15:281
2701999283,4cyclictest81rcu_preempt19:54:031
2701999281,6cyclictest24335-21swap22:05:271
2701999281,14cyclictest27027-21diskstats23:40:161
2701899289,6cyclictest13516-21fschecks_count00:30:150
2701899288,7cyclictest10741-21cstates20:05:130
2701899288,5cyclictest0-21swapper/022:22:400
2701899282,13cyclictest4795-21diskstats21:15:170
2701899281,4cyclictest81rcu_preempt23:38:470
2701899281,4cyclictest81rcu_preempt22:03:120
27018992812,5cyclictest22251-21chrt00:52:500
2701899281,23cyclictest22262-21grep23:25:290
2701899281,19cyclictest0-21swapper/000:19:410
2701899281,14cyclictest12187-21hwlatdetect23:00:180
2701899281,13cyclictest19063-21seq23:20:000
2701899281,13cyclictest12676-21diskstats20:10:140
27018992810,14cyclictest187472chrt21:50:280
27018992810,14cyclictest155572chrt21:44:160
214162281,5sleep10-21swapper/120:32:561
164672281,5sleep10-21swapper/100:36:521
113582281,5sleep10-21swapper/122:58:391
325132271,5sleep10-21swapper/122:29:341
2701999271,4cyclictest81rcu_preempt20:10:341
2701999271,14cyclictest0-21swapper/123:15:211
2701999270,4cyclictest81rcu_preempt21:10:151
2701899271,17cyclictest0-21swapper/023:45:270
2701899271,13cyclictest19822-21kernelversion23:20:220
2701899271,13cyclictest15459-21grep00:35:160
27018992711,14cyclictest0-21swapper/021:27:180
27018992710,5cyclictest344-21users19:35:280
27018992710,5cyclictest19340-21taskset20:25:500
195362271,5sleep10-21swapper/120:27:521
134042271,4sleep10-21swapper/121:36:381
119352271,5sleep10-21swapper/120:07:041
117722271,5sleep10-21swapper/121:34:061
310772261,4sleep10-21swapper/119:31:491
2701999267,7cyclictest2452-21taskset19:42:061
2701999263,8cyclictest18876-21/usr/sbin/munin00:45:321
2701999262,10cyclictest4281-21hddtemp_smartct00:05:201
27019992616,6cyclictest21337-21iostat00:50:191
2701999261,3cyclictest81rcu_preempt19:46:581
2701899269,6cyclictest4329-21taskset19:46:130
2701899269,5cyclictest6733-21/usr/sbin/munin19:55:120
2701899262,12cyclictest12628-21uname21:35:210
2701899261,13cyclictest81rcu_preempt22:15:120
2701899261,13cyclictest25780-21iostat22:10:180
2701899261,12cyclictest3055-21fschecks_time21:10:160
251852261,4sleep10-21swapper/120:42:541
2701999256,10cyclictest0-21swapper/121:20:081
2701999255,4cyclictest81rcu_preempt00:41:371
27018992511,11cyclictest29738-21fschecks_time20:55:150
110012251,5sleep10-21swapper/100:23:321
2701999242,8cyclictest29571-21iostat_ios22:20:201
2701899241,15cyclictest0-21swapper/020:34:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional