You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 08:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Thu May 07, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
142269912251216,6cyclictest0-21swapper/119:25:121
142259911361093,30cyclictest14651-21df19:25:140
142269911131087,22cyclictest15396-21strings20:50:231
141252512465,32sleep00-21swapper/019:24:320
138892512418,29sleep10-21swapper/119:22:011
1422599275234,6cyclictest0-21swapper/020:50:230
83922920,8sleep01422599cyclictest20:30:300
283922900,3sleep041ktimersoftd/022:50:260
311282770,3sleep1201rcuc/120:05:281
173312700,7sleep11422699cyclictest19:30:161
52672540,6sleep1201rcuc/120:25:111
36442460,7sleep11422699cyclictest20:20:121
238582460,6sleep123860-21watchsnmpd19:46:011
1422599411,13cyclictest11331-21sort20:40:140
1422599404,11cyclictest81rcu_preempt21:39:270
1422699361,21cyclictest11888-21turbostat23:35:001
272382340,5sleep027235-21awk19:55:260
226102341,29sleep122633-21ntp_states22:35:231
1422599341,21cyclictest12033-21taskset22:07:520
297752331,28sleep10-21swapper/121:30:101
246502331,28sleep124733-21memory21:15:231
1422599339,12cyclictest31103-21sshd21:31:520
1422599339,12cyclictest19236-21taskset23:53:150
14225993322,7cyclictest12507-21wget22:10:120
1422599332,15cyclictest0-21swapper/023:05:250
14225993318,8cyclictest18713-21diskstats21:00:150
11522331,28sleep11231-21iostat23:05:191
268772321,27sleep126881-21irqstats19:55:201
14226993217,8cyclictest28775-21iostat_ios20:00:191
14226993213,7cyclictest189892rt-features22:25:261
1422699321,18cyclictest21020-21timerandwakeup22:30:271
14225993213,6cyclictest20941-21df_inode19:40:140
14225993213,5cyclictest10361-21cron22:05:000
14225993211,7cyclictest15109-21ntp_states22:15:240
209322311,5sleep00-21swapper/023:56:250
1422699317,9cyclictest0-21swapper/120:35:131
1422699315,4cyclictest81rcu_preempt21:48:471
1422699311,4cyclictest81rcu_preempt00:40:381
1422599312,18cyclictest0-21swapper/019:30:100
1422599312,17cyclictest0-21swapper/000:50:140
14225993111,6cyclictest32562-21chrt00:29:480
14225993111,6cyclictest32562-21chrt00:29:480
40452301,5sleep10-21swapper/123:11:531
213612301,5sleep00-21swapper/022:32:030
1422699305,4cyclictest81rcu_preempt23:20:501
1422699305,4cyclictest81rcu_preempt19:44:291
1422699303,4cyclictest81rcu_preempt22:20:301
1422699301,4cyclictest81rcu_preempt22:09:311
14226993010,8cyclictest27472-21aten_r4power_cu22:50:091
14226993010,17cyclictest5258-21needreboot23:15:231
14225993013,5cyclictest25707-21hddtemp_smartct00:10:160
84052291,5sleep10-21swapper/120:30:411
76962291,5sleep00-21swapper/023:20:360
317282291,5sleep00-21swapper/020:09:390
29612291,5sleep10-21swapper/120:17:521
239302291,5sleep00-21swapper/019:46:460
1422699294,9cyclictest24301-21iostat_ios22:40:191
1422699292,4cyclictest81rcu_preempt21:01:501
1422699291,4cyclictest81rcu_preempt21:05:421
1422699291,16cyclictest31467-21irqstats00:25:201
1422699291,16cyclictest31467-21irqstats00:25:191
1422699291,16cyclictest23809-21cut00:05:161
1422599297,7cyclictest4973-21tr00:40:220
1422599292,4cyclictest81rcu_preempt21:10:080
1422599292,13cyclictest28108-21df_inode21:25:140
1422599291,4cyclictest81rcu_preempt00:33:180
14225992911,6cyclictest7350-21iostat_ios21:55:190
1422599291,16cyclictest24349-21/usr/sbin/munin00:05:250
14225992911,5cyclictest6773-21memory00:45:230
14225992911,5cyclictest27640-21/usr/sbin/munin00:15:180
1422599291,14cyclictest4051-21taskset20:20:220
1422599291,14cyclictest29333-21munin-node22:55:110
1422599291,13cyclictest17769-21unixbench_singl20:55:280
14225992910,6cyclictest32027-21/usr/sbin/munin23:00:220
141482291,4sleep10-21swapper/120:46:371
94242281,5sleep10-21swapper/100:52:281
61702281,5sleep00-21swapper/021:50:400
39942281,5sleep00-21swapper/023:11:190
286752281,5sleep10-21swapper/100:18:401
260762281,4sleep10-21swapper/119:54:371
26062281,5sleep10-21swapper/121:43:281
254062281,5sleep00-21swapper/021:16:220
236992281,5sleep00-21swapper/022:40:070
155022281,5sleep10-21swapper/123:43:281
143492281,5sleep00-21swapper/020:48:390
1422699287,4cyclictest81rcu_preempt23:55:271
1422699286,4cyclictest81rcu_preempt22:03:181
1422699285,4cyclictest81rcu_preempt23:53:121
1422699285,4cyclictest81rcu_preempt23:48:391
1422699285,4cyclictest81rcu_preempt23:37:461
1422699285,4cyclictest81rcu_preempt21:57:461
1422699285,4cyclictest81rcu_preempt00:30:351
1422699284,5cyclictest81rcu_preempt23:25:231
1422699284,4cyclictest81rcu_preempt23:00:011
1422699283,4cyclictest81rcu_preempt22:16:221
1422699283,4cyclictest81rcu_preempt19:35:481
14226992820,5cyclictest32547-21uname20:10:201
14226992820,5cyclictest31182-21date23:00:011
14226992816,7cyclictest25507-21diskstats00:10:141
1422699281,4cyclictest81rcu_preempt00:45:211
1422699281,13cyclictest23977-21latency_hist21:15:011
1422699280,4cyclictest81rcu_preempt00:36:421
1422599286,12cyclictest40250irq/92-i91520:00:280
1422599283,13cyclictest25525-21timerwakeupswit19:50:250
1422599282,13cyclictest26768-21ntp_states21:20:230
14225992811,5cyclictest32526-21iostat_ios20:10:190
1422599281,14cyclictest3099-21runrttasks20:19:170
1422599281,14cyclictest18951-21grep19:35:110
1422599281,14cyclictest15660-21latency_hist23:45:000
1422599280,4cyclictest81rcu_preempt22:27:220
123002281,5sleep10-21swapper/120:41:551
105422281,5sleep00-21swapper/020:38:220
289872271,5sleep10-21swapper/100:20:091
271922271,5sleep10-21swapper/122:49:011
1422699275,7cyclictest5474-21iostat_ios21:50:191
1422699273,4cyclictest81rcu_preempt20:57:301
1422699272,4cyclictest81rcu_preempt00:00:031
1422599274,17cyclictest20585-21diskstats21:05:150
1422599273,18cyclictest8585-21diskstats23:25:170
1422599272,13cyclictest15927-21/usr/sbin/munin23:45:110
1422599272,12cyclictest26180-21irqstats22:45:190
1422599271,13cyclictest22293-21ntp_states00:00:250
1422599271,12cyclictest2321-21cpu00:35:110
1422699267,16cyclictest0-21swapper/121:35:271
1422699263,4cyclictest81rcu_preempt22:11:091
1422699263,4cyclictest81rcu_preempt21:26:051
1422699261,4cyclictest81rcu_preempt21:22:191
1422599268,14cyclictest178352chrt22:24:230
1422599262,11cyclictest0-21swapper/020:25:120
1422599261,13cyclictest22396-21awk22:35:170
1422599261,13cyclictest12640-21irqstats23:35:200
1422599261,13cyclictest11422-21/usr/sbin/munin23:30:300
1422599257,6cyclictest4263-21users21:45:290
14225992514,6cyclictest29721-21cat00:20:220
1422599251,19cyclictest1827-21grep21:40:220
1422599251,15cyclictest0-21swapper/023:15:580
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional