You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 04:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Mon Jan 05, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
68759912391194,28cyclictest13778-21grep19:40:181
68759912131204,6cyclictest0-21swapper/119:25:141
68749911351099,26cyclictest0-21swapper/019:25:090
65342662615,31sleep00-21swapper/019:22:010
66422459413,31sleep10-21swapper/119:23:061
687499154138,12cyclictest0-21swapper/019:40:190
283402980,4sleep0111rcuc/023:36:420
183002970,8sleep0687499cyclictest00:33:460
36362960,7sleep0687499cyclictest23:10:540
16832870,8sleep0687499cyclictest00:15:530
306592780,8sleep1687599cyclictest21:25:291
145122780,3sleep041ktimersoftd/022:49:520
318632600,9sleep1138250irq/90-eth000:48:281
325802500,6sleep0687499cyclictest21:27:530
687599491,17cyclictest0-21swapper/100:21:331
687599461,18cyclictest21792-21cut21:50:171
186282450,4sleep122-21ksoftirqd/121:46:241
6874994212,6cyclictest30055-21cron20:25:000
6875994117,11cyclictest20511-21cut21:15:221
687499408,28cyclictest0-21swapper/000:26:150
687599399,4cyclictest81rcu_preempt23:50:011
687599389,10cyclictest81rcu_preempt22:05:251
6874993817,6cyclictest5536-21diskstats22:40:180
6874993817,6cyclictest5536-21diskstats22:40:170
687499381,33cyclictest0-21swapper/023:20:150
218122381,33sleep021823-21sh21:16:210
687599378,4cyclictest81rcu_preempt23:40:001
687599378,4cyclictest81rcu_preempt21:13:171
18612371,4sleep12019-21/usr/sbin/munin20:35:171
147612371,32sleep014772-21ssh21:42:500
6875993627,5cyclictest23132-21fschecks_count00:05:161
6875993613,4cyclictest22-21ksoftirqd/123:05:201
35572360,2sleep03558-21sh22:05:070
240422361,32sleep024053-21ssh21:52:150
174642361,31sleep017478-21sh23:59:460
103392361,31sleep110353-21ssh21:38:291
687599353,30cyclictest0-21swapper/120:16:351
687599353,28cyclictest0-21swapper/122:13:151
687599353,28cyclictest0-21swapper/121:34:361
687499356,4cyclictest81rcu_preempt23:29:160
687499356,15cyclictest2902-21sh21:30:250
687499352,30cyclictest0-21swapper/000:41:360
687499351,3cyclictest40550irq/92-i91522:30:160
687499351,31cyclictest8767-21runrttasks20:52:350
305972351,30sleep030611-21ssh00:12:450
687599343,29cyclictest0-21swapper/100:16:351
687599343,28cyclictest0-21swapper/121:23:561
6875993424,6cyclictest21571-21ssh22:56:051
687599342,11cyclictest0-21swapper/122:21:071
687599341,29cyclictest6704-21ssh22:40:361
687599341,29cyclictest6704-21ssh22:40:361
687599341,29cyclictest13575-21ssh23:21:151
687499345,26cyclictest3-21ksoftirqd/021:35:350
687499342,28cyclictest0-21swapper/022:16:150
687499341,5cyclictest23445-21ssh23:31:350
687499341,13cyclictest0-21swapper/000:50:320
221592341,10sleep10-21swapper/120:01:081
687599339,13cyclictest40550irq/92-i91523:50:111
687599335,4cyclictest22-21ksoftirqd/119:55:121
687599334,8cyclictest22-21ksoftirqd/121:58:531
6875993318,4cyclictest22-21ksoftirqd/122:50:011
6875993313,9cyclictest22-21ksoftirqd/100:04:201
687599331,10cyclictest22-21ksoftirqd/100:14:531
687499334,8cyclictest16383-21users21:10:320
687499332,28cyclictest0-21swapper/000:38:150
6874993322,7cyclictest350-21ssh23:08:210
687499331,5cyclictest21972-21ssh00:04:160
687499331,30cyclictest0-21swapper/023:54:560
687499331,29cyclictest19442-21ssh21:47:350
60612331,28sleep06095-21missed_timers20:45:210
273022331,28sleep027317-21cron00:10:010
687599328,13cyclictest40550irq/92-i91519:30:211
687599323,4cyclictest81rcu_preempt22:36:521
687599322,27cyclictest0-21swapper/123:25:171
687599322,25cyclictest0-21swapper/122:17:461
687599321,29cyclictest0-21swapper/123:40:361
687599321,22cyclictest40550irq/92-i91520:24:061
6875993212,10cyclictest0-21swapper/100:39:381
687599321,12cyclictest15812grep00:50:301
687599321,10cyclictest0-21swapper/123:59:521
687499325,13cyclictest24994-21fschecks_time20:10:180
687499323,4cyclictest81rcu_preempt22:01:140
687499323,4cyclictest81rcu_preempt22:01:130
6874993225,5cyclictest0-21swapper/019:55:560
687499322,4cyclictest0-21swapper/022:53:360
6874993223,5cyclictest144802sleep021:08:160
687499322,17cyclictest0-21swapper/023:48:330
687499321,20cyclictest4454-21sh22:39:240
687499321,16cyclictest22697-21/usr/sbin/munin20:05:280
687499321,11cyclictest0-21swapper/022:26:190
261722321,4sleep026186-21ssh21:20:380
687599315,5cyclictest81rcu_preempt22:25:161
687599313,4cyclictest81rcu_preempt21:06:161
687599312,4cyclictest81rcu_preempt00:30:511
6875993123,4cyclictest0-21swapper/100:26:351
6875993121,6cyclictest0-21swapper/122:31:551
6875993118,4cyclictest22-21ksoftirqd/120:50:161
687599311,4cyclictest81rcu_preempt20:07:051
687499314,4cyclictest81rcu_preempt22:24:160
687499312,4cyclictest81rcu_preempt00:21:480
687499312,17cyclictest0-21swapper/020:15:190
6874993110,17cyclictest0-21swapper/000:46:380
280132311,5sleep00-21swapper/021:56:000
252472310,4sleep0111rcuc/023:00:200
687599303,4cyclictest81rcu_preempt22:50:121
687599302,6cyclictest11698-21/usr/sbin/munin21:40:261
6875993022,5cyclictest24352-21cut00:40:121
687599301,4cyclictest81rcu_preempt23:10:491
687599301,4cyclictest81rcu_preempt20:27:141
6875993012,15cyclictest22-21ksoftirqd/122:03:001
6875993012,15cyclictest22-21ksoftirqd/122:03:001
687499308,18cyclictest12008-21irqstats19:35:210
687499302,4cyclictest81rcu_preempt20:30:240
687499301,27cyclictest0-21swapper/021:03:160
6874993012,4cyclictest3302-21runrttasks22:57:090
687499301,16cyclictest9167-21/usr/sbin/munin20:55:280
6874993011,6cyclictest1008-21ssh23:42:070
232532302,6sleep123265-21ssh23:31:191
224852301,5sleep00-21swapper/020:04:340
165052301,5sleep00-21swapper/019:46:040
687599298,7cyclictest3302-21runrttasks21:04:051
687599294,6cyclictest22-21ksoftirqd/123:04:121
687599292,4cyclictest81rcu_preempt19:35:161
6875992914,12cyclictest22-21ksoftirqd/119:45:101
687599291,24cyclictest4519-21awk20:40:281
687599291,16cyclictest7056-21df_inode23:15:141
687499299,6cyclictest11254-21munin-run19:34:590
687499292,13cyclictest9912-21users22:10:330
6874992911,5cyclictest8636-21ssh23:16:080
11502291,5sleep10-21swapper/120:32:541
687599282,5cyclictest0-21swapper/119:50:361
687599282,21cyclictest25175-21irqstats20:10:231
687499283,21cyclictest0-21swapper/020:25:100
32882281,5sleep00-21swapper/020:39:320
186302281,5sleep00-21swapper/019:53:410
687499271,13cyclictest3765-21cstates20:40:130
104702271,5sleep10-21swapper/120:55:491
687599264,13cyclictest0-21swapper/120:45:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional