You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 01:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Fri Jul 17, 2026 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
165409912421216,7cyclictest0-21swapper/007:27:130
164462563517,31sleep10-21swapper/107:24:351
164542497452,31sleep00-21swapper/007:24:400
201982830,3sleep120197-21ls11:50:011
16541998172,6cyclictest0-21swapper/107:27:141
1654099402,14cyclictest29681-21/usr/sbin/munin12:15:110
149102390,5sleep0111rcuc/010:10:010
272282372,31sleep127232-21iostat_ios09:15:221
35832350,3sleep1211ktimersoftd/112:30:181
16541993522,4cyclictest22-21ksoftirqd/109:45:131
16541993522,4cyclictest22-21ksoftirqd/109:45:121
16540993519,13cyclictest857-21switchtime09:30:280
9962341,29sleep01058-21/usr/sbin/munin12:25:120
35552341,3sleep03580-21iostat12:30:180
197092341,5sleep119792-21memory08:55:231
1654099342,20cyclictest4337-21df08:15:150
1654099342,20cyclictest0-21swapper/009:26:120
1654099341,8cyclictest0-21swapper/007:36:190
1654099341,19cyclictest9861-21grep12:45:290
1654099339,10cyclictest106492grep08:30:290
16540993322,7cyclictest23365-21tune2fs07:40:160
1654099326,12cyclictest17350-21ntp_offset11:40:260
1654099323,4cyclictest81rcu_preempt11:16:320
155942321,4sleep115677-21memory10:10:231
77562311,5sleep10-21swapper/109:50:141
58222311,26sleep15826-21irqstats11:10:231
268452311,4sleep126880-21iostat10:40:191
257142311,5sleep10-21swapper/112:04:311
1654199316,4cyclictest81rcu_preempt10:07:081
1654199312,25cyclictest0-21swapper/110:55:111
16541993113,5cyclictest3286-21runrttasks08:51:161
16540993111,4cyclictest18951-21fschecks_count07:30:060
1654099311,14cyclictest11565-21gdbus08:45:240
316102301,5sleep10-21swapper/110:53:341
273842301,4sleep127388-21irqstats07:50:231
201552301,5sleep10-21swapper/110:21:391
1654199306,13cyclictest81rcu_preempt12:35:111
1654199305,4cyclictest81rcu_preempt12:26:141
1654199305,4cyclictest81rcu_preempt07:31:491
1654199304,4cyclictest81rcu_preempt12:05:591
1654199304,19cyclictest20941-21diskstats10:25:161
1654199303,4cyclictest81rcu_preempt07:41:371
1654199301,16cyclictest3286-21runrttasks12:13:131
1654099302,16cyclictest0-21swapper/011:50:280
1654099302,14cyclictest30332-21df_inode10:50:150
16540993012,5cyclictest28033-21grep07:50:310
9132291,5sleep00-21swapper/010:57:250
54132291,5sleep10-21swapper/108:16:241
36032291,5sleep10-21swapper/108:12:041
292782291,5sleep00-21swapper/012:12:340
259292291,5sleep10-21swapper/110:38:121
257882291,5sleep00-21swapper/010:36:440
184302291,5sleep00-21swapper/010:18:270
183702291,4sleep10-21swapper/110:17:511
1654199295,4cyclictest81rcu_preempt11:24:271
1654199295,4cyclictest81rcu_preempt11:08:191
1654199295,4cyclictest81rcu_preempt08:34:241
1654199294,17cyclictest0-21swapper/111:42:241
1654199293,19cyclictest780-21iostat_ios08:05:231
1654199293,10cyclictest9623-21df09:55:151
16541992919,5cyclictest6897-21find08:20:261
1654199291,4cyclictest81rcu_preempt11:00:141
16541992910,15cyclictest0-21swapper/111:55:261
16541992910,15cyclictest0-21swapper/111:55:251
1654099299,6cyclictest6936-21mailstats08:20:270
1654099292,15cyclictest6253-21/usr/sbin/munin11:10:310
1654099292,14cyclictest8839-21python08:25:270
1654099291,4cyclictest81rcu_preempt08:53:130
1654099291,15cyclictest23684-21/usr/sbin/munin09:05:250
1654099291,15cyclictest12832-21wget11:30:130
1654099291,14cyclictest22401-21cat10:30:000
1654099291,13cyclictest19153-21aten_r4power_en08:55:130
142372291,5sleep10-21swapper/111:32:431
129632291,5sleep00-21swapper/008:36:380
90812281,5sleep00-21swapper/009:54:020
4782281,4sleep10-21swapper/112:21:251
321732281,5sleep10-21swapper/108:01:551
298742281,5sleep10-21swapper/109:21:111
278582281,5sleep00-21swapper/010:43:330
264202281,5sleep10-21swapper/107:47:591
260402281,5sleep10-21swapper/109:10:331
255562281,5sleep00-21swapper/012:02:540
238552281,5sleep00-21swapper/010:31:070
236902281,5sleep00-21swapper/011:58:120
236902281,5sleep00-21swapper/011:58:110
226792281,5sleep10-21swapper/107:38:191
1654199288,7cyclictest30285-21seq07:59:071
1654199284,4cyclictest81rcu_preempt08:49:111
1654199283,9cyclictest12176-21iostat_ios08:35:211
1654199283,4cyclictest81rcu_preempt11:25:381
1654199283,17cyclictest0-21swapper/112:45:401
16541992820,5cyclictest8485-21latency08:25:201
16541992819,5cyclictest13692-21cpuspeed_turbos08:40:131
1654199281,4cyclictest81rcu_preempt12:18:381
1654199281,23cyclictest10878-21fschecks_count12:50:131
1654099285,12cyclictest26071-21sshd07:45:310
1654099282,13cyclictest11564-21packagekitd12:52:280
16540992815,10cyclictest9460-21fschecks_time11:20:170
1654099281,4cyclictest81rcu_preempt12:22:000
1654099281,4cyclictest81rcu_preempt09:59:320
1654099281,4cyclictest81rcu_preempt07:58:160
16540992814,10cyclictest1410-21aten_r4power_po11:00:110
1654099281,17cyclictest0-21swapper/009:17:470
1654099281,15cyclictest15500-21/usr/sbin/munin11:35:240
1654099281,14cyclictest5306-21fschecks_time12:35:150
1654099281,13cyclictest3889-21cat11:05:180
16540992810,5cyclictest5630-21aten_r4power_en09:45:130
16540992810,5cyclictest5630-21aten_r4power_en09:45:120
16540992810,5cyclictest11580-21grep10:00:150
16540992810,14cyclictest2221-21cron09:40:010
13152281,5sleep10-21swapper/109:32:441
124372281,5sleep00-21swapper/011:28:300
81202271,5sleep10-21swapper/112:41:231
320592271,5sleep10-21swapper/109:29:251
225132271,5sleep10-21swapper/110:30:071
1654199274,8cyclictest21289-21df_inode09:00:131
1654199274,8cyclictest21289-21df_inode09:00:131
1654199272,21cyclictest0-21swapper/111:15:251
1654199272,13cyclictest0-21swapper/109:38:461
1654099279,14cyclictest19814-21ls10:20:300
1654099275,10cyclictest29608-21timerandwakeup09:20:290
1654099273,7cyclictest2058-21kworker/0:210:45:330
1654099272,9cyclictest27190-21users12:05:300
1654099272,12cyclictest15476-21perl10:10:170
1654099271,4cyclictest81rcu_preempt09:01:150
1654099271,4cyclictest81rcu_preempt09:01:150
1654099271,14cyclictest5272-21taskset09:43:240
1654099271,14cyclictest2695-21snmpd12:41:220
1654099271,13cyclictest15180-21taskset08:44:590
16540992711,3cyclictest0-21swapper/011:45:260
156982271,5sleep10-21swapper/111:35:281
125272271,5sleep10-21swapper/110:00:381
244812261,4sleep10-21swapper/109:08:581
16541992617,6cyclictest22-21ksoftirqd/109:41:401
1654199261,4cyclictest81rcu_preempt10:45:171
1654099261,13cyclictest1643-21taskset08:07:220
1654099261,12cyclictest31367-21irqstats08:00:220
1654099261,12cyclictest25137-21fschecks_count09:10:150
1654099251,15cyclictest0-21swapper/008:10:030
16541992417,4cyclictest22-21ksoftirqd/111:50:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional