You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-24 - 08:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Mar 24, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
191749912701,5cyclictest0-21swapper/119:26:351
191739911061095,7cyclictest0-21swapper/019:26:200
174222741694,31sleep00-21swapper/019:20:110
180082461382,63sleep10-21swapper/119:20:211
160021050,8sleep01917399cyclictest00:04:040
25552750,5sleep041ktimersoftd/000:38:150
265552560,2sleep026554-21wc19:40:250
91062490,23sleep03-21ksoftirqd/021:57:340
12062490,4sleep0111rcuc/022:56:030
19173994618,24cyclictest3-21ksoftirqd/023:56:110
1917399432,13cyclictest0-21swapper/023:43:150
19173994316,6cyclictest3-21ksoftirqd/022:52:300
1917499419,4cyclictest0-21swapper/100:54:561
1917499414,33cyclictest0-21swapper/123:30:561
1917499414,33cyclictest0-21swapper/123:02:551
1917399417,14cyclictest3-21ksoftirqd/023:11:550
19173994118,7cyclictest3-21ksoftirqd/021:40:450
19173994117,8cyclictest3-21ksoftirqd/022:31:220
19173994117,7cyclictest3-21ksoftirqd/020:18:520
19173994116,15cyclictest3-21ksoftirqd/022:40:260
19173994116,14cyclictest3-21ksoftirqd/022:49:050
19173994116,14cyclictest3-21ksoftirqd/000:31:090
19173994116,14cyclictest3-21ksoftirqd/000:14:280
19173994115,15cyclictest3-21ksoftirqd/023:51:510
19173994115,15cyclictest3-21ksoftirqd/023:26:340
19173994115,15cyclictest3-21ksoftirqd/021:45:080
19173994115,14cyclictest3-21ksoftirqd/023:47:140
19174994030,5cyclictest22320-21hddtemp_smartct19:30:161
19173994018,7cyclictest3-21ksoftirqd/023:01:160
19173994018,7cyclictest3-21ksoftirqd/000:22:280
19173994018,6cyclictest3-21ksoftirqd/000:42:210
19173994016,14cyclictest3-21ksoftirqd/021:31:450
19173994014,16cyclictest3-21ksoftirqd/000:29:070
294112390,7sleep00-21swapper/019:50:100
1917499398,3cyclictest0-21swapper/121:20:551
19173993917,6cyclictest3-21ksoftirqd/022:25:480
19173993917,6cyclictest3-21ksoftirqd/000:50:280
19173993916,8cyclictest3-21ksoftirqd/020:08:140
19173993916,8cyclictest3-21ksoftirqd/020:08:140
19173993915,14cyclictest3-21ksoftirqd/023:16:200
19173993915,14cyclictest3-21ksoftirqd/023:08:240
19173993914,14cyclictest3-21ksoftirqd/022:19:380
19173993914,14cyclictest3-21ksoftirqd/021:15:470
19173993914,11cyclictest3-21ksoftirqd/022:00:250
19173993913,14cyclictest3-21ksoftirqd/021:27:540
134072391,4sleep113418-21ssh23:42:161
19173993818,6cyclictest3-21ksoftirqd/019:35:270
19173993816,7cyclictest3-21ksoftirqd/000:06:240
19173993816,6cyclictest3-21ksoftirqd/023:30:240
19173993815,7cyclictest3-21ksoftirqd/022:10:290
19173993814,8cyclictest3-21ksoftirqd/022:21:000
19173993814,14cyclictest3-21ksoftirqd/021:22:330
19173993813,15cyclictest3-21ksoftirqd/021:51:510
220442371,4sleep122058-21ssh23:50:451
19173993713,6cyclictest3-21ksoftirqd/021:35:150
19173993712,7cyclictest3-21ksoftirqd/022:06:250
1917399371,24cyclictest0-21swapper/020:47:360
19173993712,15cyclictest3-21ksoftirqd/023:35:430
19173993712,15cyclictest3-21ksoftirqd/022:35:550
19173993712,14cyclictest3-21ksoftirqd/023:21:360
177272371,33sleep117737-21ssh21:33:191
72832361,4sleep17338-21users23:35:301
1917499363,16cyclictest0-21swapper/100:18:141
19174993622,9cyclictest31518-21df19:55:131
19174993618,4cyclictest22-21ksoftirqd/100:22:421
1917399363,22cyclictest3-21ksoftirqd/000:15:450
1917399361,18cyclictest17980-1kworker/0:1H21:11:420
26462351,30sleep12657-21ssh21:17:401
1917499352,29cyclictest0-21swapper/100:30:551
1917499351,30cyclictest10696-21ssh23:05:361
1917499351,30cyclictest10503-21diskstats20:25:151
19173993515,6cyclictest3-21ksoftirqd/000:45:070
19173993511,8cyclictest25830-21if_eth021:05:190
132952352,5sleep013349-21users20:30:320
52922340,3sleep0111rcuc/020:10:230
1917499345,26cyclictest6381-21ssh00:41:391
1917499343,12cyclictest8924-21awk00:10:311
1917499342,7cyclictest0-21swapper/122:32:151
19173993419,4cyclictest0-21swapper/019:33:080
19173993412,7cyclictest3-21ksoftirqd/020:03:050
19174993328,3cyclictest138250irq/90-eth023:11:351
1917499331,4cyclictest30390-21ssh21:12:561
1917499331,28cyclictest28763-21ssh22:50:561
19173993310,14cyclictest0-21swapper/020:36:330
16872331,28sleep11701-21ssh22:56:451
19174993222,7cyclictest0-21swapper/100:08:161
1917499321,29cyclictest0-21swapper/121:40:561
19174993210,18cyclictest0-21swapper/121:58:041
1917399329,8cyclictest3-21ksoftirqd/020:25:050
239902311,4sleep123999-21df_inode19:35:151
1917499315,19cyclictest25575-21/usr/sbin/munin22:15:331
1917499314,24cyclictest0-21swapper/123:26:261
19174993126,3cyclictest22-21ksoftirqd/123:55:121
19174993122,5cyclictest14073-21munin-plugin-st21:30:011
1917499312,16cyclictest0-21swapper/123:20:091
19174993117,11cyclictest22-21ksoftirqd/122:05:171
19174993115,13cyclictest22-21ksoftirqd/122:03:081
19174993115,12cyclictest22601-21ssh21:38:201
1917499311,3cyclictest81rcu_preempt00:00:251
1917399319,10cyclictest0-21swapper/019:57:430
19173993115,6cyclictest0-21swapper/019:49:160
19173993114,6cyclictest20208-21iostat_ios20:50:220
19173993114,6cyclictest20208-21iostat_ios20:50:210
237842301,5sleep10-21swapper/122:12:491
211972301,5sleep10-21swapper/122:43:571
194222301,5sleep10-21swapper/120:49:491
19174993025,3cyclictest0-21swapper/121:05:151
19174993024,3cyclictest0-21swapper/100:27:361
19174993020,6cyclictest4125-21ssh21:52:221
19174993018,8cyclictest5882-21ssh22:27:421
19174993017,9cyclictest22-21ksoftirqd/100:46:501
1917499301,3cyclictest81rcu_preempt19:42:421
19174993013,13cyclictest0-21swapper/121:48:111
1917499301,27cyclictest0-21swapper/120:11:561
1917399308,5cyclictest21516-21/usr/sbin/munin20:55:120
1917399307,6cyclictest30497-21gdbus20:44:590
19173993015,5cyclictest8623-21df_inode20:20:150
142582301,5sleep10-21swapper/122:35:521
23602291,4sleep10-21swapper/120:04:281
231202291,5sleep10-21swapper/120:59:151
1917499294,18cyclictest22911-21iostat_ios22:45:221
1917499291,4cyclictest81rcu_preempt23:47:131
1917499291,4cyclictest81rcu_preempt22:21:501
1917499291,4cyclictest81rcu_preempt00:37:301
19174992912,12cyclictest0-21swapper/120:05:421
19174992912,12cyclictest0-21swapper/120:05:421
1917399292,7cyclictest24000-21kernelversion21:00:220
1917499284,17cyclictest6729-21diskstats20:15:151
1917499281,4cyclictest81rcu_preempt23:16:241
1917499281,4cyclictest81rcu_preempt20:20:281
1917499281,22cyclictest28470-21awk19:45:281
174722281,5sleep10-21swapper/120:44:031
210452271,5sleep10-21swapper/120:52:101
210452271,5sleep10-21swapper/120:52:101
1917499273,18cyclictest29649-21diskstats19:50:151
155502271,5sleep10-21swapper/120:38:491
136062271,5sleep10-21swapper/120:33:031
248882261,5sleep10-21swapper/121:02:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional