You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 00:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Fri Jan 02, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
227849911701136,27cyclictest27325-21latency_hist07:35:011
227839911431119,21cyclictest0-21swapper/007:25:110
227849911421132,7cyclictest0-21swapper/107:25:071
224562617518,32sleep10-21swapper/107:22:091
226822519424,83sleep00-21swapper/007:24:290
2278399134108,22cyclictest27328-21taskset07:35:020
2806721030,8sleep02278399cyclictest12:26:340
2806721030,8sleep02278399cyclictest12:26:340
180202880,4sleep041ktimersoftd/011:43:030
140042810,5sleep014001-21iostat09:25:210
219552800,8sleep12278499cyclictest10:40:191
153042780,4sleep041ktimersoftd/010:00:130
54042770,4sleep1211ktimersoftd/112:36:411
44452740,3sleep041ktimersoftd/010:55:250
146272590,2sleep014622-21grep11:05:300
303012570,5sleep10-21swapper/110:15:251
158342500,7sleep12278499cyclictest12:14:491
22783994622,5cyclictest3-21ksoftirqd/012:35:000
114442450,7sleep12278499cyclictest11:02:511
69752430,6sleep1201rcuc/108:05:161
22783994323,4cyclictest3-21ksoftirqd/009:54:280
22783994223,5cyclictest3-21ksoftirqd/010:50:560
22783994215,7cyclictest3-21ksoftirqd/012:10:310
22783994124,6cyclictest3-21ksoftirqd/009:30:290
22783994123,6cyclictest3-21ksoftirqd/012:22:320
22783994121,9cyclictest3-21ksoftirqd/011:55:460
22783994120,5cyclictest3-21ksoftirqd/012:16:590
22783994019,5cyclictest3-21ksoftirqd/011:36:200
22783994019,5cyclictest3-21ksoftirqd/009:37:010
207302401,4sleep020826-21mailstats10:05:280
146052400,8sleep02278399cyclictest10:32:460
127002400,3sleep041ktimersoftd/009:57:150
325322391,4sleep132542-21ssh12:31:051
2278499395,6cyclictest309322ssh11:55:461
2278499395,30cyclictest0-21swapper/109:30:161
22783993923,5cyclictest3-21ksoftirqd/010:11:180
22783993923,4cyclictest3-21ksoftirqd/009:05:260
22783993922,6cyclictest3-21ksoftirqd/011:54:370
22783993922,6cyclictest3-21ksoftirqd/008:30:470
22783993922,6cyclictest3-21ksoftirqd/008:15:210
60662381,33sleep06080-21sh10:24:280
22783993823,5cyclictest3-21ksoftirqd/011:18:240
22783993823,5cyclictest3-21ksoftirqd/009:10:370
22783993820,5cyclictest3-21ksoftirqd/008:27:300
22783993818,5cyclictest3-21ksoftirqd/009:15:400
36202371,32sleep13712-21mailstats07:55:271
36202371,32sleep13712-21mailstats07:55:261
22783993723,4cyclictest3-21ksoftirqd/012:43:030
22783993722,5cyclictest3-21ksoftirqd/007:42:580
22783993721,5cyclictest3-21ksoftirqd/011:31:100
22783993718,5cyclictest3-21ksoftirqd/009:47:150
22783993716,5cyclictest3-21ksoftirqd/010:36:160
22783993716,5cyclictest3-21ksoftirqd/009:23:140
22783993713,8cyclictest3-21ksoftirqd/010:26:540
155102371,4sleep015520-21ssh12:48:280
270332361,12sleep00-21swapper/008:59:560
2278499365,28cyclictest0-21swapper/111:16:151
22783993621,5cyclictest3-21ksoftirqd/012:00:350
22783993621,5cyclictest3-21ksoftirqd/011:10:230
22783993621,5cyclictest3-21ksoftirqd/009:03:400
22783993621,5cyclictest3-21ksoftirqd/008:41:150
22783993621,5cyclictest3-21ksoftirqd/007:36:450
22783993621,4cyclictest3-21ksoftirqd/010:41:460
22783993620,6cyclictest3-21ksoftirqd/007:49:100
22783993618,8cyclictest3-21ksoftirqd/011:25:530
22783993618,6cyclictest3-21ksoftirqd/012:37:230
22783993616,9cyclictest3-21ksoftirqd/011:23:030
225582361,30sleep122596-21/usr/sbin/munin08:45:291
66252351,30sleep16636-21sh09:17:461
2278499357,4cyclictest81rcu_preempt09:53:531
2278499356,5cyclictest81rcu_preempt11:50:311
2278499356,4cyclictest81rcu_preempt08:24:231
2278499356,26cyclictest1968-21lldpad10:27:061
2278499354,4cyclictest81rcu_preempt12:20:201
2278499353,6cyclictest0-21swapper/107:44:161
2278499351,4cyclictest17014-21ssh11:41:361
297282341,5sleep00-21swapper/010:48:350
2278499345,4cyclictest81rcu_preempt09:57:061
2278499345,26cyclictest6220-21kworker/u4:011:29:061
2278499343,28cyclictest0-21swapper/109:10:151
2278499342,5cyclictest81rcu_preempt11:36:531
2278499341,4cyclictest29102-21/usr/sbin/munin09:05:151
2278499341,30cyclictest0-21swapper/109:42:551
22783993419,5cyclictest3-21ksoftirqd/012:50:290
22783993417,6cyclictest3-21ksoftirqd/011:45:510
22783993417,6cyclictest3-21ksoftirqd/008:06:240
22783993416,6cyclictest3-21ksoftirqd/011:01:510
2278399341,29cyclictest12174-21/usr/sbin/munin08:20:160
138442341,4sleep130496-21packagekitd10:31:411
87372331,28sleep18805-21sed12:40:221
323252332,27sleep10-21swapper/111:25:001
2278499338,5cyclictest81rcu_preempt11:10:271
2278499335,5cyclictest81rcu_preempt12:00:241
2278499334,8cyclictest81rcu_preempt12:49:401
2278499334,4cyclictest81rcu_preempt10:10:361
2278499333,4cyclictest81rcu_preempt09:20:331
22784993326,5cyclictest0-21swapper/108:56:551
22784993323,6cyclictest23213-21ssh11:48:351
2278499331,4cyclictest81rcu_preempt10:56:511
2278499331,28cyclictest1968-21lldpad12:15:381
22784993311,4cyclictest81rcu_preempt12:28:341
22784993311,4cyclictest81rcu_preempt12:28:341
22783993325,6cyclictest0-21swapper/008:54:150
22783993318,5cyclictest3-21ksoftirqd/010:15:050
177212331,4sleep117725-21ssh11:09:561
2278499324,4cyclictest81rcu_preempt11:31:391
2278499323,4cyclictest81rcu_preempt10:20:221
22784993223,5cyclictest1968-21lldpad10:37:361
2278499321,4cyclictest81rcu_preempt10:49:271
22783993217,5cyclictest3-21ksoftirqd/009:41:330
2278399321,5cyclictest2403-21irqbalance12:09:160
22783993215,6cyclictest3-21ksoftirqd/008:46:220
155682321,3sleep115580-21ssh09:26:381
2278499315,4cyclictest81rcu_preempt08:37:101
2278499314,4cyclictest81rcu_preempt09:35:441
2278499314,4cyclictest81rcu_preempt08:18:391
2278499313,4cyclictest81rcu_preempt08:11:281
2278499312,26cyclictest20239-21kworker/u4:110:03:361
2278499311,27cyclictest18949-21ssh12:52:161
2278399311,8cyclictest189192sed08:35:260
22783993118,4cyclictest3-21ksoftirqd/008:03:390
22783993114,6cyclictest3-21ksoftirqd/007:58:070
22783993114,6cyclictest3-21ksoftirqd/007:58:070
97192301,5sleep00-21swapper/008:10:570
31972300,3sleep130824-21diskmemload09:47:311
291752300,8sleep12278499cyclictest07:40:011
2278499303,4cyclictest81rcu_preempt10:52:581
2278499302,4cyclictest81rcu_preempt07:46:341
2278499301,4cyclictest81rcu_preempt10:05:441
2278499301,4cyclictest81rcu_preempt08:32:381
22783993023,5cyclictest0-21swapper/007:51:360
2278499294,4cyclictest81rcu_preempt08:54:261
2278499292,15cyclictest0-21swapper/108:03:231
2278499291,4cyclictest81rcu_preempt12:08:231
2278499291,15cyclictest2172-21seq07:51:441
212932291,5sleep10-21swapper/108:43:491
2278499281,4cyclictest81rcu_preempt09:04:461
156382271,5sleep10-21swapper/108:28:461
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional