You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 01:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Wed Apr 22, 2026 12:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
302039911491133,13cyclictest28806-21kworker/0:307:25:080
302049911451131,11cyclictest0-21swapper/107:25:111
302049911211080,34cyclictest13316-21mv08:00:501
300902597550,32sleep00-21swapper/007:24:210
301272525478,32sleep10-21swapper/107:24:461
3020399272233,36cyclictest0-21swapper/008:00:500
246662890,5sleep0111rcuc/012:50:220
16932850,8sleep03020399cyclictest10:45:230
205442810,8sleep020542-21ps12:45:260
280942630,4sleep10-21swapper/111:45:581
73782620,7sleep03020399cyclictest10:50:480
204282560,8sleep03020399cyclictest08:20:240
23002470,4sleep0111rcuc/009:00:110
11892450,7sleep03020399cyclictest09:38:060
132852411,35sleep113295-21ssh11:30:341
283892400,25sleep0111rcuc/010:05:290
176172391,34sleep017629-21ssh10:28:420
325892381,32sleep132596-21latency_hist08:55:011
95412371,32sleep09548-21ssh12:34:490
30204993727,6cyclictest20579-21sh10:30:581
3020399373,10cyclictest107982sh12:01:450
3020399371,13cyclictest17690-21ssh09:55:130
207042370,4sleep0111rcuc/010:31:090
3020499361,6cyclictest81rcu_preempt11:18:341
3020399361,6cyclictest4703-21ssh11:22:020
3020399361,6cyclictest4703-21ssh11:22:010
30203993613,8cyclictest28340-21hddtemp_smartct12:20:160
219522361,4sleep12695-21snmpd12:13:571
115132360,22sleep03-21ksoftirqd/010:55:260
80952350,4sleep0111rcuc/009:45:140
31822351,4sleep13193-21sh10:46:431
30204993512,7cyclictest22-21ksoftirqd/109:56:331
3020399352,16cyclictest0-21swapper/011:42:280
3020399351,21cyclictest19499-21ssh09:23:360
30203993512,11cyclictest0-21swapper/012:17:030
292842351,30sleep15914-21diskmemload12:20:331
11722351,4sleep01183-21ssh11:52:000
98812341,3sleep19895-21ssh12:35:061
56752341,29sleep15686-21ssh11:23:301
56752341,29sleep15686-21ssh11:23:291
44192343,27sleep10-21swapper/109:40:351
3020499347,23cyclictest0-21swapper/111:12:151
30204993410,12cyclictest0-21swapper/112:16:421
3020399341,7cyclictest27864-21ssh10:39:350
11542340,5sleep1211ktimersoftd/112:25:261
3020499337,22cyclictest0-21swapper/112:06:451
3020499335,8cyclictest0-21swapper/112:02:431
3020499332,5cyclictest81rcu_preempt10:51:301
30204993323,6cyclictest962-21/usr/sbin/munin07:30:171
30204993323,6cyclictest25675-21ssh10:36:241
30204993313,8cyclictest22-21ksoftirqd/111:27:241
3020399334,4cyclictest81rcu_preempt11:00:220
3020399331,9cyclictest22304-21aten_r4power_vo10:00:120
157122331,28sleep015763-21ntp_states12:40:240
142372330,10sleep13020499cyclictest10:25:131
4532320,22sleep03-21ksoftirqd/011:18:020
316582321,27sleep15914-21diskmemload10:43:051
30204993224,5cyclictest3095-21ssh11:54:371
3020499321,9cyclictest19213-21watchsnmpd12:45:001
30204993212,16cyclictest0-21swapper/109:13:551
3020399326,13cyclictest0-21swapper/007:45:120
3020399324,4cyclictest81rcu_preempt12:05:110
3020399322,19cyclictest0-21swapper/010:15:320
30203993212,6cyclictest6851-21iostat_ios09:10:190
3020399321,10cyclictest0-21swapper/009:34:090
238252321,27sleep10-21swapper/111:41:471
36252310,4sleep081rcu_preempt11:55:090
30204993118,8cyclictest14246-21diskstats08:05:141
3020499311,4cyclictest81rcu_preempt08:42:331
30204993113,5cyclictest22-21ksoftirqd/110:13:301
30204993113,5cyclictest22-21ksoftirqd/110:13:301
30204993113,14cyclictest23585-21sh12:49:591
3020399319,5cyclictest0-21swapper/009:16:350
3020399318,5cyclictest20277-21ssh11:05:110
3020399317,5cyclictest27341-21tr08:40:130
3020399312,15cyclictest1189-21/usr/sbin/munin08:55:270
3020399312,12cyclictest0-21swapper/012:28:530
3020399311,5cyclictest81rcu_preempt10:44:210
249092311,5sleep10-21swapper/109:29:271
181242311,26sleep118135-21ssh09:21:371
3020499306,20cyclictest0-21swapper/110:00:291
3020499305,4cyclictest81rcu_preempt08:46:551
3020499304,13cyclictest4212-21tr07:40:001
3020499302,24cyclictest0-21swapper/111:37:051
3020499301,3cyclictest81rcu_preempt11:07:581
30204993012,6cyclictest31272-21fschecks_count08:50:141
3020399306,6cyclictest17185-21ssh11:35:170
3020399306,12cyclictest27009-21kernelversion11:45:190
3020399303,4cyclictest81rcu_preempt12:10:530
3020399302,16cyclictest0-21swapper/007:31:240
3020399301,8cyclictest0-21swapper/009:52:480
3020399301,4cyclictest81rcu_preempt11:30:080
3020399301,4cyclictest81rcu_preempt10:22:030
30203993011,5cyclictest25205-21df11:10:130
249092301,5sleep10-21swapper/108:33:271
248752301,4sleep00-21swapper/008:33:060
91242291,5sleep10-21swapper/110:20:081
80262291,5sleep10-21swapper/112:32:381
3020499296,4cyclictest81rcu_preempt08:13:151
3020499294,4cyclictest81rcu_preempt09:05:081
3020499293,6cyclictest0-21swapper/109:38:061
3020499292,23cyclictest0-21swapper/111:55:291
3020499292,11cyclictest0-21swapper/109:47:251
3020499291,8cyclictest25392-21sort08:35:121
30204992911,14cyclictest0-21swapper/112:51:341
3020499291,10cyclictest0-21swapper/109:54:571
3020399298,10cyclictest0-21swapper/010:10:430
3020399298,10cyclictest0-21swapper/010:10:420
3020399292,13cyclictest7475-21ssh11:25:160
3020399291,15cyclictest20835-21/usr/sbin/munin09:25:110
3020399291,14cyclictest2443-21aten_r4power_po07:35:100
3020399291,10cyclictest81rcu_preempt12:39:420
192942291,5sleep00-21swapper/008:18:460
184262291,5sleep10-21swapper/111:02:561
171712291,5sleep00-21swapper/008:11:130
155512291,5sleep00-21swapper/008:08:520
131292293,22sleep115617-21kworker/1:110:57:131
116882291,5sleep00-21swapper/007:59:540
97862281,5sleep10-21swapper/107:54:391
58582281,5sleep00-21swapper/009:09:360
58082281,5sleep10-21swapper/107:42:151
3020499282,13cyclictest17702-21/usr/sbin/munin08:15:191
30204992818,6cyclictest11413-21ssh09:15:161
30204992818,6cyclictest10449-21tune2fs07:55:151
3020499281,14cyclictest8398-21ssh10:19:191
30204992810,14cyclictest26602-21proc_pri09:30:261
3020399281,18cyclictest0-21swapper/007:40:220
3020399281,14cyclictest25384-21ls08:35:110
3020399281,13cyclictest3930-21proc_pri09:40:250
30203992810,6cyclictest31274-21cut08:50:150
289052281,5sleep10-21swapper/110:06:081
228032281,5sleep00-21swapper/008:26:020
3020499277,7cyclictest0-21swapper/107:46:381
30204992718,5cyclictest3417-21cat09:00:281
229512271,5sleep10-21swapper/108:27:361
204332270,7sleep10-21swapper/108:20:251
3020399268,6cyclictest11565-21gdbus08:48:060
3020399268,14cyclictest81062chrt07:50:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional