You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 08:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Wed Aug 12, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
67149912161187,24cyclictest13839-21memory19:40:221
66442691643,32sleep10-21swapper/119:24:511
66442691643,32sleep10-21swapper/119:24:511
66112522475,32sleep00-21swapper/019:24:300
66112522475,32sleep00-21swapper/019:24:290
671399158137,16cyclictest0-21swapper/019:40:220
2391121000,9sleep0671399cyclictest20:06:240
77362780,8sleep1671499cyclictest20:50:201
77362780,8sleep1671499cyclictest20:50:201
121132630,2sleep012110-21tail21:00:300
6714995115,6cyclictest22-21ksoftirqd/119:35:181
6714994915,6cyclictest22-21ksoftirqd/121:15:001
6714994710,6cyclictest22-21ksoftirqd/123:30:261
671499468,6cyclictest22-21ksoftirqd/122:55:221
671499459,6cyclictest22-21ksoftirqd/120:55:191
6714994513,6cyclictest22-21ksoftirqd/123:10:191
6714994511,5cyclictest22-21ksoftirqd/120:10:201
225022450,8sleep0671399cyclictest21:30:150
671499449,16cyclictest22-21ksoftirqd/120:30:271
671499448,5cyclictest22-21ksoftirqd/119:55:131
6714994414,10cyclictest22-21ksoftirqd/120:15:151
671499438,6cyclictest22-21ksoftirqd/119:50:191
671499436,5cyclictest22-21ksoftirqd/100:05:301
6714994324,9cyclictest22-21ksoftirqd/122:20:181
6714994310,6cyclictest22-21ksoftirqd/123:57:231
127632430,10sleep0671399cyclictest23:55:230
671499429,6cyclictest22-21ksoftirqd/120:25:001
671499429,6cyclictest22-21ksoftirqd/100:20:111
671499426,6cyclictest22-21ksoftirqd/122:40:271
6714994221,4cyclictest22-21ksoftirqd/119:25:191
671499417,5cyclictest22-21ksoftirqd/120:45:121
671499416,16cyclictest22-21ksoftirqd/120:40:201
6714994123,4cyclictest22-21ksoftirqd/119:30:111
6714994025,4cyclictest22-21ksoftirqd/119:45:291
6714994020,4cyclictest22-21ksoftirqd/122:25:101
6714994020,4cyclictest22-21ksoftirqd/121:20:241
6714994013,10cyclictest22-21ksoftirqd/123:15:031
6714994010,5cyclictest22-21ksoftirqd/123:07:521
671499396,4cyclictest81rcu_preempt22:50:281
671499396,4cyclictest81rcu_preempt21:39:321
671499395,4cyclictest81rcu_preempt23:21:001
671499392,6cyclictest22-21ksoftirqd/100:50:181
6714993925,4cyclictest22-21ksoftirqd/122:30:161
6714993921,7cyclictest22-21ksoftirqd/121:03:431
6714993915,10cyclictest22-21ksoftirqd/121:18:361
6714993912,10cyclictest22-21ksoftirqd/121:32:301
671499388,5cyclictest81rcu_preempt22:10:161
671499387,6cyclictest22-21ksoftirqd/123:44:061
671499385,4cyclictest81rcu_preempt23:35:211
6714993821,4cyclictest22-21ksoftirqd/121:05:241
6714993820,4cyclictest22-21ksoftirqd/122:35:211
6714993819,4cyclictest22-21ksoftirqd/123:45:151
6714993819,4cyclictest22-21ksoftirqd/121:45:101
6714993818,4cyclictest22-21ksoftirqd/121:50:221
6714993818,4cyclictest22-21ksoftirqd/120:00:161
6714993810,4cyclictest22-21ksoftirqd/100:17:261
671399388,15cyclictest11565-21gdbus20:48:520
671499374,5cyclictest81rcu_preempt23:50:261
6714993723,4cyclictest22-21ksoftirqd/121:25:211
6714993723,4cyclictest22-21ksoftirqd/120:25:231
6714993721,4cyclictest22-21ksoftirqd/100:00:281
6714993718,4cyclictest22-21ksoftirqd/100:10:221
6714993714,4cyclictest22-21ksoftirqd/100:45:161
6714993710,4cyclictest81rcu_preempt23:00:151
671499367,4cyclictest81rcu_preempt20:35:141
671499365,4cyclictest18240-21/usr/sbin/munin22:45:121
671499362,4cyclictest22-21ksoftirqd/100:25:211
6714993620,4cyclictest22-21ksoftirqd/120:05:221
6714993619,4cyclictest22-21ksoftirqd/100:40:171
6714993618,4cyclictest22-21ksoftirqd/122:05:131
671499356,4cyclictest81rcu_preempt23:25:111
671499354,4cyclictest81rcu_preempt21:55:191
671499352,5cyclictest7386-21irqstats22:15:211
6714993518,5cyclictest22-21ksoftirqd/121:40:211
6714993517,4cyclictest22-21ksoftirqd/100:35:121
304182350,8sleep0671399cyclictest21:50:200
671499344,4cyclictest81rcu_preempt00:30:131
6714993418,4cyclictest22-21ksoftirqd/122:00:231
6713993413,6cyclictest11943-21memory19:35:230
207942340,8sleep0671399cyclictest21:25:180
671399337,13cyclictest16460-21latency_hist21:15:010
671399329,11cyclictest26968-21munin-plugin-st00:34:590
671399326,5cyclictest28021-21awk20:19:590
671399326,13cyclictest81rcu_preempt19:30:000
671399323,4cyclictest81rcu_preempt22:05:270
6713993224,5cyclictest21729-21switchtime20:00:320
671399321,16cyclictest10943-21runrttasks23:50:230
671399318,4cyclictest81rcu_preempt23:13:490
671399314,20cyclictest25904-21diskstats23:05:170
671399313,14cyclictest0-21swapper/022:34:140
671399311,8cyclictest0-21swapper/021:05:280
6713993113,5cyclictest18682-21irqstats22:45:200
671399305,13cyclictest81rcu_preempt20:30:230
671399302,16cyclictest0-21swapper/022:50:530
671399301,15cyclictest19820-21ls00:15:140
671399301,10cyclictest0-21swapper/000:10:270
671399300,4cyclictest81rcu_preempt00:00:240
175592301,5sleep00-21swapper/022:41:140
671399298,6cyclictest5531-21kernelversion22:10:200
671399294,5cyclictest81rcu_preempt19:50:100
671399294,4cyclictest81rcu_preempt22:18:220
671399294,12cyclictest0-21swapper/020:10:300
671399293,19cyclictest16753-21munin-run19:50:010
671399292,14cyclictest24560-21ntp_states23:00:230
671399292,14cyclictest0-21swapper/021:19:510
671399291,14cyclictest28295-21grep00:35:300
671399291,13cyclictest1637-21iostat_ios22:00:220
6713992910,6cyclictest7630-21hddtemp_smartct20:50:170
6713992910,6cyclictest7630-21hddtemp_smartct20:50:170
4992291,24sleep0501-21cron23:25:000
18842291,5sleep00-21swapper/000:53:100
671399282,4cyclictest81rcu_preempt00:43:530
671399282,4cyclictest81rcu_preempt00:06:010
671399281,4cyclictest81rcu_preempt23:30:010
671399281,4cyclictest81rcu_preempt20:39:420
671399281,15cyclictest30755-21/usr/sbin/munin20:25:220
6713992811,5cyclictest27607-21chrt21:44:130
671399281,13cyclictest30050-21date20:25:010
671399280,4cyclictest81rcu_preempt23:44:410
47862281,5sleep00-21swapper/020:41:510
325872281,5sleep00-21swapper/000:49:300
310282281,5sleep00-21swapper/023:19:350
255392281,5sleep00-21swapper/021:37:250
121532281,5sleep00-21swapper/022:28:460
104962281,5sleep00-21swapper/020:57:360
6713992721,3cyclictest0-21swapper/000:25:300
671399271,3cyclictest81rcu_preempt22:35:180
671399271,11cyclictest9862-21taskset23:48:130
291952271,5sleep00-21swapper/021:46:130
231722271,5sleep00-21swapper/000:24:440
201192271,5sleep00-21swapper/019:56:090
100622271,4sleep00-21swapper/022:21:330
671399269,5cyclictest2225-21dbus-daemon21:57:290
671399262,6cyclictest3925-21users23:30:290
671399261,17cyclictest0-21swapper/023:35:190
234002261,4sleep00-21swapper/022:58:300
108582261,5sleep00-21swapper/019:32:380
671399257,9cyclictest0-21swapper/021:24:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional