You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-18 - 08:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sat Apr 18, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
235099911211109,9cyclictest0-21swapper/119:30:061
231032606531,59sleep10-21swapper/119:21:181
231372466420,31sleep00-21swapper/019:21:390
814921090,7sleep02350899cyclictest22:25:240
23508999662,29cyclictest26100-21grep19:30:060
26172850,3sleep10-21swapper/123:26:411
12642790,5sleep0111rcuc/019:50:110
188622770,5sleep1211ktimersoftd/123:44:071
49102740,2sleep04908-21processes22:55:280
193652690,4sleep0111rcuc/023:44:510
297682550,3sleep029766-21entropy23:55:160
18912520,7sleep02350899cyclictest22:52:420
209912480,21sleep1211ktimersoftd/122:05:221
141572440,8sleep02350899cyclictest21:25:150
236512400,2sleep023648-21grep23:15:150
18752381,33sleep11887-21ssh22:19:531
13382380,3sleep0111rcuc/021:45:180
2350999372,13cyclictest30433-21ssh21:41:231
23508993720,6cyclictest3-21ksoftirqd/021:16:360
62492361,3sleep15681-21/usr/sbin/munin21:50:201
2350899361,14cyclictest0-21swapper/022:45:080
27522350,21sleep03-21ksoftirqd/023:26:510
2350899349,13cyclictest31297-21diskmemload21:32:590
2350899341,9cyclictest0-21swapper/023:49:230
2350899341,11cyclictest11697-21ssh00:10:100
75932331,28sleep17676-21memory20:05:201
251202331,4sleep125134-21hddtemp_smartct23:50:161
2350999338,21cyclictest0-21swapper/123:34:481
2350999333,17cyclictest0-21swapper/100:33:271
23509993311,9cyclictest26842-21ssh22:45:131
23509993310,8cyclictest0-21swapper/120:30:161
2350899334,5cyclictest81rcu_preempt23:35:170
2350899334,5cyclictest81rcu_preempt23:12:340
2350899333,16cyclictest3809-21diskstats00:35:150
23508993312,6cyclictest30403-21ntp_states21:05:240
23508993310,12cyclictest28397-21aten_r4power_en21:40:100
104712331,9sleep00-21swapper/020:13:550
247532321,26sleep024867-21latency_hist22:10:010
2350999322,19cyclictest0-21swapper/121:58:161
2350999321,17cyclictest12786-21cat22:30:211
23509993211,5cyclictest22-21ksoftirqd/121:30:181
2350899329,11cyclictest3286-21runrttasks00:45:060
2350899323,4cyclictest81rcu_preempt23:50:080
2350899323,4cyclictest81rcu_preempt21:14:240
2350899323,4cyclictest81rcu_preempt00:25:280
2350899321,8cyclictest30822-21chrt22:15:250
151032321,5sleep10-21swapper/100:13:251
47932311,5sleep10-21swapper/100:02:321
257012311,5sleep125712-21ssh23:17:071
2350999319,18cyclictest0-21swapper/100:52:301
2350999317,12cyclictest81rcu_preempt21:50:011
2350999316,13cyclictest0-21swapper/121:19:291
2350999314,17cyclictest0-21swapper/123:13:431
2350999313,24cyclictest0-21swapper/100:47:311
2350999312,16cyclictest0-21swapper/122:24:261
2350999311,4cyclictest81rcu_preempt00:21:001
23509993112,5cyclictest0-21swapper/122:56:081
2350899316,12cyclictest5364-21aten_r4power_vo23:30:120
2350899314,4cyclictest81rcu_preempt22:40:240
2350899313,4cyclictest81rcu_preempt22:10:560
2350899312,4cyclictest81rcu_preempt00:02:000
23508993121,6cyclictest28735-21memory23:20:210
23508993112,5cyclictest18785-21grep00:50:290
2350899311,19cyclictest16417-21ssh23:07:370
257712302,24sleep10-21swapper/122:44:181
239142301,5sleep10-21swapper/120:50:021
2350999308,18cyclictest0-21swapper/123:58:591
2350999308,18cyclictest0-21swapper/100:16:011
2350999308,18cyclictest0-21swapper/100:16:011
2350999304,16cyclictest0-21swapper/121:37:071
2350999303,4cyclictest0-21swapper/122:14:551
23509993017,7cyclictest12941-21diskstats20:20:141
2350999301,14cyclictest31297-21diskmemload00:29:421
23509993011,16cyclictest0-21swapper/122:03:051
23509993011,16cyclictest0-21swapper/122:03:051
23509993010,16cyclictest0-21swapper/123:20:111
2350899303,4cyclictest81rcu_preempt00:20:550
2350899302,12cyclictest16523-21python22:00:250
2350899302,12cyclictest16523-21python22:00:250
23508993019,7cyclictest31912-21ntp_kernel_err00:30:230
2350899301,4cyclictest81rcu_preempt22:35:230
2350899301,4cyclictest81rcu_preempt22:35:220
2350899301,4cyclictest81rcu_preempt22:20:530
23508993013,5cyclictest9221-21perl23:00:160
2350899301,24cyclictest8823-21grep00:40:160
2350899301,17cyclictest17436-21switchtime20:30:270
23508993010,6cyclictest24169-21iostat21:35:200
293372291,5sleep10-21swapper/121:04:161
272612291,5sleep10-21swapper/120:57:221
2350999296,8cyclictest8675-21/usr/sbin/munin23:00:271
2350999295,15cyclictest0-21swapper/122:37:011
2350999295,15cyclictest0-21swapper/122:37:001
2350999294,22cyclictest0-21swapper/121:20:591
2350999292,23cyclictest7115-21diskstats00:05:131
2350999292,23cyclictest0-21swapper/121:10:551
2350999292,15cyclictest0-21swapper/100:36:081
2350999292,14cyclictest0-21swapper/100:42:571
2350999291,24cyclictest16254-21/usr/sbin/munin20:30:011
2350899299,4cyclictest15597-21/usr/sbin/munin20:25:260
2350899294,4cyclictest81rcu_preempt00:05:280
2350899292,4cyclictest81rcu_preempt21:51:180
2350899292,14cyclictest3822-21irqstats19:55:200
2350899292,13cyclictest29053-21python19:35:270
2350899292,13cyclictest11467-21ntp_states21:55:240
2350899291,4cyclictest81rcu_preempt22:31:320
2350899291,19cyclictest0-21swapper/020:19:200
2350899291,14cyclictest0-21swapper/020:20:260
23508992911,14cyclictest216422chrt20:42:300
85142281,5sleep00-21swapper/020:08:010
66582281,5sleep00-21swapper/020:03:150
310552281,5sleep10-21swapper/121:07:371
2350999285,4cyclictest81rcu_preempt22:53:491
2350999283,3cyclictest81rcu_preempt22:26:321
2350999283,11cyclictest0-21swapper/119:25:141
23509992812,12cyclictest20279-21hddtemp_smartct23:45:171
2350999281,14cyclictest4955-21munin-run19:59:591
2350899289,6cyclictest26608-21awk20:55:220
2350899282,13cyclictest23939-21df_inode19:25:140
2350899281,14cyclictest9509-21fw_packets21:20:170
2350899281,14cyclictest17183-21/usr/sbin/munin00:15:210
2350899281,14cyclictest17183-21/usr/sbin/munin00:15:210
2350899281,13cyclictest30995-21switchtime19:40:280
23508992810,6cyclictest25752-21sed20:55:010
23508992810,5cyclictest28512-21ntpdc21:00:220
315672271,5sleep10-21swapper/119:44:111
2350999279,14cyclictest0-21swapper/121:25:411
2350999275,4cyclictest81rcu_preempt20:35:331
2350999275,18cyclictest0-21swapper/123:35:061
2350899272,12cyclictest611-21users19:45:290
2350899271,13cyclictest18776-21/usr/sbin/munin20:35:190
214482271,5sleep10-21swapper/120:40:311
102892271,5sleep10-21swapper/120:12:011
10202271,5sleep10-21swapper/119:49:361
65512261,5sleep10-21swapper/120:02:071
235552261,4sleep10-21swapper/120:47:511
2350999269,6cyclictest40250irq/92-i91519:50:191
2350999269,14cyclictest0-21swapper/123:05:221
2350899261,4cyclictest81rcu_preempt20:46:220
124142261,4sleep10-21swapper/120:19:331
2350999243,16cyclictest28639-21iostat_ios19:35:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional