You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-14 - 18:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sat Mar 14, 2026 12:59:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
269659912221214,5cyclictest0-21swapper/107:26:311
269649912121184,16cyclictest0-21swapper/007:26:170
266742562516,31sleep00-21swapper/007:22:320
252032487439,32sleep10-21swapper/107:20:111
836121110,4sleep041ktimersoftd/011:29:250
836121110,4sleep041ktimersoftd/011:29:250
1977821010,3sleep00-21swapper/009:26:360
2436721000,23sleep122-21ksoftirqd/111:45:211
141062920,26sleep114093-21unixbench_singl09:20:301
101942920,5sleep041ktimersoftd/012:04:480
10152900,3sleep01016-21expr11:55:120
5472840,3sleep1201rcuc/110:14:341
228862830,8sleep02696499cyclictest08:35:270
100942800,6sleep02696499cyclictest10:24:120
241112570,2sleep124112-21rm12:18:551
215412530,4sleep00-21swapper/010:35:270
129142460,4sleep012900-21ssh09:20:120
26964994527,13cyclictest25982-21ssh09:33:340
241342450,5sleep0111rcuc/010:05:120
43222430,8sleep12696599cyclictest11:58:191
26965994322,6cyclictest22-21ksoftirqd/110:29:121
26965994224,6cyclictest22-21ksoftirqd/111:30:351
26965994223,5cyclictest22-21ksoftirqd/112:27:311
26965994219,5cyclictest22-21ksoftirqd/110:50:361
2696599415,32cyclictest0-21swapper/109:46:151
26965994123,6cyclictest22-21ksoftirqd/109:13:191
26965994122,8cyclictest22-21ksoftirqd/112:30:431
26965994121,9cyclictest22-21ksoftirqd/109:26:451
36922401,35sleep03172-21/usr/sbin/munin07:45:180
26965994025,4cyclictest22-21ksoftirqd/110:20:141
26965994024,5cyclictest22-21ksoftirqd/111:44:021
26965994021,8cyclictest22-21ksoftirqd/111:35:221
26965993921,8cyclictest22-21ksoftirqd/112:54:001
26965993921,5cyclictest22-21ksoftirqd/110:18:361
26965993919,9cyclictest22-21ksoftirqd/109:51:271
26965993919,5cyclictest22-21ksoftirqd/110:46:491
26965993917,7cyclictest22-21ksoftirqd/109:55:341
26965993916,7cyclictest22-21ksoftirqd/111:05:191
104822390,3sleep0111rcuc/011:30:290
316132381,33sleep031623-21ssh11:53:020
26965993822,5cyclictest22-21ksoftirqd/112:38:411
26965993821,6cyclictest22-21ksoftirqd/110:39:471
26965993820,8cyclictest22-21ksoftirqd/112:41:291
26965993819,9cyclictest22-21ksoftirqd/112:07:291
26965993819,9cyclictest22-21ksoftirqd/112:07:281
26965993819,4cyclictest22-21ksoftirqd/110:42:091
2696599381,22cyclictest15140-21ls08:15:211
2696499386,4cyclictest81rcu_preempt09:47:520
26964993818,15cyclictest1968-21lldpad10:14:000
83902371,32sleep08455-21grep10:55:240
26965993722,5cyclictest22-21ksoftirqd/112:01:591
26965993722,5cyclictest22-21ksoftirqd/111:10:551
26965993721,5cyclictest22-21ksoftirqd/109:31:251
26965993718,9cyclictest22-21ksoftirqd/109:38:421
2696499377,26cyclictest0-21swapper/010:15:160
26964993728,5cyclictest0-21swapper/012:35:560
194032371,5sleep019414-21ssh10:33:440
26965993622,4cyclictest22-21ksoftirqd/112:22:041
26965993620,6cyclictest22-21ksoftirqd/108:01:451
26965993620,5cyclictest22-21ksoftirqd/112:11:161
26965993620,5cyclictest22-21ksoftirqd/109:06:591
2696599361,23cyclictest0-21swapper/110:59:301
2696499363,30cyclictest0-21swapper/012:53:550
2696499362,8cyclictest0-21swapper/011:07:150
2696499362,30cyclictest0-21swapper/012:41:550
2696499362,30cyclictest0-21swapper/012:27:160
26965993521,4cyclictest22-21ksoftirqd/111:26:111
26965993521,4cyclictest22-21ksoftirqd/111:26:111
26965993520,5cyclictest22-21ksoftirqd/110:00:071
26965993519,5cyclictest22-21ksoftirqd/111:22:281
2696499358,23cyclictest0-21swapper/010:53:120
2696499353,28cyclictest0-21swapper/007:50:160
2696499351,31cyclictest0-21swapper/009:53:160
2696599342,6cyclictest0-21swapper/112:48:561
2696599342,6cyclictest0-21swapper/112:48:551
26965993419,5cyclictest22-21ksoftirqd/109:44:481
26965993419,5cyclictest22-21ksoftirqd/107:37:261
26965993418,5cyclictest22-21ksoftirqd/107:34:471
26965993416,9cyclictest22-21ksoftirqd/111:02:141
2696499345,4cyclictest81rcu_preempt10:40:530
2696499342,6cyclictest19120-21/usr/sbin/munin10:00:220
2696499342,29cyclictest0-21swapper/009:17:560
26964993412,17cyclictest6949-21/usr/sbin/munin07:55:180
2696499341,14cyclictest4992sort11:20:290
164292341,4sleep116445-21irqstats10:30:221
112522340,3sleep1201rcuc/109:18:211
78982330,6sleep17894-21sendmail_mailqu07:55:271
26965993318,5cyclictest22-21ksoftirqd/110:05:331
2696599331,5cyclictest0-21swapper/108:11:161
2696499336,4cyclictest81rcu_preempt11:35:210
2696499335,4cyclictest81rcu_preempt10:45:260
2696499334,4cyclictest81rcu_preempt12:14:360
2696499334,26cyclictest12091-21kworker/u4:212:24:390
26964993324,5cyclictest0-21swapper/010:27:160
26964993313,17cyclictest24999-21runrttasks11:12:460
2696499323,4cyclictest81rcu_preempt12:07:590
2696499323,4cyclictest81rcu_preempt12:07:590
2696499323,4cyclictest81rcu_preempt09:44:060
2696499322,16cyclictest0-21swapper/009:37:370
2696499321,9cyclictest20624-21ssh12:49:260
2696499321,9cyclictest20624-21ssh12:49:260
2696499321,29cyclictest0-21swapper/008:21:160
26964993212,6cyclictest13198-21irqstats08:10:210
26964993211,5cyclictest0-21swapper/007:39:310
2696599315,12cyclictest0-21swapper/108:20:121
2696599311,9cyclictest6723-21runrttasks07:54:241
26965993117,4cyclictest22-21ksoftirqd/108:30:111
2696499317,20cyclictest0-21swapper/009:10:170
2696499312,11cyclictest0-21swapper/011:41:490
2696499311,4cyclictest81rcu_preempt11:18:100
26964993111,6cyclictest14990-21ssh09:55:210
110142311,26sleep111019-21diskstats08:05:151
2696599306,8cyclictest22-21ksoftirqd/111:50:091
2696599303,14cyclictest0-21swapper/108:45:281
2696599302,15cyclictest30121-21iostat_ios08:55:191
26965993015,5cyclictest22-21ksoftirqd/107:44:241
2696599301,20cyclictest0-21swapper/108:41:421
2696599301,17cyclictest18499-21cstates08:25:141
26965993011,6cyclictest3302-21runrttasks08:35:271
2696499309,6cyclictest2520-21aten_r4power_vo12:30:110
26964993011,6cyclictest26972-21sed08:45:290
26964993011,6cyclictest15432-21ssh11:02:550
217472301,5sleep00-21swapper/008:34:080
161962300,5sleep0111rcuc/008:19:590
105202301,5sleep00-21swapper/008:04:390
2696599291,14cyclictest27397-21idleruntime11:15:171
2696499293,6cyclictest11312-21iostat08:05:200
2696499292,14cyclictest20960-21ssh12:15:190
2696499291,21cyclictest1501-21latency09:05:220
26964992911,6cyclictest28243-21iostat_ios08:50:180
26964992910,6cyclictest24906-21python08:40:270
2696599282,8cyclictest3164-21runrttasks07:45:051
2696599281,8cyclictest676-21/usr/sbin/munin09:05:001
2696599281,8cyclictest676-21/usr/sbin/munin09:05:001
2696499282,6cyclictest1839-21ntp_states07:40:250
26964992811,5cyclictest32108-21memory09:00:210
26964992811,5cyclictest32108-21memory09:00:210
26964992811,5cyclictest31026-21seq08:57:500
2696499281,13cyclictest23875-21ssh11:45:130
26964992810,6cyclictest18521-21cstates08:25:130
2696499261,12cyclictest29084-21latency_hist07:30:010
2696599259,12cyclictest0-21swapper/108:51:581
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional