You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 10:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sat Dec 20, 2025 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
213009912901242,28cyclictest26305-21perl19:35:181
212999912111177,19cyclictest0-21swapper/019:25:050
213009910761067,6cyclictest0-21swapper/119:25:071
211242576531,29sleep00-21swapper/019:23:430
211622563518,30sleep10-21swapper/119:24:071
2129999221196,22cyclictest0-21swapper/019:35:170
1409821200,7sleep02129999cyclictest21:27:010
111382800,8sleep02129999cyclictest21:57:280
261202600,5sleep0111rcuc/023:20:120
218692550,3sleep1211ktimersoftd/123:15:221
182182520,7sleep12130099cyclictest23:11:071
140402450,8sleep02129999cyclictest22:00:210
21300994325,6cyclictest22-21ksoftirqd/122:53:061
2130099419,6cyclictest22-21ksoftirqd/122:07:031
21300993927,8cyclictest0-21swapper/122:29:351
236022380,3sleep00-21swapper/019:30:020
21300993815,4cyclictest22-21ksoftirqd/122:30:171
2129999385,5cyclictest81rcu_preempt23:02:130
2129999381,33cyclictest0-21swapper/023:43:560
2130099371,34cyclictest0-21swapper/121:36:161
21299993729,5cyclictest0-21swapper/022:54:360
2129999372,18cyclictest0-21swapper/022:27:040
256672361,31sleep125677-21ssh23:52:421
247212361,4sleep024732-21sh21:38:230
2130099363,29cyclictest0-21swapper/123:20:551
2130099363,29cyclictest0-21swapper/123:08:161
21300993621,4cyclictest22-21ksoftirqd/119:55:171
21299993628,4cyclictest0-21swapper/022:23:150
2129999362,30cyclictest0-21swapper/000:21:560
21299993611,12cyclictest0-21swapper/020:30:250
2130099359,15cyclictest0-21swapper/100:04:011
2130099356,4cyclictest81rcu_preempt23:35:141
2130099353,30cyclictest0-21swapper/121:48:161
21300993520,4cyclictest22-21ksoftirqd/121:17:441
2130099351,5cyclictest81rcu_preempt22:00:111
2130099351,5cyclictest22-21ksoftirqd/121:40:211
2130099351,4cyclictest81rcu_preempt21:25:301
21300993510,4cyclictest22-21ksoftirqd/100:27:441
2129999352,29cyclictest0-21swapper/021:15:150
21299993518,14cyclictest3-21ksoftirqd/000:30:210
11532351,30sleep01167-21sh21:47:110
42462341,5sleep14259-21sh00:37:141
280792341,4sleep02206-21dbus-daemon00:28:550
2130099343,5cyclictest0-21swapper/120:28:361
2130099343,3cyclictest0-21swapper/121:56:561
2130099343,28cyclictest0-21swapper/122:55:361
21300993426,5cyclictest0-21swapper/121:14:151
21300993423,6cyclictest7972-21ssh00:07:501
2130099341,29cyclictest21200-21ssh00:20:551
2129999348,23cyclictest0-21swapper/000:49:510
2129999343,16cyclictest32033-21python23:25:300
2129999342,29cyclictest0-21swapper/021:42:360
2129999342,29cyclictest0-21swapper/000:43:550
21299993415,16cyclictest3-21ksoftirqd/023:52:280
324692331,4sleep132482-21sh00:33:161
2130099335,4cyclictest81rcu_preempt00:48:571
2130099334,26cyclictest23235-21kworker/1:122:21:391
21300993325,6cyclictest0-21swapper/121:22:561
2130099332,17cyclictest81rcu_preempt23:45:171
2130099331,5cyclictest22-21ksoftirqd/121:30:191
21300993313,6cyclictest3012-21sh23:29:581
21300993313,4cyclictest22-21ksoftirqd/100:40:241
2130099331,29cyclictest29901-21diskstats19:45:151
2129999337,13cyclictest29073-21ssh23:55:360
21299993324,5cyclictest2403-21irqbalance23:11:150
2129999331,5cyclictest0-21swapper/022:38:360
2129999331,30cyclictest0-21swapper/020:15:360
2129999331,14cyclictest0-21swapper/000:02:570
204422331,4sleep020525-21memory20:45:220
113442331,5sleep00-21swapper/023:38:010
279282321,27sleep127995-21df22:15:131
21300993221,7cyclictest7033-21ssh23:33:481
2130099321,4cyclictest81rcu_preempt22:37:421
2130099321,29cyclictest0-21swapper/120:44:151
21300993212,4cyclictest22-21ksoftirqd/123:40:281
2129999325,4cyclictest81rcu_preempt22:44:440
2129999325,4cyclictest81rcu_preempt21:23:390
2129999325,14cyclictest12431-21ntp_states23:05:250
2129999324,4cyclictest81rcu_preempt21:53:300
21299993223,6cyclictest4671-21/usr/sbin/munin23:30:290
2129999322,12cyclictest0-21swapper/022:12:110
2129999321,5cyclictest0-21swapper/000:13:160
2129999321,4cyclictest14970-21fschecks_count00:15:150
2129999321,29cyclictest0-21swapper/020:53:150
2129999321,29cyclictest0-21swapper/020:41:560
2129999321,29cyclictest0-21swapper/020:36:560
2129999321,28cyclictest898-21/usr/sbin/munin19:55:150
2129999321,27cyclictest1968-21lldpad21:11:320
2129999321,27cyclictest1968-21lldpad00:36:380
21299993210,9cyclictest3302-21runrttasks23:46:160
2130099314,4cyclictest81rcu_preempt22:40:161
21300993126,3cyclictest0-21swapper/100:50:551
21300993123,5cyclictest25871-21cut21:00:171
21300993117,4cyclictest22-21ksoftirqd/100:13:421
2130099311,5cyclictest81rcu_preempt20:16:271
2130099311,15cyclictest0-21swapper/121:53:441
2129999317,4cyclictest81rcu_preempt22:05:180
2129999314,4cyclictest81rcu_preempt21:30:360
2129999311,6cyclictest0-21swapper/023:16:000
275562301,25sleep027654-21df21:05:140
259212301,5sleep00-21swapper/022:45:340
251342301,5sleep00-21swapper/020:58:130
2130099304,22cyclictest0-21swapper/123:00:021
21300993021,6cyclictest7929-21/usr/sbin/munin20:10:291
2130099301,4cyclictest81rcu_preempt23:58:561
2130099301,4cyclictest81rcu_preempt21:05:271
2130099301,4cyclictest81rcu_preempt20:45:281
2130099301,4cyclictest81rcu_preempt19:51:411
2130099301,4cyclictest81rcu_preempt00:15:081
21300993013,4cyclictest81rcu_preempt20:50:261
2130099301,17cyclictest0-21swapper/119:30:181
2129999308,11cyclictest5945-21grep00:05:260
2129999304,19cyclictest28329-21iostat_ios19:40:200
2129999303,4cyclictest81rcu_preempt22:34:540
2129999302,16cyclictest26091-21/usr/sbin/munin21:00:200
2129999301,17cyclictest28651-21ssh22:15:250
21299993011,6cyclictest30439-21ntp_states19:45:260
140152301,5sleep00-21swapper/020:29:560
2130099299,4cyclictest81rcu_preempt20:57:071
2130099296,4cyclictest81rcu_preempt22:10:301
2130099292,11cyclictest25111-21irqstats22:45:211
2130099291,4cyclictest81rcu_preempt19:40:441
2129999299,6cyclictest7265-21irqstats20:10:200
21299992916,10cyclictest3-21ksoftirqd/022:55:110
21299992910,7cyclictest17801-21ssh00:52:450
21299992910,6cyclictest5976-21grep20:05:300
61482281,5sleep10-21swapper/120:06:191
44802281,5sleep10-21swapper/120:03:301
4332281,5sleep00-21swapper/019:51:560
2130099285,4cyclictest81rcu_preempt20:32:101
2130099282,5cyclictest81rcu_preempt20:20:051
2129999284,18cyclictest3198-21diskstats20:00:160
163762281,5sleep116551-21perl20:35:171
118132281,5sleep00-21swapper/020:21:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional