You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 14:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Apr 30, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
203599912111191,14cyclictest1283-21ssh21:15:151
203589911741121,49cyclictest20858-21fschecks_count19:25:160
194282565517,31sleep10-21swapper/119:20:241
199882465418,32sleep00-21swapper/019:21:420
2035999216185,27cyclictest20861-21fschecks_count19:25:161
2035899139116,17cyclictest1304-21grep21:15:150
172832920,8sleep02035899cyclictest23:23:360
81212810,9sleep02035899cyclictest23:12:310
148502740,4sleep0111rcuc/021:29:280
219692690,2sleep121968-21threads22:50:281
183602580,7sleep12035999cyclictest00:03:141
315852540,16sleep10-21swapper/121:12:581
325602420,4sleep1211ktimersoftd/100:20:201
222522410,11sleep02035899cyclictest00:47:080
92792400,6sleep12035999cyclictest23:14:131
2035899401,13cyclictest8728-21latency00:30:210
2035899392,13cyclictest30004-21/usr/sbin/munin21:45:180
2035999377,4cyclictest81rcu_preempt00:25:121
20359993710,3cyclictest81rcu_preempt23:44:181
91632361,31sleep128148-21diskmemload21:57:521
2035999369,4cyclictest81rcu_preempt21:24:191
20359993625,6cyclictest26875-21basename19:40:121
2035899369,10cyclictest24784-21sort19:35:000
195002361,4sleep019511-21ssh00:04:550
26982351,28sleep12904-21sh23:45:011
2035999356,4cyclictest81rcu_preempt20:40:311
2035999353,14cyclictest19286-21fschecks_count20:45:151
2035899356,4cyclictest28148-21diskmemload23:39:380
2035899355,17cyclictest0-21swapper/020:18:350
2035899354,4cyclictest81rcu_preempt22:28:210
2035899354,4cyclictest81rcu_preempt00:06:240
2035899353,17cyclictest21789-21python20:50:280
2035899351,21cyclictest11637-21ssh22:00:210
100782351,4sleep110092-21sh23:15:111
304392341,3sleep030449-21ssh00:18:200
23492340,8sleep12035999cyclictest20:00:151
2035999341,4cyclictest81rcu_preempt19:30:181
20359993413,10cyclictest22-21ksoftirqd/122:36:221
20359993410,4cyclictest81rcu_preempt22:30:281
2035899346,13cyclictest81rcu_preempt00:20:250
2035899346,13cyclictest11565-21gdbus22:50:100
20358993423,6cyclictest10398-21munin-run21:25:000
2035899342,19cyclictest16255-21date00:40:020
2035899341,20cyclictest3031-21/usr/sbin/munin20:00:280
2035899341,20cyclictest18863-21ssh22:09:400
2035899341,10cyclictest0-21swapper/022:49:380
141242341,4sleep128148-21diskmemload21:28:261
8112331,28sleep0900-21wc19:55:250
280302331,4sleep128040-21ssh22:58:481
268732330,4sleep026874-21aten_r4power_vo19:40:110
2035999338,4cyclictest81rcu_preempt21:34:331
2035999336,14cyclictest0-21swapper/119:50:151
2035999334,8cyclictest32558-21ssh22:25:041
2035999331,6cyclictest0-21swapper/122:04:071
20359993315,6cyclictest22-21ksoftirqd/120:05:291
20359993315,15cyclictest22-21ksoftirqd/123:52:521
2035999331,4cyclictest81rcu_preempt22:11:381
2035899338,8cyclictest20356-21cyclictest21:32:020
2035899338,13cyclictest4362-21/usr/sbin/munin20:05:180
2035899334,4cyclictest81rcu_preempt21:40:530
2035899332,4cyclictest81rcu_preempt00:54:100
2035899331,7cyclictest14400-21ssh23:59:320
2035899331,4cyclictest81rcu_preempt23:33:530
2035899331,20cyclictest26419-21taskset21:05:090
247352321,4sleep124749-21ssh22:16:001
2035999329,10cyclictest81rcu_preempt23:29:041
2035999324,15cyclictest4990-21ls23:10:001
2035999321,18cyclictest27962-21sh21:42:261
20359993210,18cyclictest0-21swapper/123:21:351
2035899324,4cyclictest81rcu_preempt21:10:220
20358993224,5cyclictest7023-21tune2fs23:50:150
2035899322,14cyclictest21063-21ssh23:28:530
2035899322,10cyclictest10494-21ssh22:37:460
2035899321,9cyclictest25713-21ssh00:11:420
20358993213,6cyclictest22235-21ssh21:36:090
2035899321,19cyclictest28765-21ntp_states22:20:250
20358993210,6cyclictest13752-21users22:40:290
20359993121,5cyclictest13159-21grep22:40:231
2035999311,4cyclictest81rcu_preempt20:25:181
2035999311,4cyclictest81rcu_preempt00:50:161
2035999311,17cyclictest26914-21ssh23:35:091
2035999310,4cyclictest81rcu_preempt22:06:051
2035899313,4cyclictest81rcu_preempt23:16:110
20358993120,6cyclictest31549-21/usr/sbin/munin19:50:260
20358993112,6cyclictest6672-21ssh21:54:260
2035899311,19cyclictest32756-21ssh23:41:360
20358993111,7cyclictest17312-21/usr/sbin/munin20:40:150
148122311,9sleep10-21swapper/120:33:331
2035999309,13cyclictest22-21ksoftirqd/122:20:571
2035999305,4cyclictest81rcu_preempt00:44:301
2035999304,22cyclictest0-21swapper/100:10:151
2035999303,6cyclictest21011-21sh00:45:021
2035999301,14cyclictest0-21swapper/120:14:551
20359993010,16cyclictest241422chrt20:57:451
2035899304,4cyclictest81rcu_preempt23:07:490
20358993021,6cyclictest25533-21ssh22:17:080
20358993021,5cyclictest8506-21latency_hist22:35:000
2035899302,15cyclictest31173-21ssh23:01:170
2035899302,14cyclictest25139-21iostat21:00:190
20358993011,6cyclictest27536-21runrttasks22:58:030
20358993011,5cyclictest28955-21diskstats19:45:140
2035899301,15cyclictest21854-21taskset22:12:000
2035899301,13cyclictest0-21swapper/021:56:350
2035999296,12cyclictest0-21swapper/121:35:481
2035999294,16cyclictest0-21swapper/121:51:471
2035999293,22cyclictest0-21swapper/123:32:331
2035999293,22cyclictest0-21swapper/123:00:411
2035999292,4cyclictest81rcu_preempt00:38:321
2035999291,5cyclictest81rcu_preempt21:09:281
2035999291,4cyclictest81rcu_preempt00:19:401
2035899296,11cyclictest23774-21wc20:55:280
2035899292,14cyclictest18159-21ssh00:40:540
20358992912,5cyclictest14070-21ntp_states20:30:230
130742291,5sleep00-21swapper/020:30:000
265642281,5sleep10-21swapper/119:39:401
265642281,5sleep10-21swapper/119:39:391
20359992815,10cyclictest22-21ksoftirqd/121:00:111
2035999281,23cyclictest0-21swapper/123:57:191
2035999281,15cyclictest2225-21dbus-daemon22:47:181
2035899288,5cyclictest19301-21fschecks_time20:45:160
2035899282,14cyclictest6249-21/usr/sbin/munin20:10:190
2035899282,13cyclictest7071-21ssh00:29:050
2035899282,13cyclictest10181-21memory20:20:210
2035899281,4cyclictest81rcu_preempt19:39:500
2035899281,4cyclictest81rcu_preempt19:39:500
2035899281,23cyclictest15595-21fschecks_time20:35:180
13022281,5sleep10-21swapper/119:56:151
2035999276,18cyclictest0-21swapper/100:31:031
20359992719,4cyclictest29711-21switchtime19:45:271
20359992716,8cyclictest22-21ksoftirqd/120:35:131
2035999271,4cyclictest81rcu_preempt20:15:331
2035999271,14cyclictest30583-21wget21:45:181
2035999271,14cyclictest20323-21ssh00:05:511
2035999271,13cyclictest40250irq/92-i91520:50:281
2035899275,4cyclictest81rcu_preempt23:47:060
2035999254,7cyclictest3207-21ntpd20:20:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional