You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 03:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Thu Jul 16, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9859912741,5cyclictest30074-21latency_hist20:40:011
9859911381108,26cyclictest0-21swapper/119:25:561
8452563516,31sleep00-21swapper/019:24:050
5932563518,29sleep10-21swapper/119:21:271
98499207198,6cyclictest0-21swapper/020:40:010
2225021640,8sleep198599cyclictest00:35:241
984999066,19cyclictest0-21swapper/019:25:550
110772501,37sleep011128-21if_err_eth022:40:170
985994020,9cyclictest22-21ksoftirqd/120:00:011
6432380,4sleep0111rcuc/023:40:000
192842371,32sleep018451-21/usr/sbin/munin21:35:270
98599366,26cyclictest0-21swapper/100:20:281
88702361,31sleep18882-21munin-run21:10:011
98499352,20cyclictest26801-21ntp_states21:55:250
98499352,20cyclictest26801-21ntp_states21:55:250
98499352,16cyclictest11481-21users00:05:310
98599341,14cyclictest126922cstates22:45:121
196202341,5sleep111565-21gdbus23:02:571
984993313,7cyclictest0-21swapper/020:55:130
98599321,4cyclictest81rcu_preempt22:43:461
98499327,13cyclictest11565-21gdbus21:18:410
98499321,14cyclictest15428-21runrttasks00:17:210
5432321,4sleep1661-21sort20:45:301
98599314,4cyclictest81rcu_preempt22:58:211
98499313,21cyclictest5584-21python23:50:280
98499313,16cyclictest0-21swapper/000:44:350
98499311,21cyclictest0-21swapper/020:01:580
984993111,6cyclictest1637-21iostat22:15:190
186072311,5sleep10-21swapper/120:09:421
98599306,10cyclictest0-21swapper/120:59:091
98599305,3cyclictest81rcu_preempt19:38:011
98599304,4cyclictest81rcu_preempt23:30:511
98599304,4cyclictest81rcu_preempt21:33:231
98599304,19cyclictest1295-21iostat_ios23:40:201
98599301,4cyclictest81rcu_preempt00:00:111
985993014,5cyclictest27528-21grep20:30:281
98499308,6cyclictest192892chrt00:28:160
98499302,23cyclictest27768-21iostat00:50:190
98499302,14cyclictest17148-21tr20:05:130
98499302,13cyclictest8939-21iostat_ios00:00:190
98499301,4cyclictest81rcu_preempt20:54:120
984993012,13cyclictest12928-21ntpq00:10:260
984993012,13cyclictest12928-21ntpq00:10:260
984993011,6cyclictest30757-21python22:05:270
98499301,16cyclictest27840-21seq20:32:590
984993010,6cyclictest23522-21fgrep20:20:270
50442301,5sleep10-21swapper/119:30:341
287122301,5sleep10-21swapper/100:53:091
27052301,4sleep10-21swapper/122:19:031
98599295,4cyclictest81rcu_preempt22:22:571
98599295,3cyclictest81rcu_preempt21:25:271
98599293,4cyclictest81rcu_preempt21:16:451
98599293,4cyclictest81rcu_preempt21:13:501
98599292,5cyclictest40250irq/92-i91521:45:231
98599291,4cyclictest81rcu_preempt21:55:261
98599291,4cyclictest81rcu_preempt21:55:261
98599291,4cyclictest81rcu_preempt00:44:231
98599291,4cyclictest81rcu_preempt00:15:251
98599291,25cyclictest111-21usb-storage20:10:191
98499299,7cyclictest21901-21runrttasks21:43:250
98499297,4cyclictest0-21swapper/023:00:280
98499291,4cyclictest81rcu_preempt22:25:520
98499291,4cyclictest81rcu_preempt19:59:060
984992914,11cyclictest22297-21cut21:45:110
984992913,5cyclictest0-21swapper/022:55:280
984992912,5cyclictest28730-21/usr/sbin/munin22:00:250
98499291,18cyclictest14203-21taskset21:21:320
98499291,11cyclictest1294-21latency_hist20:50:000
84332291,5sleep10-21swapper/122:34:051
83572291,5sleep00-21swapper/022:33:190
81182291,5sleep10-21swapper/123:59:401
51442291,5sleep00-21swapper/019:31:350
299112291,5sleep00-21swapper/023:30:190
260182291,5sleep00-21swapper/020:28:310
231752291,5sleep00-21swapper/000:39:450
222262291,5sleep00-21swapper/020:18:160
190302291,5sleep10-21swapper/100:25:371
126592291,5sleep10-21swapper/119:51:311
100592291,5sleep00-21swapper/022:36:290
98599286,12cyclictest40250irq/92-i91520:00:121
98599284,3cyclictest81rcu_preempt22:53:411
98599283,4cyclictest81rcu_preempt22:01:581
98599283,4cyclictest81rcu_preempt21:01:511
98599281,4cyclictest81rcu_preempt21:36:191
98599281,4cyclictest81rcu_preempt20:29:101
98599281,4cyclictest81rcu_preempt19:41:061
98499285,5cyclictest0-21swapper/021:52:330
98499284,3cyclictest0-21swapper/020:10:360
98499282,14cyclictest0-21swapper/023:10:410
98499282,13cyclictest11565-21gdbus19:46:130
98499281,6cyclictest21209-21grep23:05:290
98499281,4cyclictest81rcu_preempt22:45:530
98499281,18cyclictest0-21swapper/000:30:040
98499281,14cyclictest32634-21python22:10:280
61622281,5sleep10-21swapper/123:53:481
4692281,5sleep10-21swapper/122:10:531
41082281,5sleep10-21swapper/123:46:561
326832281,5sleep10-21swapper/123:37:031
314102281,5sleep10-21swapper/120:40:531
291842281,5sleep00-21swapper/023:29:430
288892281,5sleep10-21swapper/123:26:371
220402281,5sleep10-21swapper/120:16:221
173042281,5sleep00-21swapper/000:22:080
160382281,4sleep00-21swapper/021:26:080
141632281,5sleep10-21swapper/121:21:091
98599274,4cyclictest81rcu_preempt23:12:171
98599274,4cyclictest81rcu_preempt00:09:481
98599273,4cyclictest81rcu_preempt00:34:031
98599273,18cyclictest12697-21iostat_ios00:10:211
98599273,18cyclictest12697-21iostat_ios00:10:211
98599272,8cyclictest3286-21runrttasks00:47:061
98599272,4cyclictest81rcu_preempt23:17:441
98499279,5cyclictest10332-21taskset21:10:360
98499274,8cyclictest24029-21diskstats23:15:150
98499272,12cyclictest8725-21taskset21:08:280
98499271,13cyclictest6645-21mailstats19:35:280
98499271,13cyclictest30696-21irqstats20:40:200
984992711,13cyclictest3-21ksoftirqd/019:53:190
984992710,5cyclictest17990-21taskset21:31:570
89522271,5sleep00-21swapper/019:42:010
270162271,5sleep10-21swapper/123:21:391
20882271,5sleep00-21swapper/023:41:310
98599264,4cyclictest81rcu_preempt19:47:141
98599263,3cyclictest81rcu_preempt23:05:521
98599262,20cyclictest0-21swapper/121:50:201
98599261,4cyclictest81rcu_preempt22:37:471
98599261,4cyclictest81rcu_preempt22:28:061
98599261,10cyclictest23531-21sendmail_mailst20:20:261
98499261,4cyclictest81rcu_preempt00:48:470
98499261,14cyclictest0-21swapper/023:20:420
984992611,4cyclictest0-21swapper/022:50:150
98499261,13cyclictest5601-21fschecks_count21:00:140
312562261,5sleep10-21swapper/122:07:581
27172261,4sleep10-21swapper/120:50:341
985992517,5cyclictest20426-21aten_r4power_po21:40:121
98499258,4cyclictest3699-21cat22:20:200
98499252,17cyclictest6726-21df23:55:110
98499241,15cyclictest0-21swapper/023:45:480
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional