You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 04:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Sun Apr 19, 2026 00:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
149899912301193,27cyclictest0-21swapper/019:25:060
149909911921183,6cyclictest0-21swapper/119:25:071
149909911891175,11cyclictest211ktimersoftd/119:40:151
141552859782,61sleep00-21swapper/019:20:270
147782596547,37sleep10-21swapper/119:23:191
1498999143137,3cyclictest0-21swapper/019:40:160
3265821000,2sleep00-21swapper/021:20:010
79452700,8sleep11499099cyclictest23:40:291
277832700,2sleep127776-21needreboot19:55:221
157032610,8sleep10-21swapper/123:15:241
156402600,22sleep03-21ksoftirqd/000:22:130
253902580,7sleep01498999cyclictest23:25:230
63102530,7sleep01498999cyclictest23:40:000
164922520,2sleep016493-21rm21:35:360
95442510,8sleep01498999cyclictest23:09:520
69132450,8sleep01498999cyclictest23:40:140
272012440,4sleep027205-21wc00:00:290
1499099422,10cyclictest0-21swapper/100:14:061
14990994213,7cyclictest3286-21runrttasks22:52:271
1498999423,24cyclictest4716-21iostat_ios20:20:180
14989994017,8cyclictest27870-21ntp_states19:55:230
241022380,7sleep01498999cyclictest22:50:270
215052380,4sleep0111rcuc/000:28:420
14989993812,7cyclictest25593-21ntp_states21:45:250
31862371,4sleep13197-21sh23:02:401
201412371,32sleep120155-21ssh22:46:261
1499099374,4cyclictest81rcu_preempt23:34:251
1498999379,13cyclictest11565-21gdbus22:29:300
1498999377,14cyclictest28819-21sort00:35:280
159742361,5sleep016001-21munin-run23:50:010
1498999365,6cyclictest224992sh22:15:290
87282350,7sleep01498999cyclictest00:49:510
14990993525,6cyclictest8346-21/usr/sbin/munin00:15:101
1498999351,5cyclictest23122-21cut00:30:170
14989993513,7cyclictest17155-21irqstats22:10:190
170632341,29sleep122779-21diskmemload00:24:191
14990993422,7cyclictest847-21ntp_states00:40:241
1498999342,11cyclictest81rcu_preempt19:46:090
1498999341,21cyclictest20117-21iostat19:35:190
14989993410,11cyclictest0-21swapper/020:55:150
60762331,28sleep16232-21cstates20:25:131
18192331,4sleep02695-21snmpd20:13:420
1499099332,19cyclictest0-21swapper/121:32:201
1499099331,4cyclictest81rcu_preempt21:56:071
1498999336,23cyclictest31104-21df_inode20:05:150
1498999336,23cyclictest31104-21df_inode20:05:140
14989993322,7cyclictest12499-21ssh21:31:520
14989993314,6cyclictest32352-21udevd23:00:000
14989993314,6cyclictest32352-21udevd23:00:000
14989993314,5cyclictest23592-21hddtemp_smartct21:10:170
1498999331,17cyclictest22430-21/usr/sbin/munin23:55:310
14989993310,5cyclictest0-21swapper/023:51:020
12322331,28sleep11243-21ssh22:27:161
277102321,5sleep00-21swapper/022:20:370
227402321,5sleep10-21swapper/123:22:571
199842321,27sleep122779-21diskmemload00:26:311
14990993215,14cyclictest22-21ksoftirqd/122:30:121
14990993214,15cyclictest22-21ksoftirqd/123:52:441
14990993214,15cyclictest22-21ksoftirqd/123:26:201
1499099321,17cyclictest30153-21ssh00:04:291
1498999325,3cyclictest0-21swapper/022:08:320
1498999324,5cyclictest81rcu_preempt00:15:150
1498999324,10cyclictest81rcu_preempt22:31:340
14989993212,6cyclictest14372-21python22:40:270
14989993212,5cyclictest2391-21perl21:55:170
14989993211,7cyclictest6885-21ssh21:25:420
122062321,5sleep10-21swapper/100:53:201
35772311,26sleep03596-21df_inode00:10:140
223992311,27sleep122410-21ssh21:42:091
168922311,26sleep116905-21ssh21:36:131
156652317,10sleep015701-21ntp_states23:15:240
1499099316,21cyclictest0-21swapper/121:49:361
1499099314,23cyclictest0-21swapper/122:59:061
1499099314,23cyclictest0-21swapper/122:59:061
1499099311,4cyclictest81rcu_preempt21:16:451
1499099311,4cyclictest81rcu_preempt00:34:571
14990993114,13cyclictest3286-21runrttasks22:35:201
1499099311,17cyclictest1922-21ssh21:20:421
1498999319,8cyclictest21485-21fschecks_time21:05:170
1498999316,13cyclictest8557-21memory20:30:200
1498999311,8cyclictest23371-21ssh21:43:330
1498999311,4cyclictest81rcu_preempt22:00:280
14989993112,16cyclictest0-21swapper/019:51:050
141322311,26sleep114146-21ssh22:07:011
322022301,5sleep10-21swapper/120:06:411
322022301,5sleep10-21swapper/120:06:401
224982300,3sleep122499-21sh22:15:291
1499099306,21cyclictest0-21swapper/121:12:351
1499099303,23cyclictest0-21swapper/123:05:541
14990993017,11cyclictest22-21ksoftirqd/123:56:021
1499099301,4cyclictest81rcu_preempt22:12:491
14990993011,5cyclictest16361-21sh22:42:561
1498999309,5cyclictest758-21sh23:00:190
1498999307,4cyclictest81rcu_preempt23:11:460
1498999302,4cyclictest81rcu_preempt00:06:140
1498999302,16cyclictest0-21swapper/020:15:160
1498999302,14cyclictest8669-21df_inode22:35:140
14989993012,6cyclictest995-21iostat_ios21:20:200
1498999301,15cyclictest11013-21users20:35:330
1498999301,13cyclictest23586-21taskset23:24:100
14989993010,6cyclictest562-21iostat00:40:190
14989993010,6cyclictest19142-21ssh22:45:270
13392301,5sleep10-21swapper/121:54:421
109162301,4sleep081rcu_preempt00:51:100
303222291,5sleep00-21swapper/020:01:370
208802291,5sleep10-21swapper/121:05:001
1499099295,21cyclictest0-21swapper/122:24:131
1499099292,23cyclictest8958-21cat00:50:011
14990992915,5cyclictest22-21ksoftirqd/123:12:501
14990992915,11cyclictest22-21ksoftirqd/123:49:541
1499099291,23cyclictest6084-21cat21:25:211
1498999292,14cyclictest15691-21df_inode20:50:130
1498999292,13cyclictest0-21swapper/020:25:080
1498999291,15cyclictest29609-21ssh23:30:150
5382281,5sleep10-21swapper/100:06:371
294072281,5sleep00-21swapper/021:50:070
211172281,5sleep10-21swapper/119:38:481
208122281,5sleep00-21swapper/021:04:130
168822281,5sleep10-21swapper/120:52:361
150052281,5sleep00-21swapper/020:47:350
1499099285,3cyclictest81rcu_preempt20:44:051
1499099284,4cyclictest81rcu_preempt20:33:541
1499099284,16cyclictest0-21swapper/120:20:071
1499099283,4cyclictest81rcu_preempt20:10:561
1499099282,4cyclictest81rcu_preempt20:55:051
1499099281,15cyclictest0-21swapper/100:35:161
113972281,4sleep10-21swapper/120:39:221
232932271,5sleep10-21swapper/119:45:091
190822271,5sleep10-21swapper/119:32:061
1499099273,18cyclictest2743-21iostat_ios20:15:191
14990992717,7cyclictest2028-21fschecks_count23:35:161
1499099271,4cyclictest81rcu_preempt22:00:251
1498999279,6cyclictest18150-21sh19:30:180
304272261,5sleep10-21swapper/120:02:421
264752261,4sleep10-21swapper/119:50:501
1499099263,9cyclictest14340-21ntpq20:45:231
1499099261,11cyclictest21495-21fschecks_time21:05:161
14989992513,8cyclictest12461-21ntpdc20:40:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional