You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 04:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Tue Aug 18, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223159912321208,21cyclictest30966-21fschecks_count19:45:151
203912598516,66sleep00-21swapper/019:20:000
222442466422,29sleep10-21swapper/119:24:501
22314992511,232cyclictest30967-21fschecks_count19:45:150
41552770,11sleep02231499cyclictest22:50:280
97412740,3sleep09746-21sort20:15:130
266932740,5sleep12231599cyclictest22:25:191
22315994024,5cyclictest22-21ksoftirqd/120:39:391
22315994023,6cyclictest22-21ksoftirqd/123:51:311
22315993922,6cyclictest22-21ksoftirqd/121:18:021
22315993822,5cyclictest22-21ksoftirqd/121:32:311
22315993822,5cyclictest22-21ksoftirqd/120:00:201
22315993722,6cyclictest22-21ksoftirqd/123:41:461
22315993721,6cyclictest22-21ksoftirqd/122:58:451
22315993721,6cyclictest22-21ksoftirqd/120:27:221
2231499376,5cyclictest81rcu_preempt00:45:160
2231499371,13cyclictest0-21swapper/019:25:180
22315993619,6cyclictest22-21ksoftirqd/100:09:491
22315993618,6cyclictest22-21ksoftirqd/121:29:141
22315993520,6cyclictest22-21ksoftirqd/119:56:241
22315993520,5cyclictest22-21ksoftirqd/120:50:011
22315993518,6cyclictest22-21ksoftirqd/123:47:481
22315993513,4cyclictest40250irq/92-i91520:20:151
22314993516,13cyclictest3-21ksoftirqd/023:30:330
192122351,3sleep119269-21sh20:40:141
2231599343,20cyclictest0-21swapper/121:55:271
22315993420,5cyclictest22-21ksoftirqd/121:23:481
22315993418,6cyclictest22-21ksoftirqd/121:13:131
2231499344,4cyclictest81rcu_preempt00:25:310
2231499341,8cyclictest0-21swapper/020:40:500
26082330,5sleep0111rcuc/021:20:280
22315993319,5cyclictest22-21ksoftirqd/119:30:531
22315993318,5cyclictest22-21ksoftirqd/123:35:091
22315993317,6cyclictest22-21ksoftirqd/100:10:031
22315993317,5cyclictest22-21ksoftirqd/122:50:091
22315993316,6cyclictest22-21ksoftirqd/122:34:201
2231599331,22cyclictest9223-21fschecks_count23:05:151
2231499331,13cyclictest105022chrt23:09:130
2231599329,12cyclictest24292-21/usr/sbin/munin22:20:201
2231599328,8cyclictest0-21swapper/120:31:001
2231599323,4cyclictest81rcu_preempt23:22:461
22315993217,6cyclictest22-21ksoftirqd/120:59:301
22315993217,5cyclictest22-21ksoftirqd/123:27:201
22315993217,5cyclictest22-21ksoftirqd/119:52:241
22314993213,6cyclictest29772-21munin-run22:34:590
2231499321,19cyclictest28502-21sshd19:39:230
69142311,4sleep011565-21gdbus21:32:220
2231599318,7cyclictest22-21ksoftirqd/100:45:161
22315993117,8cyclictest27115-21iostat_ios21:00:221
22315993117,5cyclictest22-21ksoftirqd/120:47:451
22315993116,5cyclictest22-21ksoftirqd/121:09:231
22315993116,4cyclictest22-21ksoftirqd/100:19:441
22315993115,5cyclictest22-21ksoftirqd/122:37:591
2231499312,4cyclictest81rcu_preempt00:40:500
2231499311,8cyclictest0-21swapper/021:10:260
22314993112,6cyclictest27336-21/usr/sbin/munin22:25:300
2231499311,16cyclictest12184-21chrt20:20:230
2231499311,13cyclictest6517-21missed_timers20:05:220
101842311,5sleep10-21swapper/100:34:451
22315993017,7cyclictest6403-21iostat_ios20:05:201
22315993014,5cyclictest22-21ksoftirqd/120:15:511
2231499303,14cyclictest22123-21users20:45:300
2231499302,21cyclictest5352-21irqstats00:20:220
2231499302,16cyclictest29234-21perl19:40:160
2231499302,14cyclictest30584-21python00:00:290
2231499302,14cyclictest30584-21python00:00:280
2231499301,4cyclictest81rcu_preempt00:50:240
2231499301,4cyclictest81rcu_preempt00:13:410
22314993012,5cyclictest13768-21/usr/sbin/munin21:50:220
2231499301,18cyclictest10644-21runrttasks21:41:570
109502300,8sleep12231599cyclictest21:45:001
84932291,5sleep00-21swapper/000:30:060
48692291,5sleep00-21swapper/021:25:380
257462291,5sleep00-21swapper/022:22:210
239202291,5sleep00-21swapper/022:18:050
2231599298,12cyclictest22312-21cyclictest00:28:571
2231599295,12cyclictest40250irq/92-i91519:40:271
2231599293,19cyclictest18924-21diskstats22:05:151
2231599291,8cyclictest13196-21cpuspeed_turbos21:50:111
22315992915,5cyclictest22-21ksoftirqd/123:33:201
22315992915,4cyclictest22-21ksoftirqd/119:37:431
22315992913,6cyclictest22-21ksoftirqd/100:20:041
2231499293,4cyclictest81rcu_preempt20:34:190
2231499293,18cyclictest0-21swapper/023:42:340
2231499293,14cyclictest0-21swapper/023:54:240
2231499292,4cyclictest81rcu_preempt21:15:140
22314992921,5cyclictest128952sleep023:15:110
22314992921,5cyclictest128952sleep023:15:110
2231499292,14cyclictest633-21iostat_ios19:50:190
2231499292,14cyclictest31913-21perl00:05:190
2231499292,14cyclictest23929-21sed20:50:310
2231499292,13cyclictest25272-21diskstats19:30:140
22314992911,5cyclictest8352-21ls20:10:230
2231499291,15cyclictest13365-21wget20:25:130
2231499291,14cyclictest7302-21/usr/sbin/munin23:00:160
2231499291,13cyclictest27117-21sshd21:00:230
22314992910,14cyclictest66652chrt22:58:320
219262291,5sleep10-21swapper/122:12:001
186192291,5sleep00-21swapper/022:05:060
8682281,5sleep10-21swapper/122:43:021
86232281,5sleep10-21swapper/121:35:391
7502281,5sleep00-21swapper/022:41:490
27442281,5sleep00-21swapper/022:47:370
238812281,5sleep10-21swapper/122:17:421
2231599284,8cyclictest22855-21fschecks_time19:25:171
2231599284,17cyclictest11063-21memory00:35:221
22315992813,5cyclictest22-21ksoftirqd/100:00:121
22315992813,5cyclictest22-21ksoftirqd/100:00:121
2231599281,13cyclictest2040-21grep22:45:231
2231599281,12cyclictest28633-21awk23:55:281
2231499289,11cyclictest0-21swapper/023:48:060
2231499282,14cyclictest10664-21df_inode00:35:140
2231499282,13cyclictest2541-21iostat19:55:190
2231499282,13cyclictest16988-21iostat_ios23:25:210
2231499282,13cyclictest15780-21users23:20:300
2231499281,4cyclictest81rcu_preempt21:55:290
2231499281,4cyclictest81rcu_preempt20:59:170
2231499281,14cyclictest28073-21sort23:55:160
2231499281,13cyclictest28544-21/usr/sbin/munin21:05:130
2231499280,4cyclictest81rcu_preempt21:48:290
2231499280,4cyclictest81rcu_preempt21:48:290
182042281,5sleep10-21swapper/122:02:201
121952281,5sleep10-21swapper/123:12:191
55992271,5sleep00-21swapper/020:04:350
2231599275,4cyclictest81rcu_preempt20:14:131
2231599273,3cyclictest81rcu_preempt00:44:481
2231599271,8cyclictest7319-21fschecks_count23:00:161
2231599271,8cyclictest3286-21runrttasks21:49:511
2231599271,8cyclictest3286-21runrttasks21:49:501
2231499272,4cyclictest81rcu_preempt22:12:230
2231499272,13cyclictest11231-21hddtemp_smartct23:10:180
2231499271,4cyclictest81rcu_preempt22:03:190
2231499271,18cyclictest0-21swapper/022:36:150
2231499271,14cyclictest2779-21aten_r4power_cu00:15:100
2231499271,13cyclictest18129-21ls20:35:280
215072271,5sleep00-21swapper/023:36:240
140932271,5sleep10-21swapper/123:17:321
140932271,5sleep10-21swapper/123:17:321
2231599263,5cyclictest16068-21/usr/sbin/munin00:50:281
2231499264,3cyclictest81rcu_preempt21:35:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional