You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 13:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sun Mar 15, 2026 00:59:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292019912501241,6cyclictest0-21swapper/119:26:551
292009911391111,25cyclictest0-21swapper/019:26:290
274362599516,68sleep00-21swapper/019:20:110
290412561516,31sleep10-21swapper/119:23:551
2147521210,4sleep1211ktimersoftd/123:40:211
214032980,9sleep12920199cyclictest23:06:271
214162560,7sleep02920099cyclictest00:47:310
2920199522,15cyclictest10885-21basename20:00:101
2920199521,17cyclictest12726-21grep21:50:291
2920199521,16cyclictest7614-21latency_hist00:00:001
2920199520,16cyclictest1764-21cat21:40:111
2920199520,16cyclictest1764-21cat21:40:101
175932520,23sleep03-21ksoftirqd/023:02:560
2920199511,14cyclictest20946-21head21:25:301
2920199510,16cyclictest25606-21taskset20:39:111
2920199510,16cyclictest22404-21aten_r4power_vo00:15:121
2920199510,16cyclictest1764-21taskset23:53:521
2920199501,7cyclictest29677-21iostat_ios23:15:241
2920199500,15cyclictest11153-21taskset21:15:301
2920199491,20cyclictest20449-21ssh22:32:191
2920199491,16cyclictest19231-21taskset21:24:581
2920199491,16cyclictest14958-21uname00:40:221
2920199491,15cyclictest27680-21rm23:46:241
2920199491,14cyclictest10145-21sh00:01:471
2920199490,16cyclictest24791-21ssh22:03:501
2920199490,16cyclictest19279-21ssh23:38:151
2920199490,15cyclictest30288-21taskset22:42:321
2920199490,15cyclictest27402-21cstates00:20:131
2920199490,15cyclictest10744-21rm00:35:301
2920199490,14cyclictest9129-21runrttasks21:14:251
2920199481,15cyclictest18220-21sh23:03:491
2920199481,14cyclictest23356-21tr00:50:111
2920199480,16cyclictest1504-21ssh22:45:491
2920199480,15cyclictest8739-21iostat22:20:181
2920199480,15cyclictest31492-21grep19:30:021
2920199480,14cyclictest23764-21smartctl22:35:281
2920199471,15cyclictest1754-21ssh22:13:271
2920199471,13cyclictest9658-21ssh21:47:561
2920199470,17cyclictest6254-21sh23:25:061
2920199470,16cyclictest14813-21ssh00:06:321
2920199470,16cyclictest14813-21ssh00:06:311
2920199470,15cyclictest32555-21ssh21:38:161
2920199470,15cyclictest28457-21sh21:34:211
2920199470,15cyclictest19274-21sh00:11:001
2920199470,14cyclictest16245-21chrt20:14:361
2920199468,12cyclictest11891-21ssh22:56:421
2920199460,17cyclictest3451-21ssh23:21:141
2920199460,15cyclictest22545-21rm00:49:241
2920199451,15cyclictest19331-21ssh21:57:561
2920199450,15cyclictest15017-21sh23:34:041
57432440,8sleep12920199cyclictest22:50:261
2920199441,15cyclictest2237-21rm00:27:191
2920199440,15cyclictest4433-21ssh00:30:081
2920199440,15cyclictest26188-21ssh23:11:221
2920199430,14cyclictest16208-21ssh22:28:111
321542420,4sleep0111rcuc/019:30:150
2920199421,18cyclictest2645-21snmpd20:50:171
2920199420,14cyclictest4208-21ntp_states22:15:271
2920199420,14cyclictest4208-21ntp_states22:15:271
2920199420,14cyclictest30127-21sh22:09:331
2920199411,9cyclictest0-21swapper/121:05:221
2920199411,9cyclictest0-21swapper/120:25:121
2920199411,9cyclictest0-21swapper/120:25:111
2920199403,11cyclictest0-21swapper/120:45:151
2920199401,9cyclictest0-21swapper/120:15:241
2920199401,8cyclictest0-21swapper/119:55:191
2920099401,14cyclictest10032sh23:52:460
2920199393,14cyclictest23071-21mailstats20:30:281
2920199391,8cyclictest0-21swapper/120:55:261
2920199391,8cyclictest0-21swapper/120:20:251
2920199390,16cyclictest26185-21fschecks_count20:40:151
2920099391,7cyclictest7484-21ntp_states21:45:250
2920099391,3cyclictest81rcu_preempt23:19:270
2920199375,6cyclictest22-21ksoftirqd/119:37:461
2920199370,13cyclictest13231-21ls20:05:161
29200993716,8cyclictest0-21swapper/021:40:270
29200993716,8cyclictest0-21swapper/021:40:260
2920099371,21cyclictest4270-21grep22:15:290
2920099371,21cyclictest4270-21grep22:15:280
2920199363,13cyclictest5690-21hwlatdetect19:45:181
2920099364,4cyclictest81rcu_preempt00:44:010
2920099364,3cyclictest81rcu_preempt22:05:350
2920099363,29cyclictest0-21swapper/000:19:150
2920099362,15cyclictest5089-21ssh22:50:140
2920099361,15cyclictest8747-21ssh22:20:180
294862351,28sleep04661-21diskmemload00:21:490
2920199352,8cyclictest4864-21taskset19:43:281
2920199351,12cyclictest7241-21grep19:50:111
2920099354,4cyclictest81rcu_preempt23:27:350
2920099352,23cyclictest0-21swapper/000:07:390
2920099352,23cyclictest0-21swapper/000:07:380
2920099351,6cyclictest2403-21irqbalance21:11:150
73082341,4sleep07319-21ssh00:32:320
39952341,29sleep02329-21NetworkManager23:22:030
319822340,7sleep02920099cyclictest21:37:260
2920199341,17cyclictest0-21swapper/121:02:141
29200993426,5cyclictest13414-21cat20:05:210
2920099342,5cyclictest81rcu_preempt00:52:370
2920099341,4cyclictest17717-21ssh22:30:100
29200993410,4cyclictest81rcu_preempt23:46:550
203832342,28sleep00-21swapper/021:59:300
111602341,4sleep011171-21sh22:55:380
2920099334,4cyclictest81rcu_preempt23:10:490
2920099334,4cyclictest81rcu_preempt22:11:580
2920099334,4cyclictest81rcu_preempt22:01:240
2920099334,4cyclictest81rcu_preempt21:27:240
2920099333,4cyclictest81rcu_preempt22:36:060
2920099333,4cyclictest81rcu_preempt22:26:010
2920099333,4cyclictest81rcu_preempt00:28:140
2920099332,28cyclictest0-21swapper/000:39:160
2920099331,5cyclictest2403-21irqbalance00:12:360
2920099331,5cyclictest16355-21sh21:20:490
29200993314,6cyclictest27599-21turbostat20:44:590
2920099331,29cyclictest0-21swapper/020:21:360
121312330,3sleep00-21swapper/023:30:260
2920099326,4cyclictest81rcu_preempt20:55:110
2920099323,4cyclictest81rcu_preempt23:55:240
2920099323,4cyclictest81rcu_preempt22:46:050
2920099322,4cyclictest81rcu_preempt23:06:430
2920099321,9cyclictest11727-21grep21:50:140
2920099321,4cyclictest81rcu_preempt20:28:130
2920099321,4cyclictest81rcu_preempt20:28:130
2920099321,4cyclictest81rcu_preempt19:59:320
29200993213,15cyclictest3-21ksoftirqd/021:16:180
2920099321,13cyclictest0-21swapper/023:39:270
29200993210,9cyclictest21732-21ntp_states23:40:250
2920099314,12cyclictest23068-21mailstats20:30:280
2920099312,19cyclictest0-21swapper/020:11:170
2920099311,4cyclictest81rcu_preempt21:01:330
2920099311,19cyclictest17879-21taskset20:17:010
2920099306,4cyclictest81rcu_preempt22:41:250
2920099303,4cyclictest81rcu_preempt00:00:400
2920099302,4cyclictest81rcu_preempt21:31:280
2920099301,18cyclictest5694-21/usr/sbin/munin19:45:180
2920099297,11cyclictest30497-21gdbus20:47:280
2920099292,14cyclictest3209-21df_inode21:05:130
2920099292,13cyclictest2313-21python19:35:270
2920099291,4cyclictest81rcu_preempt20:04:120
2920099282,4cyclictest81rcu_preempt20:54:350
2920099281,4cyclictest81rcu_preempt19:40:110
2920099271,12cyclictest7648-21iostat_ios19:50:190
256032271,5sleep00-21swapper/020:39:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional