You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 23:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Thu Apr 02, 2026 12:59:03)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114799911331124,6cyclictest0-21swapper/107:25:561
114789910721049,10cyclictest0-21swapper/007:25:490
109722562517,30sleep00-21swapper/007:20:150
112552463417,32sleep10-21swapper/107:23:161
1426721630,2sleep014266-21sh12:29:300
1259721090,7sleep01147899cyclictest09:40:230
207662900,7sleep11147999cyclictest09:15:261
323892850,9sleep11147999cyclictest12:14:591
106292830,4sleep041ktimersoftd/010:11:320
258472590,9sleep11147999cyclictest11:00:281
238232580,8sleep01147899cyclictest08:05:250
68632540,31sleep10-21swapper/110:40:461
130952480,6sleep01147899cyclictest11:55:010
202812470,7sleep11147999cyclictest10:55:161
11478994621,10cyclictest3-21ksoftirqd/010:42:340
11478994524,4cyclictest3-21ksoftirqd/012:45:130
11478994425,4cyclictest3-21ksoftirqd/012:35:070
11478994222,5cyclictest3-21ksoftirqd/011:38:330
11478994221,5cyclictest3-21ksoftirqd/009:39:410
11478994124,6cyclictest3-21ksoftirqd/011:59:440
11478994121,5cyclictest3-21ksoftirqd/012:01:110
11478994121,5cyclictest3-21ksoftirqd/011:09:100
1147899404,30cyclictest13986-21iostat_ios10:15:200
11478994024,5cyclictest3-21ksoftirqd/010:53:120
11478994020,5cyclictest3-21ksoftirqd/010:57:440
1147999393,33cyclictest0-21swapper/109:24:161
11478993922,6cyclictest3-21ksoftirqd/012:30:060
11478993922,5cyclictest3-21ksoftirqd/012:21:050
11478993824,5cyclictest3-21ksoftirqd/011:10:190
11478993822,5cyclictest3-21ksoftirqd/010:30:160
11478993822,5cyclictest3-21ksoftirqd/009:18:350
11478993820,8cyclictest3-21ksoftirqd/011:17:120
11478993818,8cyclictest3-21ksoftirqd/012:09:110
11478993818,5cyclictest3-21ksoftirqd/011:42:250
11478993813,15cyclictest3-21ksoftirqd/012:12:190
1147999373,30cyclictest0-21swapper/110:17:351
11478993722,5cyclictest3-21ksoftirqd/010:02:330
11478993722,4cyclictest3-21ksoftirqd/009:48:290
11478993720,6cyclictest3-21ksoftirqd/008:20:580
1147999364,4cyclictest81rcu_preempt11:09:231
11479993615,9cyclictest22-21ksoftirqd/112:39:571
1147899367,13cyclictest30497-21gdbus08:53:050
1147899366,4cyclictest81rcu_preempt11:45:270
1147899363,27cyclictest9331-21diskstats08:55:150
11478993622,4cyclictest3-21ksoftirqd/010:38:260
1147899362,19cyclictest18940-21memory10:20:210
11478993621,5cyclictest3-21ksoftirqd/010:45:090
11478993614,5cyclictest21723-21fschecks_count09:50:140
1147999356,25cyclictest25876-21cat09:54:551
11479993526,5cyclictest23634-21/usr/sbin/munin12:05:201
1147999352,30cyclictest0-21swapper/109:11:361
1147999351,5cyclictest20205-21kworker/1:109:31:361
1147899354,4cyclictest81rcu_preempt12:18:410
1147899354,4cyclictest81rcu_preempt09:29:240
11478993521,4cyclictest3-21ksoftirqd/010:05:410
11478993520,6cyclictest3-21ksoftirqd/008:15:010
11478993520,5cyclictest3-21ksoftirqd/009:32:420
1147899351,7cyclictest13360-21sh11:20:450
11478993516,5cyclictest3-21ksoftirqd/009:14:200
1147899351,5cyclictest8498-21kworker/0:109:21:160
11478993515,5cyclictest3-21ksoftirqd/009:57:380
1147999345,26cyclictest22-21ksoftirqd/112:33:061
1147999344,5cyclictest81rcu_preempt12:45:111
11479993425,5cyclictest13419-21ssh09:40:551
1147999342,10cyclictest81rcu_preempt10:52:231
1147999341,4cyclictest81rcu_preempt10:13:071
1147999341,4cyclictest81rcu_preempt09:57:501
1147999341,29cyclictest12525-21ssh10:46:561
11479993412,6cyclictest327212sh11:40:451
1147899347,6cyclictest3-21ksoftirqd/011:30:170
11478993413,6cyclictest18175-21ntp_states07:45:220
11478993413,4cyclictest1469-21df12:50:100
305822330,10sleep11147999cyclictest08:25:171
156282331,3sleep10-21swapper/111:56:481
126422331,28sleep012656-21ls09:05:000
1147999339,20cyclictest0-21swapper/112:28:071
1147999333,4cyclictest81rcu_preempt12:23:401
1147999331,4cyclictest81rcu_preempt12:19:521
11479993314,15cyclictest24718-21df08:10:131
1147999331,18cyclictest27429-21/usr/sbin/munin08:15:271
1147999330,4cyclictest81rcu_preempt08:33:211
11478993317,6cyclictest3-21ksoftirqd/012:41:390
11478993317,6cyclictest3-21ksoftirqd/008:30:430
11478993317,5cyclictest3-21ksoftirqd/007:59:110
11478993316,6cyclictest3-21ksoftirqd/008:14:120
1147899331,30cyclictest0-21swapper/011:00:350
1147899331,29cyclictest27055-21ssh10:29:160
220392321,27sleep02403-21irqbalance08:01:150
197602321,4sleep119776-21ssh11:28:011
1147999326,4cyclictest40550irq/92-i91507:50:001
1147999324,4cyclictest81rcu_preempt12:01:131
1147999324,4cyclictest81rcu_preempt11:14:201
1147999323,5cyclictest81rcu_preempt10:00:261
1147999323,4cyclictest81rcu_preempt11:48:301
1147999323,4cyclictest81rcu_preempt11:16:181
1147999322,10cyclictest0-21swapper/108:40:111
1147999322,10cyclictest0-21swapper/108:40:101
1147999321,4cyclictest81rcu_preempt10:05:091
1147999321,28cyclictest0-21swapper/107:35:561
11479993211,13cyclictest22-21ksoftirqd/110:38:061
11478993217,4cyclictest3-21ksoftirqd/007:34:280
1147899321,5cyclictest0-21swapper/008:25:360
165422311,5sleep00-21swapper/011:25:090
1147999317,4cyclictest81rcu_preempt10:34:171
1147999316,12cyclictest40550irq/92-i91509:45:141
1147999314,4cyclictest81rcu_preempt08:50:341
1147999313,4cyclictest81rcu_preempt12:50:291
1147999313,15cyclictest0-21swapper/111:34:111
11479993122,5cyclictest0-21swapper/112:42:161
1147999311,4cyclictest81rcu_preempt10:23:551
11479993113,5cyclictest27289-21processes11:35:261
11478993116,6cyclictest3-21ksoftirqd/007:41:110
106972311,9sleep10-21swapper/108:59:321
68592301,5sleep00-21swapper/008:48:390
315812301,5sleep10-21swapper/109:26:301
143602301,5sleep10-21swapper/111:22:121
1147999307,4cyclictest81rcu_preempt07:40:061
1147999303,4cyclictest81rcu_preempt09:07:401
11479993023,3cyclictest0-21swapper/109:36:561
1147899301,27cyclictest0-21swapper/008:44:160
1147899301,27cyclictest0-21swapper/008:44:150
295252291,5sleep10-21swapper/108:20:581
216712291,5sleep10-21swapper/107:59:111
198642291,5sleep00-21swapper/007:54:560
194712291,5sleep10-21swapper/107:50:511
1147999295,4cyclictest81rcu_preempt08:47:131
1147999294,9cyclictest11226-21diskstats09:00:141
1147999294,5cyclictest81rcu_preempt10:27:031
1147999291,4cyclictest81rcu_preempt08:36:341
11478992914,5cyclictest3-21ksoftirqd/009:05:300
11478992912,6cyclictest3-21ksoftirqd/007:39:000
98602281,5sleep10-21swapper/111:50:291
1147999281,4cyclictest81rcu_preempt08:02:191
11478992810,5cyclictest2037-21latency08:35:210
1147999271,4cyclictest81rcu_preempt08:06:581
1147999261,4cyclictest81rcu_preempt07:31:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional