You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 09:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Mon Aug 17, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
111749912051169,32cyclictest13046-21turbostat19:30:001
108772612516,32sleep00-21swapper/019:22:290
110602564517,32sleep10-21swapper/119:24:231
111739912076,4cyclictest13034-21munin-run19:30:000
217921050,3sleep041ktimersoftd/023:15:260
115172940,9sleep01117399cyclictest22:15:140
8332890,8sleep11117499cyclictest20:20:221
63212770,5sleep1201rcuc/120:35:151
94042650,2sleep09402-21tr22:10:110
1117499575,15cyclictest13745-21munin-node19:30:061
1117499572,14cyclictest4904-21/usr/sbin/munin00:50:191
1117499544,16cyclictest1829-21ntp_states00:40:251
1117499523,15cyclictest27588-21iostat20:05:191
1117499514,13cyclictest26135-21munin-run22:55:001
1117499503,16cyclictest15510-21smartctl22:25:191
1117499503,15cyclictest3286-21runrttasks23:04:151
1117499496,13cyclictest24669-21chrt21:25:001
1117499493,11cyclictest32054-21hddtemp_smartct00:35:181
1117499492,16cyclictest16813-21chrt21:02:161
1117499492,15cyclictest31700-21find20:15:271
1117499492,14cyclictest17604-21/usr/sbin/munin19:40:211
1117499492,13cyclictest14033-21if_eth020:55:201
1117499491,15cyclictest19713-21cstates19:45:141
1117499488,12cyclictest21252-21iostat_ios22:40:201
1117499482,18cyclictest5018-21sshd23:24:281
1117499482,15cyclictest7064-21chrt22:02:281
1117499482,15cyclictest7064-21chrt22:02:281
1117499482,15cyclictest18405-21chrt00:00:051
1117499482,14cyclictest26481-21chrt20:01:181
1117499481,16cyclictest23836-21runrttasks00:14:371
1117499481,15cyclictest11550-21grep23:40:211
1117499481,14cyclictest7498-21fschecks_count23:30:171
1117499480,17cyclictest2768-21runrttasks23:16:361
1117499480,16cyclictest28100-21runrttasks21:32:201
1117499480,16cyclictest12405-21awk20:50:231
1117499473,15cyclictest21553-21cat21:15:181
1117499471,16cyclictest19296-21cat21:10:131
1117499471,15cyclictest6675-21chrt23:27:111
1117499471,15cyclictest29418-21cat20:10:191
1117499471,15cyclictest2695-21snmpd20:31:151
1117499471,14cyclictest300-21grep21:45:161
1117499471,14cyclictest14809-21chrt22:24:401
1117499470,17cyclictest4586-21runrttasks00:48:261
1117499462,15cyclictest13362-21iostat_ios23:45:191
1117499462,14cyclictest23355-21ntpq22:45:241
1117499461,15cyclictest4293-21grep21:55:181
1117499461,15cyclictest10424-21runrttasks23:37:101
1117499460,15cyclictest32422-21which23:10:191
1117499452,14cyclictest24873-21ntpq00:15:251
1117499452,14cyclictest2218-21which21:50:181
1117499451,19cyclictest30417-21/usr/sbin/munin21:40:181
1117499451,14cyclictest8849-21smartctl20:40:281
1117499451,14cyclictest2465-21fschecks_count20:25:161
1117499450,15cyclictest20261-21chrt22:37:481
1117499442,14cyclictest8277-21ntpdc22:05:241
1117499440,14cyclictest24069-21awk19:55:261
1117499431,14cyclictest16519-21/usr/sbin/munin23:55:171
1117499430,14cyclictest10695-21sshd22:11:121
1117499422,27cyclictest26284-21/usr/sbin/munin22:55:211
1117499418,14cyclictest26114-21cpuspeed_turbos00:20:141
1117499413,15cyclictest11267-21aten_r4power_en22:15:121
1117499412,15cyclictest21850-21smartctl19:50:171
1117499404,10cyclictest30879-21ntp_states23:05:241
1117499403,18cyclictest17467-21wc21:05:131
1117499401,14cyclictest2695-21snmpd20:46:181
1117499401,14cyclictest25267-21hddtemp_smartct21:25:201
1117499400,14cyclictest15467-21ntpq23:50:261
1117499392,8cyclictest0-21swapper/100:05:151
1117499391,8cyclictest0-21swapper/100:31:151
1117499391,8cyclictest0-21swapper/100:25:021
33872380,4sleep0111rcuc/021:53:290
1117399384,11cyclictest81rcu_preempt20:25:170
1117499376,14cyclictest16502-21awk19:35:231
1117499370,15cyclictest17675-21runrttasks22:30:241
1117399371,15cyclictest0-21swapper/021:31:270
1117499361,8cyclictest0-21swapper/121:37:571
1117399361,14cyclictest0-21swapper/022:05:500
43822351,30sleep04519-21/usr/sbin/munin23:20:280
1117399353,4cyclictest81rcu_preempt21:10:270
1117399352,11cyclictest81rcu_preempt22:44:550
295172341,29sleep029627-21ls00:30:010
182272331,4sleep018251-21munin-run00:00:010
1117399331,10cyclictest81rcu_preempt00:37:380
1117399329,5cyclictest149242timerandwakeup19:30:290
1117399324,4cyclictest81rcu_preempt00:45:100
1117399321,4cyclictest81rcu_preempt23:41:500
1117399321,4cyclictest81rcu_preempt20:46:440
1117399321,4cyclictest81rcu_preempt20:08:080
1117399321,13cyclictest0-21swapper/023:04:370
95222311,26sleep02225-21dbus-daemon20:44:520
246502311,9sleep00-21swapper/019:56:590
1117399312,15cyclictest25962-21ntp_states20:00:270
1117399311,4cyclictest81rcu_preempt21:29:570
1117399311,4cyclictest81rcu_preempt00:18:570
1117399311,19cyclictest32031-21hostname23:10:140
296642302,24sleep029700-21grep20:10:240
1117399302,4cyclictest81rcu_preempt00:40:160
1117399301,4cyclictest81rcu_preempt22:39:540
1117399301,4cyclictest81rcu_preempt21:47:300
1117399301,25cyclictest8470-21seq23:31:230
1117399301,25cyclictest188462sleep021:08:540
1117399295,4cyclictest81rcu_preempt22:46:420
1117399294,18cyclictest17902-21python22:30:290
1117399293,4cyclictest81rcu_preempt22:50:150
1117399292,14cyclictest26937-21grep00:20:280
1117399292,14cyclictest15862-21/usr/sbin/munin21:00:180
1117399292,14cyclictest13958-21ntp_states22:20:240
1117399291,4cyclictest81rcu_preempt22:02:470
1117399291,4cyclictest81rcu_preempt22:02:460
1117399291,4cyclictest81rcu_preempt20:59:230
1117399291,4cyclictest81rcu_preempt00:15:010
1117399291,14cyclictest18640-21ls00:00:130
1117399291,13cyclictest4086-21aten_r4power_cu20:30:130
320382281,5sleep00-21swapper/021:44:040
1117399289,16cyclictest22186-21grep21:15:290
1117399287,16cyclictest11565-21gdbus20:15:090
1117399285,11cyclictest0-21swapper/020:50:590
1117399282,4cyclictest81rcu_preempt19:44:180
1117399282,13cyclictest5187-21df00:50:140
1117399282,12cyclictest786-21iostat_ios20:20:200
1117399281,4cyclictest81rcu_preempt23:47:380
1117399281,14cyclictest6748-21/usr/sbin/munin20:35:240
1117399281,14cyclictest15814-21grep22:25:260
52282271,5sleep00-21swapper/021:58:060
298402271,5sleep00-21swapper/021:35:590
208012271,5sleep00-21swapper/019:46:000
162762271,5sleep00-21swapper/023:54:130
1117399273,18cyclictest23179-21df21:20:130
1117399272,4cyclictest81rcu_preempt19:50:220
1117399272,12cyclictest30796-21timerandwakeup00:30:310
1117399272,12cyclictest30342-21diskstats23:05:120
1117399271,4cyclictest81rcu_preempt00:09:170
103912271,5sleep00-21swapper/023:36:510
1117399267,15cyclictest3286-21runrttasks19:35:220
1117399261,13cyclictest27806-21taskset22:58:020
1117399251,6cyclictest6066-21ntp_states23:25:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional