You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 08:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Tue Jun 23, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316269912021191,7cyclictest0-21swapper/019:26:240
314632648601,31sleep10-21swapper/119:23:551
302682516465,30sleep00-21swapper/019:20:150
694821230,5sleep00-21swapper/000:00:160
236812810,5sleep0111rcuc/023:20:010
31627996556,6cyclictest0-21swapper/119:26:241
3162699563,12cyclictest0-21swapper/020:30:020
34302540,3sleep1201rcuc/121:00:011
3162699541,14cyclictest19049-21unixbench_singl00:30:300
31626995310,5cyclictest11820-21/usr/sbin/munin22:45:300
3162699522,6cyclictest15046-21/usr/sbin/munin21:30:130
3162699522,16cyclictest10034-21/usr/sbin/munin22:40:280
3162699521,14cyclictest11565-21gdbus22:50:520
31626995210,13cyclictest29650-21latency_hist22:10:010
31626995012,6cyclictest31949-21iostat23:40:200
3162699501,15cyclictest28592-21python23:30:290
3162699501,13cyclictest13119-21sendmail_mailst00:15:270
3162699501,12cyclictest11565-21gdbus22:25:360
3162699491,14cyclictest24754-21irqstats21:55:190
3162699491,12cyclictest7309-21grep22:35:170
31626994910,6cyclictest13709-21ntp_states21:25:240
31626994910,6cyclictest13709-21ntp_states21:25:230
3162699482,13cyclictest10297-21ntp_states19:50:250
3162699474,12cyclictest0-21swapper/000:20:280
3162699473,16cyclictest14260-21python20:00:310
3162699473,16cyclictest14260-21python20:00:310
3162699472,13cyclictest19543-21python21:40:260
3162699472,12cyclictest7828-21iostat21:10:200
3162699461,21cyclictest19622-21seq20:15:210
31626994610,7cyclictest2137-21seq23:46:150
3162699451,12cyclictest32534-21hddtemp_smartct20:50:160
21692400,4sleep041ktimersoftd/020:55:210
31627993929,6cyclictest15642-21proc_pri21:30:271
246562390,8sleep03162699cyclictest23:20:250
31626993813,10cyclictest233822wc00:45:010
3162799343,10cyclictest0-21swapper/123:43:431
3162799341,14cyclictest255672grep00:50:121
280982341,5sleep128185-21cat20:40:011
3162799336,13cyclictest3286-21runrttasks23:20:321
31627993314,6cyclictest17406-21taskset00:27:271
223382331,28sleep122488-21cut21:50:121
285182321,27sleep128527-21iostat_ios22:05:211
247522321,27sleep124756-21irqstats21:55:191
233832320,3sleep123382-21wc00:45:011
134672321,27sleep113539-21python22:50:271
3162799312,4cyclictest81rcu_preempt19:38:451
3162799311,7cyclictest10851-21munin-run21:20:001
3162799311,16cyclictest14399-21taskset22:55:101
31626993111,6cyclictest31889-21cpuspeed_turbos22:15:120
3162699311,15cyclictest30025-21/usr/sbin/munin23:35:180
33582301,5sleep10-21swapper/119:31:591
3162799306,4cyclictest81rcu_preempt22:22:241
3162799304,20cyclictest8188-21iostat_ios19:45:201
3162799301,8cyclictest22641-21/usr/sbin/munin20:25:221
3162799301,5cyclictest81rcu_preempt19:52:521
3162799301,4cyclictest81rcu_preempt20:44:011
3162699301,4cyclictest81rcu_preempt21:18:250
227142301,4sleep122749-21ntp_states23:15:241
9122291,5sleep10-21swapper/122:19:421
3162799299,7cyclictest16837-21sh20:10:001
3162799296,4cyclictest81rcu_preempt00:03:231
3162799294,4cyclictest81rcu_preempt23:31:361
3162799294,4cyclictest81rcu_preempt00:36:331
3162799294,3cyclictest81rcu_preempt21:27:201
3162799294,3cyclictest81rcu_preempt21:27:191
31627992919,6cyclictest8802-21fschecks_count00:05:161
3162699292,15cyclictest0-21swapper/020:14:040
3162699291,4cyclictest81rcu_preempt21:47:040
3162699291,4cyclictest81rcu_preempt21:23:520
3162699291,16cyclictest4874-21cstates23:55:130
3162699291,14cyclictest3477-21/usr/sbin/munin23:50:210
198312291,5sleep10-21swapper/123:09:291
156042291,5sleep10-21swapper/100:23:161
136632291,5sleep10-21swapper/100:17:471
127112291,6sleep10-21swapper/121:24:571
84002281,5sleep10-21swapper/122:38:021
65502280,3sleep1201rcuc/119:40:241
3162799285,4cyclictest81rcu_preempt23:57:031
3162799285,4cyclictest81rcu_preempt20:11:261
3162799285,4cyclictest81rcu_preempt00:14:551
3162799285,3cyclictest81rcu_preempt21:47:201
3162799284,4cyclictest81rcu_preempt22:30:471
3162799283,18cyclictest25113-21iostat_ios20:30:201
31627992817,7cyclictest5888-21sort21:05:201
31627992816,7cyclictest26698-21grep22:00:211
3162799281,5cyclictest0-21swapper/100:31:051
3162799281,23cyclictest257112sleep123:25:101
3162799281,22cyclictest1457-21memory23:45:221
3162799281,15cyclictest10034-21uptime22:40:291
3162699289,7cyclictest29791-21date22:10:010
3162699289,6cyclictest23665-21sort00:45:110
3162699288,7cyclictest17515-21unixbench_singl23:00:310
3162699282,21cyclictest16150-21munin-run23:00:000
3162699282,14cyclictest0-21swapper/020:33:360
3162699282,13cyclictest20876-21ntp_states23:10:240
31626992811,5cyclictest3982-21mktemp21:00:170
3162699281,15cyclictest27164-21taskset23:27:250
3162699281,14cyclictest12791-21taskset19:57:130
31626992810,5cyclictest6527-21ntp_kernel_pll_19:40:230
248552281,5sleep10-21swapper/100:46:211
223662281,5sleep10-21swapper/120:23:541
128272281,5sleep10-21swapper/119:57:391
11622281,5sleep10-21swapper/120:53:381
88702271,5sleep10-21swapper/121:14:161
41352271,5sleep10-21swapper/122:25:261
3162799272,4cyclictest81rcu_preempt22:46:171
3162799271,10cyclictest3983-21http_loadtime21:00:181
3162699279,5cyclictest6415-21ls21:05:300
3162699278,6cyclictest18358-21tr23:05:120
3162699278,5cyclictest5691-21taskset19:40:010
3162699274,7cyclictest0-21swapper/020:36:290
3162699273,18cyclictest5298-21diskstats22:30:140
3162699272,13cyclictest3286-21runrttasks20:09:450
3162699271,15cyclictest0-21swapper/000:07:340
3162699271,14cyclictest23443-21/usr/sbin/munin21:50:290
3162699271,14cyclictest21087-21taskset00:36:470
3162699271,12cyclictest3656-21awk19:35:010
31626992710,6cyclictest25621-21cstates00:50:130
313712271,4sleep10-21swapper/122:13:271
311112271,5sleep10-21swapper/123:39:271
199912271,5sleep10-21swapper/121:42:251
182892271,5sleep10-21swapper/121:39:261
148972271,3sleep10-21swapper/120:04:281
148972271,3sleep10-21swapper/120:04:271
3162799268,5cyclictest1259-21munin-node23:10:111
3162799262,10cyclictest0-21swapper/123:01:481
31626992615,6cyclictest30394-21/usr/sbin/munin20:45:130
3162699261,4cyclictest81rcu_preempt19:49:390
3162699261,14cyclictest0-21swapper/020:43:060
202122261,4sleep10-21swapper/120:16:111
3162799253,4cyclictest81rcu_preempt23:52:301
3162699259,5cyclictest17126-21grep00:25:290
3162699251,16cyclictest0-21swapper/021:36:400
3162699251,15cyclictest0-21swapper/022:24:420
3162699251,14cyclictest0-21swapper/020:22:070
3162699251,12cyclictest27367-21taskset22:00:520
3162699251,12cyclictest10597-21chrt00:10:150
3162799241,11cyclictest30161-21/usr/sbin/munin20:45:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional