You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 03:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Aug 06, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
301659911201095,21cyclictest32037-21munin-run19:30:001
300082700602,31sleep10-21swapper/119:23:571
297162538490,32sleep00-21swapper/019:20:500
30164991601,154cyclictest32047-21munin-node19:30:010
250952790,5sleep1211ktimersoftd/100:50:301
304852430,21sleep1201rcuc/120:50:001
285972420,3sleep041ktimersoftd/023:35:220
30165993827,7cyclictest27041-21/usr/sbin/munin23:30:271
30164993811,13cyclictest25382-21fschecks_time20:35:160
30164993623,10cyclictest3-21ksoftirqd/000:08:320
3016599355,27cyclictest2088-21cron19:35:011
281772351,4sleep028224-21sed22:10:010
113762351,5sleep12695-21snmpd19:57:451
30165993419,8cyclictest30821-21iostat_ios22:15:191
30165993419,8cyclictest30821-21iostat_ios22:15:191
89342331,9sleep00-21swapper/021:15:360
3016599331,8cyclictest2766-21ntp_states21:00:241
3016499332,15cyclictest648-21df_inode19:30:120
199192331,28sleep119929-21munin-run00:40:001
30165993223,5cyclictest11838-21grep20:00:111
3016599321,17cyclictest11878-21awk22:50:231
3016499329,11cyclictest15383-21idleruntime-cro20:10:000
3016599311,5cyclictest81rcu_preempt23:35:151
3016499312,17cyclictest0-21swapper/021:39:250
30164993112,6cyclictest22560-21latency_hist21:55:000
55682301,5sleep10-21swapper/121:09:421
38162301,25sleep03825-21df_inode22:30:140
37192301,5sleep00-21swapper/021:04:580
3016599306,4cyclictest81rcu_preempt21:15:081
30165993022,5cyclictest22015-21/usr/sbin/munin00:45:231
30165993014,4cyclictest3286-21runrttasks22:34:261
30165993012,5cyclictest22-21ksoftirqd/119:35:141
3016599301,17cyclictest7193-21cron21:12:001
30164993021,5cyclictest9213-21aten_r4power_cu22:45:130
3016499301,4cyclictest81rcu_preempt00:37:060
30164993012,6cyclictest22949-21iostat23:20:180
3016499301,16cyclictest15248-21/usr/sbin/munin00:25:210
30164993011,6cyclictest11720-21diskstats21:25:150
3016499301,16cyclictest10415-21runrttasks00:13:540
3016499301,16cyclictest0-21swapper/021:44:260
224652301,5sleep10-21swapper/120:25:361
147852301,5sleep10-21swapper/121:32:411
14052301,5sleep00-21swapper/020:56:500
76222291,10sleep07623-21sshd19:47:450
67362291,5sleep10-21swapper/100:04:401
45852291,5sleep10-21swapper/123:56:591
320712291,5sleep10-21swapper/120:52:421
3016599294,9cyclictest4948-21memory19:40:251
3016599294,4cyclictest81rcu_preempt22:07:351
3016599294,19cyclictest25192-21iostat_ios22:00:211
3016599293,18cyclictest0-21swapper/100:23:121
30165992918,6cyclictest6846-21cat19:45:221
30165992912,5cyclictest19027-21fschecks_time23:10:161
30165992910,7cyclictest0-21swapper/120:32:241
3016499293,13cyclictest0-21swapper/000:00:160
3016499292,14cyclictest31180-21iostat_ios20:50:200
3016499292,14cyclictest0-21swapper/021:56:050
3016499292,14cyclictest0-21swapper/019:35:570
3016499292,13cyclictest8842-21ntp_states19:50:280
3016499292,13cyclictest24193-21df_inode00:50:160
30164992912,5cyclictest9041-21munin-run22:45:000
30164992911,6cyclictest17777-21taskset00:32:100
30164992911,5cyclictest19572-21expr20:20:120
30164992911,5cyclictest15665-21ntp_states23:00:260
30164992911,5cyclictest11955-21users00:15:300
3016499291,15cyclictest11879-21/usr/sbin/munin22:50:220
3016499291,14cyclictest21684-21unixbench_singl23:15:280
3016499291,14cyclictest12375-21iostat20:00:190
30164992911,14cyclictest234342chrt00:46:530
260962291,5sleep00-21swapper/022:02:510
243682291,5sleep00-21swapper/020:30:510
241192291,4sleep111564-21packagekitd21:57:011
228682291,5sleep00-21swapper/020:29:480
199812291,5sleep00-21swapper/023:11:460
189602291,5sleep00-21swapper/020:18:210
161532291,5sleep10-21swapper/100:29:501
13712291,4sleep11393-21munin-run22:24:591
317492281,5sleep10-21swapper/123:45:051
301962281,5sleep00-21swapper/020:47:430
3016599284,4cyclictest81rcu_preempt22:25:051
3016599284,4cyclictest81rcu_preempt20:06:431
3016599284,3cyclictest81rcu_preempt20:37:421
3016599283,4cyclictest81rcu_preempt00:13:041
30165992818,6cyclictest16148-21/usr/sbin/munin20:10:201
3016599281,6cyclictest6945-21/usr/sbin/munin00:05:271
30165992811,5cyclictest40250irq/92-i91521:45:191
3016599281,12cyclictest3286-21runrttasks20:20:551
3016499283,4cyclictest81rcu_preempt19:42:160
3016499282,14cyclictest0-21swapper/021:06:590
3016499282,13cyclictest30688-21perl22:15:150
3016499282,13cyclictest30688-21perl22:15:150
3016499282,12cyclictest27325-21smartctl20:40:170
3016499281,4cyclictest81rcu_preempt23:44:050
30164992811,6cyclictest10248-21grep21:20:260
30164992811,5cyclictest0-21swapper/022:26:330
3016499281,14cyclictest7037-21seq22:39:060
3016499281,14cyclictest664-21grep22:20:270
3016499281,14cyclictest17719-21python23:05:260
3016499281,14cyclictest0-21swapper/000:22:510
299292281,5sleep10-21swapper/122:13:461
221302281,5sleep10-21swapper/123:19:381
221022281,5sleep10-21swapper/121:50:341
168262281,5sleep00-21swapper/020:10:410
131332281,5sleep00-21swapper/021:30:020
67942271,5sleep10-21swapper/122:36:361
314212271,5sleep10-21swapper/123:43:111
3016599272,8cyclictest17408-21/usr/sbin/munin20:15:231
30165992717,6cyclictest27020-21cpuspeed_turbos20:40:131
3016599271,4cyclictest81rcu_preempt19:50:511
3016499279,5cyclictest6585-21ntpdc21:10:230
3016499278,5cyclictest11034-21sort19:55:290
3016499273,18cyclictest32037-21df23:45:120
3016499271,17cyclictest0-21swapper/023:50:240
3016499271,15cyclictest2695-21snmpd21:45:310
30164992710,5cyclictest3499-21tune2fs23:55:150
185842271,5sleep10-21swapper/121:42:591
176902271,5sleep10-21swapper/100:31:151
166972271,5sleep10-21swapper/123:05:031
164862271,4sleep10-21swapper/123:04:251
15832271,5sleep10-21swapper/120:58:381
130502271,5sleep10-21swapper/121:29:081
122182271,5sleep10-21swapper/100:18:041
105992271,5sleep10-21swapper/122:46:551
3016599264,4cyclictest81rcu_preempt21:21:551
3016599263,4cyclictest81rcu_preempt23:21:351
3016599263,4cyclictest0-21swapper/122:40:101
3016599262,11cyclictest0-21swapper/123:25:311
30165992610,5cyclictest81rcu_preempt21:35:161
3016499269,5cyclictest2225-21dbus-daemon22:14:110
3016499264,6cyclictest2225-21dbus-daemon23:25:410
30164992616,6cyclictest20774-21sort00:40:210
3016599252,8cyclictest20398-21df_inode00:40:141
3016599251,20cyclictest1214-21aten_r4power_en23:50:111
3016499253,17cyclictest27056-21sendmail_mailqu23:30:270
144962251,3sleep10-21swapper/122:58:251
3016499241,6cyclictest0-21swapper/022:59:310
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional