You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-24 - 08:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Wed Jun 24, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7529912041174,26cyclictest896-21/usr/sbin/munin19:25:241
7529911351116,16cyclictest15595-21strings20:00:311
3732563492,55sleep00-21swapper/019:21:400
314402563518,30sleep10-21swapper/119:20:041
75199163139,19cyclictest0-21swapper/019:25:230
751998878,7cyclictest0-21swapper/020:00:300
133622590,2sleep013363-21grep19:55:150
79232410,6sleep17924-21kernelversion19:40:201
751993911,15cyclictest31132-21/usr/sbin/munin20:40:300
181772381,33sleep018219-21fschecks_count23:00:150
75299361,14cyclictest0-21swapper/100:39:341
75199362,21cyclictest17525-21/usr/sbin/munin20:05:230
86412351,30sleep011564-21packagekitd21:09:580
75299351,20cyclictest23486-21fschecks_count00:40:151
75199353,6cyclictest3000-21watchsnmpd20:55:000
195042351,4sleep119589-21sensors20:10:281
173422351,4sleep011565-21gdbus00:24:510
229722341,29sleep123055-21memory20:20:301
751993315,6cyclictest3-21ksoftirqd/000:39:340
751993313,6cyclictest32346-21irqstats20:45:200
75199331,19cyclictest13748-21/usr/sbin/munin00:15:110
232752331,5sleep10-21swapper/121:45:361
75299321,11cyclictest158042egrep00:20:131
75199329,11cyclictest10360-21fschecks_count00:05:200
75299319,7cyclictest8304-21latency_hist22:35:001
75299314,4cyclictest81rcu_preempt19:35:501
75199312,15cyclictest3295-21ntp_states23:45:270
75199311,8cyclictest5690-21taskset19:35:130
751993111,7cyclictest0-21swapper/020:55:120
751993111,6cyclictest5816-21sort22:25:300
75199311,13cyclictest26403-21pidof00:46:000
75199311,12cyclictest13699-21latency_hist00:15:000
751993110,6cyclictest8602-21cpu22:35:110
751993110,6cyclictest27935-21diskstats22:00:140
42382311,5sleep00-21swapper/022:21:530
136182311,5sleep00-21swapper/022:46:350
88052301,5sleep10-21swapper/121:10:031
75299304,5cyclictest81rcu_preempt22:00:241
75299303,4cyclictest81rcu_preempt23:29:421
75299303,3cyclictest81rcu_preempt21:55:401
752993021,5cyclictest0-21swapper/122:50:281
75199302,14cyclictest11527-21ntp_states21:15:270
75199302,14cyclictest11527-21ntp_states21:15:260
75199302,13cyclictest18983-21runrttasks00:27:230
751993013,4cyclictest2087-21grep22:15:330
751993012,5cyclictest3277-21diskstats19:30:040
751993011,6cyclictest5357-21python23:50:270
751993011,6cyclictest19686-21df_inode00:30:150
309692301,5sleep00-21swapper/022:07:190
308602301,5sleep10-21swapper/122:06:111
259162301,5sleep00-21swapper/020:29:460
253302301,5sleep00-21swapper/021:52:250
214362301,5sleep00-21swapper/021:40:560
173092301,5sleep00-21swapper/022:56:010
119352301,5sleep10-21swapper/122:43:371
98022291,5sleep10-21swapper/100:04:471
84532291,5sleep10-21swapper/122:35:071
75299294,9cyclictest6514-21diskstats23:55:161
75299294,4cyclictest81rcu_preempt20:27:391
75299294,4cyclictest81rcu_preempt00:10:401
75299294,17cyclictest0-21swapper/120:41:241
75299291,4cyclictest81rcu_preempt20:08:121
75299291,10cyclictest81rcu_preempt20:54:411
75199299,16cyclictest212932chrt23:08:100
75199293,4cyclictest81rcu_preempt21:57:080
75199293,14cyclictest0-21swapper/023:15:200
75199292,14cyclictest23660-21hddtemp_smartct00:40:170
75199292,13cyclictest764-21diskstats23:40:140
75199292,13cyclictest31321-21diskstats23:35:140
75199292,13cyclictest22858-21hddtemp_smartct20:20:270
751992911,5cyclictest27135-21munin-run23:25:000
75199291,15cyclictest13574-21mailstats21:20:280
75199291,14cyclictest27639-21taskset20:33:090
75199291,13cyclictest15557-21timerandwakeup21:25:290
75199291,12cyclictest18580-21fschecks_count21:35:210
294822291,5sleep00-21swapper/020:37:530
269072291,5sleep10-21swapper/123:22:521
236232291,5sleep00-21swapper/021:49:110
193212291,5sleep10-21swapper/123:02:111
142762291,5sleep10-21swapper/119:56:101
137372291,5sleep10-21swapper/122:47:521
107402291,5sleep00-21swapper/019:48:270
94542281,5sleep00-21swapper/000:01:070
81322281,5sleep00-21swapper/022:33:190
75299286,4cyclictest18595-21cut21:35:201
75299285,4cyclictest81rcu_preempt23:15:331
75299285,4cyclictest81rcu_preempt22:10:021
75299285,4cyclictest81rcu_preempt20:38:471
75299285,3cyclictest81rcu_preempt23:49:301
75299284,4cyclictest81rcu_preempt23:39:121
75299283,4cyclictest81rcu_preempt20:57:361
75299281,5cyclictest81rcu_preempt19:30:111
75299281,4cyclictest81rcu_preempt22:20:031
75199282,14cyclictest11182-21ntp_states22:40:230
751992818,7cyclictest3-21ksoftirqd/021:10:310
75199281,14cyclictest22781-21grep23:10:300
75199281,13cyclictest32572-21unixbench_multi22:10:280
75199281,13cyclictest27895-21grep00:50:300
64762281,5sleep00-21swapper/021:01:580
300162281,5sleep00-21swapper/023:30:250
300162281,5sleep00-21swapper/023:30:240
296382281,23sleep129650-21smartctl23:30:161
296382281,23sleep129650-21smartctl23:30:151
286322281,5sleep00-21swapper/023:26:170
283262281,5sleep10-21swapper/100:51:291
219602281,4sleep00-21swapper/020:17:500
207042281,4sleep10-21swapper/100:30:501
202822281,5sleep00-21swapper/020:14:570
188012281,5sleep10-21swapper/100:25:311
155842281,5sleep00-21swapper/022:52:320
150552281,4sleep10-21swapper/100:15:501
123402281,5sleep00-21swapper/019:50:320
113342281,5sleep10-21swapper/100:06:111
75299275,4cyclictest81rcu_preempt21:27:081
75299274,4cyclictest81rcu_preempt22:15:421
75299273,4cyclictest81rcu_preempt21:33:321
75299273,4cyclictest81rcu_preempt21:05:501
752992714,7cyclictest20355-21iostat_ios23:05:201
751992711,4cyclictest6695-21fschecks_time23:55:170
64062271,5sleep10-21swapper/121:01:121
61122271,5sleep10-21swapper/122:26:511
5652271,5sleep10-21swapper/120:45:341
53612271,22sleep15491-21sort23:50:281
265712271,5sleep10-21swapper/100:47:441
174052271,5sleep10-21swapper/122:57:001
141022271,5sleep10-21swapper/121:22:531
123412271,4sleep10-21swapper/119:50:331
122632271,5sleep10-21swapper/121:18:301
122632271,5sleep10-21swapper/121:18:291
75299263,4cyclictest81rcu_preempt20:15:391
752992617,6cyclictest22-21ksoftirqd/121:43:511
752992615,8cyclictest22-21ksoftirqd/123:40:111
75299261,13cyclictest10475-21runrttasks19:45:401
75199261,12cyclictest8529-21awk19:40:280
75199261,12cyclictest16864-21hwlatdetect21:30:190
251742261,5sleep10-21swapper/121:50:491
75299253,4cyclictest81rcu_preempt20:34:111
75299249,4cyclictest40250irq/92-i91523:10:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional