You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 05:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack9slot4s (updated Fri May 22, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
314729912691241,22cyclictest878-21latency_hist19:30:001
311542584537,32sleep00-21swapper/019:22:120
311022526471,40sleep10-21swapper/119:21:431
3147199125103,15cyclictest982-21latency_hist19:30:000
285212690,3sleep10-21swapper/120:40:141
272312660,2sleep10-21swapper/120:35:261
3147299573,18cyclictest32184-21diskstats20:50:141
3147299539,8cyclictest7608-21idleruntime21:10:191
3147299529,5cyclictest40250irq/92-i91521:05:281
3147299524,16cyclictest2292-21iostat_ios19:30:201
31472995213,5cyclictest0-21swapper/121:54:341
31472995116,6cyclictest31162-21sort23:40:011
3147299502,8cyclictest22030-21irqstats00:40:191
3147299493,7cyclictest1888-21users23:45:291
3147299491,14cyclictest2531-21/usr/sbin/munin23:50:301
3147299482,8cyclictest19745-21munin-run23:10:011
3147299482,11cyclictest10138-21ntp_states19:50:231
3147299468,6cyclictest0-21swapper/121:30:011
3147299467,7cyclictest14232-21fschecks_count00:20:151
3147299462,9cyclictest7284-21latency_hist19:45:001
3147299451,8cyclictest3181-21ls22:25:121
3147299441,14cyclictest23078-21iostat_ios20:25:191
3147299432,9cyclictest30916-21users22:10:311
3147299432,8cyclictest25911-21memory00:50:211
3147299421,8cyclictest2695-21snmpd21:48:061
31472993910,8cyclictest21075-21unixbench_multi23:10:271
31471993915,12cyclictest3-21ksoftirqd/022:55:290
92072372,31sleep19211-21irqstats22:40:191
3147199366,5cyclictest0-21swapper/021:48:490
31471993511,11cyclictest22463-21cut21:50:160
31472993413,8cyclictest7189-21ntpq00:00:281
3147199346,17cyclictest7353-21ls19:45:000
3147199341,8cyclictest0-21swapper/021:55:160
32002331,4sleep03214-21kernelversion23:50:220
3147299331,5cyclictest81rcu_preempt22:00:001
3147199332,19cyclictest0-21swapper/023:25:250
31471993312,6cyclictest6202-21munin-run00:00:010
3147299326,4cyclictest81rcu_preempt22:00:091
3147299322,18cyclictest23951-21df23:20:141
3147299321,10cyclictest0-21swapper/121:40:251
3147199324,4cyclictest81rcu_preempt20:04:160
3147199322,16cyclictest30311-21python23:35:270
3147199321,19cyclictest17651-21taskset00:30:060
3147199321,18cyclictest27019-21/usr/sbin/munin20:35:210
3147199321,11cyclictest0-21swapper/000:28:300
3147199312,15cyclictest30295-21df_inode20:45:120
3147199312,15cyclictest24023-21memory00:45:210
3147199312,15cyclictest10410-21df00:10:140
31471993111,7cyclictest3286-21runrttasks00:00:540
3147199311,16cyclictest3731-21/usr/sbin/munin22:25:230
31471993110,7cyclictest9627-21python22:40:270
82172301,5sleep10-21swapper/122:37:501
65852301,5sleep00-21swapper/021:06:420
3147299301,16cyclictest24902-21runrttasks00:48:231
3147199307,11cyclictest19276-21processes21:40:250
3147199307,11cyclictest12765-21taskset19:58:370
3147199305,5cyclictest81rcu_preempt22:14:550
3147199305,12cyclictest3286-21runrttasks19:34:050
3147199304,13cyclictest32216-21python23:40:270
3147199302,15cyclictest17341-21wget20:10:160
3147199302,14cyclictest26486-21iostat22:00:190
3147199301,4cyclictest81rcu_preempt21:15:550
31471993012,6cyclictest11565-21gdbus21:39:200
31471993012,5cyclictest23698-21/usr/sbin/munin20:25:300
31471993011,6cyclictest23348-21runrttasks23:18:370
3147299297,8cyclictest0-21swapper/120:55:581
3147299294,18cyclictest17129-21diskstats20:10:141
31472992919,6cyclictest5306-21chrt23:55:231
3147299290,4cyclictest81rcu_preempt22:53:501
3147199294,17cyclictest0-21swapper/022:51:010
3147199293,18cyclictest0-21swapper/000:07:100
3147199292,14cyclictest21204-21iostat_ios20:20:180
3147199292,14cyclictest0-21swapper/000:17:340
31471992919,6cyclictest4897-21unixbench_singl19:35:280
3147199291,4cyclictest81rcu_preempt23:11:180
3147199291,4cyclictest81rcu_preempt22:15:270
31471992911,7cyclictest14819-21expr21:30:110
3147199291,14cyclictest4277-21sendmail_mailst21:00:270
31471992910,6cyclictest1150-21cpuspeed_turbos22:20:110
3147199290,4cyclictest81rcu_preempt22:49:320
3147199290,4cyclictest81rcu_preempt22:49:310
281282291,5sleep00-21swapper/020:40:110
259182291,5sleep00-21swapper/020:33:270
106852291,5sleep00-21swapper/019:51:320
3147299286,4cyclictest81rcu_preempt19:55:511
3147299285,4cyclictest81rcu_preempt21:38:331
3147299283,9cyclictest8123-21memory19:45:211
3147299283,9cyclictest25842-21diskstats23:25:161
3147299283,4cyclictest81rcu_preempt23:00:381
31472992821,4cyclictest5441-21iostat_ios22:30:201
3147299281,14cyclictest8530-21cstates00:05:111
3147199288,6cyclictest14562-21latency_hist21:30:010
3147199288,11cyclictest0-21swapper/023:21:390
3147199287,11cyclictest11565-21gdbus23:49:260
3147199286,11cyclictest25248-21wget00:50:110
3147199285,4cyclictest81rcu_preempt19:48:590
3147199284,4cyclictest81rcu_preempt22:32:410
3147199283,18cyclictest15970-21python20:05:260
31471992811,5cyclictest8331-21watchsnmpd22:39:010
31471992811,5cyclictest19204-21hddtemp_smartct20:15:170
3147199281,14cyclictest20644-21sort00:35:300
31471992810,6cyclictest28375-21irqstats22:05:190
31471992810,6cyclictest12496-21runrttasks21:24:170
228452281,5sleep00-21swapper/000:41:590
170722281,5sleep10-21swapper/100:25:401
154542281,5sleep00-21swapper/000:23:170
3147299276,4cyclictest81rcu_preempt00:30:021
3147299274,4cyclictest81rcu_preempt22:18:141
3147299274,4cyclictest81rcu_preempt21:03:121
3147299273,4cyclictest81rcu_preempt23:43:341
31472992718,5cyclictest21553-21sendmail_mailqu20:20:251
31472992714,9cyclictest2225-21dbus-daemon21:15:081
31472992711,13cyclictest23488-21cron23:20:001
3147199278,7cyclictest1775-21tune2fs20:55:160
3147199274,3cyclictest81rcu_preempt20:50:170
31471992711,5cyclictest17451-21chrt23:00:530
31471992710,6cyclictest8249-21sed21:10:290
287202271,5sleep00-21swapper/023:30:450
195782271,5sleep00-21swapper/023:08:280
3147299269,5cyclictest40250irq/92-i91521:30:121
3147299263,17cyclictest14532-21df_inode22:55:151
3147299263,17cyclictest13378-21diskstats20:00:141
31472992617,6cyclictest22-21ksoftirqd/120:32:431
31472992616,6cyclictest5152-21runrttasks19:37:421
3147299261,4cyclictest81rcu_preempt00:17:171
3147299261,14cyclictest0-21swapper/122:49:471
3147299261,14cyclictest0-21swapper/122:49:471
3147299259,5cyclictest40250irq/92-i91523:30:151
3147299256,7cyclictest20656-21timerwakeupswit00:35:291
3147299254,6cyclictest3286-21runrttasks20:19:351
3147299254,4cyclictest81rcu_preempt00:11:261
3147299253,4cyclictest81rcu_preempt22:20:091
3147299253,3cyclictest81rcu_preempt21:21:511
3147299252,19cyclictest0-21swapper/120:45:161
31472992517,5cyclictest22-21ksoftirqd/122:05:101
3147299241,9cyclictest16387-21sshd20:07:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional