You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 14:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Thu Sep 03, 2026 00:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
153909912571241,13cyclictest0-21swapper/121:45:011
153909911051094,8cyclictest0-21swapper/119:25:111
152332572525,32sleep00-21swapper/019:23:570
151232459372,72sleep10-21swapper/119:22:471
1538999220195,18cyclictest4158-21latency_hist21:45:010
2652421140,2sleep026525-21sendmail_mailqu19:50:260
2986221130,8sleep01538999cyclictest20:00:180
15389999362,6cyclictest0-21swapper/019:25:100
190632770,3sleep10-21swapper/119:30:261
25412560,10sleep01538999cyclictest23:05:200
7712410,4sleep041ktimersoftd/000:25:300
1538999371,12cyclictest81rcu_preempt19:32:130
90622361,5sleep19184-21users21:55:291
142152361,4sleep114224-21diskstats20:45:131
1538999352,20cyclictest15091-21/usr/sbin/munin20:45:270
1538999348,13cyclictest2225-21dbus-daemon00:48:050
1538999347,5cyclictest81rcu_preempt21:00:310
1538999341,29cyclictest17276-21df23:45:130
14712341,3sleep01533-21/usr/sbin/munin20:10:240
201652331,28sleep011565-21gdbus23:50:410
194002331,28sleep019412-21munin-run21:00:000
15390993318,8cyclictest10416-21iostat_ios22:00:201
15390993315,14cyclictest22-21ksoftirqd/100:01:201
1538999331,19cyclictest27878-21grep21:20:250
15389993310,11cyclictest14942-21watchsnmpd23:40:000
58612321,5sleep10-21swapper/120:21:031
1539099323,11cyclictest7947-21memory00:45:221
1538999326,13cyclictest4413-21latency_hist20:20:010
1538999326,12cyclictest7969-21fschecks_count23:20:170
1538999322,16cyclictest29289-21df_inode21:25:140
1538999321,19cyclictest28758-21hddtemp_smartct00:15:180
78802311,5sleep10-21swapper/120:27:361
318252311,26sleep131828-21irqstats20:05:241
316202311,4sleep131767-21users22:55:291
15390993121,6cyclictest21024-21df23:55:121
15390993121,6cyclictest17671-21/usr/sbin/munin22:20:151
15390993116,8cyclictest4049-21iostat_ios00:35:211
15390993116,8cyclictest11995-21diskstats22:05:141
15390993114,13cyclictest22-21ksoftirqd/119:48:531
15390993114,13cyclictest22-21ksoftirqd/119:48:521
1539099311,17cyclictest24067-21ls21:10:221
1538999318,12cyclictest40250irq/92-i91521:50:300
1538999317,13cyclictest5761-21sshd21:48:440
1538999312,14cyclictest23188-21munin-run21:10:010
1538999311,27cyclictest0-21swapper/000:00:410
320302301,5sleep10-21swapper/100:25:071
300262301,25sleep130167-21tail21:25:291
270512301,25sleep127107-21fschecks_count22:45:161
252402301,25sleep125347-21cpu21:15:141
233492301,5sleep00-21swapper/019:43:050
17162300,5sleep1201rcuc/120:10:251
169812301,5sleep10-21swapper/123:45:021
1539099305,4cyclictest81rcu_preempt20:56:041
1539099304,4cyclictest81rcu_preempt23:32:421
15390993020,6cyclictest11038-21snmpd19:41:451
1539099301,4cyclictest81rcu_preempt22:42:081
1538999302,15cyclictest16482-21/usr/sbin/munin22:15:250
1538999302,15cyclictest12998-21/usr/sbin/munin20:40:260
1538999302,14cyclictest12525-21ntp_states22:05:230
1538999302,14cyclictest10449-21diskstats20:35:140
15389993014,12cyclictest23574-21iostat22:35:180
1538999301,26cyclictest0-21swapper/023:40:180
15389993011,7cyclictest21040-21diskstats23:55:150
15389993011,6cyclictest22370-21/usr/sbin/munin22:30:290
15389993011,5cyclictest28547-21grep22:50:000
79612291,5sleep00-21swapper/020:28:260
57002291,5sleep10-21swapper/121:48:031
54372291,5sleep00-21swapper/023:14:060
43262291,5sleep10-21swapper/120:19:501
327222291,5sleep00-21swapper/020:07:490
31022291,5sleep00-21swapper/000:33:170
287332291,5sleep10-21swapper/121:24:001
246642293,5sleep00-21swapper/021:10:540
212062291,5sleep00-21swapper/019:35:330
206102291,24sleep119590-21/usr/sbin/munin21:00:301
1539099296,4cyclictest81rcu_preempt22:26:541
1539099296,4cyclictest81rcu_preempt00:23:211
1539099293,19cyclictest16109-21diskstats20:50:141
1539099291,5cyclictest81rcu_preempt21:35:271
1539099291,11cyclictest6958-21sshd00:43:591
1538999299,15cyclictest315722chrt00:21:540
1538999295,12cyclictest27941-21hddtemp_smartct19:55:170
1538999292,14cyclictest23980-21df19:45:150
1538999292,14cyclictest23980-21df19:45:150
1538999291,8cyclictest25745-21grep00:05:330
1538999291,4cyclictest81rcu_preempt00:10:340
15389992913,5cyclictest3-21ksoftirqd/021:56:410
15389992911,5cyclictest26874-21runrttasks21:19:190
1538999291,13cyclictest31361-21taskset21:30:160
148992291,5sleep00-21swapper/022:11:000
14682291,5sleep00-21swapper/023:03:020
322592281,5sleep10-21swapper/121:31:401
243032281,5sleep10-21swapper/122:35:571
16772281,5sleep00-21swapper/021:36:370
1539099286,4cyclictest81rcu_preempt20:43:221
1539099285,4cyclictest81rcu_preempt23:11:141
1539099284,3cyclictest81rcu_preempt00:34:291
1539099284,15cyclictest0-21swapper/123:22:591
1539099283,4cyclictest81rcu_preempt22:19:111
1539099281,5cyclictest0-21swapper/100:19:361
1539099281,4cyclictest81rcu_preempt21:53:151
1539099281,23cyclictest9424-21diskstats00:50:101
15390992811,13cyclictest3296-21seq23:06:271
15390992810,14cyclictest29886-21basename20:00:181
1539099280,4cyclictest81rcu_preempt22:30:121
1538999283,8cyclictest0-21swapper/020:30:240
15389992813,5cyclictest3-21ksoftirqd/022:20:190
1538999281,15cyclictest6275-21/usr/sbin/munin23:15:160
1538999281,14cyclictest19735-21/usr/sbin/munin22:25:170
1538999281,13cyclictest10636-21sed23:25:290
1538999281,13cyclictest10636-21sed23:25:280
15389992810,6cyclictest4705-21/usr/sbin/munin20:20:110
106922281,5sleep00-21swapper/000:53:260
71552271,5sleep10-21swapper/123:17:271
260162271,5sleep10-21swapper/100:07:541
171242271,5sleep00-21swapper/020:50:520
166682271,4sleep10-21swapper/123:43:181
1539099275,4cyclictest81rcu_preempt21:08:211
1539099273,9cyclictest20222-21diskstats19:35:151
1539099273,4cyclictest81rcu_preempt20:35:451
1539099272,4cyclictest81rcu_preempt19:54:341
15390992717,6cyclictest29263-21grep20:00:011
15390992717,6cyclictest14706-21cat22:10:331
1539099271,13cyclictest8571-21diskstats20:30:141
1539099271,13cyclictest13819-21irqstats23:35:211
1538999279,15cyclictest28655-21aten_r4power_cu22:50:110
1538999272,13cyclictest11943-21/usr/sbin/munin23:30:200
1538999271,14cyclictest10529-21/usr/sbin/munin22:00:220
15389992711,4cyclictest0-21swapper/022:40:200
1538999271,13cyclictest30618-21cpu22:55:130
1539099266,6cyclictest0-21swapper/123:00:241
1539099265,4cyclictest81rcu_preempt22:53:171
1539099262,4cyclictest81rcu_preempt23:51:351
1538999269,5cyclictest4107-21/usr/sbin/munin00:35:230
1538999261,13cyclictest6145-21/usr/sbin/munin00:40:240
1539099255,7cyclictest81rcu_preempt23:25:191
1539099255,7cyclictest81rcu_preempt23:25:191
15390992516,6cyclictest22-21ksoftirqd/100:10:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional