You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-26 - 12:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Wed Aug 26, 2026 00:59:02)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258299911901172,15cyclictest0-21swapper/119:25:121
258289911711155,13cyclictest0-21swapper/019:25:140
258299910801062,15cyclictest0-21swapper/121:35:161
254462547502,30sleep00-21swapper/019:21:340
254472463416,32sleep10-21swapper/119:21:351
25828992401,235cyclictest10834-21/usr/sbin/munin21:35:160
2063021060,3sleep00-21swapper/023:25:230
282902730,5sleep0111rcuc/020:55:130
22502430,4sleep02582899cyclictest19:45:190
25828994023,6cyclictest3-21ksoftirqd/000:54:260
25828993922,6cyclictest3-21ksoftirqd/023:40:180
25828993912,5cyclictest27789-21/usr/sbin/munin22:20:110
25828993822,6cyclictest3-21ksoftirqd/023:36:260
25828993821,6cyclictest3-21ksoftirqd/021:00:470
25828993821,6cyclictest3-21ksoftirqd/021:00:470
25828993720,5cyclictest3-21ksoftirqd/020:44:040
25828993711,15cyclictest3-21ksoftirqd/000:46:000
25828993620,6cyclictest3-21ksoftirqd/019:53:380
25828993618,6cyclictest3-21ksoftirqd/022:41:590
2582899351,21cyclictest7678-21iostat_ios21:25:200
2582899342,26cyclictest14900-21python00:35:290
25828993419,5cyclictest3-21ksoftirqd/021:33:320
25828993419,5cyclictest3-21ksoftirqd/019:59:310
25828993418,6cyclictest3-21ksoftirqd/022:57:080
25828993418,6cyclictest3-21ksoftirqd/022:49:530
25828993415,7cyclictest21951-21/usr/sbin/munin23:30:140
25828993410,8cyclictest3-21ksoftirqd/020:25:320
320412331,4sleep132103-21if_eth022:30:191
25828993318,5cyclictest3-21ksoftirqd/023:04:520
25828993315,5cyclictest18785-21/usr/sbin/munin23:20:230
25828993311,6cyclictest2225-21dbus-daemon00:42:490
25828993311,6cyclictest2225-21dbus-daemon00:42:490
2582999323,4cyclictest81rcu_preempt23:07:201
2582899329,13cyclictest25826-21cyclictest23:45:350
2582899328,8cyclictest4683-21cpuspeed_turbos00:10:120
2582899327,5cyclictest0-21swapper/021:20:190
2582899325,14cyclictest0-21swapper/019:43:000
25828993218,4cyclictest3-21ksoftirqd/022:06:300
25828993215,5cyclictest21198-21gzip22:00:270
25828993212,6cyclictest3-21ksoftirqd/021:51:260
25828993212,6cyclictest3-21ksoftirqd/000:32:510
2582899321,19cyclictest25158-21timerwakeupswit22:10:290
155512321,5sleep10-21swapper/100:39:341
95782311,25sleep19635-21ls22:55:291
2582999311,2cyclictest0-21swapper/121:20:201
2582899319,7cyclictest3-21ksoftirqd/020:32:360
2582899319,7cyclictest3-21ksoftirqd/020:23:270
2582899312,18cyclictest0-21swapper/021:06:050
2582899312,15cyclictest0-21swapper/021:44:100
25828993118,4cyclictest3-21ksoftirqd/021:12:180
25828993117,4cyclictest3-21ksoftirqd/000:16:020
2582899311,18cyclictest28414-21df19:30:070
25828993111,6cyclictest26247-21/usr/sbin/munin20:50:120
25828993110,7cyclictest3-21ksoftirqd/000:02:540
101482311,5sleep10-21swapper/120:05:281
96542301,5sleep00-21swapper/000:21:480
26882301,5sleep00-21swapper/022:39:510
2582999306,4cyclictest81rcu_preempt23:47:211
25829993023,4cyclictest15467-21smartctl20:20:181
2582999302,24cyclictest0-21swapper/120:51:281
2582999302,23cyclictest5432-21iostat22:45:181
25829993020,7cyclictest1791-21aten_r4power_vo19:45:121
25829993016,8cyclictest8959-21/usr/sbin/munin21:30:321
2582999301,4cyclictest81rcu_preempt23:29:181
2582999301,4cyclictest81rcu_preempt20:25:321
2582999301,4cyclictest81rcu_preempt00:15:071
2582899309,7cyclictest3-21ksoftirqd/000:28:330
2582899309,7cyclictest2225-21dbus-daemon20:14:010
25828993012,5cyclictest7705-21mailstats22:50:280
25828993011,6cyclictest13053-21/usr/sbin/munin23:05:200
25828993010,6cyclictest3-21ksoftirqd/020:06:170
159322301,5sleep00-21swapper/023:14:470
14082301,5sleep10-21swapper/119:43:591
318662291,5sleep00-21swapper/019:37:520
2582999299,4cyclictest40250irq/92-i91500:10:121
2582999296,5cyclictest40250irq/92-i91519:50:121
2582999296,4cyclictest81rcu_preempt00:44:291
2582999296,4cyclictest81rcu_preempt00:44:291
2582999295,4cyclictest81rcu_preempt23:33:571
2582999294,19cyclictest23942-21diskstats23:35:141
25829992919,5cyclictest27606-21cron22:20:001
25829992915,8cyclictest30267-21iostat_ios22:25:211
2582999291,14cyclictest29304-21/usr/sbin/munin23:50:181
2582899299,6cyclictest3-21ksoftirqd/021:59:220
2582899296,12cyclictest2682-21cpu00:05:140
2582899295,9cyclictest32370-21ntp_states22:30:250
2582899293,19cyclictest21189-21iostat_ios20:35:210
25828992914,4cyclictest14896-21df_inode21:45:140
25828992914,4cyclictest14896-21df_inode21:45:140
2582899291,24cyclictest7720-21df20:00:140
2582899291,14cyclictest31773-21iostat23:55:200
220852291,5sleep10-21swapper/120:37:471
134352291,5sleep10-21swapper/100:32:021
80732281,5sleep10-21swapper/122:51:181
70972281,5sleep10-21swapper/119:58:221
317052281,5sleep10-21swapper/121:04:501
317052281,5sleep10-21swapper/121:04:491
30142281,5sleep10-21swapper/121:13:501
293812281,5sleep10-21swapper/122:23:471
2582999289,15cyclictest47632chrt21:17:191
2582999285,4cyclictest81rcu_preempt21:54:001
2582999283,4cyclictest81rcu_preempt23:43:391
25829992819,6cyclictest11316-21unixbench_multi00:25:301
25829992819,6cyclictest11038-21snmpd23:14:011
25829992818,6cyclictest32097-21cpuspeed_turbos21:05:221
25829992818,6cyclictest17372-21head23:15:281
2582999281,5cyclictest81rcu_preempt00:45:311
2582999281,4cyclictest81rcu_preempt22:42:221
2582999281,4cyclictest81rcu_preempt20:32:351
2582999281,13cyclictest1204-21iostat00:00:201
2582899288,6cyclictest3-21ksoftirqd/023:54:370
25828992812,5cyclictest4294-21sendmail_mailtr21:15:300
2582899281,23cyclictest13474-21fschecks_time20:15:160
2582899281,13cyclictest30281-21cut22:25:220
239392281,5sleep10-21swapper/120:42:201
237332281,5sleep10-21swapper/122:08:531
215942281,5sleep10-21swapper/122:01:061
200002281,5sleep10-21swapper/121:59:151
194572281,5sleep10-21swapper/123:22:091
159662281,5sleep10-21swapper/121:46:201
159662281,5sleep10-21swapper/121:46:191
121702281,5sleep10-21swapper/123:04:391
70672271,5sleep10-21swapper/121:25:021
41022271,4sleep10-21swapper/100:07:481
326462271,5sleep10-21swapper/123:57:291
295192271,5sleep10-21swapper/120:56:471
2582999273,4cyclictest81rcu_preempt20:10:351
2582999272,8cyclictest0-21swapper/120:45:231
2582999271,4cyclictest81rcu_preempt00:53:131
2582899277,6cyclictest3-21ksoftirqd/023:18:020
2582899274,17cyclictest24661-21diskstats20:45:170
147582271,5sleep10-21swapper/120:19:491
141732271,5sleep10-21swapper/121:42:111
89202261,4sleep10-21swapper/120:02:381
318152261,5sleep10-21swapper/119:37:191
2582899262,12cyclictest27156-21users22:15:300
25829992514,6cyclictest25228-21grep22:10:311
25829992415,6cyclictest22-21ksoftirqd/122:38:141
25829992414,6cyclictest8944-21memory00:20:221
2582999241,3cyclictest81rcu_preempt19:30:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional