You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 05:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Mon May 04, 2026 00:59:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
131999912801231,28cyclictest22755-21grep19:45:291
131989912441233,7cyclictest0-21swapper/019:25:070
131999912281219,6cyclictest0-21swapper/119:25:071
130112649602,31sleep10-21swapper/119:23:371
130112649602,31sleep10-21swapper/119:23:361
127232561517,30sleep00-21swapper/019:20:340
127232561517,30sleep00-21swapper/019:20:340
1319899356347,5cyclictest22757-21sed19:45:290
172892890,6sleep117292-21processes00:25:261
178852840,4sleep10-21swapper/121:40:011
63702780,8sleep11319999cyclictest20:30:141
276942730,8sleep01319899cyclictest20:00:180
316552720,3sleep00-21swapper/023:00:220
260102610,7sleep01319899cyclictest23:28:020
1319899573,18cyclictest19566-21diskstats21:05:170
13198995714,6cyclictest5061-21runrttasks23:05:470
13198995620,31cyclictest2695-21snmpd21:46:350
1319899561,12cyclictest12906-21grep22:40:300
1319899553,17cyclictest7842-21diskstats00:50:150
1319899544,18cyclictest4949-21tr20:25:220
13198995422,28cyclictest12751-21ssh23:47:400
13198995415,6cyclictest21595-21diskstats21:10:140
13198995411,5cyclictest28421-21iostat21:50:190
1319899522,12cyclictest0-21swapper/023:41:570
1319899522,12cyclictest0-21swapper/022:20:050
1319899522,11cyclictest0-21swapper/000:15:290
13198995215,5cyclictest19773-21df23:55:130
13198995211,5cyclictest2929-21awk22:30:270
1319899521,12cyclictest1621-21runrttasks20:15:430
13198995210,12cyclictest0-21swapper/000:04:580
1319899519,6cyclictest19081-21chrt21:04:480
1319899518,7cyclictest29851-21hddtemp_smartct22:25:160
1319899513,6cyclictest28300-21iostat_ios23:30:200
1319899512,6cyclictest21210-21/usr/sbin/munin22:50:210
13198995113,6cyclictest2544-21runrttasks00:10:250
13198995112,6cyclictest21372-21ssh23:23:200
13198995112,6cyclictest14205-21ntp_states21:35:270
13198995111,5cyclictest3309-21ssh21:57:510
13198995110,5cyclictest9163-21sh22:04:180
1319899501,8cyclictest2487-21runrttasks20:20:120
13198995011,9cyclictest22640-21ssh21:45:000
1319899501,14cyclictest12685-21fgrep20:45:270
1319899499,6cyclictest10280-21ssh21:31:100
1319899497,5cyclictest8647-21ssh23:10:150
1319899497,5cyclictest26360-21ssh21:15:120
1319899495,9cyclictest31697-21iostat_ios21:20:210
1319899495,7cyclictest9861-21/usr/sbin/munin20:40:150
1319899492,15cyclictest15330-21munin-node19:30:010
1319899491,4cyclictest17607-21turbostat.cron23:19:560
13198994912,6cyclictest15205-21runrttasks20:53:430
13198994912,6cyclictest15205-21runrttasks20:53:430
1319899491,12cyclictest14875-21cat23:50:120
13198994910,6cyclictest26287-21cstates22:55:120
13198994910,5cyclictest29053-21ssh00:37:530
13198994910,5cyclictest29053-21ssh00:37:520
1319899489,6cyclictest19912-21df19:40:130
1319899487,6cyclictest6914-21ntp_states20:30:240
1319899484,9cyclictest12205-21memory00:20:220
1319899482,6cyclictest3462-21df_inode00:45:130
1319899478,6cyclictest8793-21ntp_states20:35:250
1319899478,5cyclictest0-21swapper/022:35:190
1319899477,5cyclictest16945-21irqstats00:25:190
1319899474,9cyclictest4306-21memory21:25:210
1319899474,8cyclictest31590-21memory20:10:230
1319899472,18cyclictest0-21swapper/019:36:140
1319899471,13cyclictest21795-21irqstats00:30:210
1319899471,12cyclictest31098-21sh00:06:090
1319899468,5cyclictest32467-21/usr/sbin/munin23:35:200
1319899468,14cyclictest2225-21dbus-daemon00:41:060
1319899461,13cyclictest2225-21dbus-daemon22:19:320
1319899454,9cyclictest0-21swapper/022:05:440
1319899454,9cyclictest0-21swapper/022:05:440
13198994512,7cyclictest2225-21dbus-daemon22:45:340
13198994411,8cyclictest2225-21dbus-daemon22:13:320
1319899431,6cyclictest26765-21taskset19:57:580
1319899431,5cyclictest2225-21dbus-daemon20:57:060
1319999401,26cyclictest5880-21memory22:00:201
13199993813,11cyclictest81rcu_preempt23:05:241
132642361,4sleep113274-21ssh00:21:041
1319999351,13cyclictest79812ssh21:29:501
319322341,4sleep120982-21diskmemload00:07:221
1319999349,22cyclictest0-21swapper/100:13:401
1319999341,4cyclictest81rcu_preempt00:40:291
1319999341,14cyclictest114522ssh23:45:461
1319999336,23cyclictest0-21swapper/121:56:291
1319999332,29cyclictest137450irq/90-eth023:36:021
13199993319,11cyclictest10679-21ssh23:11:541
13199993312,4cyclictest81rcu_preempt22:15:241
1319999326,15cyclictest14885-21aten_r4power_vo22:10:111
13199993227,3cyclictest137450irq/90-eth022:26:421
13199993215,14cyclictest22-21ksoftirqd/123:32:471
1319999321,4cyclictest81rcu_preempt00:35:231
1319999321,4cyclictest81rcu_preempt00:35:221
13199993214,15cyclictest22-21ksoftirqd/122:30:081
1319999321,20cyclictest577-21ssh23:01:281
5672311,26sleep1578-21ssh21:21:201
1319999316,5cyclictest81rcu_preempt21:16:001
1319999314,5cyclictest81rcu_preempt22:50:221
1319999312,4cyclictest81rcu_preempt23:22:521
1319999311,4cyclictest81rcu_preempt22:55:281
13199993113,14cyclictest22-21ksoftirqd/123:57:531
278052301,4sleep127837-21missed_timers20:00:211
178852301,5sleep10-21swapper/121:40:011
1319999308,14cyclictest201rcuc/122:08:311
1319999308,14cyclictest201rcuc/122:08:311
1319999306,5cyclictest0-21swapper/100:32:081
1319999305,21cyclictest0-21swapper/122:21:261
1319999303,4cyclictest23993-21rt-features21:45:261
1319999301,25cyclictest0-21swapper/121:31:331
13199993012,4cyclictest22-21ksoftirqd/123:28:321
13199993012,15cyclictest22-21ksoftirqd/122:47:521
13199993012,14cyclictest28293-21hddtemp_smartct21:50:171
47552291,5sleep10-21swapper/100:45:481
192942291,5sleep10-21swapper/119:38:281
1319999295,4cyclictest81rcu_preempt20:25:041
1319999294,18cyclictest30284-21users20:05:281
1319999294,18cyclictest30284-21users20:05:281
1319999294,17cyclictest0-21swapper/120:42:241
1319999292,7cyclictest0-21swapper/122:37:051
1319999292,23cyclictest5519-21hddtemp_smartct23:40:181
1319999291,4cyclictest81rcu_preempt20:15:041
1319999291,26cyclictest0-21swapper/123:15:301
267082281,5sleep10-21swapper/119:57:211
136152281,5sleep10-21swapper/120:50:091
136152281,5sleep10-21swapper/120:50:091
1319999284,4cyclictest0-21swapper/122:40:171
1319999284,18cyclictest24657-21diskstats00:00:151
1319999283,4cyclictest81rcu_preempt19:30:311
1319999282,22cyclictest0-21swapper/123:51:271
13199992813,12cyclictest22-21ksoftirqd/121:10:401
1319999281,22cyclictest2747-21hddtemp_smartct20:20:171
13199992812,12cyclictest1974-21lldpad20:35:291
1319999281,16cyclictest22-21ksoftirqd/100:54:321
1319999281,15cyclictest6463-21ssh00:15:051
13198992811,6cyclictest23823-21fschecks_time19:50:160
210762271,5sleep10-21swapper/119:42:171
1319999277,17cyclictest22-21ksoftirqd/120:10:281
1319999275,4cyclictest81rcu_preempt21:04:441
13199992719,5cyclictest16244-21needreboot20:55:211
13199992617,6cyclictest22-21ksoftirqd/119:50:241
13199992614,9cyclictest22-21ksoftirqd/121:05:311
13199992613,10cyclictest22-21ksoftirqd/120:45:241
13198992516,6cyclictest3-21ksoftirqd/020:08:370
13198992516,6cyclictest3-21ksoftirqd/020:08:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional