You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 01:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu May 21, 2026 12:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
164489911911147,40cyclictest16768-21cpuspeed_turbos07:25:120
164499911801152,24cyclictest16645-21wget07:25:121
164499911721153,16cyclictest25030-21strings10:35:231
160632588540,33sleep00-21swapper/007:21:300
160632588540,33sleep00-21swapper/007:21:300
163192462419,29sleep10-21swapper/107:24:121
163192462419,29sleep10-21swapper/107:24:111
1644899251223,25cyclictest0-21swapper/010:35:230
44232920,3sleep00-21swapper/008:15:160
16449996413,5cyclictest32710-21basename09:30:191
1644999621,7cyclictest21047-21grep09:00:111
1644999603,7cyclictest22894-21hddtemp_smartct10:30:171
1644999593,51cyclictest3286-21runrttasks11:20:191
16449995911,6cyclictest263562chrt07:46:111
1644999591,15cyclictest6344-21taskset12:38:521
1644999583,48cyclictest2266-21diskstats08:10:151
16449995813,5cyclictest32379-21latency_hist08:05:011
1644999572,7cyclictest7192-21latency_hist09:50:001
16449995711,6cyclictest8353-21latency_hist12:45:011
16449995710,6cyclictest242312chrt07:40:351
1644999559,5cyclictest0-21swapper/112:07:381
1644999554,7cyclictest1362-21hddtemp_smartct12:25:161
1644999553,9cyclictest20822-21diskstats10:25:141
1644999553,7cyclictest25195-21users12:00:291
1644999552,8cyclictest4288-21memory09:40:201
11402550,4sleep028294-21kworker/0:112:25:120
1644999544,44cyclictest3917-21memory11:05:201
16449995413,4cyclictest0-21swapper/111:19:141
16449995410,4cyclictest0-21swapper/107:30:251
1644999532,7cyclictest11008-21iostat12:50:171
16449995311,3cyclictest0-21swapper/112:45:271
1644999521,9cyclictest9595-21/usr/sbin/munin08:30:151
1644999521,8cyclictest3286-21runrttasks08:58:241
1644999521,6cyclictest3286-21runrttasks08:46:231
16449995216,31cyclictest14053-21switchtime10:05:301
16449995210,37cyclictest0-21swapper/111:10:261
1644999516,5cyclictest0-21swapper/110:55:241
1644999513,9cyclictest28735-21memory10:45:201
1644999513,14cyclictest0-21swapper/110:00:011
1644999512,8cyclictest25248-21irqstats09:10:201
1644999512,44cyclictest0-21swapper/110:20:241
1644999511,9cyclictest7300-21seq08:22:221
16449995117,30cyclictest30308-21needreboot12:15:231
16449995114,6cyclictest11350-21iostat_ios11:25:201
16449995112,6cyclictest4544-21iostat_ios08:15:201
16449995112,4cyclictest0-21swapper/111:32:241
1644999511,11cyclictest28855-21fschecks_time09:20:161
16449995110,36cyclictest0-21swapper/108:40:151
1644999509,8cyclictest0-21swapper/108:35:111
1644999503,9cyclictest564-21hddtemp_smartct08:05:161
1644999503,9cyclictest27351-21ntp_states09:15:261
1644999503,8cyclictest15101-21iostat11:35:201
1644999502,7cyclictest20159-21/usr/sbin/munin11:50:291
1644999502,6cyclictest0-21swapper/110:15:171
1644999502,14cyclictest8298-21/usr/sbin/munin09:50:281
1644999502,12cyclictest0-21swapper/107:50:111
16449995012,6cyclictest2555-21sshd11:00:311
16449995012,3cyclictest0-21swapper/111:48:331
1644999494,12cyclictest0-21swapper/110:00:201
1644999492,8cyclictest30206-21df10:50:141
1644999492,7cyclictest22764-21/usr/sbin/munin09:05:321
1644999492,7cyclictest0-21swapper/110:40:081
16449994912,6cyclictest17415-21diskstats08:50:151
16449994911,6cyclictest16602-21latency_hist10:15:011
1644999488,4cyclictest0-21swapper/112:30:271
1644999483,7cyclictest29399-21munin-run12:15:001
1644999483,14cyclictest0-21swapper/107:35:091
1644999482,14cyclictest1890-21diskstats09:35:141
1644999482,11cyclictest0-21swapper/111:58:031
1644999481,8cyclictest0-21swapper/112:20:111
16449994810,7cyclictest2225-21dbus-daemon08:25:231
142882480,4sleep041ktimersoftd/010:05:380
1644999474,8cyclictest29060-21diskstats07:55:151
1644999473,7cyclictest2695-21snmpd11:43:301
1644999471,14cyclictest31827-21taskset09:28:071
22522370,3sleep00-21swapper/008:10:130
186142361,5sleep00-21swapper/008:52:480
16448993527,5cyclictest3-21ksoftirqd/011:10:140
1644899352,21cyclictest25506-21hddtemp_smartct07:45:170
1644899351,13cyclictest28335-21/usr/sbin/munin10:45:130
44922341,9sleep00-21swapper/012:34:070
1644899341,6cyclictest12472-21munin-run11:29:590
1644899333,16cyclictest19430-21diskstats07:30:140
1644899333,12cyclictest0-21swapper/008:45:300
1644899331,20cyclictest21056-21tr09:00:110
105232331,5sleep010604-21python08:30:260
1644899328,13cyclictest17152-21sort10:15:160
1644899327,13cyclictest81rcu_preempt09:30:300
1644899321,20cyclictest31168-21taskset12:18:550
1644899319,11cyclictest15811-21gzip10:10:260
1644899317,11cyclictest721-21latency_hist12:25:010
16448993122,6cyclictest3-21ksoftirqd/010:55:240
1644899311,4cyclictest81rcu_preempt11:42:360
1644899311,4cyclictest81rcu_preempt09:55:290
16448993112,6cyclictest6935-21diskstats12:40:140
1644899311,13cyclictest7521-21kworker/u4:207:43:400
1644899303,14cyclictest18566-21df11:45:140
1644899302,15cyclictest9037-21hddtemp_smartct12:45:160
1644899302,15cyclictest5573-21ntp_states12:35:250
1644899302,15cyclictest25471-21ntp_states09:10:250
1644899302,15cyclictest1713-21perl11:00:150
1644899301,4cyclictest81rcu_preempt11:05:540
1644899301,4cyclictest81rcu_preempt09:20:420
1644899301,4cyclictest81rcu_preempt08:21:340
1644899301,4cyclictest81rcu_preempt08:06:080
1644899301,14cyclictest11749-21watchsnmpd12:51:000
282762291,5sleep00-21swapper/007:51:420
207522290,8sleep01644899cyclictest11:50:170
1644899292,15cyclictest23665-21/usr/sbin/munin10:30:310
1644899292,15cyclictest23050-21python11:55:280
1644899291,4cyclictest81rcu_preempt09:15:420
1644899291,4cyclictest81rcu_preempt08:01:050
16448992914,8cyclictest30223-21diskstats10:50:150
1644899291,16cyclictest8556-21/usr/sbin/munin08:25:250
1644899291,15cyclictest30809-21/usr/sbin/munin09:25:170
16448992910,5cyclictest19103-21tr08:55:100
1644899284,16cyclictest0-21swapper/012:00:060
1644899284,16cyclictest0-21swapper/010:41:040
1644899283,3cyclictest81rcu_preempt08:35:580
1644899283,11cyclictest0-21swapper/011:37:420
1644899282,14cyclictest0-21swapper/010:21:220
1644899282,13cyclictest30026-21users07:55:300
1644899281,4cyclictest81rcu_preempt12:14:510
1644899281,4cyclictest81rcu_preempt08:40:050
1644899281,22cyclictest23722-21awk09:05:270
1644899281,14cyclictest3611-21aten_r4power_cu09:40:100
1644899281,14cyclictest11940-21ntpdc10:00:240
1644899281,13cyclictest8190-21/usr/sbin/munin11:15:290
16448992811,14cyclictest0-21swapper/010:25:400
16448992810,6cyclictest14003-21taskset11:31:260
16448992810,5cyclictest81rcu_preempt09:45:210
1644899274,8cyclictest7651-21diskstats09:50:160
1644899274,14cyclictest0-21swapper/011:21:030
16448992717,6cyclictest2695-21snmpd07:36:160
16448992711,11cyclictest1669-21hostname09:35:110
273902261,5sleep00-21swapper/012:08:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional