You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 10:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack9slot4s (updated Thu Jun 11, 2026 00:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83579912391204,31cyclictest8997-21smartctl19:25:160
83589911031073,26cyclictest8794-21diskstats19:25:131
79062647602,30sleep10-21swapper/119:20:521
81482627580,32sleep00-21swapper/019:23:220
108722680,8sleep0835799cyclictest22:20:180
8922600,2sleep0896-21ntp_kernel_pll_00:45:250
54752480,21sleep03-21ksoftirqd/023:30:270
82432352,4sleep18253-21latency_hist22:15:011
835799341,12cyclictest0-21swapper/000:12:260
309262341,4sleep130933-21df_inode00:40:151
241522341,5sleep124208-21cat22:55:221
203692331,4sleep120373-21diskstats21:20:131
835799321,7cyclictest81rcu_preempt00:54:200
8357993210,19cyclictest0-21swapper/023:44:060
42082320,3sleep0111rcuc/022:02:000
35462321,5sleep10-21swapper/100:52:211
212392321,4sleep121250-21ntp_states19:55:251
175822321,26sleep117747-21df00:05:111
137212320,3sleep1201rcuc/119:35:231
124522322,4sleep112476-21df_inode22:25:131
8358993117,8cyclictest16539-21iostat_ios22:35:201
8358993117,7cyclictest1425-21diskstats20:30:141
8357993116,8cyclictest21887-21diskstats22:50:150
253702311,27sleep02225-21dbus-daemon21:33:140
160042311,26sleep12225-21dbus-daemon21:08:421
8358993020,6cyclictest5158-21/usr/sbin/munin23:30:241
835799302,14cyclictest31557-21munin-run20:25:000
835799301,4cyclictest81rcu_preempt22:10:020
835799301,24cyclictest17805-21grep00:05:140
8357993010,5cyclictest1440-21python23:20:260
66752301,5sleep00-21swapper/020:44:290
251832301,5sleep10-21swapper/121:31:171
182542301,5sleep00-21swapper/019:48:450
835899294,18cyclictest30436-21iostat_ios20:20:191
835899293,23cyclictest0-21swapper/122:02:531
835899292,23cyclictest0-21swapper/120:56:381
8358992919,6cyclictest8798-21aten_r4power_cu20:50:101
835799298,6cyclictest22785-21ntp_states21:25:240
835799293,19cyclictest2157-21python20:30:250
835799292,22cyclictest12675-21perl22:25:140
835799292,14cyclictest3436-21python23:25:280
835799291,4cyclictest81rcu_preempt23:10:520
835799291,4cyclictest81rcu_preempt22:45:050
835799291,4cyclictest81rcu_preempt21:04:250
835799291,4cyclictest81rcu_preempt20:46:270
835799291,4cyclictest81rcu_preempt20:37:340
835799291,4cyclictest81rcu_preempt19:56:230
835799291,4cyclictest81rcu_preempt00:40:110
835799291,24cyclictest15564-21taskset22:32:470
835799291,15cyclictest13115-21/usr/sbin/munin19:35:110
8357992910,15cyclictest4832-21cpuspeed_turbos22:05:110
8357992910,15cyclictest257832chrt20:08:460
82372291,5sleep10-21swapper/120:46:121
306852291,5sleep10-21swapper/123:13:361
263382291,5sleep10-21swapper/100:26:111
124112291,5sleep00-21swapper/019:31:420
8358992818,6cyclictest17312-21ls00:05:001
8358992815,10cyclictest22-21ksoftirqd/119:30:051
835799286,12cyclictest40250irq/92-i91520:56:440
835799284,18cyclictest16597-21diskstats21:10:150
835799282,23cyclictest0-21swapper/021:50:110
835799281,4cyclictest81rcu_preempt21:42:540
8357992811,5cyclictest9785-21python20:50:270
8357992811,5cyclictest18857-21grep19:50:150
835799281,13cyclictest27557-21memory00:30:200
835799281,13cyclictest13856-21cpu23:55:120
8357992810,6cyclictest31985-21basename23:15:260
7662281,5sleep10-21swapper/120:27:581
61652281,5sleep10-21swapper/123:35:071
323862281,5sleep10-21swapper/123:16:461
301632281,5sleep10-21swapper/100:36:591
272682281,5sleep10-21swapper/121:38:291
248942281,5sleep00-21swapper/022:57:030
245502281,5sleep10-21swapper/100:22:051
238512281,5sleep10-21swapper/120:03:101
19022281,5sleep10-21swapper/123:22:291
182522281,5sleep10-21swapper/119:48:441
177532281,5sleep10-21swapper/121:12:181
169702281,5sleep00-21swapper/000:01:320
155592281,5sleep10-21swapper/122:32:441
151072281,5sleep10-21swapper/123:56:541
116452281,5sleep00-21swapper/023:49:500
93502271,5sleep10-21swapper/123:40:311
835899274,17cyclictest12123-21diskstats23:50:141
8358992715,9cyclictest22-21ksoftirqd/120:16:071
835799273,4cyclictest81rcu_preempt21:57:520
835799272,9cyclictest28538-21irqstats20:15:200
835799272,12cyclictest0-21swapper/021:35:160
835799271,4cyclictest81rcu_preempt20:27:310
835799271,4cyclictest81rcu_preempt20:11:280
835799271,4cyclictest81rcu_preempt19:43:340
835799271,14cyclictest22711-21taskset20:00:170
8357992710,13cyclictest12049-21cstates23:50:120
65562271,5sleep10-21swapper/120:43:121
62252271,5sleep10-21swapper/122:08:321
47422271,5sleep10-21swapper/120:39:021
37072271,5sleep10-21swapper/123:25:361
309002271,5sleep10-21swapper/121:47:001
287322271,4sleep00-21swapper/000:35:030
286342271,5sleep10-21swapper/123:06:461
282952271,5sleep10-21swapper/100:32:021
274152271,5sleep10-21swapper/120:11:131
264382271,4sleep00-21swapper/000:27:120
255182271,5sleep10-21swapper/120:06:011
230822271,5sleep10-21swapper/122:52:431
835899269,12cyclictest2225-21dbus-daemon00:49:011
835899267,16cyclictest0-21swapper/122:45:261
8358992618,5cyclictest22-21ksoftirqd/100:11:051
835899261,13cyclictest8416-21/usr/sbin/munin22:15:251
8358992610,12cyclictest0-21swapper/121:55:171
835799269,6cyclictest0-21swapper/023:05:130
835799269,4cyclictest0-21swapper/021:20:010
835799267,7cyclictest24532-21seq00:21:550
835799266,10cyclictest0-21swapper/022:39:240
835799262,12cyclictest21717-21hddtemp_smartct00:15:170
8357992619,4cyclictest14811-21fschecks_count21:05:150
835799261,4cyclictest81rcu_preempt21:23:190
835799261,3cyclictest81rcu_preempt22:16:030
195032261,5sleep10-21swapper/122:44:321
163172261,5sleep10-21swapper/119:43:041
835899253,15cyclictest22483-21users00:15:291
8358992518,4cyclictest22-21ksoftirqd/123:45:241
8358992517,4cyclictest22-21ksoftirqd/121:03:511
8358992515,6cyclictest22390-21cut21:25:151
8358992513,9cyclictest22-21ksoftirqd/122:20:161
8357992517,5cyclictest3-21ksoftirqd/023:03:550
835799251,15cyclictest0-21swapper/021:48:200
835899243,16cyclictest19131-21iostat19:50:181
8358992417,4cyclictest22-21ksoftirqd/123:00:221
8358992415,5cyclictest31551-21cpuspeed_turbos21:50:121
8358992414,6cyclictest27602-21/usr/sbin/munin21:40:181
8358992411,8cyclictest2225-21dbus-daemon21:15:121
835799243,4cyclictest81rcu_preempt22:42:080
8357992415,6cyclictest3-21ksoftirqd/023:36:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional