You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 17:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack9slot4s (updated Sat Jun 20, 2026 12:59:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123409912671,4cyclictest14242-21anacron07:30:001
119172577531,31sleep00-21swapper/007:21:070
120082454358,29sleep10-21swapper/107:22:061
1233999225217,5cyclictest14236-21awk07:30:000
234162880,4sleep1211ktimersoftd/112:10:001
100502810,5sleep0111rcuc/008:40:240
87712770,3sleep041ktimersoftd/010:05:000
12339994224,6cyclictest3-21ksoftirqd/011:50:280
138452390,7sleep01233999cyclictest08:50:250
1233999392,14cyclictest81rcu_preempt08:15:220
41032375,28sleep13228-21/usr/sbin/munin09:50:271
161122371,32sleep12695-21snmpd10:23:351
12340993610,6cyclictest0-21swapper/112:20:221
1233999362,21cyclictest20824-21df_inode09:10:140
1233999361,22cyclictest27190-21pidof12:20:000
1233999361,22cyclictest27190-21pidof12:19:590
1234099351,8cyclictest3286-21runrttasks12:25:161
1234099351,12cyclictest256942grep07:55:291
12339993515,6cyclictest28263-21munin-run08:04:590
1233999349,13cyclictest81rcu_preempt10:25:300
26592331,28sleep11619-21/usr/sbin/munin08:20:281
1234099333,4cyclictest81rcu_preempt12:33:591
12340993310,10cyclictest26515-21fschecks_count09:25:171
1233999339,12cyclictest10468-21aten_r4power_po11:35:110
76682321,4sleep17843-21perl08:35:171
72932321,27sleep17300-21diskstats10:00:151
1234099324,11cyclictest2749-21diskstats12:40:141
1234099321,4cyclictest81rcu_preempt09:48:081
1234099321,17cyclictest374-21runrttasks11:06:321
12339993213,5cyclictest15857-21ntp_states07:30:260
12339993212,7cyclictest21881-21cron10:40:000
12339993212,6cyclictest24171-21/usr/sbin/munin12:10:190
1233999321,16cyclictest12301-21/usr/sbin/munin11:40:140
126882311,5sleep10-21swapper/108:48:241
1233999311,4cyclictest81rcu_preempt08:12:400
12339993113,6cyclictest3069-21munin-run09:50:000
1233999311,19cyclictest6480-21grep08:30:260
90172301,25sleep19051-21ls11:30:191
43132301,5sleep00-21swapper/011:17:090
327492301,5sleep00-21swapper/012:34:200
20302301,5sleep00-21swapper/012:37:490
136632301,5sleep10-21swapper/111:41:221
1234099307,7cyclictest20166-21/usr/sbin/munin10:35:321
1234099305,4cyclictest81rcu_preempt07:36:531
1234099303,15cyclictest0-21swapper/110:40:221
1234099302,24cyclictest23185-21iostat_ios07:50:191
12340993020,6cyclictest11561-21/usr/sbin/munin10:10:241
1234099301,4cyclictest40250irq/92-i91508:30:261
1234099301,16cyclictest18892-21irqstats10:30:191
12339993014,5cyclictest3-21ksoftirqd/009:54:510
12339993012,5cyclictest627-21/usr/sbin/munin09:40:310
12339993012,5cyclictest11565-21gdbus11:27:080
1233999301,17cyclictest0-21swapper/012:03:200
1233999301,13cyclictest26631-21ntp_kernel_pll_10:50:240
65832291,5sleep10-21swapper/109:57:311
62812291,5sleep10-21swapper/111:22:571
311012291,5sleep00-21swapper/011:02:590
290062291,5sleep00-21swapper/012:24:260
223722291,5sleep00-21swapper/007:49:290
158042291,5sleep00-21swapper/010:20:310
1234099296,4cyclictest81rcu_preempt12:03:311
1234099296,3cyclictest81rcu_preempt11:56:211
1234099295,4cyclictest81rcu_preempt11:38:311
1234099295,4cyclictest81rcu_preempt11:28:321
1234099295,4cyclictest81rcu_preempt10:58:261
1234099291,4cyclictest81rcu_preempt12:46:351
12340992912,6cyclictest22-21ksoftirqd/111:12:161
1233999294,18cyclictest25297-21ntp_states07:55:250
1233999292,4cyclictest81rcu_preempt09:59:100
1233999292,15cyclictest0-21swapper/012:27:100
1233999292,14cyclictest15188-21python11:45:240
1233999291,4cyclictest81rcu_preempt08:25:110
12339992914,5cyclictest3-21ksoftirqd/009:32:490
12339992914,12cyclictest0-21swapper/010:08:280
12339992912,5cyclictest12396-21/usr/sbin/munin08:45:300
1233999291,23cyclictest5147-21sshd11:20:150
12339992911,5cyclictest16731-21latency_hist09:00:000
10532291,5sleep10-21swapper/108:16:111
49872281,5sleep10-21swapper/108:26:361
312362281,5sleep10-21swapper/109:35:451
301132281,5sleep00-21swapper/008:09:510
25222281,5sleep00-21swapper/011:13:590
251912281,5sleep10-21swapper/112:14:021
235292281,5sleep00-21swapper/010:42:280
184182281,5sleep00-21swapper/007:37:360
164022281,5sleep10-21swapper/108:58:021
155552281,4sleep10-21swapper/111:46:331
1234099289,15cyclictest5092chrt12:35:051
1234099286,4cyclictest81rcu_preempt10:46:241
1234099285,3cyclictest81rcu_preempt10:50:521
1234099284,5cyclictest81rcu_preempt08:00:161
1234099284,3cyclictest81rcu_preempt08:07:101
1234099282,24cyclictest0-21swapper/110:17:091
12340992812,12cyclictest2858-21/usr/sbin/munin11:15:281
1233999282,13cyclictest4902-21perl12:45:150
12339992811,5cyclictest27978-21df_inode10:55:140
12339992811,5cyclictest2481-21ntpq08:20:240
1233999281,15cyclictest10321-21latency_hist11:35:010
1233999281,14cyclictest3286-21runrttasks09:17:550
1233999281,13cyclictest18365-21cut11:55:160
1233999281,11cyclictest18766-21cpu09:05:120
307702271,4sleep00-21swapper/009:35:270
256152271,5sleep10-21swapper/109:20:471
218332271,5sleep10-21swapper/109:10:431
179052271,5sleep10-21swapper/110:27:441
1234099278,4cyclictest30978-21latency08:10:231
1234099273,4cyclictest81rcu_preempt07:30:071
1234099272,9cyclictest16883-21ntp_states11:50:261
12340992716,7cyclictest19533-21cat07:40:231
1234099271,4cyclictest81rcu_preempt09:05:451
1233999273,18cyclictest22882-21diskstats07:50:140
1233999272,4cyclictest81rcu_preempt08:37:000
1233999271,8cyclictest26516-21fschecks_count09:25:170
1233999271,7cyclictest13886-21grep10:15:300
1233999271,21cyclictest18911-21cut07:40:120
1233999271,14cyclictest11565-21gdbus10:48:580
1233999271,13cyclictest31947-21tune2fs11:05:160
1233999271,13cyclictest18266-21runrttasks09:02:420
12339992710,5cyclictest7828-21chrt12:52:580
12339992710,5cyclictest22169-21perl12:05:180
105882271,5sleep10-21swapper/108:41:081
103942271,5sleep10-21swapper/110:07:581
9412261,5sleep10-21swapper/109:43:361
78392261,5sleep10-21swapper/112:53:041
220922261,5sleep10-21swapper/107:46:351
1234099264,4cyclictest81rcu_preempt09:31:081
1234099263,8cyclictest17074-21diskstats09:00:151
1234099261,3cyclictest81rcu_preempt08:50:191
1234099261,11cyclictest23243-21ntp_states09:15:261
1233999262,13cyclictest0-21swapper/010:30:190
12339992616,6cyclictest3-21ksoftirqd/012:40:100
1234099253,4cyclictest81rcu_preempt11:01:141
1234099252,10cyclictest27177-21munin-run12:20:001
1234099252,10cyclictest27177-21munin-run12:20:001
1233999251,12cyclictest25320-21mailstats09:20:260
1233999241,19cyclictest11642-21ps10:10:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional