You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 21:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #9, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack9slot4s (updated Sat Jul 25, 2026 12:59:01)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12429912691,1243cyclictest1997-21irqstats07:25:221
12419912651225,36cyclictest2154-21strings07:25:230
12429911281120,5cyclictest21248-21strings11:05:231
9752564518,30sleep10-21swapper/107:22:491
11622564516,32sleep00-21swapper/007:24:450
40562960,8sleep0124199cyclictest07:30:110
285602790,4sleep028562-21sh08:35:000
1241997150,17cyclictest6056-21kworker/0:211:05:220
44002450,5sleep0111rcuc/011:45:290
150842371,4sleep12695-21snmpd07:56:531
1242993628,5cyclictest31159-21users11:30:311
327542351,30sleep1312-21df_inode08:45:141
124299359,4cyclictest81rcu_preempt08:00:141
1242993526,6cyclictest5774-21/usr/sbin/munin11:50:241
1241993511,12cyclictest13209-21latency_hist09:20:010
231802340,3sleep1211ktimersoftd/108:20:131
1242993424,6cyclictest3638-21fschecks_time11:45:161
199692331,27sleep120070-21latency_hist12:30:001
134322331,28sleep113439-21ntp_states12:10:271
124299335,4cyclictest81rcu_preempt10:20:341
124199337,12cyclictest30228-21fschecks_count11:30:170
124199336,12cyclictest26542-21seq08:28:340
124199331,14cyclictest41942df08:55:140
170952327,21sleep117181-21cut09:30:131
124299321,17cyclictest19660-21grep08:10:171
124199329,10cyclictest0-21swapper/010:31:410
124199327,12cyclictest5722-21expr10:25:150
124199324,14cyclictest32253-21tune2fs11:35:190
124199323,4cyclictest81rcu_preempt12:45:300
124199322,15cyclictest29404-21python10:00:310
124199321,4cyclictest81rcu_preempt12:30:250
1241993213,6cyclictest9494-21df_inode10:35:160
1241993213,5cyclictest28512-21ntp_states12:50:230
1241993212,11cyclictest0-21swapper/011:20:470
104552321,4sleep111564-21packagekitd12:03:531
287992311,4sleep128941-21users12:50:281
258342319,4sleep111565-21gdbus11:18:431
17122311,26sleep01735-21/usr/sbin/munin11:40:190
1242993113,6cyclictest12810-21cron10:45:001
124199318,11cyclictest13422-21ntp_kernel_pll_12:10:260
1241993114,5cyclictest17327-21irqstats10:55:210
1241993112,6cyclictest6823-21/usr/sbin/munin09:00:280
1241993112,5cyclictest11565-21gdbus08:43:270
1241993111,6cyclictest22509-21hddtemp_smartct12:35:190
124199311,12cyclictest19743-21runrttasks12:27:370
112772311,26sleep111327-21iostat12:05:221
206742301,25sleep120701-21pidof09:40:001
1242993023,4cyclictest211ktimersoftd/109:10:311
1242993023,4cyclictest211ktimersoftd/109:10:301
124299302,24cyclictest25791-21tail09:50:311
124299301,5cyclictest81rcu_preempt07:46:321
124299301,4cyclictest81rcu_preempt11:20:191
124299301,4cyclictest285622sh08:35:001
1242993013,13cyclictest28966-21interrupts10:00:211
1242993011,15cyclictest3824-21cat08:55:001
124299300,4cyclictest81rcu_preempt12:20:561
124199305,11cyclictest11510-21fschecks_time10:40:180
124199302,24cyclictest12439-21ntp_states07:50:240
124199302,14cyclictest321-21diskstats08:45:150
1241993019,7cyclictest0-21swapper/010:52:390
1241993018,7cyclictest19023-21wget09:35:120
124199301,17cyclictest0-21swapper/007:40:220
124199301,15cyclictest31970-21cron10:10:010
75192291,5sleep10-21swapper/107:38:261
296492291,5sleep00-21swapper/011:29:120
239302291,5sleep00-21swapper/011:13:270
227692291,5sleep10-21swapper/108:18:341
200812291,5sleep10-21swapper/111:02:241
182942291,5sleep10-21swapper/110:58:321
159022291,5sleep00-21swapper/012:16:590
158412296,6sleep122-21ksoftirqd/112:16:191
149602291,5sleep00-21swapper/007:55:340
134922291,5sleep10-21swapper/107:54:511
13022291,5sleep00-21swapper/010:14:030
124299294,9cyclictest6106-21diskstats09:00:161
124299292,23cyclictest23731-21munin-run12:40:011
124299291,4cyclictest81rcu_preempt11:42:511
124299291,3cyclictest81rcu_preempt09:16:051
1242992910,7cyclictest84162chrt11:57:201
124199299,7cyclictest15325-21wget09:25:130
124199299,6cyclictest16681-21diskstats12:20:170
124199294,4cyclictest81rcu_preempt09:14:470
124199294,4cyclictest81rcu_preempt09:14:470
124199293,10cyclictest0-21swapper/009:30:240
124199292,14cyclictest21160-21diskstats09:40:150
124199292,13cyclictest9135-21df12:00:130
124199291,4cyclictest81rcu_preempt07:46:430
124199291,15cyclictest25637-21watchsnmpd12:45:000
124199291,14cyclictest4365-21awk10:20:230
124199291,13cyclictest20631-21runrttasks08:10:510
93092281,5sleep10-21swapper/109:09:081
55102281,5sleep10-21swapper/107:32:291
321282281,4sleep10-21swapper/108:42:581
300362281,5sleep10-21swapper/108:35:561
280002281,5sleep10-21swapper/109:57:581
238142281,4sleep10-21swapper/111:12:131
226262281,4sleep00-21swapper/008:17:030
165892281,5sleep10-21swapper/109:26:291
147932281,5sleep10-21swapper/109:22:191
124299285,4cyclictest81rcu_preempt10:38:181
124299284,18cyclictest32436-21diskstats10:10:161
124299284,16cyclictest0-21swapper/112:45:551
124299281,4cyclictest81rcu_preempt07:44:131
124199289,7cyclictest18272-21/usr/sbin/munin08:05:270
124199289,6cyclictest27464-21tr09:55:280
124199282,13cyclictest20416-21ls11:05:010
124199281,4cyclictest81rcu_preempt08:52:400
124199281,14cyclictest3286-21runrttasks09:08:110
124199281,14cyclictest25045-21ntp_kernel_err11:15:240
124199281,12cyclictest6470-21taskset11:51:360
10072281,5sleep10-21swapper/111:39:561
86512271,5sleep10-21swapper/110:31:001
85262271,4sleep00-21swapper/011:58:290
54392271,5sleep10-21swapper/108:58:091
241642271,5sleep10-21swapper/109:47:021
241642271,5sleep10-21swapper/109:47:021
216142271,5sleep10-21swapper/112:32:361
162942271,5sleep10-21swapper/110:52:131
124299276,4cyclictest81rcu_preempt10:19:381
124299274,15cyclictest0-21swapper/110:49:361
124299274,14cyclictest0-21swapper/109:44:011
124299273,11cyclictest26034-21sort08:25:291
124299272,11cyclictest29087-21taskset11:25:271
124299270,4cyclictest81rcu_preempt10:28:021
124199278,6cyclictest24299-21sed08:20:300
124199272,12cyclictest6563-21irqstats07:35:210
124199271,13cyclictest15888-21grep08:00:160
124199271,13cyclictest11565-21gdbus10:17:210
1241992710,5cyclictest30382-21taskset08:39:290
189452261,4sleep10-21swapper/108:07:491
124199262,4cyclictest81rcu_preempt09:54:000
124199261,14cyclictest14027-21load09:20:210
124299251,9cyclictest31452-21sed10:05:321
124299251,9cyclictest25634-21needreboot12:45:001
124199258,5cyclictest10736-21aten_r4power_cu12:05:140
124199251,7cyclictest23601-21/usr/sbin/munin09:45:270
124199251,7cyclictest23601-21/usr/sbin/munin09:45:270
1241992510,4cyclictest14025-21switchtime10:45:290
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional