You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 02:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack5slot3s.osadl.org (updated Mon Jan 05, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
124872204168,24sleep20-21swapper/219:06:282
127162201165,24sleep10-21swapper/119:09:241
125142201164,25sleep00-21swapper/019:06:450
124882201165,24sleep30-21swapper/319:06:293
929721450,3sleep01284999cyclictest21:25:180
174942480,2sleep011-21rcuc/019:15:290
1285999402,21cyclictest775-21dbus-daemon19:10:272
1285999392,26cyclictest23662-21sed19:30:242
1285999391,28cyclictest30988-21/usr/sbin/munin23:30:122
1285999381,20cyclictest19140-21sh21:50:012
12849993812,13cyclictest13182-21munin-run22:50:020
1285999361,20cyclictest16727-21pmu-power22:55:202
1285999351,5cyclictest22568-21cut21:55:212
1285999351,23cyclictest16944-21latency_hist21:45:012
1285999351,19cyclictest31442-21ntp_states22:15:222
1284999359,13cyclictest2193-21munin-run22:25:010
12849993510,12cyclictest16346-21basename20:30:010
1285999341,3cyclictest12050irq/123-ahci[0022:10:012
1285999341,3cyclictest12050irq/123-ahci[0022:10:012
1284999346,13cyclictest18225-21munin-run00:15:000
1285999331,6cyclictest23986-21awk00:25:242
1285999331,5cyclictest747-21/usr/sbin/munin23:35:242
1285999331,4cyclictest0-21swapper/223:15:132
1285999322,4cyclictest23468-21smart_sda23:10:292
1285999321,6cyclictest32660-21idleruntime21:05:222
1285999321,17cyclictest14039-21/usr/sbin/munin00:05:132
1284999329,11cyclictest24188-21awk23:15:010
1285999319,19cyclictest31749-21sort21:05:012
1285999315,12cyclictest88650irq/133-enp2s0-23:20:172
1285999312,5cyclictest15342-21diskstats19:15:032
1285999312,4cyclictest20014-21smart_sda20:35:232
1285999312,4cyclictest18859-21ntp_states23:00:222
1285999312,25cyclictest20632-21smart_sda21:50:262
1285999311,7cyclictest14653-21cstates20:25:122
1285999311,4cyclictest8876-21sed23:50:272
1285999311,4cyclictest13399-21/usr/sbin/munin22:50:122
1285999311,4cyclictest0-21swapper/222:10:162
1285999311,20cyclictest801-21snmpd22:35:142
1285999311,16cyclictest8154-21latency_hist21:25:022
1285599318,2cyclictest21384-21cat21:55:011
1285999308,19cyclictest6555-21tr20:05:202
1285999305,22cyclictest5870-21grep23:45:162
1285999305,13cyclictest12050irq/123-ahci[0023:45:022
1285999302,6cyclictest27543-21/usr/sbin/munin20:55:242
1285999302,6cyclictest27543-21/usr/sbin/munin20:55:242
1285999302,3cyclictest20004-21/usr/sbin/munin23:05:142
1285999301,4cyclictest0-21swapper/222:40:232
1285999301,3cyclictest29510-21basename23:25:192
1285999301,2cyclictest0-21swapper/222:05:022
1285999301,26cyclictest24143-21cut20:45:182
12859993011,16cyclictest9048-21grep20:10:272
1285999296,20cyclictest1305-21cpuspeed_turbos19:55:142
1285999296,19cyclictest24824-21cpuspeed_turbos19:35:132
1285999295,22cyclictest13433-21vmstat00:00:312
1285999295,20cyclictest3004-21grep22:25:172
1285999291,6cyclictest3361-21/usr/sbin/munin20:00:152
1285999291,5cyclictest3991-21/usr/sbin/munin21:15:142
1285999291,4cyclictest8729-21diskstats21:25:142
1285999291,4cyclictest22308-21/usr/sbin/munin19:30:012
1285999291,3cyclictest31326-21/usr/sbin/munin19:50:342
1285999291,2cyclictest11643-21ntp_states21:30:222
12859992912,15cyclictest25036-21/usr/sbin/munin00:30:212
12859992912,15cyclictest25036-21/usr/sbin/munin00:30:212
1285999291,15cyclictest20499-21sed00:20:012
12859992911,15cyclictest26201-21sort20:50:182
1285999290,4cyclictest0-21swapper/220:40:132
1285999290,2cyclictest0-21swapper/220:19:412
1285999290,13cyclictest0-21swapper/220:20:142
165862280,3sleep10-21swapper/122:55:181
1285999286,19cyclictest14298-21grep21:35:282
1285999282,4cyclictest27462-21uniq19:40:182
1285999282,3cyclictest457-21diskstats22:20:152
1285999281,4cyclictest904-21sssd_nss22:30:232
1285999281,4cyclictest17854-21sshd00:10:302
1285999281,4cyclictest10531-21memory23:55:202
1285999281,3cyclictest1876-21/usr/sbin/munin21:10:132
1284999280,13cyclictest22933-21awk20:45:010
272992270,2sleep1221ktimersoftd/100:35:141
1285999278,16cyclictest29874-21if_enp2s019:45:152
1285999278,16cyclictest29874-21if_enp2s019:45:152
1285999271,4cyclictest17372-21chrt20:30:182
1285999271,4cyclictest11259-21/usr/sbin/munin22:45:122
1285999271,3cyclictest904-21sssd_nss00:35:172
1285999271,3cyclictest21318-21hddtemp_smartct00:20:182
1285999271,3cyclictest18952-21irqstats19:20:212
1286699269,6cyclictest15682-21cpuspeed_turbos22:55:113
12849992611,4cyclictest0-21swapper/023:24:300
1286699258,3cyclictest27352-21grep22:05:253
1286699258,3cyclictest27352-21grep22:05:253
1285599259,13cyclictest22189-21unixbench_singl00:20:281
1285599251,17cyclictest0-21swapper/119:41:451
1284999250,12cyclictest12286-21kworker/0:221:35:010
228022230,3sleep31286699cyclictest23:10:203
12866992317,3cyclictest3879-21grep20:00:173
1285599239,4cyclictest324742grep19:50:271
1285599236,3cyclictest13206-21fschecks_count21:35:161
1284999234,16cyclictest25752-21munin-run22:05:000
1286699228,3cyclictest493-21jbd2/dm-0-822:39:363
1286699226,4cyclictest0-21swapper/321:25:233
1286699225,14cyclictest0-21swapper/320:55:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional