You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 16:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Jul 13, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205865221500,2sleep072-21kcompactd00
246549921300,2sleep20-21swapper/22
2040805211957,55sleep30-21swapper/33
203611129683,6sleep00-21swapper/00
204066928253,11sleep20-21swapper/22
204086927963,10sleep10-21swapper/11
22993422330,2sleep20-21swapper/22
22559482270,2sleep00-21swapper/00
2041170992212,5cyclictest0-21swapper/33
204117099221,16cyclictest0-21swapper/33
204117099221,16cyclictest0-21swapper/33
22517702201,8sleep02251772-21ssh0
204117099201,7cyclictest2518185-21taskset3
204117099201,15cyclictest0-21swapper/33
204117099201,15cyclictest0-21swapper/33
204117099192,12cyclictest2212158-21taskset3
2041170991912,4cyclictest0-21swapper/33
204117099191,15cyclictest66950irq/132-enp1s0-TxRx-33
204117099191,15cyclictest0-21swapper/33
2041170991911,4cyclictest2474483-21chrt3
204117099191,14cyclictest0-21swapper/33
204117099191,14cyclictest0-21swapper/33
204117099191,14cyclictest0-21swapper/33
204117099191,14cyclictest0-21swapper/33
204117099191,14cyclictest0-21swapper/33
204117099191,14cyclictest0-21swapper/33
204117099190,3cyclictest0-21swapper/33
204117099190,15cyclictest0-21swapper/33
23144072180,9sleep22168857-21diskmemload2
2041170991813,3cyclictest0-21swapper/33
204117099181,14cyclictest66950irq/132-enp1s0-TxRx-33
204117099181,14cyclictest0-21swapper/33
204117099181,14cyclictest0-21swapper/33
204117099181,14cyclictest0-21swapper/33
204117099181,14cyclictest0-21swapper/33
204117099181,13cyclictest2251256-21taskset3
204117099181,13cyclictest0-21swapper/33
204117099181,13cyclictest0-21swapper/33
204117099181,13cyclictest0-21swapper/33
204117099180,16cyclictest0-21swapper/33
204117099180,14cyclictest0-21swapper/33
204117099180,14cyclictest0-21swapper/33
204117099180,14cyclictest0-21swapper/33
25284972171,5sleep22168857-21diskmemload2
23887882171,2sleep10-21swapper/11
23487922171,9sleep172-21kcompactd01
22800702171,7sleep12280082-21ssh1
22640252170,2sleep22264342-21kthreadcore2
21912362170,13sleep10-21swapper/11
21830632171,3sleep20-21swapper/22
204117099171,13cyclictest0-21swapper/33
204117099171,13cyclictest0-21swapper/33
204117099171,13cyclictest0-21swapper/33
204117099171,13cyclictest0-21swapper/33
204117099171,13cyclictest0-21swapper/33
204117099171,13cyclictest0-21swapper/33
204117099171,13cyclictest0-21swapper/33
204117099170,15cyclictest0-21swapper/33
204117099170,14cyclictest0-21swapper/33
204117099170,14cyclictest0-21swapper/33
204117099170,14cyclictest0-21swapper/33
204117099170,13cyclictest0-21swapper/33
25107682161,2sleep00-21swapper/00
23826252161,2sleep10-21swapper/11
23657212161,2sleep10-21swapper/11
23302442161,2sleep20-21swapper/22
22466612161,10sleep22246773-21perl2
20902102161,5sleep22090403-21latency_hist2
204117099169,4cyclictest2126705-21taskset3
204117099165,8cyclictest2116428-21turbostat3
204117099161,4cyclictest0-21swapper/33
2041170991612,2cyclictest0-21swapper/33
2041170991611,3cyclictest0-21swapper/33
204117099160,13cyclictest0-21swapper/33
204117099160,12cyclictest0-21swapper/33
25169152151,2sleep10-21swapper/11
24915432151,3sleep10-21swapper/11
24692762151,2sleep10-21swapper/11
24487052151,3sleep12168857-21diskmemload1
24349602150,2sleep20-21swapper/22
23892182151,3sleep02389229-21ssh0
23115452151,4sleep02311555-21ssh0
22768902151,2sleep00-21swapper/00
21851972150,1sleep10-21swapper/11
2041170991512,1cyclictest0-21swapper/33
204117099150,2cyclictest0-21swapper/33
204117099150,12cyclictest0-21swapper/33
204117099150,12cyclictest0-21swapper/33
204117099150,12cyclictest0-21swapper/33
204117099150,12cyclictest0-21swapper/33
204117099150,12cyclictest0-21swapper/33
204117099150,12cyclictest0-21swapper/33
24238672140,2sleep00-21swapper/00
23405242140,2sleep10-21swapper/11
22698102141,1sleep10-21swapper/11
22443402141,4sleep22244351-21ssh2
22005112141,9sleep12200521-21ssh1
20753302143,7sleep02075851-21kthreadcore0
204117099149,3cyclictest0-21swapper/33
204117099148,4cyclictest2074151-21chrt3
204117099148,3cyclictest2158101-21chrt3
204117099140,12cyclictest0-21swapper/33
204117099140,11cyclictest0-21swapper/33
204117099140,11cyclictest0-21swapper/33
24932772131,7sleep02493291-21ssh0
23114522131,7sleep12168857-21diskmemload1
22973452131,6sleep02297382-21munin-run0
22475222133,6sleep12248509-21kthreadcore1
22341502131,3sleep12234164-21ssh1
22088122131,8sleep02208826-21ssh0
21927502131,7sleep22168857-21diskmemload2
21732392131,3sleep22173389-21ntp_192.168.1142
21069772131,8sleep22108573-21cut2
20758522131,8sleep10-21swapper/11
204117099138,3cyclictest20852422sleep33
25178492121,5sleep00-21swapper/00
24436282121,7sleep22443810-21expr2
24335932121,7sleep12433603-21ssh1
24231892121,7sleep12423200-21ssh1
23896452121,5sleep20-21swapper/22
23659302121,6sleep21-21systemd2
23624202120,7sleep02362538-21/usr/sbin/munin0
23570952121,6sleep02168857-21diskmemload0
23373232121,5sleep02168857-21diskmemload0
23309132121,6sleep02168857-21diskmemload0
23053952121,5sleep10-21swapper/11
22378222121,6sleep02168857-21diskmemload0
22192002121,7sleep22219211-21ssh2
22093272121,7sleep12209341-21ssh1
20956372121,6sleep22095509-21sendmail-msp2
20669172125,3sleep12068101-21latency1
25251342111,5sleep12525361-21users1
25034632111,3sleep10-21swapper/11
24939342110,2sleep20-21swapper/22
24844182110,1sleep00-21swapper/00
24821702111,6sleep12482308-21expr1
24774482111,6sleep22477459-21ssh2
24699092111,6sleep02469985-21ssh0
24605882111,6sleep12168857-21diskmemload1
24571272111,4sleep00-21swapper/00
24524672111,4sleep22452687-21hddtemp_smartct2
24409472111,5sleep12168857-21diskmemload1
24264452111,5sleep22426079-21sendmail-msp2
24184052110,7sleep22419670-21grep2
24147432112,4sleep12168857-21diskmemload1
24079392111,4sleep22168857-21diskmemload2
24066602111,3sleep00-21swapper/00
23969072111,5sleep02168857-21diskmemload0
23969072111,5sleep02168857-21diskmemload0
23728782111,3sleep00-21swapper/00
23570282110,2sleep22357042-21ssh2
23439082111,5sleep02344619-21memory0
23378042111,4sleep20-21swapper/22
23362282110,1sleep10-21swapper/11
22867182111,5sleep02168857-21diskmemload0
22816632110,7sleep12283200-21cut1
22601192111,3sleep20-21swapper/22
22374552111,6sleep12237681-21ssh1
22373992111,5sleep02237430-21munin-run0
22285042110,7sleep22228518-21ssh2
22283392111,6sleep12228350-21sh1
22124422111,5sleep12212662-21hddtemp_smartct1
21921192111,6sleep02168857-21diskmemload0
21484462110,1sleep10-21swapper/11
21325522111,4sleep22132675-21diskstats2
20852732111,5sleep12085531-21df_inode1
20590372111,3sleep10-21swapper/11
25204842101,4sleep02168857-21diskmemload0
25170222101,3sleep22168857-21diskmemload2
25084582101,2sleep20-21swapper/22
25005722101,3sleep20-21swapper/22
25003562101,4sleep12168857-21diskmemload1
24998032100,2sleep0171rcu_preempt0
24669642100,1sleep00-21swapper/00
24492222101,4sleep02168857-21diskmemload0
24399022101,4sleep02168857-21diskmemload0
24324902101,4sleep02168857-21diskmemload0
24155112101,3sleep00-21swapper/00
24145522101,5sleep22414565-21ssh2
23923572101,4sleep22168857-21diskmemload2
23923572101,4sleep22168857-21diskmemload2
23824642101,2sleep00-21swapper/00
23729952101,2sleep20-21swapper/22
23728382101,2sleep10-21swapper/11
23457762100,1sleep20-21swapper/22
23302732101,4sleep12168857-21diskmemload1
23206282100,3sleep20-21swapper/22
23190042101,4sleep12319068-21ntp_states1
23154262101,4sleep02168857-21diskmemload0
22957142101,6sleep12168857-21diskmemload1
22768642100,1sleep20-21swapper/22
22698492101,3sleep00-21swapper/00
22599082101,5sleep12259922-21ssh1
22304632100,3sleep22232039-21cut2
22253202101,4sleep02225515-21users0
22188242101,5sleep02218838-21ssh0
22032382101,3sleep20-21swapper/22
21850362101,5sleep02185049-21ssh0
21765912101,2sleep10-21swapper/11
21536572101,4sleep02153780-21perl0
21114962101,5sleep02111726-21df_inode0
21102072101,4sleep12110277-21ntp_states1
20800142101,3sleep00-21swapper/00
20747702101,4sleep22074550-21sendmail-msp2
20695052101,4sleep12069508-21apt-get1
20537972100,1sleep10-21swapper/11
20507542104,3sleep20-21swapper/22
20485912101,4sleep02048594-21apt-get0
2484590291,2sleep20-21swapper/22
2456386291,2sleep10-21swapper/11
2407026291,2sleep10-21swapper/11
2396262291,2sleep10-21swapper/11
2396262291,2sleep10-21swapper/11
2374768291,3sleep22374795-21apt-get2
2297644290,3sleep02168857-21diskmemload0
2293383291,3sleep22168857-21diskmemload2
2285750290,1sleep20-21swapper/22
2202917291,3sleep22168857-21diskmemload2
2200640290,3sleep02168857-21diskmemload0
2175251291,4sleep02175265-21ssh0
2153369291,3sleep12153388-21apt-get1
2148656290,6sleep22148776-21kthreadcore2
2143886291,5sleep12145520-21kthreadcore1
2137640291,3sleep22137659-21apt-get2
2137349291,4sleep12137415-21sendmail-msp1
2131482291,4sleep22131712-21sed2
2126713291,2sleep10-21swapper/11
2116713291,4sleep12116893-21expr1
2111727291,4sleep12111854-21perl1
2094821291,4sleep22095065-21users2
2084939290,1sleep20-21swapper/22
2168522280,4sleep22168525-21sshd-auth2
2158617280,1sleep10-21swapper/11
2152251280,1sleep00-21swapper/00
2143465281,4sleep02143885-21cat0
2137283280,1sleep00-21swapper/00
2137125280,1sleep10-21swapper/11
2127470281,3sleep12127682-21smartctl1
2121970281,3sleep02122149-21expr0
2116691280,2sleep00-21swapper/00
2101255281,3sleep22101344-21grep2
2095738281,2sleep10-21swapper/11
2069219281,4sleep22069354-21sed2
2063746280,1sleep00-21swapper/00
2045996281,3sleep12045998-21modprobe1
2168637270,1sleep10-21swapper/11
2168051271,3sleep02168196-21/usr/sbin/munin0
2158643270,2sleep00-21swapper/00
2157396270,3sleep22157444-21/usr/sbin/munin2
2142332270,1sleep00-21swapper/00
2125082271,2sleep20-21swapper/22
2116197270,1sleep20-21swapper/22
2105731270,1sleep10-21swapper/11
2100994270,2sleep00-21swapper/00
2096029270,3sleep0221rcuc/00
2095213270,1sleep10-21swapper/11
2095118270,1sleep00-21swapper/00
2090128270,1sleep00-21swapper/00
2084660270,1sleep10-21swapper/11
2074325270,1sleep20-21swapper/22
2073381270,3sleep00-21swapper/00
2063678270,1sleep20-21swapper/22
2055661271,3sleep22057413-21grep2
2043183271,3sleep00-21swapper/00
2041313270,2sleep20-21swapper/22
2160773261,2sleep20-21swapper/22
2147509261,1sleep20-21swapper/22
2131968260,1sleep00-21swapper/00
2116645261,1sleep20-21swapper/22
2106204261,2sleep00-21swapper/00
2065323261,2sleep02066914-21cut0
2053272260,4sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional