You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-07 - 15:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Sep 07, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1887775212163,53sleep30-21swapper/33
188771928365,12sleep20-21swapper/22
188801428262,12sleep10-21swapper/11
188310027453,14sleep00-21swapper/00
22010182231,18sleep22016386-21diskmemload2
188817699220,16cyclictest2138717-21taskset3
188817699211,16cyclictest0-21swapper/33
188817699211,16cyclictest0-21swapper/33
188817699211,16cyclictest0-21swapper/33
188817699211,16cyclictest0-21swapper/33
188817699211,16cyclictest0-21swapper/33
188817699211,16cyclictest0-21swapper/33
1888176992016,2cyclictest0-21swapper/33
1888176992016,1cyclictest0-21swapper/33
1888176992016,1cyclictest0-21swapper/33
188817699201,16cyclictest0-21swapper/33
188817699201,15cyclictest66950irq/132-enp1s0-TxRx-33
188817699201,15cyclictest0-21swapper/33
188817699201,15cyclictest0-21swapper/33
21561712191,7sleep02156182-21ssh0
21561712191,7sleep02156182-21ssh0
1888176991915,2cyclictest0-21swapper/33
1888176991912,5cyclictest0-21swapper/33
1888176991912,4cyclictest0-21swapper/33
188817699191,14cyclictest2000240-21taskset3
188817699191,14cyclictest1942574-21taskset3
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
188817699191,14cyclictest0-21swapper/33
1888176991910,6cyclictest2165428-21taskset3
22865952181,8sleep22281424-21sendmail-msp2
1888176991815,1cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,14cyclictest0-21swapper/33
188817699181,13cyclictest0-21swapper/33
188817699181,13cyclictest0-21swapper/33
188817699181,13cyclictest0-21swapper/33
188817699180,14cyclictest0-21swapper/33
188817699180,14cyclictest0-21swapper/33
22544102171,4sleep02254418-21ssh0
21764592171,3sleep02176538-21ssh0
21627682171,12sleep02163020-21rm0
188817699171,14cyclictest0-21swapper/33
188817699171,13cyclictest0-21swapper/33
188817699171,13cyclictest0-21swapper/33
188817699171,13cyclictest0-21swapper/33
188817699171,12cyclictest0-21swapper/33
188817699170,14cyclictest0-21swapper/33
188817699170,14cyclictest0-21swapper/33
188817699170,14cyclictest0-21swapper/33
188817699170,13cyclictest0-21swapper/33
23831222161,7sleep12378876-21/usr/sbin/munin1
23049462161,4sleep02304959-21ssh0
21208132161,3sleep02120820-21ssh0
21101582161,3sleep02016386-21diskmemload0
20844502160,2sleep20-21swapper/22
188817699167,6cyclictest1963760-21turbostat3
188817699164,8cyclictest0-21swapper/33
1888176991612,3cyclictest0-21swapper/33
188817699161,12cyclictest0-21swapper/33
188817699161,12cyclictest0-21swapper/33
188817699160,13cyclictest0-21swapper/33
188817699160,12cyclictest0-21swapper/33
23601212152,6sleep02016386-21diskmemload0
23601212152,6sleep02016386-21diskmemload0
23484242150,2sleep20-21swapper/22
23484242150,2sleep20-21swapper/22
23401992150,1sleep00-21swapper/00
22347432157,4sleep22234755-21sh2
22113302151,9sleep02211548-21df_inode0
22090412151,2sleep10-21swapper/11
19477322150,2sleep20-21swapper/22
1888176991513,1cyclictest0-21swapper/33
188817699151,2cyclictest0-21swapper/33
188817699151,2cyclictest0-21swapper/33
188817699151,12cyclictest0-21swapper/33
188817699151,11cyclictest0-21swapper/33
188817699150,12cyclictest0-21swapper/33
23669392140,1sleep00-21swapper/00
22995042141,9sleep22299523-21apt-get2
22618792141,8sleep02016386-21diskmemload0
22257902141,9sleep12225803-21ssh1
22175212141,8sleep12016386-21diskmemload1
21749002141,2sleep10-21swapper/11
21583182141,7sleep22158574-21df2
21583042141,3sleep12158308-21apt-get1
21096122140,5sleep12109768-21find1
20853332141,3sleep12085344-21ssh1
1888176991412,1cyclictest0-21swapper/33
188817699140,2cyclictest0-21swapper/33
188817699140,12cyclictest0-21swapper/33
23706432130,9sleep02370794-21cut0
23590392131,7sleep22016386-21diskmemload2
23590392131,7sleep22016386-21diskmemload2
22956522131,3sleep12295666-21ssh1
22897532137,2sleep12016386-21diskmemload1
22780852131,2sleep10-21swapper/11
22554352131,8sleep12255671-21expr1
22446312130,8sleep02016386-21diskmemload0
22354162131,2sleep10-21swapper/11
22256622131,3sleep02225676-21ssh0
22180042131,8sleep22218017-21ssh2
21833212131,8sleep22183335-21ssh2
21313032131,7sleep22016386-21diskmemload2
21123072131,6sleep22016386-21diskmemload2
20167422131,7sleep22016755-21ssh2
19057502130,1sleep00-21swapper/00
188817699136,5cyclictest1952395-21chrt3
23155142121,4sleep072-21kcompactd00
22939082121,7sleep02294703-21sed0
22817142121,4sleep02281727-21rm0
22346592120,1sleep00-21swapper/00
22207312121,8sleep22016386-21diskmemload2
21896022120,7sleep02189613-21ssh0
21750752121,5sleep22016386-21diskmemload2
21494772121,5sleep20-21swapper/22
21494772121,5sleep20-21swapper/22
21469222121,7sleep12146927-21sshd-auth1
21469222121,7sleep12146927-21sshd-auth1
21462982121,7sleep22146311-21ssh2
21462982121,7sleep22146311-21ssh2
21197792121,7sleep22119792-21ssh2
21036712121,7sleep22103686-21ssh2
20923662120,3sleep02092380-21ssh0
20792912121,7sleep02079662-21kthreadcore0
20676222121,3sleep20-21swapper/22
20667122120,3sleep12066723-21ssh1
20496252121,7sleep22049641-21sshd-session2
20490132121,6sleep02016386-21diskmemload0
20420242121,7sleep00-21swapper/00
20329722121,1sleep22016386-21diskmemload2
20328902121,7sleep02032905-21ssh0
20309882121,7sleep12016386-21diskmemload1
19540902121,7sleep11954485-21cut1
19377232120,1sleep10-21swapper/11
23857992111,6sleep22385810-21ssh2
23773942113,4sleep22377395-21sh2
23693902110,3sleep20-21swapper/22
23435812112,4sleep02343603-21apt-get0
23435812112,4sleep02343603-21apt-get0
23431852111,7sleep10-21swapper/11
23346902111,2sleep20-21swapper/22
23248022111,6sleep12324816-21sh1
22904952111,6sleep22290507-21ssh2
22685902111,5sleep12268809-21/usr/sbin/munin1
22526332111,5sleep12016386-21diskmemload1
22422512111,3sleep20-21swapper/22
22089552110,1sleep20-21swapper/22
21939952111,6sleep00-21swapper/00
21847212111,3sleep10-21swapper/11
21828282111,6sleep10-21swapper/11
21751582111,4sleep02016386-21diskmemload0
21573422110,7sleep12016386-21diskmemload1
21573422110,7sleep12016386-21diskmemload1
21460092110,2sleep00-21swapper/00
21460092110,2sleep00-21swapper/00
21313472111,6sleep12131385-21idleruntime-cro1
21011302111,5sleep12101145-21ssh1
20754132111,3sleep20-21swapper/22
20593402110,6sleep00-21swapper/00
20575552111,6sleep22057563-21ssh2
20483402111,4sleep10-21swapper/11
20399352111,5sleep22016386-21diskmemload2
20062092111,6sleep00-21swapper/00
19745622110,1sleep20-21swapper/22
19592682111,5sleep01959338-21irqstats0
19523412111,5sleep21952394-21ntp_states2
19474232111,6sleep11943003-21/usr/sbin/munin1
19062042111,3sleep21906216-21cat2
18956502112,4sleep11895669-21apt-get1
23858682100,1sleep00-21swapper/00
23684802101,5sleep12368493-21rm1
23591822101,3sleep10-21swapper/11
23591822101,3sleep10-21swapper/11
23309722101,5sleep20-21swapper/22
23260732100,4sleep00-21swapper/00
23171342101,4sleep22016386-21diskmemload2
23171072101,2sleep00-21swapper/00
23141082101,3sleep10-21swapper/11
23132252101,4sleep22016386-21diskmemload2
23068022100,3sleep10-21swapper/11
22778092100,1sleep00-21swapper/00
22553802101,3sleep22016386-21diskmemload2
22097612101,4sleep02016386-21diskmemload0
21907452100,3sleep20-21swapper/22
21377672100,1sleep00-21swapper/00
21367452101,4sleep22016386-21diskmemload2
21311762100,1sleep00-21swapper/00
21211502101,5sleep12016386-21diskmemload1
21044492100,1sleep00-21swapper/00
20931232101,2sleep20-21swapper/22
20762752100,1sleep00-21swapper/00
20750832101,3sleep10-21swapper/11
20522342101,4sleep12052506-21df_inode1
20343872100,3sleep10-21swapper/11
20228072101,4sleep02016386-21diskmemload0
20119112101,5sleep12011984-21uname1
19903762101,3sleep11990395-21apt-get1
19897422100,1sleep00-21swapper/00
19803642101,5sleep01981193-21kthreadcore0
19693332101,3sleep21969352-21apt-get2
19377542101,4sleep21938012-21df_inode2
19219852102,3sleep01921981-21apt-get0
18946332101,4sleep01895492-21irqstats0
2370795291,4sleep12372321-21cut1
2349427290,1sleep10-21swapper/11
2349427290,1sleep10-21swapper/11
2332061290,1sleep10-21swapper/11
2278785290,2sleep20-21swapper/22
2265808291,4sleep02267423-21grep0
2264162290,3sleep22264187-21apt-get2
2251389291,3sleep22016386-21diskmemload2
2237729291,2sleep10-21swapper/11
2194107291,4sleep12194281-21ssh1
2136574290,1sleep10-21swapper/11
2092907291,3sleep12016386-21diskmemload1
2066123291,4sleep00-21swapper/00
2020981291,4sleep12021081-21ssh1
2000865291,4sleep22000884-21apt-get2
2000597291,4sleep02000606-21unix_chkpwd0
1986989293,3sleep1331ktimers/11
1985353291,3sleep21984833-21sendmail-msp2
1974570291,3sleep01974589-21apt-get0
1964018292,3sleep04192556-21in:imuxsock0
1926595290,5sleep10-21swapper/11
1919158291,4sleep21920568-21load2
1917208291,4sleep01917533-21tr0
1896222291,4sleep21897409-21tr2
2006123281,2sleep22006142-21apt-get2
1995636280,2sleep20-21swapper/22
1990666281,3sleep01990829-21gltestperf0
1974153280,4sleep00-21swapper/00
1968178281,3sleep11968298-21mailstats1
1957866281,3sleep01958113-21/usr/sbin/munin0
1927237281,2sleep21927256-21apt-get2
1911458281,2sleep20-21swapper/22
1900931281,3sleep11900930-21apt-get1
1889746280,4sleep01891447-21grep0
2010774271,2sleep10-21swapper/11
2002046271,3sleep00-21swapper/00
1990946271,2sleep20-21swapper/22
1984737270,4sleep10-21swapper/11
1974592270,2sleep10-21swapper/11
1960572271,2sleep20-21swapper/22
1954487271,2sleep21956108-21kthreadcore2
1947687271,2sleep00-21swapper/00
1932496270,2sleep20-21swapper/22
1931921271,2sleep01931925-21modprobe0
1921671271,2sleep1205-21jbd2/sda2-81
1916068270,1sleep10-21swapper/11
1906228271,2sleep01906483-21df0
1901792271,3sleep21903248-21cut2
1888328270,2sleep20-21swapper/22
2016129260,4sleep00-21swapper/00
2011986261,2sleep20-21swapper/22
2005626260,1sleep10-21swapper/11
1999874261,2sleep10-21swapper/11
1980087261,2sleep21980202-21fschecks_time2
1974084260,1sleep10-21swapper/11
1964317261,1sleep20-21swapper/22
1963494260,4sleep10-21swapper/11
1953167260,2sleep00-21swapper/00
1942478260,1sleep00-21swapper/00
1937344260,1sleep10-21swapper/11
1937249260,1sleep00-21swapper/00
1921956262,1sleep20-21swapper/22
1906484260,1sleep10-21swapper/11
1892989260,1sleep10-21swapper/11
1953253250,1sleep10-21swapper/11
1927528250,1sleep10-21swapper/11
1911720240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional