You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 04:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sun May 24, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1810216213459,68sleep30-21swapper/33
181027329173,12sleep10-21swapper/11
181039028061,12sleep20-21swapper/22
181033527956,7sleep00-21swapper/00
23006092490,3sleep30-21swapper/33
181060499261,17cyclictest2204278-21taskset3
19832592241,3sleep00-21swapper/00
22128512231,18sleep02212865-21ssh0
181060499230,19cyclictest0-21swapper/33
20529382220,13sleep11940987-21diskmemload1
1810604992215,3cyclictest20090732sleep33
181060499212,15cyclictest22872702sleep33
181060499211,16cyclictest0-21swapper/33
21342662201,5sleep02134532-21df0
1810604992017,1cyclictest0-21swapper/33
1810604992011,6cyclictest0-21swapper/33
181060499201,16cyclictest0-21swapper/33
181060499200,16cyclictest0-21swapper/33
20455892191,2sleep00-21swapper/00
181060499191,14cyclictest0-21swapper/33
181060499191,14cyclictest0-21swapper/33
181060499191,14cyclictest0-21swapper/33
1810604991910,6cyclictest1998666-21taskset3
181060499190,16cyclictest0-21swapper/33
181060499190,16cyclictest0-21swapper/33
22652222181,4sleep01940987-21diskmemload0
20797892181,3sleep20-21swapper/22
181060499184,12cyclictest0-21swapper/33
1810604991811,4cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,14cyclictest0-21swapper/33
181060499181,13cyclictest0-21swapper/33
181060499181,13cyclictest0-21swapper/33
181060499181,13cyclictest0-21swapper/33
181060499181,13cyclictest0-21swapper/33
181060499181,13cyclictest0-21swapper/33
181060499180,16cyclictest0-21swapper/33
22823912171,2sleep00-21swapper/00
21852062171,5sleep10-21swapper/11
21591042171,2sleep20-21swapper/22
20957682171,2sleep10-21swapper/11
20870702171,8sleep22087079-21sh2
20423792171,7sleep11940987-21diskmemload1
1810604991714,1cyclictest0-21swapper/33
181060499171,3cyclictest0-21swapper/33
1810604991712,2cyclictest0-21swapper/33
181060499171,14cyclictest0-21swapper/33
1810604991711,3cyclictest0-21swapper/33
1810604991711,3cyclictest0-21swapper/33
181060499171,13cyclictest0-21swapper/33
181060499171,13cyclictest0-21swapper/33
181060499170,14cyclictest0-21swapper/33
181060499170,14cyclictest0-21swapper/33
181060499170,13cyclictest66950irq/132-enp1s0-TxRx-33
181060499170,13cyclictest0-21swapper/33
181060499170,13cyclictest0-21swapper/33
181060499170,13cyclictest0-21swapper/33
22702032165,8sleep0555-21dbus-daemon0
21776722161,3sleep21940987-21diskmemload2
21421562161,2sleep10-21swapper/11
21071562161,4sleep21940987-21diskmemload2
20631562161,4sleep22063169-21ssh2
19950552161,4sleep21996675-21cut2
19853342161,4sleep11940987-21diskmemload1
197340321610,2sleep20-21swapper/22
19413542161,4sleep20-21swapper/22
1810604991613,1cyclictest0-21swapper/33
181060499161,13cyclictest0-21swapper/33
181060499161,12cyclictest0-21swapper/33
181060499160,13cyclictest0-21swapper/33
22992482151,9sleep11940987-21diskmemload1
22978402156,1sleep0171rcu_preempt0
22739482151,4sleep12273961-21ssh1
22538532150,2sleep20-21swapper/22
21575732151,1sleep10-21swapper/11
21051602151,2sleep00-21swapper/00
20347302151,4sleep21940987-21diskmemload2
20111302151,3sleep11940987-21diskmemload1
19201952151,10sleep21920386-21sed2
1810604991513,1cyclictest0-21swapper/33
1810604991511,3cyclictest66950irq/132-enp1s0-TxRx-33
181060499151,12cyclictest0-21swapper/33
181060499151,12cyclictest0-21swapper/33
181060499150,13cyclictest0-21swapper/33
181060499150,12cyclictest0-21swapper/33
181060499150,12cyclictest0-21swapper/33
181060499150,12cyclictest0-21swapper/33
181060499150,12cyclictest0-21swapper/33
22555092141,8sleep12255519-21ssh1
22468022141,2sleep20-21swapper/22
22274082140,2sleep00-21swapper/00
22196652141,8sleep00-21swapper/00
21930122141,8sleep11940987-21diskmemload1
21310162140,2sleep20-21swapper/22
21310162140,2sleep20-21swapper/22
19935052141,1sleep00-21swapper/00
19551332141,9sleep21955147-21ssh2
181060499141,2cyclictest0-21swapper/33
1810604991412,1cyclictest0-21swapper/33
181060499141,12cyclictest0-21swapper/33
1810604991410,2cyclictest0-21swapper/33
181060499140,11cyclictest0-21swapper/33
181060499140,11cyclictest0-21swapper/33
23081152131,7sleep11940987-21diskmemload1
23005622131,8sleep22300596-21perf2
22902042133,6sleep01940987-21diskmemload0
22382562131,2sleep21940987-21diskmemload2
22127702131,8sleep11940987-21diskmemload1
22046952131,7sleep22204717-21apt-get2
22012292131,8sleep12201240-21ssh1
21746282131,6sleep10-21swapper/11
21686632131,7sleep11940987-21diskmemload1
20690212131,2sleep20-21swapper/22
20268882130,1sleep00-21swapper/00
19682432131,8sleep11968908-21cut1
19646672130,2sleep00-21swapper/00
19543252132,5sleep01954377-21ntpq0
18815912131,8sleep01881699-21cat0
23088002121,7sleep02308810-21ssh0
22679702121,7sleep22269719-21kthreadcore2
22302472120,5sleep10-21swapper/11
21670042121,3sleep22167016-21ssh2
20878152121,5sleep134-21ksoftirqd/11
20352742120,7sleep11940987-21diskmemload1
20283812120,8sleep22028393-21sh2
20274072120,7sleep11940987-21diskmemload1
20098262121,2sleep20-21swapper/22
19356502121,7sleep11935691-21systemd-run1
19151462121,7sleep11916054-21cut1
18612502121,2sleep10-21swapper/11
22795172111,4sleep21940987-21diskmemload2
22556982111,6sleep02255712-21ssh0
22455832111,6sleep12245594-21ssh1
22450672110,3sleep02245070-21ssh0
22361102110,2sleep00-21swapper/00
22022012111,4sleep20-21swapper/22
21697712111,6sleep02169829-21fschecks_count0
21328132111,5sleep11940987-21diskmemload1
21328132111,5sleep11940987-21diskmemload1
21248972111,3sleep20-21swapper/22
21161322111,4sleep00-21swapper/00
21158482111,4sleep11940987-21diskmemload1
20945942111,5sleep02094717-21ntpq0
20792652111,5sleep11940987-21diskmemload1
20786902111,6sleep02078704-21ssh0
20646672111,6sleep12064727-21kthreadcore1
19640372111,3sleep20-21swapper/22
19027072111,5sleep01902764-21ntp_states0
18298242111,5sleep01829889-21irqstats0
18294852111,5sleep21829609-21diskstats2
18284372110,1sleep20-21swapper/22
22917392101,4sleep21940987-21diskmemload2
22910192100,1sleep10-21swapper/11
22745222101,5sleep11940987-21diskmemload1
22622192101,4sleep11940987-21diskmemload1
22351622101,4sleep12235230-21ntp_states1
22183672100,1sleep10-21swapper/11
21938772101,5sleep22193891-21ssh2
21487852101,4sleep21940987-21diskmemload2
21470822101,4sleep12147144-21ntpq1
21325042101,4sleep02132516-21ssh0
21325042101,4sleep02132516-21ssh0
21234032101,4sleep01940987-21diskmemload0
21224152101,2sleep10-21swapper/11
21079632101,3sleep20-21swapper/22
21052652101,6sleep11940987-21diskmemload1
20604212100,1sleep10-21swapper/11
20528722101,2sleep00-21swapper/00
20525462101,4sleep21940987-21diskmemload2
20380932101,4sleep22038228-21diskstats2
20193362100,6sleep02019346-21ssh0
20193072101,4sleep21940987-21diskmemload2
20156072101,3sleep12015731-21strings1
20020942100,1sleep00-21swapper/00
19941042101,3sleep10-21swapper/11
19833742101,3sleep10-21swapper/11
19723052101,4sleep01972559-21users0
19594462101,5sleep11959697-21ssh1
19543872101,4sleep11954455-21ntpq1
19362072101,5sleep01936417-21hddtemp_smartct0
19362072101,5sleep01936417-21hddtemp_smartct0
19160552101,5sleep21917809-21kthreadcore2
18715512102,6sleep1331ktimers/11
18600292100,7sleep11860077-21ntpq1
18457922101,4sleep21845871-21irqstats2
18437892101,5sleep11843966-21cut1
18387742101,5sleep11838822-21grep1
18163522101,6sleep11817266-21grep1
2300860291,3sleep21940987-21diskmemload2
2264451291,3sleep21940987-21diskmemload2
2226706291,5sleep22226829-21ls2
2218433291,3sleep21940987-21diskmemload2
2196649291,5sleep02196683-21kthreadcore0
2193049291,2sleep00-21swapper/00
2183425290,1sleep00-21swapper/00
2178174290,1sleep20-21swapper/22
2165764291,4sleep02165774-21ssh0
2156027291,4sleep02156112-21ssh0
2147280291,4sleep02147406-21ssh0
2140994290,2sleep20-21swapper/22
2095974291,3sleep20-21swapper/22
2087053291,4sleep02087065-21ssh0
2069049290,1sleep00-21swapper/00
2060854291,2sleep00-21swapper/00
2033431291,4sleep02033501-21ssh0
2002921291,4sleep02003089-21ssh0
1985237291,3sleep21940987-21diskmemload2
1947283291,4sleep01947297-21ssh0
1946648291,2sleep10-21swapper/11
1934699291,4sleep21934736-21ntpq2
1924611290,2sleep00-21swapper/00
1908061291,4sleep01908147-21pmu-power0
1904480291,4sleep21905477-21grep2
1904324291,4sleep11904479-21/usr/sbin/munin1
1897333291,4sleep11897382-21gcc1
1891995291,4sleep01892054-21ld0
1891848291,3sleep20-21swapper/22
1877209290,2sleep20-21swapper/22
1854649291,4sleep11854690-21ntpq1
1849386291,3sleep01849432-21ntpq0
1833377291,3sleep10-21swapper/11
1822068291,4sleep21822157-21ntpq2
1814796291,4sleep21814844-21ntpq2
1976504280,3sleep21975995-21apt-get2
1940836280,2sleep10-21swapper/11
1940836280,2sleep10-21swapper/11
1918548281,3sleep01918641-21ld0
1909276281,3sleep21909537-21df_inode2
1887275280,1sleep10-21swapper/11
1874460281,4sleep21875796-21memory2
1861586281,4sleep21861802-21iwlist2
1860764280,1sleep20-21swapper/22
1855596280,1sleep20-21swapper/22
1835751281,3sleep01837457-21grep0
1823730281,2sleep10-21swapper/11
1936486271,2sleep20-21swapper/22
1936486271,2sleep20-21swapper/22
1930583270,2sleep00-21swapper/00
1924617270,1sleep10-21swapper/11
1914085270,1sleep00-21swapper/00
1903032271,3sleep11810597-21cyclictest1
1898161270,1sleep20-21swapper/22
1897998271,4sleep0151ktimers/00
1886897271,2sleep20-21swapper/22
1882547270,2sleep00-21swapper/00
1877216270,1sleep10-21swapper/11
1875985271,2sleep10-21swapper/11
1868942271,3sleep01866612-21/usr/sbin/munin0
1866611271,2sleep21866630-21apt-get2
1855935270,2sleep00-21swapper/00
1855489270,1sleep00-21swapper/00
1845590271,3sleep10-21swapper/11
1844847270,4sleep00-21swapper/00
1834992271,3sleep21835189-21/usr/sbin/munin2
1815699270,1sleep10-21swapper/11
1930082261,3sleep10-21swapper/11
1925232260,1sleep20-21swapper/22
1914046260,1sleep10-21swapper/11
1892634260,4sleep10-21swapper/11
1871914260,1sleep00-21swapper/00
1844913260,1sleep20-21swapper/22
1828700260,1sleep00-21swapper/00
1819640261,2sleep01821415-21kthreadcore0
1815588260,4sleep00-21swapper/00
1925513250,1sleep00-21swapper/00
1898584250,1sleep20-21swapper/22
1861283250,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional