You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 09:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Apr 15, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1759371212565,56sleep30-21swapper/33
175940029990,6sleep20-21swapper/22
175957828667,12sleep10-21swapper/11
175937327152,14sleep00-21swapper/00
20812082231,10sleep01890799-21diskmemload0
1759757992218,2cyclictest0-21swapper/33
1759757992114,5cyclictest0-21swapper/33
175975799211,16cyclictest0-21swapper/33
1759757992011,6cyclictest2178396-21taskset3
175975799201,16cyclictest0-21swapper/33
175975799201,15cyclictest66950irq/132-enp1s0-TxRx-33
175975799201,15cyclictest0-21swapper/33
175975799201,14cyclictest0-21swapper/33
20216892191,13sleep22021724-21munin-run2
18571692191,5sleep21857216-21ntpq2
18571692191,5sleep21857216-21ntpq2
1759757991917,1cyclictest0-21swapper/33
1759757991913,4cyclictest0-21swapper/33
1759757991911,5cyclictest0-21swapper/33
175975799191,15cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,14cyclictest0-21swapper/33
175975799191,13cyclictest1828405-21chrt3
175975799191,13cyclictest0-21swapper/33
1759757991910,6cyclictest0-21swapper/33
21689762181,3sleep20-21swapper/22
175975799189,7cyclictest0-21swapper/33
1759757991816,1cyclictest0-21swapper/33
175975799181,4cyclictest0-21swapper/33
175975799181,14cyclictest2012037-21taskset3
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,14cyclictest0-21swapper/33
175975799181,13cyclictest0-21swapper/33
175975799181,13cyclictest0-21swapper/33
175975799180,15cyclictest0-21swapper/33
22561942171,3sleep20-21swapper/22
21489972171,5sleep12149149-21ntpq1
21143102171,5sleep22114370-21ntpq2
21143102171,5sleep22114370-21ntpq2
21019852171,11sleep12103614-21grep1
20747432171,3sleep10-21swapper/11
19398102171,2sleep20-21swapper/22
18036502171,5sleep01803697-21ntpq0
175975799171,14cyclictest0-21swapper/33
175975799171,12cyclictest0-21swapper/33
175975799171,12cyclictest0-21swapper/33
175975799171,12cyclictest0-21swapper/33
175975799170,14cyclictest0-21swapper/33
175975799170,14cyclictest0-21swapper/33
22399472161,3sleep00-21swapper/00
22026802161,3sleep00-21swapper/00
20884332160,3sleep00-21swapper/00
20369682161,7sleep11890799-21diskmemload1
19871752161,2sleep20-21swapper/22
19863962162,9sleep11890799-21diskmemload1
19492532161,4sleep01890799-21diskmemload0
175975799161,13cyclictest0-21swapper/33
175975799160,14cyclictest0-21swapper/33
175975799160,13cyclictest0-21swapper/33
175975799160,13cyclictest0-21swapper/33
175975799160,13cyclictest0-21swapper/33
175975799160,13cyclictest0-21swapper/33
175975799160,13cyclictest0-21swapper/33
22585542151,10sleep12258601-21ls1
22211282158,4sleep02156216-21kworker/u16:3+rpciod0
21870372151,2sleep00-21swapper/00
21230512151,7sleep02123102-21ntpq0
20535402151,2sleep00-21swapper/00
19401542151,2sleep10-21swapper/11
19228342151,3sleep11890799-21diskmemload1
18655322151,10sleep21867317-21grep2
18249592151,9sleep01825012-21ntp_states0
175975799151,9cyclictest0-21swapper/33
175975799151,3cyclictest0-21swapper/33
1759757991513,1cyclictest0-21swapper/33
1759757991512,1cyclictest0-21swapper/33
175975799151,12cyclictest0-21swapper/33
175975799150,13cyclictest0-21swapper/33
175975799150,13cyclictest0-21swapper/33
175975799150,13cyclictest0-21swapper/33
22104932141,7sleep12210542-21ntpq1
22053012141,8sleep11890799-21diskmemload1
21852272141,7sleep11890799-21diskmemload1
20993602141,9sleep22099374-21ssh2
20455122148,3sleep12045526-21ssh1
20124642141,4sleep12012472-21ssh1
20042062141,8sleep02004243-21munin-run0
19603622141,9sleep11960376-21ssh1
19516942141,8sleep11890799-21diskmemload1
19159672141,3sleep20-21swapper/22
18985632141,3sleep20-21swapper/22
18562642141,9sleep01857047-21missed_timers0
18562642141,9sleep01857047-21missed_timers0
175975799140,2cyclictest0-21swapper/33
175975799140,1cyclictest0-21swapper/33
175975799140,12cyclictest0-21swapper/33
175975799140,12cyclictest0-21swapper/33
22507952131,8sleep02251784-21grep0
21940472130,8sleep22194061-21ssh2
21614992130,3sleep11890799-21diskmemload1
21165192131,7sleep11890799-21diskmemload1
21165192131,7sleep11890799-21diskmemload1
21063422131,9sleep22106352-21ssh2
20538672131,7sleep11890799-21diskmemload1
20537172131,7sleep21890799-21diskmemload2
20476632131,8sleep02047677-21ssh0
20209672131,3sleep12020981-21ssh1
19871432132,8sleep10-21swapper/11
19756282131,5sleep21975642-21ssh2
19049602131,8sleep01904974-21ssh0
18995072130,8sleep11899554-21awk1
18267702131,8sleep21828401-21kthreadcore2
17876162131,8sleep21787663-21ntpq2
17767492131,7sleep11776800-21ntpq1
1759757991311,1cyclictest0-21swapper/33
22119052121,2sleep21890799-21diskmemload2
22026512123,3sleep21759751-21cyclictest2
21951452121,7sleep01890799-21diskmemload0
21791122121,6sleep00-21swapper/00
21691112121,7sleep11890799-21diskmemload1
21099592121,5sleep00-21swapper/00
21099592121,5sleep00-21swapper/00
20983502121,6sleep11890799-21diskmemload1
20900762121,5sleep21890799-21diskmemload2
20628742121,2sleep00-21swapper/00
20296132121,5sleep11890799-21diskmemload1
20296132121,5sleep11890799-21diskmemload1
20262182121,7sleep22026282-21collect22
20262182121,7sleep22026282-21collect22
20041132121,4sleep10-21swapper/11
19778292121,6sleep11890799-21diskmemload1
19344812121,6sleep11890799-21diskmemload1
19344812121,6sleep11890799-21diskmemload1
19307172121,7sleep21930940-21grep2
19307172121,7sleep21930940-21grep2
19306722121,7sleep01-21systemd0
19306722121,7sleep01-21systemd0
19257172121,7sleep21925761-21idleruntime-cro2
18039392121,7sleep11804098-21cat1
22416242112,4sleep02241794-21diskstats0
22407722111,3sleep10-21swapper/11
22193512111,5sleep12219460-21ntpq1
21415182111,4sleep11890799-21diskmemload1
21337442112,4sleep2421rcuc/22
21247452110,1sleep10-21swapper/11
21193592111,2sleep20-21swapper/22
20803832111,6sleep22080396-21ssh2
20653452111,5sleep12065381-21munin-run1
20390752111,5sleep02039115-21munin-run0
20293032110,3sleep02029317-21ssh0
20293032110,3sleep02029317-21ssh0
20125032111,5sleep01890799-21diskmemload0
20111622116,2sleep20-21swapper/22
20029132111,3sleep20-21swapper/22
19870872111,3sleep00-21swapper/00
19853962111,6sleep21985409-21diskmemload2
19780192111,5sleep01978051-21munin-run0
19606302111,4sleep21960662-21munin-run2
19216422111,7sleep01921713-21ld0
19152362111,3sleep00-21swapper/00
19148492111,4sleep11890799-21diskmemload1
18462212111,5sleep01846268-21ntpq0
18436102111,6sleep11845370-21kthreadcore1
18369022111,5sleep11837120-21df_inode1
17888822111,4sleep11788901-21apt-get1
17830242111,4sleep21783052-21munin-run2
17640542111,5sleep21764103-21ntpq2
17604312111,4sleep01760501-21irqstats0
22420142101,4sleep22242099-21irqstats2
22377132101,2sleep20-21swapper/22
22304302104,3sleep1331ktimers/11
22289852101,2sleep20-21swapper/22
22151942101,2sleep20-21swapper/22
22115212101,3sleep00-21swapper/00
21963142101,2sleep10-21swapper/11
21773542101,4sleep21890799-21diskmemload2
21687412101,2sleep00-21swapper/00
21610782101,3sleep00-21swapper/00
21578902101,3sleep20-21swapper/22
21507242101,2sleep00-21swapper/00
21494762101,2sleep20-21swapper/22
21426742101,2sleep00-21swapper/00
21421882101,2sleep20-21swapper/22
21356442101,3sleep11890799-21diskmemload1
21324682101,3sleep00-21swapper/00
21051582101,5sleep02105200-21ntpq0
20875682101,4sleep11890799-21diskmemload1
20738892101,5sleep22073903-21ssh2
20714172101,3sleep10-21swapper/11
20634512101,3sleep20-21swapper/22
20448752101,3sleep20-21swapper/22
20205012101,2sleep00-21swapper/00
19664952101,3sleep00-21swapper/00
19616392101,6sleep21961679-21kthreadcore2
19610162101,4sleep11961044-21ssh1
19565262101,4sleep01956586-21ntpq0
19496352101,3sleep20-21swapper/22
19389002101,5sleep01939052-21ntpq0
19072502101,5sleep11890799-21diskmemload1
18861972101,4sleep01886313-21irqstats0
18497022101,5sleep21851521-21cut2
18371212101,6sleep21837263-21gltestperf2
18102352102,4sleep11810416-21cat1
18053842101,4sleep01805455-21irqstats0
17877302101,6sleep01787813-21/usr/sbin/munin0
17823752101,5sleep11782625-21sed1
17795572101,5sleep01781348-21cut0
17723612101,4sleep01772432-21munin-run0
17673022101,6sleep21767317-21cpu2
17605022101,5sleep11761798-21grep1
2245081292,4sleep1331ktimers/11
2231275290,5sleep00-21swapper/00
2185294291,4sleep22185308-21ssh2
2178107291,3sleep11890799-21diskmemload1
2098778291,3sleep01890799-21diskmemload0
2070198291,2sleep00-21swapper/00
2030723290,1sleep20-21swapper/22
1984164291,3sleep01890799-21diskmemload0
1905031291,2sleep20-21swapper/22
1897982291,3sleep01890799-21diskmemload0
1880403290,2sleep00-21swapper/00
1875599290,5sleep21877281-21kthreadcore2
1874789291,3sleep11874808-21apt-get1
1869705291,4sleep21869931-21cat2
1867928291,4sleep11867982-21ld1
1862561291,4sleep11862609-21ntpq1
1859528291,4sleep21861238-21cut2
1826158291,4sleep11826177-21apt-get1
1820865291,3sleep21820884-21apt-get2
1819662291,4sleep11819720-21ntp_states1
1868575280,1sleep00-21swapper/00
1836554280,3sleep01836578-21munin-run0
1793648280,2sleep20-21swapper/22
1773203281,3sleep01773911-21grep0
1890697270,3sleep20-21swapper/22
1890671270,1sleep10-21swapper/11
1885225270,2sleep20-21swapper/22
1880297270,3sleep11879878-21apt-get1
1874198270,1sleep10-21swapper/11
1874187270,1sleep00-21swapper/00
1858513270,1sleep00-21swapper/00
1857049270,2sleep10-21swapper/11
1857049270,2sleep10-21swapper/11
1852147270,4sleep10-21swapper/11
1847768270,2sleep00-21swapper/00
1830919270,1sleep00-21swapper/00
1815056270,1sleep00-21swapper/00
1805456271,2sleep134-21ksoftirqd/11
1799853271,2sleep21800065-21smartctl2
1799186270,1sleep10-21swapper/11
1799031270,1sleep00-21swapper/00
1798612271,3sleep20-21swapper/22
1787526270,2sleep10-21swapper/11
1879354261,1sleep00-21swapper/00
1837404261,2sleep00-21swapper/00
1836406260,1sleep20-21swapper/22
1820299260,1sleep20-21swapper/22
1816135261,2sleep00-21swapper/00
1812437261,2sleep20-21swapper/22
1804969260,2sleep20-21swapper/22
1793848260,4sleep00-21swapper/00
1772925261,2sleep20-21swapper/22
1772030260,4sleep10-21swapper/11
1846330250,1sleep20-21swapper/22
1835683250,1sleep10-21swapper/11
1821155250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional