You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 21:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sat Jun 27, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1695671212265,53sleep30-21swapper/33
211181221190,1sleep00-21swapper/00
169566028965,12sleep20-21swapper/22
169555528670,10sleep10-21swapper/11
169555428161,14sleep00-21swapper/00
17367702250,2sleep30-21swapper/33
16973812211,8sleep11699040-21grep1
169603199214,13cyclictest2015154-21taskset3
169603199211,18cyclictest0-21swapper/33
169603199211,18cyclictest0-21swapper/33
169603199206,3cyclictest0-21swapper/33
169603199201,15cyclictest0-21swapper/33
1696031992010,7cyclictest2078190-21taskset3
20053242191,6sleep21823800-21diskmemload2
169603199195,12cyclictest0-21swapper/33
1696031991917,1cyclictest0-21swapper/33
169603199191,15cyclictest0-21swapper/33
169603199191,14cyclictest66950irq/132-enp1s0-TxRx-33
169603199191,14cyclictest0-21swapper/33
169603199191,14cyclictest0-21swapper/33
169603199191,14cyclictest0-21swapper/33
169603199191,14cyclictest0-21swapper/33
169603199191,14cyclictest0-21swapper/33
1696031991910,5cyclictest0-21swapper/33
21426632181,5sleep02144275-21ssh0
21426632181,5sleep02144275-21ssh0
20740482181,3sleep22074274-21df2
169603199184,12cyclictest0-21swapper/33
169603199181,5cyclictest0-21swapper/33
169603199181,14cyclictest0-21swapper/33
169603199181,14cyclictest0-21swapper/33
169603199181,14cyclictest0-21swapper/33
169603199181,14cyclictest0-21swapper/33
169603199181,14cyclictest0-21swapper/33
169603199181,14cyclictest0-21swapper/33
169603199181,13cyclictest0-21swapper/33
169603199181,13cyclictest0-21swapper/33
169603199181,12cyclictest0-21swapper/33
1696031991810,5cyclictest0-21swapper/33
169603199180,15cyclictest0-21swapper/33
21384472171,3sleep10-21swapper/11
21384472171,3sleep10-21swapper/11
21230542171,2sleep00-21swapper/00
21203322172,11sleep21823800-21diskmemload2
20884102170,4sleep01823800-21diskmemload0
20851512171,11sleep22086272-21memory2
20629332171,3sleep10-21swapper/11
19224322171,3sleep10-21swapper/11
19166782171,4sleep21916919-21cat2
169603199174,2cyclictest0-21swapper/33
169603199172,10cyclictest2107083-21taskset3
169603199172,10cyclictest1803142-21taskset3
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,13cyclictest0-21swapper/33
169603199171,12cyclictest2132058-21chrt3
169603199171,12cyclictest2132058-21chrt3
169603199170,6cyclictest1730175-21chrt3
169603199170,14cyclictest0-21swapper/33
169603199170,14cyclictest0-21swapper/33
18981352161,4sleep01898146-21ssh0
18968082161,3sleep20-21swapper/22
18817302161,4sleep11823800-21diskmemload1
18405742161,10sleep21840619-21munin-run2
18304112161,4sleep11823800-21diskmemload1
169603199169,5cyclictest1750698-21chrt3
169603199162,9cyclictest1776890-21taskset3
169603199161,4cyclictest0-21swapper/33
1696031991614,1cyclictest0-21swapper/33
169603199161,3cyclictest0-21swapper/33
1696031991612,2cyclictest0-21swapper/33
1696031991611,3cyclictest0-21swapper/33
169603199161,12cyclictest0-21swapper/33
169603199160,13cyclictest0-21swapper/33
169603199160,13cyclictest0-21swapper/33
169603199160,13cyclictest0-21swapper/33
20137442150,2sleep10-21swapper/11
19637782150,2sleep20-21swapper/22
19637782150,2sleep20-21swapper/22
19303882151,4sleep01930399-21ssh0
18804632151,2sleep20-21swapper/22
18653062151,2sleep20-21swapper/22
18639712151,4sleep11863984-21sh1
18401552151,3sleep01823800-21diskmemload0
1696031991513,1cyclictest0-21swapper/33
1696031991512,2cyclictest0-21swapper/33
169603199151,12cyclictest0-21swapper/33
169603199151,11cyclictest17975952sleep33
169603199151,11cyclictest17975952sleep33
169603199151,11cyclictest0-21swapper/33
169603199150,12cyclictest0-21swapper/33
20977922140,2sleep00-21swapper/00
20966192141,8sleep22096629-21ssh2
20789342141,3sleep12078945-21ssh1
20716582141,9sleep01823800-21diskmemload0
20389122141,8sleep01823800-21diskmemload0
20296742140,2sleep10-21swapper/11
19746942141,9sleep11974881-21sed1
19728882141,9sleep11972908-21ssh1
19309752140,6sleep20-21swapper/22
18097722141,2sleep00-21swapper/00
17826622141,5sleep21782998-21kthreadcore2
17186152140,1sleep10-21swapper/11
16967562141,2sleep00-21swapper/00
1696031991411,2cyclictest0-21swapper/33
21706992131,3sleep12170710-21ssh1
21040002131,3sleep21823800-21diskmemload2
20464132130,1sleep20-21swapper/22
19973152130,1sleep10-21swapper/11
19891822130,2sleep20-21swapper/22
19826492131,2sleep11982671-21apt-get1
19816712130,1sleep00-21swapper/00
19642322131,3sleep11964245-21ssh1
19642322131,3sleep11964245-21ssh1
19564762131,3sleep1115153-21kworker/u16:0-nfsiod1
19549822130,1sleep00-21swapper/00
19155762130,2sleep10-21swapper/11
19136162131,8sleep01823800-21diskmemload0
18829402131,3sleep11882952-21ssh1
18474412131,6sleep20-21swapper/22
17200242131,8sleep21721637-21cut2
21634692121,7sleep02163482-21sh0
21486472121,7sleep02148918-21ssh0
21479432121,3sleep22147954-21ssh2
21479432121,3sleep22147954-21ssh2
21399062120,4sleep22139918-21ssh2
21399062120,4sleep22139918-21ssh2
20878602121,7sleep12087874-21ssh1
20617512121,7sleep02057252-21/usr/sbin/munin0
20413382120,3sleep01823800-21diskmemload0
20212982121,3sleep12021312-21ssh1
20205432121,7sleep02020557-21ssh0
19908562121,7sleep21990963-21cut2
19339802121,7sleep21935523-21cut2
19212022121,7sleep01823800-21diskmemload0
18562052121,7sleep21856215-21ssh2
18292722121,3sleep21829282-21ssh2
17191512122,4sleep11719169-21apt-get1
21705942111,4sleep01823800-21diskmemload0
21297392110,4sleep00-21swapper/00
21057202111,4sleep10-21swapper/11
21050772111,4sleep01823800-21diskmemload0
20626462111,3sleep20-21swapper/22
20559752111,2sleep20-21swapper/22
20550842111,3sleep00-21swapper/00
20280332111,5sleep01823800-21diskmemload0
20124432111,6sleep01823800-21diskmemload0
20070612110,2sleep10-21swapper/11
19964302111,3sleep00-21swapper/00
19902182110,1sleep00-21swapper/00
19742732111,6sleep20-21swapper/22
19638962111,6sleep01963906-21ssh0
19638962111,6sleep01963906-21ssh0
19546882110,1sleep20-21swapper/22
19488452111,6sleep11948857-21ssh1
19479482111,5sleep01823800-21diskmemload0
19463762111,6sleep21823800-21diskmemload2
19371092111,6sleep10-21swapper/11
19308722110,1sleep10-21swapper/11
19150902111,1sleep20-21swapper/22
19059662111,5sleep21823800-21diskmemload2
18904352111,3sleep20-21swapper/22
18887082111,5sleep01823800-21diskmemload0
18715842111,3sleep00-21swapper/00
18557512111,4sleep01823800-21diskmemload0
18493782110,5sleep11849411-21ssh1
18383372111,3sleep10-21swapper/11
18310142111,4sleep00-21swapper/00
18079252110,1sleep00-21swapper/00
17876782111,5sleep01787887-21hddtemp_smartct0
17506762111,4sleep21750695-21apt-get2
17401402111,4sleep21739860-21apt-get2
17188772110,5sleep21718936-21munin-run2
17011362110,1sleep20-21swapper/22
21623472101,4sleep11823800-21diskmemload1
21608602101,3sleep20-21swapper/22
21485962101,3sleep22148625-21apt-get2
21458662100,1sleep10-21swapper/11
21458662100,1sleep10-21swapper/11
21379722101,3sleep00-21swapper/00
21379722101,3sleep00-21swapper/00
21300002100,6sleep22130010-21ssh2
21286872100,3sleep10-21swapper/11
21222172100,1sleep10-21swapper/11
21150702101,5sleep12115072-21ssh1
21134632101,2sleep20-21swapper/22
20912152101,6sleep12091819-21kthreadcore1
20801862101,3sleep00-21swapper/00
20733122101,3sleep11823800-21diskmemload1
20656502101,3sleep20-21swapper/22
20566302101,4sleep11823800-21diskmemload1
20406032101,5sleep12040616-21ssh1
20371802100,1sleep10-21swapper/11
20147292101,4sleep21823800-21diskmemload2
19074812101,3sleep00-21swapper/00
19064342101,4sleep11823800-21diskmemload1
18979522101,4sleep11823800-21diskmemload1
18745162101,3sleep00-21swapper/00
18625182101,4sleep01823800-21diskmemload0
18413002101,2sleep10-21swapper/11
18410382100,1sleep00-21swapper/00
17818532101,5sleep11782079-21grep1
17672822101,5sleep11768904-21kthreadcore1
17459552101,5sleep11746971-21kthreadcore1
17401702101,4sleep11740172-21apt-get1
17158232101,5sleep01716012-21kthreadcore0
17109042100,6sleep11712536-21cat1
17034472101,3sleep01703466-21apt-get0
17012472101,5sleep21701594-21if_enp1s02
2171223291,3sleep22171233-21ssh2
2153518290,3sleep10-21swapper/11
2037397290,2sleep20-21swapper/22
2031139290,1sleep20-21swapper/22
2023534291,3sleep22023544-21ssh2
2004987291,2sleep00-21swapper/00
1971752291,2sleep20-21swapper/22
1971530291,2sleep00-21swapper/00
1938474290,2sleep00-21swapper/00
1873525291,4sleep21873536-21sh2
1872508291,4sleep11872517-21sh1
1823441290,1sleep00-21swapper/00
1818824290,4sleep11818843-21apt-get1
1794639291,5sleep11796385-21kthreadcore1
1794639291,5sleep11796385-21kthreadcore1
1776868291,2sleep20-21swapper/22
1773276291,4sleep01774987-21kthreadcore0
1766369291,3sleep01766371-21apt-get0
1761119291,3sleep11761138-21apt-get1
1756421291,4sleep21756802-21kthreadcore2
1750665291,4sleep01750368-21apt-get0
1745386291,2sleep01745405-21apt-get0
1731641292,4sleep11733392-21cut1
1813868281,3sleep00-21swapper/00
1813607280,2sleep20-21swapper/22
1803136280,2sleep20-21swapper/22
1787387280,2sleep10-21swapper/11
1786419280,5sleep10-21swapper/11
1776320280,1sleep10-21swapper/11
1771031280,1sleep20-21swapper/22
1761115280,1sleep20-21swapper/22
1744890280,1sleep00-21swapper/00
1729362281,3sleep01729428-21sendmail-msp0
1724968280,4sleep21726485-21cat2
1723972280,1sleep00-21swapper/00
1709320281,3sleep01710789-21kthreadcore0
1812519270,3sleep11812668-21grep1
1807713270,1sleep10-21swapper/11
1802771270,1sleep00-21swapper/00
1797875270,2sleep20-21swapper/22
1793216270,3sleep01794636-21kthreadcore0
1793216270,3sleep01794636-21kthreadcore0
1792166270,1sleep20-21swapper/22
1782405270,3sleep00-21swapper/00
1781841270,4sleep00-21swapper/00
1771635270,2sleep20-21swapper/22
1765831270,1sleep00-21swapper/00
1756164272,2sleep00-21swapper/00
1750160270,1sleep20-21swapper/22
1735475270,3sleep21736768-21kthreadcore2
1729962271,3sleep20-21swapper/22
1708379270,1sleep10-21swapper/11
1822857260,3sleep20-21swapper/22
1818244260,1sleep10-21swapper/11
1808334260,1sleep20-21swapper/22
1796387260,2sleep21796627-21strings2
1796387260,2sleep21796627-21strings2
1760653260,1sleep10-21swapper/11
1755316260,4sleep10-21swapper/11
1734902260,1sleep10-21swapper/11
1730245261,2sleep00-21swapper/00
1724384260,1sleep10-21swapper/11
1798171250,2sleep10-21swapper/11
1739547250,1sleep00-21swapper/00
1708705250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional