You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 23:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Aug 01, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1667762212362,57sleep30-21swapper/33
21088242950,6sleep134-21ksoftirqd/11
166770228768,11sleep20-21swapper/22
166780128464,12sleep10-21swapper/11
166774027955,7sleep00-21swapper/00
18285842271,16sleep01828593-21sh0
1668228992315,6cyclictest66950irq/132-enp1s0-TxRx-33
166822899221,17cyclictest0-21swapper/33
166822899212,15cyclictest0-21swapper/33
1668228992114,3cyclictest1743291-21taskset3
166822899211,16cyclictest0-21swapper/33
166822899205,12cyclictest66950irq/132-enp1s0-TxRx-33
166822899203,14cyclictest66950irq/132-enp1s0-TxRx-33
166822899202,15cyclictest0-21swapper/33
1668228992011,6cyclictest19965862sleep33
166822899201,16cyclictest0-21swapper/33
166822899201,15cyclictest2161480-21turbostat3
166822899201,14cyclictest0-21swapper/33
166822899201,14cyclictest0-21swapper/33
21537612191,3sleep12154285-21kthreadcore1
20924902191,14sleep02091775-21sendmail-msp0
19956112191,2sleep00-21swapper/00
166822899192,14cyclictest66950irq/132-enp1s0-TxRx-33
166822899191,15cyclictest0-21swapper/33
166822899191,15cyclictest0-21swapper/33
166822899191,15cyclictest0-21swapper/33
166822899191,14cyclictest66950irq/132-enp1s0-TxRx-33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
166822899191,14cyclictest0-21swapper/33
20278312181,7sleep02027846-21ssh0
20032582181,8sleep21795966-21diskmemload2
1668228991815,1cyclictest0-21swapper/33
166822899181,4cyclictest0-21swapper/33
1668228991814,2cyclictest0-21swapper/33
166822899181,2cyclictest0-21swapper/33
1668228991812,4cyclictest0-21swapper/33
1668228991812,3cyclictest0-21swapper/33
1668228991812,3cyclictest0-21swapper/33
166822899181,14cyclictest0-21swapper/33
166822899181,14cyclictest0-21swapper/33
166822899181,14cyclictest0-21swapper/33
166822899181,14cyclictest0-21swapper/33
166822899181,14cyclictest0-21swapper/33
166822899181,14cyclictest0-21swapper/33
166822899181,14cyclictest0-21swapper/33
166822899181,13cyclictest0-21swapper/33
166822899181,13cyclictest0-21swapper/33
166822899181,13cyclictest0-21swapper/33
166822899181,13cyclictest0-21swapper/33
166822899181,13cyclictest0-21swapper/33
166822899181,13cyclictest0-21swapper/33
166822899181,13cyclictest0-21swapper/33
1668228991810,5cyclictest66950irq/132-enp1s0-TxRx-33
20199432170,1sleep20-21swapper/22
166822899171,13cyclictest0-21swapper/33
166822899171,13cyclictest0-21swapper/33
166822899170,13cyclictest0-21swapper/33
166822899170,13cyclictest0-21swapper/33
20803562161,4sleep02080371-21ssh0
20557842161,4sleep01795966-21diskmemload0
20463682162,4sleep00-21swapper/00
20218622161,5sleep12021873-21ssh1
19872342162,4sleep21795966-21diskmemload2
19699252160,2sleep10-21swapper/11
19268662161,2sleep10-21swapper/11
18541192161,5sleep21795966-21diskmemload2
166822899168,5cyclictest1759256-21turbostat3
166822899162,9cyclictest1770066-21taskset3
1668228991614,1cyclictest0-21swapper/33
166822899161,2cyclictest0-21swapper/33
166822899160,3cyclictest0-21swapper/33
166822899160,13cyclictest0-21swapper/33
166822899160,13cyclictest0-21swapper/33
166822899160,13cyclictest0-21swapper/33
21449752151,7sleep22145059-21irqstats2
20911702151,2sleep00-21swapper/00
20376222151,4sleep12037635-21ssh1
19242052151,3sleep11795966-21diskmemload1
19070812151,4sleep11795966-21diskmemload1
18387012151,2sleep10-21swapper/11
18042842151,4sleep01795966-21diskmemload0
1668228991511,3cyclictest0-21swapper/33
166822899151,10cyclictest1791034-21chrt3
1668228991510,4cyclictest0-21swapper/33
166822899150,13cyclictest0-21swapper/33
21236062141,9sleep02123620-21ssh0
21182662141,6sleep22118296-21ssh2
21068542141,8sleep01795966-21diskmemload0
21002622140,2sleep10-21swapper/11
20736592141,8sleep21795966-21diskmemload2
20562652141,7sleep21795966-21diskmemload2
19698582141,7sleep00-21swapper/00
19430992141,2sleep10-21swapper/11
19320382141,4sleep01932049-21ssh0
18880572141,2sleep20-21swapper/22
18628782141,7sleep20-21swapper/22
166822899149,2cyclictest0-21swapper/33
166822899140,2cyclictest0-21swapper/33
166822899140,2cyclictest0-21swapper/33
21587492131,8sleep02158763-21ssh0
21494002131,8sleep12149411-21sh1
20744032132,7sleep01795966-21diskmemload0
20453682131,7sleep22045381-21ssh2
20125472131,7sleep11795966-21diskmemload1
20018152131,7sleep11795966-21diskmemload1
19846072131,8sleep01984621-21ssh0
19487152131,2sleep20-21swapper/22
19487152131,2sleep20-21swapper/22
19150922131,8sleep21915106-21ssh2
19088612131,2sleep01795966-21diskmemload0
18928912131,7sleep11894226-21cut1
18485642131,3sleep01848567-21ssh0
18114712131,8sleep11811482-21ssh1
21272732121,6sleep22126609-21sendmail-msp2
21159142121,7sleep01795966-21diskmemload0
20535452121,2sleep12053556-21ssh1
20376082121,5sleep01795966-21diskmemload0
19682952121,3sleep20-21swapper/22
19010102122,4sleep21901281-21df2
18906962121,6sleep11795966-21diskmemload1
18636862121,6sleep11795966-21diskmemload1
18375772120,2sleep2171rcu_preempt2
18366832120,7sleep01795966-21diskmemload0
17700512121,5sleep21770063-21apt-get2
17267742121,7sleep11726909-21netstat1
21513822111,4sleep01795966-21diskmemload0
21427522111,6sleep22142763-21ssh2
21181862111,3sleep10-21swapper/11
20055992111,6sleep22005818-21smartctl2
20023632111,6sleep02002377-21ssh0
19930582111,4sleep10-21swapper/11
19705572111,5sleep11970784-21df_inode1
19424402111,4sleep21795966-21diskmemload2
19415002111,4sleep01795966-21diskmemload0
19235002111,2sleep20-21swapper/22
18924602111,4sleep21795966-21diskmemload2
18805282111,3sleep20-21swapper/22
18797362111,5sleep00-21swapper/00
18536962111,3sleep10-21swapper/11
18479382111,3sleep20-21swapper/22
18462902111,5sleep11795966-21diskmemload1
18282872111,6sleep11828302-21ssh1
18216412110,2sleep10-21swapper/11
18215752111,3sleep072-21kcompactd00
18022222110,2sleep21802233-21ssh2
17963822111,4sleep10-21swapper/11
17858012111,2sleep10-21swapper/11
17648032112,4sleep139542-21systemd-journal1
17386152112,4sleep11738613-21apt-get1
17129532111,6sleep01714324-21cat0
17065212110,1sleep20-21swapper/22
16963562111,5sleep21696412-21munin-run2
21604162101,4sleep21795966-21diskmemload2
21432412101,3sleep00-21swapper/00
21414122101,4sleep11795966-21diskmemload1
21325652101,3sleep10-21swapper/11
21321982100,6sleep02132201-21ssh0
21096642101,4sleep12109890-21df_inode1
21087392101,3sleep20-21swapper/22
20835092101,4sleep12083776-21df_inode1
20826572101,4sleep12082671-21ssh1
20792542101,3sleep20-21swapper/22
20710202101,3sleep10-21swapper/11
20644112101,3sleep10-21swapper/11
20616742100,5sleep02061811-21ssh0
20573132101,4sleep22057052-21sendmail-msp2
20312312101,5sleep21795966-21diskmemload2
20293212101,5sleep12029335-21ssh1
20278592101,2sleep20-21swapper/22
20192032101,4sleep01795966-21diskmemload0
19959972101,2sleep20-21swapper/22
19790832100,1sleep10-21swapper/11
19707852101,6sleep21970930-21gltestperf2
19596042100,4sleep0151ktimers/00
19596042100,4sleep0151ktimers/00
19523272101,4sleep01795966-21diskmemload0
19523272101,4sleep01795966-21diskmemload0
19505032101,4sleep11795966-21diskmemload1
19505032101,4sleep11795966-21diskmemload1
19341122101,3sleep21795966-21diskmemload2
19265502100,1sleep00-21swapper/00
19163642101,6sleep11916377-21sh1
18914442101,3sleep00-21swapper/00
18747132101,4sleep11795966-21diskmemload1
18738132101,2sleep20-21swapper/22
18709792101,3sleep10-21swapper/11
18660332101,5sleep01795966-21diskmemload0
18653152101,3sleep00-21swapper/00
18398162101,4sleep01795966-21diskmemload0
18225262101,4sleep21822557-21ssh2
18125032101,3sleep20-21swapper/22
18117152101,3sleep01795966-21diskmemload0
17857712100,4sleep21785547-21sendmail-msp2
17281332101,3sleep00-21swapper/00
17226932101,4sleep21722660-21sendmail-msp2
17225942101,5sleep11722692-21sed1
17198632101,5sleep21721471-21sed2
2114966290,1sleep20-21swapper/22
2097412290,1sleep20-21swapper/22
2089003291,2sleep20-21swapper/22
2039612291,2sleep10-21swapper/11
2011356290,1sleep00-21swapper/00
1977017291,2sleep00-21swapper/00
1953154292,3sleep11953156-21apt-get1
1953154292,3sleep11953156-21apt-get1
1953053290,3sleep21952764-21sendmail-msp2
1953053290,3sleep21952764-21sendmail-msp2
1916509290,2sleep00-21swapper/00
1897579290,1sleep00-21swapper/00
1821656290,2sleep20-21swapper/22
1791550291,4sleep21791963-21cut2
1791011291,3sleep11791030-21apt-get1
1780522291,2sleep11780541-21apt-get1
1780054290,3sleep072-21kcompactd00
1780054290,3sleep072-21kcompactd00
1754047291,4sleep21754073-21latency_hist2
1744644291,4sleep01746253-21cut0
1739815291,4sleep21741462-21tr2
1734999291,4sleep11736715-21grep1
1728990291,4sleep11730228-21kthreadcore1
1711279291,4sleep11711409-21sensors_temp1
1697141291,4sleep21697258-21tr2
1686755292,3sleep00-21swapper/00
1685907291,4sleep01685963-21munin-run0
1785779281,2sleep01785798-21apt-get0
1785480281,3sleep00-21swapper/00
1770322281,4sleep00-21swapper/00
1764826281,3sleep01764829-21apt-get0
1759516281,3sleep01759535-21apt-get0
1749662281,3sleep00-21swapper/00
1717386281,3sleep21717482-21sed2
1714326281,3sleep10-21swapper/11
1689817281,4sleep21690105-21cat2
1673760281,3sleep01674667-21cut0
1673292280,1sleep20-21swapper/22
1795587270,1sleep00-21swapper/00
1781085270,3sleep21781882-21cut2
1775286270,2sleep10-21swapper/11
1775286270,2sleep10-21swapper/11
1773922271,2sleep10-21swapper/11
1754326270,2sleep20-21swapper/22
1744178270,3sleep21743623-21sendmail-msp2
1737984270,1sleep20-21swapper/22
1733085271,2sleep20-21swapper/22
1722881271,2sleep0205-21jbd2/sda2-80
1717670270,2sleep00-21swapper/00
1706659270,1sleep10-21swapper/11
1691493270,3sleep11691420-21/usr/sbin/munin1
1680489270,1sleep20-21swapper/22
1676196271,3sleep11677514-21kthreadcore1
1673301270,1sleep10-21swapper/11
1775857261,2sleep20-21swapper/22
1775857261,2sleep20-21swapper/22
1761496261,2sleep2401irq_work/22
1760090261,2sleep10-21swapper/11
1754617261,2sleep10-21swapper/11
1750749260,2sleep10-21swapper/11
1748646260,1sleep10-21swapper/11
1733937260,3sleep00-21swapper/00
1711988260,3sleep00-21swapper/00
1711846260,1sleep20-21swapper/22
1706609260,1sleep00-21swapper/00
1701237260,1sleep00-21swapper/00
1691992260,2sleep00-21swapper/00
1691117260,1sleep10-21swapper/11
1682311261,2sleep10-21swapper/11
1764793250,1sleep20-21swapper/22
1754411250,1sleep00-21swapper/00
1738594250,1sleep00-21swapper/00
1696928250,1sleep10-21swapper/11
1680883250,1sleep20-21swapper/22
1669373250,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional