You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 11:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 16, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1716178212958,66sleep30-21swapper/33
171624528657,12sleep10-21swapper/11
171621928354,7sleep00-21swapper/00
171608527952,7sleep20-21swapper/22
171652999241,20cyclictest2014527-21chrt3
171652999231,18cyclictest1914472-21turbostat3
171652999221,16cyclictest0-21swapper/33
171652999221,13cyclictest0-21swapper/33
18511292210,3sleep30-21swapper/33
1716529992112,6cyclictest2142102-21taskset3
171652999211,17cyclictest0-21swapper/33
171652999211,16cyclictest66950irq/132-enp1s0-TxRx-33
171652999211,16cyclictest0-21swapper/33
171652999210,18cyclictest0-21swapper/33
18399882201,14sleep11840040-21ntpq1
171652999209,7cyclictest1889417-21turbostat3
19645462191,9sleep21846584-21diskmemload2
18863842196,9sleep11846584-21diskmemload1
1716529991915,3cyclictest66950irq/132-enp1s0-TxRx-33
1716529991914,3cyclictest0-21swapper/33
1716529991913,4cyclictest0-21swapper/33
171652999191,15cyclictest66950irq/132-enp1s0-TxRx-33
171652999191,15cyclictest66950irq/132-enp1s0-TxRx-33
171652999191,15cyclictest0-21swapper/33
171652999191,14cyclictest2122591-21taskset3
171652999191,14cyclictest0-21swapper/33
171652999191,14cyclictest0-21swapper/33
171652999191,14cyclictest0-21swapper/33
171652999191,13cyclictest0-21swapper/33
171652999191,13cyclictest0-21swapper/33
20999732181,7sleep21846584-21diskmemload2
20157052188,5sleep2431ktimers/22
19927582181,3sleep20-21swapper/22
18994062181,6sleep11901117-21cut1
171652999183,13cyclictest0-21swapper/33
171652999181,4cyclictest0-21swapper/33
171652999181,14cyclictest0-21swapper/33
171652999181,14cyclictest0-21swapper/33
171652999181,14cyclictest0-21swapper/33
171652999181,14cyclictest0-21swapper/33
171652999181,14cyclictest0-21swapper/33
171652999181,14cyclictest0-21swapper/33
171652999181,14cyclictest0-21swapper/33
171652999181,13cyclictest0-21swapper/33
171652999181,13cyclictest0-21swapper/33
171652999181,13cyclictest0-21swapper/33
171652999181,13cyclictest0-21swapper/33
171652999180,2cyclictest0-21swapper/33
171652999180,14cyclictest0-21swapper/33
21485502170,9sleep01846584-21diskmemload0
17167122172,10sleep21716730-21apt-get2
171652999177,8cyclictest0-21swapper/33
1716529991715,1cyclictest0-21swapper/33
1716529991713,1cyclictest0-21swapper/33
171652999171,14cyclictest0-21swapper/33
171652999171,14cyclictest0-21swapper/33
171652999171,14cyclictest0-21swapper/33
171652999171,14cyclictest0-21swapper/33
171652999171,13cyclictest0-21swapper/33
171652999171,12cyclictest0-21swapper/33
171652999171,12cyclictest0-21swapper/33
171652999170,15cyclictest0-21swapper/33
171652999170,14cyclictest0-21swapper/33
171652999170,14cyclictest0-21swapper/33
171652999170,13cyclictest0-21swapper/33
171652999170,13cyclictest0-21swapper/33
21672532160,2sleep00-21swapper/00
21507182161,10sleep11846584-21diskmemload1
21322502161,3sleep20-21swapper/22
19982022161,3sleep00-21swapper/00
19701172161,4sleep21970344-21users2
19701172161,4sleep21970344-21users2
19648662161,2sleep00-21swapper/00
18421152168,4sleep01843762-21cut0
171652999161,12cyclictest0-21swapper/33
171652999160,13cyclictest0-21swapper/33
171652999160,13cyclictest0-21swapper/33
171652999160,13cyclictest0-21swapper/33
21988152151,1sleep10-21swapper/11
21300642151,8sleep12130163-21ntpq1
21227052151,9sleep10-21swapper/11
20978152151,9sleep11846584-21diskmemload1
20637812151,2sleep20-21swapper/22
19886622151,3sleep11846584-21diskmemload1
19809582151,8sleep11846584-21diskmemload1
19226182151,4sleep21846584-21diskmemload2
18605012151,2sleep20-21swapper/22
18543512151,10sleep21846584-21diskmemload2
18468652150,2sleep00-21swapper/00
171652999151,12cyclictest0-21swapper/33
171652999151,11cyclictest17983032sleep33
171652999150,11cyclictest0-21swapper/33
21832292141,2sleep10-21swapper/11
20560332141,9sleep01846584-21diskmemload0
20392132141,8sleep11846584-21diskmemload1
19296432141,9sleep01929657-21ssh0
19058012141,8sleep21846584-21diskmemload2
18618952141,9sleep11861906-21ssh1
17705752141,8sleep11770674-21ntpq1
171652999148,4cyclictest17208072sleep33
1716529991410,3cyclictest0-21swapper/33
171652999140,2cyclictest0-21swapper/33
171652999140,2cyclictest0-21swapper/33
171652999140,12cyclictest0-21swapper/33
171652999140,12cyclictest0-21swapper/33
21808372131,8sleep02180889-21/usr/sbin/munin0
21749732131,3sleep12174976-21ssh1
21514492130,2sleep20-21swapper/22
20804532131,7sleep01846584-21diskmemload0
20745672131,8sleep21846584-21diskmemload2
20240942131,8sleep12024108-21ssh1
19377602130,6sleep20-21swapper/22
19130322130,1sleep00-21swapper/00
18975652131,8sleep01897575-21ssh0
18876602131,8sleep21887674-21ssh2
18806432131,3sleep11846584-21diskmemload1
18801762131,8sleep21880186-21ssh2
18719562134,5sleep0151ktimers/00
18687842131,3sleep21868874-21cat2
1716529991311,1cyclictest0-21swapper/33
1716529991310,1cyclictest0-21swapper/33
171652999130,11cyclictest0-21swapper/33
22010652121,5sleep20-21swapper/22
21807122121,6sleep22180771-21ntpq2
21759762121,5sleep00-21swapper/00
21664312121,7sleep21846584-21diskmemload2
21486302121,7sleep22148640-21ssh2
21418812121,5sleep00-21swapper/00
21127742121,3sleep22113432-21sed2
20912272121,6sleep01846584-21diskmemload0
20206172121,7sleep22020673-21ssh2
19484802121,5sleep11846584-21diskmemload1
19118212121,6sleep21846584-21diskmemload2
18079472121,5sleep21807992-21ntpq2
18079472121,5sleep21807992-21ntpq2
17652732122,2sleep1171rcu_preempt1
21581442112,4sleep01846584-21diskmemload0
21154212111,6sleep12115431-21ssh1
21077992111,5sleep21846584-21diskmemload2
20913472110,4sleep20-21swapper/22
20810782111,7sleep11846584-21diskmemload1
20719972111,7sleep02072009-21rm0
20645432111,3sleep10-21swapper/11
20558742111,6sleep20-21swapper/22
20320862111,3sleep20-21swapper/22
20302842110,1sleep00-21swapper/00
20153442111,3sleep00-21swapper/00
20140312110,2sleep10-21swapper/11
20064382114,3sleep11846584-21diskmemload1
19889342111,3sleep00-21swapper/00
19477622111,5sleep11846584-21diskmemload1
19476312111,5sleep20-21swapper/22
19378352111,3sleep10-21swapper/11
19347372111,5sleep01935697-21memory0
18456292111,5sleep11845682-21ntp_states1
18252342112,2sleep1171rcu_preempt1
17829082111,6sleep21782620-21/usr/sbin/munin2
17493962111,5sleep21749443-21ntpq2
17293742111,5sleep01729393-21apt-get0
21938452101,4sleep00-21swapper/00
21928742100,5sleep11846584-21diskmemload1
21890462101,4sleep02189187-21ntpq0
21748872101,4sleep21846584-21diskmemload2
21659902101,4sleep11846584-21diskmemload1
21567092101,2sleep10-21swapper/11
21423742101,2sleep20-21swapper/22
21417172101,4sleep11846584-21diskmemload1
21339712101,4sleep01846584-21diskmemload0
21233612100,2sleep20-21swapper/22
21079582101,4sleep01846584-21diskmemload0
21062832100,3sleep10-21swapper/11
20915322101,4sleep11846584-21diskmemload1
20821172101,3sleep20-21swapper/22
20669722101,4sleep11846584-21diskmemload1
20650092101,5sleep02065021-21ssh0
20552352101,4sleep11846584-21diskmemload1
20418712101,4sleep12042091-21hddtemp_smartct1
20414712101,4sleep01846584-21diskmemload0
20397462100,1sleep00-21swapper/00
20373022101,4sleep22037360-21ntpq2
20300642100,2sleep10-21swapper/11
19993102100,1sleep20-21swapper/22
19915792101,5sleep11992755-21kthreadcore1
19902132101,6sleep21846584-21diskmemload2
19798202100,2sleep00-21swapper/00
19739192101,4sleep21973932-21apt-get2
19712692100,2sleep10-21swapper/11
19712692100,2sleep10-21swapper/11
19539992101,3sleep00-21swapper/00
19536382101,2sleep20-21swapper/22
19298152100,4sleep20-21swapper/22
19152422101,3sleep10-21swapper/11
19030722101,2sleep00-21swapper/00
18952162101,4sleep11846584-21diskmemload1
18903942101,2sleep20-21swapper/22
18706152101,2sleep10-21swapper/11
18553142101,3sleep00-21swapper/00
18310122101,4sleep11831129-21irqstats1
18145852101,4sleep01814604-21apt-get0
18099362101,6sleep01811582-21cut0
17932982101,4sleep01793317-21apt-get0
17929412101,3sleep272-21kcompactd02
17879452101,4sleep11787964-21apt-get1
17399822101,4sleep11740001-21apt-get1
17399822101,4sleep11740001-21apt-get1
17352452101,5sleep01735280-21kthreadcore0
17334482101,4sleep11733502-21ntpq1
2193019291,3sleep21846584-21diskmemload2
2109398291,4sleep02109561-21cat0
2091908291,4sleep02092376-21appstreamcli0
2041200290,1sleep20-21swapper/22
2023397291,2sleep00-21swapper/00
2004626291,4sleep02004636-21ssh0
1970366291,3sleep00-21swapper/00
1970366291,3sleep00-21swapper/00
1963339291,3sleep11846584-21diskmemload1
1941687291,5sleep01943386-21cut0
1923180291,3sleep11846584-21diskmemload1
1917691291,4sleep01918815-21memory0
1906337290,1sleep10-21swapper/11
1887883290,4sleep01846584-21diskmemload0
1876950291,3sleep00-21swapper/00
1852489291,2sleep10-21swapper/11
1836175291,4sleep21836339-21gltestperf2
1834051291,4sleep01834540-21needreboot0
1799183291,4sleep01800664-21cut0
1786669291,4sleep01786706-21ntpq0
1784483291,4sleep11786299-21cut1
1777973291,4sleep21779630-21cut2
1777810290,2sleep10-21swapper/11
1767183292,3sleep2421rcuc/22
1764781291,4sleep01765272-21sed0
1750656291,3sleep21750675-21apt-get2
1745826291,4sleep11746072-21cat1
1738803290,1sleep20-21swapper/22
1734259290,2sleep20-21swapper/22
1729044290,1sleep20-21swapper/22
2123099281,1sleep00-21swapper/00
1839938281,4sleep01839987-21gcc0
1825806283,2sleep244-21ksoftirqd/22
1818718280,1sleep20-21swapper/22
1815197281,3sleep11816841-21cut1
1814302281,3sleep11814361-21sendmail-msp1
1808284280,5sleep01808419-21timerwakeupswit0
1808284280,5sleep01808419-21timerwakeupswit0
1793870281,3sleep11795301-21kthreadcore1
1769906281,3sleep01770553-21missed_timers0
1759930281,3sleep21760010-21ntpq2
1736346281,3sleep11738127-21tr1
1829954271,3sleep0768-21lldpd0
1824929270,1sleep00-21swapper/00
1819905270,2sleep20-21swapper/22
1808618270,1sleep10-21swapper/11
1808618270,1sleep10-21swapper/11
1803591270,1sleep20-21swapper/22
1803485270,4sleep10-21swapper/11
1781473270,4sleep01781586-21processes0
1771968270,2sleep01771987-21apt-get0
1766047270,1sleep20-21swapper/22
1760863270,1sleep10-21swapper/11
1755551270,2sleep00-21swapper/00
1744709270,1sleep20-21swapper/22
1744709270,1sleep20-21swapper/22
1721480270,1sleep10-21swapper/11
1831130261,2sleep20-21swapper/22
1824681260,4sleep10-21swapper/11
1814144260,1sleep20-21swapper/22
1792680260,4sleep00-21swapper/00
1773995261,2sleep21774061-21kthreadcore2
1772549261,2sleep10-21swapper/11
1757670261,2sleep00-21swapper/00
1750227260,1sleep00-21swapper/00
1724532261,2sleep10-21swapper/11
1723461261,1sleep00-21swapper/00
1721601260,1sleep00-21swapper/00
1841427250,1sleep20-21swapper/22
1798062250,3sleep20-21swapper/22
1754402250,1sleep10-21swapper/11
1739773240,1sleep00-21swapper/00
1739773240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional