You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 12:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Wed Apr 01, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1881276212261,56sleep30-21swapper/33
188133728858,11sleep10-21swapper/11
188134728758,7sleep00-21swapper/00
188107328056,10sleep20-21swapper/22
1881516992714,2cyclictest0-21swapper/33
1881516992623,1cyclictest0-21swapper/33
1881516992522,1cyclictest0-21swapper/33
21330662241,19sleep12012246-21diskmemload1
1881516992422,1cyclictest0-21swapper/33
1881516992422,1cyclictest0-21swapper/33
1881516992422,1cyclictest0-21swapper/33
1881516992421,1cyclictest0-21swapper/33
1881516992319,2cyclictest0-21swapper/33
188151699231,18cyclictest0-21swapper/33
1881516992220,1cyclictest0-21swapper/33
1881516992220,1cyclictest0-21swapper/33
1881516992218,2cyclictest0-21swapper/33
1881516992218,2cyclictest0-21swapper/33
1881516992212,6cyclictest2062669-21taskset3
188151699219,2cyclictest0-21swapper/33
188151699219,10cyclictest0-21swapper/33
188151699217,10cyclictest2053154-21taskset3
188151699215,13cyclictest0-21swapper/33
1881516992119,1cyclictest0-21swapper/33
1881516992118,1cyclictest0-21swapper/33
1881516992118,1cyclictest0-21swapper/33
1881516992118,1cyclictest0-21swapper/33
1881516992118,1cyclictest0-21swapper/33
1881516992117,2cyclictest0-21swapper/33
188151699211,6cyclictest2240030-21taskset3
188151699211,16cyclictest2213831-21taskset3
188151699211,16cyclictest0-21swapper/33
1881516992110,1cyclictest0-21swapper/33
23640482201,9sleep12364304-21users1
188151699205,13cyclictest0-21swapper/33
1881516992018,1cyclictest0-21swapper/33
1881516992018,1cyclictest0-21swapper/33
1881516992017,1cyclictest0-21swapper/33
1881516992016,2cyclictest0-21swapper/33
1881516992014,3cyclictest66950irq/132-enp1s0-TxRx-33
188151699201,14cyclictest0-21swapper/33
188151699194,13cyclictest0-21swapper/33
1881516991917,1cyclictest0-21swapper/33
1881516991916,1cyclictest0-21swapper/33
1881516991916,1cyclictest0-21swapper/33
1881516991916,1cyclictest0-21swapper/33
1881516991916,1cyclictest0-21swapper/33
1881516991915,2cyclictest0-21swapper/33
1881516991915,2cyclictest0-21swapper/33
188151699191,14cyclictest1974659-21turbostat3
188151699191,14cyclictest0-21swapper/33
20364012181,3sleep00-21swapper/00
1881516991815,1cyclictest0-21swapper/33
1881516991815,1cyclictest0-21swapper/33
1881516991814,2cyclictest0-21swapper/33
1881516991812,3cyclictest0-21swapper/33
188151699181,14cyclictest0-21swapper/33
23569892171,3sleep10-21swapper/11
23223742171,4sleep20-21swapper/22
20732962171,3sleep10-21swapper/11
20133032171,4sleep02014888-21ssh0
20133032171,4sleep02014888-21ssh0
188151699172,12cyclictest0-21swapper/33
1881516991715,1cyclictest0-21swapper/33
1881516991715,1cyclictest0-21swapper/33
188151699171,4cyclictest0-21swapper/33
1881516991714,1cyclictest0-21swapper/33
1881516991714,1cyclictest0-21swapper/33
1881516991713,2cyclictest0-21swapper/33
1881516991713,2cyclictest0-21swapper/33
188151699171,13cyclictest0-21swapper/33
188151699171,13cyclictest0-21swapper/33
23007512161,4sleep12012246-21diskmemload1
22486912161,2sleep00-21swapper/00
20546312161,2sleep20-21swapper/22
20537522161,3sleep10-21swapper/11
20462322161,2sleep00-21swapper/00
20206952161,3sleep10-21swapper/11
20206952161,3sleep10-21swapper/11
1881516991614,1cyclictest0-21swapper/33
188151699161,3cyclictest0-21swapper/33
1881516991613,1cyclictest0-21swapper/33
1881516991613,1cyclictest0-21swapper/33
1881516991613,1cyclictest0-21swapper/33
1881516991613,1cyclictest0-21swapper/33
22044832151,4sleep02204497-21ssh0
21299182151,9sleep02131100-21memory0
20736632151,8sleep20-21swapper/22
1881516991513,1cyclictest0-21swapper/33
23582802141,9sleep02358294-21ssh0
23373742143,3sleep10-21swapper/11
22825682141,4sleep12282581-21ssh1
22407962140,3sleep00-21swapper/00
21765452141,7sleep22012246-21diskmemload2
21694542141,3sleep12169465-21ssh1
21226692140,9sleep02012246-21diskmemload0
21226692140,9sleep02012246-21diskmemload0
20976962141,3sleep12012246-21diskmemload1
19386542141,3sleep01939787-21kthreadcore0
1881516991410,3cyclictest0-21swapper/33
188151699140,13cyclictest0-21swapper/33
23221552131,8sleep12322167-21sh1
22733792131,8sleep12012246-21diskmemload1
22642712131,7sleep12012246-21diskmemload1
22576262131,8sleep12012246-21diskmemload1
21935092131,8sleep02193523-21ssh0
21621652132,7sleep02162334-21wc0
21591272131,8sleep22159137-21ssh2
21440872131,8sleep02144102-21ssh0
21079962130,9sleep22108009-21ssh2
19640282131,8sleep01964224-21cut0
23748282121,6sleep12012246-21diskmemload1
23322602121,6sleep12012246-21diskmemload1
22672282121,7sleep22267242-21apt-get2
22288442121,7sleep12228854-21ssh1
21787582120,4sleep00-21swapper/00
21239812121,3sleep22012246-21diskmemload2
21239812121,3sleep22012246-21diskmemload2
21051372121,7sleep12100832-21/usr/sbin/munin1
20612752121,7sleep2764-21sshd2
20453462121,3sleep22045360-21ssh2
20254742121,2sleep12025530-21ssh1
19736562121,5sleep21973705-21ntpq2
19056872121,6sleep21905706-21apt-get2
23495552111,3sleep20-21swapper/22
23411832111,6sleep22341439-21cat2
23305062111,4sleep20-21swapper/22
23179162111,7sleep22317926-21ssh2
23160462111,4sleep12012246-21diskmemload1
23092262111,4sleep12012246-21diskmemload1
22937542111,5sleep22293778-21apt-get2
22923312111,3sleep00-21swapper/00
22702922111,5sleep02271216-21memory0
22539402111,5sleep22253992-21ntpq2
22234282111,4sleep00-21swapper/00
22222512110,7sleep02222264-21rm0
22222512110,7sleep02222264-21rm0
22188692111,5sleep22218925-21ntpq2
22188692111,5sleep22218925-21ntpq2
22142282111,2sleep20-21swapper/22
22127982111,4sleep12012246-21diskmemload1
22047532111,6sleep12012246-21diskmemload1
22024522111,4sleep22012246-21diskmemload2
21953362111,3sleep10-21swapper/11
21862462111,3sleep00-21swapper/00
21595702111,4sleep12012246-21diskmemload1
21050742111,5sleep02105133-21ntpq0
20979972111,5sleep00-21swapper/00
20620252110,3sleep02062036-21ssh0
20301532111,5sleep12030419-21df1
20291642111,3sleep20-21swapper/22
19740782111,5sleep01974278-21users0
19683292111,5sleep11968381-21ntpq1
19327352111,6sleep21932326-21/usr/sbin/munin2
19158772110,1sleep00-21swapper/00
23762532101,4sleep22012246-21diskmemload2
23564432101,2sleep20-21swapper/22
23478192100,2sleep00-21swapper/00
23470642101,4sleep12012246-21diskmemload1
23404942101,3sleep00-21swapper/00
23291162100,2sleep00-21swapper/00
23226052101,3sleep00-21swapper/00
23079752101,4sleep22307990-21ssh2
23013992100,4sleep00-21swapper/00
22909292101,4sleep12012246-21diskmemload1
22904722100,3sleep20-21swapper/22
22814642101,2sleep20-21swapper/22
22664942101,3sleep00-21swapper/00
22638692101,4sleep22012246-21diskmemload2
22572112100,5sleep02257225-21ssh0
22478082101,4sleep22012246-21diskmemload2
22408842101,2sleep10-21swapper/11
22321482101,4sleep22232172-21apt-get2
22320822101,4sleep12012246-21diskmemload1
22315902101,3sleep20-21swapper/22
22210062101,4sleep12012246-21diskmemload1
22210062101,4sleep12012246-21diskmemload1
22128372101,3sleep00-21swapper/00
21960662101,3sleep20-21swapper/22
21872602101,3sleep12012246-21diskmemload1
21872212101,5sleep22187232-21sh2
21667842101,4sleep22167038-21users2
21511192101,3sleep00-21swapper/00
21451032101,2sleep20-21swapper/22
21449862101,5sleep12145099-21grep1
21418522101,3sleep12012246-21diskmemload1
21224662101,3sleep10-21swapper/11
21224662101,3sleep10-21swapper/11
21149692101,4sleep22012246-21diskmemload2
21149132101,3sleep10-21swapper/11
20892122101,3sleep10-21swapper/11
20808162101,2sleep20-21swapper/22
20804452101,2sleep10-21swapper/11
20739382101,3sleep00-21swapper/00
20395192101,5sleep12039659-21grep1
20357162101,2sleep20-21swapper/22
20271602101,4sleep02027172-21ssh0
19967842101,5sleep21998303-21kthreadcore2
19964932101,4sleep01996706-21hddtemp_smartct0
19576582101,5sleep11957713-21ntpq1
19423732100,1sleep20-21swapper/22
19267362101,4sleep21926785-21munin-run2
19096232101,4sleep11909736-21ntpq1
18895062101,4sleep01889622-21irqstats0
2368308291,2sleep00-21swapper/00
2365759291,3sleep00-21swapper/00
2359959291,4sleep22360050-21ssh2
2316323291,2sleep00-21swapper/00
2307799291,2sleep00-21swapper/00
2276937291,4sleep02278452-21grep0
2175065291,2sleep10-21swapper/11
2157889290,1sleep00-21swapper/00
2141824291,3sleep22012246-21diskmemload2
2132878291,2sleep20-21swapper/22
2110653291,4sleep02112258-21tr0
2097101290,1sleep20-21swapper/22
2089254290,1sleep00-21swapper/00
2088871291,3sleep22012246-21diskmemload2
2080126291,2sleep00-21swapper/00
2057641291,4sleep12059150-21cat1
2052273291,4sleep02052330-21ssh0
2017881290,1sleep20-21swapper/22
2017881290,1sleep20-21swapper/22
2007153291,2sleep10-21swapper/11
1975440290,5sleep01975762-21kthreadcore0
1968383291,4sleep21968437-21ntpq2
1948897291,4sleep21950394-21tr2
1947044291,4sleep01947098-21ntpq0
1933766291,4sleep01935533-21cut0
1916935291,4sleep01918210-21cut0
1894676291,3sleep21894158-21apt-get2
2011741280,1sleep00-21swapper/00
1984189280,4sleep20-21swapper/22
1975766281,3sleep10-21swapper/11
1968284281,3sleep01968322-21ntpq0
1932610281,3sleep11932734-21perl1
1927577280,1sleep20-21swapper/22
1920716281,3sleep11920808-21timerandwakeup1
1911522281,4sleep11911703-21kthreadcore1
1900316281,3sleep11899825-21apt-get1
1899813280,2sleep00-21swapper/00
1889095281,3sleep21889338-21df_inode2
2006583270,1sleep00-21swapper/00
1996203270,2sleep10-21swapper/11
1991169271,3sleep01991383-21smartctl0
1990876270,2sleep11990895-21apt-get1
1990325270,1sleep00-21swapper/00
1985158270,4sleep10-21swapper/11
1960228271,3sleep11961993-21kthreadcore1
1958577270,1sleep00-21swapper/00
1943271270,2sleep20-21swapper/22
1942490270,1sleep10-21swapper/11
1926996270,2sleep10-21swapper/11
1926723270,1sleep10-21swapper/11
1926663270,1sleep00-21swapper/00
1921084270,1sleep20-21swapper/22
1910562270,1sleep00-21swapper/00
1905256270,1sleep20-21swapper/22
1899738270,4sleep10-21swapper/11
1894127270,1sleep10-21swapper/11
2007175261,2sleep20-21swapper/22
2006468260,1sleep10-21swapper/11
2001556260,1sleep20-21swapper/22
1991479261,2sleep20-21swapper/22
1989719260,3sleep10-21swapper/11
1984335260,2sleep00-21swapper/00
1975182261,2sleep20-21swapper/22
1969592260,1sleep10-21swapper/11
1963950260,4sleep20-21swapper/22
1957715260,2sleep20-21swapper/22
1952335260,2sleep10-21swapper/11
1944261261,2sleep10-21swapper/11
1931818260,1sleep00-21swapper/00
1911036261,2sleep20-21swapper/22
1886577260,1sleep10-21swapper/11
1881708260,1sleep20-21swapper/22
1990352250,3sleep20-21swapper/22
1899727250,1sleep00-21swapper/00
1886424250,2sleep00-21swapper/00
1948606240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional