You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 11:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Thu Jun 25, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2063805212453,66sleep30-21swapper/33
206369928770,11sleep20-21swapper/22
206400628667,11sleep10-21swapper/11
206379227753,17sleep00-21swapper/00
2064138992613,3cyclictest66950irq/132-enp1s0-TxRx-33
21402312251,19sleep02140811-21tr0
206413899232,14cyclictest2358095-21chrt3
2064138992111,6cyclictest24838422chrt3
206413899211,15cyclictest0-21swapper/33
2064138992110,6cyclictest2191743-21turbostat3
206413899203,15cyclictest66950irq/132-enp1s0-TxRx-33
206413899201,16cyclictest0-21swapper/33
206413899201,15cyclictest2323831-21taskset3
206413899201,15cyclictest0-21swapper/33
206413899201,13cyclictest0-21swapper/33
22627392191,12sleep12262919-21timerandwakeup1
206413899191,15cyclictest2440118-21taskset3
206413899191,15cyclictest0-21swapper/33
206413899191,14cyclictest66950irq/132-enp1s0-TxRx-33
206413899191,14cyclictest0-21swapper/33
206413899191,14cyclictest0-21swapper/33
206413899191,14cyclictest0-21swapper/33
206413899191,13cyclictest2181590-21chrt3
206413899191,12cyclictest2299897-21chrt3
2064138991910,5cyclictest0-21swapper/33
206413899190,16cyclictest66950irq/132-enp1s0-TxRx-33
206413899181,6cyclictest66950irq/132-enp1s0-TxRx-33
2064138991814,2cyclictest0-21swapper/33
206413899181,14cyclictest0-21swapper/33
206413899181,14cyclictest0-21swapper/33
206413899181,14cyclictest0-21swapper/33
206413899181,14cyclictest0-21swapper/33
206413899181,14cyclictest0-21swapper/33
206413899181,14cyclictest0-21swapper/33
206413899181,14cyclictest0-21swapper/33
206413899181,13cyclictest0-21swapper/33
206413899181,13cyclictest0-21swapper/33
206413899181,12cyclictest2103031-21chrt3
206413899180,15cyclictest0-21swapper/33
24760312171,3sleep12473770-40find1
24705562171,3sleep00-21swapper/00
22893722171,2sleep10-21swapper/11
22082862171,3sleep22208297-21ssh2
206413899173,12cyclictest66950irq/132-enp1s0-TxRx-33
206413899172,10cyclictest2308166-21taskset3
2064138991711,3cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,13cyclictest0-21swapper/33
206413899171,12cyclictest0-21swapper/33
206413899170,15cyclictest0-21swapper/33
206413899170,14cyclictest0-21swapper/33
206413899170,13cyclictest0-21swapper/33
23313062161,3sleep02191734-21diskmemload0
22138302161,5sleep02191734-21diskmemload0
2064138991613,2cyclictest0-21swapper/33
206413899161,12cyclictest0-21swapper/33
206413899161,12cyclictest0-21swapper/33
206413899161,12cyclictest0-21swapper/33
206413899160,13cyclictest0-21swapper/33
206413899160,13cyclictest0-21swapper/33
206413899160,13cyclictest0-21swapper/33
206413899160,12cyclictest0-21swapper/33
25385922150,9sleep22538758-21/usr/sbin/munin2
25311492151,9sleep02191734-21diskmemload0
24803552152,9sleep22480423-21/usr/sbin/munin2
24638282151,9sleep22191734-21diskmemload2
24550552151,2sleep20-21swapper/22
24153032151,2sleep20-21swapper/22
24066012150,4sleep02191734-21diskmemload0
23666942151,10sleep22366807-21perl2
23645552151,2sleep00-21swapper/00
22231162151,3sleep02191734-21diskmemload0
206413899159,3cyclictest0-21swapper/33
206413899151,8cyclictest2087296-21taskset3
2064138991510,3cyclictest0-21swapper/33
206413899150,13cyclictest0-21swapper/33
25168412141,3sleep02516850-21ssh0
24325202141,9sleep02432157-21apt-get0
24066622141,3sleep12191734-21diskmemload1
23736502140,2sleep00-21swapper/00
23580612142,5sleep22191734-21diskmemload2
22643952141,3sleep02191734-21diskmemload0
22314822141,4sleep22231492-21ssh2
22213612141,8sleep22221497-21/usr/sbin/munin2
206413899143,8cyclictest0-21swapper/33
206413899140,2cyclictest0-21swapper/33
206413899140,12cyclictest0-21swapper/33
25177642132,5sleep22517782-21apt-get2
25061782135,4sleep22506187-21ssh2
24982852131,8sleep12498297-21rm1
24458972131,5sleep10-21swapper/11
24237432131,4sleep12423757-21ssh1
23979172131,8sleep12397929-21ssh1
23775032131,6sleep12378646-21memory1
23478372131,5sleep10-21swapper/11
23229812131,6sleep22191734-21diskmemload2
23142812130,4sleep12314292-21ssh1
22998632131,4sleep20-21swapper/22
22837562131,4sleep20-21swapper/22
22497702130,3sleep20-21swapper/22
22055422131,8sleep12205552-21ssh1
20868542130,1sleep10-21swapper/11
206413899131,9cyclictest2082087-21chrt3
2064138991311,1cyclictest0-21swapper/33
25260662121,7sleep22526312-21cstates2
25136832121,6sleep12513842-21run-parts1
24844932122,4sleep22484515-21apt-get2
24707742121,3sleep22470781-21ssh2
22750232121,6sleep22191734-21diskmemload2
22729332121,6sleep22191734-21diskmemload2
22064392121,7sleep02191734-21diskmemload0
21865292121,5sleep22186585-21munin-run2
21559482121,7sleep02157042-21kthreadcore0
20820672122,5sleep22082084-21apt-get2
20718982121,7sleep02072117-21cat0
25088102110,1sleep00-21swapper/00
25010162110,1sleep10-21swapper/11
24743112113,4sleep00-21swapper/00
24716362111,5sleep12471647-21sshd-session1
24560142111,4sleep02191734-21diskmemload0
24465362111,3sleep00-21swapper/00
24325492111,5sleep22432581-21ssh2
24077842112,4sleep02407797-21apt-get0
24045912111,3sleep20-21swapper/22
23829492111,5sleep02382974-21apt-get0
23812972111,4sleep02191734-21diskmemload0
23575252111,3sleep20-21swapper/22
23525742111,4sleep02353677-21memory0
23145952111,4sleep02191734-21diskmemload0
22809302110,7sleep02280943-21sh0
22753362111,5sleep12275556-21/usr/sbin/munin1
22666832111,6sleep02266793-21tr0
22552232111,4sleep02191734-21diskmemload0
22507422113,3sleep12250849-21ps1
22409502111,4sleep02191734-21diskmemload0
22272082111,6sleep12228840-21tr1
21982832111,3sleep10-21swapper/11
21791302111,5sleep02180187-21memory0
21719562111,2sleep20-21swapper/22
21708092111,5sleep22170866-21munin-run2
21700542111,6sleep12170257-21cat1
21489302111,6sleep12148989-21/usr/sbin/munin1
21397032111,5sleep12139959-21df1
21134632111,4sleep02113482-21apt-get0
25397492101,3sleep10-21swapper/11
25343372101,4sleep00-21swapper/00
25255402101,2sleep10-21swapper/11
25006042100,1sleep00-21swapper/00
24892452101,2sleep00-21swapper/00
24625962101,4sleep12191734-21diskmemload1
24572942101,3sleep02191734-21diskmemload0
24532122101,5sleep12453282-21pmu-power1
24468872100,1sleep20-21swapper/22
24383682101,2sleep10-21swapper/11
24313752101,3sleep20-21swapper/22
24294272101,2sleep10-21swapper/11
24242082101,2sleep00-21swapper/00
24235592101,3sleep22191734-21diskmemload2
24225892101,3sleep02191734-21diskmemload0
23973622101,5sleep22397376-21ssh2
23964452101,2sleep02396459-21ssh0
23879142101,4sleep12191734-21diskmemload1
23830542101,4sleep22383268-21diskstats2
23796592101,4sleep22191734-21diskmemload2
23718392100,1sleep10-21swapper/11
23483912100,1sleep00-21swapper/00
23463342101,3sleep20-21swapper/22
23409882101,3sleep02191734-21diskmemload0
23247862101,4sleep12324788-21apt-get1
23239392101,3sleep00-21swapper/00
23167032101,4sleep12316834-21diskstats1
23157682101,5sleep22315779-21sh2
23048972101,3sleep10-21swapper/11
22999732101,4sleep02300186-21diskstats0
22981802100,2sleep10-21swapper/11
22973682100,1sleep00-21swapper/00
22915422101,4sleep22291571-21apt-get2
22896462101,4sleep02191734-21diskmemload0
22721432101,4sleep12272154-21ssh1
22629222101,4sleep22263148-21users2
22490502101,3sleep10-21swapper/11
22468652101,4sleep02191734-21diskmemload0
22394932101,2sleep20-21swapper/22
22356032101,4sleep12237244-21ssh1
22306952101,4sleep02191734-21diskmemload0
22219882101,4sleep12191734-21diskmemload1
22139872101,3sleep20-21swapper/22
21977242101,2sleep20-21swapper/22
21974822100,1sleep00-21swapper/00
21917172101,4sleep12191779-21munin-run1
21760422100,4sleep12176098-21munin-run1
21239832101,4sleep12124002-21apt-get1
20975182101,5sleep10-21swapper/11
20686322101,5sleep02068871-21grep0
2531390291,4sleep12531404-21ssh1
2525489291,2sleep00-21swapper/00
2509352291,4sleep22509130-21sendmail-msp2
2499380291,4sleep22499394-21ssh2
2490864291,2sleep10-21swapper/11
2415537291,4sleep12191734-21diskmemload1
2365253291,4sleep12365255-21ssh1
2354608290,1sleep10-21swapper/11
2339192291,4sleep22339204-21ssh2
2333099291,4sleep12191734-21diskmemload1
2331239291,2sleep20-21swapper/22
2255910291,3sleep22191734-21diskmemload2
2214775291,4sleep12191734-21diskmemload1
2160927291,4sleep22161136-21hddtemp_smartct2
2123011291,4sleep22123232-21unixbench_multi2
2097445291,4sleep02097513-21sendmail-msp0
2093091291,4sleep22094536-21cut2
2087290291,2sleep20-21swapper/22
2171079281,3sleep02171098-21apt-get0
2164750281,3sleep12160637-21/usr/sbin/munin1
2161214280,4sleep02162526-21kthreadcore0
2155450281,3sleep12155666-21diskstats1
2150166280,1sleep20-21swapper/22
2150144280,3sleep12150163-21apt-get1
2149642280,1sleep00-21swapper/00
2134414280,2sleep10-21swapper/11
2129187280,2sleep10-21swapper/11
2119295280,2sleep00-21swapper/00
2108253280,3sleep22108232-21/usr/sbin/munin2
2081068280,1sleep10-21swapper/11
2076832280,2sleep20-21swapper/22
2072118281,3sleep12072545-21kthreadcore1
2186788270,1sleep00-21swapper/00
2186214270,1sleep10-21swapper/11
2176326270,2sleep22176328-21apt-get2
2149639270,1sleep20-21swapper/22
2144630270,4sleep20-21swapper/22
2135000271,2sleep20-21swapper/22
2133854270,1sleep00-21swapper/00
2130095271,3sleep20-21swapper/22
2128877270,1sleep00-21swapper/00
2128018271,3sleep22123984-21/usr/sbin/munin2
2118323270,1sleep20-21swapper/22
2107956270,3sleep22108003-2192
2098359270,1sleep00-21swapper/00
2092509270,2sleep10-21swapper/11
2091985270,1sleep00-21swapper/00
2078210271,3sleep02079887-21kthreadcore0
2076242270,1sleep20-21swapper/22
2069299270,1sleep10-21swapper/11
2064902270,3sleep22066281-21cat2
2188259260,3sleep20-21swapper/22
2181155260,1sleep10-21swapper/11
2170566260,1sleep00-21swapper/00
2154746260,1sleep00-21swapper/00
2139376260,4sleep00-21swapper/00
2118054260,2sleep10-21swapper/11
2108231260,1sleep10-21swapper/11
2107698260,1sleep00-21swapper/00
2106810260,2sleep12106983-21strings1
2101582260,2sleep22101761-21strings2
2092162260,1sleep10-21swapper/11
2082341261,2sleep014-21ksoftirqd/00
2185727251,1sleep00-21swapper/00
2155667250,1sleep20-21swapper/22
2118494250,2sleep10-21swapper/11
2108518250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional