You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 10:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Mar 18, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2090885212568,53sleep30-21swapper/33
209079128856,7sleep00-21swapper/00
209074728052,10sleep10-21swapper/11
209087427858,12sleep20-21swapper/22
209114599231,19cyclictest0-21swapper/33
22108592221,6sleep02210882-21munin-run0
2091145992211,7cyclictest2510165-21taskset3
237103022111,6sleep02371043-21sh0
22277932211,2sleep00-21swapper/00
209114599212,14cyclictest2274817-21chrt3
2091145992117,2cyclictest0-21swapper/33
209114599211,16cyclictest2569734-21taskset3
209114599211,15cyclictest66950irq/132-enp1s0-TxRx-33
209114599210,17cyclictest2545077-21chrt3
2091145992015,3cyclictest0-21swapper/33
209114599201,16cyclictest0-21swapper/33
209114599201,15cyclictest66950irq/132-enp1s0-TxRx-33
2091145991915,2cyclictest0-21swapper/33
2091145991912,4cyclictest0-21swapper/33
209114599191,15cyclictest0-21swapper/33
209114599191,15cyclictest0-21swapper/33
209114599191,15cyclictest0-21swapper/33
209114599191,14cyclictest0-21swapper/33
209114599191,14cyclictest0-21swapper/33
209114599191,14cyclictest0-21swapper/33
209114599191,14cyclictest0-21swapper/33
209114599191,14cyclictest0-21swapper/33
209114599191,13cyclictest2301404-21chrt3
209114599190,16cyclictest0-21swapper/33
25472262181,3sleep20-21swapper/22
24298002181,3sleep20-21swapper/22
23601352181,3sleep00-21swapper/00
2091145991812,3cyclictest0-21swapper/33
2091145991811,4cyclictest0-21swapper/33
2091145991811,4cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,14cyclictest0-21swapper/33
209114599181,13cyclictest0-21swapper/33
209114599181,13cyclictest0-21swapper/33
209114599181,13cyclictest0-21swapper/33
209114599181,13cyclictest0-21swapper/33
209114599180,14cyclictest0-21swapper/33
258865921712,2sleep10-21swapper/11
25635542171,3sleep10-21swapper/11
25279482171,4sleep02221840-21diskmemload0
23433872171,4sleep12221840-21diskmemload1
23183772170,12sleep12221840-21diskmemload1
209114599171,5cyclictest2120014-21turbostat3
209114599171,13cyclictest0-21swapper/33
209114599171,13cyclictest0-21swapper/33
209114599171,13cyclictest0-21swapper/33
209114599171,13cyclictest0-21swapper/33
209114599171,13cyclictest0-21swapper/33
209114599171,13cyclictest0-21swapper/33
209114599171,13cyclictest0-21swapper/33
209114599171,13cyclictest0-21swapper/33
209114599171,12cyclictest0-21swapper/33
209114599171,12cyclictest0-21swapper/33
209114599171,12cyclictest0-21swapper/33
209114599170,14cyclictest0-21swapper/33
25030822160,2sleep20-21swapper/22
24037752161,3sleep20-21swapper/22
23795112161,4sleep02221840-21diskmemload0
23425642161,11sleep02221840-21diskmemload0
209114599161,12cyclictest0-21swapper/33
209114599160,13cyclictest0-21swapper/33
209114599160,13cyclictest0-21swapper/33
209114599160,13cyclictest0-21swapper/33
209114599160,12cyclictest0-21swapper/33
25178642150,2sleep20-21swapper/22
24846482151,2sleep20-21swapper/22
24733582151,2sleep20-21swapper/22
24220072151,2sleep20-21swapper/22
24136822151,3sleep02221840-21diskmemload0
24059992150,3sleep10-21swapper/11
23873082151,4sleep12221840-21diskmemload1
209114599157,3cyclictest0-21swapper/33
209114599152,10cyclictest0-21swapper/33
209114599150,13cyclictest0-21swapper/33
209114599150,13cyclictest0-21swapper/33
209114599150,12cyclictest0-21swapper/33
25207382140,3sleep12221840-21diskmemload1
25032212141,6sleep10-21swapper/11
24935132141,2sleep20-21swapper/22
24576582140,2sleep00-21swapper/00
24130392141,2sleep12221840-21diskmemload1
23277452141,8sleep22328005-21df2
23270542141,2sleep00-21swapper/00
23249962141,9sleep22325010-21ssh2
22730522140,2sleep20-21swapper/22
22630932141,8sleep12221840-21diskmemload1
22630932141,8sleep12221840-21diskmemload1
22626512141,4sleep22262665-21ssh2
22626512141,4sleep22262665-21ssh2
22349712141,7sleep12235071-21ntpq1
209114599148,3cyclictest2210620-21chrt3
209114599141,1cyclictest0-21swapper/33
209114599140,12cyclictest0-21swapper/33
209114599140,10cyclictest0-21swapper/33
25793542131,8sleep02579367-21sh0
25718692131,7sleep22221840-21diskmemload2
25453502131,8sleep12545364-21ssh1
25449442131,6sleep02221840-21diskmemload0
24950402131,4sleep00-21swapper/00
24562972131,5sleep20-21swapper/22
23523322131,8sleep02221840-21diskmemload0
23059802131,8sleep02306089-21sed0
22954952132,6sleep22296636-21memory2
22814092131,6sleep20-21swapper/22
22739882131,3sleep12274002-21ssh1
22469482133,6sleep22246961-21sh2
22352092131,8sleep02235300-21proc_pri0
21778772131,8sleep12178060-21cat1
21735272131,8sleep02173785-21df_inode0
209114599138,3cyclictest0-21swapper/33
209114599130,12cyclictest0-21swapper/33
209114599130,10cyclictest0-21swapper/33
25642502121,7sleep02564261-21ssh0
25285102121,7sleep22528524-21ssh2
25263422121,3sleep12526352-21ssh1
25181882121,5sleep00-21swapper/00
23721132121,7sleep22373384-21cut2
23710562120,5sleep20-21swapper/22
23253342120,6sleep12221840-21diskmemload1
23013702121,4sleep20-21swapper/22
22724652121,3sleep02272479-21ssh0
22469892121,5sleep12221840-21diskmemload1
22284122121,6sleep12221840-21diskmemload1
21844982121,6sleep22184756-21df_inode2
21415712121,7sleep02141649-21cpuspeed_turbos0
21370372121,7sleep12138729-21grep1
21258682121,7sleep02125895-21cut0
21255922122,5sleep22125611-21apt-get2
25740362111,5sleep12574308-21df_inode1
25716922111,5sleep12221840-21diskmemload1
25694862111,5sleep090-21kswapd00
25607672112,4sleep22560822-21ntpq2
25518172111,5sleep02551931-21ntpq0
25102472111,5sleep12221840-21diskmemload1
24862892111,6sleep02334452-21kworker/u16:2-rpciod0
24638302111,5sleep22463969-21ntpq2
24473702111,7sleep22221840-21diskmemload2
24415012111,3sleep00-21swapper/00
23944952111,4sleep02221840-21diskmemload0
23884622111,6sleep02388473-21ssh0
23669672111,5sleep12367025-21ntpq1
23503612111,4sleep12221840-21diskmemload1
23275982111,2sleep00-21swapper/00
23104842111,3sleep20-21swapper/22
22978582111,3sleep10-21swapper/11
22876662111,5sleep12287757-21ntpq1
22836012110,7sleep22283573-21/usr/sbin/munin2
22818992111,4sleep12221840-21diskmemload1
22802132110,5sleep02221840-21diskmemload0
22005532111,5sleep22200771-21df_inode2
21791092111,5sleep12179128-21apt-get1
21628342112,4sleep02162853-21apt-get0
21522252111,2sleep20-21swapper/22
21045842111,6sleep02104700-21grep0
21043032112,4sleep22104321-21apt-get2
20964872111,3sleep12096384-21apt-get1
25882662101,3sleep20-21swapper/22
25880852101,3sleep00-21swapper/00
25798482101,2sleep20-21swapper/22
25540802101,4sleep12221840-21diskmemload1
25531392100,6sleep22221840-21diskmemload2
25353522102,3sleep12221840-21diskmemload1
25308302101,3sleep20-21swapper/22
25037572101,4sleep22504022-21df2
24930492101,3sleep12221840-21diskmemload1
24827722101,3sleep00-21swapper/00
24738082101,3sleep12221840-21diskmemload1
24731112101,5sleep02473088-21mailstats0
24571542100,1sleep10-21swapper/11
24505652100,3sleep00-21swapper/00
24422132101,3sleep12221840-21diskmemload1
24401682100,2sleep20-21swapper/22
24386242101,3sleep12221840-21diskmemload1
24303532101,5sleep12221840-21diskmemload1
24218312101,6sleep02421844-21sh0
24211852101,4sleep12221840-21diskmemload1
24110752101,5sleep22411129-21ntpq2
24048102100,2sleep00-21swapper/00
23893212101,3sleep12221840-21diskmemload1
23870722101,3sleep20-21swapper/22
23756082101,4sleep12375706-21ntpq1
23590932101,3sleep20-21swapper/22
23454942101,6sleep22345544-21fschecks_count2
23413702101,3sleep22221840-21diskmemload2
23343352101,3sleep12221840-21diskmemload1
23154712101,3sleep00-21swapper/00
23057542101,4sleep12221840-21diskmemload1
22925032101,3sleep02221840-21diskmemload0
22622142100,2sleep00-21swapper/00
22622142100,2sleep00-21swapper/00
22557802101,3sleep00-21swapper/00
22541652101,4sleep12221840-21diskmemload1
22277642100,4sleep20-21swapper/22
21911982101,5sleep22192968-21tr2
21726232101,4sleep12172867-21users1
21710162103,4sleep00-21swapper/00
21524962101,4sleep02152706-21hddtemp_smartct0
21190162101,4sleep02119066-21ntpq0
21190162101,4sleep02119066-21ntpq0
2529666294,2sleep0221rcuc/00
2503655291,4sleep02503668-21ssh0
2481612291,2sleep10-21swapper/11
2467704290,1sleep00-21swapper/00
2460114291,4sleep12460221-21ssh1
2429679291,2sleep00-21swapper/00
2393951291,5sleep20-21swapper/22
2288732291,3sleep00-21swapper/00
2253666291,2sleep20-21swapper/22
2244823291,2sleep00-21swapper/00
2231514291,4sleep22232629-21ssh2
2218712291,5sleep02220529-21kthreadcore0
2216013291,4sleep12216014-21sshd1
2204526291,3sleep12204564-21ntpq1
2195172291,4sleep12195191-21apt-get1
2185022292,3sleep12185523-21kthreadcore1
2183231290,4sleep22183280-21ntpq2
2162574291,4sleep02162596-21grep0
2152707291,4sleep12152805-21grep1
2146900291,4sleep02147158-21df_inode0
2134937291,4sleep02134985-21ntpq0
2132838292,3sleep22134667-21tr2
2130940291,4sleep12131070-21expr1
2110200292,3sleep2421rcuc/22
2359894281,2sleep10-21swapper/11
2221593280,2sleep10-21swapper/11
2217245280,1sleep20-21swapper/22
2200172280,4sleep072-21kcompactd00
2188694281,3sleep02188838-21mailstats0
2163114280,5sleep22163197-21fschecks_time2
2157531281,2sleep10-21swapper/11
2136771281,3sleep02137036-21cat0
2121462281,3sleep02123219-21cut0
2095681280,1sleep10-21swapper/11
2211142270,2sleep00-21swapper/00
2205356270,1sleep00-21swapper/00
2200229270,3sleep20-21swapper/22
2194899270,1sleep10-21swapper/11
2179409271,2sleep00-21swapper/00
2151037271,3sleep10-21swapper/11
2146442270,1sleep10-21swapper/11
2140364270,1sleep20-21swapper/22
2130386270,1sleep10-21swapper/11
2124152271,2sleep20-21swapper/22
2120540271,3sleep10-21swapper/11
2119661270,1sleep20-21swapper/22
2119661270,1sleep20-21swapper/22
2096898271,2sleep20-21swapper/22
2091568270,4sleep20-21swapper/22
2215904260,1sleep20-21swapper/22
2210569260,4sleep20-21swapper/22
2206394261,2sleep10-21swapper/11
2193782261,2sleep02193901-21modprobe0
2178397260,1sleep20-21swapper/22
2168182261,2sleep20-21swapper/22
2164018261,2sleep10-21swapper/11
2158422260,3sleep22160124-21tr2
2147262261,2sleep20-21swapper/22
2146453260,1sleep20-21swapper/22
2109628260,1sleep10-21swapper/11
2109056260,4sleep10-21swapper/11
2103024260,2sleep00-21swapper/00
2091300261,2sleep00-21swapper/00
2115233250,2sleep10-21swapper/11
2115233250,2sleep10-21swapper/11
2114076250,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional