You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 13:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri Apr 24, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2183292211867,47sleep30-21swapper/33
218337628758,10sleep20-21swapper/22
218341428452,12sleep10-21swapper/11
218350727756,15sleep00-21swapper/00
218366199231,18cyclictest66950irq/132-enp1s0-TxRx-33
218366199222,16cyclictest0-21swapper/33
2183661992218,2cyclictest0-21swapper/33
218366199211,7cyclictest2233231-21taskset3
218366199211,17cyclictest0-21swapper/33
2183661992016,2cyclictest0-21swapper/33
2183661992013,4cyclictest0-21swapper/33
2183661992012,5cyclictest0-21swapper/33
218366199201,16cyclictest0-21swapper/33
218366199201,15cyclictest0-21swapper/33
218366199201,15cyclictest0-21swapper/33
26264012190,4sleep20-21swapper/22
218366199193,14cyclictest0-21swapper/33
218366199192,14cyclictest66950irq/132-enp1s0-TxRx-33
2183661991916,1cyclictest0-21swapper/33
2183661991915,2cyclictest0-21swapper/33
2183661991915,2cyclictest0-21swapper/33
2183661991915,2cyclictest0-21swapper/33
218366199191,15cyclictest0-21swapper/33
218366199191,15cyclictest0-21swapper/33
218366199191,15cyclictest0-21swapper/33
218366199191,14cyclictest0-21swapper/33
218366199191,14cyclictest0-21swapper/33
218366199191,14cyclictest0-21swapper/33
218366199191,14cyclictest0-21swapper/33
218366199191,14cyclictest0-21swapper/33
218366199190,17cyclictest0-21swapper/33
218366199190,15cyclictest66950irq/132-enp1s0-TxRx-33
26358982180,2sleep20-21swapper/22
23997422189,4sleep22313768-21diskmemload2
23468762186,4sleep12346888-21sh1
218366199183,12cyclictest66950irq/132-enp1s0-TxRx-33
218366199181,14cyclictest0-21swapper/33
218366199181,13cyclictest2637779-21chrt3
218366199181,13cyclictest2293211-21taskset3
218366199181,13cyclictest0-21swapper/33
218366199181,13cyclictest0-21swapper/33
218366199181,13cyclictest0-21swapper/33
218366199181,13cyclictest0-21swapper/33
218366199181,13cyclictest0-21swapper/33
218366199181,13cyclictest0-21swapper/33
218366199180,14cyclictest0-21swapper/33
218366199180,14cyclictest0-21swapper/33
218366199180,14cyclictest0-21swapper/33
25646182171,2sleep10-21swapper/11
23980182171,3sleep10-21swapper/11
23722122171,3sleep00-21swapper/00
218366199179,5cyclictest2313767-21turbostat3
2183661991715,1cyclictest0-21swapper/33
2183661991713,2cyclictest0-21swapper/33
218366199171,14cyclictest0-21swapper/33
2183661991711,3cyclictest0-21swapper/33
218366199171,13cyclictest0-21swapper/33
218366199171,13cyclictest0-21swapper/33
218366199171,13cyclictest0-21swapper/33
218366199171,13cyclictest0-21swapper/33
218366199170,14cyclictest0-21swapper/33
218366199170,14cyclictest0-21swapper/33
26168682161,3sleep10-21swapper/11
25822592161,2sleep20-21swapper/22
25593142161,4sleep22559332-21apt-get2
25489612161,4sleep02313768-21diskmemload0
25299102161,3sleep20-21swapper/22
24964472161,2sleep20-21swapper/22
23219742160,2sleep12313768-21diskmemload1
23020522165,7sleep22302091-21ntpq2
218366199165,8cyclictest2212246-21turbostat3
218366199161,4cyclictest66950irq/132-enp1s0-TxRx-33
2183661991614,1cyclictest0-21swapper/33
218366199160,13cyclictest0-21swapper/33
218366199160,13cyclictest0-21swapper/33
218366199160,13cyclictest0-21swapper/33
26806762150,2sleep20-21swapper/22
26542282151,8sleep20-21swapper/22
25732652151,2sleep20-21swapper/22
24977472150,3sleep1331ktimers/11
24675752151,4sleep12467662-21pmu-power1
24342832151,4sleep12434297-21ssh1
23921192151,2sleep00-21swapper/00
23287222151,3sleep20-21swapper/22
22311082151,4sleep12232385-21memory1
218366199157,5cyclictest66950irq/132-enp1s0-TxRx-33
218366199157,5cyclictest2265839-21turbostat3
2183661991512,2cyclictest0-21swapper/33
218366199150,13cyclictest0-21swapper/33
218366199150,12cyclictest0-21swapper/33
218366199150,12cyclictest0-21swapper/33
26679492141,8sleep02668093-21ntpq0
26528162141,9sleep12652830-21ssh1
25739132140,3sleep12313768-21diskmemload1
25563052141,2sleep20-21swapper/22
25563052141,2sleep20-21swapper/22
24087762141,9sleep12408790-21ssh1
23480342141,9sleep02348048-21ssh0
23392152141,2sleep10-21swapper/11
23212772141,2sleep20-21swapper/22
218366199140,12cyclictest0-21swapper/33
218366199140,12cyclictest0-21swapper/33
26259222131,6sleep02313768-21diskmemload0
26016942131,3sleep02601705-21ssh0
25487882131,2sleep2171rcu_preempt2
25325132131,3sleep12532527-21ssh1
25125762131,5sleep20-21swapper/22
25065052133,6sleep1555-21dbus-daemon1
24603652131,8sleep02460378-21ssh0
24423412131,8sleep02442351-21ssh0
23652132131,8sleep02365225-21ssh0
23652132131,8sleep02365225-21ssh0
22431122131,8sleep02243200-21ntpq0
22325732131,6sleep02232622-21ntpq0
22178522130,3sleep20-21swapper/22
218366199138,2cyclictest23082472sleep33
218366199137,4cyclictest0-21swapper/33
218366199137,3cyclictest21886362sleep33
26699572121,7sleep12669970-21ssh1
26442162121,5sleep22313768-21diskmemload2
26041242121,7sleep12605779-21kthreadcore1
25910852121,4sleep00-21swapper/00
25760152121,6sleep02313768-21diskmemload0
25461622121,3sleep12546221-21ssh1
25218482121,7sleep12521859-21sh1
25132192121,6sleep00-21swapper/00
25129752121,8sleep12512985-21ssh1
24888732121,7sleep22488884-21ssh2
24533942121,7sleep22313768-21diskmemload2
24368092121,7sleep22437075-21/usr/sbin/munin2
24186062121,8sleep02418616-21ssh0
23672332121,5sleep12367424-21smartctl1
23646822121,2sleep20-21swapper/22
23646822121,2sleep20-21swapper/22
23535402121,6sleep12353588-21ntpq1
23500302121,7sleep22351453-21ssh2
23231352121,7sleep12313768-21diskmemload1
22660762120,2sleep10-21swapper/11
21993112121,5sleep12200413-21memory1
26608922110,3sleep22660903-21ssh2
26429242111,5sleep02313768-21diskmemload0
26362342110,5sleep10-21swapper/11
26183302116,2sleep00-21swapper/00
26102142111,3sleep20-21swapper/22
25286392111,5sleep02528702-21ntpq0
25198772111,5sleep02519935-21ntpq0
24848752112,5sleep02484927-21ntpq0
24772892111,7sleep22477302-21rm2
24705012111,3sleep20-21swapper/22
24697212111,4sleep02313768-21diskmemload0
24606352111,4sleep22313768-21diskmemload2
24362222111,3sleep20-21swapper/22
24336742110,5sleep00-21swapper/00
24258742111,3sleep20-21swapper/22
24174012111,7sleep12417414-21sh1
24155992111,3sleep20-21swapper/22
24087642110,1sleep00-21swapper/00
23919422111,4sleep20-21swapper/22
23831322110,2sleep02383146-21ssh0
23741492110,3sleep22374163-21ssh2
23645722111,4sleep12313768-21diskmemload1
23645722111,4sleep12313768-21diskmemload1
23481582110,4sleep20-21swapper/22
23319422111,4sleep22332205-21df2
23276982110,1sleep00-21swapper/00
22714252111,5sleep02271680-21df0
22658152111,5sleep12265843-21perf1
22604662111,7sleep22260533-21systemd-run2
22556832111,5sleep12255892-21hddtemp_smartct1
22541652111,5sleep12254219-21ntpq1
22019712111,5sleep22202123-21diskstats2
21887002110,1sleep20-21swapper/22
21841022111,6sleep12184252-21grep1
26795562101,4sleep12313768-21diskmemload1
26778952101,4sleep02313768-21diskmemload0
26700702100,2sleep20-21swapper/22
26430442101,2sleep10-21swapper/11
26356232101,2sleep00-21swapper/00
26183542101,2sleep20-21swapper/22
26081832100,1sleep00-21swapper/00
26020392101,5sleep12602053-21ssh1
25983892101,4sleep22598443-21ntpq2
25910042101,2sleep20-21swapper/22
25896792101,3sleep10-21swapper/11
25816662101,4sleep02313768-21diskmemload0
25770302101,5sleep12577167-21grep1
25621592101,4sleep02563332-21memory0
25560862101,2sleep10-21swapper/11
25560862101,2sleep10-21swapper/11
25558752101,3sleep02313768-21diskmemload0
25558752101,3sleep02313768-21diskmemload0
25372542101,5sleep02537316-21ntpq0
25038952101,3sleep20-21swapper/22
24985112101,4sleep02498643-21perl0
24968272101,3sleep00-21swapper/00
24878362101,3sleep12313768-21diskmemload1
24795772101,3sleep02313768-21diskmemload0
24785262100,1sleep10-21swapper/11
24591452101,5sleep12459399-21unixbench_singl1
24506042101,4sleep02313768-21diskmemload0
24408612101,3sleep10-21swapper/11
24247462101,2sleep10-21swapper/11
24027522101,5sleep22404359-21cut2
23497232101,5sleep02349940-21hddtemp_smartct0
23149882102,4sleep02313768-21diskmemload0
23087112101,4sleep12308730-21apt-get1
23074042101,4sleep22307452-21ntpq2
22859612101,4sleep02286102-21ntpq0
22272402101,4sleep02227288-21ntpq0
21903612101,4sleep22191117-21hddtemp_smartct2
2661870290,1sleep00-21swapper/00
2660173291,2sleep10-21swapper/11
2652042291,2sleep00-21swapper/00
2626237291,3sleep10-21swapper/11
2539302291,3sleep10-21swapper/11
2537677291,4sleep22537754-21threads2
2522068291,3sleep22313768-21diskmemload2
2450764291,3sleep12313768-21diskmemload1
2425997291,3sleep02313768-21diskmemload0
2399770291,2sleep00-21swapper/00
2389257291,2sleep10-21swapper/11
2380962291,3sleep12313768-21diskmemload1
2379824291,3sleep20-21swapper/22
2332249291,4sleep02332470-21ssh0
2303379290,1sleep10-21swapper/11
2249725291,3sleep22249549-21apt-get2
2248549291,4sleep12248600-21ld1
2237699291,4sleep22237833-21netstat2
2217548291,4sleep20-21swapper/22
2214036291,4sleep02215824-21grep0
2205854291,4sleep02205911-21ntpq0
2185450291,4sleep02187243-21cut0
2308733281,3sleep22308888-21cstates2
2302820280,1sleep00-21swapper/00
2298322280,1sleep10-21swapper/11
2297774281,3sleep02297905-21latency_hist0
2282614281,3sleep12282657-21kthreadcore1
2275575281,3sleep22275719-21mailstats2
2260749281,2sleep22260768-21apt-get2
2257373280,5sleep02257487-21kthreadcore0
2227353281,3sleep22227466-21ps2
2222544280,2sleep10-21swapper/11
2212097280,1sleep10-21swapper/11
2211188281,3sleep20-21swapper/22
2287381270,2sleep10-21swapper/11
2278199271,3sleep02279963-21cut0
2276201270,1sleep10-21swapper/11
2266098271,2sleep20-21swapper/22
2260929270,4sleep02260750-21/usr/sbin/munin0
2250076271,1sleep02250095-21apt-get0
2249347272,3sleep2431ktimers/22
2244471270,2sleep00-21swapper/00
2238580270,2sleep10-21swapper/11
2217200270,1sleep10-21swapper/11
2202407271,2sleep10-21swapper/11
2195055271,3sleep12195193-21/usr/sbin/munin1
2313595260,1sleep00-21swapper/00
2307761260,2sleep00-21swapper/00
2297473260,1sleep20-21swapper/22
2296831261,2sleep10-21swapper/11
2287403261,2sleep20-21swapper/22
2283379261,1sleep20-21swapper/22
2281630260,1sleep10-21swapper/11
2280612260,2sleep20-21swapper/22
2269916260,2sleep02270089-21strings0
2240739260,2sleep20-21swapper/22
2239151261,2sleep10-21swapper/11
2238709260,1sleep00-21swapper/00
2223149260,4sleep10-21swapper/11
2222742260,1sleep00-21swapper/00
2209257261,2sleep00-21swapper/00
2197590261,2sleep00-21swapper/00
2196169260,1sleep00-21swapper/00
2228808250,1sleep20-21swapper/22
2287380240,3sleep00-21swapper/00
2196856240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional