You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 23:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Jun 13, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
252250922080,2sleep02522507-21ntpq0
262494521420,2sleep0221rcuc/00
2150888212752,70sleep30-21swapper/33
215031928055,14sleep10-21swapper/11
215074827858,14sleep00-21swapper/00
215087727658,12sleep20-21swapper/22
2151215992220,1cyclictest0-21swapper/33
2151215992218,2cyclictest0-21swapper/33
215121599221,16cyclictest2290864-21chrt3
26329352211,3sleep00-21swapper/00
24512452211,8sleep02451457-21hddtemp_smartct0
2151215992118,1cyclictest0-21swapper/33
215121599211,17cyclictest0-21swapper/33
215121599211,16cyclictest2467118-21taskset3
215121599211,14cyclictest0-21swapper/33
25176522200,2sleep30-21swapper/33
24978692201,2sleep10-21swapper/11
215121599201,16cyclictest0-21swapper/33
215121599201,14cyclictest0-21swapper/33
2151215991916,2cyclictest0-21swapper/33
2151215991916,1cyclictest0-21swapper/33
215121599191,15cyclictest0-21swapper/33
215121599191,15cyclictest0-21swapper/33
215121599191,14cyclictest2322434-21taskset3
215121599191,14cyclictest0-21swapper/33
215121599191,14cyclictest0-21swapper/33
2151215991910,6cyclictest2523649-21taskset3
26091202181,4sleep02282162-21diskmemload0
22547532181,7sleep22254927-21cat2
2151215991816,1cyclictest0-21swapper/33
2151215991814,2cyclictest0-21swapper/33
2151215991813,3cyclictest66950irq/132-enp1s0-TxRx-33
2151215991813,2cyclictest0-21swapper/33
2151215991811,6cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,14cyclictest0-21swapper/33
215121599181,13cyclictest0-21swapper/33
215121599181,13cyclictest0-21swapper/33
215121599181,13cyclictest0-21swapper/33
215121599181,13cyclictest0-21swapper/33
215121599181,13cyclictest0-21swapper/33
25657242171,5sleep02282162-21diskmemload0
25322642171,4sleep02282162-21diskmemload0
24141552171,3sleep10-21swapper/11
23132982171,4sleep12282162-21diskmemload1
21750192171,5sleep12175272-21df1
215121599171,4cyclictest0-21swapper/33
215121599171,4cyclictest0-21swapper/33
2151215991713,2cyclictest0-21swapper/33
2151215991712,3cyclictest0-21swapper/33
215121599171,13cyclictest0-21swapper/33
215121599171,13cyclictest0-21swapper/33
215121599171,12cyclictest0-21swapper/33
215121599170,14cyclictest0-21swapper/33
215121599170,14cyclictest0-21swapper/33
215121599170,14cyclictest0-21swapper/33
215121599170,14cyclictest0-21swapper/33
215121599170,13cyclictest0-21swapper/33
26170522161,2sleep00-21swapper/00
24410792161,3sleep20-21swapper/22
24322282162,8sleep02282162-21diskmemload0
24065932161,3sleep20-21swapper/22
21637882167,2sleep2171rcu_preempt2
215121599163,1cyclictest0-21swapper/33
2151215991613,1cyclictest0-21swapper/33
215121599161,13cyclictest0-21swapper/33
215121599160,13cyclictest0-21swapper/33
215121599160,13cyclictest0-21swapper/33
215121599160,12cyclictest0-21swapper/33
25933292151,7sleep22593340-21ssh2
25930472151,2sleep10-21swapper/11
25594922151,3sleep02282162-21diskmemload0
25080712151,4sleep12508082-21ssh1
24818942151,9sleep20-21swapper/22
24308132157,5sleep12151209-21cyclictest1
24144782151,4sleep02282162-21diskmemload0
24138822151,4sleep22413895-21ssh2
24072202151,4sleep12282162-21diskmemload1
23634442150,2sleep00-21swapper/00
23485882151,9sleep12282162-21diskmemload1
21805842151,4sleep12180687-21perl1
215121599156,6cyclictest2174760-21turbostat3
215121599153,8cyclictest0-21swapper/33
215121599151,2cyclictest0-21swapper/33
2151215991511,2cyclictest0-21swapper/33
2151215991510,3cyclictest0-21swapper/33
215121599150,13cyclictest0-21swapper/33
215121599150,12cyclictest0-21swapper/33
26246312141,4sleep12618267-21kworker/u16:2+rpciod1
25504602141,2sleep20-21swapper/22
25176802141,4sleep12517700-21apt-get1
24564182141,4sleep22456429-21ssh2
24486232140,3sleep20-21swapper/22
215121599140,11cyclictest0-21swapper/33
215121599140,11cyclictest0-21swapper/33
25522922131,7sleep22552657-21cut2
25503832131,5sleep00-21swapper/00
25430722130,3sleep12282162-21diskmemload1
25137992131,7sleep22513840-21ntpq2
24082782131,3sleep02408288-21ssh0
23568732132,7sleep22282162-21diskmemload2
23562832134,4sleep0151ktimers/00
23547602131,8sleep12354771-21ssh1
23294792131,8sleep02282162-21diskmemload0
23142422131,7sleep22282162-21diskmemload2
22491852131,6sleep02249241-21ntpq0
22391572130,1sleep00-21swapper/00
21853782131,3sleep02185309-31find0
215121599138,3cyclictest2185795-21chrt3
215121599138,3cyclictest2185795-21chrt3
215121599131,9cyclictest2255441-21taskset3
26119152121,7sleep12613591-21tr1
26076942121,3sleep12607705-21ssh1
26010372120,1sleep00-21swapper/00
25588192121,5sleep10-21swapper/11
25262882121,7sleep22282162-21diskmemload2
25068102121,5sleep20-21swapper/22
24684622121,7sleep02470019-21cut0
24582682121,5sleep10-21swapper/11
24313352121,3sleep22431347-21ssh2
24246552121,3sleep02424666-21ssh0
24171982121,5sleep12417222-21ssh1
23992702121,5sleep00-21swapper/00
23989612121,2sleep10-21swapper/11
23921692121,6sleep22392305-21diskstats2
23899592120,2sleep10-21swapper/11
23491252121,7sleep02349139-21ssh0
23463552121,3sleep22346365-21ssh2
23127722121,7sleep02282162-21diskmemload0
23061992121,8sleep12282162-21diskmemload1
22758622121,5sleep22275911-21ntpq2
22651152121,6sleep22265162-21ntpq2
26337252110,1sleep10-21swapper/11
25897292111,5sleep02589793-21ntpq0
25819182111,4sleep20-21swapper/22
25739332111,7sleep12573944-21ssh1
25687942115,3sleep02568468-21/usr/sbin/munin0
25673812110,7sleep12567393-21ssh1
25606772111,5sleep22560760-21irqstats2
25496922110,3sleep12549699-21ssh1
25396592111,6sleep02535109-21/usr/sbin/munin0
25262772111,4sleep12282162-21diskmemload1
24917932111,5sleep22282162-21diskmemload2
24851562111,6sleep12485704-21tr1
24756732111,3sleep20-21swapper/22
24647032111,3sleep00-21swapper/00
24642572111,6sleep22464271-21ssh2
24487412111,6sleep02448751-21ssh0
24412902111,3sleep00-21swapper/00
24402322114,1sleep1171rcu_preempt1
24252232111,3sleep20-21swapper/22
23885992110,3sleep22388613-21ssh2
23828912111,4sleep12282162-21diskmemload1
23745432110,7sleep02374554-21ssh0
23388362111,6sleep12338847-21ssh1
23370772111,5sleep22337131-21ntpq2
23231722111,4sleep20-21swapper/22
22908302111,4sleep22282162-21diskmemload2
22870882111,3sleep20-21swapper/22
22557262111,6sleep22255705-21/usr/sbin/munin2
22504472111,5sleep12250700-21df1
22277842113,3sleep22227825-21ntpq2
21914612111,5sleep02191670-21hddtemp_smartct0
21696752111,4sleep12169694-21apt-get1
21646402111,6sleep22165639-21grep2
26339142101,3sleep20-21swapper/22
26155372100,4sleep20-21swapper/22
26071162101,2sleep20-21swapper/22
25987182101,5sleep12598730-21ssh1
25978532101,5sleep22597899-21ntpq2
25828762101,3sleep10-21swapper/11
25827242101,4sleep02282162-21diskmemload0
25738952101,3sleep20-21swapper/22
25334262103,1sleep20-21swapper/22
25139052101,4sleep02513968-21ntp_states0
25009472101,4sleep02282162-21diskmemload0
25000512101,3sleep02282162-21diskmemload0
24927902101,2sleep20-21swapper/22
24914682101,4sleep02282162-21diskmemload0
24818132100,1sleep00-21swapper/00
24811282101,3sleep12282162-21diskmemload1
24756142101,2sleep12475626-21ssh1
24656722101,3sleep10-21swapper/11
24481042101,3sleep10-21swapper/11
23894682101,4sleep02282162-21diskmemload0
23823082101,4sleep02282162-21diskmemload0
23713522101,3sleep20-21swapper/22
23710122101,3sleep10-21swapper/11
23652082100,4sleep10-21swapper/11
23626422101,5sleep22362701-21ntpq2
23396142101,4sleep02282162-21diskmemload0
23294422101,3sleep10-21swapper/11
23218442101,5sleep12282162-21diskmemload1
23215002100,1sleep00-21swapper/00
22986402101,2sleep10-21swapper/11
22970912103,3sleep02282162-21diskmemload0
22885512101,3sleep10-21swapper/11
22599002101,5sleep02260027-21systemctl0
22154942101,4sleep22216723-21memory2
22138072101,5sleep12215493-21kthreadcore1
21952302101,4sleep22195285-21ntpq2
21911702101,4sleep12191189-21apt-get1
21564512101,5sleep02156596-21munin-node0
2625250291,2sleep20-21swapper/22
2540896291,2sleep20-21swapper/22
2531912291,2sleep10-21swapper/11
2382336291,4sleep22382349-21sh2
2329591291,2sleep20-21swapper/22
2305535291,3sleep02282162-21diskmemload0
2304137290,3sleep20-21swapper/22
2288219291,2sleep00-21swapper/00
2277598290,5sleep22277727-21kthreadcore2
2271217291,2sleep00-21swapper/00
2266699291,4sleep22266912-21hddtemp_smartct2
2254423291,4sleep02254464-21ntpq0
2240335291,4sleep02241930-21tr0
2234978291,4sleep12235696-21cut1
2212774291,3sleep02212279-21apt-get0
2187708292,3sleep02189519-21kthreadcore0
2187708292,3sleep02189519-21kthreadcore0
2164358291,5sleep02164491-21tail0
2275695281,2sleep00-21swapper/00
2255704280,3sleep12255723-21apt-get1
2238508281,3sleep22238554-21grep2
2227646281,3sleep12223764-21/usr/sbin/munin1
2212061280,2sleep10-21swapper/11
2211269281,3sleep02211320-21ntpq0
2201826280,2sleep20-21swapper/22
2190592281,4sleep2802-21snmpd2
2190592281,4sleep2802-21snmpd2
2185390280,2sleep22185273-31frcode2
2174997281,2sleep00-21swapper/00
2170315281,3sleep22171982-21kthreadcore2
2169138281,4sleep12169393-21cat1
2156713281,3sleep12157135-21ps1
2266063270,1sleep00-21swapper/00
2245081270,2sleep20-21swapper/22
2244710270,1sleep20-21swapper/22
2244499270,1sleep10-21swapper/11
2234137270,1sleep10-21swapper/11
2229658271,3sleep22230485-21kthreadcore2
2219708271,3sleep00-21swapper/00
2211645271,3sleep20-21swapper/22
2206810270,1sleep00-21swapper/00
2201395270,1sleep10-21swapper/11
2201340270,1sleep00-21swapper/00
2201229270,1sleep20-21swapper/22
2190753270,1sleep10-21swapper/11
2190753270,1sleep10-21swapper/11
2179962270,1sleep20-21swapper/22
2156240270,1sleep10-21swapper/11
2151968271,3sleep02153564-21kthreadcore0
2281820260,1sleep10-21swapper/11
2271760260,2sleep10-21swapper/11
2270540260,3sleep10-21swapper/11
2261027260,1sleep10-21swapper/11
2250072260,1sleep10-21swapper/11
2233832260,4sleep00-21swapper/00
2228470260,1sleep00-21swapper/00
2223278260,4sleep20-21swapper/22
2206658260,1sleep10-21swapper/11
2174503260,4sleep00-21swapper/00
2156168260,1sleep20-21swapper/22
2282111250,1sleep00-21swapper/00
2217893250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional