You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 00:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sun Apr 19, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2031139212349,69sleep30-21swapper/33
222075821150,2sleep00-21swapper/00
203116428767,12sleep20-21swapper/22
203119628466,12sleep10-21swapper/11
203133427753,7sleep00-21swapper/00
203145699262,20cyclictest0-21swapper/33
203145699214,3cyclictest2431685-21taskset3
203145699211,13cyclictest0-21swapper/33
24156512201,8sleep02161400-21diskmemload0
2031456992016,2cyclictest0-21swapper/33
203145699201,15cyclictest2492567-21chrt3
203145699200,18cyclictest0-21swapper/33
203145699200,18cyclictest0-21swapper/33
203145699200,18cyclictest0-21swapper/33
23157562190,2sleep00-21swapper/00
22139272191,5sleep10-21swapper/11
203145699191,7cyclictest2520278-21taskset3
203145699191,7cyclictest0-21swapper/33
203145699191,6cyclictest66950irq/132-enp1s0-TxRx-33
203145699191,15cyclictest0-21swapper/33
203145699191,14cyclictest66950irq/132-enp1s0-TxRx-33
203145699191,14cyclictest0-21swapper/33
203145699191,14cyclictest0-21swapper/33
203145699191,14cyclictest0-21swapper/33
203145699191,14cyclictest0-21swapper/33
203145699191,14cyclictest0-21swapper/33
203145699191,14cyclictest0-21swapper/33
203145699191,14cyclictest0-21swapper/33
203145699191,14cyclictest0-21swapper/33
21684152181,12sleep12161400-21diskmemload1
203145699183,13cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,14cyclictest0-21swapper/33
203145699181,13cyclictest0-21swapper/33
203145699181,13cyclictest0-21swapper/33
203145699181,13cyclictest0-21swapper/33
203145699181,13cyclictest0-21swapper/33
203145699181,13cyclictest0-21swapper/33
203145699181,12cyclictest0-21swapper/33
203145699180,14cyclictest0-21swapper/33
23495892171,3sleep00-21swapper/00
22306702170,2sleep10-21swapper/11
22045902171,4sleep22161400-21diskmemload2
203145699171,14cyclictest0-21swapper/33
203145699171,14cyclictest0-21swapper/33
203145699171,13cyclictest0-21swapper/33
203145699171,13cyclictest0-21swapper/33
203145699171,13cyclictest0-21swapper/33
203145699170,14cyclictest66950irq/132-enp1s0-TxRx-33
203145699170,14cyclictest0-21swapper/33
203145699170,13cyclictest0-21swapper/33
25190462161,4sleep12161400-21diskmemload1
24765062161,7sleep22476516-21ssh2
23336502161,4sleep02161400-21diskmemload0
21866922161,6sleep12161400-21diskmemload1
21766802161,4sleep22161400-21diskmemload2
203145699161,13cyclictest0-21swapper/33
203145699161,12cyclictest0-21swapper/33
203145699160,14cyclictest0-21swapper/33
203145699160,13cyclictest0-21swapper/33
203145699160,13cyclictest0-21swapper/33
203145699160,13cyclictest0-21swapper/33
203145699160,13cyclictest0-21swapper/33
24505462151,3sleep20-21swapper/22
24242942157,4sleep12424307-21sh1
23702462151,2sleep00-21swapper/00
23702462151,2sleep00-21swapper/00
23194732151,4sleep02319487-21ssh0
22916672151,9sleep12161400-21diskmemload1
21780292151,4sleep02178041-21ssh0
203145699158,4cyclictest2108093-21chrt3
203145699158,4cyclictest2108093-21chrt3
203145699151,8cyclictest20443632sleep33
203145699151,2cyclictest0-21swapper/33
2031456991512,2cyclictest0-21swapper/33
203145699150,13cyclictest0-21swapper/33
203145699150,13cyclictest0-21swapper/33
203145699150,12cyclictest0-21swapper/33
203145699150,12cyclictest0-21swapper/33
24919032141,5sleep22491910-21sh2
24790832140,2sleep014-21ksoftirqd/00
24225472141,2sleep20-21swapper/22
23794122141,2sleep20-21swapper/22
23695992141,8sleep12161400-21diskmemload1
23695992141,8sleep12161400-21diskmemload1
23625522141,7sleep072-21kcompactd00
23237422141,7sleep22323801-21ntpq2
23085922140,2sleep10-21swapper/11
22944712141,8sleep02296100-21cut0
22135622141,3sleep02213574-21ssh0
21945272141,2sleep20-21swapper/22
21700412140,2sleep20-21swapper/22
21093662141,9sleep12111074-21grep1
203145699144,7cyclictest2043468-21taskset3
203145699144,7cyclictest2043468-21taskset3
203145699140,2cyclictest0-21swapper/33
203145699140,2cyclictest0-21swapper/33
25291242132,7sleep22529135-21ssh2
25132762131,8sleep00-21swapper/00
25029932131,8sleep22503004-21ssh2
24919662131,4sleep02491980-21ssh0
24756362131,8sleep12475646-21ssh1
24045062131,3sleep12404514-21ssh1
23863422131,7sleep02161400-21diskmemload0
23687612131,6sleep20-21swapper/22
23687612131,6sleep20-21swapper/22
23609122131,5sleep20-21swapper/22
23177452131,7sleep12161400-21diskmemload1
22293862131,8sleep02229400-21ssh0
21872392131,8sleep02161400-21diskmemload0
21336192131,8sleep12133759-21ntp_192.168.1141
20708672131,8sleep02070984-21sed0
203145699130,1cyclictest0-21swapper/33
25110662121,7sleep02511077-21ssh0
25095132120,1sleep10-21swapper/11
25041832121,7sleep22503863-21/usr/sbin/munin2
24847012121,6sleep12161400-21diskmemload1
24666352121,3sleep12466647-21ssh1
24290222121,5sleep12429080-21ntpq1
24116012121,7sleep12411663-21ssh1
23885982121,6sleep12161400-21diskmemload1
23809762120,3sleep22380990-21ssh2
23765922121,6sleep12376652-21ntpq1
23729652121,7sleep02374361-21cut0
23608022121,3sleep12360813-21ssh1
23443222121,7sleep22161400-21diskmemload2
23370402121,5sleep02337064-21apt-get0
22840862121,6sleep00-21swapper/00
22825832121,7sleep12282596-21sh1
22371322121,5sleep12161400-21diskmemload1
22020342121,5sleep00-21swapper/00
22011072121,7sleep12201248-21ssh1
21324872121,5sleep02133618-21memory0
20730942121,7sleep12074931-21grep1
20456672121,3sleep02047424-21cut0
203145699121,8cyclictest2031799-21taskset3
24931542111,3sleep10-21swapper/11
24466342111,5sleep12446698-21ntp_states1
24315752111,4sleep22161400-21diskmemload2
23939302111,5sleep22394083-21ntpq2
23898312111,7sleep12389842-21sh1
23257712111,6sleep12325781-21ssh1
23062452111,5sleep22306306-21ssh2
22986332111,4sleep22161400-21diskmemload2
22923812111,6sleep22161400-21diskmemload2
22739632111,4sleep22161400-21diskmemload2
22710772111,5sleep02271229-21ntpq0
22541362111,6sleep22254145-21/usr/sbin/munin2
22193062111,3sleep20-21swapper/22
21925732111,5sleep02192630-21ntpq0
21836402111,5sleep22183743-21ntpq2
21456942112,4sleep12145713-21apt-get1
21288602111,5sleep02129057-21users0
21016292111,5sleep02101770-21ntpq0
20749332110,2sleep22075138-21strings2
20653362111,6sleep22065368-21gpgconf2
20643582111,5sleep02064404-21ntpq0
20482992111,4sleep22048412-21ntpq2
20361242111,5sleep02036329-21users0
25269662101,2sleep00-21swapper/00
25213002101,4sleep12161400-21diskmemload1
25009552100,2sleep10-21swapper/11
24950152100,1sleep00-21swapper/00
24840582101,4sleep22483584-21kworker/u16:3+rpciod2
24756242100,1sleep00-21swapper/00
24599172101,5sleep22460048-21cpuspeed_turbos2
24564792101,3sleep00-21swapper/00
24561492101,2sleep20-21swapper/22
24560822101,3sleep10-21swapper/11
24397322101,4sleep02161400-21diskmemload0
24332132101,4sleep12161400-21diskmemload1
24307852101,4sleep02430799-21ssh0
23994202101,6sleep22401024-21kthreadcore2
23976692101,3sleep00-21swapper/00
23460112102,5sleep22319036-21kworker/u16:1+xprtiod2
23425972101,4sleep12161400-21diskmemload1
23362562101,4sleep22161400-21diskmemload2
23338672101,4sleep12161400-21diskmemload1
23150602101,4sleep22315128-21ntp_states2
23056532101,2sleep00-21swapper/00
22907982100,1sleep00-21swapper/00
22817292101,3sleep20-21swapper/22
22740592101,4sleep12161400-21diskmemload1
22604122101,5sleep02262169-21tr0
22550032101,3sleep12161400-21diskmemload1
22547922101,3sleep00-21swapper/00
22479442101,3sleep20-21swapper/22
22464512100,2sleep02246463-21ssh0
22321192101,2sleep2171rcu_preempt2
22311352101,3sleep20-21swapper/22
22103742101,4sleep22161400-21diskmemload2
21943092101,4sleep12161400-21diskmemload1
21679462100,1sleep00-21swapper/00
21602582102,3sleep22160371-21ntpq2
21406582101,4sleep02140867-21hddtemp_smartct0
21350652101,4sleep22135317-21df2
21294332101,4sleep12129504-21munin-run1
21084032101,4sleep02108422-21apt-get0
21018192101,4sleep22101873-21ntpq2
20654182101,4sleep12065392-31find1
20555772101,2sleep10-21swapper/11
20446442101,4sleep12044747-21perl1
2448898291,3sleep00-21swapper/00
2433467291,2sleep20-21swapper/22
2421921291,3sleep00-21swapper/00
2409020292,3sleep20-21swapper/22
2405051290,3sleep00-21swapper/00
2345926291,4sleep12161400-21diskmemload1
2299181291,3sleep12161400-21diskmemload1
2264605291,2sleep20-21swapper/22
2263530291,3sleep12161400-21diskmemload1
2247224291,3sleep12161400-21diskmemload1
2237445291,2sleep00-21swapper/00
2214866291,3sleep12161400-21diskmemload1
2151021290,4sleep02151040-21apt-get0
2145433291,4sleep12145459-21grep1
2119039291,3sleep02119058-21apt-get0
2050234291,4sleep12050645-21cut1
2039473291,4sleep02039696-21kthreadcore0
2039473291,4sleep02039696-21kthreadcore0
2517750280,2sleep20-21swapper/22
2467537280,2sleep00-21swapper/00
2177948281,3sleep12161400-21diskmemload1
2151298281,4sleep22151361-21cut2
2145238280,2sleep20-21swapper/22
2139241280,1sleep00-21swapper/00
2130258281,3sleep22130771-21kthreadcore2
2097745281,3sleep12097764-21apt-get1
2081281280,1sleep10-21swapper/11
2059366280,5sleep22059376-21switchtime2
2058961281,3sleep02059050-21ntpq0
2039699281,3sleep12041389-21tr1
2039699281,3sleep12041389-21tr1
2161152270,4sleep10-21swapper/11
2155934270,1sleep10-21swapper/11
2135043270,2sleep10-21swapper/11
2124991271,2sleep20-21swapper/22
2123748270,1sleep10-21swapper/11
2118078271,2sleep12118149-21find1
2115238271,3sleep00-21swapper/00
2113447270,1sleep20-21swapper/22
2107420271,3sleep22107590-21wc2
2107420271,3sleep22107590-21wc2
2103048270,2sleep00-21swapper/00
2103048270,2sleep00-21swapper/00
2097170270,4sleep20-21swapper/22
2092422270,2sleep00-21swapper/00
2092091270,1sleep00-21swapper/00
2089092271,3sleep12090931-21grep1
2086586270,1sleep20-21swapper/22
2076453270,2sleep20-21swapper/22
2071698271,2sleep02073093-21kthreadcore0
2070525270,1sleep20-21swapper/22
2054714270,1sleep00-21swapper/00
2054397270,1sleep20-21swapper/22
2041391270,3sleep22042864-21cut2
2041391270,3sleep22042864-21cut2
2031629270,2sleep12031648-21apt-get1
2157619261,2sleep00-21swapper/00
2150602260,1sleep20-21swapper/22
2145693260,1sleep00-21swapper/00
2123765260,1sleep20-21swapper/22
2118428260,1sleep20-21swapper/22
2104139260,2sleep12105846-21cut1
2104139260,2sleep12105846-21cut1
2096514260,2sleep10-21swapper/11
2082380261,2sleep10-21swapper/11
2081777260,1sleep00-21swapper/00
2031651260,3sleep22031794-21cstates2
2091273250,1sleep20-21swapper/22
2076244250,1sleep00-21swapper/00
2069892250,2sleep12069933-21ntpq1
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional