You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 06:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Thu Jun 18, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2196430212258,58sleep30-21swapper/33
2196430212258,58sleep30-21swapper/33
24536372930,2sleep10-21swapper/11
220120528958,12sleep10-21swapper/11
220120528958,12sleep10-21swapper/11
219622928661,17sleep00-21swapper/00
219622928661,17sleep00-21swapper/00
220089228362,12sleep20-21swapper/22
220089228362,12sleep20-21swapper/22
2201361992420,2cyclictest0-21swapper/33
24210562230,2sleep20-21swapper/22
24210562230,2sleep20-21swapper/22
220136199221,17cyclictest2664214-21taskset3
220136199221,17cyclictest2413398-21taskset3
220136199221,17cyclictest2404798-21taskset3
25601422211,16sleep12561787-21kthreadcore1
23819402211,6sleep12382019-21/usr/sbin/munin1
2201361992118,1cyclictest0-21swapper/33
220136199201,3cyclictest0-21swapper/33
220136199201,15cyclictest66950irq/132-enp1s0-TxRx-33
25567702191,3sleep00-21swapper/00
220136199199,6cyclictest24835862sleep33
2201361991915,2cyclictest0-21swapper/33
2201361991912,6cyclictest0-21swapper/33
2201361991911,6cyclictest0-21swapper/33
220136199191,15cyclictest0-21swapper/33
220136199191,15cyclictest0-21swapper/33
220136199191,14cyclictest0-21swapper/33
220136199191,14cyclictest0-21swapper/33
220136199191,14cyclictest0-21swapper/33
220136199191,14cyclictest0-21swapper/33
220136199191,14cyclictest0-21swapper/33
220136199190,16cyclictest66950irq/132-enp1s0-TxRx-33
220136199190,15cyclictest66950irq/132-enp1s0-TxRx-33
220136199190,15cyclictest2673830-21chrt3
23902182181,7sleep02331507-21diskmemload0
2201361991814,3cyclictest66950irq/132-enp1s0-TxRx-33
2201361991814,2cyclictest0-21swapper/33
2201361991811,5cyclictest0-21swapper/33
220136199181,14cyclictest0-21swapper/33
220136199181,14cyclictest0-21swapper/33
220136199181,14cyclictest0-21swapper/33
220136199181,14cyclictest0-21swapper/33
220136199181,14cyclictest0-21swapper/33
220136199181,14cyclictest0-21swapper/33
220136199181,13cyclictest0-21swapper/33
220136199181,13cyclictest0-21swapper/33
220136199181,13cyclictest0-21swapper/33
220136199181,13cyclictest0-21swapper/33
220136199180,2cyclictest0-21swapper/33
220136199180,14cyclictest2441438-21taskset3
24391182171,12sleep02439131-21ssh0
220136199177,6cyclictest2272893-21turbostat3
220136199177,6cyclictest2272893-21turbostat3
2201361991714,1cyclictest0-21swapper/33
220136199171,14cyclictest0-21swapper/33
220136199171,14cyclictest0-21swapper/33
220136199171,13cyclictest0-21swapper/33
220136199171,13cyclictest0-21swapper/33
220136199171,12cyclictest2441104-21turbostat3
220136199170,14cyclictest0-21swapper/33
220136199170,13cyclictest0-21swapper/33
25404592161,3sleep10-21swapper/11
220136199161,3cyclictest0-21swapper/33
2201361991612,2cyclictest0-21swapper/33
2201361991612,2cyclictest0-21swapper/33
220136199161,13cyclictest0-21swapper/33
220136199161,13cyclictest0-21swapper/33
220136199161,11cyclictest2262464-21chrt3
220136199160,13cyclictest0-21swapper/33
220136199160,13cyclictest0-21swapper/33
220136199160,13cyclictest0-21swapper/33
26024652155,6sleep12604187-21cut1
25997942151,3sleep02331507-21diskmemload0
25713612151,8sleep12571428-21ntp_states1
24810652151,3sleep10-21swapper/11
24484322151,4sleep12331507-21diskmemload1
24132502151,4sleep22331507-21diskmemload2
23658782150,1sleep00-21swapper/00
220136199156,6cyclictest2310223-21turbostat3
220136199151,2cyclictest0-21swapper/33
2201361991512,1cyclictest0-21swapper/33
220136199151,12cyclictest0-21swapper/33
220136199150,13cyclictest0-21swapper/33
220136199150,13cyclictest0-21swapper/33
220136199150,13cyclictest0-21swapper/33
220136199150,13cyclictest0-21swapper/33
220136199150,12cyclictest0-21swapper/33
26573212141,3sleep10-21swapper/11
26567512140,2sleep20-21swapper/22
25472532141,8sleep22331507-21diskmemload2
25149922141,4sleep12515002-21ssh1
23530432141,8sleep12353109-21ntp_states1
23367352140,3sleep22331507-21diskmemload2
23367352140,3sleep22331507-21diskmemload2
220136199148,3cyclictest22941022sleep33
220136199141,1cyclictest0-21swapper/33
220136199140,2cyclictest0-21swapper/33
220136199140,12cyclictest0-21swapper/33
26651592131,8sleep22665170-21ssh2
26483172137,3sleep12648331-21ssh1
25823392131,8sleep02582352-21sh0
25044162131,6sleep12504467-21ntpq1
24728492131,2sleep00-21swapper/00
23962972131,5sleep20-21swapper/22
23715022131,6sleep20-21swapper/22
23380082130,8sleep02331507-21diskmemload0
23380082130,8sleep02331507-21diskmemload0
22771882131,7sleep02277229-21ntpq0
2201361991310,2cyclictest0-21swapper/33
26751542121,5sleep10-21swapper/11
26738192121,7sleep22673829-21ssh2
26583702121,7sleep02658380-21ssh0
26331622121,6sleep12331507-21diskmemload1
26148592120,2sleep22614870-21ssh2
26062672120,8sleep22606280-21ssh2
25972242121,3sleep20-21swapper/22
25900822121,7sleep02331507-21diskmemload0
25893102121,6sleep12331507-21diskmemload1
25651272121,6sleep22331507-21diskmemload2
25330892121,3sleep10-21swapper/11
25245472121,3sleep02524558-21ssh0
25074942121,6sleep22331507-21diskmemload2
24722582121,6sleep21-21systemd2
24297782121,5sleep10-21swapper/11
24235712121,7sleep12423583-21ssh1
24235712121,7sleep12423583-21ssh1
24062552121,7sleep02406268-21ssh0
24057172121,6sleep20-21swapper/22
24007772121,8sleep10-21swapper/11
23815692123,5sleep2431ktimers/22
23452112120,3sleep02345222-21ssh0
23104962121,6sleep02310749-21df0
23047672121,4sleep10-21swapper/11
22790662121,3sleep1321rcuc/11
22609242120,6sleep02260970-21ntpq0
26763872111,5sleep12676606-21hddtemp_smartct1
26462262111,5sleep22646283-21ntpq2
26406142111,4sleep20-21swapper/22
26295942111,5sleep22629646-21ntpq2
26235922110,6sleep02331507-21diskmemload0
26171782111,5sleep22617437-21df2
26153462111,4sleep10-21swapper/11
25795152110,5sleep12579563-21ntpq1
25735122111,6sleep00-21swapper/00
25655212111,6sleep02565534-21ssh0
25509922111,6sleep22552421-21kthreadcore2
25374602111,4sleep22537874-21memory2
25230362111,3sleep1171rcu_preempt1
24819792111,3sleep20-21swapper/22
24565302111,4sleep22331507-21diskmemload2
24518752111,6sleep02453445-21ssh0
24336272111,3sleep20-21swapper/22
23895832111,6sleep22389595-21ssh2
23810432111,5sleep02331507-21diskmemload0
23637622111,3sleep10-21swapper/11
23631582111,3sleep20-21swapper/22
23409982111,6sleep22342605-21cut2
23381042111,4sleep172-21kcompactd01
23381042111,4sleep172-21kcompactd01
23056502111,4sleep22305714-21irqstats2
22672752111,7sleep0802-21snmpd0
22515232111,5sleep22251541-21apt-get2
22408682111,5sleep22240887-21apt-get2
22405492111,6sleep02240550-21sshd0
22055762111,5sleep22205633-21ntpq2
26762392101,4sleep02676385-21diskstats0
26745902101,6sleep02331507-21diskmemload0
26498022101,4sleep02331507-21diskmemload0
26398692101,2sleep10-21swapper/11
26326392101,2sleep00-21swapper/00
26243122101,3sleep10-21swapper/11
25980742101,4sleep12331507-21diskmemload1
25908572100,2sleep20-21swapper/22
25827212101,3sleep22331507-21diskmemload2
25722262101,4sleep22331507-21diskmemload2
25574492100,2sleep10-21swapper/11
25495882101,2sleep10-21swapper/11
25490082101,4sleep02331507-21diskmemload0
25411142101,3sleep00-21swapper/00
25084992101,4sleep02331507-21diskmemload0
25002252101,4sleep02500249-21apt-get0
24997772101,2sleep10-21swapper/11
24937602100,6sleep22495462-21grep2
24913752101,3sleep00-21swapper/00
24890582101,2sleep20-21swapper/22
24633382101,4sleep12331507-21diskmemload1
24493412100,2sleep00-21swapper/00
24410672102,5sleep12441200-21sh1
24251972101,5sleep22426450-21tr2
24115272101,4sleep02411580-21ntpq0
23964022101,5sleep02396416-21ssh0
23726492101,4sleep12331507-21diskmemload1
23542752101,5sleep22354286-21sh2
23488262101,4sleep02349088-21df0
23452732101,4sleep12331507-21diskmemload1
22780702100,3sleep272-21kcompactd02
22728842101,4sleep22272911-21munin-run2
22728842101,4sleep22272911-21munin-run2
22518032101,4sleep02251906-21perl0
22355662101,6sleep22235681-21tr2
22094392101,5sleep12210645-21kthreadcore1
2681040291,2sleep20-21swapper/22
2664514291,3sleep02331507-21diskmemload0
2659459291,3sleep12331507-21diskmemload1
2633967291,4sleep02634066-21fschecks_time0
2614983291,2sleep00-21swapper/00
2600146290,2sleep00-21swapper/00
2531432290,1sleep20-21swapper/22
2530902291,2sleep00-21swapper/00
2524252291,3sleep22331507-21diskmemload2
2513637291,3sleep22331507-21diskmemload2
2498871291,3sleep02331507-21diskmemload0
2487880291,2sleep10-21swapper/11
2472437290,1sleep10-21swapper/11
2464610291,3sleep20-21swapper/22
2463516291,3sleep02331507-21diskmemload0
2446597291,4sleep22446600-21ssh2
2431718291,4sleep02331507-21diskmemload0
2421034291,2sleep00-21swapper/00
2421034291,2sleep00-21swapper/00
2411582291,3sleep10-21swapper/11
2389425291,3sleep12331507-21diskmemload1
2363326290,5sleep02363337-21sh0
2303731290,2sleep00-21swapper/00
2300960291,4sleep22302675-21cut2
2294010290,4sleep20-21swapper/22
2293216290,4sleep00-21swapper/00
2288821290,2sleep10-21swapper/11
2278578291,3sleep22278782-21diskstats2
2262057291,3sleep12261948-21apt-get1
2245059290,1sleep10-21swapper/11
2234133290,4sleep10-21swapper/11
2230771291,4sleep22231620-21grep2
2225425291,5sleep12225480-21kthreadcore1
2219290291,4sleep02219310-21dump-pmu-power0
2480142281,3sleep02480152-21ssh0
2390714281,3sleep12331507-21diskmemload1
2325199281,4sleep12325251-21gcc1
2317328281,3sleep22317872-21kthreadcore2
2278995281,3sleep02278496-21/usr/sbin/munin0
2272193281,3sleep02272389-21/usr/sbin/munin0
2272193281,3sleep02272389-21/usr/sbin/munin0
2256434280,1sleep10-21swapper/11
2247053281,3sleep00-21swapper/00
2234607281,3sleep02234857-21sed0
2224898280,1sleep20-21swapper/22
2219270280,2sleep20-21swapper/22
2210648281,3sleep22212413-21grep2
2207066281,3sleep02207264-21kthreadcore0
2329013271,3sleep12330333-21load1
2326453270,3sleep02326709-21df0
2315510270,1sleep10-21swapper/11
2299516270,1sleep20-21swapper/22
2299471270,1sleep00-21swapper/00
2284391270,4sleep02285890-21/usr/sbin/munin0
2278213271,3sleep12278254-21idleruntime-cro1
2272841270,1sleep10-21swapper/11
2272841270,1sleep10-21swapper/11
2262462271,2sleep22262463-21apt-get2
2258639271,3sleep10-21swapper/11
2235544270,2sleep10-21swapper/11
2221328271,3sleep02221641-21kthreadcore0
2214223270,2sleep10-21swapper/11
2325871260,1sleep20-21swapper/22
2321692261,2sleep00-21swapper/00
2320644260,1sleep10-21swapper/11
2315438260,4sleep20-21swapper/22
2306871261,2sleep00-21swapper/00
2294492260,2sleep12294511-21apt-get1
2290432261,2sleep10-21swapper/11
2261792260,1sleep20-21swapper/22
2250737261,2sleep20-21swapper/22
2248752260,3sleep10-21swapper/11
2245611260,1sleep00-21swapper/00
2206393260,1sleep10-21swapper/11
2203647261,2sleep00-21swapper/00
2326730251,1sleep20-21swapper/22
2315776250,2sleep00-21swapper/00
2305436250,1sleep10-21swapper/11
2288238250,1sleep20-21swapper/22
2228784250,1sleep00-21swapper/00
2224561250,1sleep10-21swapper/11
2223805250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional