You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 04:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Jun 27, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2614157213560,70sleep30-21swapper/33
261413628554,12sleep20-21swapper/22
261381328461,10sleep10-21swapper/11
260948327857,14sleep00-21swapper/00
2614532992623,1cyclictest0-21swapper/33
2614532992422,1cyclictest0-21swapper/33
2614532992422,1cyclictest0-21swapper/33
2614532992321,1cyclictest0-21swapper/33
2614532992321,1cyclictest0-21swapper/33
2614532992321,1cyclictest0-21swapper/33
2614532992220,1cyclictest0-21swapper/33
2614532992220,1cyclictest0-21swapper/33
2614532992219,1cyclictest0-21swapper/33
2614532992219,1cyclictest0-21swapper/33
2614532992119,1cyclictest0-21swapper/33
2614532992119,1cyclictest0-21swapper/33
2614532992118,1cyclictest0-21swapper/33
2614532992118,1cyclictest0-21swapper/33
2614532992118,1cyclictest0-21swapper/33
2614532992118,1cyclictest0-21swapper/33
2614532992116,2cyclictest0-21swapper/33
2614532992116,2cyclictest0-21swapper/33
28587282201,5sleep02859030-21grep0
261453299208,9cyclictest2948407-21turbostat3
261453299207,2cyclictest0-21swapper/33
261453299204,13cyclictest0-21swapper/33
2614532992018,1cyclictest0-21swapper/33
2614532992018,1cyclictest0-21swapper/33
2614532992018,1cyclictest0-21swapper/33
2614532992017,1cyclictest0-21swapper/33
2614532992016,2cyclictest0-21swapper/33
261453299201,15cyclictest2849741-21taskset3
261453299201,15cyclictest0-21swapper/33
29880602191,7sleep12742360-21diskmemload1
28895612197,8sleep02742360-21diskmemload0
261453299195,2cyclictest0-21swapper/33
2614532991917,1cyclictest0-21swapper/33
2614532991917,1cyclictest0-21swapper/33
2614532991917,1cyclictest0-21swapper/33
2614532991917,1cyclictest0-21swapper/33
2614532991917,1cyclictest0-21swapper/33
2614532991916,1cyclictest0-21swapper/33
2614532991916,1cyclictest0-21swapper/33
2614532991916,1cyclictest0-21swapper/33
2614532991912,4cyclictest0-21swapper/33
261453299191,14cyclictest2642549-21taskset3
29050192181,3sleep20-21swapper/22
29050192181,3sleep20-21swapper/22
28503622181,4sleep02851486-21grep0
261453299185,1cyclictest0-21swapper/33
2614532991816,1cyclictest0-21swapper/33
2614532991816,1cyclictest0-21swapper/33
2614532991815,1cyclictest0-21swapper/33
2614532991815,1cyclictest0-21swapper/33
2614532991815,1cyclictest0-21swapper/33
2614532991814,2cyclictest0-21swapper/33
2614532991814,2cyclictest0-21swapper/33
261453299181,14cyclictest0-21swapper/33
261453299181,13cyclictest0-21swapper/33
261453299180,16cyclictest0-21swapper/33
261453299180,15cyclictest0-21swapper/33
29077282171,5sleep12907993-21df1
27905542171,3sleep10-21swapper/11
27658942171,3sleep10-21swapper/11
27651882171,10sleep02742360-21diskmemload0
2614532991715,1cyclictest0-21swapper/33
2614532991713,2cyclictest0-21swapper/33
2614532991713,2cyclictest0-21swapper/33
2614532991713,2cyclictest0-21swapper/33
2614532991713,2cyclictest0-21swapper/33
2614532991713,2cyclictest0-21swapper/33
2614532991713,2cyclictest0-21swapper/33
30719362161,7sleep13071950-21ssh1
30396782160,13sleep03039691-21ssh0
28472282161,3sleep20-21swapper/22
28396672161,4sleep22742360-21diskmemload2
28382712161,2sleep00-21swapper/00
28305112160,1sleep00-21swapper/00
27742652161,9sleep02742360-21diskmemload0
26899962165,2sleep00-21swapper/00
2614532991614,1cyclictest0-21swapper/33
2614532991614,1cyclictest0-21swapper/33
2614532991613,1cyclictest0-21swapper/33
2614532991613,1cyclictest0-21swapper/33
261453299160,13cyclictest0-21swapper/33
29873452151,2sleep00-21swapper/00
29730782151,9sleep22742360-21diskmemload2
29543572151,3sleep10-21swapper/11
28140842151,2sleep20-21swapper/22
27567292151,2sleep00-21swapper/00
261453299157,6cyclictest66950irq/132-enp1s0-TxRx-33
2614532991513,1cyclictest0-21swapper/33
2614532991513,1cyclictest0-21swapper/33
2614532991512,1cyclictest0-21swapper/33
30739222141,7sleep20-21swapper/22
29984792142,6sleep22998505-21apt-get2
29389862141,8sleep22939000-21ssh2
29323052141,7sleep12932331-21ssh1
29309192140,4sleep20-21swapper/22
28631482141,8sleep12742360-21diskmemload1
28318372146,3sleep12742360-21diskmemload1
27922012142,6sleep12792225-21apt-get1
27420602140,1sleep10-21swapper/11
26902342143,6sleep22690231-21apt-get2
30831442131,5sleep20-21swapper/22
30811402131,4sleep13081152-21rm1
30413152132,4sleep1171rcu_preempt1
29813272133,4sleep2431ktimers/22
29723732130,2sleep00-21swapper/00
29654102132,5sleep12965409-21apt-get1
29616232131,6sleep02961881-21uptime0
29207442131,8sleep22920749-21ssh2
28739822131,7sleep12742360-21diskmemload1
28559902131,8sleep12856003-21sshd-auth1
27897742134,2sleep0171rcu_preempt0
26688162130,1sleep00-21swapper/00
30910582120,7sleep22742360-21diskmemload2
30845352121,7sleep03086086-21cut0
30467792121,7sleep03047017-21sed0
30416302121,7sleep23041644-21ssh2
30322682121,6sleep12742360-21diskmemload1
30322322121,2sleep20-21swapper/22
30222602120,3sleep23022272-21ssh2
30222472121,6sleep12742360-21diskmemload1
30068052120,8sleep02742360-21diskmemload0
29920032121,7sleep02993667-21cut0
29892302121,7sleep22989240-21ssh2
29400382121,7sleep02742360-21diskmemload0
28800382121,7sleep22880052-21ssh2
28650772120,7sleep22865091-21ssh2
28160422121,4sleep10-21swapper/11
28151522121,6sleep02742360-21diskmemload0
27984362121,7sleep22798450-21ssh2
27813372121,7sleep00-21swapper/00
27475672121,5sleep02742360-21diskmemload0
27374262121,6sleep22737679-21df2
27056312121,7sleep02705642-21apt-get0
27012422121,7sleep22701815-21grep2
26745282121,5sleep22674781-21df2
30896892111,2sleep10-21swapper/11
30805642111,4sleep02742360-21diskmemload0
30636672110,1sleep00-21swapper/00
30571492111,2sleep20-21swapper/22
30423852111,4sleep13042409-21apt-get1
29773732114,3sleep1331ktimers/11
29571832110,7sleep12957205-21grep1
29486712111,3sleep20-21swapper/22
29471422110,2sleep00-21swapper/00
29464592111,5sleep12742360-21diskmemload1
29227202111,3sleep00-21swapper/00
29128792111,4sleep22742360-21diskmemload2
29037762112,5sleep12904013-21grep1
29037762112,5sleep12904013-21grep1
28975152112,3sleep22742360-21diskmemload2
28558142110,1sleep20-21swapper/22
28475422114,2sleep1331ktimers/11
28385022110,1sleep10-21swapper/11
28227952110,7sleep22822806-21ssh2
28002752111,4sleep02800307-21ssh0
27998792110,1sleep00-21swapper/00
27805672111,3sleep10-21swapper/11
27426792111,4sleep22742360-21diskmemload2
27111922110,5sleep22711211-21apt-get2
26802882111,6sleep12681052-21cut1
26326122112,4sleep02632613-21apt-get0
26220652111,4sleep02622084-21apt-get0
26191522111,5sleep02619337-21users0
30723002101,4sleep02742360-21diskmemload0
30637532100,1sleep10-21swapper/11
30583612101,6sleep03058514-21ls0
30557632101,3sleep10-21swapper/11
30486732101,2sleep20-21swapper/22
30204702101,4sleep02742360-21diskmemload0
30146782101,3sleep10-21swapper/11
30068292101,3sleep23006849-21apt-get2
30033582101,3sleep10-21swapper/11
30032532101,4sleep02742360-21diskmemload0
29949462101,3sleep12742360-21diskmemload1
29901272100,1sleep20-21swapper/22
29813472100,6sleep02981357-21ssh0
29648142101,4sleep22742360-21diskmemload2
29558902101,2sleep00-21swapper/00
29483632101,5sleep22742360-21diskmemload2
29248502101,5sleep02924872-21kthreadcore0
29208632101,4sleep12742360-21diskmemload1
29149672101,3sleep00-21swapper/00
29012282101,4sleep02902881-21grep0
29012282101,4sleep02902881-21grep0
28961622101,3sleep02742360-21diskmemload0
28949482101,3sleep10-21swapper/11
28826432101,3sleep20-21swapper/22
28811282101,3sleep02742360-21diskmemload0
28794672101,2sleep10-21swapper/11
28735262101,3sleep20-21swapper/22
28733242101,4sleep02742360-21diskmemload0
28487672101,3sleep00-21swapper/00
28329652100,1sleep20-21swapper/22
28223142101,4sleep12742360-21diskmemload1
28219712100,1sleep00-21swapper/00
28061952101,3sleep20-21swapper/22
28057152101,3sleep10-21swapper/11
27901932100,1sleep20-21swapper/22
27816452101,2sleep20-21swapper/22
27748952101,2sleep20-21swapper/22
27728412100,1sleep10-21swapper/11
27657672101,3sleep22742360-21diskmemload2
27564542100,1sleep20-21swapper/22
27426682100,1sleep10-21swapper/11
26954712101,3sleep22695474-21apt-get2
26375532101,5sleep22637582-21munin-run2
26314102101,6sleep02631501-21proc_pri0
26276482101,4sleep22627857-21hddtemp_smartct2
26220892101,5sleep22622350-21/usr/sbin/munin2
26158322102,4sleep22617489-21grep2
3065158291,2sleep20-21swapper/22
3030696291,4sleep03023392-40find0
2929244291,2sleep10-21swapper/11
2888933291,3sleep12742360-21diskmemload1
2756790291,2sleep10-21swapper/11
2735158290,1sleep00-21swapper/00
2730958291,4sleep02726893-21/usr/sbin/munin0
2728534291,3sleep12730262-21cut1
2717488291,4sleep22719118-21cut2
2716441291,3sleep12716444-21apt-get1
2711180290,4sleep10-21swapper/11
2695781290,1sleep10-21swapper/11
2664030291,3sleep12664049-21apt-get1
2663414290,1sleep10-21swapper/11
2652534291,4sleep22652744-21cat2
2648901291,4sleep02650164-21tr0
2645189291,4sleep22646890-21grep2
2727182281,4sleep22727369-21head2
2705959281,2sleep12706215-21/usr/sbin/munin1
2684970280,3sleep02684972-21apt-get0
2675033281,3sleep12675332-21tr1
2660487281,3sleep20-21swapper/22
2653843283,2sleep0221rcuc/00
2643050281,2sleep00-21swapper/00
2638399280,4sleep2431ktimers/22
2637546281,4sleep10-21swapper/11
2627452281,3sleep12627647-21diskstats1
2614744280,2sleep10-21swapper/11
2732172270,2sleep10-21swapper/11
2722228271,2sleep00-21swapper/00
2710562270,1sleep20-21swapper/22
2709953271,3sleep02710011-21open_files0
2705276270,1sleep10-21swapper/11
2690201271,2sleep10-21swapper/11
2686160271,3sleep12687823-21kthreadcore1
2685232271,3sleep20-21swapper/22
2681054271,3sleep20-21swapper/22
2679718270,2sleep00-21swapper/00
2679436270,1sleep00-21swapper/00
2674052270,1sleep00-21swapper/00
2673920270,1sleep10-21swapper/11
2669285270,2sleep22669304-21apt-get2
2658795270,2sleep00-21swapper/00
2653912271,2sleep10-21swapper/11
2653578270,2sleep20-21swapper/22
2650165271,2sleep10-21swapper/11
2647757270,4sleep10-21swapper/11
2642779271,2sleep10-21swapper/11
2642058270,4sleep02642271-21unixbench-2d0
2626912270,1sleep10-21swapper/11
2736791260,1sleep20-21swapper/22
2726255260,1sleep20-21swapper/22
2723270260,2sleep12715939-21kworker/1:1-events1
2721047260,1sleep00-21swapper/00
2712434261,2sleep00-21swapper/00
2699639260,1sleep00-21swapper/00
2664052250,1sleep20-21swapper/22
2737403240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional