You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 20:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Tue Apr 07, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2676954212461,59sleep30-21swapper/33
267700128857,12sleep20-21swapper/22
267705428365,12sleep10-21swapper/11
267699427557,13sleep00-21swapper/00
27340162260,4sleep20-21swapper/22
2677205992421,1cyclictest0-21swapper/33
267720599237,13cyclictest0-21swapper/33
267720599229,10cyclictest2948511-21turbostat3
267720599211,2cyclictest0-21swapper/33
267720599211,17cyclictest3015756-21taskset3
267720599211,17cyclictest2944404-21chrt3
267720599211,14cyclictest0-21swapper/33
267720599210,2cyclictest0-21swapper/33
267720599210,17cyclictest2902424-21chrt3
267720599210,17cyclictest2759447-21chrt3
31637732201,7sleep03163832-21ntpq0
2677205992014,4cyclictest66950irq/132-enp1s0-TxRx-33
267720599201,15cyclictest0-21swapper/33
267720599201,15cyclictest0-21swapper/33
267720599201,13cyclictest0-21swapper/33
2677205992010,7cyclictest3086738-21chrt3
29652242191,2sleep20-21swapper/22
2677205991916,1cyclictest0-21swapper/33
2677205991915,2cyclictest0-21swapper/33
2677205991915,2cyclictest0-21swapper/33
267720599191,15cyclictest0-21swapper/33
267720599191,14cyclictest0-21swapper/33
267720599191,14cyclictest0-21swapper/33
267720599191,14cyclictest0-21swapper/33
267720599191,14cyclictest0-21swapper/33
31329172181,5sleep03133029-21ls0
29101692181,4sleep10-21swapper/11
28323062181,3sleep20-21swapper/22
267720599184,12cyclictest0-21swapper/33
2677205991815,1cyclictest0-21swapper/33
2677205991814,2cyclictest0-21swapper/33
2677205991811,4cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,14cyclictest0-21swapper/33
267720599181,13cyclictest2786175-21turbostat3
267720599181,13cyclictest2775393-21taskset3
267720599181,13cyclictest0-21swapper/33
267720599181,13cyclictest0-21swapper/33
267720599180,15cyclictest0-21swapper/33
267720599180,15cyclictest0-21swapper/33
31750912172,10sleep02807492-21diskmemload0
31750912172,10sleep02807492-21diskmemload0
31722872170,2sleep10-21swapper/11
31722872170,2sleep10-21swapper/11
30778642171,2sleep00-21swapper/00
29551182171,2sleep00-21swapper/00
267720599176,8cyclictest2764891-21turbostat3
267720599172,10cyclictest2878721-21taskset3
2677205991715,1cyclictest0-21swapper/33
2677205991715,1cyclictest0-21swapper/33
2677205991712,4cyclictest0-21swapper/33
267720599171,13cyclictest0-21swapper/33
267720599170,14cyclictest0-21swapper/33
267720599170,14cyclictest0-21swapper/33
267720599170,13cyclictest0-21swapper/33
31306002161,2sleep20-21swapper/22
29619342161,4sleep02807492-21diskmemload0
27798662161,4sleep12779920-21ntpq1
26853022168,4sleep22686379-21cut2
267720599162,9cyclictest0-21swapper/33
2677205991612,2cyclictest0-21swapper/33
267720599161,12cyclictest0-21swapper/33
267720599161,11cyclictest0-21swapper/33
267720599160,13cyclictest0-21swapper/33
267720599160,13cyclictest0-21swapper/33
31563202150,1sleep10-21swapper/11
31516392151,5sleep23153225-21cut2
30524592150,1sleep00-21swapper/00
30254422151,3sleep20-21swapper/22
29962572151,9sleep02996715-21needreboot0
29540262150,1sleep20-21swapper/22
29530182151,8sleep12953077-21ntpq1
29467752150,3sleep00-21swapper/00
28142752151,3sleep20-21swapper/22
26779202150,3sleep20-21swapper/22
267720599150,13cyclictest0-21swapper/33
267720599150,13cyclictest0-21swapper/33
267720599150,12cyclictest0-21swapper/33
267720599150,12cyclictest0-21swapper/33
267720599150,12cyclictest0-21swapper/33
31755032140,2sleep20-21swapper/22
31755032140,2sleep20-21swapper/22
30904662141,9sleep13092083-21ssh1
30527362141,4sleep23052748-21ssh2
30094032144,6sleep23009416-21sh2
29793072141,8sleep02979358-21ntpq0
29793072141,8sleep02979358-21ntpq0
29706692141,9sleep12966378-21/usr/sbin/munin1
29289212141,3sleep02807492-21diskmemload0
29034052141,7sleep10-21swapper/11
28566952141,9sleep12856982-21sed1
28493472141,9sleep12807492-21diskmemload1
27441492141,9sleep12744317-21gltestperf1
2677205991412,1cyclictest0-21swapper/33
2677205991412,1cyclictest0-21swapper/33
2677205991411,2cyclictest0-21swapper/33
2677205991411,1cyclictest0-21swapper/33
2677205991411,1cyclictest0-21swapper/33
267720599140,12cyclictest0-21swapper/33
31502332130,2sleep00-21swapper/00
31400012131,3sleep03140011-21ssh0
29978412131,3sleep12997852-21ssh1
29899052131,8sleep22989919-21ssh2
29391452131,1sleep00-21swapper/00
28063752131,6sleep12806464-21ntpq1
267720599130,11cyclictest0-21swapper/33
31554452121,7sleep03150809-21/usr/sbin/munin0
31475242121,7sleep23147535-21ssh2
31227372121,5sleep00-21swapper/00
31161162121,7sleep13117533-21ssh1
30777812121,5sleep12807492-21diskmemload1
30686232121,7sleep13068635-21sh1
30544162121,7sleep03054969-21cut0
30428102123,3sleep22677196-21cyclictest2
30265962121,5sleep12807492-21diskmemload1
29834722121,7sleep22983597-21cat2
29834722121,7sleep22983597-21cat2
29736082120,2sleep02807492-21diskmemload0
29629552121,3sleep12962966-21ssh1
29300002121,7sleep22930010-21ssh2
29217652121,6sleep02807492-21diskmemload0
29132202121,7sleep22913231-21ssh2
29105582121,3sleep02910572-21ssh0
28602862121,5sleep20-21swapper/22
28570162121,7sleep02857027-21ssh0
28508942120,2sleep20-21swapper/22
28475782121,6sleep02847635-21/usr/sbin/munin0
28206772121,6sleep12820772-21ntpq1
27585292121,6sleep22758570-21ntpq2
27547672121,7sleep02754868-21grep0
27112912120,7sleep12711234-31find1
27013352121,8sleep12701375-21cut1
26850202121,7sleep02685158-21grep0
31106422111,5sleep23110689-21ntpq2
30973542111,6sleep03097535-21latency_hist0
30967382111,6sleep23096749-21ssh2
30801072111,4sleep23080128-21apt-get2
30787982111,4sleep20-21swapper/22
30667142111,5sleep23066766-21ntpq2
30325612111,4sleep00-21swapper/00
30291822111,6sleep23030879-21cut2
29824412114,3sleep12807492-21diskmemload1
29824412114,3sleep12807492-21diskmemload1
29383532111,5sleep12807492-21diskmemload1
28929922111,5sleep02807492-21diskmemload0
28876382111,5sleep22887775-21diskstats2
28742252111,5sleep22874285-21ntp_states2
28741652110,7sleep12874222-21ntpq1
28664082110,1sleep10-21swapper/11
28227452111,3sleep20-21swapper/22
28169112111,6sleep02817087-21gltestperf0
28155792111,5sleep12807492-21diskmemload1
28120842114,4sleep0151ktimers/00
27494432111,5sleep12749656-21hddtemp_smartct1
27332082110,5sleep10-21swapper/11
27270292111,5sleep12727246-21users1
27174012111,5sleep22717537-21diskstats2
27172712111,6sleep12717397-21cpuspeed_turbos1
27159652111,4sleep12716013-21ntpq1
27113152110,2chrt90-21kswapd02
26957372111,5sleep12695998-21df_inode1
31647962100,3sleep10-21swapper/11
31599512101,2sleep20-21swapper/22
31397112101,3sleep20-21swapper/22
31317492101,4sleep12807492-21diskmemload1
31197542101,3sleep20-21swapper/22
31111552101,4sleep13111384-21users1
31037162101,2sleep10-21swapper/11
31033022101,4sleep02807492-21diskmemload0
30876072101,2sleep10-21swapper/11
30680502101,3sleep00-21swapper/00
30603662100,1sleep20-21swapper/22
30537252101,5sleep13053739-21ssh1
30417812101,3sleep10-21swapper/11
30413702101,2sleep00-21swapper/00
30345882101,5sleep12807492-21diskmemload1
30181142101,4sleep12807492-21diskmemload1
30100462101,4sleep23010070-21apt-get2
30074482100,2sleep00-21swapper/00
30064942101,4sleep12807492-21diskmemload1
30006192101,4sleep22807492-21diskmemload2
29900982101,4sleep12807492-21diskmemload1
29450172100,7sleep22945028-21sh2
29384082101,4sleep22807492-21diskmemload2
29278742101,4sleep12807492-21diskmemload1
29209652100,1sleep20-21swapper/22
29179972101,4sleep12807492-21diskmemload1
29037472101,2sleep00-21swapper/00
28933132101,4sleep12807492-21diskmemload1
28860882101,4sleep12807492-21diskmemload1
28857972101,2sleep20-21swapper/22
28751642100,3sleep00-21swapper/00
28608412101,3sleep00-21swapper/00
28422422101,3sleep00-21swapper/00
28403292101,3sleep22807492-21diskmemload2
28342502101,4sleep12834510-21df_inode1
28338212101,6sleep12833945-21latency_hist1
28319822100,6sleep02807492-21diskmemload0
27851942101,4sleep22785248-21ntpq2
27789582101,5sleep22779717-21sed2
27704662101,4sleep22770485-21apt-get2
27599862100,1sleep10-21swapper/11
27544852101,5sleep12754495-21find1
27313222101,5sleep22731849-21cut2
27279042101,5sleep12728161-21df_inode1
3147100290,3sleep12807492-21diskmemload1
3140770291,3sleep12807492-21diskmemload1
3112073291,2sleep00-21swapper/00
3104486290,1sleep20-21swapper/22
3085435291,2sleep00-21swapper/00
3050296291,3sleep12807492-21diskmemload1
3019391291,4sleep03019906-21cut0
3015822291,3sleep02807492-21diskmemload0
2989072291,3sleep00-21swapper/00
2971550290,2sleep20-21swapper/22
2946337290,4sleep12807492-21diskmemload1
2901538290,1sleep20-21swapper/22
2807375291,4sleep22807377-21sshd2
2806817291,5sleep02807082-21unixbench_singl0
2797645291,4sleep12799011-21cut1
2786724290,1sleep20-21swapper/22
2786447291,4sleep02786699-21df0
2770012290,1sleep10-21swapper/11
2743932291,4sleep02744148-21diskstats0
2711195291,4sleep02711245-40gst-plugin-scan0
2705152290,4sleep02705201-21ntpq0
2699907290,6sleep22700020-21ps2
2881186281,3sleep02882721-21ssh0
2860812280,2sleep20-21swapper/22
2792046281,3sleep02792256-21/usr/sbin/munin0
2765160280,5sleep22765259-21cut2
2749153280,3sleep22749172-21apt-get2
2742629281,3sleep22742677-21ntpq2
2738536280,2sleep10-21swapper/11
2727619281,3sleep22727649-21perf2
2694484280,1sleep20-21swapper/22
2677751280,1sleep10-21swapper/11
2792359271,2sleep20-21swapper/22
2791748270,2sleep10-21swapper/11
2791203270,2sleep10-21swapper/11
2786083270,1sleep00-21swapper/00
2781104270,4sleep10-21swapper/11
2775793270,2sleep00-21swapper/00
2775150270,1sleep10-21swapper/11
2731919271,2sleep00-21swapper/00
2717249270,2sleep00-21swapper/00
2712894271,2sleep20-21swapper/22
2706065270,1sleep20-21swapper/22
2696283271,2sleep00-21swapper/00
2694894270,1sleep10-21swapper/11
2690111270,2sleep00-21swapper/00
2799012261,2sleep20-21swapper/22
2797073260,1sleep00-21swapper/00
2760412261,2sleep00-21swapper/00
2743860260,2sleep20-21swapper/22
2738047260,4sleep00-21swapper/00
2716989260,3sleep00-21swapper/00
2689590260,1sleep10-21swapper/11
2682372260,1sleep00-21swapper/00
2774820250,1sleep00-21swapper/00
2770079251,3sleep00-21swapper/00
2760101250,1sleep20-21swapper/22
2749321250,1sleep00-21swapper/00
2726694250,2sleep00-21swapper/00
2738885240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional