You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-21 - 06:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Apr 21, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3378448211454,55sleep30-21swapper/33
337788828764,12sleep20-21swapper/22
337846128263,12sleep10-21swapper/11
337878027849,6sleep00-21swapper/00
35752612260,3sleep10-21swapper/11
36573762241,17sleep23509318-21diskmemload2
38098272211,1sleep10-21swapper/11
34775612218,8sleep23477684-21diskstats2
3378938992117,2cyclictest0-21swapper/33
337893899211,3cyclictest0-21swapper/33
337893899211,17cyclictest0-21swapper/33
337893899211,16cyclictest0-21swapper/33
337893899211,16cyclictest0-21swapper/33
337893899211,16cyclictest0-21swapper/33
337893899210,8cyclictest3666014-21chrt3
337893899210,8cyclictest3666014-21chrt3
337893899209,8cyclictest3614635-21taskset3
337893899201,15cyclictest3721837-21turbostat3
337893899200,7cyclictest3788441-21chrt3
3378938991917,1cyclictest0-21swapper/33
3378938991917,1cyclictest0-21swapper/33
3378938991912,4cyclictest3423815-21taskset3
3378938991911,6cyclictest0-21swapper/33
3378938991911,5cyclictest36010202sleep33
337893899191,15cyclictest0-21swapper/33
337893899191,15cyclictest0-21swapper/33
337893899191,14cyclictest0-21swapper/33
337893899191,14cyclictest0-21swapper/33
337893899191,14cyclictest0-21swapper/33
337893899191,14cyclictest0-21swapper/33
337893899191,14cyclictest0-21swapper/33
337893899190,2cyclictest0-21swapper/33
337893899190,16cyclictest66950irq/132-enp1s0-TxRx-33
35973162181,5sleep03597341-21apt-get0
3378938991815,1cyclictest0-21swapper/33
3378938991811,5cyclictest0-21swapper/33
337893899181,14cyclictest0-21swapper/33
337893899181,14cyclictest0-21swapper/33
337893899181,14cyclictest0-21swapper/33
337893899181,14cyclictest0-21swapper/33
337893899181,14cyclictest0-21swapper/33
337893899181,14cyclictest0-21swapper/33
337893899181,14cyclictest0-21swapper/33
337893899181,13cyclictest0-21swapper/33
337893899181,13cyclictest0-21swapper/33
337893899181,13cyclictest0-21swapper/33
337893899181,13cyclictest0-21swapper/33
3378938991810,5cyclictest3498083-21taskset3
337893899180,2cyclictest0-21swapper/33
37019332171,10sleep20-21swapper/22
35622942171,4sleep13562322-21apt1
35030292175,8sleep23503091-21cat2
34973852171,4sleep23497435-21ntpq2
337893899172,9cyclictest3704275-21taskset3
337893899172,10cyclictest3509580-21taskset3
337893899171,14cyclictest36420552sleep33
337893899171,13cyclictest0-21swapper/33
337893899171,13cyclictest0-21swapper/33
337893899171,13cyclictest0-21swapper/33
337893899170,14cyclictest0-21swapper/33
337893899170,14cyclictest0-21swapper/33
337893899170,14cyclictest0-21swapper/33
337893899170,13cyclictest0-21swapper/33
337893899170,13cyclictest0-21swapper/33
38292632160,9sleep23828738-21apt-get2
36847112161,3sleep03509318-21diskmemload0
36150802161,3sleep20-21swapper/22
35942642161,7sleep13594278-21ssh1
35881162162,8sleep23588150-21munin-run2
35589402161,2sleep20-21swapper/22
35439322161,4sleep13543944-21rm1
35335862160,13sleep03533598-21rm0
35278632161,3sleep23529465-21kthreadcore2
337893899161,13cyclictest0-21swapper/33
337893899161,12cyclictest0-21swapper/33
337893899160,13cyclictest0-21swapper/33
337893899160,13cyclictest0-21swapper/33
337893899160,13cyclictest0-21swapper/33
38364452151,3sleep10-21swapper/11
37723492150,2sleep00-21swapper/00
37534392151,10sleep13753665-21grep1
37455222150,1sleep20-21swapper/22
37285812151,8sleep10-21swapper/11
37203022151,3sleep03509318-21diskmemload0
37100242151,4sleep13509318-21diskmemload1
36776752152,7sleep13677938-21df1
36570842152,3sleep03657099-21ssh0
35686712151,3sleep03509318-21diskmemload0
34450882150,1sleep20-21swapper/22
33968622151,4sleep03396935-21munin-run0
3378938991512,2cyclictest66950irq/132-enp1s0-TxRx-33
337893899150,13cyclictest0-21swapper/33
337893899150,13cyclictest0-21swapper/33
337893899150,13cyclictest0-21swapper/33
337893899150,12cyclictest0-21swapper/33
337893899150,12cyclictest0-21swapper/33
337893899150,12cyclictest0-21swapper/33
337893899150,12cyclictest0-21swapper/33
38780012141,8sleep03509318-21diskmemload0
38641222140,2sleep20-21swapper/22
38243002141,2sleep00-21swapper/00
37976042141,7sleep23797661-21ntpq2
37624332141,4sleep03762689-21users0
37624332141,4sleep03762689-21users0
37583182141,9sleep13758465-21cut1
37583182141,9sleep13758465-21cut1
37390592141,8sleep03509318-21diskmemload0
36234132140,3sleep13509318-21diskmemload1
35934492141,9sleep03593460-21ssh0
35424452140,2sleep00-21swapper/00
34720462141,3sleep23472065-21apt-get2
33958982141,5sleep23395950-21/usr/sbin/munin2
337893899140,2cyclictest0-21swapper/33
337893899140,2cyclictest0-21swapper/33
337893899140,12cyclictest0-21swapper/33
337893899140,11cyclictest0-21swapper/33
38532612131,8sleep13853275-21ssh1
38430622131,8sleep13843181-21ssh1
37042622131,8sleep23509318-21diskmemload2
36923152131,7sleep13509318-21diskmemload1
35177502131,7sleep10-21swapper/11
34707422131,4sleep13470790-21ntpq1
34388602131,6sleep23438909-21ntpq2
34078102131,7sleep23407832-21munin-run2
33870012131,7sleep13387772-21cut1
38788752121,6sleep23509318-21diskmemload2
38703412121,4sleep00-21swapper/00
38602842121,5sleep13860336-21ntpq1
38517882121,7sleep03851864-21cat0
38446842121,5sleep00-21swapper/00
38358972121,6sleep03509318-21diskmemload0
37926972121,7sleep23792712-21ssh2
37732732121,7sleep23773287-21ssh2
37543812121,7sleep03509318-21diskmemload0
37194702121,6sleep13509318-21diskmemload1
37138902121,7sleep23714559-21cut2
36489362121,5sleep20-21swapper/22
36380272120,2sleep23509318-21diskmemload2
36292972121,6sleep23509318-21diskmemload2
36232982121,7sleep03509318-21diskmemload0
36139912121,7sleep23614004-21ssh2
36133982121,6sleep13509318-21diskmemload1
35973462120,8sleep13597551-21expr1
35954542121,4sleep23595466-21ssh2
35867242121,5sleep00-21swapper/00
35713502121,7sleep23571501-21expr2
35489312121,7sleep03548992-21ntpq0
34814482121,5sleep13481497-21ntpq1
34347682121,5sleep13434787-21apt-get1
34297282121,7sleep03429919-21sed0
38702022110,2sleep13870216-21ssh1
38438642110,5sleep20-21swapper/22
37989932111,7sleep13799007-21ssh1
37833612111,3sleep00-21swapper/00
37469862110,2sleep10-21swapper/11
37400352111,5sleep03740304-21df_inode0
37296862111,3sleep20-21swapper/22
36953532111,6sleep13695364-21ssh1
36766242110,4sleep20-21swapper/22
36747222111,6sleep13674734-21ssh1
36743382111,5sleep03509318-21diskmemload0
36472432112,3sleep13378932-21cyclictest1
36103692111,5sleep03610429-21ntpq0
35683412111,6sleep23568354-21ssh2
35588152111,3sleep10-21swapper/11
35168432113,3sleep23509318-21diskmemload2
35083612111,5sleep23508409-21ntpq2
34778992111,6sleep03477397-21/usr/sbin/munin0
34670352111,5sleep03467244-21hddtemp_smartct0
34299232111,5sleep13430007-21irqstats1
34021622110,1sleep20-21swapper/22
38818212100,1sleep10-21swapper/11
38640462101,3sleep00-21swapper/00
38539042101,4sleep23509318-21diskmemload2
38253022101,3sleep10-21swapper/11
38179912101,4sleep03509318-21diskmemload0
38112492101,4sleep23811273-21apt-get2
38097132101,3sleep03509318-21diskmemload0
38089492101,3sleep20-21swapper/22
38014262101,4sleep03509318-21diskmemload0
37838712101,3sleep20-21swapper/22
37819112101,3sleep10-21swapper/11
37725222101,3sleep10-21swapper/11
37659302101,3sleep20-21swapper/22
37659302101,3sleep20-21swapper/22
37532242101,3sleep20-21swapper/22
37284542101,4sleep03509318-21diskmemload0
37105382101,4sleep03509318-21diskmemload0
36931392101,3sleep03509318-21diskmemload0
36907582101,5sleep23690818-21ntpq2
36653632101,2sleep00-21swapper/00
36653632101,2sleep00-21swapper/00
36645662101,5sleep23664825-21/usr/sbin/munin2
36645662101,5sleep23664825-21/usr/sbin/munin2
36602272101,2sleep10-21swapper/11
36602272101,2sleep10-21swapper/11
36510322101,5sleep13651063-21apt1
36405442101,4sleep03509318-21diskmemload0
36405002101,3sleep10-21swapper/11
36323192100,2sleep03632334-21ssh0
36306982101,4sleep13509318-21diskmemload1
36052142101,3sleep20-21swapper/22
35852092101,3sleep10-21swapper/11
35538212101,6sleep03554039-21hddtemp_smartct0
35517682101,2sleep10-21swapper/11
35316142100,2sleep10-21swapper/11
35253612101,2sleep20-21swapper/22
35237662101,4sleep13509318-21diskmemload1
35042402100,1sleep00-21swapper/00
34841662101,5sleep13485949-21kthreadcore1
34601402101,4sleep23460194-21ntpq2
34396012101,3sleep072-21kcompactd00
34281732100,4sleep13428222-21ntpq1
34231692101,5sleep03423178-21/usr/sbin/munin0
34173572101,4sleep13417498-21ntpq1
3870631291,3sleep20-21swapper/22
3820305291,3sleep23820520-21ssh2
3815262291,4sleep13815416-21grep1
3792480291,4sleep13792495-21ssh1
3792045291,3sleep03509318-21diskmemload0
3739171291,4sleep13739186-21ssh1
3737174291,2sleep20-21swapper/22
3700433290,3sleep03509318-21diskmemload0
3681900290,3sleep20-21swapper/22
3650126291,2sleep00-21swapper/00
3578781291,2sleep00-21swapper/00
3552042291,2sleep20-21swapper/22
3540248290,4sleep23540314-21ntpq2
3519052291,4sleep03520083-21cut0
3514652290,1sleep00-21swapper/00
3488756291,4sleep23490432-21tr2
3483265291,4sleep03484164-21cut0
3482983291,3sleep23483107-21perl2
3461151291,4sleep13461168-21munin-run1
3444158291,4sleep13444207-21ntpq1
3440546290,1sleep00-21swapper/00
3418163290,3sleep20-21swapper/22
3497266281,3sleep13497379-21ntpq1
3488542281,3sleep10-21swapper/11
3471427280,1sleep20-21swapper/22
3463045281,3sleep13463507-21kthreadcore1
3461982281,4sleep03463044-21cut0
3430008281,3sleep23431171-21kthreadcore2
3407702280,3sleep00-21swapper/00
3396997281,3sleep13396872-21apt-get1
3392370281,3sleep13393613-21kthreadcore1
3504821270,3sleep13506310-21cut1
3455749270,1sleep10-21swapper/11
3455108271,3sleep03455272-21timerwakeupswit0
3446673271,2sleep00-21swapper/00
3445702271,3sleep10-21swapper/11
3445415270,1sleep20-21swapper/22
3423744270,4sleep10-21swapper/11
3422747270,2sleep20-21swapper/22
3408358271,3sleep00-21swapper/00
3397402270,2sleep00-21swapper/00
3391158270,1sleep20-21swapper/22
3383952270,1sleep20-21swapper/22
3380512270,3sleep0221rcuc/00
3499523261,2sleep10-21swapper/11
3492991260,1sleep00-21swapper/00
3476940260,1sleep00-21swapper/00
3476784260,4sleep10-21swapper/11
3464846261,2sleep20-21swapper/22
3461030260,1sleep00-21swapper/00
3455804260,2sleep20-21swapper/22
3428053260,3sleep03428172-21kworker/u16:00
3425543261,2sleep20-21swapper/22
3418219260,4sleep00-21swapper/00
3413012260,1sleep20-21swapper/22
3412040260,1sleep10-21swapper/11
3496345250,1sleep00-21swapper/00
3407289250,1sleep10-21swapper/11
3384360250,2sleep00-21swapper/00
3382256250,2sleep10-21swapper/11
3498941240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional