You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 19:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat May 09, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3087325213372,57sleep30-21swapper/33
308722928556,11sleep10-21swapper/11
308728428353,11sleep20-21swapper/22
308724327556,14sleep00-21swapper/00
308757899231,16cyclictest33285442sleep33
308757899211,16cyclictest3387250-21taskset3
3087578992011,7cyclictest3159098-21chrt3
308757899201,16cyclictest0-21swapper/33
308757899201,16cyclictest0-21swapper/33
308757899201,15cyclictest66950irq/132-enp1s0-TxRx-33
308757899201,15cyclictest0-21swapper/33
308757899201,15cyclictest0-21swapper/33
308757899192,12cyclictest3342032-21taskset3
3087578991914,3cyclictest0-21swapper/33
308757899191,15cyclictest0-21swapper/33
308757899191,14cyclictest66950irq/132-enp1s0-TxRx-33
308757899191,14cyclictest0-21swapper/33
308757899191,14cyclictest0-21swapper/33
308757899191,14cyclictest0-21swapper/33
308757899191,14cyclictest0-21swapper/33
308757899191,14cyclictest0-21swapper/33
308757899191,14cyclictest0-21swapper/33
308757899191,14cyclictest0-21swapper/33
308757899191,11cyclictest0-21swapper/33
3087578991910,6cyclictest3186165-21turbostat3
3087578991910,6cyclictest0-21swapper/33
308757899190,16cyclictest66950irq/132-enp1s0-TxRx-33
308757899190,16cyclictest0-21swapper/33
308757899190,15cyclictest3311868-21taskset3
308757899186,1cyclictest0-21swapper/33
308757899182,12cyclictest3218643-21chrt3
308757899181,7cyclictest3358875-21chrt3
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899181,14cyclictest0-21swapper/33
308757899180,15cyclictest0-21swapper/33
34698192170,4sleep10-21swapper/11
33681662171,5sleep03368176-21ssh0
32771832171,3sleep10-21swapper/11
32515022171,3sleep10-21swapper/11
308757899179,5cyclictest3175489-21turbostat3
308757899179,5cyclictest3121695-21turbostat3
308757899176,8cyclictest3186165-21turbostat3
308757899174,10cyclictest0-21swapper/33
308757899171,3cyclictest3142133-21taskset3
308757899171,14cyclictest0-21swapper/33
308757899171,13cyclictest0-21swapper/33
308757899171,13cyclictest0-21swapper/33
308757899171,13cyclictest0-21swapper/33
308757899171,13cyclictest0-21swapper/33
308757899170,14cyclictest0-21swapper/33
308757899170,14cyclictest0-21swapper/33
308757899170,13cyclictest0-21swapper/33
308757899170,13cyclictest0-21swapper/33
35588642161,10sleep03560574-21tr0
35388642160,2sleep00-21swapper/00
35370052161,10sleep13218239-21diskmemload1
35289532161,2sleep10-21swapper/11
33006642161,1sleep20-21swapper/22
33006642161,1sleep20-21swapper/22
31205282163,8sleep03120566-21ntpq0
31112042161,10sleep03111407-21diskstats0
3087578991614,1cyclictest0-21swapper/33
3087578991611,3cyclictest0-21swapper/33
308757899161,11cyclictest0-21swapper/33
308757899160,13cyclictest0-21swapper/33
308757899160,13cyclictest0-21swapper/33
308757899160,13cyclictest0-21swapper/33
35441922154,6sleep13544256-21rm1
34794322151,4sleep13218239-21diskmemload1
34357422150,1sleep00-21swapper/00
34252552151,9sleep03426319-21memory0
34032452154,5sleep1331ktimers/11
33254422151,3sleep10-21swapper/11
33202132151,2sleep00-21swapper/00
32511282151,4sleep23218239-21diskmemload2
32492312151,2sleep00-21swapper/00
32418752151,2sleep20-21swapper/22
31656002157,4sleep03166429-21cut0
308757899154,8cyclictest3148448-21turbostat3
308757899151,4cyclictest0-21swapper/33
3087578991512,1cyclictest0-21swapper/33
308757899151,11cyclictest0-21swapper/33
308757899150,12cyclictest0-21swapper/33
35199202141,2sleep00-21swapper/00
34867282140,2sleep20-21swapper/22
33671462141,4sleep23367272-21sed2
33343532142,7sleep03218239-21diskmemload0
33172352142,2sleep2171rcu_preempt2
32850512141,2sleep00-21swapper/00
32569772141,7sleep13257075-21ntpq1
32323912141,4sleep03232405-21ssh0
31231292141,9sleep13124855-21tr1
308757899148,3cyclictest32073002sleep33
308757899148,3cyclictest31052682sleep33
308757899141,9cyclictest3132699-21chrt3
308757899140,12cyclictest0-21swapper/33
35713362131,5sleep20-21swapper/22
35713362131,5sleep20-21swapper/22
35689872131,6sleep03569285-21strings0
35689872131,6sleep03569285-21strings0
34971992130,3sleep03497210-21ssh0
34873642131,2sleep10-21swapper/11
34785322131,8sleep23478540-21ssh2
34369292131,5sleep10-21swapper/11
34346562131,7sleep23434808-21/usr/sbin/munin2
33616242131,8sleep03361638-21ssh0
33601062131,4sleep1171rcu_preempt1
33452752131,8sleep23345289-21ssh2
33179322131,6sleep13218239-21diskmemload1
32910732130,2sleep03291184-21strings0
32840712131,8sleep13284081-21ssh1
32534842131,7sleep23254682-21grep2
32336482131,7sleep23218239-21diskmemload2
32186092131,6sleep23218239-21diskmemload2
35174422121,7sleep23218239-21diskmemload2
35042562121,7sleep13504266-21ssh1
34733292121,7sleep03218239-21diskmemload0
34515062121,5sleep03451628-21ntpq0
34454472120,5sleep014-21ksoftirqd/00
34209292121,3sleep03420940-21ssh0
33941022121,6sleep03218239-21diskmemload0
33773602121,6sleep03218239-21diskmemload0
33715782122,4sleep13371604-21apt-get1
32613102121,5sleep13261342-21ssh1
31709442121,7sleep03171394-21cut0
31540422122,5sleep23154060-21apt-get2
31380182121,7sleep23137997-21/usr/sbin/munin2
31001772120,1sleep10-21swapper/11
308757899129,1cyclictest0-21swapper/33
35526542111,5sleep03552706-21ntpq0
35477912111,5sleep03218239-21diskmemload0
35451142111,3sleep20-21swapper/22
35292492111,4sleep23218239-21diskmemload2
35125942111,4sleep03218239-21diskmemload0
35066052111,5sleep23506833-21df_inode2
35031872111,4sleep03218239-21diskmemload0
34685542111,5sleep23468612-21ntpq2
34544362111,3sleep20-21swapper/22
34537542111,6sleep13453771-21ssh1
34441742111,3sleep20-21swapper/22
34140282111,6sleep13414191-21cstates1
34114112110,5sleep20-21swapper/22
34058762111,7sleep03406101-21basename0
33849692111,4sleep23218239-21diskmemload2
33705532111,6sleep13370567-21ssh1
33617432111,3sleep20-21swapper/22
33433822111,4sleep03218239-21diskmemload0
33359102111,5sleep10-21swapper/11
33281072111,3sleep00-21swapper/00
33259432111,5sleep23218239-21diskmemload2
33089572111,3sleep10-21swapper/11
33038302111,5sleep23304095-21df2
32912592111,5sleep23291312-21ntpq2
32778542111,3sleep20-21swapper/22
32428652111,5sleep13218239-21diskmemload1
31594052111,5sleep13159423-21apt-get1
31213622110,1sleep20-21swapper/22
30991852111,5sleep13099238-21ntpq1
35719952101,3sleep13218239-21diskmemload1
35719952101,3sleep13218239-21diskmemload1
35621532101,3sleep10-21swapper/11
35618742101,4sleep23218239-21diskmemload2
35546602101,3sleep10-21swapper/11
35287562100,2sleep00-21swapper/00
35227222100,2sleep10-21swapper/11
35071282101,5sleep13507183-21kthreadcore1
34980822101,3sleep20-21swapper/22
34948332101,3sleep10-21swapper/11
34690052101,4sleep03218239-21diskmemload0
34609092101,4sleep03218239-21diskmemload0
34432342101,5sleep13443284-21ntpq1
34300622101,3sleep10-21swapper/11
34264722100,2sleep20-21swapper/22
34104472100,3sleep10-21swapper/11
34042842101,3sleep20-21swapper/22
33955492101,2sleep20-21swapper/22
33936432101,3sleep10-21swapper/11
33842172101,4sleep13384271-21ntpq1
33806132101,5sleep03381412-21kthreadcore0
33793582101,4sleep23218239-21diskmemload2
33535502101,5sleep03218239-21diskmemload0
33517782101,5sleep20-21swapper/22
33462792101,4sleep13218239-21diskmemload1
33418542102,4sleep13218239-21diskmemload1
33369442100,7sleep23336955-21ssh2
33107642101,4sleep03218239-21diskmemload0
33016012100,1sleep10-21swapper/11
33016012100,1sleep10-21swapper/11
32957842101,4sleep03296000-21hddtemp_smartct0
32957842101,4sleep03296000-21hddtemp_smartct0
32876542102,4sleep10-21swapper/11
32834852101,4sleep23218239-21diskmemload2
32751572100,1sleep00-21swapper/00
32666122100,1sleep00-21swapper/00
32655012101,3sleep20-21swapper/22
32579642101,6sleep03257966-21ssh0
32405852101,4sleep03218239-21diskmemload0
32238262101,2sleep00-21swapper/00
31905672101,4sleep13190620-21ntp_states1
31831922101,5sleep03184941-21latency0
31692292101,6sleep23169293-21pmu-power2
31635032101,4sleep23163552-21ntpq2
31424622101,4sleep03142706-21users0
31278422101,5sleep23127960-21grep2
31213862101,4sleep13121321-31find1
31111192101,6sleep23111138-21apt2
31098992101,4sleep03109960-21ntpq0
3554711291,3sleep23554722-21ssh2
3531718291,3sleep20-21swapper/22
3489585291,2sleep23218239-21diskmemload2
3481321291,3sleep00-21swapper/00
3461258291,4sleep13461269-21ssh1
3455972291,3sleep20-21swapper/22
3418217290,4sleep23218239-21diskmemload2
3402416291,4sleep03402433-21ssh0
3232207291,3sleep13218239-21diskmemload1
3192062291,5sleep13192278-21idleruntime1
3191762291,3sleep23191781-21apt-get2
3158231291,4sleep03158277-21/usr/sbin/munin0
3095090291,3sleep03095109-21apt-get0
3092829291,4sleep23093134-21irqstats2
3224761281,3sleep13224771-21ssh1
3213145280,3sleep03213164-21apt-get0
3211888280,5sleep13211942-21ntp_kernel_pll_1
3194283281,3sleep03195659-21/usr/sbin/munin0
3180768280,1sleep00-21swapper/00
3176298281,3sleep23177072-21grep2
3171395281,3sleep13173103-21kthreadcore1
3170024280,1sleep10-21swapper/11
3145340281,4sleep10-21swapper/11
3136866281,4sleep13136992-21readlink1
3104560281,3sleep03104618-21ntpq0
3088471281,3sleep23090146-21grep2
3212655270,1sleep20-21swapper/22
3207838270,2sleep00-21swapper/00
3197687271,3sleep20-21swapper/22
3197083270,2sleep10-21swapper/11
3191347270,1sleep20-21swapper/22
3181585271,3sleep23181669-21kernelversion2
3179688271,2sleep10-21swapper/11
3170386270,1sleep20-21swapper/22
3158849270,1sleep10-21swapper/11
3153499270,4sleep00-21swapper/00
3150602271,3sleep20-21swapper/22
3137996270,2sleep10-21swapper/11
3132678270,2sleep20-21swapper/22
3132058270,1sleep00-21swapper/00
3121971270,2sleep00-21swapper/00
3116184270,1sleep10-21swapper/11
3092763270,1sleep00-21swapper/00
3091799271,2sleep10-21swapper/11
3217286260,1sleep20-21swapper/22
3213726260,2sleep10-21swapper/11
3207206260,4sleep20-21swapper/22
3202495261,2sleep00-21swapper/00
3201979260,4sleep00-21swapper/00
3186445260,2sleep03186697-21df0
3186119260,1sleep10-21swapper/11
3149274260,2sleep10-21swapper/11
3148085260,1sleep20-21swapper/22
3143933261,2sleep00-21swapper/00
3137443260,3sleep00-21swapper/00
3131249261,2sleep10-21swapper/11
3126384261,1sleep20-21swapper/22
3110203261,2sleep10-21swapper/11
3109756260,3sleep20-21swapper/22
3105415260,1sleep20-21swapper/22
3163318250,1sleep00-21swapper/00
3202747240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional