You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-01 - 03:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Aug 01, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2581189213257,70sleep30-21swapper/33
257651828454,23sleep00-21swapper/00
257631128362,11sleep20-21swapper/22
258112328159,12sleep10-21swapper/11
258149599256,17cyclictest2693492-21turbostat3
27357282221,9sleep02709218-21diskmemload0
258149599221,17cyclictest0-21swapper/33
258149599211,16cyclictest0-21swapper/33
258149599211,16cyclictest0-21swapper/33
258149599211,16cyclictest0-21swapper/33
258149599211,15cyclictest0-21swapper/33
30272352201,4sleep23027248-21sh2
2581495992012,5cyclictest0-21swapper/33
258149599201,16cyclictest0-21swapper/33
258149599201,15cyclictest0-21swapper/33
258149599201,15cyclictest0-21swapper/33
258149599201,15cyclictest0-21swapper/33
258149599200,17cyclictest0-21swapper/33
258149599191,15cyclictest0-21swapper/33
258149599191,14cyclictest0-21swapper/33
258149599191,14cyclictest0-21swapper/33
258149599190,15cyclictest66950irq/132-enp1s0-TxRx-33
258149599190,15cyclictest2987707-21taskset3
29233072181,7sleep12923320-21ssh1
258149599189,6cyclictest2677760-21turbostat3
2581495991812,4cyclictest0-21swapper/33
258149599181,14cyclictest66950irq/132-enp1s0-TxRx-33
258149599181,14cyclictest0-21swapper/33
258149599181,14cyclictest0-21swapper/33
258149599181,14cyclictest0-21swapper/33
258149599181,14cyclictest0-21swapper/33
258149599181,14cyclictest0-21swapper/33
258149599181,14cyclictest0-21swapper/33
258149599181,14cyclictest0-21swapper/33
258149599181,14cyclictest0-21swapper/33
258149599181,13cyclictest0-21swapper/33
258149599181,13cyclictest0-21swapper/33
258149599180,14cyclictest0-21swapper/33
29259662171,5sleep22709218-21diskmemload2
25941872172,9sleep22593959-21sendmail-msp2
258149599172,12cyclictest0-21swapper/33
258149599171,4cyclictest0-21swapper/33
2581495991713,2cyclictest0-21swapper/33
258149599171,13cyclictest0-21swapper/33
258149599171,13cyclictest0-21swapper/33
258149599171,13cyclictest0-21swapper/33
258149599171,13cyclictest0-21swapper/33
258149599170,14cyclictest2614594-21chrt3
258149599170,14cyclictest0-21swapper/33
258149599170,14cyclictest0-21swapper/33
258149599170,14cyclictest0-21swapper/33
258149599170,14cyclictest0-21swapper/33
258149599170,14cyclictest0-21swapper/33
258149599170,13cyclictest0-21swapper/33
258149599170,13cyclictest0-21swapper/33
258149599170,13cyclictest0-21swapper/33
30128262161,4sleep02709218-21diskmemload0
29936752160,1sleep20-21swapper/22
29496112161,11sleep02949625-21ssh0
28031482161,2sleep10-21swapper/11
27845342161,4sleep12784548-21ssh1
27326712160,1sleep20-21swapper/22
26308702160,2sleep10-21swapper/11
2581495991613,1cyclictest0-21swapper/33
2581495991612,2cyclictest0-21swapper/33
258149599161,12cyclictest0-21swapper/33
258149599161,12cyclictest0-21swapper/33
258149599160,13cyclictest0-21swapper/33
258149599160,13cyclictest0-21swapper/33
258149599160,13cyclictest0-21swapper/33
258149599160,12cyclictest0-21swapper/33
258149599160,12cyclictest0-21swapper/33
30265852152,8sleep02709218-21diskmemload0
30171872151,8sleep02709218-21diskmemload0
30170482151,3sleep22709218-21diskmemload2
29860502151,4sleep12986062-21ssh1
29149762151,2sleep00-21swapper/00
28486922150,3sleep02709218-21diskmemload0
258149599151,2cyclictest0-21swapper/33
2581495991512,1cyclictest0-21swapper/33
2581495991510,3cyclictest0-21swapper/33
2581495991510,3cyclictest0-21swapper/33
258149599150,12cyclictest0-21swapper/33
30118082141,9sleep13004937-40find1
29965382141,8sleep12996752-21diskstats1
29665922140,6sleep10-21swapper/11
28803002141,3sleep02880311-21ssh0
28449182141,3sleep12844930-21sshd-session1
27667692140,10sleep22766782-21ssh2
27608062141,8sleep1106713-21snmpd1
27485632141,6sleep12748632-21ntp_states1
26890922148,2sleep30-21swapper/33
258149599141,8cyclictest2588969-21taskset3
258149599140,2cyclictest0-21swapper/33
30708222131,8sleep12709218-21diskmemload1
30604582131,3sleep03060469-21ssh0
30459522131,8sleep23045964-21sh2
29864792130,3sleep22986493-21ssh2
29707342131,8sleep02970865-21grep0
29608852131,8sleep12960897-21ssh1
29325292131,5sleep10-21swapper/11
29168132131,7sleep22916824-21ssh2
29001962131,5sleep20-21swapper/22
28875962131,7sleep22709218-21diskmemload2
28875962131,7sleep22709218-21diskmemload2
28710682131,8sleep22871078-21ssh2
28626642131,3sleep10-21swapper/11
28473072131,8sleep02847321-21ssh0
28316602131,5sleep02831879-21smartctl0
27336822130,1sleep00-21swapper/00
258149599131,10cyclictest2709216-21turbostat3
30450642121,7sleep13045075-21ssh1
30376182121,7sleep03037316-21sendmail-msp0
30354752121,6sleep02709218-21diskmemload0
29878352121,5sleep00-21swapper/00
29616072121,5sleep20-21swapper/22
29401302121,7sleep22940399-21sed2
28537542121,7sleep12709218-21diskmemload1
27879142121,4sleep00-21swapper/00
26256722122,4sleep02625669-21apt-get0
258149599121,7cyclictest2662290-21taskset3
258149599120,10cyclictest0-21swapper/33
30524562110,2sleep00-21swapper/00
30520682111,5sleep23052079-21ssh2
30275842111,4sleep12709218-21diskmemload1
30072902111,5sleep23004786-21sendmail-msp2
30041352111,4sleep22709218-21diskmemload2
29929392111,3sleep10-21swapper/11
29749862111,5sleep12975229-21users1
29710322111,5sleep22970082-21sendmail-msp2
29687932111,5sleep02709218-21diskmemload0
29406942110,5sleep10-21swapper/11
29328532111,3sleep20-21swapper/22
29170022111,6sleep12917017-21ssh1
29069262111,6sleep02906940-21ssh0
28878152115,3sleep02581489-21cyclictest0
28878152115,3sleep02581489-21cyclictest0
28732342111,4sleep02709218-21diskmemload0
28539212110,7sleep22709218-21diskmemload2
28464182111,6sleep22846429-21ssh2
28308842110,2sleep00-21swapper/00
28195742111,6sleep02819584-21ssh0
27952372110,2sleep10-21swapper/11
27870992111,6sleep22787107-21ssh2
27756922111,4sleep22709218-21diskmemload2
27593072111,3sleep00-21swapper/00
27508572111,3sleep00-21swapper/00
27163972111,6sleep22716411-21ssh2
27133282110,7sleep12713759-21needreboot1
26780342113,4sleep02678052-21apt-get0
26730562111,6sleep02673109-21fschecks_count0
26642252111,6sleep22665957-21kthreadcore2
26561422111,5sleep02656327-21users0
26477842111,6sleep22649440-21kthreadcore2
26414632111,4sleep22641616-21diskstats2
26000432111,6sleep22601555-21kthreadcore2
25994392111,4sleep12599457-21apt-get1
30653442101,5sleep23066968-21kthreadcore2
30637202101,4sleep03063752-21ssh0
30633252101,5sleep13063350-21latency_hist1
30347862101,4sleep22709218-21diskmemload2
30183702101,6sleep13018381-21ssh1
30016932100,1sleep00-21swapper/00
29828652101,5sleep02983238-21needreboot0
29506662101,2sleep20-21swapper/22
29415462101,4sleep02709218-21diskmemload0
29185872100,1sleep00-21swapper/00
29063122101,4sleep10-21swapper/11
29059232101,4sleep22709218-21diskmemload2
29002242101,2sleep00-21swapper/00
28977322100,1sleep10-21swapper/11
28802172101,4sleep22709218-21diskmemload2
28671642101,5sleep12868568-21kthreadcore1
28647052101,3sleep00-21swapper/00
28574662101,4sleep22857690-21df_inode2
28369942101,4sleep12709218-21diskmemload1
28355442101,5sleep22830976-21sendmail-msp2
28274762101,3sleep10-21swapper/11
28257972101,3sleep20-21swapper/22
28199712101,3sleep22709218-21diskmemload2
28198472101,3sleep12709218-21diskmemload1
28133632101,3sleep00-21swapper/00
28102692101,4sleep12709218-21diskmemload1
28067102101,5sleep22808182-21kthreadcore2
28026802101,4sleep02709218-21diskmemload0
27931522101,4sleep22709218-21diskmemload2
27791042101,5sleep02779106-21ssh0
27737632101,5sleep02774517-21missed_timers0
27614042101,3sleep02709218-21diskmemload0
27603082101,4sleep22709218-21diskmemload2
27357002101,4sleep22709218-21diskmemload2
27356852100,2sleep10-21swapper/11
27317072101,4sleep12731846-21users1
27186792101,2sleep00-21swapper/00
27183612101,5sleep10-21swapper/11
26531362101,5sleep22654833-21kthreadcore2
26200032101,3sleep20-21swapper/22
26046712101,3sleep10-21swapper/11
3055649291,4sleep23055982-21kthreadcore2
3050590291,5sleep13050685-21pmu-power1
2958753290,1sleep20-21swapper/22
2953041291,3sleep02953072-21apt-get0
2944365291,2sleep10-21swapper/11
2932572291,3sleep00-21swapper/00
2889048291,4sleep12889061-21ssh1
2889048291,4sleep12889061-21ssh1
2874838291,3sleep12874859-21apt-get1
2801478291,4sleep22801489-21ssh2
2770490291,3sleep12770515-21apt-get1
2766905291,4sleep12709218-21diskmemload1
2750628291,5sleep20-21swapper/22
2718395291,2sleep20-21swapper/22
2715900291,3sleep02709218-21diskmemload0
2699008291,3sleep02699020-21apt-get0
2694405291,4sleep22695986-21cut2
2694253291,4sleep12694403-21grep1
2688508290,2sleep20-21swapper/22
2680008291,4sleep22680133-21kthreadcore2
2657022291,4sleep12657019-21apt-get1
2656995290,1sleep00-21swapper/00
2641326291,3sleep02641345-21apt-get0
2615162290,1sleep00-21swapper/00
3034980281,3sleep13034994-21ssh1
2705037281,3sleep12706674-21kthreadcore1
2704238280,3sleep02704256-21apt-get0
2693472281,3sleep12693473-21cron1
2687243281,4sleep02521616-21kworker/0:2+events0
2672466280,2sleep10-21swapper/11
2672145280,1sleep00-21swapper/00
2650523281,3sleep12650593-21ntp_states1
2641348281,3sleep12641462-21expr1
2636639281,3sleep12636697-21kthreadcore1
2636113280,4sleep20-21swapper/22
2630853280,1sleep00-21swapper/00
2626340281,3sleep12627742-21kthreadcore1
2615189281,3sleep12615308-21cpuspeed_turbos1
2608740281,3sleep20-21swapper/22
2599733281,3sleep02599943-21hddtemp_smartct0
2586500280,1sleep20-21swapper/22
2709199271,2sleep20-21swapper/22
2698992271,2sleep10-21swapper/11
2698707271,2sleep02698735-21sh0
2678028271,2sleep10-21swapper/11
2673324271,2sleep20-21swapper/22
2667546270,2sleep20-21swapper/22
2662876271,2sleep10-21swapper/11
2662302270,2sleep00-21swapper/00
2661903270,3sleep22661904-21sshd-session2
2652308271,2sleep10-21swapper/11
2646566271,1sleep02646585-21apt-get0
2620403270,2sleep00-21swapper/00
2609910270,2sleep20-21swapper/22
2598932270,1sleep10-21swapper/11
2596000270,3sleep00-21swapper/00
2586917271,2sleep00-21swapper/00
2693116260,1sleep00-21swapper/00
2687950260,1sleep20-21swapper/22
2684535261,2sleep10-21swapper/11
2636090260,2sleep02636109-21apt-get0
2631854261,2sleep20-21swapper/22
2625936261,2sleep20-21swapper/22
2620974261,2sleep10-21swapper/11
2614797260,1sleep10-21swapper/11
2610090260,2sleep00-21swapper/00
2604670260,4sleep00-21swapper/00
2588963260,2sleep20-21swapper/22
2582754260,2sleep00-21swapper/00
2698993251,1sleep20-21swapper/22
2677111250,1sleep10-21swapper/11
2624496250,1sleep20-21swapper/22
2592803250,1sleep10-21swapper/11
2581538240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional