You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 15:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Apr 29, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5819642137120,10sleep20-21swapper/22
581960212263,53sleep30-21swapper/33
58217828958,12sleep10-21swapper/11
58204527953,15sleep00-21swapper/00
58237699241,19cyclictest932116-21taskset3
58237699241,18cyclictest0-21swapper/33
58237699225,14cyclictest66950irq/132-enp1s0-TxRx-33
58237699225,14cyclictest66950irq/132-enp1s0-TxRx-33
58237699223,16cyclictest66950irq/132-enp1s0-TxRx-33
58237699223,15cyclictest0-21swapper/33
58237699219,8cyclictest747490-21sleep3
8314522201,3sleep00-21swapper/00
58237699201,16cyclictest0-21swapper/33
58237699201,15cyclictest855466-21taskset3
58237699200,18cyclictest0-21swapper/33
9142712191,14sleep1713579-21diskmemload1
9037782191,6sleep0903844-21ntpq0
9037782191,6sleep0903844-21ntpq0
58237699191,2cyclictest0-21swapper/33
582376991912,5cyclictest0-21swapper/33
582376991911,7cyclictest0-21swapper/33
58237699191,15cyclictest600503-21taskset3
58237699191,14cyclictest744508-21taskset3
58237699191,14cyclictest0-21swapper/33
58237699191,14cyclictest0-21swapper/33
58237699191,14cyclictest0-21swapper/33
58237699191,14cyclictest0-21swapper/33
582376991910,6cyclictest1066295-21taskset3
10337962191,6sleep0713579-21diskmemload0
7197172181,4sleep0719731-21ssh0
582376991816,1cyclictest0-21swapper/33
58237699181,2cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,14cyclictest0-21swapper/33
58237699181,13cyclictest0-21swapper/33
58237699181,13cyclictest0-21swapper/33
58237699181,13cyclictest0-21swapper/33
58237699180,15cyclictest66950irq/132-enp1s0-TxRx-33
58237699180,14cyclictest0-21swapper/33
9821232171,5sleep0713579-21diskmemload0
8490762171,2sleep20-21swapper/22
58237699179,5cyclictest7280162sleep33
58237699171,4cyclictest0-21swapper/33
58237699171,4cyclictest0-21swapper/33
582376991712,3cyclictest0-21swapper/33
58237699171,14cyclictest8482062sleep33
58237699171,13cyclictest0-21swapper/33
58237699171,13cyclictest0-21swapper/33
58237699170,15cyclictest0-21swapper/33
58237699170,14cyclictest66950irq/132-enp1s0-TxRx-33
58237699170,14cyclictest0-21swapper/33
9841172161,4sleep2984387-21df_inode2
8991722161,11sleep00-21swapper/00
7542602161,3sleep20-21swapper/22
7294352160,1sleep20-21swapper/22
6815162161,6sleep2681671-21cstates2
582376991614,1cyclictest0-21swapper/33
58237699161,13cyclictest0-21swapper/33
58237699160,13cyclictest0-21swapper/33
58237699160,13cyclictest0-21swapper/33
58237699160,13cyclictest0-21swapper/33
58237699160,13cyclictest0-21swapper/33
58237699160,13cyclictest0-21swapper/33
10430122161,3sleep20-21swapper/22
9566832151,2sleep00-21swapper/00
8486892150,3sleep20-21swapper/22
8237792151,5sleep2823781-21ssh2
7436652151,4sleep1743712-21ntpq1
6009072151,3sleep2600926-21apt-get2
5943192151,2sleep00-21swapper/00
58237699151,9cyclictest702901-21taskset3
582376991513,1cyclictest0-21swapper/33
582376991512,2cyclictest0-21swapper/33
582376991512,1cyclictest0-21swapper/33
58237699151,13cyclictest0-21swapper/33
58237699150,13cyclictest0-21swapper/33
58237699150,13cyclictest0-21swapper/33
58237699150,12cyclictest0-21swapper/33
10266102151,7sleep21026828-21hddtemp_smartct2
9567892142,7sleep1713579-21diskmemload1
9338052140,1sleep20-21swapper/22
8891042141,2sleep2171rcu_preempt2
8726772141,9sleep1872692-21ssh1
8141902141,3sleep10-21swapper/11
7882042141,8sleep0713579-21diskmemload0
7619672141,9sleep1761981-21ssh1
7561182141,8sleep1713579-21diskmemload1
7374112140,3sleep10-21swapper/11
7214702141,8sleep2713579-21diskmemload2
58237699149,3cyclictest0-21swapper/33
582376991411,2cyclictest0-21swapper/33
582376991411,1cyclictest0-21swapper/33
58237699140,12cyclictest0-21swapper/33
58237699140,12cyclictest0-21swapper/33
58237699140,12cyclictest0-21swapper/33
10490402141,4sleep11049054-21ssh1
10411682140,1sleep20-21swapper/22
10256342141,3sleep21025648-21ssh2
9909382131,3sleep1990948-21ssh1
9897492131,7sleep0713579-21diskmemload0
9401982130,7sleep134-21ksoftirqd/11
9229002131,7sleep2713579-21diskmemload2
8026742130,2sleep10-21swapper/11
7961232130,1sleep10-21swapper/11
6962382131,6sleep0696287-21ntpq0
6428252131,8sleep2642876-21ld2
582376991310,2cyclictest0-21swapper/33
582376991310,1cyclictest0-21swapper/33
10514672132,5sleep0713579-21diskmemload0
10487482131,3sleep01048758-21ssh0
10163462131,8sleep11016358-21ssh1
9814032124,4sleep2981414-21ssh2
9741572121,5sleep20-21swapper/22
9642342121,7sleep2713579-21diskmemload2
9630642122,6sleep0963192-21ld0
9558602121,3sleep2955871-21ssh2
9206312121,7sleep1920686-21collect21
8911632121,5sleep1891196-21ssh1
8804252121,6sleep0713579-21diskmemload0
8645582123,2sleep1171rcu_preempt1
8375042121,7sleep1837515-21ssh1
7636352121,6sleep2713579-21diskmemload2
7627962121,3sleep0762810-21ssh0
7069412121,3sleep20-21swapper/22
6334362121,7sleep0633586-21cstates0
10672642121,1sleep20-21swapper/22
10422222121,6sleep0713579-21diskmemload0
10414672121,6sleep1713579-21diskmemload1
10253532121,5sleep11025363-21ssh1
10172432121,6sleep20-21swapper/22
10002962121,6sleep2713579-21diskmemload2
9940372111,6sleep1995731-21tr1
9719402112,5sleep1972173-21grep1
9667972111,3sleep10-21swapper/11
9483072111,4sleep10-21swapper/11
9418212112,4sleep2941841-21apt-get2
9142592111,6sleep0914270-21ssh0
9133042111,3sleep20-21swapper/22
8897792111,3sleep00-21swapper/00
8876772111,4sleep1713579-21diskmemload1
8748072111,5sleep2874935-21irqstats2
8652012111,6sleep2865209-21ssh2
8408142111,5sleep0841081-21df0
8397752110,2sleep20-21swapper/22
8200422111,4sleep2713579-21diskmemload2
8154402111,7sleep0815666-21cstates0
7818512111,5sleep1782079-21df_inode1
7779552112,2sleep2171rcu_preempt2
7721902110,7sleep0713579-21diskmemload0
7713932111,3sleep20-21swapper/22
7453302111,3sleep20-21swapper/22
6909412111,5sleep2690999-21ntp_states2
6621182111,6sleep2663963-21cut2
6227322111,5sleep0622750-21apt-get0
6070932111,6sleep2607128-21kthreadcore2
10590172111,6sleep21059025-21ssh2
10229942111,5sleep0713579-21diskmemload0
10078412111,4sleep2713579-21diskmemload2
9759932101,5sleep1976221-21iwlist1
9742262101,4sleep0713579-21diskmemload0
9417972101,4sleep0713579-21diskmemload0
9323222101,4sleep1713579-21diskmemload1
9299582101,4sleep2713579-21diskmemload2
9270862101,5sleep0928837-21kthreadcore0
9216612100,1sleep00-21swapper/00
9058682101,3sleep1713579-21diskmemload1
9058682101,3sleep1713579-21diskmemload1
9001042101,4sleep2900185-21irqstats2
9001042101,4sleep2900185-21irqstats2
8963682101,2sleep20-21swapper/22
8802372101,3sleep10-21swapper/11
8720952101,4sleep2713579-21diskmemload2
8660562100,5sleep0866091-21ssh0
8634692100,1sleep00-21swapper/00
8558712101,4sleep1713579-21diskmemload1
8492182101,4sleep0849483-21df0
8468992101,3sleep10-21swapper/11
8329052101,6sleep0832992-21kthreadcore0
8126572101,3sleep0713579-21diskmemload0
8031762101,6sleep0803433-21ssh0
7961622101,2sleep00-21swapper/00
7863162101,4sleep2713579-21diskmemload2
7794182101,3sleep0713579-21diskmemload0
7700552101,3sleep10-21swapper/11
7539522102,3sleep0713579-21diskmemload0
7338682100,7sleep0735130-21ssh0
7299832101,5sleep0729997-21ssh0
7269202101,5sleep1727170-21unixbench_singl1
6976182101,4sleep1697778-21diskstats1
6873872101,5sleep1688611-21tr1
6802032101,4sleep2680250-21ntpq2
6705372100,6sleep1670717-21cat1
6700062100,6sleep0670170-21/usr/sbin/munin0
6547442101,4sleep2654763-21apt-get2
6375092101,4sleep1637562-21ntp_states1
6173912101,4sleep2617410-21apt-get2
6119022101,4sleep1612154-21df1
6101082104,3sleep0610569-21grep0
6069772101,5sleep1607092-21irqstats1
5945912100,2sleep1594816-21tail1
10588212101,2sleep10-21swapper/11
10067882101,3sleep10-21swapper/11
10065412101,4sleep0713579-21diskmemload0
10003722101,4sleep0713579-21diskmemload0
933467290,3sleep00-21swapper/00
830353291,4sleep1830366-21sh1
821128291,4sleep1821139-21ssh1
807193291,2sleep20-21swapper/22
805697290,1sleep20-21swapper/22
778316291,2sleep10-21swapper/11
747208290,1sleep00-21swapper/00
736209291,2sleep20-21swapper/22
713915291,4sleep1713925-21ssh1
697512291,5sleep0697616-21tr0
685505291,4sleep1685535-21ntpq1
674991291,4sleep2675111-21grep2
650772291,4sleep1652519-21tr1
644096291,4sleep2644251-21cstates2
624137291,4sleep1625879-21grep1
616827291,4sleep0616886-31find0
612155291,4sleep2612200-21grep2
605295291,4sleep0605302-21sensors_temp0
582807291,4sleep1582933-21perl1
582807291,4sleep1582933-21perl1
1065791291,3sleep0713579-21diskmemload0
1064985291,4sleep11064997-21ssh1
1016009291,3sleep0713579-21diskmemload0
793715281,3sleep2790159-21/usr/sbin/munin2
690839281,3sleep0690887-21ntpq0
648914281,2sleep10-21swapper/11
595565281,3sleep0595584-21apt-get0
583908283,2sleep00-21swapper/00
583908283,2sleep00-21swapper/00
1025929280,3sleep10-21swapper/11
713436270,1sleep10-21swapper/11
707846270,2sleep10-21swapper/11
702423270,1sleep20-21swapper/22
680863270,1sleep10-21swapper/11
675869271,3sleep00-21swapper/00
675858270,1sleep10-21swapper/11
665180270,1sleep10-21swapper/11
660112270,2sleep00-21swapper/00
658949270,4sleep10-21swapper/11
654250271,2sleep2582369-21cyclictest2
649974271,2sleep00-21swapper/00
643529270,1sleep00-21swapper/00
638732270,2sleep10-21swapper/11
638114270,1sleep20-21swapper/22
632960270,1sleep10-21swapper/11
627122271,3sleep2627339-21unixbench_multi2
605981270,1sleep10-21swapper/11
595028270,1sleep20-21swapper/22
582517270,4sleep20-21swapper/22
582517270,4sleep20-21swapper/22
713395260,1sleep20-21swapper/22
708494260,2sleep00-21swapper/00
707714260,4sleep00-21swapper/00
697026260,1sleep10-21swapper/11
696978260,4sleep20-21swapper/22
681485260,3sleep00-21swapper/00
680998260,3sleep0680999-21pool-udisksd0
669562261,2sleep2401irq_work/22
654484260,3sleep00-21swapper/00
644068260,4sleep00-21swapper/00
633023260,1sleep20-21swapper/22
629697261,2sleep00-21swapper/00
622249260,1sleep00-21swapper/00
597476261,2sleep20-21swapper/22
596137250,1sleep10-21swapper/11
617689240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional