You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-18 - 01:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Thu Sep 17, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
83036021360,4sleep0221rcuc/00
590249212756,66sleep30-21swapper/33
59009828567,12sleep10-21swapper/11
59009428454,11sleep20-21swapper/22
58989328357,7sleep00-21swapper/00
6181862430,2sleep20-21swapper/22
59042499221,16cyclictest0-21swapper/33
59042499212,15cyclictest0-21swapper/33
59042499211,2cyclictest0-21swapper/33
59042499211,15cyclictest0-21swapper/33
59042499210,3cyclictest0-21swapper/33
8256852201,2sleep00-21swapper/00
59042499209,7cyclictest740948-21taskset3
590424992016,2cyclictest0-21swapper/33
590424992016,2cyclictest0-21swapper/33
59042499201,15cyclictest0-21swapper/33
59042499201,15cyclictest0-21swapper/33
59042499200,16cyclictest9871142sleep33
59042499200,16cyclictest759870-21chrt3
9794022191,7sleep2979035-21apt-get2
7611232191,13sleep1761313-21grep1
7611232191,13sleep1761313-21grep1
59042499198,8cyclictest7839062sleep33
59042499198,8cyclictest7839062sleep33
59042499193,12cyclictest0-21swapper/33
590424991912,4cyclictest9175172sleep33
59042499191,15cyclictest0-21swapper/33
59042499191,15cyclictest0-21swapper/33
59042499191,14cyclictest66950irq/132-enp1s0-TxRx-33
59042499191,14cyclictest0-21swapper/33
59042499191,14cyclictest0-21swapper/33
59042499191,13cyclictest827969-21turbostat3
8333652182,1sleep30-21swapper/33
8155402181,8sleep0815692-21/usr/sbin/munin0
590424991811,4cyclictest0-21swapper/33
590424991811,4cyclictest0-21swapper/33
59042499181,14cyclictest0-21swapper/33
59042499181,14cyclictest0-21swapper/33
59042499181,14cyclictest0-21swapper/33
59042499181,14cyclictest0-21swapper/33
59042499181,14cyclictest0-21swapper/33
59042499181,14cyclictest0-21swapper/33
59042499181,14cyclictest0-21swapper/33
59042499181,13cyclictest0-21swapper/33
59042499181,13cyclictest0-21swapper/33
59042499181,13cyclictest0-21swapper/33
59042499181,13cyclictest0-21swapper/33
59042499181,13cyclictest0-21swapper/33
59042499180,14cyclictest0-21swapper/33
8781022171,3sleep10-21swapper/11
8687372171,2sleep10-21swapper/11
8022902171,2sleep00-21swapper/00
7580872171,3sleep00-21swapper/00
59042499179,4cyclictest0-21swapper/33
590424991715,1cyclictest0-21swapper/33
59042499171,4cyclictest0-21swapper/33
590424991712,2cyclictest0-21swapper/33
59042499171,14cyclictest0-21swapper/33
59042499171,14cyclictest0-21swapper/33
59042499171,13cyclictest0-21swapper/33
59042499171,13cyclictest0-21swapper/33
59042499171,12cyclictest0-21swapper/33
59042499171,12cyclictest0-21swapper/33
59042499171,12cyclictest0-21swapper/33
59042499171,12cyclictest0-21swapper/33
59042499170,13cyclictest0-21swapper/33
9774902161,3sleep20-21swapper/22
9207902161,10sleep2921003-21expr2
9179982161,4sleep0718523-21diskmemload0
9057252161,10sleep0907259-21grep0
8347742161,2sleep20-21swapper/22
6761182160,3sleep072-21kcompactd00
6078042161,4sleep2602898-21sendmail-msp2
59042499162,9cyclictest671543-21taskset3
59042499161,3cyclictest0-21swapper/33
590424991613,1cyclictest0-21swapper/33
59042499161,12cyclictest0-21swapper/33
59042499160,13cyclictest0-21swapper/33
59042499160,13cyclictest0-21swapper/33
59042499160,13cyclictest0-21swapper/33
59042499160,12cyclictest0-21swapper/33
10016792161,4sleep1718523-21diskmemload1
9521902151,10sleep1718523-21diskmemload1
9357712151,4sleep1718523-21diskmemload1
8605112150,2sleep00-21swapper/00
7123342154,3sleep00-21swapper/00
590424991512,1cyclictest0-21swapper/33
59042499150,13cyclictest0-21swapper/33
59042499150,12cyclictest0-21swapper/33
59042499150,12cyclictest0-21swapper/33
59042499150,11cyclictest602535-21chrt3
10446862151,4sleep11044697-21ssh1
10182302150,1sleep20-21swapper/22
9928172141,8sleep1992828-21ssh1
8409242141,5sleep2836354-21sendmail-msp2
8104742140,2sleep10-21swapper/11
7766072140,2sleep10-21swapper/11
7436672141,6sleep2743733-21munin-run2
7327902141,4sleep2732804-21ssh2
6720552142,8sleep2672388-21cat2
59042499141,8cyclictest686064-21taskset3
590424991411,1cyclictest0-21swapper/33
59042499140,2cyclictest0-21swapper/33
59042499140,12cyclictest0-21swapper/33
10523712141,8sleep01052381-21ssh0
10293272141,9sleep11029339-21ssh1
10185032141,8sleep0718523-21diskmemload0
10083602142,8sleep01008508-21/usr/sbin/munin0
9876512131,8sleep2987665-21ssh2
9441662131,8sleep2944177-21ssh2
8934682131,7sleep1893478-21ssh1
8332102131,4sleep1833221-21ssh1
7858382131,7sleep1718523-21diskmemload1
7858382131,7sleep1718523-21diskmemload1
7653152131,6sleep2765571-21users2
7653152131,6sleep2765571-21users2
7440462132,5sleep0744074-21apt-get0
7434152131,7sleep1743425-21ssh1
6982892131,7sleep2698360-21irqstats2
6452312131,5sleep2644990-21sendmail-msp2
6405102131,7sleep1641062-21cut1
6132382130,1sleep10-21swapper/11
59042499130,11cyclictest0-21swapper/33
59042499130,11cyclictest0-21swapper/33
10592182131,8sleep11059292-21rm1
10269362132,7sleep2718523-21diskmemload2
9442802121,5sleep0718523-21diskmemload0
9348312120,2sleep2718523-21diskmemload2
9346312121,7sleep0934633-21ssh0
9281602121,3sleep1928172-21ssh1
8953822121,4sleep00-21swapper/00
8752632121,2sleep00-21swapper/00
8509332121,6sleep10-21swapper/11
8416082121,7sleep00-21swapper/00
8366012121,6sleep1718523-21diskmemload1
8270912121,6sleep1718523-21diskmemload1
7929092121,6sleep2718523-21diskmemload2
7929092121,6sleep2718523-21diskmemload2
7454082121,7sleep2747017-21cut2
7135682121,5sleep0713821-21df0
6396902121,7sleep2639859-21cat2
10283902121,3sleep10-21swapper/11
9862612111,6sleep1986272-21ssh1
9689032110,2sleep2968914-21ssh2
9531612111,3sleep20-21swapper/22
9268072111,6sleep00-21swapper/00
9008192110,1sleep10-21swapper/11
8836782110,1sleep00-21swapper/00
8787802111,4sleep1878995-21diskstats1
8672772110,7sleep0718523-21diskmemload0
8525422110,2sleep20-21swapper/22
8267632111,4sleep20-21swapper/22
7778662111,5sleep0777891-21ssh0
7778662111,5sleep0777891-21ssh0
7625012111,6sleep0764168-21kthreadcore0
7625012111,6sleep0764168-21kthreadcore0
7405682110,1sleep00-21swapper/00
7237802111,4sleep20-21swapper/22
7130192110,1sleep10-21swapper/11
6973552110,1sleep20-21swapper/22
6807732110,2sleep1171rcu_preempt1
6764192111,4sleep172-21kcompactd01
6288582111,5sleep2623973-21sendmail-msp2
6084662112,4sleep0608725-21df_inode0
10511982110,1sleep20-21swapper/22
10509362111,6sleep11050941-21ssh1
10451532110,2sleep01045156-21ssh0
10298572111,5sleep21029936-21irqstats2
10190672110,2sleep10-21swapper/11
10034272111,6sleep0718523-21diskmemload0
9935762101,4sleep0718523-21diskmemload0
9841782101,3sleep00-21swapper/00
9602332101,4sleep2718523-21diskmemload2
9597662100,1sleep00-21swapper/00
9525232101,4sleep0718523-21diskmemload0
9427862101,2sleep10-21swapper/11
9192392101,4sleep1718523-21diskmemload1
9098782101,4sleep1718523-21diskmemload1
9088702101,4sleep2718523-21diskmemload2
9007272101,3sleep20-21swapper/22
8935702101,3sleep20-21swapper/22
8863542101,2sleep20-21swapper/22
8610742101,2sleep20-21swapper/22
8592982101,3sleep10-21swapper/11
8517252100,1sleep00-21swapper/00
8182412101,4sleep1718523-21diskmemload1
8084782101,6sleep2808492-21ssh2
7995512100,1sleep10-21swapper/11
7926992101,2sleep10-21swapper/11
7926992101,2sleep10-21swapper/11
7846992101,4sleep2718523-21diskmemload2
7846992101,4sleep2718523-21diskmemload2
7764882101,3sleep20-21swapper/22
7597172101,4sleep2718523-21diskmemload2
7577132101,3sleep10-21swapper/11
7491172100,2sleep10-21swapper/11
7266102101,4sleep0718523-21diskmemload0
7188872101,4sleep1718912-21apt-get1
6919212100,1sleep10-21swapper/11
6819942101,3sleep10-21swapper/11
6767802101,4sleep2677039-21df_inode2
6712442100,1sleep00-21swapper/00
6662332101,4sleep2665987-21sendmail-msp2
6557252101,3sleep2655744-21apt-get2
6494572101,5sleep1649674-21sed1
6194232101,5sleep1619518-21/usr/sbin/munin1
5984032101,4sleep1599147-21cut1
10703932101,3sleep00-21swapper/00
10696542101,4sleep2718523-21diskmemload2
10689352101,4sleep1718523-21diskmemload1
10602502100,2sleep2171rcu_preempt2
10440732101,4sleep2718523-21diskmemload2
10294642101,4sleep01029645-21diskstats0
10096162101,5sleep21009627-21ssh2
10085092101,4sleep11008577-21ntp_states1
10009682100,1sleep20-21swapper/22
975838291,2sleep00-21swapper/00
971007292,3sleep1971029-21apt-get1
968839291,3sleep0718523-21diskmemload0
959702291,4sleep1959712-21ssh1
912286291,2sleep20-21swapper/22
891972291,2sleep00-21swapper/00
875856291,2sleep20-21swapper/22
867255291,2sleep20-21swapper/22
815767291,4sleep2815902-21mailstats2
808862291,3sleep0718523-21diskmemload0
801202291,3sleep2718523-21diskmemload2
792157290,1sleep00-21swapper/00
792157290,1sleep00-21swapper/00
776475291,4sleep0776484-21sh0
732684291,4sleep1732698-21ssh1
732525291,4sleep0732527-21ssh0
716171291,4sleep1717426-21memory1
708248291,4sleep2708024-21sendmail-msp2
702411291,4sleep0702412-21sshd-session0
687251291,2sleep00-21swapper/00
666252291,2sleep10-21swapper/11
661461291,4sleep1661532-21uname1
650489291,3sleep2650508-21apt-get2
650220291,4sleep0650441-21wc0
634726291,3sleep0634745-21apt-get0
629518291,4sleep0629742-21cstates0
629518291,4sleep0629742-21cstates0
629226291,4sleep0629362-21cut0
627301293,2sleep1482475-21rs:main1
617946291,4sleep1618185-21sed1
597841291,3sleep0597860-21apt-get0
594909291,4sleep1595172-21unixbench_singl1
1059986290,2sleep00-21swapper/00
1027154291,3sleep00-21swapper/00
968134280,2sleep10-21swapper/11
696871281,3sleep1697116-21/usr/sbin/munin1
655309280,1sleep00-21swapper/00
634192280,1sleep20-21swapper/22
634192280,1sleep20-21swapper/22
603127280,2sleep10-21swapper/11
707601270,1sleep00-21swapper/00
704671271,3sleep1706399-21grep1
702609270,1sleep10-21swapper/11
692271270,3sleep00-21swapper/00
687336271,2sleep20-21swapper/22
682598270,3sleep2684096-21sed2
682290270,3sleep0682502-21smartctl0
676757270,2sleep00-21swapper/00
665852270,1sleep00-21swapper/00
661534271,2sleep20-21swapper/22
660531270,1sleep10-21swapper/11
660525270,1sleep00-21swapper/00
644555270,1sleep20-21swapper/22
644354271,2sleep00-21swapper/00
639490270,3sleep10-21swapper/11
633639271,2sleep10-21swapper/11
633639271,2sleep10-21swapper/11
623780270,3sleep00-21swapper/00
608442270,2sleep20-21swapper/22
608174271,2sleep00-21swapper/00
602519270,1sleep20-21swapper/22
590572270,2sleep20-21swapper/22
718237260,4sleep20-21swapper/22
707608260,4sleep20-21swapper/22
654301260,2sleep1654474-21strings1
618936261,2sleep20-21swapper/22
615713261,2sleep00-21swapper/00
595512260,4sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional