You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 00:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri May 08, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
722083212063,53sleep30-21swapper/33
722083212063,53sleep30-21swapper/33
71719228756,11sleep10-21swapper/11
71719228756,11sleep10-21swapper/11
72215528454,10sleep20-21swapper/22
72215528454,10sleep20-21swapper/22
71698528154,6sleep00-21swapper/00
71698528154,6sleep00-21swapper/00
722368992119,1cyclictest0-21swapper/33
722368992118,2cyclictest0-21swapper/33
722368992118,1cyclictest0-21swapper/33
722368992017,1cyclictest0-21swapper/33
72236899201,15cyclictest869441-21taskset3
72236899201,15cyclictest0-21swapper/33
72236899201,14cyclictest0-21swapper/33
722368992010,6cyclictest805010-21turbostat3
72236899194,12cyclictest1110419-21taskset3
72236899194,10cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
72236899191,14cyclictest0-21swapper/33
722368991910,5cyclictest756460-21turbostat3
722368991910,5cyclictest66950irq/132-enp1s0-TxRx-33
72236899190,16cyclictest891987-21taskset3
72236899190,16cyclictest66950irq/132-enp1s0-TxRx-33
9095542189,6sleep1852998-21diskmemload1
72236899181,5cyclictest852982-21taskset3
72236899181,5cyclictest0-21swapper/33
722368991814,2cyclictest0-21swapper/33
722368991814,2cyclictest0-21swapper/33
72236899181,15cyclictest809605-21taskset3
72236899181,15cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,14cyclictest0-21swapper/33
72236899181,13cyclictest0-21swapper/33
72236899181,13cyclictest0-21swapper/33
722368991810,5cyclictest0-21swapper/33
72236899180,14cyclictest0-21swapper/33
11506392180,2sleep20-21swapper/22
10956622181,3sleep10-21swapper/11
9788352171,2sleep00-21swapper/00
72236899171,6cyclictest799452-21chrt3
72236899171,14cyclictest0-21swapper/33
722368991711,3cyclictest0-21swapper/33
72236899171,12cyclictest0-21swapper/33
72236899170,14cyclictest0-21swapper/33
72236899170,14cyclictest0-21swapper/33
9435172161,3sleep0852998-21diskmemload0
8955082161,3sleep0895532-21apt-get0
8767762161,2sleep20-21swapper/22
72236899161,12cyclictest0-21swapper/33
72236899160,13cyclictest0-21swapper/33
72236899160,13cyclictest0-21swapper/33
11857062161,4sleep1852998-21diskmemload1
10438822161,2sleep10-21swapper/11
8539962151,3sleep2855417-21kthreadcore2
72236899154,7cyclictest0-21swapper/33
72236899151,3cyclictest0-21swapper/33
722368991512,2cyclictest0-21swapper/33
722368991512,1cyclictest0-21swapper/33
722368991512,1cyclictest0-21swapper/33
722368991512,1cyclictest0-21swapper/33
72236899151,13cyclictest0-21swapper/33
72236899150,13cyclictest0-21swapper/33
72236899150,12cyclictest0-21swapper/33
72236899150,12cyclictest0-21swapper/33
11259382151,2sleep0171rcu_preempt0
11259382151,2sleep0171rcu_preempt0
10259102151,4sleep1852998-21diskmemload1
9038062141,8sleep0852998-21diskmemload0
722368991412,1cyclictest0-21swapper/33
72236899140,12cyclictest0-21swapper/33
72236899140,12cyclictest0-21swapper/33
11775532141,8sleep0852998-21diskmemload0
11089772141,3sleep0852998-21diskmemload0
10940322140,2sleep10-21swapper/11
10420362141,8sleep0852998-21diskmemload0
10263892140,2sleep20-21swapper/22
9437882131,8sleep2943798-21ssh2
9304042131,7sleep0932112-21grep0
9175382131,8sleep0917539-21ssh0
8845072131,8sleep2852998-21diskmemload2
8667532131,5sleep20-21swapper/22
8123692132,7sleep2814151-21cut2
72236899130,1cyclictest0-21swapper/33
12015512131,6sleep0852998-21diskmemload0
11865962131,3sleep2852998-21diskmemload2
11779332131,7sleep2852998-21diskmemload2
10791882131,8sleep21079411-21ssh2
10755462131,7sleep0852998-21diskmemload0
10243692132,5sleep0852998-21diskmemload0
10180342131,6sleep10-21swapper/11
10172262131,6sleep20-21swapper/22
9927412121,6sleep1992752-21ssh1
9918082121,6sleep2852998-21diskmemload2
9746802122,5sleep2974737-21ntpq2
8750062121,7sleep1875017-21ssh1
7561122120,8sleep0756040-31find0
7560982120,3sleep10-21swapper/11
7265792121,5sleep0726622-21ntpq0
11961122121,3sleep11196371-21cstates1
11883542121,7sleep21189754-21grep2
11616312121,7sleep0852998-21diskmemload0
11592632121,5sleep10-21swapper/11
11529712121,6sleep1852998-21diskmemload1
10922242121,5sleep0852998-21diskmemload0
10680642121,5sleep10-21swapper/11
10606692121,7sleep21060680-21ssh2
10363932121,5sleep10-21swapper/11
10363932121,5sleep10-21swapper/11
10006232121,3sleep01000635-21ssh0
9942872111,6sleep0994296-21ssh0
9867032111,6sleep1986714-21ssh1
9664512111,5sleep0966510-21ntpq0
9621862112,4sleep2962210-21apt-get2
9530862111,3sleep20-21swapper/22
9507882110,3sleep1950799-21ssh1
9261982111,7sleep2926209-21ssh2
9255292110,1sleep00-21swapper/00
9175002112,3sleep1852998-21diskmemload1
9043872111,7sleep20-21swapper/22
9023452111,4sleep1852998-21diskmemload1
8932092111,3sleep00-21swapper/00
8617892111,6sleep10-21swapper/11
8265702110,1sleep20-21swapper/22
8146432111,5sleep1814689-21ntpq1
8145292111,5sleep0814642-21ntpq0
7897092111,5sleep1789828-21irqstats1
7450252111,6sleep1745239-21unixbench_singl1
7405802111,4sleep2740599-21apt-get2
11918762111,4sleep10-21swapper/11
11855052111,5sleep0852998-21diskmemload0
11674562111,3sleep10-21swapper/11
11541182111,4sleep2852998-21diskmemload2
11531002111,4sleep0852998-21diskmemload0
11439242111,4sleep1852998-21diskmemload1
11351962111,4sleep1852998-21diskmemload1
11179932111,7sleep00-21swapper/00
11090432111,3sleep10-21swapper/11
10945552113,5sleep2959855-21kworker/u16:2+xprtiod2
10844112111,4sleep0852998-21diskmemload0
10628392112,5sleep21063361-21kthreadcore2
10503142112,3sleep2852998-21diskmemload2
10420582111,3sleep20-21swapper/22
10340422111,5sleep20-21swapper/22
10340422111,5sleep20-21swapper/22
10093122111,5sleep0852998-21diskmemload0
10006362111,3sleep10-21swapper/11
9954932101,2sleep20-21swapper/22
9775292102,5sleep1959855-21kworker/u16:2+xprtiod1
9693482101,3sleep10-21swapper/11
9420672100,1sleep1942069-21ssh1
9336172101,4sleep1852998-21diskmemload1
9327032101,4sleep2852998-21diskmemload2
9261322101,2sleep10-21swapper/11
9178882101,5sleep2917899-21ssh2
8921422100,4sleep20-21swapper/22
8850742101,4sleep1852998-21diskmemload1
8848232101,4sleep0852998-21diskmemload0
8694042101,3sleep00-21swapper/00
8601192101,4sleep1852998-21diskmemload1
8592252101,3sleep0852998-21diskmemload0
8301272101,2sleep10-21swapper/11
8041332101,5sleep2804254-21/usr/sbin/munin2
7959852101,5sleep2797725-21kthreadcore2
7883062101,5sleep1783975-21/usr/sbin/munin1
7723462101,5sleep2772556-21grep2
7503242103,3sleep0750600-21sed0
7499782100,4sleep2750027-21ntpq2
7347902102,6sleep0151ktimers/00
7256712101,5sleep2726437-21/usr/sbin/munin2
12011342101,3sleep20-21swapper/22
11680962101,3sleep20-21swapper/22
11386192101,6sleep21140248-21cut2
11369422101,3sleep00-21swapper/00
11264042101,3sleep2852998-21diskmemload2
11264042101,3sleep2852998-21diskmemload2
11165552101,4sleep11116611-21ntpq1
11107822101,4sleep2852998-21diskmemload2
11021272101,3sleep20-21swapper/22
10865722101,3sleep10-21swapper/11
10767622101,4sleep2852998-21diskmemload2
10608362101,3sleep0852998-21diskmemload0
10516442101,5sleep11051655-21ssh1
10334882101,3sleep0852998-21diskmemload0
10334882101,3sleep0852998-21diskmemload0
983416291,3sleep20-21swapper/22
959492291,2sleep20-21swapper/22
958100291,4sleep1958141-21ntpq1
954481291,4sleep0955541-21grep0
950643291,3sleep0852998-21diskmemload0
900400291,2sleep20-21swapper/22
894173291,4sleep1894183-21ssh1
875709291,5sleep0852998-21diskmemload0
843131291,4sleep2843570-21grep2
802334290,5sleep1803838-21/usr/sbin/munin1
798637291,4sleep1798692-21grep1
793318291,4sleep2793365-21ntpq2
778938291,5sleep10-21swapper/11
773859291,4sleep0774672-21grep0
767971290,3sleep00-21swapper/00
726624291,4sleep1726671-21ntpq1
1192733291,4sleep01192744-21ssh0
1171270291,4sleep1852998-21diskmemload1
1169134291,4sleep01169137-21ssh0
1135751291,2sleep20-21swapper/22
1121138291,2sleep10-21swapper/11
1121138291,2sleep10-21swapper/11
1117875290,1sleep20-21swapper/22
1095314291,4sleep01095571-21ssh0
1071024291,4sleep11071214-21tr1
1067500291,3sleep0852998-21diskmemload0
1053866290,1sleep10-21swapper/11
1050762290,6sleep0852998-21diskmemload0
1003883291,3sleep21003907-21ssh2
976705281,2sleep0852998-21diskmemload0
848211281,3sleep1848345-21grep1
837246281,3sleep1837401-21cstates1
832478281,3sleep1833962-21cut1
816523281,3sleep1818119-21kthreadcore1
805260281,2sleep2805279-21apt-get2
774673281,3sleep1776420-21kthreadcore1
769164281,3sleep1770907-21cut1
761409281,3sleep1761483-21grep1
735229281,2sleep2735248-21apt-get2
1143622280,1sleep00-21swapper/00
1018021281,3sleep01018033-21ssh0
1008974281,3sleep11008984-21ssh1
851895271,3sleep20-21swapper/22
847360270,1sleep00-21swapper/00
842921271,3sleep10-21swapper/11
837224270,2sleep00-21swapper/00
831897271,1sleep00-21swapper/00
825969270,1sleep20-21swapper/22
822285271,2sleep0824010-21kthreadcore0
815917271,2sleep0815936-21apt-get0
806920271,3sleep0808698-21kthreadcore0
799612270,1sleep00-21swapper/00
785345271,2sleep00-21swapper/00
779407271,3sleep00-21swapper/00
778648270,2sleep20-21swapper/22
767550270,1sleep20-21swapper/22
766806270,3sleep0766880-21head0
756335270,1sleep20-21swapper/22
745911270,2sleep10-21swapper/11
745334270,1sleep00-21swapper/00
734635270,1sleep10-21swapper/11
852682260,1sleep00-21swapper/00
842241260,1sleep20-21swapper/22
836015260,2sleep20-21swapper/22
828334261,2sleep00-21swapper/00
800666261,2sleep0802331-21kthreadcore0
793432261,2sleep00-21swapper/00
784362261,2sleep20-21swapper/22
778032260,1sleep20-21swapper/22
766554260,2sleep10-21swapper/11
757868260,2sleep00-21swapper/00
740077260,1sleep10-21swapper/11
734631260,1sleep20-21swapper/22
824011250,1sleep10-21swapper/11
756742250,1sleep20-21swapper/22
815909240,2sleep20-21swapper/22
805549240,1sleep10-21swapper/11
735395240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional