You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 13:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Wed Apr 22, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
695969212262,56sleep30-21swapper/33
73044421150,2sleep20-21swapper/22
69587028759,10sleep10-21swapper/11
69604428465,12sleep20-21swapper/22
69600527653,14sleep00-21swapper/00
9830142330,1sleep272-21kcompactd02
10603482300,1sleep10-21swapper/11
696160992217,3cyclictest8501522chrt3
69616099221,17cyclictest1123031-21taskset3
69616099203,14cyclictest66950irq/132-enp1s0-TxRx-33
69616099202,7cyclictest1193895-21taskset3
69616099201,7cyclictest0-21swapper/33
69616099201,4cyclictest800318-21chrt3
69616099201,16cyclictest893895-21chrt3
69616099201,16cyclictest0-21swapper/33
69616099200,16cyclictest0-21swapper/33
10638912200,8sleep134-21ksoftirqd/11
8323722191,14sleep0832383-21ssh0
7810842191,9sleep1782814-21latency1
69616099198,8cyclictest821421-21turbostat3
69616099191,6cyclictest0-21swapper/33
69616099191,15cyclictest0-21swapper/33
69616099191,15cyclictest0-21swapper/33
69616099191,14cyclictest1169421-21taskset3
69616099191,14cyclictest0-21swapper/33
69616099191,14cyclictest0-21swapper/33
69616099191,14cyclictest0-21swapper/33
69616099191,14cyclictest0-21swapper/33
69616099190,17cyclictest0-21swapper/33
8316332181,13sleep2831676-21mailstats2
69616099184,2cyclictest0-21swapper/33
696160991813,3cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,14cyclictest0-21swapper/33
69616099181,13cyclictest0-21swapper/33
696160991810,5cyclictest66950irq/132-enp1s0-TxRx-33
69616099180,13cyclictest0-21swapper/33
69616099180,12cyclictest0-21swapper/33
10986432181,2sleep00-21swapper/00
9911602171,2sleep00-21swapper/00
9441342172,8sleep1945212-21memory1
9397112171,5sleep0826766-21diskmemload0
9042062171,3sleep00-21swapper/00
696160991714,1cyclictest0-21swapper/33
69616099171,13cyclictest0-21swapper/33
69616099171,13cyclictest0-21swapper/33
69616099171,13cyclictest0-21swapper/33
69616099171,13cyclictest0-21swapper/33
69616099171,13cyclictest0-21swapper/33
69616099171,13cyclictest0-21swapper/33
69616099171,13cyclictest0-21swapper/33
69616099170,14cyclictest0-21swapper/33
69616099170,14cyclictest0-21swapper/33
9988502161,4sleep0826766-21diskmemload0
9827922161,4sleep0826766-21diskmemload0
8607472161,3sleep20-21swapper/22
69616099166,5cyclictest7789072sleep33
69616099161,3cyclictest0-21swapper/33
69616099160,13cyclictest0-21swapper/33
69616099160,13cyclictest0-21swapper/33
69616099160,13cyclictest0-21swapper/33
69616099160,13cyclictest0-21swapper/33
69616099160,12cyclictest0-21swapper/33
11844942160,1sleep00-21swapper/00
11836102161,3sleep20-21swapper/22
11661622161,4sleep0826766-21diskmemload0
11563332161,4sleep1826766-21diskmemload1
11426272161,4sleep2826766-21diskmemload2
9648152151,10sleep1964825-21ssh1
9172102151,10sleep1918934-21latency1
69616099153,8cyclictest0-21swapper/33
69616099151,3cyclictest0-21swapper/33
69616099151,2cyclictest0-21swapper/33
69616099150,13cyclictest0-21swapper/33
69616099150,12cyclictest0-21swapper/33
69616099150,12cyclictest0-21swapper/33
69616099150,12cyclictest0-21swapper/33
11314752151,2sleep20-21swapper/22
10603362151,8sleep0826766-21diskmemload0
10354812151,4sleep2826766-21diskmemload2
10286302151,9sleep0826766-21diskmemload0
9935322141,3sleep1826766-21diskmemload1
9277102141,4sleep0927858-21sh0
7305452140,9sleep0730206-31find0
69616099149,3cyclictest0-21swapper/33
69616099144,6cyclictest0-21swapper/33
69616099141,2cyclictest0-21swapper/33
69616099140,2cyclictest0-21swapper/33
69616099140,12cyclictest0-21swapper/33
69616099140,12cyclictest0-21swapper/33
11484372141,4sleep11148448-21ssh1
11385922141,8sleep21138847-21users2
11131962141,2sleep00-21swapper/00
10625672141,8sleep21062582-21ssh2
9560342131,7sleep2826766-21diskmemload2
8361872132,8sleep0826766-21diskmemload0
7936272138,2sleep0793677-21ldconfig0
7302602130,2sleep00-21swapper/00
7185122131,6sleep0718558-21ntpq0
69616099130,11cyclictest0-21swapper/33
69616099130,10cyclictest7192682sleep33
11568362131,7sleep0826766-21diskmemload0
10977382130,2sleep00-21swapper/00
10876152131,8sleep21087628-21rm2
10864532131,7sleep1826766-21diskmemload1
10709292133,5sleep0151ktimers/00
10505982130,8sleep0826766-21diskmemload0
10239742131,6sleep11024065-21ntpq1
9392882126,2sleep20-21swapper/22
9289292121,7sleep2928941-21ssh2
9104322121,6sleep1910488-21ntpq1
8851592121,7sleep2885173-21ssh2
8753652121,1sleep10-21swapper/11
8696922127,2sleep00-21swapper/00
8683042121,7sleep2802-21snmpd2
8597742121,7sleep0826766-21diskmemload0
8451912121,7sleep1845323-21fschecks_time1
8400092121,5sleep1840069-21ntpq1
8341452121,2sleep1834157-21ssh1
8043452121,6sleep2804383-21ntpq2
7456822121,6sleep1745722-21ntpq1
7202712125,3sleep10-21swapper/11
11947012121,7sleep21194715-21ssh2
11776172121,5sleep11177638-21apt-get1
11302442121,4sleep072-21kcompactd00
11139282123,2sleep2171rcu_preempt2
10967522121,6sleep2826766-21diskmemload2
10880892121,5sleep00-21swapper/00
10728702121,7sleep11072927-21tune2fs1
10161362120,3sleep21016147-21ssh2
10044212121,2sleep172-21kcompactd01
9985692110,3sleep2998584-21ssh2
9921902110,2sleep2992202-21ssh2
9915582110,2sleep1171rcu_preempt1
9734772111,6sleep1973488-21ssh1
9715382111,6sleep0971641-21ntpq0
9665972111,3sleep20-21swapper/22
9579792111,7sleep1957993-21ssh1
9494082111,3sleep00-21swapper/00
9045152111,6sleep1904529-21ssh1
8943952111,6sleep2826766-21diskmemload2
8858062110,1sleep10-21swapper/11
8511762115,2sleep00-21swapper/00
8204382111,4sleep1820487-21ntpq1
7954692111,6sleep0795566-21ps0
7897572111,5sleep2789881-21diskstats2
7779232111,7sleep0777927-21mailstats0
7722182111,5sleep0772266-21ntpq0
7683262111,5sleep2768510-21diskstats2
7516562112,6sleep1802-21snmpd1
7091312110,7sleep1709110-21/usr/sbin/munin1
7037742111,6sleep0703752-21/usr/sbin/munin0
6966372110,1sleep00-21swapper/00
11943882112,4sleep1826766-21diskmemload1
11942612111,3sleep00-21swapper/00
11556162111,5sleep21155682-21ntpq2
10527462110,7sleep21052756-21ssh2
10387322111,6sleep01040369-21kthreadcore0
10191532111,6sleep01019164-21ssh0
10170802111,4sleep10-21swapper/11
10096532111,4sleep2826766-21diskmemload2
10065872115,1sleep00-21swapper/00
9666652101,4sleep0826766-21diskmemload0
9580722101,6sleep0958083-21ssh0
9392252101,4sleep1826766-21diskmemload1
9220202101,3sleep00-21swapper/00
9212892101,3sleep20-21swapper/22
9061722101,4sleep00-21swapper/00
9044752100,6sleep2904486-21ssh2
8955782100,3sleep00-21swapper/00
8941232101,4sleep1826766-21diskmemload1
8787932100,1sleep20-21swapper/22
8764952101,2sleep00-21swapper/00
8671712101,2sleep10-21swapper/11
8598322101,4sleep1826766-21diskmemload1
8499352101,2sleep20-21swapper/22
8418522101,2sleep20-21swapper/22
8219642101,4sleep1822174-21hddtemp_smartct1
8056572101,5sleep2805851-21cstates2
7776692101,5sleep1777725-21awk1
7616922100,1sleep00-21swapper/00
7615882101,5sleep2761636-21ntpq2
7509662101,5sleep0751012-21ntpq0
7242392101,6sleep0724456-21/usr/sbin/munin0
7096582101,5sleep0709878-21cut0
11771142101,3sleep10-21swapper/11
11738122101,4sleep0826766-21diskmemload0
11655722101,3sleep10-21swapper/11
11458102101,5sleep01146689-21/usr/sbin/munin0
11381542101,4sleep01138214-21ntpq0
11369922101,4sleep1826766-21diskmemload1
11294112101,5sleep11129464-21ld1
11129672101,4sleep1826766-21diskmemload1
11040952100,2sleep10-21swapper/11
10992612101,3sleep20-21swapper/22
10905382101,5sleep11090622-21cut1
10806332101,3sleep20-21swapper/22
10710502101,4sleep2826766-21diskmemload2
10450992101,3sleep20-21swapper/22
10423962101,3sleep1826766-21diskmemload1
10340702101,4sleep1826766-21diskmemload1
982346290,1sleep10-21swapper/11
972843291,4sleep2972854-21ssh2
947061291,2sleep20-21swapper/22
923699291,3sleep1923724-21apt-get1
912931291,2sleep20-21swapper/22
881206291,4sleep0882861-21ssh0
825711291,4sleep2825762-21ntpq2
809675291,4sleep1809717-21ntpq1
804680291,4sleep0804815-21/usr/sbin/munin0
789615291,4sleep1789753-21grep1
785384291,5sleep0787125-21kthreadcore0
756395292,3sleep10-21swapper/11
749891291,4sleep2750826-21wc2
701504291,4sleep2701920-21cut2
1176067290,1sleep20-21swapper/22
1164128291,4sleep21160125-21/usr/sbin/munin2
1123775291,3sleep21123789-21ssh2
1122895291,2sleep00-21swapper/00
1120845291,2sleep10-21swapper/11
1079788291,3sleep0826766-21diskmemload0
1052024291,4sleep11052038-21ssh1
1019913291,4sleep21019987-21grep2
816885281,3sleep0817617-21grep0
809831283,2sleep00-21swapper/00
800591281,4sleep1800803-21smartctl1
795572281,3sleep1797237-21kthreadcore1
757887281,3sleep1758091-21hddtemp_smartct1
741574280,2sleep00-21swapper/00
740346281,3sleep1740513-21timerwakeupswit1
736990281,3sleep0738693-21kthreadcore0
711589280,4sleep2713011-21load2
1019816281,3sleep01019827-21ssh0
821140271,3sleep2802-21snmpd2
811532270,3sleep2811581-21kthreadcore2
799767270,1sleep20-21swapper/22
788648270,4sleep1788903-21awk1
784009270,1sleep20-21swapper/22
778630270,1sleep20-21swapper/22
768244271,3sleep10-21swapper/11
767269271,3sleep20-21swapper/22
763468271,3sleep1764728-21kthreadcore1
756711270,3sleep2756923-21awk2
752291271,3sleep00-21swapper/00
740760270,1sleep20-21swapper/22
734514271,2sleep2685225-21kworker/u16:2+kvfree_rcu_reclaim2
730554270,4sleep1730206-31find1
714731270,4sleep2714948-21basename2
705568271,2sleep10-21swapper/11
696919271,2sleep20-21swapper/22
816024260,1sleep10-21swapper/11
815786261,3sleep00-21swapper/00
789300260,1sleep20-21swapper/22
767663260,1sleep00-21swapper/00
744344260,2sleep20-21swapper/22
730273261,2sleep10-21swapper/11
724502260,2sleep20-21swapper/22
719228260,2sleep10-21swapper/11
696347260,2sleep1696366-21apt-get1
783011250,1sleep00-21swapper/00
821411240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional