You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 18:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Thu Sep 03, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
700024211959,55sleep30-21swapper/33
70015628661,6sleep00-21swapper/00
70012328252,12sleep20-21swapper/22
70002728049,12sleep10-21swapper/11
70032899233,14cyclictest916935-21taskset3
70032899231,18cyclictest775639-21taskset3
70032899221,16cyclictest1128669-21chrt3
70032899211,16cyclictest0-21swapper/33
70032899211,16cyclictest0-21swapper/33
11644962211,8sleep11163542-21sendmail-msp1
9616812207,9sleep0962013-21ssh0
700328992014,4cyclictest0-21swapper/33
70032899201,16cyclictest0-21swapper/33
70032899201,15cyclictest0-21swapper/33
8357632193,7sleep244-21ksoftirqd/22
700328991916,1cyclictest0-21swapper/33
700328991915,2cyclictest0-21swapper/33
70032899191,15cyclictest0-21swapper/33
70032899191,15cyclictest0-21swapper/33
70032899191,15cyclictest0-21swapper/33
70032899191,14cyclictest0-21swapper/33
70032899191,14cyclictest0-21swapper/33
70032899191,14cyclictest0-21swapper/33
70032899191,14cyclictest0-21swapper/33
70032899191,14cyclictest0-21swapper/33
70032899190,15cyclictest0-21swapper/33
9948702180,2sleep20-21swapper/22
7361672181,3sleep0737779-21kthreadcore0
7277342181,7sleep2727881-21find2
70032899182,12cyclictest0-21swapper/33
700328991814,2cyclictest0-21swapper/33
700328991812,3cyclictest0-21swapper/33
700328991812,3cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,14cyclictest0-21swapper/33
70032899181,13cyclictest66950irq/132-enp1s0-TxRx-33
70032899181,13cyclictest0-21swapper/33
70032899181,13cyclictest0-21swapper/33
70032899180,2cyclictest0-21swapper/33
70032899180,15cyclictest0-21swapper/33
70032899180,14cyclictest0-21swapper/33
70032899180,14cyclictest0-21swapper/33
9171062171,3sleep00-21swapper/00
70032899171,14cyclictest0-21swapper/33
70032899171,13cyclictest0-21swapper/33
70032899171,13cyclictest0-21swapper/33
70032899171,12cyclictest0-21swapper/33
70032899170,14cyclictest0-21swapper/33
70032899170,14cyclictest0-21swapper/33
70032899170,13cyclictest0-21swapper/33
70032899170,12cyclictest0-21swapper/33
11962972171,3sleep00-21swapper/00
9914292160,9sleep0987181-21sendmail-msp0
9319952160,1sleep20-21swapper/22
70032899165,8cyclictest791515-21turbostat3
700328991613,1cyclictest0-21swapper/33
70032899160,14cyclictest0-21swapper/33
70032899160,14cyclictest0-21swapper/33
70032899160,14cyclictest0-21swapper/33
70032899160,13cyclictest0-21swapper/33
70032899160,13cyclictest0-21swapper/33
70032899160,13cyclictest0-21swapper/33
70032899160,13cyclictest0-21swapper/33
11616222161,4sleep1828269-21diskmemload1
11517192161,2sleep00-21swapper/00
11362032160,3sleep10-21swapper/11
11349272161,2sleep00-21swapper/00
11282722160,5sleep0108271-21gdbus0
11067712161,10sleep01106990-21/usr/sbin/munin0
10951032161,11sleep01096545-21cut0
10799762161,9sleep11080042-21ntp_states1
10367922161,4sleep01036803-21ssh0
9440482150,11sleep0945070-21cut0
9440482150,11sleep0945070-21cut0
8640802155,5sleep2431ktimers/22
70032899154,8cyclictest781061-21turbostat3
70032899154,7cyclictest0-21swapper/33
700328991511,3cyclictest0-21swapper/33
70032899150,13cyclictest0-21swapper/33
70032899150,13cyclictest0-21swapper/33
70032899150,12cyclictest0-21swapper/33
70032899150,12cyclictest0-21swapper/33
70032899150,12cyclictest0-21swapper/33
11911642157,5sleep11192666-21kthreadcore1
10641482150,2sleep00-21swapper/00
10569582151,3sleep1828269-21diskmemload1
10558642151,2sleep20-21swapper/22
8022952141,4sleep1802015-21apt-get1
7486042141,9sleep1748683-21grep1
7433442141,9sleep1739348-21/usr/sbin/munin1
70032899140,12cyclictest0-21swapper/33
70032899140,11cyclictest0-21swapper/33
11866022141,7sleep00-21swapper/00
11702002141,4sleep01170214-21ssh0
11516202141,8sleep10-21swapper/11
10901212141,2sleep20-21swapper/22
10228482141,2sleep10-21swapper/11
9947962131,8sleep1994809-21sh1
9578002130,1sleep10-21swapper/11
9398532130,3sleep0939864-21ssh0
9339382131,7sleep1828269-21diskmemload1
9052722130,3sleep2828269-21diskmemload2
8812062131,3sleep0881220-21ssh0
8793832131,7sleep2879396-21ssh2
8720272131,3sleep1872041-21ssh1
7957852132,3sleep20-21swapper/22
700328991310,2cyclictest0-21swapper/33
11779782131,3sleep21177991-21ssh2
10753592131,6sleep21075393-21munin-run2
10632092131,4sleep11063222-21rm1
10136162131,8sleep21013657-21munin-run2
10019302131,2sleep10-21swapper/11
10019302131,2sleep10-21swapper/11
9426872121,7sleep2942689-21ssh2
9315022121,5sleep0828269-21diskmemload0
9169022122,4sleep20-21swapper/22
8602852121,7sleep1860299-21ssh1
8527642121,6sleep0828269-21diskmemload0
7860552121,7sleep0786058-21sshd-auth0
7655642121,6sleep2765583-21apt-get2
7380542121,2sleep2733824-21sendmail-msp2
11967952120,2sleep2828269-21diskmemload2
11798912121,7sleep01179903-21ssh0
11713292122,6sleep2106713-21snmpd2
10846032121,5sleep0828269-21diskmemload0
10479802121,7sleep11047994-21ssh1
10373452121,2sleep20-21swapper/22
10206752121,2sleep00-21swapper/00
9791032111,6sleep2979314-21cat2
9772152111,4sleep0828269-21diskmemload0
9771122111,6sleep1828269-21diskmemload1
9756452111,4sleep272-21kcompactd02
9536912112,5sleep0955108-21kthreadcore0
9172302112,5sleep1916576-21sendmail-msp1
9141232111,6sleep0914134-21ssh0
8993622112,4sleep1899360-21apt-get1
8969182111,3sleep10-21swapper/11
8607262111,3sleep20-21swapper/22
8423602111,5sleep2828269-21diskmemload2
8160492111,5sleep0816633-21memory0
8123302112,5sleep2106713-21snmpd2
7609012111,6sleep0761394-21kthreadcore0
7550592111,4sleep2754831-21sendmail-msp2
7538132111,6sleep1753877-21/usr/sbin/munin1
7512712111,2sleep20-21swapper/22
7183302111,4sleep2718333-21apt-get2
7180432111,5sleep2718099-21munin-run2
7135172111,5sleep1713588-21irqstats1
7005322112,4sleep1700535-21apt-get1
11621982111,6sleep21162210-21sh2
11336352114,3sleep21128296-21sendmail-msp2
11270292111,3sleep10-21swapper/11
11170632110,2sleep01117076-21ssh0
11098492110,7sleep11109860-21ssh1
10907312111,4sleep1828269-21diskmemload1
10832002111,4sleep20-21swapper/22
10471542111,5sleep20-21swapper/22
10287632110,1sleep00-21swapper/00
10224142111,6sleep11-21systemd1
9835262101,6sleep0983544-21ssh0
9830372101,3sleep1983196-21find1
9654222101,4sleep2828269-21diskmemload2
9622632101,5sleep1963262-21kthreadcore1
9582282100,2sleep20-21swapper/22
9502432101,4sleep2828269-21diskmemload2
9502432101,4sleep2828269-21diskmemload2
9497582101,3sleep10-21swapper/11
9497582101,3sleep10-21swapper/11
9428732101,3sleep10-21swapper/11
9147192100,1sleep10-21swapper/11
9136172101,4sleep2828269-21diskmemload2
9044462101,3sleep0828269-21diskmemload0
8867292101,3sleep10-21swapper/11
8866432101,3sleep20-21swapper/22
8816412101,3sleep00-21swapper/00
8808512100,1sleep10-21swapper/11
8690112101,5sleep00-21swapper/00
8634532100,2sleep00-21swapper/00
8514042101,3sleep10-21swapper/11
8453062101,3sleep10-21swapper/11
8446642100,1sleep00-21swapper/00
8368562101,2sleep00-21swapper/00
8345382101,3sleep10-21swapper/11
8133462101,5sleep2814334-21kthreadcore2
7965662100,3sleep172-21kcompactd01
7833282101,5sleep2785083-21tr2
7495242101,5sleep0749672-21latency_hist0
7447272101,4sleep2744850-21diskstats2
7245192101,5sleep1726137-21kthreadcore1
7055082101,4sleep0705564-21munin-run0
11884202101,4sleep10-21swapper/11
11528042101,4sleep2828269-21diskmemload2
11423682101,3sleep0828269-21diskmemload0
11422172101,5sleep1828269-21diskmemload1
11374322101,4sleep21137446-21ssh2
11274722101,4sleep2828269-21diskmemload2
11184302101,4sleep1828269-21diskmemload1
11113882100,7sleep21111424-21forks2
11097502101,3sleep20-21swapper/22
10985172101,4sleep2828269-21diskmemload2
10812212100,1sleep00-21swapper/00
10741302101,3sleep0828269-21diskmemload0
10735732101,4sleep1828269-21diskmemload1
10636452101,4sleep2828269-21diskmemload2
10573102101,5sleep01057322-21ssh0
10377022102,3sleep1828269-21diskmemload1
10119192101,3sleep10-21swapper/11
10015372101,2sleep20-21swapper/22
10015372101,2sleep20-21swapper/22
895302291,3sleep20-21swapper/22
890471290,6sleep0890484-21sh0
827110291,4sleep0827193-21sed0
823308290,4sleep1823327-21apt-get1
818032291,3sleep1818027-21apt-get1
818003290,1sleep00-21swapper/00
801637291,3sleep2796794-21sendmail-msp2
801377291,4sleep1801621-21users1
780963290,1sleep20-21swapper/22
774931291,4sleep0775098-21cat0
755057291,4sleep00-21swapper/00
744163293,3sleep0106713-21snmpd0
730765291,4sleep1732507-21cut1
1184769291,4sleep21185620-21memory2
1178119291,3sleep1828269-21diskmemload1
1154763290,1sleep00-21swapper/00
1099662290,3sleep1828269-21diskmemload1
1045382291,3sleep00-21swapper/00
1022808290,5sleep21022492-21sendmail-msp2
1019644291,2sleep20-21swapper/22
1010853291,2sleep00-21swapper/00
1001510290,1sleep00-21swapper/00
1001510290,1sleep00-21swapper/00
846506281,3sleep2845974-21sendmail-msp2
823913280,5sleep2825408-21kthreadcore2
818005281,3sleep2817782-21sendmail-msp2
802329281,3sleep00-21swapper/00
791429280,2sleep00-21swapper/00
786532280,2sleep20-21swapper/22
781036280,1sleep00-21swapper/00
775739283,2sleep2775954-21sed2
765171280,1sleep10-21swapper/11
755344281,3sleep1755446-21perl1
740416280,5sleep2742068-21grep2
723567280,2sleep00-21swapper/00
713010281,3sleep04192558-21rs:main0
817407270,1sleep10-21swapper/11
807566270,3sleep0807763-21expr0
799463271,2sleep00-21swapper/00
791242270,1sleep10-21swapper/11
786181270,1sleep10-21swapper/11
754726270,1sleep00-21swapper/00
738711271,2sleep10-21swapper/11
733436270,1sleep20-21swapper/22
732823271,3sleep0151ktimers/00
723091270,1sleep00-21swapper/00
722637270,4sleep10-21swapper/11
707777270,2sleep20-21swapper/22
707770270,1sleep00-21swapper/00
701353271,2sleep20-21swapper/22
812439260,4sleep10-21swapper/11
806502261,2sleep20-21swapper/22
774648261,2sleep10-21swapper/11
770396260,1sleep10-21swapper/11
794711250,1sleep00-21swapper/00
776022250,1sleep10-21swapper/11
770280250,3sleep00-21swapper/00
763041250,1sleep20-21swapper/22
712423250,3sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional