You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 23:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 23, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
608309215397,52sleep30-21swapper/33
6082612119102,10sleep10-21swapper/11
60818828557,10sleep20-21swapper/22
60849127959,14sleep00-21swapper/00
7672182230,2sleep0221rcuc/00
60870099228,10cyclictest869003-21turbostat3
9264392210,2sleep20-21swapper/22
60870099211,15cyclictest66950irq/132-enp1s0-TxRx-33
10341892211,6sleep0736396-21diskmemload0
8435642201,4sleep1843565-21sh1
60870099209,7cyclictest668313-21turbostat3
608700992016,2cyclictest0-21swapper/33
608700992014,3cyclictest66950irq/132-enp1s0-TxRx-33
60870099201,15cyclictest613516-21taskset3
8991012191,2sleep10-21swapper/11
60870099191,15cyclictest793360-21chrt3
60870099191,15cyclictest0-21swapper/33
60870099191,15cyclictest0-21swapper/33
60870099191,14cyclictest0-21swapper/33
60870099191,14cyclictest0-21swapper/33
60870099191,14cyclictest0-21swapper/33
60870099191,13cyclictest0-21swapper/33
60870099190,16cyclictest7764402sleep33
60870099190,16cyclictest7764402sleep33
7279492180,6sleep014-21ksoftirqd/00
60870099181,5cyclictest0-21swapper/33
60870099181,14cyclictest10643362sleep33
60870099181,14cyclictest0-21swapper/33
60870099181,14cyclictest0-21swapper/33
60870099181,14cyclictest0-21swapper/33
60870099181,14cyclictest0-21swapper/33
60870099181,14cyclictest0-21swapper/33
60870099181,14cyclictest0-21swapper/33
60870099181,13cyclictest0-21swapper/33
60870099181,13cyclictest0-21swapper/33
60870099181,13cyclictest0-21swapper/33
60870099181,13cyclictest0-21swapper/33
60870099181,13cyclictest0-21swapper/33
60870099180,15cyclictest66950irq/132-enp1s0-TxRx-33
60870099180,14cyclictest0-21swapper/33
9273892171,7sleep1927464-21cpuspeed_turbos1
8781022171,10sleep1878205-21irqstats1
8610972172,10sleep1736396-21diskmemload1
6938222171,5sleep0694065-21users0
60870099171,5cyclictest9337572sleep33
60870099171,4cyclictest0-21swapper/33
60870099171,3cyclictest0-21swapper/33
608700991711,4cyclictest66950irq/132-enp1s0-TxRx-33
60870099171,14cyclictest0-21swapper/33
60870099171,14cyclictest0-21swapper/33
608700991711,3cyclictest0-21swapper/33
60870099171,13cyclictest0-21swapper/33
60870099171,13cyclictest0-21swapper/33
60870099171,13cyclictest0-21swapper/33
60870099171,13cyclictest0-21swapper/33
60870099171,13cyclictest0-21swapper/33
60870099171,13cyclictest0-21swapper/33
60870099170,14cyclictest0-21swapper/33
60870099170,14cyclictest0-21swapper/33
60870099170,14cyclictest0-21swapper/33
60870099170,13cyclictest0-21swapper/33
10743202171,3sleep10-21swapper/11
9848662161,6sleep1736396-21diskmemload1
9743812161,3sleep10-21swapper/11
9165732160,3sleep20-21swapper/22
9165342160,2sleep30-21swapper/33
8501572161,5sleep2736396-21diskmemload2
7586562161,3sleep10-21swapper/11
608700991613,1cyclictest0-21swapper/33
608700991613,1cyclictest0-21swapper/33
608700991611,3cyclictest0-21swapper/33
60870099160,4cyclictest0-21swapper/33
60870099160,14cyclictest0-21swapper/33
60870099160,13cyclictest0-21swapper/33
60870099160,13cyclictest0-21swapper/33
10429632162,4sleep2736396-21diskmemload2
9814122151,9sleep2981624-21grep2
9504112152,8sleep0736396-21diskmemload0
9492492151,4sleep1736396-21diskmemload1
7679952151,2sleep10-21swapper/11
7391052151,10sleep0736778-21/usr/sbin/munin0
60870099153,9cyclictest0-21swapper/33
60870099151,3cyclictest0-21swapper/33
60870099151,11cyclictest0-21swapper/33
608700991510,3cyclictest0-21swapper/33
60870099150,12cyclictest0-21swapper/33
60870099150,12cyclictest0-21swapper/33
10649862151,2sleep20-21swapper/22
10416562150,6sleep11041666-21ssh1
10319902159,3sleep11032001-21ssh1
10312482150,3sleep2736396-21diskmemload2
9990642142,7sleep0736396-21diskmemload0
9662682140,9sleep0736396-21diskmemload0
9592172140,2sleep20-21swapper/22
9576992141,2sleep10-21swapper/11
8845652141,9sleep00-21swapper/00
8362682141,6sleep00-21swapper/00
8187152141,9sleep0818728-21ssh0
7857002141,9sleep0785711-21ssh0
7209112141,9sleep0721067-21/usr/sbin/munin0
6904132141,3sleep10-21swapper/11
60870099149,3cyclictest0-21swapper/33
60870099141,2cyclictest0-21swapper/33
608700991412,1cyclictest0-21swapper/33
608700991411,1cyclictest0-21swapper/33
60870099140,11cyclictest736340-21chrt3
9747182131,3sleep0974730-21ssh0
8665292135,2sleep014-21ksoftirqd/00
8267822131,9sleep1826793-21ssh1
8196292131,3sleep0819257-21apt-get0
8006862131,6sleep10-21swapper/11
6785292130,1sleep00-21swapper/00
60870099130,2cyclictest0-21swapper/33
10257962131,7sleep2736396-21diskmemload2
10215072131,7sleep01022330-21cat0
9894002121,5sleep1989463-21ntp_states1
9894002121,5sleep1989463-21ntp_states1
9177032121,6sleep0736396-21diskmemload0
9086952121,7sleep1908709-21ssh1
8507602121,7sleep0850764-21ssh0
8411562121,7sleep2841164-21ssh2
8273212120,8sleep2827333-21ssh2
8091342121,2sleep10-21swapper/11
7860312121,3sleep10-21swapper/11
7777542121,7sleep1777762-21ssh1
7777542121,7sleep1777762-21ssh1
7715252121,7sleep2773134-21cut2
7715252121,7sleep2773134-21cut2
7520422120,2sleep10-21swapper/11
6952542121,7sleep1695663-21cat1
6423542121,5sleep0642373-21apt-get0
60870099121,8cyclictest641727-21chrt3
10525732121,7sleep01054182-21grep0
10414272120,2sleep20-21swapper/22
10177562121,5sleep2736396-21diskmemload2
10100222122,4sleep01010051-21apt-get0
9992192111,3sleep10-21swapper/11
9911342111,6sleep0991144-21ssh0
9911342111,6sleep0991144-21ssh0
9904452111,3sleep20-21swapper/22
9904452111,3sleep20-21swapper/22
9845452111,4sleep0736396-21diskmemload0
9646682111,6sleep2964772-21ps2
9572182111,4sleep0736396-21diskmemload0
9338852111,4sleep20-21swapper/22
9264282111,6sleep1926438-21ssh1
9190642112,4sleep0919062-21apt-get0
8922332113,4sleep2892243-21ssh2
8916142111,6sleep1736396-21diskmemload1
8782062111,6sleep2879267-21kthreadcore2
8750652111,6sleep0875076-21ssh0
8606802111,6sleep10-21swapper/11
8528192111,5sleep2853084-21df2
8359612111,2sleep00-21swapper/00
8354162112,4sleep2736396-21diskmemload2
8185552111,3sleep20-21swapper/22
8098802111,4sleep2736396-21diskmemload2
8091692111,6sleep0736396-21diskmemload0
7941522110,1sleep10-21swapper/11
7604142111,4sleep0736396-21diskmemload0
7588102111,3sleep20-21swapper/22
7418032111,5sleep2736396-21diskmemload2
7313902112,4sleep0731409-21apt-get0
7266362111,5sleep2726707-21irqstats2
7156792111,5sleep2715935-21df2
7039442111,5sleep2704001-21ntp_states2
6947192111,5sleep00-21swapper/00
6787612111,5sleep2678817-21munin-run2
10800672111,5sleep11080131-21ntp_states1
10770882111,6sleep21078674-21kthreadcore2
10763722111,3sleep00-21swapper/00
10741912111,4sleep2736396-21diskmemload2
10504562110,2sleep00-21swapper/00
10157102111,2sleep10-21swapper/11
10093522111,4sleep1736396-21diskmemload1
10073512111,3sleep00-21swapper/00
9740142101,4sleep2736396-21diskmemload2
9653632101,4sleep1736396-21diskmemload1
9516682101,3sleep20-21swapper/22
9404492101,4sleep0736396-21diskmemload0
9354772101,3sleep20-21swapper/22
9092462101,4sleep2736396-21diskmemload2
9072632101,2sleep00-21swapper/00
9007672101,4sleep0736396-21diskmemload0
8906292101,4sleep0736396-21diskmemload0
8677672100,2sleep2867779-21ssh2
8347362101,4sleep1736396-21diskmemload1
8168212101,4sleep10-21swapper/11
8027402100,4sleep0736396-21diskmemload0
7923832101,4sleep0736396-21diskmemload0
7917062101,3sleep20-21swapper/22
7749052101,3sleep0736396-21diskmemload0
7749052101,3sleep0736396-21diskmemload0
7502682101,3sleep2736396-21diskmemload2
7083192101,6sleep2709073-21wc2
6892142101,4sleep0689270-21munin-run0
6542722101,4sleep0655955-21cut0
6377742101,5sleep20-21swapper/22
6370892101,4sleep1637108-21apt-get1
10737952100,3sleep00-21swapper/00
10645792101,2sleep10-21swapper/11
10494792101,3sleep1736396-21diskmemload1
10408072100,1sleep00-21swapper/00
10090452101,3sleep2736396-21diskmemload2
10008612101,3sleep20-21swapper/22
942742291,3sleep1736396-21diskmemload1
932633291,3sleep0736396-21diskmemload0
910617291,2sleep10-21swapper/11
899777290,3sleep20-21swapper/22
877026290,1sleep20-21swapper/22
876179291,4sleep1876191-21ssh1
859915291,3sleep0736396-21diskmemload0
851527290,5sleep1851537-21ssh1
799893290,1sleep20-21swapper/22
784336291,3sleep2784347-21ssh2
745163291,2sleep00-21swapper/00
742926291,3sleep10-21swapper/11
736379291,4sleep2736487-21date2
731412291,4sleep1731591-21expr1
722994291,4sleep1724697-21expr1
715674291,3sleep1715676-21apt-get1
711683291,3sleep1713341-21kthreadcore1
705758291,4sleep0706626-21cut0
699686291,4sleep2699758-21latency_hist2
663936291,4sleep1665431-21ps1
662845290,2sleep00-21swapper/00
652842291,3sleep2652861-21apt-get2
646523291,4sleep2642355-21/usr/sbin/munin2
628552291,4sleep1630299-21tr1
620511290,1sleep10-21swapper/11
613843291,4sleep2613895-21systemd-run2
1067147291,3sleep00-21swapper/00
1051190291,3sleep2736396-21diskmemload2
1026192291,4sleep11026340-21ls1
769473280,2sleep20-21swapper/22
716007280,4sleep00-21swapper/00
710448281,2sleep00-21swapper/00
686035281,3sleep1686361-21kthreadcore1
679053281,3sleep2679187-21tr2
677396280,1sleep10-21swapper/11
663118281,3sleep20-21swapper/22
658091280,2sleep10-21swapper/11
650688281,3sleep20-21swapper/22
646432280,1sleep10-21swapper/11
626341280,4sleep039542-21systemd-journal0
608869281,3sleep0608543-21apt-get0
1057180281,3sleep11057192-21ssh1
706627271,2sleep10-21swapper/11
704813270,1sleep10-21swapper/11
699950270,1sleep00-21swapper/00
694087270,1sleep20-21swapper/22
683738270,1sleep00-21swapper/00
679031270,2sleep10-21swapper/11
673412270,1sleep20-21swapper/22
668586270,3sleep00-21swapper/00
663339270,2sleep00-21swapper/00
659118271,2sleep20-21swapper/22
657445270,1sleep10-21swapper/11
649025271,2sleep10-21swapper/11
647630270,2sleep00-21swapper/00
642022270,1sleep00-21swapper/00
633210271,3sleep00-21swapper/00
631856270,1sleep20-21swapper/22
626033270,1sleep20-21swapper/22
622560271,2sleep10-21swapper/11
620738270,1sleep00-21swapper/00
616137271,2sleep20-21swapper/22
613499270,1sleep10-21swapper/11
724698260,2sleep2724862-21strings2
715332260,4sleep20-21swapper/22
688958260,1sleep20-21swapper/22
673425260,1sleep10-21swapper/11
632142261,2sleep1632266-21perl1
631317260,1sleep20-21swapper/22
631286260,1sleep00-21swapper/00
726427250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional