You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 09:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri Jun 12, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
709192212651,70sleep30-21swapper/33
709192212651,70sleep30-21swapper/33
70925428462,12sleep10-21swapper/11
70925428462,12sleep10-21swapper/11
70911828466,12sleep20-21swapper/22
70911828466,12sleep20-21swapper/22
70893828255,19sleep00-21swapper/00
70893828255,19sleep00-21swapper/00
9935242280,1sleep2993525-21cat2
709385992523,1cyclictest0-21swapper/33
70938599211,17cyclictest66950irq/132-enp1s0-TxRx-33
70938599211,16cyclictest1059340-21taskset3
70938599210,18cyclictest66950irq/132-enp1s0-TxRx-33
70938599202,13cyclictest1101743-21taskset3
70938599201,16cyclictest0-21swapper/33
70938599201,14cyclictest1183053-21taskset3
70938599201,14cyclictest0-21swapper/33
9892212191,3sleep20-21swapper/22
70938599193,11cyclictest992956-21taskset3
70938599191,15cyclictest0-21swapper/33
70938599191,15cyclictest0-21swapper/33
70938599191,15cyclictest0-21swapper/33
70938599191,14cyclictest0-21swapper/33
70938599191,14cyclictest0-21swapper/33
70938599191,14cyclictest0-21swapper/33
70938599191,14cyclictest0-21swapper/33
70938599191,13cyclictest925512-21chrt3
709385991910,6cyclictest1191018-21taskset3
70938599183,3cyclictest1016420-21taskset3
709385991814,2cyclictest0-21swapper/33
709385991811,5cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,14cyclictest0-21swapper/33
70938599181,13cyclictest66950irq/132-enp1s0-TxRx-33
70938599181,13cyclictest0-21swapper/33
70938599181,13cyclictest0-21swapper/33
70938599181,13cyclictest0-21swapper/33
70938599181,13cyclictest0-21swapper/33
70938599180,13cyclictest0-21swapper/33
70938599180,12cyclictest0-21swapper/33
8902772171,5sleep1840181-21diskmemload1
70938599172,10cyclictest1123365-21taskset3
70938599171,4cyclictest896077-21taskset3
709385991712,3cyclictest0-21swapper/33
709385991712,2cyclictest0-21swapper/33
709385991711,4cyclictest0-21swapper/33
70938599171,13cyclictest0-21swapper/33
70938599171,13cyclictest0-21swapper/33
70938599171,13cyclictest0-21swapper/33
70938599170,14cyclictest0-21swapper/33
70938599170,14cyclictest0-21swapper/33
70938599170,14cyclictest0-21swapper/33
70938599170,14cyclictest0-21swapper/33
10589432171,3sleep20-21swapper/22
9676852160,1sleep10-21swapper/11
8981222161,9sleep00-21swapper/00
709385991613,2cyclictest0-21swapper/33
709385991613,1cyclictest0-21swapper/33
70938599161,12cyclictest0-21swapper/33
70938599160,13cyclictest0-21swapper/33
70938599160,13cyclictest0-21swapper/33
70938599160,13cyclictest0-21swapper/33
70938599160,13cyclictest0-21swapper/33
70938599160,13cyclictest0-21swapper/33
11927802160,3sleep20-21swapper/22
9001642151,4sleep0840181-21diskmemload0
8826722152,9sleep2882682-21ssh2
70938599150,13cyclictest0-21swapper/33
70938599150,13cyclictest0-21swapper/33
70938599150,12cyclictest0-21swapper/33
70938599150,12cyclictest0-21swapper/33
70938599150,12cyclictest0-21swapper/33
11827132151,8sleep2840181-21diskmemload2
11081472151,3sleep1840181-21diskmemload1
10642522151,4sleep21064298-21ssh2
10083522150,1sleep00-21swapper/00
9562182141,8sleep20-21swapper/22
8800832141,2sleep00-21swapper/00
8662562141,8sleep0840181-21diskmemload0
7964622141,9sleep0796513-21ntpq0
70938599140,12cyclictest0-21swapper/33
70938599140,12cyclictest0-21swapper/33
70938599140,12cyclictest0-21swapper/33
11830272145,4sleep1331ktimers/11
11516482141,4sleep1840181-21diskmemload1
11102702141,2sleep20-21swapper/22
10500842141,3sleep1840181-21diskmemload1
9907262130,2sleep00-21swapper/00
9322452130,1sleep20-21swapper/22
9142212130,3sleep0840181-21diskmemload0
8790842131,6sleep1879138-21ntpq1
7651642132,6sleep2765183-21apt-get2
70938599130,2cyclictest0-21swapper/33
70938599130,10cyclictest7753212sleep33
11932932131,7sleep10-21swapper/11
11648972131,8sleep21164955-21ntpq2
11256112131,8sleep21125625-21ssh2
10906512131,3sleep01090661-21ssh0
10739522131,6sleep272-21kcompactd02
10235562131,6sleep0840181-21diskmemload0
9339042121,7sleep1933918-21ssh1
9128672121,5sleep1912916-21ntpq1
8988982121,7sleep1840181-21diskmemload1
8625512121,5sleep2862748-21users2
8557312120,7sleep0840181-21diskmemload0
7208102121,5sleep2720951-21ntpq2
11710202125,3sleep20-21swapper/22
11587542121,5sleep0840181-21diskmemload0
11145192121,6sleep11114569-21ntpq1
10815532121,6sleep01081563-21ssh0
10677432121,6sleep1840181-21diskmemload1
10514692122,4sleep11051491-21apt-get1
10419522121,7sleep11041963-21ssh1
10316402121,7sleep21031651-21ssh2
10263632121,7sleep01026424-21ssh0
10081702120,7sleep11008180-21ssh1
10067042121,5sleep2840181-21diskmemload2
9732042111,6sleep2973215-21sh2
9726622110,5sleep00-21swapper/00
9571142111,6sleep1957124-21ssh1
9552782111,7sleep0955321-21ssh0
9419902111,1sleep00-21swapper/00
9389312111,4sleep2840181-21diskmemload2
8976982111,5sleep20-21swapper/22
8888962111,4sleep2840181-21diskmemload2
8477682111,3sleep00-21swapper/00
8405582112,3sleep134-21ksoftirqd/11
11860042111,6sleep01186195-21expr0
11817672111,5sleep01181815-21ntpq0
11660192110,2sleep00-21swapper/00
11187532112,4sleep01118777-21apt-get0
10918942111,2sleep10-21swapper/11
10605872112,6sleep01061552-21kthreadcore0
10576692111,5sleep0840181-21diskmemload0
10417342111,3sleep20-21swapper/22
10112532111,6sleep11012981-21cut1
10097152111,5sleep0840181-21diskmemload0
10002862111,3sleep10-21swapper/11
9982052101,2sleep00-21swapper/00
9893602101,4sleep1840181-21diskmemload1
9838962101,3sleep2840181-21diskmemload2
9836582101,3sleep00-21swapper/00
9812972101,4sleep1840181-21diskmemload1
9659382101,4sleep2840181-21diskmemload2
9645802101,3sleep00-21swapper/00
9497012101,4sleep1840181-21diskmemload1
9258112101,4sleep1840181-21diskmemload1
9173312101,4sleep0917447-21perl0
9135482101,3sleep2840181-21diskmemload2
8738102101,3sleep10-21swapper/11
8716672101,2sleep20-21swapper/22
8646152100,3sleep00-21swapper/00
8574532101,2sleep20-21swapper/22
8294692101,3sleep2829451-21fwupd2
8285182101,4sleep0828575-21ntp_states0
7977312101,5sleep0797750-21apt-get0
7856292101,4sleep2785838-21users2
7855182101,5sleep1785627-21grep1
7692912101,4sleep0769347-21ntp_states0
7633632101,5sleep1763823-21cut1
7278802101,4sleep0727899-21apt-get0
7273462101,4sleep2727371-21munin-run2
7110712102,4sleep0712843-21cut0
11662112101,6sleep1840181-21diskmemload1
11426742101,5sleep11142681-21ssh1
11357422100,4sleep20-21swapper/22
11357182101,4sleep0840181-21diskmemload0
11324702101,4sleep2840181-21diskmemload2
11323542101,3sleep0840181-21diskmemload0
11177952100,6sleep01117806-21ssh0
11069192102,3sleep00-21swapper/00
11017102101,3sleep21101735-21apt-get2
10985762101,3sleep0840181-21diskmemload0
10931992100,1sleep10-21swapper/11
10849572101,2sleep20-21swapper/22
10844742101,2sleep20-21swapper/22
10828242100,5sleep10-21swapper/11
10739902101,4sleep1840181-21diskmemload1
10685542101,4sleep0840181-21diskmemload0
10506882101,4sleep0840181-21diskmemload0
10431792101,5sleep21043344-21/usr/sbin/munin2
10401572101,4sleep0840181-21diskmemload0
10243852101,3sleep10-21swapper/11
959225291,5sleep1959325-21cpuspeed_turbos1
946721291,4sleep21-21systemd2
922954290,1sleep10-21swapper/11
917040291,3sleep2917060-21apt-get2
905721290,6sleep1905731-21sh1
904987291,4sleep2905120-21users2
883283291,4sleep0883439-21cat0
863214290,1sleep10-21swapper/11
849357291,3sleep1840181-21diskmemload1
846997290,4sleep20-21swapper/22
829767290,4sleep2829785-21apt-get2
818823291,4sleep1818994-21latency_hist1
808974291,4sleep2809985-21grep2
806218291,4sleep1806997-21wc1
791533290,1sleep00-21swapper/00
785221291,4sleep0785269-21ntpq0
763824290,4sleep2763870-21ntpq2
759438290,6sleep00-21swapper/00
747894290,4sleep2421rcuc/22
721060291,3sleep172-21kcompactd01
1174334290,6sleep11174345-21sh1
1173271291,4sleep01173369-21ntpq0
1157598290,1sleep10-21swapper/11
1152335291,1sleep20-21swapper/22
1149424291,5sleep01149437-21diskmemload0
1143816291,2sleep20-21swapper/22
1133397291,4sleep11133407-21ssh1
1099310290,1sleep20-21swapper/22
1033106291,2sleep10-21swapper/11
1023230291,2sleep20-21swapper/22
1015837290,2sleep20-21swapper/22
947905281,2sleep00-21swapper/00
930532280,3sleep00-21swapper/00
817862281,2sleep2817907-21ntpq2
808406281,2sleep10-21swapper/11
786743281,3sleep1786223-21apt-get1
780160280,1sleep00-21swapper/00
779931282,3sleep1779995-21modprobe1
754037280,2sleep20-21swapper/22
738079280,2sleep20-21swapper/22
728452281,3sleep1729939-21kthreadcore1
721001281,3sleep0721058-21ntpq0
1123723281,2sleep10-21swapper/11
840166270,3sleep1840207-21ssh1
835654271,3sleep00-21swapper/00
823230271,3sleep20-21swapper/22
819651271,2sleep00-21swapper/00
802449270,2sleep20-21swapper/22
797275270,1sleep20-21swapper/22
780681270,1sleep20-21swapper/22
771056271,2sleep20-21swapper/22
748832270,1sleep10-21swapper/11
743566271,2sleep10-21swapper/11
743392270,4sleep00-21swapper/00
738829271,2sleep2739036-21smartctl2
734774271,2sleep10-21swapper/11
733770271,2sleep00-21swapper/00
714447270,1sleep10-21swapper/11
834746260,4sleep00-21swapper/00
834597260,1sleep10-21swapper/11
819140261,2sleep10-21swapper/11
813732261,2sleep00-21swapper/00
806998261,1sleep20-21swapper/22
804467260,2sleep0806215-21kthreadcore0
801800261,2sleep10-21swapper/11
787344261,2sleep20-21swapper/22
775402260,1sleep00-21swapper/00
770900260,2sleep10-21swapper/11
759360260,1sleep10-21swapper/11
759264260,4sleep20-21swapper/22
749182260,2sleep10-21swapper/11
731993261,2sleep20-21swapper/22
725081261,2sleep00-21swapper/00
713478260,2sleep20-21swapper/22
835374250,1sleep20-21swapper/22
828847250,1sleep10-21swapper/11
808126250,1sleep00-21swapper/00
792408250,1sleep10-21swapper/11
769064250,1sleep10-21swapper/11
764552250,3sleep0151ktimers/00
753000250,2sleep0753172-21strings0
743872250,1sleep00-21swapper/00
722245240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional