You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-04 - 01:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Aug 04, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173286021240,2sleep10-21swapper/11
1385247212360,58sleep30-21swapper/33
138525528856,12sleep10-21swapper/11
138511528163,11sleep20-21swapper/22
138508427361,6sleep00-21swapper/00
138557299257,6cyclictest66950irq/132-enp1s0-TxRx-33
138557299231,18cyclictest1853997-21chrt3
138557299221,16cyclictest0-21swapper/33
138557299211,15cyclictest0-21swapper/33
17837672201,2sleep20-21swapper/22
15489602201,4sleep21548657-21/usr/sbin/munin2
15489602201,4sleep21548657-21/usr/sbin/munin2
138557299202,15cyclictest66950irq/132-enp1s0-TxRx-33
138557299201,15cyclictest66950irq/132-enp1s0-TxRx-33
138557299201,15cyclictest0-21swapper/33
138557299201,15cyclictest0-21swapper/33
138557299200,18cyclictest0-21swapper/33
18122302191,4sleep01812450-21smartctl0
15138762192,5sleep01513901-21apt-get0
138557299199,7cyclictest1774641-21turbostat3
138557299192,5cyclictest0-21swapper/33
1385572991912,5cyclictest0-21swapper/33
1385572991912,4cyclictest0-21swapper/33
138557299191,1cyclictest0-21swapper/33
138557299191,15cyclictest0-21swapper/33
138557299191,15cyclictest0-21swapper/33
138557299191,14cyclictest66950irq/132-enp1s0-TxRx-33
138557299191,14cyclictest1423816-21taskset3
138557299191,14cyclictest0-21swapper/33
138557299191,14cyclictest0-21swapper/33
138557299191,14cyclictest0-21swapper/33
138557299190,17cyclictest0-21swapper/33
16146682180,8sleep01513483-21diskmemload0
15973012181,3sleep10-21swapper/11
1385572991812,3cyclictest0-21swapper/33
1385572991811,5cyclictest0-21swapper/33
138557299181,14cyclictest66950irq/132-enp1s0-TxRx-33
1385572991811,4cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
138557299181,14cyclictest0-21swapper/33
1385572991811,3cyclictest0-21swapper/33
138557299181,13cyclictest0-21swapper/33
138557299181,13cyclictest0-21swapper/33
138557299181,13cyclictest0-21swapper/33
138557299180,14cyclictest0-21swapper/33
16421612171,5sleep01513483-21diskmemload0
15539882171,4sleep01513483-21diskmemload0
15539882171,4sleep01513483-21diskmemload0
138557299171,13cyclictest0-21swapper/33
138557299170,14cyclictest0-21swapper/33
138557299170,14cyclictest0-21swapper/33
138557299170,13cyclictest0-21swapper/33
18351402161,4sleep11513483-21diskmemload1
17976992161,4sleep01513483-21diskmemload0
17296432161,9sleep01513483-21diskmemload0
16691902161,2sleep20-21swapper/22
16512732161,4sleep01651284-21ssh0
16232202161,4sleep11623234-21ssh1
15719902161,2sleep20-21swapper/22
1385572991614,1cyclictest0-21swapper/33
138557299161,3cyclictest0-21swapper/33
1385572991612,2cyclictest0-21swapper/33
1385572991612,2cyclictest0-21swapper/33
1385572991611,3cyclictest0-21swapper/33
138557299161,12cyclictest0-21swapper/33
138557299161,12cyclictest0-21swapper/33
138557299161,12cyclictest0-21swapper/33
138557299160,14cyclictest0-21swapper/33
138557299160,13cyclictest0-21swapper/33
138557299160,13cyclictest0-21swapper/33
18346422151,4sleep21513483-21diskmemload2
16929202150,1sleep00-21swapper/00
138557299159,4cyclictest0-21swapper/33
1385572991510,3cyclictest0-21swapper/33
138557299150,13cyclictest0-21swapper/33
138557299150,12cyclictest0-21swapper/33
17996242141,7sleep20-21swapper/22
17737512141,9sleep01773762-21ssh0
17214312141,8sleep21513483-21diskmemload2
17202962141,3sleep11513483-21diskmemload1
17025192141,7sleep01513483-21diskmemload0
15714532143,7sleep01571461-21ssh0
14975632140,1sleep00-21swapper/00
14250672141,9sleep11426137-21grep1
13979482141,9sleep01398023-21sqv0
138557299148,4cyclictest1427854-21chrt3
138557299148,3cyclictest14711702sleep33
138557299148,3cyclictest1457797-21chrt3
138557299140,2cyclictest0-21swapper/33
138557299140,12cyclictest0-21swapper/33
138557299140,11cyclictest0-21swapper/33
138557299140,11cyclictest0-21swapper/33
18713972131,7sleep21513483-21diskmemload2
18597582131,8sleep11859914-21readlink1
18207332131,5sleep20-21swapper/22
17810272131,8sleep01781041-21ssh0
17175262131,6sleep01718129-21/usr/sbin/munin0
16970002131,8sleep11697080-21/usr/sbin/munin1
15979482131,8sleep01597959-21ssh0
15727362131,8sleep11513483-21diskmemload1
14087122132,5sleep11408724-21apt-get1
1385572991311,1cyclictest0-21swapper/33
138557299130,9cyclictest1492763-21chrt3
18707052121,7sleep01870716-21ssh0
18513022121,7sleep01851547-21/usr/sbin/munin0
18054742121,7sleep11805706-21ssh1
17358032121,3sleep20-21swapper/22
16596612121,4sleep20-21swapper/22
16575202121,6sleep11657685-21sed1
16319152120,2sleep20-21swapper/22
16242512121,6sleep21513483-21diskmemload2
16239772121,7sleep01623989-21ssh0
16172312121,3sleep21617244-21ssh2
16169642123,4sleep11616978-21ssh1
15835522121,7sleep11583824-21/usr/sbin/munin1
15791862121,4sleep11579323-21find1
15643382120,3sleep11564350-21ssh1
15378362121,3sleep11537849-21sh1
15266832121,6sleep11513483-21diskmemload1
15082582121,7sleep21508423-21cut2
14772182127,2sleep2431ktimers/22
14617752121,7sleep10-21swapper/11
14556762121,5sleep11455736-21munin-run1
18681402110,2sleep11868323-21strings1
18549472110,6sleep11513483-21diskmemload1
18203952111,3sleep10-21swapper/11
18012532111,5sleep01801387-21diskstats0
18010612111,4sleep21801085-21apt-get2
17656932111,3sleep10-21swapper/11
17539152111,5sleep21753929-21ssh2
17301722111,6sleep21513483-21diskmemload2
17103402111,2sleep20-21swapper/22
17052822110,2sleep10-21swapper/11
17031712111,6sleep21703185-21ssh2
16850352112,4sleep01513483-21diskmemload0
16800032111,6sleep21680806-21kthreadcore2
16757902111,6sleep01675803-21sh0
16685932111,5sleep01513483-21diskmemload0
16582512111,3sleep00-21swapper/00
16085392111,6sleep01608550-21sshd-session0
16015722110,6sleep21602754-21grep2
15474952111,5sleep11547513-21ssh1
15473332111,4sleep01513483-21diskmemload0
15311942111,4sleep20-21swapper/22
15085322111,4sleep11508551-21apt-get1
14822202111,6sleep11481967-21sendmail-msp1
14729452111,2sleep2171rcu_preempt2
14034892112,4sleep21403508-21apt-get2
14030522110,5sleep072-21kcompactd00
13973502111,5sleep21397566-21users2
13884152111,5sleep01389666-21memory0
18788672101,3sleep00-21swapper/00
18624702100,1sleep20-21swapper/22
18603392101,4sleep01860350-21ssh0
18386442101,4sleep21838771-21irqstats2
18164712101,3sleep10-21swapper/11
17972992101,5sleep11797313-21ssh1
17911662100,1sleep10-21swapper/11
17885732101,3sleep01513483-21diskmemload0
17733272101,3sleep20-21swapper/22
17714072101,4sleep11513483-21diskmemload1
17627782100,2sleep21762789-21ssh2
17545472101,4sleep01513483-21diskmemload0
17534472101,4sleep11753644-21users1
17481462101,2sleep11748159-21rm1
17481462101,2sleep11748159-21rm1
17448662101,2sleep20-21swapper/22
17448662101,2sleep20-21swapper/22
17299122100,2sleep1171rcu_preempt1
17054302101,4sleep01705438-21apt-get0
16844292101,4sleep11513483-21diskmemload1
16766252100,3sleep10-21swapper/11
16761762101,3sleep20-21swapper/22
16619832101,4sleep11662200-21diskstats1
16520732100,1sleep20-21swapper/22
16512852101,4sleep11651299-21ssh1
16409912101,4sleep11513483-21diskmemload1
16269462100,1sleep00-21swapper/00
15974702101,4sleep21513483-21diskmemload2
15897522100,5sleep01513483-21diskmemload0
15886462101,3sleep20-21swapper/22
15747012101,4sleep01513483-21diskmemload0
15644222101,5sleep01564433-21sh0
15638842100,1sleep2171rcu_preempt2
15550782101,3sleep10-21swapper/11
15550782101,3sleep10-21swapper/11
15448552101,3sleep20-21swapper/22
15362302102,4sleep01536243-21rm0
15287742100,2sleep20-21swapper/22
15275102101,4sleep01513483-21diskmemload0
15205872101,2sleep10-21swapper/11
15199482101,4sleep21513483-21diskmemload2
14822502101,4sleep01482508-21df_inode0
14755772101,4sleep01475717-21ntp_192.168.1140
14722532101,6sleep11472943-21kthreadcore1
14485022101,5sleep01449361-21memory0
14455042101,4sleep21445501-21apt-get2
14408232101,5sleep11441949-21kthreadcore1
14349582101,4sleep01434977-21apt-get0
14249502101,4sleep01425066-21irqstats0
13982812102,4sleep11398300-21apt-get1
13982582101,4sleep21398017-21sendmail-msp2
13933012101,4sleep11393510-21hddtemp_smartct1
1879605291,4sleep11879617-21ssh1
1878633291,3sleep20-21swapper/22
1846688291,2sleep20-21swapper/22
1843624290,5sleep11843638-21ssh1
1838113291,4sleep01513483-21diskmemload0
1829411291,2sleep00-21swapper/00
1826570291,4sleep01826581-21ssh0
1812552291,4sleep21813802-21cut2
1781607291,4sleep11781621-21ssh1
1778118291,3sleep21774672-21sendmail-msp2
1765177291,2sleep00-21swapper/00
1745456291,3sleep01513483-21diskmemload0
1745456291,3sleep01513483-21diskmemload0
1737052291,3sleep00-21swapper/00
1695104291,2sleep20-21swapper/22
1692879291,2sleep10-21swapper/11
1641201291,2sleep20-21swapper/22
1626961291,3sleep11513483-21diskmemload1
1607483291,4sleep11607495-21ssh1
1579896291,2sleep20-21swapper/22
1509068291,5sleep21509411-21cut2
1497996292,3sleep10-21swapper/11
1489753291,4sleep11491311-21latency1
1482612291,4sleep21481967-21sendmail-msp2
1466457291,3sleep11466476-21apt-get1
1466251290,1sleep00-21swapper/00
1455951290,4sleep11455970-21apt-get1
1440251291,3sleep01440269-21apt-get0
1434952291,2sleep20-21swapper/22
1429719291,3sleep11429731-21apt-get1
1419142291,3sleep11419162-21apt-get1
1418218291,4sleep01418461-21/usr/sbin/munin0
1413956291,3sleep11413959-21apt-get1
1503228281,3sleep0106713-21snmpd0
1497974281,3sleep01497993-21apt-get0
1492748280,2sleep20-21swapper/22
1492183281,3sleep21492184-21sshd-session2
1461203281,2sleep01461222-21apt-get0
1456525281,3sleep21457796-21cut2
1456243280,4sleep00-21swapper/00
1450718280,2sleep00-21swapper/00
1423998280,1sleep20-21swapper/22
1419136281,3sleep01418909-21sendmail-msp0
1418475280,1sleep20-21swapper/22
1385752280,2sleep20-21swapper/22
1513323270,1sleep00-21swapper/00
1497579270,1sleep10-21swapper/11
1481804270,1sleep10-21swapper/11
1477482271,2sleep00-21swapper/00
1462857271,2sleep20-21swapper/22
1455562270,1sleep20-21swapper/22
1445482270,2sleep10-21swapper/11
1435529271,2sleep11436592-21kthreadcore1
1430379271,2sleep20-21swapper/22
1429372270,1sleep20-21swapper/22
1413301270,2sleep20-21swapper/22
1408344270,1sleep10-21swapper/11
1390183271,2sleep10-21swapper/11
1503229260,2sleep10-21swapper/11
1502910260,1sleep20-21swapper/22
1488171261,2sleep00-21swapper/00
1467025260,3sleep21467896-21kthreadcore2
1440244260,1sleep20-21swapper/22
1429711260,3sleep00-21swapper/00
1413584260,4sleep00-21swapper/00
1405307261,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional