You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 19:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Thu Jun 11, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1627197212168,49sleep30-21swapper/33
162713328656,11sleep20-21swapper/22
162691828561,16sleep00-21swapper/00
162695428050,11sleep10-21swapper/11
20432582271,2sleep10-21swapper/11
162738399235,13cyclictest0-21swapper/33
1627383992320,1cyclictest0-21swapper/33
162738399231,14cyclictest0-21swapper/33
18345572213,13sleep21834660-21/usr/sbin/munin2
1627383992117,2cyclictest0-21swapper/33
1627383992117,2cyclictest0-21swapper/33
1627383992116,3cyclictest0-21swapper/33
1627383992116,2cyclictest0-21swapper/33
162738399211,3cyclictest0-21swapper/33
1627383992017,2cyclictest0-21swapper/33
162738399201,16cyclictest0-21swapper/33
162738399201,15cyclictest0-21swapper/33
162738399201,15cyclictest0-21swapper/33
162738399200,14cyclictest0-21swapper/33
1627383991912,4cyclictest1645258-21chrt3
162738399191,15cyclictest2025051-21taskset3
162738399191,15cyclictest0-21swapper/33
162738399191,14cyclictest0-21swapper/33
162738399191,14cyclictest0-21swapper/33
162738399191,14cyclictest0-21swapper/33
162738399191,14cyclictest0-21swapper/33
162738399191,14cyclictest0-21swapper/33
1627383991910,5cyclictest2077129-21taskset3
1627383991910,5cyclictest0-21swapper/33
162738399190,17cyclictest0-21swapper/33
162738399190,17cyclictest0-21swapper/33
1627383991815,1cyclictest0-21swapper/33
1627383991813,2cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,14cyclictest0-21swapper/33
162738399181,13cyclictest0-21swapper/33
162738399181,13cyclictest0-21swapper/33
162738399181,13cyclictest0-21swapper/33
162738399181,13cyclictest0-21swapper/33
20592052174,3sleep21757928-21diskmemload2
19765692171,4sleep01976577-21ssh0
18511722171,5sleep21851306-21diskstats2
17818212171,3sleep00-21swapper/00
17658792170,8sleep20-21swapper/22
162738399179,4cyclictest1747220-21turbostat3
162738399177,6cyclictest1632682-21turbostat3
162738399171,4cyclictest0-21swapper/33
1627383991711,4cyclictest1704704-21taskset3
162738399171,14cyclictest0-21swapper/33
162738399171,13cyclictest66950irq/132-enp1s0-TxRx-33
162738399171,13cyclictest0-21swapper/33
162738399171,13cyclictest0-21swapper/33
162738399171,13cyclictest0-21swapper/33
162738399171,13cyclictest0-21swapper/33
162738399171,13cyclictest0-21swapper/33
162738399170,14cyclictest0-21swapper/33
162738399170,14cyclictest0-21swapper/33
20823922161,7sleep12078140-21/usr/sbin/munin1
20823922161,7sleep12078140-21/usr/sbin/munin1
19766392161,3sleep20-21swapper/22
18611032161,10sleep11862728-21grep1
17052812161,3sleep00-21swapper/00
16355142161,4sleep01636186-21cat0
162738399167,6cyclictest1650730-21turbostat3
162738399164,8cyclictest0-21swapper/33
1627383991611,4cyclictest0-21swapper/33
1627383991611,2cyclictest0-21swapper/33
1627383991611,2cyclictest0-21swapper/33
162738399160,13cyclictest0-21swapper/33
162738399160,13cyclictest0-21swapper/33
162738399160,13cyclictest0-21swapper/33
20505632151,9sleep01757928-21diskmemload0
20257292151,2sleep00-21swapper/00
19494962151,3sleep01757928-21diskmemload0
19344312151,2sleep10-21swapper/11
18901342151,9sleep01757928-21diskmemload0
18901342151,9sleep01757928-21diskmemload0
18403462151,3sleep01757928-21diskmemload0
16613672151,4sleep11661313-31find1
16613672151,4sleep11661313-31find1
162738399152,11cyclictest1757943-21sleep3
1627383991513,1cyclictest0-21swapper/33
162738399150,13cyclictest0-21swapper/33
162738399150,13cyclictest0-21swapper/33
162738399150,12cyclictest0-21swapper/33
20514872141,2sleep10-21swapper/11
20349922140,2sleep10-21swapper/11
20160312141,2sleep10-21swapper/11
19922702140,2sleep20-21swapper/22
19839822141,3sleep21757928-21diskmemload2
19816052141,8sleep11981668-21ntpq1
19581072141,4sleep21757928-21diskmemload2
19516532141,2sleep20-21swapper/22
19246602141,5sleep11924670-21ssh1
18498202140,2sleep20-21swapper/22
16744992141,5sleep01676334-21tr0
1627383991412,1cyclictest0-21swapper/33
162738399140,12cyclictest0-21swapper/33
162738399140,12cyclictest0-21swapper/33
20676732131,2sleep10-21swapper/11
20582442130,1sleep00-21swapper/00
20403802131,8sleep21757928-21diskmemload2
19180282130,1sleep00-21swapper/00
18891912131,8sleep21889239-21ssh2
18891912131,8sleep21889239-21ssh2
17670492131,8sleep21767127-21cut2
17246242131,6sleep01724766-21ntpq0
17159552131,8sleep21717259-21grep2
16927452131,6sleep21692791-21ntpq2
16496992131,7sleep11649748-21ntpq1
1627383991310,1cyclictest0-21swapper/33
21106372120,2sleep12110649-21ssh1
21023882121,7sleep21757928-21diskmemload2
20837422122,7sleep01757928-21diskmemload0
20837422122,7sleep01757928-21diskmemload0
20824572121,7sleep21757928-21diskmemload2
20824572121,7sleep21757928-21diskmemload2
20603342121,7sleep12060344-21ssh1
20489352121,7sleep22049040-21cat2
20241312120,2sleep21757928-21diskmemload2
20023142121,5sleep190-21kswapd01
19412902121,7sleep11941300-21ssh1
19251852121,3sleep20-21swapper/22
19192122121,4sleep01920288-21cat0
18653102121,7sleep01865320-21ssh0
18430882121,3sleep00-21swapper/00
18260292121,7sleep01826268-21cut0
18066522121,7sleep01806666-21ssh0
18043682121,6sleep11804430-21ntpq1
17667922121,6sleep11767048-21df1
17582272121,6sleep01757928-21diskmemload0
17349942121,7sleep01735468-21needreboot0
16889802121,7sleep01689188-21gltestperf0
16549492121,5sleep01655038-21ntpq0
16507202121,5sleep21650770-21munin-run2
21074642110,7sleep02107515-21ssh0
21005562110,1sleep00-21swapper/00
20931362111,3sleep10-21swapper/11
20748832111,3sleep10-21swapper/11
20669642111,4sleep01757928-21diskmemload0
20108212111,5sleep02011034-21diskstats0
19989612111,6sleep01757928-21diskmemload0
19856552111,6sleep01985666-21ssh0
19484572111,6sleep11948684-21users1
19144682111,5sleep11914536-21ntp_states1
18821012111,2sleep072-21kcompactd00
18771842111,5sleep21878046-21tr2
18747592111,3sleep00-21swapper/00
18722552111,5sleep21872354-21ntpq2
18516122111,6sleep11852913-21kthreadcore1
18309672111,4sleep20-21swapper/22
18217852111,7sleep11821786-21ssh1
17977792110,1sleep00-21swapper/00
17976002111,7sleep11797614-21ssh1
17888272111,6sleep21788838-21ssh2
17808222110,7sleep21780836-21ssh2
17804412111,6sleep11780450-21ssh1
17651942110,2sleep10-21swapper/11
17573042111,5sleep21757549-21users2
17515502111,5sleep01751591-21ntpq0
17407012111,5sleep01740708-21memory0
17367812110,4sleep11736801-21apt-get1
17289542111,4sleep21730000-21memory2
17037622111,6sleep21704003-21head2
16995152111,5sleep11699638-21diskstats1
16891892111,5sleep11689259-21irqstats1
16659412111,6sleep01665977-21ntp_kernel_pll_0
16550992111,5sleep21655153-21ntpq2
16443742111,5sleep21644423-21ntpq2
16379182111,5sleep21638877-21memory2
16349822111,5sleep11635237-21df1
16316892111,5sleep21631738-21ntpq2
21085792101,3sleep20-21swapper/22
20955442101,5sleep12097036-21cat1
20920722101,4sleep22092083-21ssh2
20907312100,4sleep00-21swapper/00
20755992101,3sleep21757928-21diskmemload2
20703622101,5sleep02071366-21grep0
20660432101,4sleep21757928-21diskmemload2
20272382101,2sleep10-21swapper/11
20023482101,5sleep22002432-21grep2
20012452101,5sleep12001257-21ssh1
19945712100,1sleep20-21swapper/22
19924032100,2sleep10-21swapper/11
19846062101,3sleep00-21swapper/00
19682792101,4sleep01757928-21diskmemload0
19669652101,4sleep21757928-21diskmemload2
19587572101,3sleep10-21swapper/11
19415652100,6sleep01757928-21diskmemload0
19338822101,4sleep01757928-21diskmemload0
19269912101,3sleep20-21swapper/22
19172142100,1sleep20-21swapper/22
19080272101,4sleep01757928-21diskmemload0
19072012101,3sleep20-21swapper/22
18952672101,5sleep01896960-21tr0
18920202100,1sleep10-21swapper/11
18920202100,1sleep10-21swapper/11
18816622100,1sleep10-21swapper/11
18640552101,4sleep21864118-21ntp_states2
18561082101,2sleep00-21swapper/00
18478232101,4sleep11757928-21diskmemload1
18392112101,4sleep11757928-21diskmemload1
18320782100,2sleep10-21swapper/11
18209072101,4sleep01821058-21ntpq0
18185482101,5sleep21820209-21tr2
18131642101,2sleep00-21swapper/00
18126152101,3sleep10-21swapper/11
17921942101,5sleep21791764-21/usr/sbin/munin2
17879732101,5sleep01788019-21cat0
17745602101,4sleep01757928-21diskmemload0
17569362101,5sleep01756982-21ntpq0
16613172101,5sleep01661326-40gst-plugin-scan0
16613172101,5sleep01661326-40gst-plugin-scan0
16442322100,5sleep11644373-21ntpq1
2036806291,4sleep02038356-21cut0
2032553291,3sleep20-21swapper/22
2016183291,3sleep21757928-21diskmemload2
2008116291,3sleep01757928-21diskmemload0
1974963291,2sleep10-21swapper/11
1960550291,3sleep11757928-21diskmemload1
1958543291,2sleep00-21swapper/00
1942113291,3sleep21757928-21diskmemload2
1908142291,3sleep11757928-21diskmemload1
1900655291,3sleep11757928-21diskmemload1
1899648291,2sleep20-21swapper/22
1874240291,2sleep10-21swapper/11
1814103291,4sleep21814114-21ssh2
1802168291,3sleep21803832-21tr2
1787771291,4sleep11787863-21ps1
1746187291,4sleep01746211-21ntpq0
1737596291,5sleep21739237-21kthreadcore2
1731988291,4sleep21733191-21cut2
1724767291,4sleep11724813-21ntpq1
1721979291,4sleep21723688-21cut2
1699089291,4sleep21699318-21cat2
1698954291,4sleep11698955-21sshd1
1671990290,1sleep10-21swapper/11
1671196291,4sleep21671256-21ntpq2
1651542291,4sleep11652436-21grep1
2027324280,1sleep00-21swapper/00
1755024281,4sleep11752839-21/usr/sbin/munin1
1751593280,4sleep11751645-21ld1
1747197280,2sleep10-21swapper/11
1727243281,3sleep11728165-21kthreadcore1
1726628281,4sleep01727239-21kthreadcore0
1715383281,3sleep11715402-21apt-get1
1710617281,3sleep21712079-21kthreadcore2
1709095280,1sleep20-21swapper/22
1681908281,3sleep21681959-21/usr/sbin/munin2
1677851281,3sleep10-21swapper/11
1677829280,3sleep01677848-21apt-get0
1676776280,4sleep20-21swapper/22
1747479270,1sleep20-21swapper/22
1714932270,1sleep00-21swapper/00
1710035270,2sleep10-21swapper/11
1709690270,1sleep10-21swapper/11
1699922271,3sleep00-21swapper/00
1698943270,1sleep00-21swapper/00
1688141270,1sleep10-21swapper/11
1688100270,1sleep00-21swapper/00
1672797271,3sleep11673008-21hddtemp_smartct1
1671974270,1sleep00-21swapper/00
1746862260,1sleep20-21swapper/22
1731414260,1sleep10-21swapper/11
1720452260,2sleep00-21swapper/00
1683105260,4sleep20-21swapper/22
1666669260,1sleep20-21swapper/22
1661348260,1sleep20-21swapper/22
1661348260,1sleep20-21swapper/22
1645182260,1sleep00-21swapper/00
1627867260,2sleep00-21swapper/00
1627571260,2sleep10-21swapper/11
1649557250,1sleep00-21swapper/00
1662092240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional