You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 07:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Apr 29, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170614622490,3sleep11706142-21ssh1
1488604214890,54sleep30-21swapper/33
1488450211997,10sleep20-21swapper/22
148844928567,12sleep10-21swapper/11
148868528156,7sleep00-21swapper/00
1488854992219,1cyclictest0-21swapper/33
148885499221,3cyclictest0-21swapper/33
148885499221,16cyclictest0-21swapper/33
19726932211,13sleep10-21swapper/11
148885499201,15cyclictest1635106-21chrt3
148885499201,15cyclictest0-21swapper/33
148885499201,14cyclictest1501110-21taskset3
1488854992010,7cyclictest1669195-21taskset3
148885499199,7cyclictest1961641-21chrt3
148885499192,11cyclictest1918719-21taskset3
1488854991916,1cyclictest0-21swapper/33
1488854991911,5cyclictest0-21swapper/33
148885499191,15cyclictest0-21swapper/33
148885499191,14cyclictest1653748-21chrt3
148885499191,14cyclictest0-21swapper/33
148885499191,14cyclictest0-21swapper/33
148885499191,14cyclictest0-21swapper/33
148885499191,14cyclictest0-21swapper/33
148885499191,14cyclictest0-21swapper/33
148885499191,14cyclictest0-21swapper/33
148885499191,14cyclictest0-21swapper/33
148885499191,14cyclictest0-21swapper/33
148885499190,3cyclictest0-21swapper/33
148885499190,16cyclictest66950irq/132-enp1s0-TxRx-33
18806932181,4sleep01619771-21diskmemload0
15488682181,6sleep11548917-21ntpq1
1488854991815,1cyclictest0-21swapper/33
1488854991814,2cyclictest0-21swapper/33
148885499181,14cyclictest66950irq/132-enp1s0-TxRx-33
148885499181,14cyclictest0-21swapper/33
148885499181,14cyclictest0-21swapper/33
148885499181,13cyclictest0-21swapper/33
148885499181,13cyclictest0-21swapper/33
148885499181,13cyclictest0-21swapper/33
148885499181,12cyclictest0-21swapper/33
1488854991810,5cyclictest1576323-21taskset3
148885499180,16cyclictest0-21swapper/33
148885499180,15cyclictest0-21swapper/33
148885499180,15cyclictest0-21swapper/33
148885499180,14cyclictest0-21swapper/33
17587222172,8sleep21758821-21ntpq2
17281662171,4sleep21619771-21diskmemload2
17002112171,3sleep01619771-21diskmemload0
148885499176,8cyclictest1506838-21turbostat3
1488854991714,1cyclictest0-21swapper/33
148885499171,3cyclictest0-21swapper/33
1488854991713,2cyclictest0-21swapper/33
1488854991713,2cyclictest0-21swapper/33
1488854991711,3cyclictest0-21swapper/33
148885499171,13cyclictest0-21swapper/33
148885499171,13cyclictest0-21swapper/33
148885499171,13cyclictest0-21swapper/33
148885499171,13cyclictest0-21swapper/33
148885499171,13cyclictest0-21swapper/33
148885499170,14cyclictest0-21swapper/33
148885499170,13cyclictest0-21swapper/33
148885499170,13cyclictest0-21swapper/33
148885499170,13cyclictest0-21swapper/33
19463872160,2sleep00-21swapper/00
18724482161,5sleep11872715-21ssh1
18560582162,8sleep01856139-21irqstats0
18465522161,4sleep01846563-21ssh0
18056412161,3sleep20-21swapper/22
17588702161,5sleep01758910-21ntpq0
17351282161,3sleep20-21swapper/22
16776872161,3sleep00-21swapper/00
16613322161,3sleep10-21swapper/11
16529622160,3sleep10-21swapper/11
16016592160,1sleep10-21swapper/11
148885499161,13cyclictest0-21swapper/33
148885499161,12cyclictest0-21swapper/33
148885499160,14cyclictest0-21swapper/33
148885499160,13cyclictest0-21swapper/33
148885499160,13cyclictest0-21swapper/33
148885499160,10cyclictest0-21swapper/33
19275032152,7sleep21927585-21/usr/sbin/munin2
19225832151,8sleep11922641-21munin-run1
19029982151,6sleep11903012-21ssh1
19025732152,3sleep01619771-21diskmemload0
18501342152,6sleep11851168-21memory1
17778642151,2sleep00-21swapper/00
17615352150,3sleep10-21swapper/11
16841232151,1sleep00-21swapper/00
16685902152,7sleep2802-21snmpd2
1488854991512,2cyclictest0-21swapper/33
1488854991512,1cyclictest0-21swapper/33
1488854991510,4cyclictest0-21swapper/33
148885499150,13cyclictest0-21swapper/33
148885499150,12cyclictest0-21swapper/33
19615352140,2sleep20-21swapper/22
19555652147,2sleep20-21swapper/22
19450822141,4sleep11945096-21ssh1
18867532141,4sleep21886764-21ssh2
18700642141,8sleep01619771-21diskmemload0
18700642141,8sleep01619771-21diskmemload0
16915832141,4sleep01691641-21ntpq0
16537372141,9sleep21653747-21ssh2
15608582141,9sleep11560878-21grep1
15233742140,3sleep10-21swapper/11
148885499141,10cyclictest0-21swapper/33
148885499140,2cyclictest0-21swapper/33
148885499140,12cyclictest0-21swapper/33
148885499140,12cyclictest0-21swapper/33
19521602131,4sleep01952310-21awk0
19455682131,6sleep21619771-21diskmemload2
19102762131,6sleep01910337-21ntpq0
18623612131,3sleep11862373-21ssh1
18357692131,3sleep11835783-21ssh1
18045362131,3sleep11804547-21ssh1
17947802131,2sleep01619771-21diskmemload0
17131362131,8sleep21713299-21expr2
16255022131,2sleep10-21swapper/11
15919432131,8sleep21591972-21cut2
19128782121,4sleep10-21swapper/11
18965122122,6sleep10-21swapper/11
18948302121,7sleep01894840-21ssh0
18795462121,7sleep21879560-21ssh2
18275012121,7sleep11827512-21ssh1
18032502121,3sleep20-21swapper/22
17973622121,7sleep01797579-21grep0
17870792121,7sleep20-21swapper/22
17709412121,6sleep01619771-21diskmemload0
17694292121,4sleep10-21swapper/11
17427322121,3sleep21742742-21ssh2
17268632120,7sleep0151ktimers/00
17112272121,7sleep21711238-21ssh2
16666702121,6sleep00-21swapper/00
16493252121,2sleep20-21swapper/22
16284232120,8sleep01628647-21expr0
15343422121,5sleep21534551-21hddtemp_smartct2
14963632121,5sleep11496382-21apt-get1
19696042112,4sleep01619771-21diskmemload0
19356022111,5sleep01935648-21ntpq0
19141042111,5sleep21914162-21munin-run2
18608592111,3sleep20-21swapper/22
18442682111,6sleep11844277-21ssh1
18359652110,5sleep20-21swapper/22
18284062111,7sleep21828418-21rm2
18052862111,2sleep10-21swapper/11
17953052111,3sleep20-21swapper/22
17705822111,7sleep21619771-21diskmemload2
17539452110,3sleep10-21swapper/11
17528892112,4sleep21619771-21diskmemload2
17025832111,5sleep21619771-21diskmemload2
16948572111,3sleep10-21swapper/11
16765602111,4sleep21619771-21diskmemload2
16455382111,6sleep01645699-21/usr/sbin/munin0
16431422110,7sleep01619771-21diskmemload0
16426532111,2sleep20-21swapper/22
16419162110,1sleep10-21swapper/11
16280142110,7sleep21628025-21sh2
16152072111,6sleep10-21swapper/11
16141042111,6sleep11614347-21base641
16031702110,1sleep00-21swapper/00
15608802111,5sleep21561134-21df_inode2
15504502111,5sleep21550660-21hddtemp_smartct2
15391002111,6sleep01539117-21gpg-agent0
15075532111,5sleep01507657-21irqstats0
14934402111,7sleep20-21swapper/22
19650522101,4sleep21965081-21apt-get2
19621802101,3sleep01619771-21diskmemload0
19547432101,3sleep10-21swapper/11
19395102101,4sleep21939584-21munin-run2
19367742102,4sleep11919540-21kworker/u16:2+xprtiod1
19271602101,4sleep11619771-21diskmemload1
19219652100,2sleep00-21swapper/00
19198492101,2sleep20-21swapper/22
19040852101,3sleep20-21swapper/22
18713282101,3sleep20-21swapper/22
18713282101,3sleep20-21swapper/22
18684032100,5sleep11619771-21diskmemload1
18684032100,5sleep11619771-21diskmemload1
18533142100,2sleep21853328-21ssh2
18309702101,6sleep01832025-21kthreadcore0
18175742101,4sleep11817717-21ntpq1
18121752101,4sleep01619771-21diskmemload0
17860252101,5sleep01786034-21ssh0
17847592100,1sleep10-21swapper/11
17776322100,1sleep10-21swapper/11
17765202101,3sleep21619771-21diskmemload2
17528122101,4sleep01619771-21diskmemload0
17374112101,5sleep11737516-21cat1
17192042101,4sleep11619771-21diskmemload1
17182162101,3sleep01619771-21diskmemload0
17101622101,4sleep01619771-21diskmemload0
17009992101,4sleep11619771-21diskmemload1
16850272101,3sleep20-21swapper/22
16849512101,4sleep11619771-21diskmemload1
16706562101,4sleep11670682-21apt-get1
16684232101,4sleep11619771-21diskmemload1
16613702101,3sleep00-21swapper/00
16349582101,2sleep20-21swapper/22
16200532101,4sleep01619771-21diskmemload0
16054752101,5sleep11607290-21cut1
15769022101,6sleep20-21swapper/22
15756002101,4sleep01575642-21ntpq0
15721412101,5sleep11573663-21sort1
15713012100,1sleep10-21swapper/11
15667912101,6sleep21567998-21tr2
15648332101,4sleep01564922-21ntpq0
15555462101,4sleep01555801-21df0
15468072101,5sleep21548630-21kthreadcore2
15434732101,4sleep21543520-21ntpq2
15328012101,5sleep01532854-21ntp_states0
15291772101,5sleep21529247-21uname2
15284172101,4sleep01528440-21munin-run0
15219312101,4sleep21522072-21ntpq2
15088372101,5sleep21510650-21kthreadcore2
14931432101,4sleep11493200-21ntpq1
1961708290,1sleep10-21swapper/11
1922867291,3sleep01619771-21diskmemload0
1895001291,3sleep21895012-21ssh2
1887773290,1sleep10-21swapper/11
1872070290,2sleep00-21swapper/00
1852317291,3sleep01619771-21diskmemload0
1828059291,3sleep01619771-21diskmemload0
1819776291,4sleep21819787-21ssh2
1819100291,3sleep01619771-21diskmemload0
1743273291,2sleep00-21swapper/00
1737773291,3sleep11619771-21diskmemload1
1735108291,4sleep01735119-21ssh0
1726613291,3sleep10-21swapper/11
1687351290,3sleep20-21swapper/22
1619231291,4sleep01619388-21users0
1613144291,4sleep21613189-21ntpq2
1587997292,3sleep11587588-21/usr/sbin/munin1
1555802291,4sleep11555872-21/usr/sbin/munin1
1516428291,4sleep21516484-21ld2
1489026291,3sleep01489044-21apt-get0
1843975281,2sleep20-21swapper/22
1792950281,4sleep11793004-21switchtime1
1633285281,2sleep10-21swapper/11
1597732281,3sleep272-21kcompactd02
1590782281,3sleep01591538-21missed_timers0
1544778280,3sleep01544797-21apt-get0
1543583280,1sleep00-21swapper/00
1511806280,1sleep10-21swapper/11
1506467280,1sleep10-21swapper/11
1501740281,2sleep00-21swapper/00
1497005281,3sleep21498682-21kthreadcore2
1608635270,1sleep20-21swapper/22
1607732271,2sleep00-21swapper/00
1597648270,1sleep10-21swapper/11
1596913270,4sleep00-21swapper/00
1587070270,1sleep10-21swapper/11
1582812271,2sleep20-21swapper/22
1577959271,3sleep01579685-21kthreadcore0
1570974270,1sleep00-21swapper/00
1555078270,1sleep00-21swapper/00
1524624271,2sleep20-21swapper/22
1494460271,3sleep00-21swapper/00
1614349260,1sleep20-21swapper/22
1612949260,2sleep00-21swapper/00
1587040260,1sleep00-21swapper/00
1555137260,1sleep10-21swapper/11
1543351261,2sleep10-21swapper/11
1539096260,4sleep10-21swapper/11
1532514260,2sleep11532687-21strings1
1523090260,2sleep11523161-21unin-run1
1519313261,2sleep00-21swapper/00
1517172260,1sleep10-21swapper/11
1517133260,1sleep00-21swapper/00
1602277250,1sleep20-21swapper/22
1577184250,1sleep10-21swapper/11
1571732250,1sleep20-21swapper/22
1559434250,2sleep20-21swapper/22
1501968250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional