You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 06:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 23, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1516865212854,68sleep30-21swapper/33
151601328553,7sleep10-21swapper/11
151668028455,11sleep20-21swapper/22
151665327854,16sleep00-21swapper/00
151710299211,16cyclictest0-21swapper/33
151710299211,16cyclictest0-21swapper/33
151710299202,14cyclictest1938462-21turbostat3
151710299202,12cyclictest1545540-21taskset3
1517102992012,6cyclictest0-21swapper/33
151710299201,16cyclictest0-21swapper/33
151710299201,15cyclictest0-21swapper/33
151710299201,15cyclictest0-21swapper/33
1517102991914,3cyclictest66950irq/132-enp1s0-TxRx-33
1517102991912,4cyclictest0-21swapper/33
151710299191,15cyclictest0-21swapper/33
151710299191,15cyclictest0-21swapper/33
151710299191,14cyclictest1628923-21taskset3
151710299191,14cyclictest0-21swapper/33
151710299191,14cyclictest0-21swapper/33
151710299191,12cyclictest0-21swapper/33
1517102991910,6cyclictest1803028-21taskset3
151710299190,15cyclictest1576665-21sleep3
19265802181,3sleep00-21swapper/00
18923072180,2sleep00-21swapper/00
18601202180,2sleep11644711-21diskmemload1
16507782181,4sleep21644711-21diskmemload2
16274272181,12sleep01627966-21cut0
151710299185,10cyclictest15659432sleep33
151710299182,14cyclictest66950irq/132-enp1s0-TxRx-33
1517102991815,1cyclictest0-21swapper/33
151710299181,4cyclictest0-21swapper/33
1517102991813,2cyclictest0-21swapper/33
151710299181,14cyclictest1720295-21taskset3
151710299181,14cyclictest0-21swapper/33
151710299181,14cyclictest0-21swapper/33
151710299181,14cyclictest0-21swapper/33
151710299181,14cyclictest0-21swapper/33
151710299181,14cyclictest0-21swapper/33
151710299181,14cyclictest0-21swapper/33
151710299181,13cyclictest0-21swapper/33
151710299181,13cyclictest0-21swapper/33
151710299181,12cyclictest1736988-21chrt3
151710299180,15cyclictest0-21swapper/33
151710299180,15cyclictest0-21swapper/33
19797302171,2sleep20-21swapper/22
19518512171,3sleep01947127-21/usr/sbin/munin0
18503902171,2sleep00-21swapper/00
17838042172,10sleep01644711-21diskmemload0
17526822171,3sleep10-21swapper/11
17276082171,11sleep01644711-21diskmemload0
15978162172,4sleep01597839-21apt-get0
151710299178,6cyclictest1623731-21turbostat3
151710299173,10cyclictest1631314-21taskset3
151710299172,13cyclictest0-21swapper/33
151710299172,10cyclictest1729222-21taskset3
151710299171,3cyclictest0-21swapper/33
151710299171,14cyclictest0-21swapper/33
1517102991711,3cyclictest0-21swapper/33
151710299171,13cyclictest0-21swapper/33
151710299171,13cyclictest0-21swapper/33
151710299171,13cyclictest0-21swapper/33
151710299171,13cyclictest0-21swapper/33
151710299171,13cyclictest0-21swapper/33
151710299171,13cyclictest0-21swapper/33
151710299171,12cyclictest0-21swapper/33
151710299171,12cyclictest0-21swapper/33
151710299170,14cyclictest0-21swapper/33
151710299170,14cyclictest0-21swapper/33
19170042161,4sleep01644711-21diskmemload0
19032162161,10sleep11903248-21ssh1
19032162161,10sleep11903248-21ssh1
18602142161,5sleep01860227-21sh0
17941222161,2sleep20-21swapper/22
17294912161,11sleep01731082-21tr0
16504592161,4sleep01644711-21diskmemload0
15870842161,9sleep21587111-21munin-run2
151710299169,4cyclictest0-21swapper/33
1517102991613,1cyclictest0-21swapper/33
1517102991611,3cyclictest0-21swapper/33
151710299160,13cyclictest0-21swapper/33
19611992150,2sleep20-21swapper/22
19458662151,2sleep00-21swapper/00
18455072151,9sleep11845633-21irqstats1
17257992151,4sleep11644711-21diskmemload1
1517102991512,2cyclictest0-21swapper/33
151710299150,12cyclictest0-21swapper/33
151710299150,11cyclictest0-21swapper/33
19867262141,8sleep21644711-21diskmemload2
19607082141,6sleep10-21swapper/11
18750572141,8sleep01644711-21diskmemload0
17451852140,1sleep00-21swapper/00
151710299148,4cyclictest1611511-21chrt3
1517102991412,1cyclictest0-21swapper/33
1517102991412,1cyclictest0-21swapper/33
1517102991410,2cyclictest0-21swapper/33
151710299140,12cyclictest0-21swapper/33
151710299140,11cyclictest0-21swapper/33
19859152130,3sleep11644711-21diskmemload1
19438672131,7sleep11644711-21diskmemload1
19344332131,8sleep21934512-21ssh2
19263522131,7sleep11926367-21ssh1
18750202131,7sleep11644711-21diskmemload1
18264002131,8sleep21826410-21ssh2
18117192132,6sleep11811745-21apt-get1
18083272131,3sleep21808337-21ssh2
16932012130,4sleep21693215-21ssh2
16774092131,6sleep00-21swapper/00
16767072131,8sleep21676716-21sh2
16680412131,7sleep11668055-21ssh1
16033422131,8sleep11603529-21head1
1517102991311,1cyclictest0-21swapper/33
151710299130,10cyclictest15451232sleep33
19965502121,7sleep1321rcuc/11
19864852120,2sleep0171rcu_preempt0
19527922120,8sleep21952805-21sh2
19246802121,5sleep21644711-21diskmemload2
19120802121,7sleep11913580-21cut1
18848102121,7sleep21884820-21ssh2
18673522121,6sleep01644711-21diskmemload0
18588652121,6sleep21644711-21diskmemload2
18418582121,7sleep21841868-21ssh2
18338212121,2sleep01833828-21ssh0
18016832121,7sleep21801697-21ssh2
17956892121,7sleep01795776-21kernelversion0
17670562121,2sleep01767068-21ssh0
17419042121,6sleep01644711-21diskmemload0
17278182120,8sleep21727828-21ssh2
17188092121,5sleep10-21swapper/11
17170302121,6sleep21644711-21diskmemload2
16991472121,7sleep11699275-21grep1
16936052121,5sleep01644711-21diskmemload0
15416472121,7sleep01543326-21cut0
15298362121,3sleep11530045-21expr1
19945932110,1sleep00-21swapper/00
19472242111,5sleep11947434-21diskstats1
19371552111,2sleep00-21swapper/00
19303342111,5sleep11930358-21ssh1
19019562110,2sleep21901967-21ssh2
18685262111,3sleep10-21swapper/11
18676012111,2sleep20-21swapper/22
18251602111,3sleep00-21swapper/00
18029532111,5sleep11644711-21diskmemload1
17939662111,3sleep10-21swapper/11
17918002111,3sleep00-21swapper/00
17752072111,4sleep01644711-21diskmemload0
17604732111,5sleep21760484-21ssh2
17583282110,1sleep00-21swapper/00
17578362111,5sleep11757978-21sensors_temp1
17369582111,3sleep20-21swapper/22
17097512111,3sleep20-21swapper/22
17027012111,3sleep00-21swapper/00
16852612110,7sleep01685274-21sh0
16597982111,4sleep01644711-21diskmemload0
16478662111,4sleep11644711-21diskmemload1
16438042110,6sleep21643917-21ps2
16295462111,5sleep01629758-21hddtemp_smartct0
16215662111,5sleep21622631-21memory2
16135672111,5sleep11613828-21df_inode1
16082852111,4sleep01608304-21apt-get0
16035302111,5sleep21603621-21irqstats2
15713762111,5sleep11571414-21munin-run1
15504542111,6sleep139542-21systemd-journal1
15455182111,4sleep21545537-21apt-get2
19886662101,4sleep21988689-21apt-get2
19772612101,2sleep10-21swapper/11
19686802101,2sleep20-21swapper/22
19631342101,4sleep01644711-21diskmemload0
19109762100,1sleep20-21swapper/22
19109762100,1sleep20-21swapper/22
19106992101,4sleep01644711-21diskmemload0
19106992101,4sleep01644711-21diskmemload0
19014322101,3sleep11644711-21diskmemload1
18937662100,1sleep10-21swapper/11
18929402101,3sleep20-21swapper/22
18834642101,4sleep01644711-21diskmemload0
18747512101,2sleep20-21swapper/22
18500422101,2sleep20-21swapper/22
18426222101,3sleep10-21swapper/11
18366192100,3sleep00-21swapper/00
18354872102,3sleep21835497-21ssh2
18349052101,3sleep10-21swapper/11
18205292101,5sleep11820615-21kernelversion1
18170172101,3sleep21644711-21diskmemload2
18165142101,4sleep01644711-21diskmemload0
18034452102,3sleep01803447-21apt-get0
17841632101,2sleep20-21swapper/22
17760342101,3sleep21644711-21diskmemload2
17750782101,2sleep10-21swapper/11
17696342101,2sleep20-21swapper/22
17620052102,4sleep11762002-21apt-get1
17515262101,3sleep20-21swapper/22
17418732101,3sleep11644711-21diskmemload1
17354532101,4sleep21644711-21diskmemload2
17186512100,4sleep01644711-21diskmemload0
17083682101,4sleep11644711-21diskmemload1
17018742101,2sleep20-21swapper/22
16935162101,2sleep10-21swapper/11
16837452101,2sleep10-21swapper/11
16832492100,2sleep20-21swapper/22
16753662100,1sleep10-21swapper/11
16667822101,3sleep21644711-21diskmemload2
16591112100,1sleep20-21swapper/22
15998532101,5sleep21599918-21kthreadcore2
15984022103,4sleep11599851-21cut1
15926202101,5sleep11592730-21tr1
15925982100,4sleep01592617-21apt-get0
15835292101,5sleep11585227-21kthreadcore1
15716972100,6sleep21571948-21cstates2
15298142101,3sleep072-21kcompactd00
15203902100,1sleep20-21swapper/22
1979294291,2sleep00-21swapper/00
1967767291,4sleep01967878-21ssh0
1964360291,4sleep11965293-21grep1
1943738291,2sleep20-21swapper/22
1918339291,2sleep20-21swapper/22
1899985290,1sleep00-21swapper/00
1878208290,5sleep11877872-21apt-get1
1808615291,3sleep11808625-21ssh1
1784846290,1sleep10-21swapper/11
1733446291,4sleep11644711-21diskmemload1
1703416291,2sleep00-21swapper/00
1667191291,2sleep00-21swapper/00
1658596290,2sleep10-21swapper/11
1639180290,1sleep10-21swapper/11
1634511291,2sleep00-21swapper/00
1618343290,2sleep20-21swapper/22
1604774291,4sleep01606492-21cut0
1565941290,1sleep10-21swapper/11
1528000291,4sleep01528497-21grep0
1525123291,4sleep21526283-21cut2
1639760280,2sleep10-21swapper/11
1629254280,2sleep10-21swapper/11
1628921280,1sleep10-21swapper/11
1624589281,3sleep21624624-21kthreadcore2
1619327281,3sleep01619915-21kthreadcore0
1613250280,4sleep11613316-21sendmail-msp1
1609811281,3sleep21610384-21kthreadcore2
1588466281,3sleep21590110-21kthreadcore2
1587909280,5sleep11588463-21kthreadcore1
1587358281,2sleep00-21swapper/00
1576908280,2sleep00-21swapper/00
1576313280,1sleep00-21swapper/00
1571676280,2sleep10-21swapper/11
1566986281,3sleep20-21swapper/22
1552379281,3sleep21554095-21kthreadcore2
1551325281,3sleep11552377-21kthreadcore1
1547447281,3sleep01549216-21kthreadcore0
1545243281,3sleep20-21swapper/22
1539823280,1sleep20-21swapper/22
1535330281,3sleep11535454-21perl1
1638654271,3sleep21638793-21sort2
1634058270,1sleep20-21swapper/22
1582691271,2sleep00-21swapper/00
1561208270,3sleep00-21swapper/00
1560646270,1sleep00-21swapper/00
1560548270,1sleep20-21swapper/22
1554682270,1sleep00-21swapper/00
1544997272,3sleep1331ktimers/11
1536470271,2sleep00-21swapper/00
1534435270,1sleep20-21swapper/22
1524552270,2sleep10-21swapper/11
1644336260,1sleep00-21swapper/00
1594475261,2sleep20-21swapper/22
1576678260,3sleep10-21swapper/11
1570682261,2sleep00-21swapper/00
1566022260,1sleep20-21swapper/22
1557390261,2sleep10-21swapper/11
1517844261,2sleep00-21swapper/00
1517270260,1sleep10-21swapper/11
1618800250,1sleep10-21swapper/11
1618147250,3sleep00-21swapper/00
1578993250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional