You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-02 - 15:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Thu Apr 02, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3288964212361,58sleep30-21swapper/33
328904029059,12sleep20-21swapper/22
328448928553,6sleep00-21swapper/00
328875828352,12sleep10-21swapper/11
3289185992212,5cyclictest35572032sleep33
3289185992210,9cyclictest3459958-21chrt3
35215852211,9sleep23521595-21ssh2
3289185992117,2cyclictest0-21swapper/33
328918599211,2cyclictest0-21swapper/33
328918599211,16cyclictest3548903-21taskset3
3289185992110,7cyclictest3661942-21taskset3
328918599201,16cyclictest3487277-21chrt3
328918599201,15cyclictest66950irq/132-enp1s0-TxRx-33
3289185992010,7cyclictest0-21swapper/33
328918599200,17cyclictest0-21swapper/33
33600122190,4sleep03360016-21latency_hist0
3289185991915,2cyclictest0-21swapper/33
328918599191,3cyclictest0-21swapper/33
328918599191,3cyclictest0-21swapper/33
328918599191,15cyclictest3506160-21chrt3
328918599191,15cyclictest3477461-21taskset3
328918599191,15cyclictest0-21swapper/33
328918599191,15cyclictest0-21swapper/33
328918599191,14cyclictest66950irq/132-enp1s0-TxRx-33
328918599191,14cyclictest0-21swapper/33
328918599191,14cyclictest0-21swapper/33
328918599191,14cyclictest0-21swapper/33
37482962181,11sleep13748352-21ntpq1
37271912181,13sleep23726602-21/usr/sbin/munin2
36910602181,9sleep03691067-21ssh0
36517572181,3sleep00-21swapper/00
36351652181,4sleep00-21swapper/00
3289185991814,2cyclictest0-21swapper/33
3289185991814,2cyclictest0-21swapper/33
3289185991814,2cyclictest0-21swapper/33
328918599181,14cyclictest0-21swapper/33
328918599181,14cyclictest0-21swapper/33
328918599181,14cyclictest0-21swapper/33
328918599181,14cyclictest0-21swapper/33
328918599181,14cyclictest0-21swapper/33
328918599181,14cyclictest0-21swapper/33
328918599181,13cyclictest0-21swapper/33
328918599181,13cyclictest0-21swapper/33
328918599181,13cyclictest0-21swapper/33
328918599181,13cyclictest0-21swapper/33
328918599181,13cyclictest0-21swapper/33
328918599181,13cyclictest0-21swapper/33
328918599181,13cyclictest0-21swapper/33
37413102171,3sleep00-21swapper/00
36089802171,2sleep10-21swapper/11
36079742171,3sleep00-21swapper/00
33494172171,4sleep03349436-21apt-get0
328918599171,14cyclictest0-21swapper/33
328918599171,13cyclictest0-21swapper/33
328918599171,13cyclictest0-21swapper/33
328918599171,13cyclictest0-21swapper/33
328918599171,13cyclictest0-21swapper/33
328918599171,12cyclictest0-21swapper/33
328918599170,14cyclictest0-21swapper/33
328918599170,13cyclictest0-21swapper/33
37141982161,3sleep00-21swapper/00
34962472160,5sleep13496258-21ssh1
34679432161,2sleep10-21swapper/11
33817202160,3sleep20-21swapper/22
32985622161,11sleep13299453-21kthreadcore1
328918599161,3cyclictest0-21swapper/33
3289185991611,2cyclictest0-21swapper/33
328918599161,12cyclictest0-21swapper/33
328918599160,13cyclictest0-21swapper/33
328918599160,13cyclictest0-21swapper/33
328918599160,13cyclictest0-21swapper/33
328918599160,12cyclictest0-21swapper/33
37288082150,4sleep0221rcuc/00
36878272151,2sleep10-21swapper/11
35842182151,3sleep13392116-21diskmemload1
35649412151,9sleep23392116-21diskmemload2
35070042152,4sleep23507028-21apt-get2
34982672151,10sleep03498509-21cat0
34860332151,2sleep00-21swapper/00
34142292151,8sleep13414287-21ntpq1
34068462150,1sleep00-21swapper/00
3289185991511,2cyclictest0-21swapper/33
328918599151,12cyclictest0-21swapper/33
328918599151,12cyclictest0-21swapper/33
328918599151,12cyclictest0-21swapper/33
328918599151,11cyclictest32977332sleep33
3289185991510,3cyclictest0-21swapper/33
328918599150,13cyclictest0-21swapper/33
328918599150,12cyclictest0-21swapper/33
328918599150,12cyclictest0-21swapper/33
328918599150,12cyclictest0-21swapper/33
37570602143,5sleep03757119-21ntpq0
36370322141,8sleep13392116-21diskmemload1
35931272141,3sleep23593141-21ssh2
35237042140,2sleep00-21swapper/00
34505682141,8sleep23392116-21diskmemload2
34322102141,9sleep13432469-21grep1
33506842141,9sleep13352433-21grep1
328918599148,3cyclictest3370388-21chrt3
3289185991410,2cyclictest0-21swapper/33
328918599140,12cyclictest0-21swapper/33
328918599140,11cyclictest0-21swapper/33
37482232131,8sleep03748294-21ntpq0
37078772131,2sleep20-21swapper/22
36651512131,7sleep13392116-21diskmemload1
36564762131,4sleep00-21swapper/00
35908482131,6sleep03591079-21users0
35573962131,5sleep20-21swapper/22
35391292131,8sleep23392116-21diskmemload2
35391292131,8sleep23392116-21diskmemload2
35382972131,8sleep13538308-21sh1
35382972131,8sleep13538308-21sh1
34969422130,6sleep00-21swapper/00
34691992131,6sleep00-21swapper/00
34513102131,7sleep00-21swapper/00
34053782131,7sleep23405436-21ntpq2
33754072131,8sleep03375435-21grep0
32903052131,8sleep23291849-21grep2
328918599138,3cyclictest33216352sleep33
37483542121,6sleep23748421-21ntp_states2
37395252121,5sleep13739588-21ntpq1
37118062121,5sleep13713071-21memory1
36976882120,8sleep13392116-21diskmemload1
36793652121,7sleep23679375-21ssh2
35738222121,7sleep13573825-21ssh1
35495402121,7sleep13549553-21ssh1
35476832121,2sleep03547697-21ssh0
35141322121,5sleep10-21swapper/11
35127512121,8sleep03512762-21sh0
34814492121,8sleep13483107-21tr1
34799312121,8sleep03479945-21ssh0
34778132120,4sleep23477815-21ssh2
34611642121,3sleep23461174-21ssh2
34368912121,6sleep03437025-21diskstats0
34368912121,6sleep03437025-21diskstats0
34067522121,4sleep13406765-21ssh1
33920982121,8sleep20-21swapper/22
33228982123,5sleep03323033-21kthreadcore0
33090572121,6sleep13308981-31find1
328918599120,1cyclictest0-21swapper/33
37236392111,4sleep23392116-21diskmemload2
37003662112,4sleep03700390-21apt-get0
36956342111,4sleep23695757-21ntpq2
36870222111,5sleep23687078-21ntpq2
36724302111,4sleep00-21swapper/00
36628882111,4sleep13392116-21diskmemload1
36531072110,7sleep13392116-21diskmemload1
36370992111,3sleep20-21swapper/22
36218422111,6sleep03623352-21sh0
36184482110,2sleep10-21swapper/11
36042682111,6sleep23604303-21kthreadcore2
35912412111,2sleep10-21swapper/11
35587142111,4sleep13392116-21diskmemload1
35480642111,5sleep20-21swapper/22
35294872111,4sleep13392116-21diskmemload1
35042702111,3sleep20-21swapper/22
34985102111,5sleep13498562-21ssh1
34974232111,4sleep23392116-21diskmemload2
34853722111,4sleep23392116-21diskmemload2
34695812111,3sleep20-21swapper/22
34543232111,5sleep13454545-21df_inode1
34514202111,4sleep13392116-21diskmemload1
34372502111,6sleep23437329-21ssh2
34372502111,6sleep23437329-21ssh2
34317112111,4sleep23431814-21ntpq2
34243252110,1sleep00-21swapper/00
33968152110,5sleep03396912-21ps0
33924992111,4sleep13392116-21diskmemload1
33440932111,5sleep23344352-21df_inode2
33440722112,4sleep13344090-21apt-get1
37600562101,2sleep20-21swapper/22
37578002101,3sleep13392116-21diskmemload1
37309212103,3sleep10-21swapper/11
37244812101,2sleep00-21swapper/00
37003982101,4sleep13700661-21df1
36782112101,4sleep13678270-21ntpq1
36693912101,2sleep20-21swapper/22
36593492101,4sleep23660545-21memory2
36535782101,3sleep23392116-21diskmemload2
36443032101,4sleep13392116-21diskmemload1
36435702101,6sleep03643581-21sh0
36274162100,1sleep20-21swapper/22
36264532101,3sleep13392116-21diskmemload1
36182312101,2sleep00-21swapper/00
36166892101,2sleep2171rcu_preempt2
36021352101,4sleep23392116-21diskmemload2
36008052101,5sleep13600815-21ssh1
35999262101,3sleep00-21swapper/00
35743662101,2sleep00-21swapper/00
35616312101,5sleep03563351-21kthreadcore0
35335692101,3sleep00-21swapper/00
35335692101,3sleep00-21swapper/00
35248232101,4sleep23525049-21hddtemp_smartct2
35231522101,3sleep13392116-21diskmemload1
34782582101,3sleep13392116-21diskmemload1
34437282101,4sleep13392116-21diskmemload1
34437282101,4sleep13392116-21diskmemload1
34277052101,6sleep03427937-21sh0
34262372101,3sleep20-21swapper/22
34257662101,3sleep13392116-21diskmemload1
34151612101,2sleep00-21swapper/00
33910742101,4sleep13391120-21ntpq1
33695622100,2sleep23369623-21modprobe2
33651812101,6sleep23365260-21latency_hist2
33044852103,3sleep23304572-21kthreadcore2
3741132291,2sleep20-21swapper/22
3717804291,3sleep13392116-21diskmemload1
3714832291,2sleep20-21swapper/22
3696515291,2sleep00-21swapper/00
3680400290,1sleep00-21swapper/00
3644469291,2sleep20-21swapper/22
3583998291,2sleep00-21swapper/00
3582964291,3sleep23392116-21diskmemload2
3568574291,3sleep20-21swapper/22
3566345290,1sleep10-21swapper/11
3556034291,2sleep00-21swapper/00
3524462291,4sleep00-21swapper/00
3459150291,4sleep03459165-21ssh0
3416147291,4sleep23416158-21ssh2
3338751291,4sleep23338989-21expr2
3338729291,3sleep13338748-21apt-get1
3328537293,2sleep03328911-21kthreadcore0
3323037291,4sleep13324705-21grep1
3387697280,1sleep20-21swapper/22
3386570280,2sleep10-21swapper/11
3375811280,1sleep10-21swapper/11
3352435280,4sleep20-21swapper/22
3332183280,3sleep23332231-21/usr/sbin/munin2
3326540280,1sleep20-21swapper/22
3321583280,1sleep00-21swapper/00
3309036280,3sleep03308981-31find0
3297587280,2sleep10-21swapper/11
3292269281,3sleep13291974-21/usr/sbin/munin1
3376390270,2sleep23376409-21apt-get2
3376017270,1sleep20-21swapper/22
3365107270,1sleep00-21swapper/00
3364978270,1sleep10-21swapper/11
3354734270,2sleep23354753-21apt-get2
3342925271,3sleep00-21swapper/00
3333659270,4sleep00-21swapper/00
3333358270,2sleep10-21swapper/11
3321815270,1sleep10-21swapper/11
3321153270,1sleep20-21swapper/22
3318005271,3sleep00-21swapper/00
3315809270,1sleep20-21swapper/22
3315671270,1sleep00-21swapper/00
3311361271,2sleep20-21swapper/22
3310142270,2sleep10-21swapper/11
3309795270,1sleep20-21swapper/22
3303538270,1sleep00-21swapper/00
3289580270,1sleep20-21swapper/22
3386579260,1sleep00-21swapper/00
3381129260,1sleep10-21swapper/11
3381090260,4sleep00-21swapper/00
3366015261,2sleep10-21swapper/11
3365446261,2sleep00-21swapper/00
3359516260,1sleep10-21swapper/11
3349066260,1sleep00-21swapper/00
3334266260,2sleep20-21swapper/22
3328915261,2sleep10-21swapper/11
3321540260,4sleep20-21swapper/22
3315515260,1sleep10-21swapper/11
3314063260,2sleep03314184-21ntpq0
3309848260,1sleep10-21swapper/11
3303432260,4sleep20-21swapper/22
3303426260,1sleep10-21swapper/11
3302998260,1sleep00-21swapper/00
3296343261,2sleep03296572-21unixbench_multi0
3289638260,3sleep00-21swapper/00
3391811250,3sleep00-21swapper/00
3319809250,1sleep13320133-21strings1
3302366250,2sleep20-21swapper/22
3297732250,3sleep20-21swapper/22
3297402250,1sleep00-21swapper/00
3289556250,3sleep10-21swapper/11
3309832240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional