You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 20:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat May 23, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
281438222280,1sleep22814379-21perf2
2726354212254,63sleep30-21swapper/33
312877921170,2sleep20-21swapper/22
272582628456,16sleep10-21swapper/11
272625628354,11sleep20-21swapper/22
272154127955,17sleep00-21swapper/00
30689752340,2sleep20-21swapper/22
313753522312,7sleep13137549-21apt-get1
27344202231,17sleep12734543-21diskstats1
272671299231,17cyclictest0-21swapper/33
272671299212,16cyclictest66950irq/132-enp1s0-TxRx-33
272671299211,16cyclictest2908081-21taskset3
272671299211,16cyclictest0-21swapper/33
2726712992016,3cyclictest66950irq/132-enp1s0-TxRx-33
2726712992012,4cyclictest2978925-21taskset3
272671299201,16cyclictest0-21swapper/33
272671299201,16cyclictest0-21swapper/33
272671299201,16cyclictest0-21swapper/33
272671299201,15cyclictest66950irq/132-enp1s0-TxRx-33
272671299201,15cyclictest0-21swapper/33
2726712992010,7cyclictest2914994-21taskset3
272671299200,18cyclictest0-21swapper/33
32059412190,1sleep20-21swapper/22
272671299191,15cyclictest0-21swapper/33
272671299191,15cyclictest0-21swapper/33
272671299191,14cyclictest0-21swapper/33
272671299191,14cyclictest0-21swapper/33
272671299191,14cyclictest0-21swapper/33
272671299191,14cyclictest0-21swapper/33
31614552180,6sleep2431ktimers/22
27595872181,12sleep12759728-21ntpq1
272671299189,6cyclictest2744712-21turbostat3
272671299187,1cyclictest0-21swapper/33
2726712991815,1cyclictest0-21swapper/33
2726712991812,3cyclictest0-21swapper/33
2726712991811,5cyclictest30062822chrt3
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,14cyclictest0-21swapper/33
272671299181,13cyclictest0-21swapper/33
272671299181,13cyclictest0-21swapper/33
272671299180,16cyclictest0-21swapper/33
32162042172,8sleep03216476-21df_inode0
31900262172,5sleep23190050-21apt-get2
31900262172,5sleep23190050-21apt-get2
31699222171,4sleep02857293-21diskmemload0
30846612170,1sleep00-21swapper/00
30214812171,2sleep20-21swapper/22
29536562171,3sleep20-21swapper/22
272671299178,5cyclictest2835697-21turbostat3
2726712991712,4cyclictest0-21swapper/33
272671299171,13cyclictest0-21swapper/33
272671299171,13cyclictest0-21swapper/33
272671299171,13cyclictest0-21swapper/33
272671299171,13cyclictest0-21swapper/33
272671299171,13cyclictest0-21swapper/33
272671299170,15cyclictest0-21swapper/33
30994612161,7sleep13099467-21ssh1
29860842160,4sleep00-21swapper/00
29317552162,5sleep12931803-21ntpq1
29253542160,1sleep20-21swapper/22
272671299161,3cyclictest0-21swapper/33
2726712991613,1cyclictest0-21swapper/33
2726712991612,2cyclictest0-21swapper/33
272671299161,12cyclictest2798081-21chrt3
272671299161,12cyclictest0-21swapper/33
272671299160,14cyclictest0-21swapper/33
272671299160,13cyclictest0-21swapper/33
272671299160,13cyclictest0-21swapper/33
272671299160,13cyclictest0-21swapper/33
272671299160,13cyclictest0-21swapper/33
272671299160,13cyclictest0-21swapper/33
31954572152,3sleep02857293-21diskmemload0
31954572152,3sleep02857293-21diskmemload0
31442542151,3sleep20-21swapper/22
31200012151,9sleep02857293-21diskmemload0
30831162151,3sleep10-21swapper/11
30387802151,10sleep13038794-21ssh1
29905782151,6sleep22992279-21tr2
29674502151,9sleep22857293-21diskmemload2
272671299159,3cyclictest28142722sleep33
272671299158,4cyclictest0-21swapper/33
272671299157,6cyclictest3207813-21taskset3
2726712991512,2cyclictest0-21swapper/33
272671299151,10cyclictest2824086-21taskset3
272671299150,13cyclictest0-21swapper/33
272671299150,13cyclictest0-21swapper/33
272671299150,12cyclictest0-21swapper/33
31866672141,9sleep03186681-21ssh0
31865322141,4sleep13186543-21ssh1
31705432141,2sleep12857293-21diskmemload1
31688812141,2sleep20-21swapper/22
31011622141,3sleep23101175-21ssh2
30931422141,3sleep12857293-21diskmemload1
30921312141,8sleep02857293-21diskmemload0
30921032141,2sleep20-21swapper/22
30569052141,4sleep23056916-21ssh2
30217752141,3sleep12857293-21diskmemload1
29790982141,2sleep10-21swapper/11
29779362141,9sleep02977950-21ssh0
29579062141,2sleep10-21swapper/11
31352462131,2sleep00-21swapper/00
31274662131,8sleep23127480-21ssh2
30837252131,3sleep23083736-21ssh2
30744622131,8sleep13074472-21ssh1
30667922131,6sleep02857293-21diskmemload0
30553112131,3sleep03055325-21ssh0
30492372131,8sleep23049251-21ssh2
29669202131,3sleep02966974-21ssh0
29372822131,8sleep12938863-21cut1
29150222131,4sleep12915033-21ssh1
28996712130,1sleep00-21swapper/00
28915132131,4sleep22891527-21ssh2
28239882131,6sleep12824029-21ntpq1
27822172130,1sleep20-21swapper/22
27760042131,6sleep22776058-21ntpq2
272671299136,4cyclictest2727167-21taskset3
272671299130,11cyclictest0-21swapper/33
32157882121,8sleep00-21swapper/00
32139422122,4sleep12857293-21diskmemload1
31869522121,5sleep244-21ksoftirqd/22
31741002121,7sleep03175793-21grep0
31523262121,5sleep22857293-21diskmemload2
31458632121,5sleep12857293-21diskmemload1
31351102121,2sleep13135123-21ssh1
31084072121,5sleep10-21swapper/11
30483562126,3sleep00-21swapper/00
30291802121,3sleep13029191-21ssh1
29970202121,7sleep02997156-21latency_hist0
29938632121,7sleep12993874-21ssh1
29680322121,7sleep12968046-21ssh1
29497632124,4sleep22949936-21vmstat2
29335292121,7sleep02933542-21sh0
28807772121,5sleep10-21swapper/11
28806302120,7sleep20-21swapper/22
28724282121,7sleep22872439-21sh2
28723062121,7sleep02857293-21diskmemload0
28414162121,5sleep22841539-21diskstats2
27932652122,5sleep12793284-21apt-get1
27781902121,7sleep12779864-21cut1
32029092111,5sleep13202970-21ntpq1
32028112111,5sleep03202908-21ntpq0
30983752111,7sleep03098392-21sh0
30721422111,4sleep02857293-21diskmemload0
30651482110,1sleep10-21swapper/11
30644602111,4sleep22857293-21diskmemload2
30451052110,5sleep13045257-21ntpq1
30301062111,4sleep22857293-21diskmemload2
30217092111,5sleep02857293-21diskmemload0
30142242111,4sleep10-21swapper/11
30064172111,5sleep03006640-21hddtemp_smartct0
29768402111,4sleep22857293-21diskmemload2
29620462111,6sleep090-21kswapd00
29492822111,5sleep02949343-21ntpq0
29271372111,5sleep02927200-21munin-run0
29169382111,6sleep22916946-21ssh2
28977862111,5sleep22857293-21diskmemload2
28766172110,2sleep02878123-21ssh0
28418262111,6sleep12843189-21kthreadcore1
28244392111,5sleep02824639-21users0
27607082110,1sleep00-21swapper/00
27597292111,5sleep22759775-21ntpq2
27544192111,4sleep12754468-21ntpq1
27451332111,5sleep02745256-21diskstats0
32229772101,3sleep10-21swapper/11
32137542101,3sleep22857293-21diskmemload2
31973852101,4sleep12857293-21diskmemload1
31973852101,4sleep12857293-21diskmemload1
31795792100,5sleep12857293-21diskmemload1
31603312101,6sleep03160342-21ssh0
31553482101,5sleep13155568-21hddtemp_smartct1
31527122101,4sleep02857293-21diskmemload0
31203442101,2sleep10-21swapper/11
31191422101,3sleep10-21swapper/11
31190212101,3sleep02857293-21diskmemload0
31113562101,4sleep23111594-21df_inode2
31105242101,3sleep02857293-21diskmemload0
31099362101,3sleep20-21swapper/22
30560852100,1sleep10-21swapper/11
30296662101,4sleep02857293-21diskmemload0
30103382101,4sleep23010398-21ntpq2
30039332101,4sleep12857293-21diskmemload1
29973512101,3sleep02857293-21diskmemload0
29850622101,3sleep22857293-21diskmemload2
29486902101,6sleep12949139-21cut1
29363112101,4sleep02936333-21apt-get0
29327972101,3sleep20-21swapper/22
29263022101,4sleep12857293-21diskmemload1
29171192101,3sleep00-21swapper/00
29066952101,4sleep02857293-21diskmemload0
29012912100,1sleep10-21swapper/11
28991772101,4sleep12857293-21diskmemload1
28874762101,5sleep12887899-21ssh1
28644742104,3sleep02726706-21cyclictest0
28639392101,4sleep12857293-21diskmemload1
28638562101,3sleep20-21swapper/22
28572832100,6sleep12857336-21unin-run1
28090172101,4sleep22809045-21munin-run2
28090172101,4sleep22809045-21munin-run2
27918742101,6sleep20-21swapper/22
27767232101,3sleep072-21kcompactd00
27290922100,6sleep22730803-21cat2
3221267290,3sleep20-21swapper/22
3179176291,2sleep20-21swapper/22
3039164291,3sleep00-21swapper/00
3038492291,5sleep23038504-21rm2
3002677290,1sleep20-21swapper/22
2980261290,1sleep10-21swapper/11
2936282291,2sleep20-21swapper/22
2903288291,4sleep22904846-21ssh2
2884046291,4sleep02884181-21diskstats0
2867954291,4sleep12869677-21tr1
2825314291,4sleep02825570-21df0
2819966291,4sleep22820214-21cat2
2797453291,4sleep02797538-21ps0
2787656291,4sleep22787812-21sed2
2777215291,3sleep02777234-21apt-get0
2775951291,4sleep12776002-21ntpq1
2762119291,4sleep02763787-21tr0
2731984291,4sleep02732001-21latency_hist0
3144182281,3sleep03144196-21ssh0
2856157281,3sleep00-21swapper/00
2851663281,3sleep22851813-21apt-config2
2841250280,3sleep02841269-21apt-get0
2836530281,3sleep12838030-21kthreadcore1
2834589280,4sleep12834678-21ntpq1
2831189281,3sleep22832242-21kthreadcore2
2815182281,3sleep12816126-21cut1
2800254281,3sleep10-21swapper/11
2798894280,1sleep20-21swapper/22
2766530280,2sleep20-21swapper/22
2750311281,2sleep00-21swapper/00
2838035271,3sleep22839768-21wc2
2835945270,2sleep00-21swapper/00
2830114270,1sleep10-21swapper/11
2814105270,1sleep10-21swapper/11
2813658271,2sleep00-21swapper/00
2804463271,3sleep12804609-21kthreadcore1
2804463271,3sleep12804609-21kthreadcore1
2803371270,1sleep00-21swapper/00
2792319271,3sleep12792553-21unixbench_multi1
2787607270,1sleep10-21swapper/11
2771572270,1sleep10-21swapper/11
2770919270,4sleep00-21swapper/00
2765910270,1sleep10-21swapper/11
2749159271,3sleep12749246-21grep1
2744966270,2sleep20-21swapper/22
2744650270,1sleep10-21swapper/11
2739162270,1sleep20-21swapper/22
2731004270,2sleep10-21swapper/11
2853516261,2sleep20-21swapper/22
2851567260,1sleep10-21swapper/11
2830257260,4sleep20-21swapper/22
2816128261,2sleep20-21swapper/22
2793287260,2sleep20-21swapper/22
2783351261,2sleep00-21swapper/00
2761468261,2sleep20-21swapper/22
2754699261,2sleep20-21swapper/22
2739647261,2sleep00-21swapper/00
2738348260,2sleep00-21swapper/00
2830607250,1sleep00-21swapper/00
2818567250,1sleep00-21swapper/00
2804253250,1sleep00-21swapper/00
2804253250,1sleep00-21swapper/00
2787995250,1sleep00-21swapper/00
2739623250,1sleep20-21swapper/22
2846598241,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional