You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 03:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sat Jul 04, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2427645212455,64sleep30-21swapper/33
242758928254,9sleep10-21swapper/11
242275128053,13sleep00-21swapper/00
242752927761,10sleep20-21swapper/22
26437122320,2sleep30-21swapper/33
242803599220,7cyclictest2503572-21taskset3
2428035992118,1cyclictest0-21swapper/33
242803599211,16cyclictest0-21swapper/33
242803599211,16cyclictest0-21swapper/33
242803599211,16cyclictest0-21swapper/33
242803599201,3cyclictest0-21swapper/33
242803599201,16cyclictest0-21swapper/33
2428035992010,6cyclictest2524249-21turbostat3
27103552191,8sleep22555778-21diskmemload2
24395232191,14sleep12439640-21/usr/sbin/munin1
242803599195,12cyclictest0-21swapper/33
242803599191,15cyclictest0-21swapper/33
242803599191,14cyclictest0-21swapper/33
242803599191,14cyclictest0-21swapper/33
242803599191,14cyclictest0-21swapper/33
242803599191,14cyclictest0-21swapper/33
2428035991910,6cyclictest2580696-21taskset3
242803599190,15cyclictest0-21swapper/33
242803599190,12cyclictest0-21swapper/33
26623912181,2sleep00-21swapper/00
25880312180,4sleep20-21swapper/22
242803599181,6cyclictest2742846-21taskset3
242803599181,4cyclictest0-21swapper/33
2428035991814,2cyclictest0-21swapper/33
242803599181,14cyclictest0-21swapper/33
242803599181,14cyclictest0-21swapper/33
242803599181,14cyclictest0-21swapper/33
242803599181,14cyclictest0-21swapper/33
242803599181,14cyclictest0-21swapper/33
242803599181,14cyclictest0-21swapper/33
242803599181,14cyclictest0-21swapper/33
242803599181,13cyclictest0-21swapper/33
242803599181,13cyclictest0-21swapper/33
242803599181,13cyclictest0-21swapper/33
242803599181,13cyclictest0-21swapper/33
242803599180,14cyclictest0-21swapper/33
242803599180,14cyclictest0-21swapper/33
242803599180,12cyclictest0-21swapper/33
28794802171,3sleep10-21swapper/11
28794802171,3sleep10-21swapper/11
27627892171,2sleep20-21swapper/22
27599052171,5sleep22555778-21diskmemload2
27211012170,2sleep10-21swapper/11
26607762170,1sleep10-21swapper/11
242803599179,5cyclictest2456163-21turbostat3
242803599173,11cyclictest0-21swapper/33
242803599172,10cyclictest2749034-21taskset3
2428035991714,2cyclictest0-21swapper/33
2428035991712,3cyclictest0-21swapper/33
242803599171,13cyclictest0-21swapper/33
242803599171,13cyclictest0-21swapper/33
242803599171,13cyclictest0-21swapper/33
242803599171,13cyclictest0-21swapper/33
242803599171,13cyclictest0-21swapper/33
242803599171,13cyclictest0-21swapper/33
242803599171,13cyclictest0-21swapper/33
242803599171,12cyclictest0-21swapper/33
242803599171,12cyclictest0-21swapper/33
242803599171,12cyclictest0-21swapper/33
242803599171,12cyclictest0-21swapper/33
242803599171,12cyclictest0-21swapper/33
242803599170,14cyclictest0-21swapper/33
28962922161,4sleep02555778-21diskmemload0
28711412161,2sleep00-21swapper/00
28711412161,2sleep00-21swapper/00
28610502161,4sleep02861293-21users0
28277912161,2sleep10-21swapper/11
27369072161,2sleep00-21swapper/00
2428035991611,3cyclictest0-21swapper/33
242803599161,13cyclictest0-21swapper/33
242803599160,13cyclictest0-21swapper/33
29034712151,3sleep22555778-21diskmemload2
28029432150,3sleep20-21swapper/22
28024912159,2sleep0221rcuc/00
26930082151,5sleep22688706-21/usr/sbin/munin2
26881032151,8sleep22555778-21diskmemload2
26866272151,9sleep02555778-21diskmemload0
26374682151,2sleep00-21swapper/00
26201332151,3sleep02620145-21ssh0
25623812151,4sleep02562390-21ssh0
25617452151,2sleep20-21swapper/22
242803599151,11cyclictest24822602sleep33
242803599151,10cyclictest2482608-21chrt3
242803599150,3cyclictest0-21swapper/33
242803599150,13cyclictest0-21swapper/33
242803599150,12cyclictest0-21swapper/33
242803599150,12cyclictest0-21swapper/33
29057822141,6sleep10-21swapper/11
28733042141,3sleep22873316-21ssh2
28733042141,3sleep22873316-21ssh2
28637912141,2sleep20-21swapper/22
28174832141,2sleep10-21swapper/11
28118352140,2sleep10-21swapper/11
27844472141,4sleep02555778-21diskmemload0
27789152140,2sleep20-21swapper/22
26704302141,9sleep12555778-21diskmemload1
26144442141,8sleep22614525-21irqstats2
25798612140,2sleep00-21swapper/00
25788832141,9sleep12578897-21ssh1
25707832141,4sleep12555778-21diskmemload1
242803599149,3cyclictest0-21swapper/33
242803599140,2cyclictest0-21swapper/33
242803599140,11cyclictest0-21swapper/33
28706302131,3sleep22555778-21diskmemload2
28706302131,3sleep22555778-21diskmemload2
28260732131,6sleep22786769-21kworker/2:0+events2
28040212131,8sleep12804033-21ssh1
27777332131,3sleep12777744-21ssh1
26780832131,7sleep02555778-21diskmemload0
26694502131,3sleep22669460-21ssh2
26462032132,6sleep20-21swapper/22
26285952131,7sleep02555778-21diskmemload0
26202622131,2sleep10-21swapper/11
26130852131,6sleep00-21swapper/00
25974712133,5sleep22597470-21apt-get2
25966102131,7sleep02555778-21diskmemload0
25601332131,8sleep12560262-21ssh1
25409662131,8sleep02542545-21cut0
25356082131,8sleep10-21swapper/11
24616762132,7sleep02461765-21expr0
242803599139,2cyclictest0-21swapper/33
242803599130,10cyclictest2466908-21chrt3
242803599130,10cyclictest0-21swapper/33
29055322121,5sleep00-21swapper/00
28784592121,7sleep02878474-21ssh0
28784592121,7sleep02878474-21ssh0
28565752121,5sleep12856589-21/usr/sbin/munin1
28465552121,6sleep00-21swapper/00
28397462121,7sleep22839774-21apt2
28369892121,6sleep20-21swapper/22
28192762121,7sleep02555778-21diskmemload0
27882002121,3sleep02788273-21fschecks_count0
27844602121,2sleep12784472-21ssh1
27533702121,7sleep02753380-21ssh0
27474512121,6sleep22749033-21cut2
27037322121,5sleep22555778-21diskmemload2
26773942121,6sleep12555778-21diskmemload1
26699632123,2sleep0171rcu_preempt0
26377292120,1sleep20-21swapper/22
26111282121,5sleep20-21swapper/22
25724692120,3sleep22572480-21ssh2
25345142120,1sleep10-21swapper/11
25146152121,7sleep02515709-21grep0
25146152121,7sleep02515709-21grep0
24612272120,8sleep12461230-21sshd-auth1
242803599125,4cyclictest2493340-21taskset3
28972212111,3sleep10-21swapper/11
28889252111,3sleep00-21swapper/00
28857462111,6sleep12885823-21needreboot1
28448152111,3sleep12837340-40sort1
28368222110,6sleep02555778-21diskmemload0
28046142111,5sleep22804747-21diskstats2
27640092111,6sleep02765584-21kthreadcore0
27446252110,2sleep20-21swapper/22
27018472111,4sleep02555778-21diskmemload0
27009842111,6sleep12696777-21/usr/sbin/munin1
26942242111,5sleep02555778-21diskmemload0
26849532111,3sleep10-21swapper/11
26547922110,1sleep20-21swapper/22
26524792111,5sleep12652488-21ssh1
26439942110,7sleep02644008-21ssh0
26380792111,5sleep12555778-21diskmemload1
26279902111,4sleep10-21swapper/11
26222462111,4sleep22622257-21apt-get2
25891762112,4sleep22589195-21apt-get2
25815332111,6sleep12583043-21grep1
25121362111,1sleep00-21swapper/00
24930522111,4sleep02493071-21apt-get0
24918372111,6sleep12487818-21/usr/sbin/munin1
24845352111,6sleep02486299-21kthreadcore0
24723532111,6sleep22472392-21forks2
24521042111,2sleep10-21swapper/11
24501942111,3sleep00-21swapper/00
28954362103,3sleep2431ktimers/22
28890022101,4sleep22555778-21diskmemload2
28711922100,1sleep10-21swapper/11
28711922100,1sleep10-21swapper/11
28533612101,3sleep02555778-21diskmemload0
28342552101,5sleep12834267-21ssh1
28261252101,2sleep00-21swapper/00
28181822100,1sleep20-21swapper/22
28123342101,4sleep039542-21systemd-journal0
27947252101,3sleep20-21swapper/22
27936382101,3sleep10-21swapper/11
27800572101,5sleep22780138-21sh2
27776682101,4sleep02555778-21diskmemload0
27687512101,3sleep10-21swapper/11
27595492101,4sleep02555778-21diskmemload0
27513652101,2sleep10-21swapper/11
27436352101,4sleep12555778-21diskmemload1
27366242101,3sleep10-21swapper/11
27273252100,4sleep20-21swapper/22
27193742101,4sleep02555778-21diskmemload0
27135482101,5sleep22713723-21diskstats2
27051582101,4sleep12705424-21df1
27051462101,2sleep00-21swapper/00
26795062100,3sleep20-21swapper/22
26611842100,6sleep22661197-21ssh2
26436402100,1sleep10-21swapper/11
26106272101,2sleep10-21swapper/11
25935532104,3sleep139542-21systemd-journal1
25860282101,4sleep02555778-21diskmemload0
25717792101,4sleep02555778-21diskmemload0
25707442100,4sleep20-21swapper/22
25557602101,4sleep12555778-21diskmemload1
25396842100,1sleep20-21swapper/22
25088092101,3sleep12508828-21apt-get1
25077812101,6sleep02507983-21timerwakeupswit0
24980762100,6sleep12498278-21sqv1
24727772101,5sleep12474363-21kthreadcore1
24619442101,4sleep22462153-21hddtemp_smartct2
24512042101,4sleep02451201-21apt-get0
2853856291,2sleep20-21swapper/22
2754531291,2sleep10-21swapper/11
2744408290,5sleep02744419-21ssh0
2735405291,2sleep20-21swapper/22
2722307291,4sleep02722966-21ssh0
2721743291,4sleep12722009-21ssh1
2694670291,3sleep12555778-21diskmemload1
2652418291,2sleep00-21swapper/00
2605293291,3sleep02555778-21diskmemload0
2603618291,4sleep12603632-21ssh1
2545527290,4sleep20-21swapper/22
2529826290,5sleep22530001-21cstates2
2524575291,4sleep02524833-21df_inode0
2519278291,4sleep22519297-21apt-get2
2503597290,4sleep22503594-21apt-get2
2498820291,4sleep02498892-21kernelversion0
2477326291,4sleep22477345-21apt-get2
2471772291,4sleep22471773-21sshd-session2
2445948291,3sleep12445967-21apt-get1
2440738291,4sleep02440996-21df0
2433129291,3sleep1106713-21snmpd1
2428768291,4sleep22429659-21cut2
2848595280,5sleep12848816-21sh1
2555536280,2sleep20-21swapper/22
2554676280,4sleep00-21swapper/00
2524535281,3sleep22524289-21sendmail-msp2
2502478281,3sleep22502642-21switchtime2
2477058281,3sleep02477114-21unin-run0
2470770280,4sleep10-21swapper/11
2461077280,1sleep20-21swapper/22
2440714281,3sleep22440733-21apt-get2
2550302270,1sleep10-21swapper/11
2535039270,2sleep00-21swapper/00
2534722270,1sleep00-21swapper/00
2524137270,1sleep10-21swapper/11
2520497270,3sleep0221rcuc/00
2518891270,1sleep20-21swapper/22
2518891270,1sleep20-21swapper/22
2503575270,2sleep10-21swapper/11
2494688271,3sleep22496403-21kthreadcore2
2493622271,2sleep10-21swapper/11
2492442270,1sleep20-21swapper/22
2487817271,1sleep02487836-21apt-get0
2487317270,1sleep10-21swapper/11
2482586270,2sleep20-21swapper/22
2478516270,4sleep02479425-21kthreadcore0
2461360271,2sleep00-21swapper/00
2455935271,2sleep22455936-2192
2436008271,2sleep02436635-21kthreadcore0
2433242271,3sleep20-21swapper/22
2433098270,1sleep00-21swapper/00
2545789261,2sleep00-21swapper/00
2544119260,2sleep22544232-21strings2
2527640260,2sleep10-21swapper/11
2518789260,1sleep10-21swapper/11
2518789260,1sleep10-21swapper/11
2508831261,2sleep20-21swapper/22
2482273260,4sleep10-21swapper/11
2461440260,2sleep10-21swapper/11
2540137250,1sleep10-21swapper/11
2471765250,3sleep00-21swapper/00
2446518250,1sleep20-21swapper/22
2440707250,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional