You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 19:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Thu Mar 26, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3520793211757,55sleep30-21swapper/33
352079628872,10sleep10-21swapper/11
351614228361,6sleep00-21swapper/00
352092528053,9sleep20-21swapper/22
35570582680,2sleep00-21swapper/00
38899162251,8sleep13889948-21ssh1
352125599241,14cyclictest0-21swapper/33
36569762222,14sleep23657033-21/usr/sbin/munin2
39426602211,2sleep10-21swapper/11
352125599211,17cyclictest0-21swapper/33
352125599211,16cyclictest0-21swapper/33
38987492201,4sleep13898957-21diskstats1
38346422201,8sleep13652468-21diskmemload1
352125599205,12cyclictest0-21swapper/33
352125599201,15cyclictest0-21swapper/33
352125599201,15cyclictest0-21swapper/33
352125599201,14cyclictest0-21swapper/33
352125599201,13cyclictest0-21swapper/33
3521255992010,7cyclictest3739028-21taskset3
352125599194,12cyclictest0-21swapper/33
352125599191,16cyclictest0-21swapper/33
3521255991911,5cyclictest66950irq/132-enp1s0-TxRx-33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,14cyclictest0-21swapper/33
352125599191,12cyclictest0-21swapper/33
352125599190,15cyclictest0-21swapper/33
37124672181,14sleep03652468-21diskmemload0
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,14cyclictest0-21swapper/33
352125599181,13cyclictest0-21swapper/33
352125599181,13cyclictest0-21swapper/33
352125599181,13cyclictest0-21swapper/33
352125599181,13cyclictest0-21swapper/33
352125599180,14cyclictest0-21swapper/33
40209472171,12sleep14021194-21ssh1
39762952170,1sleep10-21swapper/11
39133942171,3sleep10-21swapper/11
38099432171,2sleep00-21swapper/00
37811062172,4sleep13652468-21diskmemload1
352125599171,14cyclictest0-21swapper/33
352125599171,13cyclictest0-21swapper/33
352125599171,13cyclictest0-21swapper/33
352125599171,12cyclictest0-21swapper/33
39992972161,10sleep03999357-21ntpq0
39776542162,9sleep13977683-21apt-get1
39325312161,4sleep23932538-21ssh2
38620872161,2sleep20-21swapper/22
37893232161,4sleep13652468-21diskmemload1
36936112161,2sleep00-21swapper/00
35281082161,10sleep03528739-21munin-node0
3521255991612,2cyclictest0-21swapper/33
352125599161,12cyclictest0-21swapper/33
352125599161,11cyclictest3593508-21turbostat3
3521255991610,4cyclictest0-21swapper/33
352125599160,13cyclictest0-21swapper/33
352125599160,13cyclictest0-21swapper/33
352125599160,13cyclictest0-21swapper/33
352125599160,13cyclictest0-21swapper/33
352125599160,13cyclictest0-21swapper/33
352125599160,13cyclictest0-21swapper/33
352125599160,13cyclictest0-21swapper/33
39933142151,2sleep00-21swapper/00
39597212156,6sleep13652468-21diskmemload1
39417132151,6sleep13941720-21ssh1
39049202151,2sleep20-21swapper/22
38879152150,3sleep00-21swapper/00
38450292151,8sleep20-21swapper/22
38262252151,3sleep03826236-21ssh0
38078872151,2sleep20-21swapper/22
36846962151,7sleep20-21swapper/22
35977572151,10sleep13597805-21ntpq1
352125599152,8cyclictest3631098-21taskset3
352125599151,2cyclictest0-21swapper/33
3521255991512,2cyclictest0-21swapper/33
3521255991512,1cyclictest0-21swapper/33
352125599150,13cyclictest0-21swapper/33
352125599150,13cyclictest0-21swapper/33
352125599150,13cyclictest0-21swapper/33
352125599150,12cyclictest0-21swapper/33
39859912141,2sleep20-21swapper/22
39841462141,9sleep03984160-21ssh0
38811952140,8sleep13652468-21diskmemload1
38636092141,2sleep20-21swapper/22
38449632141,8sleep13652468-21diskmemload1
38295372141,4sleep23831155-21tr2
37913782145,4sleep2431ktimers/22
37143492141,3sleep03714240-21apt-get0
36756082141,3sleep20-21swapper/22
36746702141,8sleep03674805-21ntpq0
35344512141,8sleep03534706-21df0
3521255991410,2cyclictest0-21swapper/33
352125599140,11cyclictest0-21swapper/33
352125599140,11cyclictest0-21swapper/33
39468332131,6sleep23946896-21ld2
39230452131,6sleep13652468-21diskmemload1
38781942131,8sleep23878208-21ssh2
38166522131,4sleep23816665-21ssh2
38069442131,7sleep13806976-21ls1
37822812131,8sleep23782294-21ssh2
37649772131,3sleep23764991-21ssh2
37561842131,6sleep13652468-21diskmemload1
37221792131,7sleep13652468-21diskmemload1
37019772130,2sleep10-21swapper/11
35457342131,8sleep20-21swapper/22
40085182121,2sleep20-21swapper/22
39146692121,7sleep2802-21snmpd2
39119912121,7sleep03912160-21sed0
38959502120,1sleep00-21swapper/00
38707502121,8sleep13652468-21diskmemload1
38439482121,7sleep03652468-21diskmemload0
37997612123,6sleep13799774-21sh1
37979572121,2sleep03798055-21ps0
37302912121,6sleep03652468-21diskmemload0
36855832121,3sleep03685594-21ssh0
36846262121,3sleep13684637-21ssh1
36705942121,7sleep13652468-21diskmemload1
35795182120,8sleep13579883-21kthreadcore1
35768262121,7sleep23577028-21grep2
35629532121,7sleep03564682-21grep0
35597192121,7sleep23560383-21sed2
35583442121,7sleep13555551-31find1
35328682121,7sleep23532924-21modprobe2
40190032111,4sleep23652468-21diskmemload2
40166212111,5sleep04016772-21ntpq0
39755602111,5sleep03652468-21diskmemload0
39667922111,5sleep00-21swapper/00
39667232111,3sleep20-21swapper/22
39341102111,5sleep03934238-21diskstats0
39066332111,6sleep03906646-21ssh0
38941372111,6sleep23894189-21ssh2
38727472111,5sleep13872964-21sed1
38678872111,5sleep03867943-21ntpq0
37936832111,5sleep23793851-21ssh2
37728782111,6sleep13772893-21ssh1
37642582111,2sleep10-21swapper/11
37473102111,4sleep13652468-21diskmemload1
37287752111,6sleep13728786-21ssh1
37212022111,6sleep23721212-21ssh2
36940422111,4sleep20-21swapper/22
36618212112,4sleep23661846-21apt-get2
36616942111,3sleep10-21swapper/11
36595962111,4sleep13652468-21diskmemload1
36461502111,5sleep03646199-21ntpq0
36310772111,5sleep23631095-21apt-get2
35397892111,4sleep23539808-21apt-get2
40081632101,5sleep14008227-21ntpq1
40012962101,3sleep20-21swapper/22
40001062101,3sleep13652468-21diskmemload1
39670032100,2sleep10-21swapper/11
39588772101,3sleep20-21swapper/22
39477772101,3sleep00-21swapper/00
39406452101,5sleep23940657-21sh2
39301502101,4sleep13652468-21diskmemload1
39229772100,2sleep00-21swapper/00
38894842101,3sleep20-21swapper/22
38625702100,2sleep00-21swapper/00
38548622101,3sleep13652468-21diskmemload1
38525482101,4sleep13652468-21diskmemload1
38290752101,6sleep03829229-21idleruntime0
38264532101,3sleep20-21swapper/22
38257812101,4sleep13652468-21diskmemload1
38192402101,3sleep10-21swapper/11
38184602101,2sleep00-21swapper/00
37929732101,2sleep00-21swapper/00
37810942101,2sleep00-21swapper/00
37673812101,3sleep00-21swapper/00
37627522101,4sleep03762823-21ssh0
37540392101,3sleep20-21swapper/22
37480302101,3sleep20-21swapper/22
37463822100,1sleep00-21swapper/00
37388602101,3sleep20-21swapper/22
37386372101,3sleep00-21swapper/00
37323752101,4sleep13732399-21apt-get1
37241752101,4sleep23724397-21cut2
37127802101,4sleep13652468-21diskmemload1
37112172101,3sleep20-21swapper/22
36415152101,5sleep13641828-21sed1
36313582100,6sleep03631463-21grep0
36189702101,4sleep03619111-21ntpq0
36085042101,4sleep03608559-21ntpq0
36031342101,4sleep03603182-21ntpq0
35813182101,5sleep23581751-21grep2
35765032101,4sleep03576549-21ntpq0
35555692101,4sleep03555564-40gst-plugin-scan0
35338712100,7sleep13534210-21apt-key1
4008826290,2sleep00-21swapper/00
3992364291,3sleep13652468-21diskmemload1
3986715291,3sleep20-21swapper/22
3975946290,2sleep20-21swapper/22
3956367291,4sleep03956379-21ssh0
3933259291,4sleep03933493-21cat0
3923309290,2sleep20-21swapper/22
3877865290,1sleep00-21swapper/00
3853009290,1sleep20-21swapper/22
3846133291,3sleep00-21swapper/00
3767667291,3sleep20-21swapper/22
3755710291,4sleep03755724-21ssh0
3703110291,4sleep23703124-21ssh2
3696885291,4sleep03697066-21ssh0
3690067291,4sleep13691780-21kthreadcore1
3668676290,1sleep00-21swapper/00
3652758291,4sleep03652772-21ssh0
3640554291,4sleep23640614-21/usr/sbin/munin2
3620896290,1sleep20-21swapper/22
3603487291,4sleep23603586-21cat2
3588455291,4sleep23588707-21df2
3587162290,1sleep20-21swapper/22
3587162290,1sleep20-21swapper/22
3554494290,4sleep13554542-21ntpq1
3550465291,4sleep23550721-21sh2
3534211291,3sleep23533882-21apt-get2
3651506281,2sleep00-21swapper/00
3646816280,1sleep20-21swapper/22
3615074280,2sleep10-21swapper/11
3594028281,3sleep03594241-21hddtemp_smartct0
3581843280,2sleep00-21swapper/00
3576557281,3sleep13576605-21ntpq1
3572163281,3sleep03572165-21sshd0
3567128280,2sleep20-21swapper/22
3641208270,1sleep00-21swapper/00
3630755270,1sleep00-21swapper/00
3629944270,3sleep13630065-21mailstats1
3625747270,2sleep20-21swapper/22
3625223270,1sleep00-21swapper/00
3620701271,3sleep13620894-21gltestperf1
3609748270,2sleep20-21swapper/22
3609214270,1sleep20-21swapper/22
3609157270,1sleep10-21swapper/11
3588123270,1sleep00-21swapper/00
3588123270,1sleep00-21swapper/00
3566596270,1sleep10-21swapper/11
3545116270,2sleep10-21swapper/11
3544746270,1sleep00-21swapper/00
3544360270,4sleep10-21swapper/11
3539185270,1sleep10-21swapper/11
3526146270,1sleep10-21swapper/11
3525779270,1sleep20-21swapper/22
3651358261,2sleep20-21swapper/22
3646830260,1sleep10-21swapper/11
3635036260,2sleep10-21swapper/11
3619166261,2sleep20-21swapper/22
3613655260,1sleep10-21swapper/11
3599931261,2sleep10-21swapper/11
3593760261,2sleep20-21swapper/22
3593285260,1sleep00-21swapper/00
3588949261,2sleep13589239-21kthreadcore1
3588060260,4sleep10-21swapper/11
3588060260,4sleep10-21swapper/11
3571920260,1sleep10-21swapper/11
3566709260,1sleep20-21swapper/22
3526478260,2sleep00-21swapper/00
3549999250,1sleep00-21swapper/00
3647233240,1sleep10-21swapper/11
3609529240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional