You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 13:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat May 23, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3622094211755,57sleep30-21swapper/33
362206828353,10sleep20-21swapper/22
362203127961,12sleep10-21swapper/11
362228327652,7sleep00-21swapper/00
36985722290,2sleep20-21swapper/22
37726752221,7sleep03774379-21tr0
362245399221,17cyclictest3954113-21taskset3
39108322211,16sleep03752806-21diskmemload0
362245399211,16cyclictest66950irq/132-enp1s0-TxRx-33
362245399211,16cyclictest4041435-21taskset3
362245399211,16cyclictest4041435-21taskset3
362245399211,16cyclictest3832134-21taskset3
362245399211,16cyclictest0-21swapper/33
362245399211,16cyclictest0-21swapper/33
362245399201,6cyclictest3767160-21taskset3
362245399201,16cyclictest0-21swapper/33
362245399201,15cyclictest0-21swapper/33
362245399201,15cyclictest0-21swapper/33
362245399201,13cyclictest0-21swapper/33
362245399198,8cyclictest3876601-21sleep3
362245399194,2cyclictest4017203-21taskset3
3622453991915,2cyclictest0-21swapper/33
3622453991914,2cyclictest66950irq/132-enp1s0-TxRx-33
362245399191,15cyclictest0-21swapper/33
362245399191,14cyclictest3793927-21chrt3
3622453991911,4cyclictest0-21swapper/33
362245399191,14cyclictest0-21swapper/33
362245399191,14cyclictest0-21swapper/33
362245399191,14cyclictest0-21swapper/33
362245399191,14cyclictest0-21swapper/33
40392592180,6sleep2431ktimers/22
40392592180,6sleep2431ktimers/22
362245399184,12cyclictest0-21swapper/33
362245399181,5cyclictest0-21swapper/33
362245399181,5cyclictest0-21swapper/33
3622453991812,3cyclictest0-21swapper/33
3622453991811,4cyclictest66950irq/132-enp1s0-TxRx-33
362245399181,14cyclictest0-21swapper/33
362245399181,14cyclictest0-21swapper/33
362245399181,14cyclictest0-21swapper/33
362245399181,14cyclictest0-21swapper/33
362245399181,14cyclictest0-21swapper/33
362245399180,2cyclictest0-21swapper/33
362245399180,14cyclictest3890958-21taskset3
39525962171,12sleep13952608-21ssh1
362245399178,6cyclictest3779389-21turbostat3
3622453991713,2cyclictest0-21swapper/33
3622453991713,2cyclictest0-21swapper/33
3622453991712,3cyclictest0-21swapper/33
362245399171,14cyclictest66950irq/132-enp1s0-TxRx-33
362245399171,13cyclictest0-21swapper/33
362245399171,13cyclictest0-21swapper/33
362245399171,13cyclictest0-21swapper/33
362245399171,13cyclictest0-21swapper/33
362245399171,13cyclictest0-21swapper/33
362245399170,14cyclictest0-21swapper/33
362245399170,14cyclictest0-21swapper/33
362245399170,13cyclictest0-21swapper/33
41138222161,4sleep24113843-21apt-get2
40801342161,11sleep14081801-21kthreadcore1
40294352164,7sleep04030117-21sed0
39952362160,4sleep13995304-21ntpq1
38126942160,8sleep13752806-21diskmemload1
362245399161,12cyclictest0-21swapper/33
362245399160,13cyclictest0-21swapper/33
362245399160,12cyclictest0-21swapper/33
41110672151,2sleep00-21swapper/00
40703192150,3sleep00-21swapper/00
40166662151,2sleep20-21swapper/22
40057172150,7sleep03752806-21diskmemload0
39509042150,3sleep2421rcuc/22
38747502151,4sleep13874760-21ssh1
38018162151,2sleep00-21swapper/00
37533422152,7sleep13753493-21diskstats1
37300662156,5sleep03730203-21ntpq0
362245399154,8cyclictest0-21swapper/33
362245399151,9cyclictest3683440-21taskset3
3622453991512,2cyclictest0-21swapper/33
362245399151,12cyclictest0-21swapper/33
362245399151,11cyclictest0-21swapper/33
362245399150,13cyclictest0-21swapper/33
362245399150,13cyclictest0-21swapper/33
362245399150,12cyclictest0-21swapper/33
362245399150,12cyclictest0-21swapper/33
40955452140,2sleep10-21swapper/11
40951562141,6sleep20-21swapper/22
40509102141,8sleep03752806-21diskmemload0
39294212141,9sleep13929435-21ssh1
38217982141,4sleep13821810-21ssh1
38204542140,2sleep00-21swapper/00
38044522141,8sleep20-21swapper/22
37926962142,8sleep13792747-21ssh1
37689832141,3sleep03768995-21ssh0
362245399141,1cyclictest0-21swapper/33
3622453991411,1cyclictest0-21swapper/33
40956782131,8sleep04095691-21ssh0
39634172131,2sleep20-21swapper/22
38769712132,6sleep13876999-21apt-get1
38419122131,2sleep20-21swapper/22
38374372131,3sleep03837498-21ld0
37753592131,5sleep23775456-21processes2
36982022131,8sleep13694079-21/usr/sbin/munin1
36226282131,7sleep03622647-21apt-get0
362245399138,3cyclictest3731250-21sleep3
362245399131,1cyclictest0-21swapper/33
3622453991311,1cyclictest0-21swapper/33
362245399131,10cyclictest0-21swapper/33
3622453991310,2cyclictest0-21swapper/33
362245399130,1cyclictest0-21swapper/33
40791792121,7sleep04080133-21grep0
40488402121,6sleep13752806-21diskmemload1
40316632121,5sleep10-21swapper/11
40172312120,8sleep14017245-21ssh1
39902192121,3sleep13990233-21ssh1
39535802121,7sleep03953594-21ssh0
39128742120,8sleep13914464-21cut1
38889812121,7sleep13889743-21ls1
38840732121,7sleep23884088-21ssh2
38646172121,6sleep20-21swapper/22
38489162120,5sleep00-21swapper/00
37261322122,5sleep13726151-21apt-get1
36951772124,4sleep03696907-21grep0
36717552120,8sleep13671764-21switchtime1
36500622121,5sleep03650110-21ntpq0
41125102111,3sleep20-21swapper/22
41027642111,3sleep20-21swapper/22
40740082111,5sleep14074066-21ntpq1
40566152111,5sleep24056686-21ntp_states2
40414492111,6sleep04041463-21rm0
40414492111,6sleep04041463-21rm0
40347922111,5sleep10-21swapper/11
40347922111,5sleep10-21swapper/11
40160472110,2sleep10-21swapper/11
39988272111,6sleep03752806-21diskmemload0
39982412111,5sleep23752806-21diskmemload2
39875662112,4sleep03752806-21diskmemload0
39808592111,6sleep13980870-21ssh1
39735602110,3sleep23973573-21ssh2
39702952111,7sleep03752806-21diskmemload0
39699482112,4sleep13752806-21diskmemload1
39690572111,5sleep23969104-21ntpq2
39442832111,6sleep03752806-21diskmemload0
39442832111,6sleep03752806-21diskmemload0
39363412111,5sleep03752806-21diskmemload0
39301512111,6sleep23931467-21tr2
39261332111,3sleep00-21swapper/00
39180182112,4sleep03752806-21diskmemload0
39100622112,4sleep23752806-21diskmemload2
38945142111,2sleep00-21swapper/00
38940412110,1sleep00-21swapper/00
38765642111,5sleep23876643-21munin-run2
38681432111,5sleep03752806-21diskmemload0
38402832110,1sleep20-21swapper/22
38309292111,5sleep03752806-21diskmemload0
37861892111,6sleep10-21swapper/11
37697562111,5sleep20-21swapper/22
37611722111,3sleep00-21swapper/00
37527392110,1sleep20-21swapper/22
37208062112,4sleep23720825-21apt-get2
37106512111,7sleep03711386-21tr0
37076602111,5sleep03708673-21memory0
36766342111,5sleep23676775-21ntpq2
36460222111,5sleep13646277-21df1
36340902111,5sleep03634139-21ntpq0
41192302101,6sleep04119245-21ssh0
41181662101,5sleep14118304-21ssh1
41050662100,2sleep10-21swapper/11
41022512101,4sleep13752806-21diskmemload1
40853392101,3sleep20-21swapper/22
40670002101,4sleep03752806-21diskmemload0
40662092101,4sleep23752806-21diskmemload2
40334502101,3sleep20-21swapper/22
40248202101,4sleep23752806-21diskmemload2
40241762101,4sleep03752806-21diskmemload0
40040232101,5sleep24004087-21ldconfig2
39998462101,3sleep10-21swapper/11
39853932101,4sleep23986368-21memory2
39638932100,1sleep00-21swapper/00
39441562101,2sleep20-21swapper/22
39441562101,2sleep20-21swapper/22
39435872101,4sleep13752806-21diskmemload1
39435872101,4sleep13752806-21diskmemload1
39258892101,3sleep10-21swapper/11
39254452101,4sleep23925700-21users2
39173822100,2sleep23917393-21ssh2
39003302101,3sleep10-21swapper/11
38932032101,5sleep23893216-21ssh2
38650182101,2sleep10-21swapper/11
38636382101,5sleep03863702-21ntpq0
38566802100,7sleep13752806-21diskmemload1
38556612101,3sleep00-21swapper/00
38556332102,3sleep23752806-21diskmemload2
38460722101,3sleep13846120-21ntpq1
38217012101,3sleep20-21swapper/22
38121762101,2sleep00-21swapper/00
38035212101,2sleep10-21swapper/11
37927542101,5sleep23792815-21ntpq2
37860232101,4sleep03752806-21diskmemload0
37673352100,2sleep10-21swapper/11
37574972101,6sleep23757536-21pmu-power2
37472982101,3sleep00-21swapper/00
37410782101,5sleep23741129-21ntpq2
37317602101,4sleep13731779-21apt-get1
36928502101,4sleep13692904-21ntpq1
36660772101,4sleep03666123-21ntpq0
36403922101,5sleep23640409-21munin-run2
36363982101,6sleep03638108-21kthreadcore0
4101682290,1sleep00-21swapper/00
4069064291,3sleep13752806-21diskmemload1
4057480291,3sleep13752806-21diskmemload1
4056813291,2sleep00-21swapper/00
4050378290,1sleep20-21swapper/22
4016489291,2sleep00-21swapper/00
3977769291,4sleep03977829-21sed0
3960650290,6sleep13960770-21sed1
3900850291,2sleep20-21swapper/22
3882765291,3sleep00-21swapper/00
3833495291,3sleep13833633-21ssh1
3830745291,3sleep13752806-21diskmemload1
3830255291,4sleep23830268-21ssh2
3809646291,4sleep23810348-21sed2
3793738291,3sleep03752806-21diskmemload0
3784013291,4sleep23784080-21ntp_states2
3771286291,4sleep13771473-21sed1
3747731290,4sleep13747750-21apt-get1
3711387291,5sleep13713131-21kthreadcore1
3686335290,2sleep00-21swapper/00
3660834291,4sleep03660890-21/usr/sbin/munin0
3645678290,1sleep20-21swapper/22
3641227291,4sleep13642562-21grep1
4076929281,2sleep20-21swapper/22
3903245280,2sleep10-21swapper/11
3732060281,4sleep03732279-21sort0
3731221282,3sleep20-21swapper/22
3716040281,3sleep23717606-21grep2
3700239281,4sleep13701925-21cut1
3699420281,2sleep03699439-21apt-get0
3682137280,5sleep20-21swapper/22
3673923281,3sleep00-21swapper/00
3667936281,3sleep03669019-21kthreadcore0
3655890280,1sleep00-21swapper/00
3627764281,3sleep13628889-21kthreadcore1
3744609271,3sleep10-21swapper/11
3742699271,2sleep23742913-21smartctl2
3736806270,1sleep20-21swapper/22
3721131271,3sleep13721350-21if_enp1s01
3720511270,1sleep10-21swapper/11
3720381270,1sleep00-21swapper/00
3715087270,1sleep20-21swapper/22
3693605270,1sleep20-21swapper/22
3688738270,2sleep00-21swapper/00
3688359270,1sleep10-21swapper/11
3683418270,2sleep20-21swapper/22
3662778271,3sleep10-21swapper/11
3651332270,1sleep20-21swapper/22
3640654271,3sleep00-21swapper/00
3725518260,4sleep00-21swapper/00
3682945260,1sleep00-21swapper/00
3666789260,1sleep20-21swapper/22
3661670260,1sleep10-21swapper/11
3660658260,1sleep20-21swapper/22
3651339260,1sleep10-21swapper/11
3645736260,2sleep20-21swapper/22
3640354260,1sleep10-21swapper/11
3634852260,4sleep20-21swapper/22
3627451260,4sleep10-21swapper/11
3626748260,1sleep20-21swapper/22
3752546250,3sleep00-21swapper/00
3741789250,1sleep00-21swapper/00
3741561250,2sleep10-21swapper/11
3709303250,1sleep10-21swapper/11
3704772250,1sleep20-21swapper/22
3704262250,2sleep20-21swapper/22
3671768250,1sleep20-21swapper/22
3678070240,1sleep10-21swapper/11
3672593240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional