You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-20 - 16:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Wed May 20, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3930021217062,104sleep30-21swapper/33
39349092118110,5sleep10-21swapper/11
393481128050,11sleep20-21swapper/22
393468327657,14sleep00-21swapper/00
3935104992619,5cyclictest1602012sleep33
547372241,11sleep14065631-21diskmemload1
3935104992319,2cyclictest0-21swapper/33
3935104992319,2cyclictest0-21swapper/33
3935104992219,1cyclictest0-21swapper/33
3935104992218,2cyclictest0-21swapper/33
3935104992118,2cyclictest0-21swapper/33
3935104992118,1cyclictest0-21swapper/33
3935104992117,2cyclictest0-21swapper/33
393510499211,17cyclictest0-21swapper/33
393510499211,17cyclictest0-21swapper/33
393510499211,16cyclictest624592sleep33
393510499211,16cyclictest0-21swapper/33
393510499211,16cyclictest0-21swapper/33
41875082200,7sleep134-21ksoftirqd/11
393510499209,7cyclictest166753-21chrt3
393510499208,1cyclictest0-21swapper/33
393510499202,1cyclictest0-21swapper/33
393510499202,16cyclictest66950irq/132-enp1s0-TxRx-33
3935104992016,2cyclictest0-21swapper/33
3935104992011,6cyclictest66950irq/132-enp1s0-TxRx-33
393510499201,15cyclictest0-21swapper/33
3935104992010,6cyclictest0-21swapper/33
393510499194,2cyclictest0-21swapper/33
3935104991917,1cyclictest0-21swapper/33
3935104991917,1cyclictest0-21swapper/33
3935104991917,1cyclictest0-21swapper/33
3935104991915,2cyclictest0-21swapper/33
393510499191,15cyclictest0-21swapper/33
393510499191,15cyclictest0-21swapper/33
3935104991911,4cyclictest66950irq/132-enp1s0-TxRx-33
393510499191,14cyclictest0-21swapper/33
393510499191,14cyclictest0-21swapper/33
393510499191,14cyclictest0-21swapper/33
393510499191,14cyclictest0-21swapper/33
393510499190,16cyclictest0-21swapper/33
393510499190,15cyclictest0-21swapper/33
3935104991815,2cyclictest0-21swapper/33
3935104991815,1cyclictest0-21swapper/33
3935104991814,2cyclictest0-21swapper/33
3935104991813,2cyclictest0-21swapper/33
3935104991813,2cyclictest0-21swapper/33
393510499181,14cyclictest0-21swapper/33
393510499181,13cyclictest0-21swapper/33
393510499181,13cyclictest0-21swapper/33
368222181,4sleep00-21swapper/00
1244222180,8sleep04065631-21diskmemload0
795362171,2sleep20-21swapper/22
41520052171,3sleep00-21swapper/00
41429192171,4sleep14065631-21diskmemload1
41381532171,4sleep04139862-21kthreadcore0
40850132171,5sleep14086682-21cut1
393510499172,11cyclictest4065652-21turbostat3
3935104991715,1cyclictest0-21swapper/33
3935104991713,2cyclictest0-21swapper/33
3935104991712,2cyclictest0-21swapper/33
393510499171,13cyclictest0-21swapper/33
393510499170,14cyclictest0-21swapper/33
393510499170,13cyclictest0-21swapper/33
1360472171,5sleep2136882-21kthreadcore2
1092502171,11sleep1109284-21ssh1
1064962171,7sleep24065631-21diskmemload2
634882161,8sleep10-21swapper/11
41778932161,4sleep14065631-21diskmemload1
41077682161,2sleep20-21swapper/22
393510499169,4cyclictest3943214-21chrt3
393510499161,3cyclictest0-21swapper/33
3935104991613,1cyclictest0-21swapper/33
3935104991612,2cyclictest0-21swapper/33
393510499161,13cyclictest0-21swapper/33
393510499161,13cyclictest0-21swapper/33
393510499161,12cyclictest0-21swapper/33
393510499160,13cyclictest0-21swapper/33
393510499160,13cyclictest0-21swapper/33
393510499160,13cyclictest0-21swapper/33
2388692161,3sleep04065631-21diskmemload0
465582151,2sleep10-21swapper/11
41420252150,1sleep20-21swapper/22
41071822151,4sleep04107196-21ssh0
40964802151,4sleep00-21swapper/00
40735682151,4sleep14065631-21diskmemload1
393510499152,8cyclictest4033954-21taskset3
3935104991512,2cyclictest0-21swapper/33
3935104991512,1cyclictest0-21swapper/33
393510499151,10cyclictest4060311-21chrt3
393510499150,12cyclictest0-21swapper/33
393510499150,11cyclictest0-21swapper/33
2293742150,3sleep00-21swapper/00
204562150,1sleep10-21swapper/11
1618402151,9sleep14065631-21diskmemload1
1487342151,7sleep1148779-21ntpq1
1326062150,3sleep00-21swapper/00
971732140,2sleep20-21swapper/22
783302141,8sleep078397-21ntp_states0
532132140,3sleep04065631-21diskmemload0
40788842141,7sleep14078945-21ntpq1
393510499140,12cyclictest0-21swapper/33
1533562142,5sleep2152850-21apt-get2
1343532141,9sleep2134363-21ssh2
98772131,8sleep14065631-21diskmemload1
895442131,2sleep14065631-21diskmemload1
795722131,5sleep10-21swapper/11
720542130,2sleep14065631-21diskmemload1
533332131,3sleep253346-21ssh2
458872131,8sleep045893-21sh0
41701012131,2sleep10-21swapper/11
41325142131,3sleep14132525-21ssh1
41177322130,2sleep20-21swapper/22
40895862131,8sleep04065631-21diskmemload0
40891072131,8sleep24089121-21ssh2
40789492131,6sleep24079003-21ntpq2
347792131,7sleep24065631-21diskmemload2
2241542131,6sleep2224181-21apt-get2
2225592134,4sleep0151ktimers/00
2062442131,8sleep0206258-21ssh0
1780102131,8sleep1178021-21ssh1
1762812131,8sleep0176296-21ssh0
1537832131,3sleep04065631-21diskmemload0
1055772131,8sleep1105589-21ssh1
632012121,7sleep263213-21sh2
41279482121,7sleep04127293-21/usr/sbin/munin0
41227362121,5sleep14122797-21ntpq1
40973122120,8sleep14097326-21ssh1
40659942122,5sleep24066023-21apt-get2
40004662121,6sleep14000515-21ntpq1
39523712121,6sleep13952418-21ntpq1
39358682121,7sleep13936421-21grep1
2400002120,1sleep10-21swapper/11
22172121,6sleep02228-21ssh0
1445002121,1sleep00-21swapper/00
1160452121,7sleep24065631-21diskmemload2
114172121,5sleep00-21swapper/00
10102121,6sleep14065631-21diskmemload1
711072111,4sleep20-21swapper/22
41751902110,2sleep244-21ksoftirqd/22
41683202111,4sleep04065631-21diskmemload0
41600402111,3sleep00-21swapper/00
41518822110,1sleep20-21swapper/22
41276162111,5sleep24127836-21hddtemp_smartct2
41235372111,3sleep20-21swapper/22
41226872112,4sleep04122735-21ntpq0
40661092111,6sleep04065631-21diskmemload0
40606152111,5sleep24060861-21df_inode2
40605732111,6sleep04060588-21acpi0
40326312111,5sleep04032682-21ntpq0
40019912111,5sleep24002200-21hddtemp_smartct2
39989692111,5sleep24000278-21memory2
39755162111,5sleep03975631-21irqstats0
39693552111,5sleep13969337-31find1
35792111,5sleep23598-21apt-get2
350622111,4sleep14065631-21diskmemload1
276952110,2sleep10-21swapper/11
257432111,5sleep225940-21users2
2021352111,5sleep2202191-21ntpq2
1803752111,6sleep2180506-21perl2
1681662111,7sleep0168177-21ssh0
1669922111,5sleep2167188-21users2
1506372111,7sleep20-21swapper/22
1408582111,3sleep00-21swapper/00
1395072111,2sleep10-21swapper/11
1083762111,2sleep00-21swapper/00
987802101,3sleep10-21swapper/11
959802101,4sleep04065631-21diskmemload0
882842101,3sleep04065631-21diskmemload0
870102101,4sleep287074-21ntpq2
701772101,3sleep04065631-21diskmemload0
616672100,6sleep061677-21ssh0
437812101,4sleep24065631-21diskmemload2
41846682101,5sleep24184678-21ssh2
41779732101,6sleep04065631-21diskmemload0
41705242101,4sleep24065631-21diskmemload2
41600132101,3sleep20-21swapper/22
41587282101,2sleep10-21swapper/11
41452952101,5sleep14145825-21kthreadcore1
41177732101,2sleep10-21swapper/11
41059892101,3sleep10-21swapper/11
40966062101,4sleep24065631-21diskmemload2
40499352101,4sleep04050191-21df0
40433492101,4sleep14043399-21ntpq1
40395382101,4sleep24039641-21perl2
40259562101,4sleep14027180-21memory1
40259562101,4sleep14027180-21memory1
40242582100,5sleep03996058-21kworker/0:1+events0
40242582100,5sleep03996058-21kworker/0:1+events0
40018372101,5sleep14001990-21diskstats1
39969072101,6sleep03997264-21grep0
39847422102,4sleep13984770-21sed1
39630752101,5sleep13963128-21/usr/sbin/munin1
39467552101,5sleep03946808-21ld0
259602100,1sleep00-21swapper/00
2156582101,2sleep20-21swapper/22
2147652101,4sleep04065631-21diskmemload0
2121622101,3sleep20-21swapper/22
2066332101,3sleep10-21swapper/11
1890752101,4sleep14065631-21diskmemload1
188432101,4sleep24065631-21diskmemload2
1884312101,4sleep0188484-21http0
1683282101,6sleep1168342-21ssh1
1337422101,2sleep10-21swapper/11
1247492100,3sleep20-21swapper/22
123262101,2sleep00-21swapper/00
1221882101,4sleep1122245-21ntpq1
1165862101,4sleep04065631-21diskmemload0
4184789290,1sleep00-21swapper/00
4114038290,1sleep00-21swapper/00
4080749291,3sleep04065631-21diskmemload0
4061138291,4sleep14061896-21grep1
4060315290,5sleep24060330-21latency_hist2
4055869291,4sleep04057437-21cut0
4048695291,5sleep14048740-21ntpq1
4044873291,4sleep24045007-21head2
4038853290,4sleep10-21swapper/11
4034211291,4sleep04034260-21fschecks_count0
4033932291,2sleep20-21swapper/22
4028223290,4sleep20-21swapper/22
4028223290,4sleep20-21swapper/22
4017956291,3sleep14017975-21apt-get1
4016742291,4sleep24016798-21ntpq2
4008527291,4sleep04010282-21cut0
3983662291,4sleep23984310-21cat2
3968714290,1sleep00-21swapper/00
2448291,4sleep22459-21ssh2
239249291,4sleep2239263-21ssh2
231462291,3sleep14065631-21diskmemload1
220965290,3sleep10-21swapper/11
203085291,4sleep1203100-21ssh1
195058290,1sleep20-21swapper/22
194981290,3sleep00-21swapper/00
186577291,2sleep10-21swapper/11
171321291,2sleep20-21swapper/22
4044595281,3sleep04044610-21cpu0
4039257281,2sleep00-21swapper/00
4028877281,3sleep24028983-21perl2
4023011281,3sleep01-21systemd0
4001723281,3sleep04001836-21cpuspeed_turbos0
3995964280,1sleep00-21swapper/00
3995118281,3sleep23995171-21ntpq2
3991614281,3sleep13992610-21kthreadcore1
3986300281,3sleep03987927-21grep0
3974639280,2sleep00-21swapper/00
4050262271,3sleep20-21swapper/22
4029794271,3sleep14031541-21kthreadcore1
4013202271,3sleep14014167-21grep1
4011993270,1sleep20-21swapper/22
3990544270,1sleep20-21swapper/22
3980125270,2sleep20-21swapper/22
3979992272,2sleep13935100-21cyclictest1
3974076270,3sleep20-21swapper/22
3970239271,3sleep10-21swapper/11
3969124270,1sleep20-21swapper/22
3959543270,4sleep03960901-21kthreadcore0
3958965270,4sleep20-21swapper/22
3958615270,1sleep10-21swapper/11
3958350270,1sleep20-21swapper/22
3952281271,2sleep00-21swapper/00
3946809270,4sleep13946858-21/usr/sbin/munin1
4057438260,3sleep14055265-21/usr/sbin/munin1
4054839260,1sleep10-21swapper/11
4017978261,2sleep20-21swapper/22
4012611260,1sleep00-21swapper/00
4012025260,1sleep10-21swapper/11
3989831260,2sleep10-21swapper/11
3980958261,2sleep00-21swapper/00
3953106260,1sleep20-21swapper/22
3947406260,1sleep20-21swapper/22
3940082260,1sleep20-21swapper/22
3954092250,1sleep00-21swapper/00
3935668250,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional