You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-21 - 17:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sun Jun 21, 2026 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52817212355,63sleep30-21swapper/33
5277128259,20sleep20-21swapper/22
5286028064,10sleep10-21swapper/11
5279927857,15sleep00-21swapper/00
4726452320,2sleep10-21swapper/11
3982642310,2sleep20-21swapper/22
3519922260,2sleep00-21swapper/00
4818792241,18sleep0180948-21diskmemload0
5327099230,2cyclictest2380142sleep33
5327099221,16cyclictest0-21swapper/33
5327099216,11cyclictest247846-21turbostat3
5327099211,7cyclictest102289-21taskset3
53270992116,2cyclictest0-21swapper/33
5327099211,16cyclictest0-21swapper/33
5327099210,19cyclictest0-21swapper/33
5327099201,2cyclictest0-21swapper/33
5327099201,16cyclictest0-21swapper/33
5327099201,15cyclictest0-21swapper/33
5327099201,15cyclictest0-21swapper/33
5327099201,14cyclictest0-21swapper/33
5327099201,14cyclictest0-21swapper/33
4800402201,10sleep2180948-21diskmemload2
4026392201,8sleep1402797-21wc1
5327099192,14cyclictest66950irq/132-enp1s0-TxRx-33
53270991917,1cyclictest0-21swapper/33
53270991915,3cyclictest0-21swapper/33
53270991915,2cyclictest228760-21taskset3
53270991912,3cyclictest0-21swapper/33
53270991911,5cyclictest66950irq/132-enp1s0-TxRx-33
5327099191,14cyclictest0-21swapper/33
5327099191,14cyclictest0-21swapper/33
5327099191,14cyclictest0-21swapper/33
5327099191,14cyclictest0-21swapper/33
5327099191,14cyclictest0-21swapper/33
5327099191,14cyclictest0-21swapper/33
53270991910,5cyclictest0-21swapper/33
5327099190,17cyclictest0-21swapper/33
5327099190,17cyclictest0-21swapper/33
5327099190,17cyclictest0-21swapper/33
2148562190,8sleep20-21swapper/22
5327099183,13cyclictest0-21swapper/33
5327099181,14cyclictest0-21swapper/33
5327099181,14cyclictest0-21swapper/33
5327099181,14cyclictest0-21swapper/33
5327099181,14cyclictest0-21swapper/33
5327099181,14cyclictest0-21swapper/33
5327099181,13cyclictest0-21swapper/33
5327099181,13cyclictest0-21swapper/33
5327099181,13cyclictest0-21swapper/33
53270991810,6cyclictest0-21swapper/33
5327099180,15cyclictest0-21swapper/33
5327099178,5cyclictest0-21swapper/33
5327099172,9cyclictest81643-21taskset3
5327099171,14cyclictest0-21swapper/33
5327099171,13cyclictest0-21swapper/33
5327099171,13cyclictest0-21swapper/33
5327099171,13cyclictest0-21swapper/33
5327099171,13cyclictest0-21swapper/33
5327099170,14cyclictest0-21swapper/33
5327099170,14cyclictest0-21swapper/33
5327099170,14cyclictest0-21swapper/33
5327099170,14cyclictest0-21swapper/33
5327099170,14cyclictest0-21swapper/33
4211262171,3sleep20-21swapper/22
5327099162,11cyclictest180973-21sleep3
5327099161,3cyclictest0-21swapper/33
53270991611,3cyclictest0-21swapper/33
5327099161,13cyclictest0-21swapper/33
5327099160,13cyclictest0-21swapper/33
5123782161,4sleep0180948-21diskmemload0
5123782161,4sleep0180948-21diskmemload0
4804562161,10sleep1180948-21diskmemload1
4633882161,3sleep0180948-21diskmemload0
4384112161,4sleep0180948-21diskmemload0
4142362165,6sleep1180948-21diskmemload1
3899502161,2sleep10-21swapper/11
3893492161,2sleep20-21swapper/22
3400902161,10sleep2340253-21diskstats2
2130982161,2sleep20-21swapper/22
53270991512,1cyclictest0-21swapper/33
5327099150,13cyclictest0-21swapper/33
5327099150,13cyclictest0-21swapper/33
5327099150,11cyclictest0-21swapper/33
5327099150,11cyclictest0-21swapper/33
4555262151,2sleep20-21swapper/22
4470392151,8sleep2180948-21diskmemload2
3625452151,8sleep00-21swapper/00
3386632150,2sleep00-21swapper/00
2886142151,3sleep2180948-21diskmemload2
2736052151,9sleep2273718-21perl2
2727622150,1sleep00-21swapper/00
2637442151,4sleep1180948-21diskmemload1
2035552152,3sleep2180948-21diskmemload2
1938902151,2sleep10-21swapper/11
1288832150,3sleep10-21swapper/11
5327099148,4cyclictest153674-21chrt3
53270991411,2cyclictest0-21swapper/33
5327099141,10cyclictest0-21swapper/33
53270991410,2cyclictest0-21swapper/33
5327099140,2cyclictest0-21swapper/33
5327099140,12cyclictest0-21swapper/33
5327099140,11cyclictest0-21swapper/33
3114462140,2sleep10-21swapper/11
2964512141,7sleep0180948-21diskmemload0
1983612141,9sleep1198496-21gltestperf1
1975232141,1sleep20-21swapper/22
1498292140,3sleep0149825-21apt-get0
1442682141,4sleep2144364-21cat2
5327099130,1cyclictest0-21swapper/33
5327099130,10cyclictest916882sleep33
5153982131,7sleep20-21swapper/22
3976192131,8sleep2397632-21sh2
3708492131,8sleep0370860-21ssh0
3640362131,5sleep20-21swapper/22
3039712131,3sleep1303982-21ssh1
3039712131,3sleep1303982-21ssh1
2876882130,8sleep0180948-21diskmemload0
2718412130,2sleep20-21swapper/22
2451182131,8sleep2245132-21ssh2
1289052131,3sleep2129071-21cstates2
921702122,4sleep191885-21apt-get1
5054792121,7sleep0505489-21ssh0
5054792121,7sleep0505489-21ssh0
4974942121,2sleep10-21swapper/11
4974942121,2sleep10-21swapper/11
4786982121,7sleep0478709-21ssh0
4659562121,6sleep2467046-21cut2
4652192121,7sleep0180948-21diskmemload0
4626452121,7sleep2462659-21ssh2
4311422121,2sleep00-21swapper/00
4282962121,3sleep2428307-21sh2
4210242121,7sleep1421035-21ssh1
4157592121,6sleep0417199-21cut0
4135182121,7sleep0413529-21ssh0
3945072121,7sleep0394754-21unixbench_singl0
3881382121,4sleep00-21swapper/00
3645902121,4sleep172-21kcompactd01
3393432121,7sleep2339354-21ssh2
2706772121,5sleep10-21swapper/11
2373782120,3sleep00-21swapper/00
1976012121,8sleep0180948-21diskmemload0
1801652121,6sleep2180310-21timerandwakeup2
975542111,4sleep297677-21diskstats2
5237712111,4sleep1523776-21apt-get1
4881242110,8sleep2488138-21ssh2
4560252111,5sleep10-21swapper/11
4553552111,4sleep0180948-21diskmemload0
4465192111,6sleep1446531-21ssh1
4403102111,3sleep00-21swapper/00
4393762111,4sleep20-21swapper/22
4304112111,3sleep10-21swapper/11
4135412111,4sleep2180948-21diskmemload2
3873062111,6sleep1387313-21ssh1
3802802111,4sleep0180948-21diskmemload0
3477932111,6sleep1347807-21ssh1
3444712111,5sleep0344664-21users0
3295052111,3sleep10-21swapper/11
3231612111,2sleep00-21swapper/00
3213292111,3sleep20-21swapper/22
3110462111,4sleep2311242-21users2
3041012110,7sleep0180948-21diskmemload0
3041012110,7sleep0180948-21diskmemload0
2948562111,4sleep1180948-21diskmemload1
2531842110,3sleep10-21swapper/11
2445822111,6sleep1244596-21ssh1
2358722111,5sleep2236131-21users2
2116262111,4sleep1180948-21diskmemload1
1980182110,2sleep0198032-21ssh0
1702602111,4sleep172-21kcompactd01
1651302110,1sleep00-21swapper/00
1550272111,3sleep20-21swapper/22
1183892112,4sleep2118408-21apt-get2
874912101,6sleep188960-21tr1
792472101,4sleep280266-21memory2
755952101,5sleep275759-21vmstat2
623242101,5sleep164039-21cut1
5236872101,5sleep0523703-21ssh0
5138832101,2sleep10-21swapper/11
5138832101,2sleep10-21swapper/11
5131442101,4sleep2180948-21diskmemload2
5131442101,4sleep2180948-21diskmemload2
4967782100,2sleep00-21swapper/00
4967782100,2sleep00-21swapper/00
4957792101,2sleep20-21swapper/22
4957792101,2sleep20-21swapper/22
4817582101,4sleep1180948-21diskmemload1
4627782101,5sleep1462789-21ssh1
4382412101,3sleep10-21swapper/11
3786922101,3sleep10-21swapper/11
3737092101,5sleep2373819-21ssh2
3701102101,2sleep20-21swapper/22
3650312101,3sleep10-21swapper/11
3537172101,3sleep10-21swapper/11
3364632101,3sleep10-21swapper/11
3308862101,3sleep20-21swapper/22
3208492101,4sleep1180948-21diskmemload1
3201312100,4sleep00-21swapper/00
3113622101,3sleep0180948-21diskmemload0
3038782100,1sleep20-21swapper/22
3038782100,1sleep20-21swapper/22
2874142101,4sleep1180948-21diskmemload1
2806182101,2sleep10-21swapper/11
2739012101,5sleep0274531-21grep0
2615742101,4sleep2180948-21diskmemload2
2561712101,3sleep00-21swapper/00
2536602101,2sleep20-21swapper/22
2481752101,4sleep0180948-21diskmemload0
2448562101,3sleep00-21swapper/00
2313642101,4sleep1231375-21ssh1
2306692101,4sleep1175424-21kworker/u16:1+nfsiod1
2303902100,5sleep2180948-21diskmemload2
2142392101,4sleep0180948-21diskmemload0
1813202101,3sleep10-21swapper/11
1799892101,4sleep0180041-21ntp_states0
1671122101,5sleep2168837-21kthreadcore2
1643142101,4sleep2164364-21ntp_states2
1544412100,1sleep10-21swapper/11
1445522101,3sleep20-21swapper/22
1131542101,3sleep10-21swapper/11
1131322101,4sleep0113151-21apt-get0
1026032101,4sleep0102622-21apt-get0
97961291,4sleep199284-21cut1
97388290,2sleep00-21swapper/00
92171290,3sleep292193-21apt-get2
85870291,4sleep181621-21/usr/sbin/munin1
76966291,4sleep077599-21grep0
66477291,3sleep166937-21grep1
65952291,4sleep266206-21sh2
58474291,4sleep058886-21sed0
530036290,1sleep20-21swapper/22
516870291,4sleep0518452-21kthreadcore0
515332290,4sleep1515347-21ssh1
503653291,2sleep20-21swapper/22
503653291,2sleep20-21swapper/22
498723291,3sleep1180948-21diskmemload1
498723291,3sleep1180948-21diskmemload1
403202291,2sleep00-21swapper/00
353090291,2sleep20-21swapper/22
294817290,3sleep20-21swapper/22
228767291,2sleep00-21swapper/00
220053291,4sleep0220064-21ssh0
219358291,4sleep1219591-21ssh1
186571291,2sleep00-21swapper/00
186265291,2sleep20-21swapper/22
175724291,4sleep0175745-21latency_hist0
147923291,4sleep1148479-21sed1
146221291,4sleep0147921-21kthreadcore0
107864292,2sleep10-21swapper/11
107568291,4sleep1107647-21munin-run1
91784280,1sleep00-21swapper/00
81642280,2sleep20-21swapper/22
80467280,1sleep10-21swapper/11
175397280,2sleep20-21swapper/22
156760281,3sleep0158508-21grep0
139591281,3sleep1139715-21perl1
125581280,4sleep0127338-21cut0
123623280,2sleep20-21swapper/22
114376281,3sleep20-21swapper/22
97061270,1sleep00-21swapper/00
88961271,3sleep20-21swapper/22
65430270,1sleep20-21swapper/22
55247271,3sleep156998-21kthreadcore1
170787270,2sleep10-21swapper/11
164972270,1sleep10-21swapper/11
144207270,4sleep00-21swapper/00
138975270,1sleep10-21swapper/11
138975270,1sleep10-21swapper/11
123914271,2sleep10-21swapper/11
112737270,1sleep20-21swapper/22
111490271,3sleep00-21swapper/00
86368260,1sleep00-21swapper/00
75784260,1sleep10-21swapper/11
72557261,2sleep00-21swapper/00
58320260,1sleep00-21swapper/00
58317260,4sleep20-21swapper/22
177050260,2sleep10-21swapper/11
165527260,1sleep00-21swapper/00
154402260,1sleep20-21swapper/22
138785260,4sleep20-21swapper/22
138785260,4sleep20-21swapper/22
133620260,1sleep00-21swapper/00
123027260,1sleep10-21swapper/11
122544261,2sleep0122701-21switchtime0
107543260,1sleep20-21swapper/22
70258250,1sleep00-21swapper/00
155317250,1sleep10-21swapper/11
138699250,3sleep00-21swapper/00
138699250,3sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional