You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 19:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Fri Mar 20, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222531921240,2sleep1321rcuc/11
1794287212162,55sleep30-21swapper/33
179422128655,12sleep10-21swapper/11
178972628154,14sleep00-21swapper/00
178954327755,13sleep20-21swapper/22
1794643992522,1cyclictest0-21swapper/33
179464399241,20cyclictest0-21swapper/33
179464399238,12cyclictest0-21swapper/33
179464399232,15cyclictest1952193-21chrt3
1794643992320,1cyclictest0-21swapper/33
1794643992320,1cyclictest0-21swapper/33
1794643992320,1cyclictest0-21swapper/33
179464399231,17cyclictest0-21swapper/33
22910162222,7sleep22291073-21ntpq2
22046062222,9sleep21925440-21diskmemload2
179464399229,1cyclictest0-21swapper/33
1794643992218,2cyclictest0-21swapper/33
1794643992118,2cyclictest0-21swapper/33
1794643992118,1cyclictest0-21swapper/33
1794643992118,1cyclictest0-21swapper/33
1794643992118,1cyclictest0-21swapper/33
1794643992116,2cyclictest0-21swapper/33
20002592201,3sleep10-21swapper/11
1794643992018,1cyclictest0-21swapper/33
1794643992017,1cyclictest0-21swapper/33
179464399201,6cyclictest2057262-21sleep3
1794643992016,2cyclictest0-21swapper/33
1794643992016,2cyclictest0-21swapper/33
1794643992015,2cyclictest0-21swapper/33
179464399201,16cyclictest0-21swapper/33
179464399201,15cyclictest0-21swapper/33
179464399201,15cyclictest0-21swapper/33
1794643992010,6cyclictest1799905-21taskset3
1794643992010,6cyclictest1799905-21taskset3
21445262191,2sleep00-21swapper/00
20356222191,4sleep02035774-21ssh0
20183112198,3sleep2171rcu_preempt2
1794643991916,2cyclictest0-21swapper/33
1794643991916,1cyclictest0-21swapper/33
1794643991916,1cyclictest0-21swapper/33
1794643991915,2cyclictest0-21swapper/33
1794643991915,2cyclictest0-21swapper/33
1794643991914,2cyclictest0-21swapper/33
1794643991912,5cyclictest0-21swapper/33
1794643991912,4cyclictest0-21swapper/33
179464399191,15cyclictest0-21swapper/33
179464399191,14cyclictest0-21swapper/33
179464399190,3cyclictest0-21swapper/33
20017342181,2sleep20-21swapper/22
19858632180,6sleep10-21swapper/11
1794643991815,2cyclictest0-21swapper/33
1794643991815,1cyclictest0-21swapper/33
1794643991814,2cyclictest0-21swapper/33
1794643991814,2cyclictest0-21swapper/33
1794643991814,2cyclictest0-21swapper/33
1794643991814,2cyclictest0-21swapper/33
1794643991814,2cyclictest0-21swapper/33
179464399181,14cyclictest0-21swapper/33
179464399181,14cyclictest0-21swapper/33
179464399180,14cyclictest0-21swapper/33
179464399180,14cyclictest0-21swapper/33
22248862170,11sleep22224899-21apt-get2
21966072171,3sleep00-21swapper/00
21688332171,7sleep11925440-21diskmemload1
21613702171,5sleep11925440-21diskmemload1
21442382171,3sleep20-21swapper/22
21148732171,3sleep00-21swapper/00
20648022171,3sleep00-21swapper/00
19345782171,5sleep01934840-21df0
1794643991714,1cyclictest0-21swapper/33
1794643991714,1cyclictest0-21swapper/33
179464399171,3cyclictest1866103-21taskset3
1794643991713,1cyclictest0-21swapper/33
1794643991711,3cyclictest1834409-21taskset3
179464399171,13cyclictest0-21swapper/33
179464399171,12cyclictest1893697-21chrt3
179464399170,14cyclictest0-21swapper/33
22133282161,3sleep20-21swapper/22
20285092161,3sleep00-21swapper/00
20145902161,11sleep02016158-21ssh0
1794643991614,1cyclictest0-21swapper/33
179464399161,3cyclictest0-21swapper/33
1794643991613,1cyclictest0-21swapper/33
1794643991612,2cyclictest0-21swapper/33
179464399160,13cyclictest0-21swapper/33
22746072151,8sleep11925440-21diskmemload1
22680622151,3sleep20-21swapper/22
22414482151,10sleep22241461-21ssh2
22397012151,4sleep02239712-21ssh0
22054032151,3sleep01925440-21diskmemload0
19521592153,6sleep21952183-21apt-get2
19137022152,7sleep11913735-21ntpq1
179464399153,1cyclictest0-21swapper/33
1794643991513,1cyclictest0-21swapper/33
1794643991512,2cyclictest0-21swapper/33
1794643991512,2cyclictest0-21swapper/33
1794643991512,1cyclictest0-21swapper/33
22582772141,2sleep20-21swapper/22
22280742141,7sleep02228874-21memory0
22232442141,3sleep20-21swapper/22
21261832141,9sleep02126197-21ssh0
21001582141,6sleep02100170-21ssh0
20453042141,4sleep02045318-21ssh0
20288362141,9sleep22028850-21ssh2
20198612141,8sleep11925440-21diskmemload1
19668162141,7sleep11925440-21diskmemload1
179464399147,4cyclictest18220992sleep33
179464399140,11cyclictest0-21swapper/33
22867502131,7sleep01925440-21diskmemload0
22684112131,7sleep11925440-21diskmemload1
22516502131,2sleep00-21swapper/00
22481182130,8sleep21925440-21diskmemload2
22132622131,6sleep10-21swapper/11
21873892130,3sleep20-21swapper/22
21352152131,4sleep02135217-21ssh0
21147582131,5sleep22114815-21ntpq2
21078372131,3sleep11925440-21diskmemload1
21053482131,3sleep20-21swapper/22
20403372131,6sleep11925440-21diskmemload1
20366592130,8sleep21925440-21diskmemload2
20365492131,7sleep11925440-21diskmemload1
20119882131,8sleep22012000-21sh2
20102762131,3sleep02010288-21ssh0
19876342131,8sleep01987824-21ssh0
19859232131,6sleep20-21swapper/22
19649292131,8sleep01965034-21tail0
19586432131,8sleep01958655-21ssh0
19320742131,7sleep11925440-21diskmemload1
19309502131,7sleep01925440-21diskmemload0
18600402131,6sleep11860088-21ntpq1
18307002131,8sleep00-21swapper/00
22857192121,6sleep21925440-21diskmemload2
22832572121,8sleep12283272-21ssh1
22756582121,5sleep00-21swapper/00
21884462121,6sleep11925440-21diskmemload1
21628272120,2sleep02162840-21rm0
21461982121,3sleep20-21swapper/22
20660602121,3sleep20-21swapper/22
20491132121,7sleep02049335-21head0
20017612121,6sleep01925440-21diskmemload0
19775232121,7sleep11925440-21diskmemload1
19715602127,2sleep20-21swapper/22
19489062121,5sleep00-21swapper/00
19398402121,7sleep11925440-21diskmemload1
19155902121,7sleep01915009-21/usr/sbin/munin0
19029972121,5sleep11903045-21ntpq1
18459412121,2sleep10-21swapper/11
17999262121,6sleep11800245-21cat1
17999262121,6sleep11800245-21cat1
17992292121,7sleep21799300-21find2
17992292121,7sleep21799300-21find2
22924532111,4sleep11925440-21diskmemload1
22757252111,5sleep21925440-21diskmemload2
22377272112,5sleep12237789-21ntpq1
22044392110,5sleep11925440-21diskmemload1
21952732111,4sleep20-21swapper/22
21871652110,2sleep00-21swapper/00
21779212111,3sleep10-21swapper/11
21511002111,7sleep10-21swapper/11
21340752111,5sleep21925440-21diskmemload2
21338562111,4sleep11925440-21diskmemload1
20975612111,5sleep22097710-21ssh2
20920102110,1sleep20-21swapper/22
20910742111,5sleep11925440-21diskmemload1
20883942111,5sleep02088456-21ntpq0
20829892111,3sleep20-21swapper/22
20794072111,4sleep02079468-21collect20
20747682111,5sleep02074800-21munin-run0
20741142111,6sleep11925440-21diskmemload1
20651212111,3sleep10-21swapper/11
20637052111,3sleep20-21swapper/22
20528982111,5sleep12053000-21ntpq1
19842452111,3sleep00-21swapper/00
19580892111,3sleep10-21swapper/11
19507202110,6sleep11950731-21ssh1
19497122111,3sleep20-21swapper/22
19310312110,1sleep20-21swapper/22
19217422111,7sleep11923529-21cut1
18990232111,6sleep20-21swapper/22
18812872111,5sleep11881428-21ntpq1
18347322111,5sleep01834984-21df0
18289592111,6sleep272-21kcompactd02
18202582111,7sleep21822098-21tr2
17952792111,5sleep01795395-21irqstats0
17952792111,5sleep01795395-21irqstats0
22643512100,4sleep02264407-21ntpq0
22552592101,4sleep12255320-21ntpq1
22212982101,3sleep11925440-21diskmemload1
22147272100,1sleep00-21swapper/00
21764072101,4sleep02176468-21ntpq0
21606062101,2sleep20-21swapper/22
21525702101,3sleep00-21swapper/00
21413522101,4sleep12141421-21ntp_states1
21277762100,5sleep190-21kswapd01
21253912101,5sleep22125403-21sh2
21099152101,3sleep00-21swapper/00
20985372101,3sleep11925440-21diskmemload1
20530012101,4sleep22053058-21ntpq2
20440152101,2sleep20-21swapper/22
20301622100,4sleep11925440-21diskmemload1
20098802101,3sleep11925440-21diskmemload1
19924122101,4sleep11925440-21diskmemload1
19872592101,6sleep21987525-21df2
19766062101,4sleep01925440-21diskmemload0
19388772101,4sleep21925440-21diskmemload2
18936752102,3sleep21893694-21apt-get2
18664402101,4sleep11866488-21munin-run1
18563112101,4sleep01856520-21hddtemp_smartct0
18441332101,4sleep01844184-21ntpq0
18296402101,4sleep11829743-21perl1
18289522100,5sleep01828866-31find0
18238652101,5sleep11824126-21df_inode1
18024892101,3sleep072-21kcompactd00
2283496291,3sleep01925440-21diskmemload0
2247072291,4sleep12247248-21vmstat1
2242293291,3sleep01925440-21diskmemload0
2221382291,3sleep00-21swapper/00
2194949291,3sleep11925440-21diskmemload1
2168645291,2sleep20-21swapper/22
2168239291,2sleep00-21swapper/00
2115853291,4sleep12115865-21ssh1
2082518291,4sleep12082531-21sh1
1965134291,2sleep20-21swapper/22
1913737291,4sleep21913783-21ntpq2
1899290291,4sleep01899500-21hddtemp_smartct0
1887152291,4sleep01887399-21uptime0
1873309291,4sleep01875061-21cut0
1873309291,4sleep01875061-21cut0
1865495291,3sleep21865552-21ntp_states2
1845359291,3sleep01845378-21apt-get0
1822578291,3sleep11822627-21ntpq1
1813184290,2sleep10-21swapper/11
1812039291,4sleep01812159-21gzip0
2178027281,3sleep22178042-21ssh2
1920641281,3sleep21920744-21/usr/sbin/munin2
1919147281,2sleep11919201-21ntpq1
1914719280,1sleep00-21swapper/00
1889042281,3sleep11890733-21grep1
1888311281,2sleep00-21swapper/00
1882177280,2sleep20-21swapper/22
1877683281,3sleep00-21swapper/00
1866701281,2sleep00-21swapper/00
1856043281,4sleep21856156-21cpuspeed_turbos2
1851424281,3sleep01853116-21grep0
1844411281,4sleep11844671-21sed1
1920361271,2sleep01920379-21apt-get0
1904310270,2sleep20-21swapper/22
1887723270,4sleep20-21swapper/22
1876807270,1sleep10-21swapper/11
1876807270,1sleep10-21swapper/11
1871709270,1sleep10-21swapper/11
1870850271,2sleep20-21swapper/22
1855692270,1sleep10-21swapper/11
1833306271,3sleep21833430-21ntpq2
1813473271,3sleep00-21swapper/00
1807860270,2sleep21807878-21apt-get2
1807858270,1sleep10-21swapper/11
1806916270,3sleep11807154-21unixbench_singl1
1800246271,2sleep21799934-21apt-get2
1919209260,3sleep20-21swapper/22
1909103260,4sleep10-21swapper/11
1909044260,4sleep00-21swapper/00
1898592260,1sleep00-21swapper/00
1898243260,2sleep10-21swapper/11
1893100260,4sleep20-21swapper/22
1876891260,1sleep20-21swapper/22
1876891260,1sleep20-21swapper/22
1861341260,4sleep00-21swapper/00
1849721261,2sleep20-21swapper/22
1839463260,1sleep10-21swapper/11
1818966260,2sleep00-21swapper/00
1818136260,4sleep20-21swapper/22
1854892250,1sleep20-21swapper/22
1843939250,1sleep20-21swapper/22
1839745250,1sleep20-21swapper/22
1882709240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional