You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 20:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Tue Dec 09, 2025 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18093359913860,1382cyclictest18307142sleep33
18093359913401,1334cyclictest22386342sleep33
197877521110,1sleep00-21swapper/00
180933599187,8cyclictest18812982sleep33
19247672173,1sleep30-21swapper/33
1809335991714,1cyclictest0-21swapper/33
1809335991714,1cyclictest0-21swapper/33
1809335991714,1cyclictest0-21swapper/33
1809335991714,1cyclictest0-21swapper/33
1809335991714,1cyclictest0-21swapper/33
1809335991613,1cyclictest0-21swapper/33
1809335991613,1cyclictest0-21swapper/33
180933599161,12cyclictest1919067-21taskset3
180933599161,11cyclictest2213907-21turbostat3
180933599161,11cyclictest2140292-21taskset3
180933599161,11cyclictest2123448-21taskset3
180933599160,12cyclictest2270998-21taskset3
180933599157,5cyclictest2303104-21turbostat3
1809335991513,1cyclictest0-21swapper/33
1809335991512,1cyclictest0-21swapper/33
1809335991512,1cyclictest0-21swapper/33
180933599151,11cyclictest2238124-21turbostat3
180933599151,11cyclictest2095263-21taskset3
180933599151,11cyclictest2095263-21taskset3
180933599147,4cyclictest1815417-21taskset3
180933599145,6cyclictest2251994-21taskset3
180933599145,6cyclictest21749422sleep33
180933599144,7cyclictest1943045-21taskset3
180933599144,7cyclictest1829942-21taskset3
1809335991413,0cyclictest0-21swapper/33
1809335991413,0cyclictest0-21swapper/33
1809335991412,1cyclictest0-21swapper/33
1809335991412,1cyclictest0-21swapper/33
1809335991412,1cyclictest0-21swapper/33
1809335991412,0cyclictest0-21swapper/33
1809335991411,1cyclictest0-21swapper/33
1809335991411,1cyclictest0-21swapper/33
1809335991411,1cyclictest0-21swapper/33
180933599141,10cyclictest2188572-21taskset3
180933599141,10cyclictest2081742-21taskset3
180933599141,10cyclictest2074613-21taskset3
180933599141,10cyclictest2060630-21taskset3
180933599141,10cyclictest2023718-21taskset3
180933599141,10cyclictest1963807-21taskset3
180933599141,10cyclictest1931583-21taskset3
180933599140,11cyclictest2133384-21turbostat3
22628132131,3sleep22262852-21apt-get2
20522892130,5sleep12052294-21sh1
19934622132,8sleep01993601-21/usr/sbin/munin0
180933599134,7cyclictest2278866-21taskset3
180933599134,7cyclictest2157766-21taskset3
180933599133,7cyclictest2155665-21taskset3
180933599132,8cyclictest2256535-21chrt3
180933599131,9cyclictest2228616-21chrt3
180933599131,9cyclictest1946388-21taskset3
1809335991311,1cyclictest0-21swapper/33
1809335991311,1cyclictest0-21swapper/33
1809335991311,1cyclictest0-21swapper/33
1809335991311,1cyclictest0-21swapper/33
180933599131,10cyclictest2147960-21taskset3
1809335991310,1cyclictest0-21swapper/33
1809335991310,1cyclictest0-21swapper/33
1809335991310,1cyclictest0-21swapper/33
180933599130,10cyclictest2044597-21taskset3
19386512120,4sleep11938199-21apt-get1
19195172121,7sleep11919550-21apt-get1
190898120,8rtkit-daemon2236146-21ssh0
190898120,4rtkit-daemon1815676-21munin-node0
180933599129,1cyclictest0-21swapper/33
180933599123,7cyclictest2198228-21taskset3
180933599121,9cyclictest1963410-21taskset3
180933599121,8cyclictest2214693-21taskset3
180933599121,8cyclictest2057766-21taskset3
180933599121,8cyclictest1980034-21taskset3
180933599120,9cyclictest2189940-21taskset3
180933599120,10cyclictest2279207-21taskset3
22548802110,1sleep12254919-21apt-get1
22296022111,7sleep02229610-21ssh0
22138852111,7sleep02214099-21cat0
19778092110,4sleep10-21swapper/11
19627242110,8sleep21962828-21awk2
190898110,3rtkit-daemon667-21snmpd1
190898110,2rtkit-daemon0-21swapper/11
21819712102,4sleep22181993-21apt-get2
21716442100,7sleep02171650-21ssh0
21011962101,5sleep22101233-21apt-get2
20767972102,4sleep02076830-21apt-get0
19451192100,1sleep01945212-21/usr/sbin/munin0
190898100,6rtkit-daemon2136471-21grep0
190898100,6rtkit-daemon2092238-21chrt0
190898100,5rtkit-daemon667-21snmpd0
190898100,5rtkit-daemon2133408-21ssh0
190898100,5rtkit-daemon2118575-21irqrtprio1
190898100,4rtkit-daemon2058613-21ssh0
190898100,3rtkit-daemon2155786-21ssh2
190898100,3rtkit-daemon2068361-21ssh0
18876012101,5sleep01887756-21diskstats0
18876012101,5sleep01887756-21diskstats0
18099422100,7sleep01810846-21sed0
2298095292,4sleep02300241-21grep0
2286788290,1sleep10-21swapper/11
2237939290,7sleep12237946-21sh1
2215695291,6sleep02217141-21tr0
2086564291,5sleep10-21swapper/11
2068102291,6sleep12068108-21ssh1
2035765290,6sleep02035773-21ssh0
2001552290,6sleep12001667-21find1
19089890,5rtkit-daemon2260857-21ssh2
19089890,5rtkit-daemon1932174-21apt-get1
19089890,5rtkit-daemon1815676-21munin-node0
19089890,4rtkit-daemon438-21wpa_supplicant2
19089890,4rtkit-daemon2020013-21ssh0
19089890,4rtkit-daemon1802746-21apt-get1
19089890,1rtkit-daemon0-21swapper/11
1906823290,6sleep01906962-21tail0
1851133290,7sleep21852829-21cut2
1831813291,2sleep00-21swapper/00
1830239290,6sleep21830224-21apt-get2
1830211292,4sleep11830226-21munin-run1
1809535290,7sleep11809500-21/usr/sbin/munin1
2239407281,4sleep10-21swapper/11
2230377281,3sleep22230415-21apt-get2
2222825281,4sleep12223782-21sed1
2206182281,3sleep22206221-21apt-get2
2206113280,5sleep12206121-21ssh1
2188940280,6sleep12188947-21sh1
2173927281,3sleep22173966-21apt-get2
2156729280,5sleep02156737-21ssh0
2141941281,4sleep02142059-21ssh0
2133923280,5sleep22134129-21hddtemp_smartct2
2126015281,4sleep22126242-21sed2
2116948280,1sleep20-21swapper/22
2100854280,2sleep10-21swapper/11
2100854280,2sleep10-21swapper/11
2078262280,5sleep12079879-21ps1
2060374280,5sleep12060399-21munin-run1
2056978280,5sleep20-21swapper/22
2012390280,2sleep20-21swapper/22
2009510280,6sleep02009581-21ssh0
1978946281,2sleep20-21swapper/22
1962965281,4sleep01963182-21users0
1918076281,4sleep21918153-21ntp_states2
19089880,5rtkit-daemon2156558-21ssh1
19089880,5rtkit-daemon1928-21sendmail-mta1
19089880,5rtkit-daemon1928-21sendmail-mta0
19089880,5rtkit-daemon1815676-21munin-node1
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon667-21snmpd1
19089880,4rtkit-daemon438-21wpa_supplicant1
19089880,4rtkit-daemon2287301-21ssh1
19089880,4rtkit-daemon2244094-21systemctl0
19089880,4rtkit-daemon2124145-21ssh0
19089880,4rtkit-daemon2115206-21ssh1
19089880,4rtkit-daemon1965276-21sed1
19089880,4rtkit-daemon1815676-21munin-node2
19089880,4rtkit-daemon1815676-21munin-node1
19089880,4rtkit-daemon1815676-21munin-node1
19089880,4rtkit-daemon1815676-21munin-node1
19089880,4rtkit-daemon1815676-21munin-node0
19089880,4rtkit-daemon1815676-21munin-node0
19089880,4rtkit-daemon1815676-21munin-node0
19089880,3rtkit-daemon2171079-21ntpq1
19089880,1rtkit-daemon0-21swapper/11
19089880,1rtkit-daemon0-21swapper/11
19089880,1rtkit-daemon0-21swapper/00
1856598281,4sleep21857315-21irqrtprio2
1856366281,5sleep01856396-21fschecks_count0
1815719280,5sleep01817171-21kthreadcore0
1803438281,4sleep30-21swapper/33
2285832271,3sleep02285834-21ssh0
2279778270,4sleep22280780-21ps2
2278456270,1sleep20-21swapper/22
2240386270,5sleep22242413-21kthreadcore2
2221637271,4sleep1667-21snmpd1
2190182271,3sleep12190367-21gltestperf1
2173379270,3sleep22173387-21ssh2
2161596270,4sleep02162842-21memory0
2157784270,5sleep22157790-21ssh2
2149272270,1sleep20-21swapper/22
2147207271,3sleep12147454-21head1
2131521270,5sleep12131528-21sh1
2107964271,3sleep02107972-21ssh0
2094155270,5sleep22095261-21cut2
2094155270,5sleep22095261-21cut2
2035464270,5sleep2667-21snmpd2
1964354270,4sleep01965057-21cut0
19089870,4rtkit-daemon674-21lldpd1
19089870,4rtkit-daemon667-21snmpd1
19089870,4rtkit-daemon667-21snmpd1
19089870,4rtkit-daemon1815676-21munin-node1
19089870,4rtkit-daemon1815676-21munin-node0
19089870,4rtkit-daemon0-21swapper/11
19089870,3rtkit-daemon671-21ntpd1
19089870,3rtkit-daemon667-21snmpd1
19089870,3rtkit-daemon667-21snmpd0
19089870,3rtkit-daemon421-21avahi-daemon1
19089870,3rtkit-daemon2020410-21ssh0
19089870,3rtkit-daemon1963563-21diskmemload0
19089870,3rtkit-daemon1868501-21systemd-run1
19089870,3rtkit-daemon1844775-21kthreadcore1
1887563270,4sleep21887567-21find2
1887563270,4sleep21887567-21find2
1811995270,4sleep21814162-21cut2
2302235260,3sleep22302241-21ssh2
2294357260,3sleep02294365-21ssh0
2263035260,3sleep12263240-21hddtemp_smartct1
2260663260,1sleep00-21swapper/00
2228419260,1sleep20-21swapper/22
2221485260,1sleep20-21swapper/22
2197615260,4sleep20-21swapper/22
2117964260,4sleep22118241-21irqcore2
2107878260,1sleep10-21swapper/11
2090429260,4sleep22090525-21/usr/sbin/munin2
2076031260,1sleep10-21swapper/11
2075894260,1sleep20-21swapper/22
2067378260,1sleep20-21swapper/22
2051321260,1sleep20-21swapper/22
2043926260,4sleep10-21swapper/11
2034608260,1sleep10-21swapper/11
2027987260,1sleep20-21swapper/22
2002530260,1sleep20-21swapper/22
1995414260,1sleep20-21swapper/22
1986614260,1sleep00-21swapper/00
1938880260,4sleep21938922-21fschecks_count2
1938701261,2sleep00-21swapper/00
1925270260,1sleep00-21swapper/00
19089860,3rtkit-daemon667-21snmpd0
19089860,3rtkit-daemon1928-21sendmail-mta1
1882875260,3sleep01884942-21cut0
1880308260,3sleep01880434-21sed0
1855401260,1sleep00-21swapper/00
1838210261,3sleep01839408-21kthreadcore0
1837233261,3sleep20-21swapper/22
1823696260,1sleep20-21swapper/22
1808343260,3sleep21808384-21ps2
2271211251,1sleep10-21swapper/11
2253366250,1sleep10-21swapper/11
2248874250,3sleep02250736-21ssh0
2199061251,2sleep20-21swapper/22
2135414251,2sleep10-21swapper/11
2110245250,3sleep02110760-21kthreadcore0
2042557250,3sleep20-21swapper/22
2017835250,2sleep10-21swapper/11
2010750250,3sleep20-21swapper/22
2005757251,2sleep10-21swapper/11
1986027250,3sleep20-21swapper/22
1970851252,1sleep20-21swapper/22
1952683251,2sleep20-21swapper/22
1931799250,1sleep20-21swapper/22
1931230250,2sleep0221rcuc/00
1918966250,1sleep00-21swapper/00
1901627251,2sleep00-21swapper/00
1875769251,2sleep21876652-21kthreadcore2
1868415250,1sleep20-21swapper/22
1843283250,3sleep01843315-21/usr/sbin/munin0
1826317251,2sleep00-21swapper/00
1824169250,2sleep20-21swapper/22
2204713241,1sleep10-21swapper/11
2180293240,3sleep10-21swapper/11
2084149241,1sleep20-21swapper/22
1956937240,3sleep00-21swapper/00
1944934240,1sleep20-21swapper/22
1924714240,2sleep21924766-21/usr/sbin/munin2
1906631240,1sleep20-21swapper/22
1900604240,2sleep21900812-21idleruntime2
1899588240,3sleep00-21swapper/00
1893851240,1sleep20-21swapper/22
1881681240,1sleep20-21swapper/22
1870665240,2sleep21872773-21grep2
1868714241,1sleep00-21swapper/00
1845154240,2sleep2421rcuc/22
1807993240,1sleep00-21swapper/00
1937495230,1sleep00-21swapper/00
1933461230,1sleep20-21swapper/22
1862474230,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional