You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 03:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Sun Jan 04, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18726339912570,1253cyclictest22162392sleep33
18726339911500,1146cyclictest19394862sleep33
18726339910310,1027cyclictest2113035-21sleep3
1872633994105,402cyclictest2003784-21turbostat3
1872633992873,281cyclictest2280439-21turbostat3
223555321510,147sleep02158187-21kworker/u16:0+efi_rts_wq0
1872633992421,1cyclictest0-21swapper/33
1872633992018,1cyclictest0-21swapper/33
1872633991714,1cyclictest0-21swapper/33
187263399171,12cyclictest2080973-21turbostat3
18718632171,5sleep21872107-21uptime2
187263399166,7cyclictest1878999-21turbostat3
187263399165,8cyclictest2241804-21taskset3
1872633991613,1cyclictest0-21swapper/33
1872633991613,1cyclictest0-21swapper/33
18782142150,5sleep1331ktimers/11
1872633991513,1cyclictest0-21swapper/33
1872633991513,1cyclictest0-21swapper/33
1872633991512,1cyclictest0-21swapper/33
1872633991512,1cyclictest0-21swapper/33
1872633991512,1cyclictest0-21swapper/33
1872633991512,1cyclictest0-21swapper/33
187263399151,11cyclictest2287173-21taskset3
187263399151,11cyclictest2158482-21chrt3
187263399151,11cyclictest2094032-21taskset3
187263399151,11cyclictest1879347-21taskset3
187263399144,7cyclictest1926930-21taskset3
187263399143,8cyclictest1984714-21taskset3
1872633991413,0cyclictest0-21swapper/33
1872633991413,0cyclictest0-21swapper/33
1872633991413,0cyclictest0-21swapper/33
1872633991412,1cyclictest0-21swapper/33
1872633991412,1cyclictest0-21swapper/33
1872633991412,1cyclictest0-21swapper/33
1872633991412,0cyclictest0-21swapper/33
1872633991411,1cyclictest0-21swapper/33
1872633991411,1cyclictest0-21swapper/33
1872633991411,1cyclictest0-21swapper/33
1872633991411,1cyclictest0-21swapper/33
187263399141,10cyclictest2280092-21taskset3
187263399141,10cyclictest2248686-21taskset3
187263399141,10cyclictest2248047-21taskset3
187263399141,10cyclictest2235114-21taskset3
187263399141,10cyclictest2197352-21taskset3
187263399141,10cyclictest2184159-21taskset3
187263399141,10cyclictest2177790-21taskset3
187263399141,10cyclictest2153512-21taskset3
187263399141,10cyclictest2015524-21taskset3
187263399141,10cyclictest1926399-21chrt3
187263399141,10cyclictest1893994-21turbostat3
187263399140,11cyclictest2029823-21taskset3
187263399131,9cyclictest2293832-21taskset3
187263399131,9cyclictest1971980-21taskset3
1872633991312,0cyclictest0-21swapper/33
1872633991312,0cyclictest0-21swapper/33
1872633991312,0cyclictest0-21swapper/33
1872633991312,0cyclictest0-21swapper/33
1872633991312,0cyclictest0-21swapper/33
187263399131,10cyclictest2145365-21turbostat3
187263399131,10cyclictest2067895-21chrt3
187263399131,10cyclictest2035876-21taskset3
1872633991310,1cyclictest0-21swapper/33
1872633991310,1cyclictest0-21swapper/33
187263399130,6cyclictest0-21swapper/33
187263399130,10cyclictest2068390-21taskset3
187263399130,10cyclictest2020761-21taskset3
187263399130,10cyclictest1939849-21taskset3
301798120,5rtkit-daemon2251051-21kthreadcore2
202307521210,1sleep01920336-21kworker/0:1+kacpid0
187263399123,7cyclictest2132174-21taskset3
187263399121,9cyclictest2215843-21chrt3
187263399121,9cyclictest2042329-21taskset3
21325122110,8sleep12132719-21wc1
19942682110,1sleep00-21swapper/00
19399632111,7sleep01940142-21gltestperf0
301798100,5rtkit-daemon2145653-21apt-get2
301798100,5rtkit-daemon2125869-21munin-run2
301798100,5rtkit-daemon2029929-21apt-get0
301798100,5rtkit-daemon1888030-21df_inode0
21649302101,5sleep02164963-21apt-get0
21263732101,5sleep02126406-21apt-get0
30179890,5rtkit-daemon636-21snmpd0
30179890,5rtkit-daemon448-21wpa_supplicant2
30179890,5rtkit-daemon3205-21sendmail-mta2
30179890,5rtkit-daemon317-21systemd-udevd2
30179890,5rtkit-daemon1879133-21munin-node0
30179890,5rtkit-daemon0-21swapper/00
30179890,4rtkit-daemon2255229-21df_inode2
30179890,4rtkit-daemon2178215-21if_eno12
30179890,4rtkit-daemon2049562-21hddtemp_smartct0
30179890,4rtkit-daemon1893993-21apt-get0
30179890,4rtkit-daemon1893993-21apt-get0
30179890,4rtkit-daemon1879133-21munin-node0
30179890,3rtkit-daemon3200908-21packagekitd0
30179890,1rtkit-daemon0-21swapper/00
2261475291,4sleep22261508-21apt-get2
2140675290,6sleep12142591-21cut1
2128349290,6sleep22130373-21grep2
2109995291,6sleep22110475-21kthreadcore2
2100838291,5sleep00-21swapper/00
2074475295,2sleep0376-21hwrng0
2061551291,2sleep00-21swapper/00
2029635290,6sleep22029822-21sed2
2023539291,4sleep12023694-21diskstats1
2023514291,4sleep02023536-21apt-get0
2012141290,6sleep12013370-21cut1
1971486295,3sleep0376-21hwrng0
1927140290,6sleep01927337-21/usr/sbin/munin0
1920549291,4sleep11920582-21apt-get1
30179880,5rtkit-daemon317-21systemd-udevd1
30179880,4rtkit-daemon667-21lldpd2
30179880,4rtkit-daemon667-21lldpd2
30179880,4rtkit-daemon667-21lldpd0
30179880,4rtkit-daemon667-21lldpd0
30179880,4rtkit-daemon638-21ntpd2
30179880,4rtkit-daemon636-21snmpd2
30179880,4rtkit-daemon636-21snmpd0
30179880,4rtkit-daemon492-21gmain2
30179880,4rtkit-daemon448-21wpa_supplicant0
30179880,4rtkit-daemon441-21rsyslogd0
30179880,4rtkit-daemon3205-21sendmail-mta1
30179880,4rtkit-daemon3205-21sendmail-mta0
30179880,4rtkit-daemon297-21systemd-journal2
30179880,4rtkit-daemon2066134-21kthreadcore0
30179880,4rtkit-daemon2000526-21cut0
30179880,4rtkit-daemon1934449-21irqrtprio1
30179880,4rtkit-daemon1879133-21munin-node2
30179880,4rtkit-daemon1879133-21munin-node2
30179880,4rtkit-daemon1879133-21munin-node2
30179880,4rtkit-daemon1879133-21munin-node1
30179880,4rtkit-daemon1879133-21munin-node0
30179880,1rtkit-daemon0-21swapper/22
30179880,1rtkit-daemon0-21swapper/00
2274280280,4sleep12274313-21apt-get1
2255509281,4sleep12256496-21irqstats1
2197049281,3sleep02197081-21apt-get0
2176779280,1sleep00-21swapper/00
2166231280,5sleep12167345-21kthreadcore1
2157136281,4sleep12157298-21head1
2145657281,4sleep02145806-21df_inode0
2118527280,4sleep12118577-21ntp_states1
2049558280,5sleep12049741-21irqcore1
2036308281,3sleep12036341-21apt-get1
2035468281,4sleep22035684-21users2
1997653280,4sleep11997793-21diskstats1
1934628280,5sleep21935743-21cut2
1902183280,5sleep21903331-21cut2
30179870,4rtkit-daemon667-21lldpd2
30179870,4rtkit-daemon492-21gmain2
30179870,4rtkit-daemon3200908-21packagekitd2
30179870,4rtkit-daemon1879133-21munin-node1
30179870,3rtkit-daemon638-21ntpd2
30179870,3rtkit-daemon636-21snmpd2
30179870,3rtkit-daemon636-21snmpd0
30179870,3rtkit-daemon492-21gmain2
30179870,3rtkit-daemon2279923-21/usr/sbin/munin2
30179870,3rtkit-daemon2191041-21cat2
30179870,3rtkit-daemon1879133-21munin-node2
30179870,3rtkit-daemon1879133-21munin-node2
30179870,3rtkit-daemon1879133-21munin-node2
30179870,1rtkit-daemon0-21swapper/22
2293563270,4sleep12293718-21diskstats1
2289827270,4sleep02291975-21kthreadcore0
2179217270,5sleep02180912-21kthreadcore0
2176499270,4sleep12176625-21sed1
2172800270,5sleep22174053-21cat2
2158495270,4sleep12158525-21awk1
2144439270,5sleep00-21swapper/00
2119738270,4sleep02119787-21cpuspeed_turbos0
2100179270,4sleep12100325-21sed1
2089047270,4sleep12090440-21tr1
2066697271,3sleep22067095-21memory2
2003818270,3sleep22003770-21apt-get2
1991183271,4sleep11991203-21awk1
1979803270,4sleep11981656-21cut1
1959057270,3sleep11959090-21apt-get1
1953624270,4sleep01954630-21cut0
1919761270,4sleep21919926-21users2
1893059270,4sleep21893130-21ntp_states2
1872792270,3sleep21872825-21apt-get2
1866568271,3sleep01866617-21fschecks_count0
1866420270,4sleep30-21swapper/33
30179860,3rtkit-daemon636-21snmpd0
2280672261,2sleep02280705-21apt-get0
2261664260,3sleep02261777-21perl0
2248836261,2sleep02248925-21fschecks_time0
2242193260,3sleep02242226-21apt-get0
2229116261,3sleep12229259-21df1
2229070260,1sleep00-21swapper/00
2228610260,1sleep00-21swapper/00
2215830260,1sleep00-21swapper/00
2209587260,1sleep10-21swapper/11
2204916261,3sleep02206379-21cat0
2186350260,4sleep02188435-21cut0
2132954260,3sleep02133015-21cut0
2106897260,3sleep12106848-21/usr/sbin/munin1
2101376260,3sleep12102187-21cut1
2076309260,4sleep22078130-21kthreadcore2
2035735260,1sleep10-21swapper/11
2010879260,3sleep22010991-21fw_packets2
2010130260,1sleep10-21swapper/11
2000740260,3sleep22002657-21latency2
1991204260,2sleep20-21swapper/22
1987400260,4sleep11987882-21kthreadcore1
1978042260,3sleep21978043-21sshd2
1972290260,4sleep11972381-21irqcore1
1952222260,1sleep00-21swapper/00
1937869261,2sleep00-21swapper/00
1888237260,3sleep11888398-21irqcore1
1881597261,3sleep11881797-21hddtemp_smartct1
2280351250,1sleep00-21swapper/00
2267854250,1sleep10-21swapper/11
2267375250,1sleep10-21swapper/11
2261174250,3sleep00-21swapper/00
2253090250,2sleep12253756-21missed_timers1
2222662250,1sleep10-21swapper/11
2218950250,2sleep10-21swapper/11
2217712251,2sleep00-21swapper/00
2190984250,3sleep02191295-21cut0
2183873250,1sleep10-21swapper/11
2163863250,2sleep02163985-21sensors_temp0
2138165250,2sleep10-21swapper/11
2112681250,3sleep00-21swapper/00
2095680250,2sleep02097704-21kthreadcore0
2093645250,1sleep00-21swapper/00
2087113250,3sleep10-21swapper/11
2074483250,1sleep20-21swapper/22
2068126250,2sleep10-21swapper/11
2061443250,1sleep10-21swapper/11
2044750250,2sleep22046819-21kthreadcore2
2036344251,2sleep20-21swapper/22
2023040250,1sleep20-21swapper/22
1958520250,1sleep20-21swapper/22
1947300250,2sleep20-21swapper/22
1945865250,1sleep20-21swapper/22
1926974251,2sleep20-21swapper/22
1913761250,1sleep20-21swapper/22
1901145250,2sleep10-21swapper/11
1900325250,1sleep10-21swapper/11
1900325250,1sleep10-21swapper/11
1900274250,1sleep20-21swapper/22
1900274250,1sleep20-21swapper/22
1881798250,2sleep20-21swapper/22
1872471250,1sleep10-21swapper/11
2299648240,3sleep00-21swapper/00
2292945240,1sleep10-21swapper/11
2269934241,1sleep00-21swapper/00
2247790240,2sleep12248006-21/usr/sbin/munin1
2238296240,2sleep10-21swapper/11
2215924240,1sleep10-21swapper/11
2198501240,2sleep10-21swapper/11
2190267240,3sleep10-21swapper/11
2119130240,2sleep02119131-21pool-udisksd0
2068405240,1sleep10-21swapper/11
2055530240,2sleep20-21swapper/22
2043738240,2sleep12044240-21kthreadcore1
1984325240,3sleep23016-21rtkit-daemon2
1971641240,1sleep20-21swapper/22
1926431240,3sleep20-21swapper/22
1919605240,2sleep11919760-21sed1
1907582240,3sleep10-21swapper/11
2281160230,1sleep10-21swapper/11
2190330230,1sleep10-21swapper/11
2157420230,1sleep00-21swapper/00
2145807230,1sleep10-21swapper/11
2119789230,1sleep10-21swapper/11
2075305230,1sleep10-21swapper/11
2055248230,1sleep20-21swapper/22
2017160230,1sleep10-21swapper/11
1990661231,1sleep20-21swapper/22
1971482230,1sleep10-21swapper/11
1960038230,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional