You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 13:35

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Tue Jun 09, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2009589212972,51sleep30-21swapper/33
209301221170,2sleep10-21swapper/11
201055329060,10sleep10-21swapper/11
201047228654,12sleep20-21swapper/22
201040128051,14sleep00-21swapper/00
201085799202,13cyclictest2158990-21taskset3
2010857992016,2cyclictest0-21swapper/33
2010857992016,2cyclictest0-21swapper/33
2010857992012,5cyclictest0-21swapper/33
2010857992010,6cyclictest2200025-21taskset3
201085799192,15cyclictest66950irq/132-enp1s0-TxRx-33
2010857991915,2cyclictest0-21swapper/33
201085799191,15cyclictest0-21swapper/33
201085799191,14cyclictest0-21swapper/33
201085799191,14cyclictest0-21swapper/33
201085799191,14cyclictest0-21swapper/33
201085799190,16cyclictest66950irq/132-enp1s0-TxRx-33
24465162180,2sleep10-21swapper/11
231027721810,5sleep02141323-21diskmemload0
231027721810,5sleep02141323-21diskmemload0
20600492181,5sleep12060098-21ntpq1
201085799184,11cyclictest21368272sleep33
201085799184,11cyclictest21368272sleep33
201085799182,13cyclictest2321083-21turbostat3
2010857991814,3cyclictest66950irq/132-enp1s0-TxRx-33
201085799181,15cyclictest0-21swapper/33
201085799181,14cyclictest0-21swapper/33
201085799181,14cyclictest0-21swapper/33
201085799181,14cyclictest0-21swapper/33
201085799181,14cyclictest0-21swapper/33
201085799181,14cyclictest0-21swapper/33
201085799181,14cyclictest0-21swapper/33
201085799181,13cyclictest0-21swapper/33
201085799181,13cyclictest0-21swapper/33
201085799181,13cyclictest0-21swapper/33
201085799181,13cyclictest0-21swapper/33
2010857991810,5cyclictest0-21swapper/33
201085799180,16cyclictest0-21swapper/33
201085799180,15cyclictest0-21swapper/33
201085799180,14cyclictest0-21swapper/33
201085799180,14cyclictest0-21swapper/33
24538752171,5sleep12141323-21diskmemload1
23287952171,3sleep10-21swapper/11
21921782171,11sleep22141323-21diskmemload2
2010857991712,3cyclictest0-21swapper/33
201085799171,14cyclictest0-21swapper/33
2010857991711,3cyclictest23387932sleep33
2010857991711,3cyclictest0-21swapper/33
201085799171,13cyclictest0-21swapper/33
201085799171,13cyclictest0-21swapper/33
201085799171,12cyclictest0-21swapper/33
2010857991710,5cyclictest0-21swapper/33
201085799170,14cyclictest0-21swapper/33
201085799170,14cyclictest0-21swapper/33
201085799170,13cyclictest0-21swapper/33
201085799170,13cyclictest0-21swapper/33
201085799170,13cyclictest0-21swapper/33
23952952160,1sleep10-21swapper/11
23886082160,1sleep00-21swapper/00
23629222161,3sleep02141323-21diskmemload0
23622242167,5sleep1331ktimers/11
23388662161,2sleep00-21swapper/00
22273042161,4sleep22227330-21apt-get2
22273042161,4sleep22227330-21apt-get2
21982552161,3sleep10-21swapper/11
21918512161,4sleep02191865-21ssh0
201085799162,12cyclictest0-21swapper/33
2010857991614,1cyclictest0-21swapper/33
201085799161,3cyclictest0-21swapper/33
2010857991612,2cyclictest0-21swapper/33
201085799161,13cyclictest0-21swapper/33
201085799161,12cyclictest0-21swapper/33
201085799160,13cyclictest0-21swapper/33
201085799160,13cyclictest0-21swapper/33
201085799160,13cyclictest0-21swapper/33
201085799160,13cyclictest0-21swapper/33
201085799160,12cyclictest0-21swapper/33
24678992152,3sleep02141323-21diskmemload0
24139282151,3sleep02413940-21ssh0
23459632151,3sleep10-21swapper/11
23177332151,9sleep22141323-21diskmemload2
22706052151,6sleep02270646-21kthreadcore0
22171742151,4sleep12141323-21diskmemload1
20161122151,9sleep12016137-21munin-run1
201085799151,8cyclictest2093706-21taskset3
201085799151,4cyclictest0-21swapper/33
2010857991510,3cyclictest0-21swapper/33
201085799150,12cyclictest0-21swapper/33
201085799150,12cyclictest0-21swapper/33
24970902141,2sleep00-21swapper/00
24660692141,4sleep12466291-21sh1
24530742141,7sleep22453138-21ntpq2
24362532141,6sleep02436311-21ntpq0
24070262141,9sleep22407227-21/usr/sbin/munin2
23888112141,3sleep12388823-21ssh1
23796752142,2sleep2171rcu_preempt2
22781642141,8sleep22141323-21diskmemload2
22500102141,8sleep12141323-21diskmemload1
22176042141,8sleep02141323-21diskmemload0
21459262141,4sleep02145949-21ntpq0
201085799148,4cyclictest2023307-21chrt3
201085799147,5cyclictest2114735-21turbostat3
201085799141,1cyclictest0-21swapper/33
2010857991411,2cyclictest0-21swapper/33
201085799140,2cyclictest0-21swapper/33
24807352132,6sleep02141323-21diskmemload0
24647272130,9sleep22464741-21ssh2
23898212130,2sleep20-21swapper/22
23866002131,8sleep22386611-21ssh2
23777212131,5sleep10-21swapper/11
23708282131,8sleep02141323-21diskmemload0
23365232130,2sleep1171rcu_preempt1
22856372131,7sleep22285648-21ssh2
22525002131,6sleep02252558-21munin-run0
22519862131,6sleep22141323-21diskmemload2
22004282131,9sleep02200442-21ssh0
21838132131,7sleep02141323-21diskmemload0
21359022130,1sleep10-21swapper/11
21090262130,1sleep10-21swapper/11
21030512131,6sleep12103098-21ntpq1
20714972131,7sleep12071699-21users1
20559982131,7sleep22056256-21df_inode2
201085799138,3cyclictest20454092sleep33
201085799133,8cyclictest0-21swapper/33
201085799130,2cyclictest0-21swapper/33
24882532122,5sleep22141323-21diskmemload2
24724302120,6sleep22141323-21diskmemload2
24224192121,3sleep22422430-21ssh2
23783662121,6sleep02141323-21diskmemload0
23715322121,7sleep22371543-21ssh2
23485792124,5sleep02350222-21kthreadcore0
23108912121,7sleep22310902-21ssh2
23108912121,7sleep22310902-21ssh2
23030702121,7sleep22141323-21diskmemload2
22657362121,5sleep12265782-21ntpq1
22590812121,7sleep02259095-21ssh0
22530242121,6sleep22253159-21diskstats2
22413472121,7sleep22141323-21diskmemload2
22238252121,3sleep12223836-21ssh1
21652262121,7sleep12165239-21ssh1
21296842121,6sleep12129733-21ntpq1
21202992121,6sleep10-21swapper/11
21200392121,7sleep22120140-21cat2
20223922121,6sleep02022440-21ntpq0
2010857991210,1cyclictest0-21swapper/33
24884202111,6sleep02141323-21diskmemload0
24280482111,3sleep20-21swapper/22
24240612111,5sleep02424139-21irqstats0
24231022111,7sleep02423116-21ssh0
24230182111,5sleep12141323-21diskmemload1
24069442111,6sleep12407025-21cut1
24041892111,6sleep00-21swapper/00
24041892111,6sleep00-21swapper/00
22926382111,3sleep20-21swapper/22
22715742111,2sleep12234081-21kworker/1:1-events1
22615032111,6sleep02261766-21df0
22260232111,3sleep20-21swapper/22
21666702112,5sleep0151ktimers/00
21543552111,5sleep12154415-21ntpq1
21492602115,3sleep134-21ksoftirqd/11
21096692112,4sleep02109688-21apt-get0
20976832111,5sleep22097731-21ntpq2
20827232111,6sleep13671894-21systemd-journal1
20732112111,6sleep22074879-21kthreadcore2
20224422111,5sleep12022486-21ntpq1
24953062101,2sleep20-21swapper/22
24921632102,4sleep12493767-21tr1
24819232101,2sleep10-21swapper/11
24783642101,5sleep22478410-21ld2
24636312101,4sleep02141323-21diskmemload0
24628362101,2sleep10-21swapper/11
24405062101,4sleep02440534-21ssh0
24391952101,4sleep22141323-21diskmemload2
24365772101,6sleep12436765-21sed1
24040152101,3sleep20-21swapper/22
24040152101,3sleep20-21swapper/22
23620952101,2sleep20-21swapper/22
23524262101,4sleep22141323-21diskmemload2
23304972101,4sleep02330585-21irqstats0
23214152101,4sleep22321439-21apt-get2
23133762102,4sleep10-21swapper/11
23123282100,1sleep10-21swapper/11
23123282100,1sleep10-21swapper/11
23028122101,4sleep12141323-21diskmemload1
22935312101,3sleep10-21swapper/11
22860562101,3sleep00-21swapper/00
22828292101,4sleep12282896-21ntp_states1
22599152101,3sleep10-21swapper/11
22433632101,3sleep10-21swapper/11
22337042100,1sleep00-21swapper/00
22337042100,1sleep00-21swapper/00
22084822101,4sleep12208494-21ssh1
21995822101,2sleep20-21swapper/22
21925742101,4sleep12141323-21diskmemload1
21831672101,3sleep20-21swapper/22
21818862101,3sleep12141323-21diskmemload1
21718942101,2sleep00-21swapper/00
21717002101,4sleep12171758-21ntpq1
21682062100,2sleep20-21swapper/22
21654912100,1sleep20-21swapper/22
21580942101,4sleep02141323-21diskmemload0
21497922101,2sleep20-21swapper/22
21483742101,3sleep20-21swapper/22
21205942101,5sleep02120802-21hddtemp_smartct0
20830062101,5sleep12083078-21grep1
20723332101,4sleep12072352-21apt-get1
20331352101,5sleep02033189-21ld0
2487958290,1sleep10-21swapper/11
2445063291,4sleep22445225-21sed2
2424140291,4sleep12425317-21grep1
2402374291,4sleep12402438-21ntpq1
2402374291,4sleep12402438-21ntpq1
2396087291,3sleep02141323-21diskmemload0
2371854290,1sleep10-21swapper/11
2338533291,4sleep22338792-21sh2
2326581290,1sleep00-21swapper/00
2319347291,4sleep02319349-21ssh0
2300664291,4sleep02300676-21ssh0
2265790291,3sleep20-21swapper/22
2240779291,3sleep00-21swapper/00
2233381290,1sleep10-21swapper/11
2233381290,1sleep10-21swapper/11
2218730291,2sleep00-21swapper/00
2216898290,1sleep20-21swapper/22
2207688291,3sleep02141323-21diskmemload0
2201707291,3sleep22201726-21apt-get2
2141310291,3sleep22141349-21awk2
2141310291,3sleep22141349-21awk2
2112181291,4sleep22113551-21load2
2097786291,4sleep02097843-21ntp_states0
2088643291,5sleep02088794-21tail0
2065252291,4sleep02065391-21/usr/sbin/munin0
2061319291,3sleep12061338-21apt-get1
2053976291,4sleep22054380-21needreboot2
2049423292,3sleep22049630-21grep2
2024012291,4sleep12024225-21hddtemp_smartct1
2449291281,2sleep00-21swapper/00
2351661281,3sleep12351866-21ssh1
2334193281,3sleep22334254-21ntpq2
2292332281,4sleep02292343-21ssh0
2129964280,1sleep20-21swapper/22
2077835280,1sleep00-21swapper/00
2066965281,3sleep22066984-21apt-get2
2050946281,3sleep02052163-21grep0
2043610281,3sleep02043732-21ntpq0
2038390281,3sleep12038447-21ntpq1
2033190280,1sleep10-21swapper/11
2141267270,1sleep10-21swapper/11
2141267270,1sleep10-21swapper/11
2135644270,1sleep00-21swapper/00
2130577270,1sleep00-21swapper/00
2120902271,3sleep22122432-21cut2
2119961270,1sleep10-21swapper/11
2119778270,1sleep00-21swapper/00
2109387271,3sleep12109655-21latency_hist1
2103836270,1sleep00-21swapper/00
2098417270,1sleep10-21swapper/11
2088365271,3sleep22088387-21cpu2
2084757271,3sleep22086548-21kthreadcore2
2082984270,2sleep00-21swapper/00
2081903270,3sleep20-21swapper/22
2059929271,2sleep00-21swapper/00
2052164271,3sleep12053973-21kthreadcore1
2044657270,1sleep10-21swapper/11
2044628270,1sleep20-21swapper/22
2039369270,1sleep00-21swapper/00
2039222270,2sleep20-21swapper/22
2023721271,2sleep22023740-21apt-get2
2020545271,3sleep22022240-21latency2
2134826260,3sleep20-21swapper/22
2109246260,2sleep00-21swapper/00
2105693261,2sleep20-21swapper/22
2100393261,2sleep20-21swapper/22
2076241261,2sleep00-21swapper/00
2071379261,2sleep00-21swapper/00
2062606261,2sleep20-21swapper/22
2049790260,1sleep10-21swapper/11
2045025260,1sleep00-21swapper/00
2033883260,1sleep20-21swapper/22
2025814261,2sleep00-21swapper/00
2011604261,2sleep20-21swapper/22
2011327261,2sleep00-21swapper/00
2136028240,1sleep00-21swapper/00
2136028240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional