You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 19:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Tue May 05, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2067031213460,69sleep30-21swapper/33
206707328555,12sleep10-21swapper/11
206693628466,12sleep20-21swapper/22
206693427548,16sleep00-21swapper/00
2067386992522,1cyclictest0-21swapper/33
21817162240,3sleep20-21swapper/22
2067386992420,2cyclictest0-21swapper/33
22206132231,9sleep02198242-21diskmemload0
206738699235,14cyclictest2404912-21taskset3
206738699222,16cyclictest0-21swapper/33
206738699211,3cyclictest0-21swapper/33
206738699211,17cyclictest0-21swapper/33
206738699211,16cyclictest2206649-21taskset3
206738699201,15cyclictest66950irq/132-enp1s0-TxRx-33
206738699201,14cyclictest0-21swapper/33
23609732191,5sleep02198242-21diskmemload0
22752052191,9sleep12275217-21ssh1
206738699198,8cyclictest2371919-21turbostat3
206738699192,14cyclictest66950irq/132-enp1s0-TxRx-33
2067386991911,5cyclictest66950irq/132-enp1s0-TxRx-33
206738699191,15cyclictest2247739-21taskset3
206738699191,15cyclictest0-21swapper/33
206738699191,15cyclictest0-21swapper/33
206738699191,15cyclictest0-21swapper/33
206738699191,14cyclictest0-21swapper/33
206738699191,14cyclictest0-21swapper/33
206738699191,14cyclictest0-21swapper/33
206738699191,13cyclictest0-21swapper/33
2067386991910,5cyclictest2107142-21turbostat3
2067386991816,1cyclictest0-21swapper/33
2067386991815,1cyclictest0-21swapper/33
2067386991814,3cyclictest66950irq/132-enp1s0-TxRx-33
2067386991814,3cyclictest66950irq/132-enp1s0-TxRx-33
2067386991811,4cyclictest66950irq/132-enp1s0-TxRx-33
206738699181,14cyclictest0-21swapper/33
206738699181,14cyclictest0-21swapper/33
206738699181,14cyclictest0-21swapper/33
206738699181,13cyclictest0-21swapper/33
206738699181,13cyclictest0-21swapper/33
206738699181,13cyclictest0-21swapper/33
206738699181,13cyclictest0-21swapper/33
206738699181,13cyclictest0-21swapper/33
206738699181,13cyclictest0-21swapper/33
206738699181,13cyclictest0-21swapper/33
206738699180,15cyclictest0-21swapper/33
25224502171,2sleep20-21swapper/22
25006952171,3sleep00-21swapper/00
22221132171,3sleep20-21swapper/22
206738699176,8cyclictest2160963-21turbostat3
206738699172,10cyclictest2182508-21taskset3
2067386991715,1cyclictest0-21swapper/33
2067386991713,2cyclictest0-21swapper/33
206738699171,13cyclictest0-21swapper/33
206738699171,13cyclictest0-21swapper/33
206738699171,13cyclictest0-21swapper/33
206738699170,13cyclictest0-21swapper/33
206738699170,13cyclictest0-21swapper/33
24853432162,8sleep02485400-21ntpq0
24103902161,5sleep12410462-21ssh1
23699762161,3sleep00-21swapper/00
22602352161,11sleep12260247-21sendmail-mta1
22523532160,4sleep2421rcuc/22
206738699161,5cyclictest2090495-21taskset3
206738699161,13cyclictest0-21swapper/33
206738699161,12cyclictest0-21swapper/33
206738699160,13cyclictest0-21swapper/33
25305812151,9sleep02198242-21diskmemload0
25052872151,2sleep20-21swapper/22
24618812151,3sleep12198242-21diskmemload1
23540412151,3sleep02198242-21diskmemload0
23304722155,6sleep0151ktimers/00
23136112151,2sleep20-21swapper/22
23078002150,3sleep12260343-21kworker/u16:0+kvfree_rcu_reclaim1
22961852150,1sleep10-21swapper/11
22392262151,8sleep00-21swapper/00
22366712150,1sleep10-21swapper/11
22232992151,3sleep22198242-21diskmemload2
21013242151,3sleep12101267-31find1
206738699151,11cyclictest21723912sleep33
206738699151,11cyclictest0-21swapper/33
206738699151,11cyclictest0-21swapper/33
206738699150,13cyclictest0-21swapper/33
206738699150,13cyclictest0-21swapper/33
206738699150,13cyclictest0-21swapper/33
206738699150,12cyclictest0-21swapper/33
206738699150,12cyclictest0-21swapper/33
206738699150,12cyclictest0-21swapper/33
206738699150,12cyclictest0-21swapper/33
25072062142,9sleep22508840-21kthreadcore2
23935682140,2sleep00-21swapper/00
23429542140,9sleep12343052-21ntpq1
22882532141,9sleep12288265-21ssh1
22872202140,2sleep20-21swapper/22
22632092141,8sleep20-21swapper/22
22626232141,8sleep02198242-21diskmemload0
22494092141,8sleep12198242-21diskmemload1
20803082142,7sleep12080327-21apt-get1
206738699142,8cyclictest0-21swapper/33
2067386991411,2cyclictest0-21swapper/33
2067386991411,2cyclictest0-21swapper/33
206738699140,11cyclictest0-21swapper/33
25041982131,2sleep10-21swapper/11
24950092131,8sleep02198242-21diskmemload0
24901632136,4sleep22490898-21grep2
24880362131,2sleep22198242-21diskmemload2
24704062130,2sleep10-21swapper/11
24540382131,8sleep22454052-21ssh2
24212352130,2sleep20-21swapper/22
24029762131,8sleep22402986-21ssh2
23617182130,5sleep20-21swapper/22
23535962131,8sleep12353606-21ssh1
23348092131,6sleep22334873-21ntpq2
22944612130,2sleep20-21swapper/22
22489312131,7sleep02198242-21diskmemload0
21494202131,8sleep02149550-21run-parts0
20912492131,8sleep12091439-21grep1
206738699137,4cyclictest2107389-21chrt3
2067386991310,1cyclictest0-21swapper/33
206738699130,1cyclictest0-21swapper/33
25274282121,7sleep12527561-21wc1
24784462121,2sleep10-21swapper/11
24205952121,7sleep02420607-21rm0
23556982121,2sleep10-21swapper/11
23298862121,6sleep22198242-21diskmemload2
23282032121,2sleep10-21swapper/11
23262312121,6sleep02326282-21ntpq0
23043622124,3sleep02198242-21diskmemload0
22766972122,5sleep02276717-21apt-get0
22766972122,5sleep02276717-21apt-get0
22716632121,7sleep12271674-21ssh1
22695672122,5sleep02198242-21diskmemload0
22483782121,7sleep22248605-21cat2
22462382121,3sleep10-21swapper/11
22207572121,7sleep10-21swapper/11
24695382111,3sleep00-21swapper/00
24625762111,5sleep22198242-21diskmemload2
24561612111,6sleep02198242-21diskmemload0
24533832110,3sleep00-21swapper/00
24435682111,5sleep22443626-21ntpq2
24223052112,4sleep12422324-21latency_hist1
24102152111,5sleep22410263-21ntpq2
23896032111,5sleep12389822-21hddtemp_smartct1
23878822111,4sleep134-21ksoftirqd/11
23874622111,6sleep02387473-21ssh0
23466882111,6sleep02198242-21diskmemload0
23463892111,4sleep20-21swapper/22
23195512111,4sleep12198242-21diskmemload1
23194992111,6sleep02319510-21ssh0
23125122111,4sleep22198242-21diskmemload2
23035952111,4sleep10-21swapper/11
22479262111,3sleep00-21swapper/00
22320852111,5sleep22232111-21apt-get2
22067602111,5sleep22207019-21df2
22066232112,4sleep12198242-21diskmemload1
22049482111,3sleep00-21swapper/00
22039162111,4sleep10-21swapper/11
21878362112,3sleep12187855-21apt-get1
21760432111,5sleep22176160-21/usr/sbin/munin2
21705792111,5sleep22170627-21ntpq2
21659252111,3sleep272-21kcompactd02
21360932111,2sleep10-21swapper/11
21289782112,4sleep12128997-21apt-get1
21071322111,6sleep12107187-21cat1
20675832111,5sleep12067843-21df_inode1
25272432101,4sleep22198242-21diskmemload2
25212252100,1sleep00-21swapper/00
25205172101,4sleep12198242-21diskmemload1
25113632100,2sleep02511375-21ssh0
24955272101,4sleep12198242-21diskmemload1
24890722101,3sleep10-21swapper/11
24770982101,4sleep22477149-21ntpq2
24447022100,2sleep10-21swapper/11
24397032101,4sleep02439919-21hddtemp_smartct0
24384592101,4sleep12198242-21diskmemload1
24273062101,5sleep12427562-21users1
24114702100,6sleep02411481-21ssh0
24044682101,3sleep10-21swapper/11
23951172101,3sleep20-21swapper/22
23804032102,5sleep20-21swapper/22
23801942101,2sleep00-21swapper/00
23683692101,3sleep22198242-21diskmemload2
23683012101,4sleep12368367-21ntp_states1
23547572101,6sleep2431ktimers/22
23379192101,3sleep10-21swapper/11
23054022101,5sleep02305664-21df0
23016272101,3sleep20-21swapper/22
22936042101,4sleep02293609-21ssh0
22838272101,4sleep12198242-21diskmemload1
22838272101,4sleep12198242-21diskmemload1
22750072101,3sleep00-21swapper/00
22314502101,5sleep02231792-21cat0
22035742100,2sleep22203581-21ssh2
21849832101,5sleep02186389-21load0
21724942101,5sleep02174163-21kthreadcore0
21688952101,5sleep02170460-21/usr/sbin/munin0
21617562101,2sleep00-21swapper/00
21600102101,4sleep12160063-21ntp_states1
21505712101,5sleep12150555-21/usr/sbin/munin1
21492762101,4sleep12149324-21ntpq1
21439322101,4sleep22143979-21ntpq2
21403582101,4sleep12140429-21irqstats1
21223542101,4sleep02122400-21ntpq0
21180742101,4sleep22118098-21munin-run2
21124612101,6sleep02112556-21apt-key0
20856342101,4sleep12085653-21apt-get1
20731192101,4sleep02074554-21users0
2511607290,6sleep12511621-21ssh1
2477208291,4sleep02477333-21rt-features0
2471086291,4sleep22471097-21ssh2
2453281291,3sleep10-21swapper/11
2435329291,4sleep02435396-21ntpq0
2431058291,4sleep22431086-21apt-get2
2430447291,2sleep20-21swapper/22
2422629291,2sleep00-21swapper/00
2403132291,3sleep02198242-21diskmemload0
2387489290,1sleep20-21swapper/22
2377953291,4sleep12377963-21ssh1
2286680291,4sleep02198242-21diskmemload0
2276989291,2sleep20-21swapper/22
2276989291,2sleep20-21swapper/22
2274330291,2sleep20-21swapper/22
2264599291,2sleep20-21swapper/22
2264101291,3sleep12198242-21diskmemload1
2259075290,3sleep20-21swapper/22
2257545291,3sleep02198242-21diskmemload0
2228458290,3sleep10-21swapper/11
2206614290,1sleep00-21swapper/00
2165298291,4sleep12165348-21ntpq1
2150601291,4sleep22150838-21df_inode2
2124217291,4sleep12124896-21tr1
2123380291,4sleep12123385-21cron1
2101415291,3sleep272-21kcompactd02
2101348290,4sleep02101267-31find0
2092652292,3sleep02094456-21kthreadcore0
2198231281,3sleep02198242-21diskmemload0
2194407280,5sleep20-21swapper/22
2188474281,3sleep22190155-21grep2
2181533280,5sleep12181713-21timerwakeupswit1
2154491281,3sleep02154612-21ntpq0
2139317280,1sleep20-21swapper/22
2139248280,1sleep00-21swapper/00
2130135281,3sleep20-21swapper/22
2084394281,3sleep22084446-21ld2
2074930282,2sleep22074949-21apt-get2
2071760281,4sleep22071843-21proc_pri2
2067567281,3sleep02067582-21cpu0
2198008270,1sleep10-21swapper/11
2182486270,2sleep20-21swapper/22
2177906270,4sleep00-21swapper/00
2176634271,4sleep10-21swapper/11
2160596270,1sleep00-21swapper/00
2160064271,2sleep20-21swapper/22
2144046271,3sleep02144131-21ps0
2128589270,1sleep00-21swapper/00
2123123270,3sleep20-21swapper/22
2118065270,1sleep00-21swapper/00
2117984270,1sleep10-21swapper/11
2112262270,1sleep20-21swapper/22
2102053271,3sleep02102208-21cstates0
2090382270,1sleep20-21swapper/22
2089474270,2sleep02089647-21strings0
2192723260,1sleep00-21swapper/00
2187399260,1sleep10-21swapper/11
2171270260,4sleep10-21swapper/11
2146428261,2sleep20-21swapper/22
2128599260,1sleep20-21swapper/22
2111477260,2sleep10-21swapper/11
2095763260,1sleep20-21swapper/22
2129346251,1sleep00-21swapper/00
2106988250,1sleep20-21swapper/22
2079673251,2sleep1662-21gmain1
2080633240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional