You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-29 - 22:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Mon Jun 29, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2243073212955,68sleep30-21swapper/33
224281928757,10sleep20-21swapper/22
224305628264,12sleep10-21swapper/11
224298028261,15sleep00-21swapper/00
23431042317,5sleep02343175-21cut0
23058832300,2sleep00-21swapper/00
26352582290,7sleep014-21ksoftirqd/00
224328899251,4cyclictest0-21swapper/33
224328899250,16cyclictest0-21swapper/33
224328899250,16cyclictest0-21swapper/33
26846822241,3sleep00-21swapper/00
224328899240,6cyclictest0-21swapper/33
224328899240,6cyclictest0-21swapper/33
224328899240,5cyclictest0-21swapper/33
224328899230,6cyclictest0-21swapper/33
224328899230,6cyclictest0-21swapper/33
224328899230,6cyclictest0-21swapper/33
224328899230,5cyclictest0-21swapper/33
224328899230,15cyclictest0-21swapper/33
224328899230,15cyclictest0-21swapper/33
224328899221,18cyclictest0-21swapper/33
224328899220,5cyclictest0-21swapper/33
224328899220,4cyclictest0-21swapper/33
224328899220,19cyclictest0-21swapper/33
224328899220,15cyclictest0-21swapper/33
25830732210,2sleep10-21swapper/11
224328899211,17cyclictest0-21swapper/33
224328899211,16cyclictest2255649-21turbostat3
224328899210,5cyclictest0-21swapper/33
224328899210,4cyclictest0-21swapper/33
224328899210,14cyclictest0-21swapper/33
25015522201,2sleep20-21swapper/22
24691172201,3sleep20-21swapper/22
23776482200,6sleep22377662-21ssh2
2243288992015,4cyclictest0-21swapper/33
2243288992011,6cyclictest0-21swapper/33
224328899201,16cyclictest0-21swapper/33
224328899201,15cyclictest0-21swapper/33
224328899201,15cyclictest0-21swapper/33
224328899201,13cyclictest0-21swapper/33
224328899201,11cyclictest0-21swapper/33
224328899200,4cyclictest0-21swapper/33
224328899200,14cyclictest0-21swapper/33
25985582191,3sleep00-21swapper/00
25356552191,3sleep02535684-21apt-get0
25082342191,3sleep20-21swapper/22
224328899196,2cyclictest0-21swapper/33
2243288991916,2cyclictest0-21swapper/33
224328899191,16cyclictest0-21swapper/33
224328899191,15cyclictest0-21swapper/33
224328899191,15cyclictest0-21swapper/33
224328899191,15cyclictest0-21swapper/33
224328899191,15cyclictest0-21swapper/33
224328899191,15cyclictest0-21swapper/33
224328899191,15cyclictest0-21swapper/33
224328899191,14cyclictest2333657-21turbostat3
224328899191,14cyclictest2328257-21taskset3
224328899191,14cyclictest0-21swapper/33
224328899191,14cyclictest0-21swapper/33
224328899191,14cyclictest0-21swapper/33
224328899191,13cyclictest0-21swapper/33
224328899190,16cyclictest0-21swapper/33
27079672181,3sleep00-21swapper/00
26926992181,13sleep02370033-21diskmemload0
26184702182,10sleep02370033-21diskmemload0
24661072181,3sleep12466119-21ssh1
24364132181,4sleep12370033-21diskmemload1
24364132181,4sleep12370033-21diskmemload1
224328899185,9cyclictest2408521-21taskset3
224328899181,4cyclictest2260609-21taskset3
224328899181,14cyclictest0-21swapper/33
224328899181,14cyclictest0-21swapper/33
224328899181,14cyclictest0-21swapper/33
224328899181,14cyclictest0-21swapper/33
224328899181,13cyclictest0-21swapper/33
224328899180,9cyclictest0-21swapper/33
26038092171,2sleep12605476-21kthreadcore1
224328899171,12cyclictest2370005-21taskset3
224328899171,12cyclictest2359652-21turbostat3
224328899170,14cyclictest0-21swapper/33
224328899170,14cyclictest0-21swapper/33
26593842160,3sleep10-21swapper/11
26155492161,10sleep10-21swapper/11
26079262161,11sleep22607937-21ssh2
25670362161,10sleep22370033-21diskmemload2
25413852161,2sleep10-21swapper/11
24671622161,10sleep02370033-21diskmemload0
24600912161,3sleep20-21swapper/22
24519612161,2sleep20-21swapper/22
23923082161,10sleep12370033-21diskmemload1
224328899167,6cyclictest2248453-21turbostat3
224328899161,3cyclictest0-21swapper/33
224328899161,13cyclictest2318099-21turbostat3
224328899161,13cyclictest0-21swapper/33
224328899161,12cyclictest2323297-21turbostat3
224328899160,13cyclictest0-21swapper/33
224328899160,13cyclictest0-21swapper/33
25847962150,1sleep00-21swapper/00
25274132151,4sleep22527435-21apt-get2
224328899151,6cyclictest0-21swapper/33
224328899151,6cyclictest0-21swapper/33
224328899150,13cyclictest0-21swapper/33
26665012141,8sleep02370033-21diskmemload0
26489732140,1sleep00-21swapper/00
26333932141,3sleep12633405-21ssh1
26237202141,3sleep12623731-21ssh1
26173232140,2sleep22617334-21ssh2
24596062141,8sleep12370033-21diskmemload1
24413642143,2sleep0171rcu_preempt0
24413642143,2sleep0171rcu_preempt0
24282142141,9sleep12370033-21diskmemload1
24178642141,9sleep02417874-21ssh0
24115972142,6sleep12411625-21apt-get1
23910512141,6sleep22391114-21ntp_states2
23852762141,8sleep02370033-21diskmemload0
23764232141,3sleep02376433-21ssh0
22732722141,9sleep22275012-21cut2
22732722141,9sleep22275012-21cut2
26911702131,3sleep22691184-21ssh2
26744522131,6sleep10-21swapper/11
26232982131,2sleep20-21swapper/22
26120502131,8sleep02613709-21cut0
26074802131,7sleep02370033-21diskmemload0
25761702130,3sleep12576180-21ssh1
25344842131,6sleep00-21swapper/00
25255882131,6sleep02370033-21diskmemload0
25017552131,7sleep02370033-21diskmemload0
24836612138,2sleep00-21swapper/00
24778552131,5sleep20-21swapper/22
24509942131,7sleep02370033-21diskmemload0
24354132131,3sleep22435421-21ssh2
24122062134,5sleep22412754-21kthreadcore2
24016402131,6sleep22370033-21diskmemload2
23245602131,4sleep22326210-21kthreadcore2
23209282131,8sleep02322198-21/usr/sbin/munin0
22484852131,8sleep12248880-21cat1
27153452121,5sleep22370033-21diskmemload2
26491292121,7sleep12649140-21ssh1
26314312122,3sleep22370033-21diskmemload2
25757402121,6sleep02575758-21ssh0
25427562121,5sleep20-21swapper/22
25108452120,3sleep12510859-21ssh1
24607772121,7sleep02460788-21ssh0
24343272121,3sleep02434329-21ssh0
24264592123,2sleep2171rcu_preempt2
24248292120,2sleep00-21swapper/00
23709952121,6sleep12371610-21grep1
23183872122,5sleep22318384-21apt-get2
22719642121,5sleep02272035-21irqstats0
22719642121,5sleep02272035-21irqstats0
22703212120,1sleep00-21swapper/00
27159292111,4sleep02370033-21diskmemload0
27003442111,6sleep22700358-21ssh2
26991982111,4sleep12370033-21diskmemload1
26897862111,5sleep12370033-21diskmemload1
26836072111,3sleep10-21swapper/11
26827782111,2sleep00-21swapper/00
26560372111,6sleep22656255-21ssh2
26397902111,3sleep20-21swapper/22
25992992111,5sleep22370033-21diskmemload2
25912592111,6sleep12591270-21ssh1
25903252111,5sleep02370033-21diskmemload0
25848942111,5sleep22584892-21sendmail-msp2
25579612111,4sleep22370033-21diskmemload2
25522882111,5sleep12552503-21diskstats1
25490012111,4sleep12370033-21diskmemload1
25273612111,5sleep12370033-21diskmemload1
25253142111,4sleep12370033-21diskmemload1
25191112111,3sleep20-21swapper/22
25181052111,4sleep22370033-21diskmemload2
25108842111,4sleep02510905-21apt-get0
25100052110,2sleep00-21swapper/00
25026272111,4sleep10-21swapper/11
25003942111,2sleep12500406-21ssh1
24914972110,1sleep00-21swapper/00
24902812112,5sleep22490333-21awk2
24826092111,4sleep12370033-21diskmemload1
24424992111,4sleep22370033-21diskmemload2
24424992111,4sleep22370033-21diskmemload2
24263532110,6sleep10-21swapper/11
24100922111,6sleep12410102-21ssh1
24090542111,4sleep02370033-21diskmemload0
24027832111,5sleep02370033-21diskmemload0
24014252111,6sleep12401435-21ssh1
23847202110,1sleep20-21swapper/22
23547002111,4sleep02354719-21apt-get0
23494972111,5sleep22349516-21apt-get2
23486192111,5sleep12348816-21users1
23440342111,5sleep22344090-21munin-run2
23339102111,4sleep02333928-21apt-get0
23284462111,5sleep12328506-21munin-run1
22822452111,6sleep22282344-21perl2
27065872101,3sleep22370033-21diskmemload2
27013312101,4sleep12701542-21hddtemp_smartct1
26812162101,3sleep20-21swapper/22
26672312101,4sleep12370033-21diskmemload1
26666252101,4sleep22370033-21diskmemload2
26570402101,2sleep00-21swapper/00
26483822101,3sleep20-21swapper/22
26348892100,1sleep10-21swapper/11
26322502101,3sleep02370033-21diskmemload0
25987142100,2sleep10-21swapper/11
25773562102,4sleep22577568-21gltestperf2
25759112101,4sleep22370033-21diskmemload2
25681342100,1sleep00-21swapper/00
25605962101,4sleep12370033-21diskmemload1
25578452101,3sleep02370033-21diskmemload0
25507992101,3sleep20-21swapper/22
25439602102,3sleep02543962-21apt-get0
24867032101,4sleep12486978-21kthreadcore1
24770222101,2sleep20-21swapper/22
24763712101,4sleep02370033-21diskmemload0
24694552101,4sleep12370033-21diskmemload1
24085082101,4sleep22370033-21diskmemload2
23921172100,1sleep00-21swapper/00
23851972101,4sleep12370033-21diskmemload1
23640412101,6sleep22364190-21threads2
23494902101,4sleep12349213-21apt-get1
23330672101,4sleep22333252-21users2
23327592101,5sleep02332871-21wc0
23135012100,1sleep20-21swapper/22
22975622101,4sleep22297564-21apt-get2
22871922101,5sleep02287267-21tr0
22820202101,4sleep12282244-21df_inode1
22507072101,4sleep02250726-21apt-get0
2716033291,4sleep12716043-21ssh1
2674296291,2sleep02370033-21diskmemload0
2672793291,2sleep20-21swapper/22
2369814290,1sleep10-21swapper/11
2354722291,4sleep12354945-21cstates1
2349525291,3sleep00-21swapper/00
2318365290,5sleep10-21swapper/11
2318044290,1sleep10-21swapper/11
2288407291,4sleep12290058-21cut1
2261393291,4sleep22261556-21expr2
2260562290,1sleep00-21swapper/00
2248882291,4sleep22250429-21hddtemp_smartct2
2243478290,3sleep10-21swapper/11
2450636280,3sleep12450650-21ssh1
2365113280,2sleep20-21swapper/22
2359920280,2sleep00-21swapper/00
2344875281,3sleep20-21swapper/22
2338740280,6sleep20-21swapper/22
2337910280,1sleep10-21swapper/11
2327362281,3sleep02327481-21/usr/sbin/munin0
2313173281,3sleep02313430-21/usr/sbin/munin0
2307944280,2sleep10-21swapper/11
2307656280,1sleep20-21swapper/22
2297823281,3sleep02297858-21fschecks_count0
2292382281,3sleep12292643-21df_inode1
2281475280,1sleep10-21swapper/11
2281475280,1sleep10-21swapper/11
2281397280,1sleep20-21swapper/22
2281397280,1sleep20-21swapper/22
2271188280,1sleep10-21swapper/11
2266249280,1sleep20-21swapper/22
2260637280,1sleep10-21swapper/11
2243768281,3sleep02243980-21smartctl0
2364503270,5sleep10-21swapper/11
2349175270,1sleep00-21swapper/00
2340922271,3sleep12342673-21kthreadcore1
2312620270,1sleep20-21swapper/22
2302732270,2sleep10-21swapper/11
2292925271,2sleep00-21swapper/00
2282515271,3sleep00-21swapper/00
2276315270,2sleep10-21swapper/11
2276315270,2sleep10-21swapper/11
2262722271,3sleep10-21swapper/11
2261675271,3sleep00-21swapper/00
2248192270,1sleep20-21swapper/22
2369669260,1sleep00-21swapper/00
2359306260,1sleep20-21swapper/22
2297014260,1sleep20-21swapper/22
2277316261,2sleep00-21swapper/00
2277316261,2sleep00-21swapper/00
2256203261,2sleep20-21swapper/22
2308239250,1sleep00-21swapper/00
2297533250,1sleep10-21swapper/11
2287461250,1sleep20-21swapper/22
2329008240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional