You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 06:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sun Apr 05, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2964380213882,52sleep30-21swapper/33
310809421300,6sleep0221rcuc/00
29643162121104,10sleep20-21swapper/22
31605092880,2sleep0221rcuc/00
296435528060,12sleep10-21swapper/11
295952227251,14sleep00-21swapper/00
296469199221,9cyclictest3340165-21chrt3
296469199221,14cyclictest0-21swapper/33
2964691992211,3cyclictest0-21swapper/33
31874522213,13sleep23187587-21/usr/sbin/munin2
296469199211,16cyclictest0-21swapper/33
296469199211,16cyclictest0-21swapper/33
296469199211,13cyclictest0-21swapper/33
296469199210,18cyclictest0-21swapper/33
34286832208,9sleep00-21swapper/00
31873282201,13sleep03187381-21ntpq0
296469199202,12cyclictest3411027-21taskset3
296469199202,12cyclictest3411027-21taskset3
296469199201,5cyclictest3275697-21taskset3
296469199201,16cyclictest0-21swapper/33
296469199201,15cyclictest66950irq/132-enp1s0-TxRx-33
296469199201,15cyclictest66950irq/132-enp1s0-TxRx-33
296469199201,15cyclictest3451881-21taskset3
296469199201,15cyclictest0-21swapper/33
2964691992011,4cyclictest32604102sleep33
296469199201,14cyclictest0-21swapper/33
296469199200,16cyclictest66950irq/132-enp1s0-TxRx-33
34002102190,2sleep30-21swapper/33
296469199192,13cyclictest3428416-21chrt3
296469199192,12cyclictest2977343-21turbostat3
2964691991916,1cyclictest0-21swapper/33
296469199191,15cyclictest0-21swapper/33
2964691991911,4cyclictest3187588-21chrt3
296469199191,14cyclictest0-21swapper/33
296469199191,14cyclictest0-21swapper/33
296469199191,14cyclictest0-21swapper/33
296469199191,14cyclictest0-21swapper/33
296469199190,16cyclictest66950irq/132-enp1s0-TxRx-33
32401372181,6sleep23240312-21sed2
30260612181,5sleep03027002-21tr0
296469199184,12cyclictest0-21swapper/33
2964691991812,4cyclictest0-21swapper/33
296469199181,15cyclictest0-21swapper/33
296469199181,14cyclictest0-21swapper/33
296469199181,14cyclictest0-21swapper/33
296469199181,14cyclictest0-21swapper/33
296469199181,14cyclictest0-21swapper/33
296469199181,14cyclictest0-21swapper/33
296469199181,14cyclictest0-21swapper/33
296469199181,13cyclictest0-21swapper/33
296469199181,13cyclictest0-21swapper/33
296469199181,13cyclictest0-21swapper/33
296469199181,13cyclictest0-21swapper/33
296469199181,13cyclictest0-21swapper/33
296469199181,13cyclictest0-21swapper/33
296469199180,2cyclictest0-21swapper/33
296469199180,14cyclictest0-21swapper/33
296469199180,14cyclictest0-21swapper/33
34597482171,2sleep00-21swapper/00
33225552170,3sleep20-21swapper/22
33225552170,3sleep20-21swapper/22
32762002170,7sleep20-21swapper/22
31625592171,2sleep20-21swapper/22
31104752170,7sleep10-21swapper/11
296469199172,11cyclictest2977609-21taskset3
296469199172,10cyclictest3385057-21taskset3
296469199171,12cyclictest0-21swapper/33
296469199170,14cyclictest0-21swapper/33
34109372161,4sleep13094783-21diskmemload1
34109372161,4sleep13094783-21diskmemload1
33225942160,3sleep10-21swapper/11
33225942160,3sleep10-21swapper/11
33132012161,2sleep20-21swapper/22
33045582166,1sleep2171rcu_preempt2
32709212161,5sleep13271195-21df_inode1
32611482161,3sleep20-21swapper/22
32080752161,3sleep20-21swapper/22
31293832161,4sleep13094783-21diskmemload1
2964691991612,2cyclictest0-21swapper/33
296469199161,13cyclictest0-21swapper/33
296469199160,14cyclictest0-21swapper/33
296469199160,13cyclictest0-21swapper/33
296469199160,13cyclictest0-21swapper/33
296469199160,13cyclictest0-21swapper/33
34096532151,2sleep10-21swapper/11
34006962150,1sleep20-21swapper/22
30197492150,2sleep10-21swapper/11
2964691991512,2cyclictest0-21swapper/33
2964691991512,2cyclictest0-21swapper/33
2964691991511,2cyclictest0-21swapper/33
296469199150,12cyclictest0-21swapper/33
296469199150,12cyclictest0-21swapper/33
34611062141,4sleep13094783-21diskmemload1
33721472140,2sleep0221rcuc/00
33549542146,3sleep13094783-21diskmemload1
32877262141,8sleep23094783-21diskmemload2
32239712140,2sleep20-21swapper/22
32239712140,2sleep20-21swapper/22
31277432140,2sleep00-21swapper/00
31189812140,3sleep10-21swapper/11
31186912141,2sleep20-21swapper/22
29722332141,4sleep12972417-21expr1
296469199141,8cyclictest3062846-21taskset3
2964691991411,1cyclictest0-21swapper/33
296469199141,11cyclictest0-21swapper/33
296469199140,1cyclictest0-21swapper/33
296469199140,12cyclictest0-21swapper/33
296469199140,11cyclictest0-21swapper/33
296469199140,11cyclictest0-21swapper/33
34569272131,7sleep23458352-21/usr/sbin/munin2
34239322131,5sleep00-21swapper/00
33989442130,2sleep10-21swapper/11
33652972131,3sleep13365309-21ssh1
32926642131,8sleep03292730-21ntpq0
32875492131,8sleep03287563-21ssh0
32431402130,2sleep13094783-21diskmemload1
32347592131,7sleep20-21swapper/22
32162982131,8sleep23216309-21ssh2
32048162131,9sleep13204882-21ntp_offset1
31636702130,1sleep10-21swapper/11
31525792134,5sleep03152739-21timerwakeupswit0
31521782131,6sleep23152229-21ntpq2
31464242131,2sleep20-21swapper/22
30737542131,8sleep13073969-21basename1
30731482130,3sleep00-21swapper/00
30678532131,4sleep20-21swapper/22
34537862121,7sleep03453800-21ssh0
34441432121,7sleep00-21swapper/00
34168922120,1sleep20-21swapper/22
34168922120,1sleep20-21swapper/22
33922932121,7sleep03392307-21ssh0
33837612121,5sleep03094783-21diskmemload0
33763652121,6sleep13376375-21ssh1
33719292122,4sleep13371984-21ntpq1
33488412121,2sleep20-21swapper/22
33383922121,7sleep03338406-21ssh0
33377502121,6sleep13094783-21diskmemload1
33205532121,7sleep03320564-21ssh0
33205532121,7sleep03320564-21ssh0
33101822122,5sleep13310239-21ntpq1
33024142121,8sleep13302422-21ssh1
32506982121,6sleep13094783-21diskmemload1
32495192121,3sleep03249531-21ssh0
31821952121,7sleep13182209-21ssh1
31722592120,8sleep13094783-21diskmemload1
30684442122,5sleep23068654-21hddtemp_smartct2
30374252121,7sleep13039177-21cut1
34477992111,6sleep13449589-21cut1
34360282111,4sleep13094783-21diskmemload1
34266112111,4sleep13094783-21diskmemload1
34093402111,7sleep03409352-21rm0
33916732111,4sleep13094783-21diskmemload1
33550102111,5sleep23355024-21ssh2
33321022111,5sleep13332157-21munin-run1
32768792111,4sleep03094783-21diskmemload0
32689142111,6sleep03268925-21ssh0
32624832111,4sleep13094783-21diskmemload1
32355872111,3sleep00-21swapper/00
32328562111,7sleep13094783-21diskmemload1
32099932111,6sleep03211462-21cut0
31959932111,6sleep23196046-21ssh2
31921142111,3sleep00-21swapper/00
31540362111,4sleep13094783-21diskmemload1
31374412111,2sleep20-21swapper/22
31267052110,5sleep20-21swapper/22
31027422111,5sleep20-21swapper/22
30953312111,5sleep03095488-21diskstats0
30937832111,5sleep03093832-21ntpq0
30899972111,5sleep23090206-21hddtemp_smartct2
30787602111,5sleep13078778-21apt-get1
30518862111,8sleep23051889-21cron2
30508852111,6sleep03050925-21ntpq0
30029772111,5sleep13003034-21ntp_states1
34512752101,2sleep20-21swapper/22
34202492102,4sleep20-21swapper/22
34189972101,3sleep00-21swapper/00
34189972101,3sleep00-21swapper/00
33936352101,2sleep00-21swapper/00
33890802101,5sleep23389178-21ntpq2
33826452101,3sleep20-21swapper/22
33652522101,3sleep20-21swapper/22
33474582101,3sleep10-21swapper/11
33454192101,4sleep03345480-21ntpq0
33327852101,3sleep20-21swapper/22
33294242101,5sleep23329426-21ssh2
33112022102,3sleep02964686-21cyclictest0
32924942101,5sleep23292597-21ld2
32887092101,4sleep13094783-21diskmemload1
32688872101,2sleep20-21swapper/22
32613252101,4sleep03261336-21ssh0
32593622100,2sleep10-21swapper/11
32519702101,3sleep20-21swapper/22
32309312101,3sleep03230994-21ntpq0
32242992101,2sleep00-21swapper/00
32242992101,2sleep00-21swapper/00
32231032101,2sleep10-21swapper/11
32231032101,2sleep10-21swapper/11
32158292101,3sleep13094783-21diskmemload1
32081982101,6sleep03094783-21diskmemload0
31993152101,3sleep10-21swapper/11
31813232101,4sleep03094783-21diskmemload0
31716522101,6sleep23171666-21ssh2
31709162100,1sleep00-21swapper/00
31460422101,4sleep03094783-21diskmemload0
31368122101,5sleep03136824-21ssh0
31365702101,2sleep10-21swapper/11
31184042101,3sleep072-21kcompactd00
31120572101,3sleep23094783-21diskmemload2
30950492101,3sleep13094783-21diskmemload1
30614932101,4sleep03061541-21ntpq0
30487432101,5sleep13050561-21kthreadcore1
30287672101,4sleep23029390-21memory2
30133942101,5sleep03013533-21ntp_192.168.1140
30048602100,6sleep23006533-21grep2
29887192101,5sleep22988866-21kthreadcore2
29829012101,4sleep12982920-21apt-get1
29779132101,5sleep12978129-21iwlist1
29689062101,4sleep02968952-21ntpq0
3445252291,3sleep13094783-21diskmemload1
3443223291,2sleep20-21swapper/22
3432537291,4sleep23432590-21ntpq2
3406603291,3sleep20-21swapper/22
3367800291,2sleep20-21swapper/22
3363757291,2sleep00-21swapper/00
3356206291,2sleep00-21swapper/00
3324104291,4sleep03324312-21cat0
3301774291,3sleep03301852-21ssh0
3189879290,5sleep13189890-21ssh1
3181701291,2sleep20-21swapper/22
3144212290,1sleep10-21swapper/11
3094080291,4sleep13094163-21expr1
3082672291,3sleep03082785-21ntpq0
3062361290,1sleep20-21swapper/22
3057495291,5sleep13057643-21wc1
3041535293,3sleep00-21swapper/00
3030831291,4sleep23031088-21sh2
3009516291,3sleep13009528-21apt-get1
3004180290,3sleep10-21swapper/11
2994998291,4sleep12996767-21cut1
2983274291,4sleep02983451-21if_err_enp1s00
2981623291,3sleep22981661-21ntpq2
2969935291,4sleep12970152-21nin-node1
3284660281,2sleep10-21swapper/11
3089227280,2sleep10-21swapper/11
3073455281,2sleep20-21swapper/22
3056522280,3sleep03056593-21find0
3056168280,3sleep23056225-21ntpq2
3041808280,1sleep20-21swapper/22
3035948280,4sleep20-21swapper/22
3030809280,2sleep10-21swapper/11
3020167280,3sleep03020186-21apt-get0
3019877280,1sleep00-21swapper/00
3008084280,4sleep00-21swapper/00
2993515281,2sleep00-21swapper/00
2984121281,3sleep22985851-21kthreadcore2
3085905271,3sleep23087675-21cut2
3078224270,1sleep00-21swapper/00
3036174270,4sleep03036199-21grep0
3030282270,1sleep10-21swapper/11
3024975270,1sleep20-21swapper/22
3013858271,3sleep23013861-21mailstats2
3003610270,1sleep20-21swapper/22
2999650271,3sleep00-21swapper/00
2993255270,3sleep11-21systemd1
2972211270,2sleep00-21swapper/00
3084336260,2sleep00-21swapper/00
3080171260,2sleep23081929-21kthreadcore2
3067556260,1sleep10-21swapper/11
3046515260,1sleep10-21swapper/11
3020189261,2sleep10-21swapper/11
3017221261,2sleep20-21swapper/22
2992321261,2sleep00-21swapper/00
2977864261,2sleep00-21swapper/00
2969240261,2sleep20-21swapper/22
3070342250,2sleep10-21swapper/11
3063108250,1sleep00-21swapper/00
3055989250,1sleep10-21swapper/11
3035868250,2sleep00-21swapper/00
2993298250,1sleep20-21swapper/22
2976607250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional