You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 06:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat Aug 08, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2196690212856,67sleep30-21swapper/33
2196856210091,6sleep10-21swapper/11
219694528856,12sleep20-21swapper/22
219691627555,14sleep00-21swapper/00
25643762340,1sleep30-21swapper/33
2197112992724,1cyclictest0-21swapper/33
24993382251,13sleep12325271-21diskmemload1
24993382251,13sleep12325271-21diskmemload1
2197112992522,1cyclictest0-21swapper/33
219711299249,12cyclictest0-21swapper/33
219711299249,12cyclictest0-21swapper/33
219711299249,12cyclictest0-21swapper/33
2197112992422,1cyclictest0-21swapper/33
2197112992421,1cyclictest0-21swapper/33
2197112992421,1cyclictest0-21swapper/33
2197112992321,1cyclictest0-21swapper/33
2197112992320,1cyclictest0-21swapper/33
219711299230,19cyclictest2375872-21taskset3
2197112992219,1cyclictest0-21swapper/33
2197112992219,1cyclictest0-21swapper/33
2197112992119,1cyclictest0-21swapper/33
2197112992112,5cyclictest0-21swapper/33
219711299211,16cyclictest0-21swapper/33
25614912201,15sleep12325271-21diskmemload1
2197112992017,2cyclictest0-21swapper/33
2197112992017,1cyclictest0-21swapper/33
2197112992017,1cyclictest0-21swapper/33
2197112992012,5cyclictest0-21swapper/33
219711299201,16cyclictest0-21swapper/33
219711299201,15cyclictest0-21swapper/33
219711299201,15cyclictest0-21swapper/33
219711299201,14cyclictest0-21swapper/33
26680642190,2sleep10-21swapper/11
25109752191,3sleep00-21swapper/00
23409832191,3sleep20-21swapper/22
219711299194,12cyclictest2536639-21taskset3
2197112991917,1cyclictest0-21swapper/33
2197112991916,2cyclictest0-21swapper/33
2197112991916,2cyclictest0-21swapper/33
2197112991916,1cyclictest0-21swapper/33
2197112991916,1cyclictest0-21swapper/33
219711299191,5cyclictest0-21swapper/33
2197112991915,2cyclictest0-21swapper/33
2197112991915,2cyclictest0-21swapper/33
2197112991914,2cyclictest0-21swapper/33
2197112991913,3cyclictest26538982sleep33
219711299191,15cyclictest2455028-21taskset3
219711299191,15cyclictest0-21swapper/33
219711299191,14cyclictest0-21swapper/33
219711299191,14cyclictest0-21swapper/33
219711299191,14cyclictest0-21swapper/33
26904042181,8sleep02690419-21ssh0
22148372181,11sleep22214893-21/usr/sbin/munin2
219711299186,10cyclictest0-21swapper/33
219711299185,11cyclictest0-21swapper/33
2197112991816,1cyclictest0-21swapper/33
2197112991815,1cyclictest0-21swapper/33
2197112991815,1cyclictest0-21swapper/33
2197112991814,2cyclictest0-21swapper/33
219711299181,14cyclictest0-21swapper/33
219711299181,14cyclictest0-21swapper/33
219711299180,14cyclictest0-21swapper/33
26240372170,4sleep20-21swapper/22
26159602172,9sleep02325271-21diskmemload0
25778602172,8sleep12577924-21ntp_states1
25733012171,4sleep22325271-21diskmemload2
24496802170,1sleep00-21swapper/00
2197112991715,1cyclictest0-21swapper/33
2197112991714,1cyclictest0-21swapper/33
2197112991713,2cyclictest0-21swapper/33
2197112991711,3cyclictest0-21swapper/33
2197112991711,3cyclictest0-21swapper/33
219711299171,13cyclictest0-21swapper/33
219711299171,12cyclictest0-21swapper/33
219711299170,14cyclictest0-21swapper/33
219711299170,13cyclictest0-21swapper/33
26984222162,5sleep22325271-21diskmemload2
26068672161,10sleep22325271-21diskmemload2
26048092161,4sleep02605065-21awk0
25825392160,2sleep00-21swapper/00
25543522161,5sleep12325271-21diskmemload1
25531852161,2sleep20-21swapper/22
24905442161,2sleep00-21swapper/00
24480462161,3sleep10-21swapper/11
23953042161,2sleep00-21swapper/00
23670462161,3sleep20-21swapper/22
23508962161,7sleep072-21kcompactd00
2197112991614,1cyclictest0-21swapper/33
219711299161,3cyclictest0-21swapper/33
2197112991613,2cyclictest0-21swapper/33
2197112991613,2cyclictest0-21swapper/33
2197112991613,1cyclictest0-21swapper/33
2197112991613,1cyclictest0-21swapper/33
2197112991612,2cyclictest0-21swapper/33
219711299161,12cyclictest0-21swapper/33
219711299160,13cyclictest0-21swapper/33
26913682152,8sleep12691503-21diskstats1
26343892151,4sleep12626711-40find1
25963272150,2sleep00-21swapper/00
25874662151,4sleep12325271-21diskmemload1
25291052152,7sleep0555-21dbus-daemon0
25186352151,9sleep02325271-21diskmemload0
24823342151,2sleep1321rcuc/11
24823342151,2sleep1321rcuc/11
23935542151,3sleep10-21swapper/11
23332052151,8sleep02325271-21diskmemload0
2197112991513,1cyclictest0-21swapper/33
26457862143,2sleep1171rcu_preempt1
25357642140,2sleep10-21swapper/11
25248322141,8sleep12524902-21ntp_states1
24993822141,3sleep02499393-21ssh0
24993822141,3sleep02499393-21ssh0
24845042141,8sleep02325271-21diskmemload0
24845042141,8sleep02325271-21diskmemload0
24510552141,9sleep12452482-21kthreadcore1
26788422131,8sleep02325271-21diskmemload0
26748922131,8sleep12676485-21cut1
26635462131,8sleep22663564-21ssh2
26579412131,7sleep12659665-21cut1
26448272131,8sleep02644840-21ssh0
26168712131,7sleep12325271-21diskmemload1
26147132131,6sleep22325271-21diskmemload2
25915412131,7sleep12591702-21ssh1
25732432131,8sleep12325271-21diskmemload1
24845852131,8sleep22325271-21diskmemload2
24845852131,8sleep22325271-21diskmemload2
24675522131,8sleep02467650-21grep0
24403082131,8sleep2106713-21snmpd2
24232142131,5sleep22423230-21ssh2
23867422130,3sleep12325271-21diskmemload1
23761682131,7sleep12325271-21diskmemload1
23666152131,2sleep12325271-21diskmemload1
22890262131,7sleep22289236-21hddtemp_smartct2
22047262131,6sleep22204849-21diskstats2
26982942121,6sleep02325271-21diskmemload0
26865082121,7sleep12682360-21/usr/sbin/munin1
25898722121,7sleep22589887-21ssh2
25786002121,5sleep20-21swapper/22
25282822120,8sleep22325271-21diskmemload2
25086492121,3sleep12508663-21ssh1
24627792121,7sleep02458647-21/usr/sbin/munin0
24586202120,1sleep20-21swapper/22
24315742121,7sleep12325271-21diskmemload1
24009882121,7sleep02396590-21/usr/sbin/munin0
23767692121,5sleep20-21swapper/22
23604012121,6sleep12360416-21ssh1
23586942121,2sleep00-21swapper/00
23429352121,6sleep12342985-21munin-run1
22782272121,5sleep10-21swapper/11
22670262122,4sleep10-21swapper/11
22611972121,7sleep22257206-21/usr/sbin/munin2
26714532111,3sleep20-21swapper/22
26343462111,3sleep20-21swapper/22
26228632110,2sleep12622877-21ssh1
26190472111,6sleep02620611-21cut0
26061172111,5sleep12325271-21diskmemload1
25984362111,3sleep20-21swapper/22
25626252110,2sleep20-21swapper/22
25614772110,7sleep02561490-21ssh0
25523692111,3sleep00-21swapper/00
25445462112,4sleep02535105-21kworker/0:1+events0
25347062111,7sleep22534721-21ssh2
25172162111,3sleep10-21swapper/11
25116782111,4sleep22325271-21diskmemload2
25097892111,3sleep20-21swapper/22
24989242111,4sleep22325271-21diskmemload2
24989242111,4sleep22325271-21diskmemload2
24852212112,4sleep12485243-21apt-get1
24737072110,7sleep22473719-21sh2
24488782111,6sleep02448890-21ssh0
24457702111,3sleep20-21swapper/22
24326732111,6sleep12434093-21kthreadcore1
24217492111,6sleep12325271-21diskmemload1
24138462111,4sleep22325271-21diskmemload2
24104852111,5sleep10-21swapper/11
23972182111,6sleep22398329-21grep2
23971312111,6sleep12397215-21ssh1
23862542110,1sleep00-21swapper/00
23672942111,4sleep02325271-21diskmemload0
23516132116,2sleep2106604-21rpcbind2
23400382111,3sleep00-21swapper/00
23190072110,5sleep22319060-21ntp_states2
23139712111,7sleep134-21ksoftirqd/11
23139712111,7sleep134-21ksoftirqd/11
22994542111,5sleep22299577-21diskstats2
22218692111,3sleep1321rcuc/11
22157152111,6sleep22217259-21grep2
22151112111,3sleep10-21swapper/11
22023562111,6sleep12202949-21kthreadcore1
26897902101,2sleep20-21swapper/22
26701502101,5sleep02670161-21ssh0
26625632101,3sleep02325271-21diskmemload0
26545082101,3sleep00-21swapper/00
26525582101,4sleep12325271-21diskmemload1
26499482101,4sleep22650917-21memory2
26429822101,4sleep22325271-21diskmemload2
26290552102,4sleep02626467-21sendmail-msp0
25811222101,4sleep02325271-21diskmemload0
25652082101,5sleep02325271-21diskmemload0
25438842101,4sleep22325271-21diskmemload2
25348942101,4sleep02325271-21diskmemload0
24933912100,3sleep20-21swapper/22
24724662100,2sleep10-21swapper/11
24501072101,5sleep22450230-21perl2
24384772101,4sleep02325271-21diskmemload0
24211592100,1sleep00-21swapper/00
24211312101,4sleep22325271-21diskmemload2
24095802101,4sleep02409651-21ntp_states0
23909462101,5sleep22391763-21/usr/sbin/munin2
23702572101,4sleep02325271-21diskmemload0
23598272101,4sleep22325271-21diskmemload2
23490032101,3sleep10-21swapper/11
23256462100,3sleep20-21swapper/22
23255162100,2sleep10-21swapper/11
23211902101,6sleep12322820-21cut1
23096932102,3sleep22309712-21apt-get2
23096932102,3sleep22309712-21apt-get2
22939922102,3sleep12294011-21apt-get1
22729482101,4sleep22272949-21apt-get2
22676682101,4sleep02267671-21apt-get0
22523762101,4sleep02252447-21irqstats0
22364132101,4sleep12236625-21hddtemp_smartct1
22203702101,5sleep02220373-21grep0
2680053290,2sleep20-21swapper/22
2545620290,1sleep10-21swapper/11
2423496291,4sleep02423548-21ssh0
2381560290,1sleep20-21swapper/22
2320281291,3sleep00-21swapper/00
2294287291,4sleep02294496-21hddtemp_smartct0
2293983291,3sleep22293765-21sendmail-msp2
2283481291,3sleep02283201-21apt-get0
2277952291,4sleep12278165-21sed1
2263042291,4sleep02264561-21cut0
2252448291,4sleep12253559-21cut1
2236626291,4sleep22236715-21cut2
2231102291,5sleep20-21swapper/22
2214491290,1sleep00-21swapper/00
2204560291,3sleep00-21swapper/00
2464721281,3sleep12464740-21ssh1
2314926281,2sleep10-21swapper/11
2313827280,1sleep00-21swapper/00
2313827280,1sleep00-21swapper/00
2303141281,4sleep02303255-21/usr/sbin/munin0
2282960280,1sleep00-21swapper/00
2269713281,3sleep22271473-21tr2
2246621280,2sleep20-21swapper/22
2241371281,2sleep00-21swapper/00
2236300281,4sleep02236412-21/usr/sbin/munin0
2215405281,3sleep02215619-21smartctl0
2319982270,1sleep00-21swapper/00
2309276270,4sleep10-21swapper/11
2309140270,1sleep00-21swapper/00
2304458270,2sleep20-21swapper/22
2293438270,1sleep10-21swapper/11
2282986270,1sleep20-21swapper/22
2273214271,2sleep00-21swapper/00
2272270270,1sleep10-21swapper/11
2266238270,3sleep22266399-21strings2
2257492271,3sleep02257645-21gltestperf0
2257202270,2sleep10-21swapper/11
2253560271,2sleep22255125-21cut2
2230886271,2sleep10-21swapper/11
2230836271,2sleep02214750-21kworker/u16:3+ext4-rsv-conversion0
2225580270,1sleep00-21swapper/00
2209816270,2sleep10-21swapper/11
2299860261,2sleep10-21swapper/11
2289315261,2sleep02277749-21kworker/0:0+events0
2285166261,2sleep10-21swapper/11
2283787261,2sleep20-21swapper/22
2248434261,2sleep00-21swapper/00
2246601260,1sleep10-21swapper/11
2246010260,4sleep20-21swapper/22
2230377260,1sleep20-21swapper/22
2230337260,4sleep10-21swapper/11
2202153260,1sleep20-21swapper/22
2197876261,2sleep00-21swapper/00
2246108250,1sleep10-21swapper/11
2220634250,1sleep20-21swapper/22
2202034250,3sleep10-21swapper/11
2320554240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional