You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 00:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Tue Apr 21, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2487505211963,51sleep30-21swapper/33
290048521090,2sleep00-21swapper/00
2492159210698,5sleep20-21swapper/22
249250928064,10sleep10-21swapper/11
249226027958,15sleep00-21swapper/00
2492618992420,2cyclictest0-21swapper/33
28841362221,3sleep00-21swapper/00
249261899221,17cyclictest2780788-21taskset3
249261899211,17cyclictest0-21swapper/33
249261899211,16cyclictest2956277-21taskset3
29741842201,2sleep10-21swapper/11
27824282200,1sleep00-21swapper/00
2492618992017,1cyclictest0-21swapper/33
2492618992017,1cyclictest0-21swapper/33
2492618992017,1cyclictest0-21swapper/33
2492618992011,6cyclictest0-21swapper/33
249261899201,15cyclictest66950irq/132-enp1s0-TxRx-33
249261899200,3cyclictest0-21swapper/33
29879072191,8sleep22988046-21systemctl2
28685672191,3sleep10-21swapper/11
2492618991915,2cyclictest0-21swapper/33
2492618991912,5cyclictest0-21swapper/33
249261899191,15cyclictest2564409-21taskset3
249261899191,15cyclictest0-21swapper/33
249261899191,14cyclictest0-21swapper/33
249261899191,14cyclictest0-21swapper/33
249261899191,14cyclictest0-21swapper/33
249261899190,2cyclictest0-21swapper/33
249261899190,15cyclictest0-21swapper/33
249261899190,15cyclictest0-21swapper/33
29637272181,3sleep00-21swapper/00
27077702181,8sleep02623107-21diskmemload0
2492618991816,1cyclictest0-21swapper/33
249261899181,5cyclictest66950irq/132-enp1s0-TxRx-33
2492618991815,1cyclictest0-21swapper/33
2492618991815,1cyclictest0-21swapper/33
249261899181,14cyclictest2497572-21taskset3
249261899181,14cyclictest0-21swapper/33
249261899181,14cyclictest0-21swapper/33
249261899181,14cyclictest0-21swapper/33
249261899181,14cyclictest0-21swapper/33
249261899181,14cyclictest0-21swapper/33
249261899181,14cyclictest0-21swapper/33
249261899181,13cyclictest0-21swapper/33
249261899181,13cyclictest0-21swapper/33
249261899181,13cyclictest0-21swapper/33
249261899181,12cyclictest2623121-21turbostat3
249261899180,1cyclictest0-21swapper/33
249261899180,15cyclictest66950irq/132-enp1s0-TxRx-33
249261899180,14cyclictest0-21swapper/33
29543162171,2sleep00-21swapper/00
28868552171,11sleep12887117-21df1
28666072171,3sleep20-21swapper/22
27484522171,13sleep02750171-21kthreadcore0
26742662170,3sleep00-21swapper/00
26662842171,5sleep02623107-21diskmemload0
249261899171,4cyclictest0-21swapper/33
249261899171,13cyclictest0-21swapper/33
249261899171,13cyclictest0-21swapper/33
249261899171,13cyclictest0-21swapper/33
249261899170,14cyclictest0-21swapper/33
249261899170,13cyclictest0-21swapper/33
28130022161,4sleep02623107-21diskmemload0
26378242161,4sleep12623107-21diskmemload1
25267122161,5sleep02526645-31find0
2492618991612,2cyclictest0-21swapper/33
249261899161,11cyclictest0-21swapper/33
249261899161,10cyclictest2554114-21chrt3
249261899160,13cyclictest0-21swapper/33
249261899160,13cyclictest0-21swapper/33
249261899160,13cyclictest0-21swapper/33
29584602151,4sleep22623107-21diskmemload2
29391582151,9sleep02623107-21diskmemload0
29017272151,9sleep12623107-21diskmemload1
28492662151,4sleep22849277-21ssh2
27617972151,2sleep20-21swapper/22
27348552151,4sleep02623107-21diskmemload0
27189742150,2sleep20-21swapper/22
27176882151,10sleep02717691-21ssh0
26820642151,4sleep12682077-21ssh1
26744302151,3sleep12623107-21diskmemload1
26567702151,9sleep12623107-21diskmemload1
249261899151,2cyclictest0-21swapper/33
249261899151,11cyclictest0-21swapper/33
249261899150,3cyclictest0-21swapper/33
249261899150,13cyclictest0-21swapper/33
249261899150,13cyclictest0-21swapper/33
29460422141,3sleep12623107-21diskmemload1
28735202141,2sleep00-21swapper/00
28473502141,9sleep12847437-21grep1
28248742141,6sleep00-21swapper/00
28073502141,2sleep10-21swapper/11
27582722142,6sleep02759241-21memory0
27010722141,4sleep02701084-21ssh0
26925362140,1sleep00-21swapper/00
26124422141,9sleep02612464-21ls0
25810062141,9sleep12581031-21/usr/sbin/munin1
2492618991411,1cyclictest0-21swapper/33
249261899140,2cyclictest0-21swapper/33
249261899140,2cyclictest0-21swapper/33
249261899140,12cyclictest0-21swapper/33
249261899140,11cyclictest0-21swapper/33
249261899140,11cyclictest0-21swapper/33
29912732131,9sleep12991284-21ssh1
29461902131,8sleep02623107-21diskmemload0
29376682131,8sleep22937671-21ssh2
29372042131,8sleep12937215-21ssh1
28938542131,8sleep22893869-21ssh2
28692762131,8sleep12869288-21ssh1
28574342131,8sleep02857448-21ssh0
28121672131,7sleep12812225-21ntpq1
27791882131,3sleep00-21swapper/00
27696852131,6sleep12623107-21diskmemload1
26910852131,7sleep12623107-21diskmemload1
26320192131,8sleep12632033-21ssh1
25531462131,8sleep22553346-21grep2
2492618991311,1cyclictest0-21swapper/33
249261899131,10cyclictest0-21swapper/33
249261899130,2cyclictest25855502sleep33
249261899130,10cyclictest0-21swapper/33
249261899130,10cyclictest0-21swapper/33
29567542121,7sleep12956764-21ssh1
29137202121,6sleep12913755-21fschecks_count1
28940762121,7sleep02894087-21ssh0
28296372121,7sleep12829681-21ntp_192.168.1141
27900792121,6sleep12623107-21diskmemload1
27782162121,6sleep22623107-21diskmemload2
27714912121,6sleep02623107-21diskmemload0
27650102121,6sleep22766561-21cut2
27296162121,7sleep12731223-21ssh1
27277332121,3sleep12727747-21ssh1
27210552126,3sleep20-21swapper/22
26397942121,8sleep00-21swapper/00
26061272120,8sleep22606182-21ld2
25964982121,5sleep02596546-21munin-run0
25266702121,7sleep12526645-31find1
29836382111,5sleep02983908-21df_inode0
29810922111,3sleep00-21swapper/00
29704442111,6sleep02966104-21/usr/sbin/munin0
29085742111,5sleep12908633-21ntpq1
29030072111,2sleep20-21swapper/22
28748182111,4sleep20-21swapper/22
28396702110,2sleep20-21swapper/22
28258232111,5sleep02826047-21hddtemp_smartct0
28237272111,6sleep12623107-21diskmemload1
27903632110,6sleep02623107-21diskmemload0
27869882111,3sleep20-21swapper/22
27592422111,5sleep12759396-21ntpq1
27519652110,3sleep12751978-21ssh1
27509202110,4sleep20-21swapper/22
27434462111,4sleep02623107-21diskmemload0
27152002111,4sleep12715363-21strings1
27025662111,5sleep12702716-21grep1
26937672111,5sleep12623107-21diskmemload1
26891152110,7sleep22689215-21ntpq2
26752592111,3sleep20-21swapper/22
26480862111,3sleep20-21swapper/22
26288582111,7sleep02623107-21diskmemload0
26167302111,5sleep02616781-21ntpq0
26114572111,5sleep22611503-21ntpq2
25780692111,5sleep22579306-21memory2
25594182111,4sleep22559670-21df2
25052612111,5sleep02505284-21munin-run0
29819592101,4sleep12623107-21diskmemload1
29789342101,4sleep22979025-21ntpq2
29727292101,3sleep20-21swapper/22
29567142101,3sleep20-21swapper/22
29454592101,2sleep20-21swapper/22
29284722101,4sleep02623107-21diskmemload0
29277372101,2sleep20-21swapper/22
29240922101,5sleep12925825-21tr1
29184542100,1sleep20-21swapper/22
29132072101,4sleep02912706-21apt-get0
29107542101,3sleep20-21swapper/22
29098802100,1sleep00-21swapper/00
28678022100,6sleep02623107-21diskmemload0
28572562100,7sleep22857269-21sh2
28523542101,5sleep12852671-21kthreadcore1
28430982101,4sleep02843326-21df_inode0
28406102101,5sleep02840620-21ssh0
28405712101,4sleep12623107-21diskmemload1
28325382101,2sleep20-21swapper/22
28146932101,2sleep20-21swapper/22
28050032101,4sleep22623107-21diskmemload2
28047762101,4sleep02623107-21diskmemload0
27904882101,4sleep12790510-21apt-get1
27786072101,3sleep10-21swapper/11
27451462101,4sleep22623107-21diskmemload2
27368432101,2sleep20-21swapper/22
27276182101,4sleep02623107-21diskmemload0
26992742101,3sleep20-21swapper/22
26830372100,4sleep2431ktimers/22
26762822100,6sleep02676244-21/usr/sbin/munin0
26659512100,2sleep20-21swapper/22
26653402101,3sleep10-21swapper/11
26573852101,4sleep22623107-21diskmemload2
26414542101,4sleep12641588-21diskstats1
26324312101,2sleep20-21swapper/22
26290762101,3sleep20-21swapper/22
26180882101,4sleep02618314-21df_inode0
26079232101,5sleep12608175-21tr1
25970452101,5sleep02597225-21tail0
25702382101,4sleep02570361-21diskstats0
25492992101,5sleep02549996-21kthreadcore0
25368342101,5sleep02536889-21ntpq0
25315172100,6sleep22531571-21ld2
25001942101,4sleep12500213-21apt-get1
24979252101,5sleep1255-21systemd-journal1
2964302291,2sleep10-21swapper/11
2884449291,4sleep12884463-21ssh1
2877953291,3sleep22623107-21diskmemload2
2823940291,4sleep22823943-21ssh2
2796144291,5sleep20-21swapper/22
2742909291,3sleep12623107-21diskmemload1
2704366291,4sleep22706119-21tr2
2645475291,3sleep02623107-21diskmemload0
2575424291,4sleep12575682-21df_inode1
2568631290,4sleep02568771-21ntpq0
2564721291,3sleep12564741-21apt-get1
2563445291,4sleep12563491-21ntpq1
2554092291,2sleep20-21swapper/22
2538653291,4sleep22539841-21cut2
2532494291,4sleep02532721-21sed0
2521452291,2sleep072-21kcompactd00
2514914291,4sleep22514962-21ntpq2
2506610291,4sleep02508327-21tr0
2504259291,4sleep22504307-21ntpq2
2655196281,3sleep02655207-21ssh0
2622201280,4sleep12622287-21grep1
2581595281,4sleep00-21swapper/00
2566088280,5sleep22567834-21grep2
2552871281,3sleep12552919-21ntpq1
2543536281,3sleep22543702-21diskstats2
2543436281,3sleep12543533-21tr1
2543414282,2sleep02543433-21apt-get0
2523783281,4sleep22525632-21cut2
2505824281,3sleep12505877-21fschecks_count1
2497703280,2sleep20-21swapper/22
2613439271,3sleep12615117-21kthreadcore1
2602375270,4sleep00-21swapper/00
2601769270,1sleep10-21swapper/11
2591106270,3sleep02591108-21sshd0
2590100270,3sleep10-21swapper/11
2564202270,1sleep00-21swapper/00
2559022270,1sleep10-21swapper/11
2542810270,1sleep00-21swapper/00
2535355271,3sleep1321rcuc/11
2527318270,2sleep10-21swapper/11
2515606270,1sleep00-21swapper/00
2510322270,1sleep20-21swapper/22
2497622270,1sleep00-21swapper/00
2618016260,4sleep20-21swapper/22
2616836260,2sleep20-21swapper/22
2602585260,2sleep10-21swapper/11
2597323261,2sleep20-21swapper/22
2592545261,2sleep20-21swapper/22
2591994261,2sleep10-21swapper/11
2585207260,1sleep20-21swapper/22
2575402260,1sleep00-21swapper/00
2575056260,1sleep10-21swapper/11
2570072260,1sleep20-21swapper/22
2541991260,2sleep10-21swapper/11
2536596261,2sleep20-21swapper/22
2517192261,2sleep22518585-21kthreadcore2
2517009261,2sleep10-21swapper/11
2514735260,2sleep12514908-21strings1
2590909250,2sleep20-21swapper/22
2553874250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional