You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 23:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri Sep 11, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
356361621290,2sleep10-21swapper/11
321065521200,1sleep03210657-21sed0
3093724211854,59sleep30-21swapper/33
3094022210080,11sleep20-21swapper/22
309375628659,7sleep00-21swapper/00
309389628468,10sleep10-21swapper/11
33564332370,6sleep1321rcuc/11
3094215992317,3cyclictest3433451-21chrt3
309421599220,18cyclictest3211721-21taskset3
328261222112,4sleep1331ktimers/11
32721572211,8sleep23222249-21diskmemload2
32721572211,8sleep23222249-21diskmemload2
309421599211,16cyclictest0-21swapper/33
309421599211,16cyclictest0-21swapper/33
309421599211,16cyclictest0-21swapper/33
309421599211,16cyclictest0-21swapper/33
309421599211,16cyclictest0-21swapper/33
309421599211,15cyclictest3310897-21chrt3
309421599211,15cyclictest0-21swapper/33
309421599204,13cyclictest0-21swapper/33
309421599201,16cyclictest0-21swapper/33
309421599201,16cyclictest0-21swapper/33
3094215992011,5cyclictest35447682sleep33
309421599201,15cyclictest0-21swapper/33
309421599201,15cyclictest0-21swapper/33
3094215991916,1cyclictest0-21swapper/33
309421599191,15cyclictest0-21swapper/33
309421599191,15cyclictest0-21swapper/33
309421599191,15cyclictest0-21swapper/33
309421599191,14cyclictest3127265-21taskset3
309421599191,14cyclictest3127265-21taskset3
309421599191,14cyclictest0-21swapper/33
309421599191,14cyclictest0-21swapper/33
309421599191,14cyclictest0-21swapper/33
309421599191,14cyclictest0-21swapper/33
309421599191,14cyclictest0-21swapper/33
309421599191,14cyclictest0-21swapper/33
309421599191,14cyclictest0-21swapper/33
309421599191,14cyclictest0-21swapper/33
309421599191,13cyclictest0-21swapper/33
309421599190,6cyclictest3190355-21taskset3
309421599190,17cyclictest0-21swapper/33
309421599190,17cyclictest0-21swapper/33
309421599190,16cyclictest0-21swapper/33
33438382181,8sleep13343849-21ssh1
3094215991814,2cyclictest3148633-21taskset3
3094215991813,3cyclictest0-21swapper/33
3094215991813,3cyclictest0-21swapper/33
3094215991812,3cyclictest0-21swapper/33
309421599181,14cyclictest0-21swapper/33
309421599181,14cyclictest0-21swapper/33
309421599181,14cyclictest0-21swapper/33
309421599181,14cyclictest0-21swapper/33
309421599181,13cyclictest0-21swapper/33
309421599180,14cyclictest3229460-21taskset3
309421599180,14cyclictest0-21swapper/33
34308692171,2sleep00-21swapper/00
34140092171,5sleep13414016-21ssh1
33512412171,4sleep03222249-21diskmemload0
32637452171,3sleep00-21swapper/00
32562632171,2sleep10-21swapper/11
31489832171,8sleep13149159-21cstates1
31285132171,13sleep23129683-21tr2
309421599171,4cyclictest3221869-21taskset3
309421599171,4cyclictest0-21swapper/33
3094215991712,3cyclictest0-21swapper/33
309421599171,13cyclictest0-21swapper/33
309421599171,13cyclictest0-21swapper/33
309421599171,13cyclictest0-21swapper/33
309421599171,13cyclictest0-21swapper/33
309421599171,11cyclictest0-21swapper/33
35374792161,2sleep00-21swapper/00
35214482161,4sleep03222249-21diskmemload0
35094722161,4sleep03222249-21diskmemload0
34829312161,11sleep23482945-21ssh2
33985942160,1sleep10-21swapper/11
33142212162,10sleep13310512-21sendmail-msp1
32060362160,4sleep1321rcuc/11
309421599161,4cyclictest0-21swapper/33
3094215991612,2cyclictest0-21swapper/33
309421599161,13cyclictest0-21swapper/33
309421599161,13cyclictest0-21swapper/33
309421599161,12cyclictest0-21swapper/33
309421599161,12cyclictest0-21swapper/33
309421599161,12cyclictest0-21swapper/33
309421599160,14cyclictest0-21swapper/33
34937542150,1sleep20-21swapper/22
34932972151,3sleep03222249-21diskmemload0
34589482151,2sleep00-21swapper/00
33798452151,5sleep23379859-21sh2
33698822151,3sleep13222249-21diskmemload1
33348422151,2sleep10-21swapper/11
3094215991511,2cyclictest0-21swapper/33
309421599150,12cyclictest0-21swapper/33
309421599150,12cyclictest0-21swapper/33
35529852141,2sleep00-21swapper/00
35374042141,3sleep23222249-21diskmemload2
35225962143,2sleep0171rcu_preempt0
34304282141,4sleep23430442-21ssh2
33877252145,3sleep2421rcuc/22
33715362141,9sleep23371550-21ssh2
32823262140,2sleep00-21swapper/00
32461052141,9sleep03246118-21ssh0
32297002141,2sleep10-21swapper/11
35834582131,8sleep23583473-21ssh2
35816382130,2sleep10-21swapper/11
35574062131,7sleep03557418-21ssh0
35463832130,2sleep20-21swapper/22
34861912130,1sleep10-21swapper/11
34646072131,8sleep03464756-21awk0
34506872131,3sleep23222249-21diskmemload2
34306242131,8sleep1106713-21snmpd1
34049842130,2sleep03222249-21diskmemload0
33363202131,7sleep03222249-21diskmemload0
33275972130,9sleep03327609-21sh0
33186272131,6sleep00-21swapper/00
33076182130,4sleep23307630-21sh2
32893402131,3sleep23289354-21ssh2
32844492131,8sleep13284460-21ssh1
32646542130,1sleep10-21swapper/11
32451492131,2sleep10-21swapper/11
32226792131,6sleep23222708-21ssh2
32215392131,8sleep23221802-21unixbench_singl2
31854152130,1sleep20-21swapper/22
31486682131,8sleep23148875-21cat2
309421599137,4cyclictest0-21swapper/33
309421599131,8cyclictest3111082-21taskset3
3094215991311,1cyclictest0-21swapper/33
3094215991311,1cyclictest0-21swapper/33
309421599130,11cyclictest0-21swapper/33
35725902122,4sleep1331ktimers/11
34873292121,5sleep13486606-21sendmail-msp1
34777552120,8sleep23477769-21ssh2
34772612121,6sleep10-21swapper/11
34516942121,5sleep23451353-21sendmail-msp2
34471052121,7sleep13447289-21mailstats1
33893452121,7sleep03389356-21ssh0
33581142121,6sleep23358875-21ls2
33539602121,5sleep20-21swapper/22
33074432121,6sleep13307457-21ssh1
32895252121,4sleep00-21swapper/00
32668042121,3sleep00-21swapper/00
32668042121,3sleep00-21swapper/00
32569622121,6sleep23256975-21ssh2
32399042121,3sleep03239993-21systemd-run0
32382672121,7sleep23238278-21ssh2
31169082120,1sleep00-21swapper/00
35911972111,4sleep00-21swapper/00
35388632111,3sleep10-21swapper/11
35268392110,1sleep10-21swapper/11
35209412110,1sleep20-21swapper/22
35195562111,3sleep10-21swapper/11
35098142111,5sleep23222249-21diskmemload2
35042782111,5sleep03504312-21apt0
34754892111,3sleep00-21swapper/00
34671652111,6sleep10-21swapper/11
34662402111,4sleep23222249-21diskmemload2
34483302111,5sleep03222249-21diskmemload0
34342862111,5sleep23434409-21diskstats2
34233942110,1sleep20-21swapper/22
34165852111,3sleep10-21swapper/11
34147562111,6sleep23414771-21ssh2
34042562111,4sleep13222249-21diskmemload1
33989212111,5sleep20-21swapper/22
33544182111,4sleep10-21swapper/11
33426602112,4sleep03222249-21diskmemload0
33372562111,5sleep23337527-21df2
33108702111,4sleep23222249-21diskmemload2
33014022111,3sleep20-21swapper/22
32993682111,4sleep03222249-21diskmemload0
32825682116,1sleep2421rcuc/22
32719842114,3sleep13222249-21diskmemload1
32719842114,3sleep13222249-21diskmemload1
32468782111,3sleep20-21swapper/22
31926292111,6sleep03194178-21cut0
31909642111,5sleep23190983-21apt-get2
31752802112,4sleep03175276-21apt-get0
31542812111,5sleep03154300-21apt-get0
31509892111,5sleep23148734-21sendmail-msp2
35908512100,1sleep20-21swapper/22
35906802101,4sleep13590694-21ssh1
35813682101,3sleep00-21swapper/00
35713972101,2sleep20-21swapper/22
35662452101,5sleep03566259-21ssh0
35397562100,2sleep10-21swapper/11
35280052101,4sleep23222249-21diskmemload2
35025102101,3sleep20-21swapper/22
34972272101,5sleep13498820-21cut1
34839052100,1sleep00-21swapper/00
34591732101,3sleep13222249-21diskmemload1
34414482101,2sleep0171rcu_preempt0
34398312100,3sleep10-21swapper/11
33969102101,2sleep20-21swapper/22
33959982101,4sleep03222249-21diskmemload0
33863382100,2sleep10-21swapper/11
33775552101,5sleep03377570-21ssh0
33727452101,2sleep10-21swapper/11
33606142100,1sleep00-21swapper/00
33333732101,3sleep23222249-21diskmemload2
33253812100,1sleep10-21swapper/11
33253412101,3sleep23222249-21diskmemload2
33069022101,3sleep00-21swapper/00
32996982101,4sleep13222249-21diskmemload1
32641952101,4sleep23222249-21diskmemload2
32542932101,3sleep00-21swapper/00
32313942100,1sleep10-21swapper/11
32303342101,3sleep00-21swapper/00
32125982101,5sleep23213733-21kthreadcore2
32120252101,3sleep10-21swapper/11
31805172101,5sleep03180673-21cstates0
31705472101,5sleep23169747-21sendmail-msp2
31584522100,6sleep23158601-21awk2
31387852101,5sleep13138991-21cut1
31323632101,4sleep13132583-21users1
31282312101,5sleep03128440-21hddtemp_smartct0
31065812101,4sleep23106660-21munin-run2
3563266291,4sleep23563277-21ssh2
3554120291,2sleep10-21swapper/11
3548578291,2sleep20-21swapper/22
3544671291,4sleep03544685-21ssh0
3510491291,3sleep13222249-21diskmemload1
3422428291,3sleep00-21swapper/00
3414164291,2sleep00-21swapper/00
3369027291,4sleep03369042-21ssh0
3201128294,3sleep2431ktimers/22
3196536290,5sleep13196637-21fschecks_time1
3165308291,4sleep23166719-21grep2
3140214291,4sleep03141941-21tr0
3135483291,4sleep13137120-21sed1
3135483291,4sleep13137120-21sed1
3127646291,4sleep23127779-21ls2
3127646291,4sleep23127779-21ls2
3106890292,3sleep13106893-21apt-get1
3094394291,3sleep03094413-21apt-get0
3201512281,3sleep03201235-21apt-get0
3175281280,4sleep10-21swapper/11
3174787280,1sleep00-21swapper/00
3169974281,3sleep13169993-21apt-get1
3154303281,3sleep13154480-21expr1
3148956281,3sleep00-21swapper/00
3144483281,3sleep00-21swapper/00
3138087280,1sleep20-21swapper/22
3138087280,1sleep20-21swapper/22
3133897280,5sleep03135478-21kthreadcore0
3133897280,5sleep03135478-21kthreadcore0
3110986281,3sleep23106647-21sendmail-msp2
3100124281,3sleep13099630-21munin-node1
3222035270,1sleep10-21swapper/11
3211367270,1sleep20-21swapper/22
3206371270,1sleep20-21swapper/22
3190953271,2sleep10-21swapper/11
3185728270,2sleep10-21swapper/11
3185151270,1sleep10-21swapper/11
3169398270,1sleep00-21swapper/00
3164735270,1sleep10-21swapper/11
3164258270,2sleep00-21swapper/00
3163709271,3sleep10-21swapper/11
3148572270,1sleep10-21swapper/11
3138495270,2sleep20-21swapper/22
3127517270,1sleep10-21swapper/11
3127517270,1sleep10-21swapper/11
3127427271,4sleep03083586-21kworker/0:2+events0
3127427271,4sleep03083586-21kworker/0:2+events0
3117974271,2sleep00-21swapper/00
3112189270,1sleep10-21swapper/11
3106275270,1sleep00-21swapper/00
3221881260,1sleep00-21swapper/00
3217021260,1sleep00-21swapper/00
3197455261,2sleep00-21swapper/00
3189971261,2sleep00-21swapper/00
3186304261,2sleep20-21swapper/22
3164179260,4sleep20-21swapper/22
3122246260,3sleep20-21swapper/22
3121984260,1sleep10-21swapper/11
3111541261,1sleep00-21swapper/00
3094416261,2sleep10-21swapper/11
3206778250,2sleep10-21swapper/11
3112194250,1sleep20-21swapper/22
3094592250,1sleep20-21swapper/22
3175540240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional