You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 08:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sat May 30, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3362699212362,57sleep30-21swapper/33
336252128453,11sleep20-21swapper/22
336251428061,14sleep00-21swapper/00
336272727961,12sleep10-21swapper/11
336292199251,21cyclictest3408192-21chrt3
336292199236,14cyclictest34136532sleep33
336292199236,14cyclictest34136532sleep33
36569072221,8sleep03656917-21ssh0
3362921992218,2cyclictest0-21swapper/33
35363712211,10sleep13493284-21diskmemload1
3362921992111,7cyclictest0-21swapper/33
336292199211,16cyclictest0-21swapper/33
36058252207,5sleep244-21ksoftirqd/22
3362921992016,2cyclictest0-21swapper/33
336292199201,15cyclictest66950irq/132-enp1s0-TxRx-33
3362921992011,5cyclictest0-21swapper/33
3362921992010,7cyclictest3563987-21chrt3
336292199200,17cyclictest0-21swapper/33
37893912191,14sleep23493284-21diskmemload2
3362921991917,1cyclictest0-21swapper/33
3362921991917,1cyclictest0-21swapper/33
336292199191,5cyclictest36154472sleep33
336292199191,15cyclictest0-21swapper/33
336292199191,15cyclictest0-21swapper/33
336292199191,15cyclictest0-21swapper/33
336292199191,15cyclictest0-21swapper/33
336292199191,15cyclictest0-21swapper/33
336292199191,15cyclictest0-21swapper/33
336292199191,15cyclictest0-21swapper/33
336292199191,15cyclictest0-21swapper/33
336292199191,14cyclictest0-21swapper/33
336292199191,14cyclictest0-21swapper/33
336292199191,14cyclictest0-21swapper/33
336292199191,14cyclictest0-21swapper/33
36901392181,4sleep03690796-21ssh0
36417732181,3sleep10-21swapper/11
35413352181,11sleep23541477-21ntpq2
3362921991811,5cyclictest0-21swapper/33
336292199181,14cyclictest3601898-21chrt3
3362921991811,4cyclictest0-21swapper/33
336292199181,14cyclictest0-21swapper/33
336292199181,14cyclictest0-21swapper/33
336292199181,14cyclictest0-21swapper/33
336292199181,14cyclictest0-21swapper/33
336292199181,14cyclictest0-21swapper/33
336292199181,14cyclictest0-21swapper/33
336292199181,13cyclictest0-21swapper/33
336292199181,13cyclictest0-21swapper/33
336292199181,13cyclictest0-21swapper/33
336292199180,15cyclictest0-21swapper/33
336292199180,14cyclictest0-21swapper/33
35981412170,1sleep10-21swapper/11
3362921991711,3cyclictest0-21swapper/33
336292199171,13cyclictest0-21swapper/33
336292199171,13cyclictest0-21swapper/33
336292199171,13cyclictest0-21swapper/33
336292199170,14cyclictest0-21swapper/33
336292199170,14cyclictest0-21swapper/33
336292199170,14cyclictest0-21swapper/33
336292199170,14cyclictest0-21swapper/33
336292199170,13cyclictest0-21swapper/33
336292199170,13cyclictest0-21swapper/33
38326102161,10sleep23493284-21diskmemload2
38241632161,2sleep10-21swapper/11
36945782161,2sleep20-21swapper/22
36841992161,3sleep10-21swapper/11
35602712161,3sleep20-21swapper/22
35529752161,10sleep13493284-21diskmemload1
33636652168,4sleep23364791-21cat2
336292199161,3cyclictest0-21swapper/33
3362921991612,2cyclictest0-21swapper/33
336292199161,12cyclictest0-21swapper/33
336292199161,11cyclictest0-21swapper/33
336292199160,13cyclictest0-21swapper/33
336292199160,13cyclictest0-21swapper/33
336292199160,13cyclictest0-21swapper/33
336292199160,12cyclictest0-21swapper/33
38068612151,2sleep10-21swapper/11
37368402155,2sleep0171rcu_preempt0
36759982151,2sleep20-21swapper/22
35562452151,2sleep00-21swapper/00
35269062151,4sleep23493284-21diskmemload2
35164622151,3sleep03516474-21ssh0
34988422151,7sleep03493284-21diskmemload0
336292199151,2cyclictest0-21swapper/33
336292199151,11cyclictest3493287-21turbostat3
336292199150,12cyclictest0-21swapper/33
336292199150,12cyclictest0-21swapper/33
336292199150,12cyclictest0-21swapper/33
37988172141,5sleep23798829-21diskmemload2
37980442140,2sleep10-21swapper/11
37822912141,9sleep23782306-21ssh2
36422622140,2sleep00-21swapper/00
35512722141,7sleep20-21swapper/22
35029352141,8sleep13503035-21kthreadcore1
34704132141,9sleep23470841-21tail2
336292199141,2cyclictest34508442sleep33
3362921991411,2cyclictest0-21swapper/33
336292199141,11cyclictest0-21swapper/33
3362921991410,3cyclictest0-21swapper/33
38278872131,7sleep13829335-21cut1
37459532131,3sleep13745964-21ssh1
37194352131,2sleep03493284-21diskmemload0
36780652131,7sleep23678093-21apt-get2
36587412130,4sleep10-21swapper/11
36492852131,8sleep23649296-21ssh2
36045062131,8sleep13604511-21ssh1
36041512131,3sleep03604352-21ssh0
35703842131,1sleep10-21swapper/11
33968372130,1sleep00-21swapper/00
38615372121,7sleep03861547-21ssh0
38519952121,5sleep00-21swapper/00
38447982121,6sleep23844822-21apt-get2
38272462122,4sleep03827274-21apt-get0
38240892121,2sleep00-21swapper/00
37663442121,7sleep23766523-21expr2
37649332121,7sleep23764946-21sh2
37231162121,7sleep23724780-21tr2
37145032121,6sleep23716171-21cut2
37032822121,7sleep23703293-21ssh2
36833662121,3sleep03683378-21ssh0
36347282121,7sleep23634951-21sh2
36315892121,7sleep03493284-21diskmemload0
36301932121,3sleep13630239-21ssh1
36226762121,6sleep03493284-21diskmemload0
36162882121,2sleep13616302-21ssh1
35716482120,7sleep23493284-21diskmemload2
35356482121,6sleep03493284-21diskmemload0
35152792121,6sleep13515327-21ntpq1
34922652121,5sleep13492314-21ntpq1
34567172121,7sleep13456909-21cut1
34512792121,6sleep23451395-21irqstats2
33811762121,5sleep23381195-21apt-get2
38366612111,6sleep23838031-21grep2
38234132110,1sleep20-21swapper/22
38104712111,5sleep23811955-21cat2
38067262111,4sleep20-21swapper/22
37892812111,3sleep10-21swapper/11
37801182111,6sleep13780129-21ssh1
37539312110,1sleep20-21swapper/22
37536642111,6sleep13753678-21ssh1
37311382111,6sleep13731172-21kthreadcore1
37181832111,5sleep13493284-21diskmemload1
37125802111,2sleep03712638-21systemd-run0
37045982111,6sleep23704819-21basename2
36692622111,7sleep00-21swapper/00
36230472110,7sleep13623059-21rm1
36156672110,1sleep00-21swapper/00
35883802111,3sleep10-21swapper/11
35415412111,5sleep03541609-21ntpq0
35286492111,5sleep23528864-21diskstats2
35204942110,7sleep13522007-21cut1
35186702111,5sleep23493284-21diskmemload2
35103412111,5sleep23510352-21ssh2
34986582111,5sleep13493284-21diskmemload1
34881852111,5sleep03488204-21apt-get0
38590902100,2sleep10-21swapper/11
38588492101,2sleep20-21swapper/22
38418972101,4sleep13493284-21diskmemload1
38160582101,2sleep10-21swapper/11
38147902101,4sleep03493284-21diskmemload0
37997642100,1sleep00-21swapper/00
37904232101,2sleep00-21swapper/00
37790132101,5sleep03779081-21ntpq0
37661202101,5sleep13766343-21diskstats1
37442912100,2sleep20-21swapper/22
37293022100,2sleep10-21swapper/11
37117902101,4sleep13493284-21diskmemload1
36997882101,4sleep13699848-21ntpq1
36735232101,4sleep13673580-21ntpq1
36648082101,6sleep23664865-21gcc2
36605922101,4sleep13660614-21apt-get1
36597542101,4sleep23493284-21diskmemload2
36491202101,4sleep13493284-21diskmemload1
36319612100,1sleep20-21swapper/22
36212762101,3sleep20-21swapper/22
35972992101,3sleep20-21swapper/22
35946632101,4sleep03594725-21ntpq0
35870392101,2sleep00-21swapper/00
35434272100,1sleep10-21swapper/11
34936402101,2sleep20-21swapper/22
34872332101,5sleep23487314-21grep2
34709792101,4sleep13471037-21ntpq1
34615832101,4sleep23461799-21diskstats2
34561902101,4sleep23456445-21df2
34401862101,4sleep03440205-21apt-get0
34285402101,5sleep23428615-21/usr/sbin/munin2
34246602101,4sleep03424731-21irqstats0
34193322101,6sleep23419427-21cut2
34134882101,4sleep13413507-21apt-get1
34134882101,4sleep13413507-21apt-get1
34025682101,4sleep03402589-21munin-run0
33904452100,1sleep10-21swapper/11
3850548291,3sleep13493284-21diskmemload1
3836354291,4sleep03836574-21hddtemp_smartct0
3770226291,3sleep00-21swapper/00
3763121291,3sleep03493284-21diskmemload0
3754109291,3sleep03493284-21diskmemload0
3746501291,2sleep00-21swapper/00
3732382291,5sleep23734105-21kthreadcore2
3727162291,3sleep00-21swapper/00
3695456290,1sleep00-21swapper/00
3692539291,3sleep13493284-21diskmemload1
3664605291,4sleep03664755-21ntp_192.168.1140
3647800291,4sleep03648052-21ssh0
3614925291,2sleep20-21swapper/22
3587479291,4sleep23587494-21ssh2
3577043291,4sleep03493284-21diskmemload0
3574390291,4sleep13576081-21grep1
3573158291,4sleep23573301-21ssh2
3563726291,3sleep03563737-21ssh0
3560056291,2sleep10-21swapper/11
3551853291,3sleep03493284-21diskmemload0
3524305291,4sleep03524363-21sh0
3466594291,4sleep03466606-21cron0
3462083291,4sleep13462599-21grep1
3446054291,4sleep03447528-21tr0
3445224291,4sleep13445311-21cat1
3439905291,4sleep23440085-21cut2
3370505291,4sleep13370719-21expr1
3808072281,3sleep03808086-21ssh0
3763549281,3sleep13493284-21diskmemload1
3502319280,2sleep00-21swapper/00
3470926281,3sleep03470973-21ntpq0
3429197282,2sleep13362913-21cyclictest1
3417824280,1sleep20-21swapper/22
3417824280,1sleep20-21swapper/22
3412502281,3sleep23412512-21/usr/sbin/munin2
3402608280,1sleep10-21swapper/11
3396924281,3sleep10-21swapper/11
3396824280,4sleep20-21swapper/22
3386158280,2sleep10-21swapper/11
3368109280,1sleep10-21swapper/11
3493052270,1sleep20-21swapper/22
3477534270,2sleep10-21swapper/11
3472544270,4sleep10-21swapper/11
3472195270,2sleep20-21swapper/22
3450522270,1sleep20-21swapper/22
3434820270,1sleep00-21swapper/00
3434310270,1sleep10-21swapper/11
3403738271,2sleep03405415-21kthreadcore0
3391548270,1sleep00-21swapper/00
3391357270,1sleep20-21swapper/22
3380791270,2sleep03380780-21fwupd0
3375415270,2sleep20-21swapper/22
3370483271,2sleep00-21swapper/00
3482843260,1sleep00-21swapper/00
3475129261,2sleep00-21swapper/00
3461152260,1sleep00-21swapper/00
3455645260,1sleep10-21swapper/11
3452539261,2sleep00-21swapper/00
3450325260,4sleep10-21swapper/11
3445208260,1sleep20-21swapper/22
3439649260,4sleep10-21swapper/11
3434329260,1sleep00-21swapper/00
3429491260,2sleep23429510-21apt-get2
3423607260,1sleep10-21swapper/11
3407626260,1sleep20-21swapper/22
3402371260,1sleep10-21swapper/11
3386014260,1sleep00-21swapper/00
3380218261,2sleep10-21swapper/11
3376185260,3sleep23375860-21/usr/sbin/munin2
3483446251,1sleep10-21swapper/11
3482226250,2sleep20-21swapper/22
3481332250,1sleep03481505-21strings0
3423205251,1sleep00-21swapper/00
3413778250,1sleep00-21swapper/00
3413778250,1sleep00-21swapper/00
3408446250,1sleep00-21swapper/00
3401947250,1sleep20-21swapper/22
3362803250,2sleep00-21swapper/00
3408495240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional