You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 03:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Wed Aug 19, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3488913213161,66sleep30-21swapper/33
359849121250,2sleep00-21swapper/00
348893628553,12sleep20-21swapper/22
348889028060,14sleep00-21swapper/00
348891127760,10sleep10-21swapper/11
348936999242,16cyclictest3916179-21chrt3
39242282221,9sleep03924241-21ssh0
37045672220,2sleep30-21swapper/33
3489369992218,2cyclictest0-21swapper/33
348936999220,20cyclictest0-21swapper/33
348936999220,19cyclictest66950irq/132-enp1s0-TxRx-33
348936999211,17cyclictest0-21swapper/33
348936999211,17cyclictest0-21swapper/33
348936999211,15cyclictest0-21swapper/33
36956142201,8sleep13617330-21diskmemload1
3489369992017,1cyclictest0-21swapper/33
3489369992013,3cyclictest3841894-21taskset3
3489369992011,5cyclictest66950irq/132-enp1s0-TxRx-33
348936999201,15cyclictest0-21swapper/33
39830692191,2sleep23983083-21ssh2
37931962191,13sleep03794765-21cut0
35016352190,1sleep10-21swapper/11
3489369991911,6cyclictest0-21swapper/33
348936999191,14cyclictest66950irq/132-enp1s0-TxRx-33
348936999191,14cyclictest0-21swapper/33
348936999191,14cyclictest0-21swapper/33
348936999191,14cyclictest0-21swapper/33
348936999191,14cyclictest0-21swapper/33
348936999191,14cyclictest0-21swapper/33
348936999191,14cyclictest0-21swapper/33
348936999191,14cyclictest0-21swapper/33
348936999191,14cyclictest0-21swapper/33
348936999190,2cyclictest0-21swapper/33
348936999190,1cyclictest0-21swapper/33
348936999190,15cyclictest66950irq/132-enp1s0-TxRx-33
348936999190,15cyclictest35540352chrt3
37535072181,2sleep20-21swapper/22
348936999182,13cyclictest3739375-21turbostat3
3489369991811,5cyclictest0-21swapper/33
348936999181,15cyclictest0-21swapper/33
3489369991811,4cyclictest0-21swapper/33
3489369991811,4cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999181,14cyclictest0-21swapper/33
348936999180,15cyclictest0-21swapper/33
348936999180,14cyclictest0-21swapper/33
348936999180,14cyclictest0-21swapper/33
39026832171,10sleep23617330-21diskmemload2
37360252171,5sleep23736029-21sh2
36603192171,3sleep20-21swapper/22
35285172170,2sleep30-21swapper/33
3489369991713,2cyclictest3595875-21taskset3
3489369991713,2cyclictest0-21swapper/33
348936999171,13cyclictest0-21swapper/33
348936999171,12cyclictest0-21swapper/33
348936999170,14cyclictest0-21swapper/33
348936999170,14cyclictest0-21swapper/33
348936999170,14cyclictest0-21swapper/33
348936999170,14cyclictest0-21swapper/33
39127422161,2sleep20-21swapper/22
39036422160,3sleep10-21swapper/11
38885712164,8sleep23889350-21cat2
38514552161,5sleep23617330-21diskmemload2
37714052160,8sleep23771420-21ssh2
37688822161,5sleep13769931-21ssh1
36794472162,4sleep03617330-21diskmemload0
348936999161,12cyclictest0-21swapper/33
348936999160,13cyclictest0-21swapper/33
348936999160,13cyclictest0-21swapper/33
348936999160,13cyclictest0-21swapper/33
38847792151,2sleep00-21swapper/00
36759782151,8sleep13617330-21diskmemload1
36505142151,4sleep03650527-21ssh0
36373812151,6sleep13638883-21kthreadcore1
36329512151,3sleep03617330-21diskmemload0
348936999156,6cyclictest3585717-21turbostat3
348936999152,9cyclictest3575513-21taskset3
348936999151,11cyclictest0-21swapper/33
348936999150,12cyclictest0-21swapper/33
348936999150,12cyclictest0-21swapper/33
39592162141,2sleep0171rcu_preempt0
39498812141,8sleep03617330-21diskmemload0
39221902141,2sleep10-21swapper/11
39039852141,5sleep03617330-21diskmemload0
38941062141,8sleep03617330-21diskmemload0
38315322142,6sleep13831744-21users1
38298492141,6sleep03830980-21memory0
37717962141,8sleep03617330-21diskmemload0
37397212141,9sleep23739414-21sendmail-msp2
37291522141,2sleep1171rcu_preempt1
37071422141,8sleep13708725-21cut1
37010572141,8sleep03701063-21sh0
36849992140,2sleep10-21swapper/11
36517532140,4sleep13651769-21ssh1
36351052141,8sleep03634720-21apt-get0
36340042141,8sleep23617330-21diskmemload2
36242312141,3sleep10-21swapper/11
35689202141,9sleep03564753-21sendmail-msp0
35227432141,8sleep13522822-21munin-run1
348936999141,10cyclictest0-21swapper/33
348936999140,12cyclictest0-21swapper/33
348936999140,12cyclictest0-21swapper/33
348936999140,11cyclictest0-21swapper/33
39850522131,7sleep03617330-21diskmemload0
39571852131,5sleep20-21swapper/22
39352902131,8sleep23936922-21cut2
38919682131,2sleep10-21swapper/11
38748542131,8sleep23875063-21ls2
38516632130,8sleep03851678-21ssh0
38449602131,8sleep13845024-21kthreadcore1
38182652132,5sleep13818294-21apt-get1
38148642131,3sleep03814875-21ssh0
37475702131,5sleep10-21swapper/11
37352902131,8sleep03735423-21ssh0
37044732131,8sleep21-21systemd2
36784022131,3sleep23678671-21ssh2
36613602131,7sleep23661631-21df_inode2
35846692130,6sleep244-21ksoftirqd/22
35826472130,2sleep00-21swapper/00
35803562130,1sleep10-21swapper/11
35754522130,1sleep00-21swapper/00
3489369991310,2cyclictest0-21swapper/33
39395412121,7sleep03939555-21ssh0
39161472121,6sleep23617330-21diskmemload2
38768742121,7sleep13876887-21rm1
38406212120,7sleep03617330-21diskmemload0
38255772120,6sleep014-21ksoftirqd/00
38095272122,5sleep13809127-21sendmail-msp1
38056932120,7sleep13617330-21diskmemload1
37829932121,7sleep03783178-21date0
37651972121,3sleep10-21swapper/11
37218012121,7sleep03721814-21ssh0
36776812121,7sleep23677694-21ssh2
36657692121,8sleep03666014-21unixbench_multi0
36070262121,2sleep10-21swapper/11
36061112121,5sleep13606359-21users1
35283112122,5sleep13528330-21apt-get1
35242162121,3sleep03525674-21kthreadcore0
35217812121,5sleep23521851-21ntp_states2
35121932120,1sleep00-21swapper/00
39752672110,3sleep03975281-21ssh0
39568152111,5sleep13617330-21diskmemload1
39477482111,5sleep13617330-21diskmemload1
39419162111,5sleep13617330-21diskmemload1
39321942111,6sleep23932209-21sh2
39305762111,4sleep03617330-21diskmemload0
38796702111,5sleep13879773-21irqstats1
38439312111,6sleep13843945-21ssh1
38406482115,2sleep23800149-21kworker/u16:2+events_power_efficient2
38322052111,5sleep20-21swapper/22
38094872111,4sleep272-21kcompactd02
38063892111,4sleep03617330-21diskmemload0
37966192111,4sleep23796853-21users2
37912032111,5sleep13617330-21diskmemload1
37799342111,3sleep10-21swapper/11
37484712110,1sleep00-21swapper/00
37371962111,7sleep13737207-21ssh1
37285442112,4sleep23617330-21diskmemload2
37210012111,6sleep13721014-21sh1
37101932111,3sleep20-21swapper/22
36743802111,6sleep03669677-21sendmail-msp0
36593162111,4sleep00-21swapper/00
36526332112,4sleep13652652-21apt-get1
35862892111,5sleep03586497-21hddtemp_smartct0
35479452110,1sleep20-21swapper/22
35390252111,5sleep13539127-21perl1
35125892111,6sleep03512700-21tr0
39846532100,6sleep13984667-21ssh1
39756512100,6sleep23975657-21ssh2
39680172101,4sleep03617330-21diskmemload0
39656652100,3sleep20-21swapper/22
39490392101,5sleep23949052-21ssh2
38705322101,5sleep03617330-21diskmemload0
38698582100,1sleep10-21swapper/11
38698582100,1sleep10-21swapper/11
38586602101,2sleep20-21swapper/22
38585852101,3sleep00-21swapper/00
38182992101,2sleep20-21swapper/22
37884062101,2sleep20-21swapper/22
37883802101,4sleep03617330-21diskmemload0
37797352101,2sleep20-21swapper/22
37612352101,5sleep23761385-21ssh2
37587362101,5sleep03760347-21kthreadcore0
37485582101,5sleep13748580-21grep1
37476072101,4sleep03617330-21diskmemload0
37282732101,3sleep00-21swapper/00
36924642101,3sleep00-21swapper/00
36613562101,6sleep13661359-21http1
36434072101,5sleep23643419-21sh2
36316252101,3sleep10-21swapper/11
36111362101,5sleep23606807-21sendmail-msp2
35742872100,2sleep00-21swapper/00
35655542101,5sleep13566616-21cut1
35645862100,4sleep172-21kcompactd01
35439982100,2sleep0171rcu_preempt0
35338232101,5sleep13533873-21sort1
35070572101,4sleep03507113-21munin-run0
35020242101,3sleep13502043-21apt-get1
34915192101,5sleep13493282-21kthreadcore1
3972570291,4sleep13972724-21ntp_192.168.1141
3960627291,4sleep13962156-21cut1
3930377290,1sleep10-21swapper/11
3912071290,4sleep10-21swapper/11
3905447290,1sleep00-21swapper/00
3883968291,4sleep23878809-21sendmail-msp2
3868499291,4sleep23868511-21sh2
3868499291,4sleep23868511-21sh2
3868375291,4sleep03617330-21diskmemload0
3868375291,4sleep03617330-21diskmemload0
3861200291,2sleep10-21swapper/11
3806208291,2sleep20-21swapper/22
3798773290,1sleep10-21swapper/11
3718703292,3sleep2431ktimers/22
3704950291,3sleep03705217-21df0
3702981291,4sleep13702994-21ssh1
3693004290,1sleep20-21swapper/22
3623854291,4sleep03623868-21ssh0
3617676291,2sleep20-21swapper/22
3584993291,4sleep139542-21systemd-journal1
3559742291,3sleep23559761-21apt-get2
3559469290,4sleep072-21kcompactd00
3549324291,4sleep13549583-21df_inode1
3534495291,4sleep03536102-21grep0
3525677291,5sleep10-21swapper/11
3643907281,2sleep23643929-21apt-get2
3601789280,2sleep20-21swapper/22
3591265280,2sleep20-21swapper/22
3549861281,3sleep03549910-21kthreadcore0
3543999281,2sleep10-21swapper/11
3539878281,4sleep03541532-21tr0
3538740281,2sleep20-21swapper/22
3517471281,3sleep23517475-21modprobe2
3514365281,3sleep10-21swapper/11
3502046281,3sleep23501796-21sendmail-msp2
3501713281,4sleep0106713-21snmpd0
3489296280,1sleep00-21swapper/00
3613188271,2sleep00-21swapper/00
3612632271,3sleep10-21swapper/11
3596500270,2sleep20-21swapper/22
3596138270,1sleep10-21swapper/11
3591258270,1sleep00-21swapper/00
3590064271,2sleep20-21swapper/22
3575491270,2sleep20-21swapper/22
3561224270,3sleep03562921-21kthreadcore0
3559281270,1sleep20-21swapper/22
3554145270,1sleep20-21swapper/22
3512260270,1sleep20-21swapper/22
3507324270,2sleep10-21swapper/11
3496775270,2sleep20-21swapper/22
3616227261,2sleep20-21swapper/22
3607030261,2sleep00-21swapper/00
3606714260,4sleep00-21swapper/00
3601224260,4sleep10-21swapper/11
3589972260,2sleep10-21swapper/11
3575009260,4sleep20-21swapper/22
3574953260,1sleep10-21swapper/11
3569806260,1sleep20-21swapper/22
3556074261,2sleep10-21swapper/11
3533536260,1sleep20-21swapper/22
3532522261,2sleep00-21swapper/00
3528898261,2sleep20-21swapper/22
3527411260,2sleep20-21swapper/22
3522529260,1sleep00-21swapper/00
3493851261,2sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional