You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-16 - 07:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Sep 16, 2026 00:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
375309521930,2sleep10-21swapper/11
3316334212755,66sleep30-21swapper/33
3316292210790,10sleep10-21swapper/11
331624828651,11sleep20-21swapper/22
331635627855,6sleep00-21swapper/00
331656599238,12cyclictest0-21swapper/33
331656599224,15cyclictest66950irq/132-enp1s0-TxRx-33
37388922211,16sleep13740611-21grep1
331656599218,1cyclictest0-21swapper/33
331656599212,16cyclictest66950irq/132-enp1s0-TxRx-33
331656599211,8cyclictest3575057-21taskset3
3316565992117,2cyclictest0-21swapper/33
331656599211,16cyclictest0-21swapper/33
34683302201,4sleep03468344-21ssh0
3316565992012,5cyclictest0-21swapper/33
3316565992012,5cyclictest0-21swapper/33
3316565992012,5cyclictest0-21swapper/33
331656599200,18cyclictest0-21swapper/33
35423712192,5sleep03542391-21apt-get0
331656599192,12cyclictest3560013-21taskset3
3316565991916,1cyclictest0-21swapper/33
3316565991915,2cyclictest0-21swapper/33
3316565991912,4cyclictest0-21swapper/33
331656599191,15cyclictest0-21swapper/33
331656599191,14cyclictest0-21swapper/33
331656599191,14cyclictest0-21swapper/33
331656599191,14cyclictest0-21swapper/33
331656599191,14cyclictest0-21swapper/33
331656599191,14cyclictest0-21swapper/33
331656599191,12cyclictest3392392-21chrt3
331656599190,15cyclictest0-21swapper/33
37825312181,8sleep03782545-21sh0
36967332181,3sleep00-21swapper/00
34623462181,5sleep03462435-21munin-run0
331656599181,4cyclictest0-21swapper/33
3316565991814,2cyclictest0-21swapper/33
3316565991814,2cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,14cyclictest0-21swapper/33
331656599181,13cyclictest0-21swapper/33
3316565991810,5cyclictest0-21swapper/33
331656599180,16cyclictest0-21swapper/33
331656599180,15cyclictest0-21swapper/33
38165662171,3sleep00-21swapper/00
35403772171,2sleep10-21swapper/11
331656599178,6cyclictest3413173-21turbostat3
331656599178,6cyclictest3413173-21turbostat3
331656599171,4cyclictest0-21swapper/33
331656599171,4cyclictest0-21swapper/33
3316565991713,2cyclictest0-21swapper/33
331656599171,14cyclictest0-21swapper/33
331656599171,13cyclictest0-21swapper/33
331656599171,13cyclictest0-21swapper/33
331656599171,13cyclictest0-21swapper/33
331656599170,14cyclictest0-21swapper/33
331656599170,14cyclictest0-21swapper/33
37250402160,1sleep10-21swapper/11
36639462161,3sleep10-21swapper/11
35926952161,2sleep20-21swapper/22
34982132161,4sleep03498481-21ssh0
34892922161,2sleep00-21swapper/00
34521112160,2sleep10-21swapper/11
3316565991613,1cyclictest0-21swapper/33
3316565991613,1cyclictest0-21swapper/33
331656599161,13cyclictest0-21swapper/33
331656599161,12cyclictest0-21swapper/33
331656599161,10cyclictest0-21swapper/33
331656599160,13cyclictest0-21swapper/33
331656599160,12cyclictest0-21swapper/33
37914302151,9sleep23444703-21diskmemload2
37752372151,9sleep23776759-21cut2
37630982151,8sleep20-21swapper/22
37443282150,6sleep23744342-21rm2
36923392151,9sleep20-21swapper/22
36253992151,9sleep03625944-21/usr/sbin/munin0
35895102151,8sleep13590501-21memory1
35423272150,1sleep10-21swapper/11
34944042151,8sleep272-21kcompactd02
3316565991513,1cyclictest0-21swapper/33
3316565991513,1cyclictest0-21swapper/33
3316565991511,2cyclictest0-21swapper/33
3316565991511,2cyclictest0-21swapper/33
3316565991511,2cyclictest0-21swapper/33
331656599150,13cyclictest0-21swapper/33
331656599150,12cyclictest0-21swapper/33
331656599150,11cyclictest0-21swapper/33
37796842141,6sleep10-21swapper/11
37531242143,7sleep03745690-40find0
36914292141,2sleep20-21swapper/22
36270662141,9sleep13627081-21ssh1
35687272141,8sleep23568455-21sendmail-msp2
35230852141,8sleep10-21swapper/11
35125202140,2sleep20-21swapper/22
34733502141,9sleep13474967-21kthreadcore1
34402292141,2sleep20-21swapper/22
34236802141,9sleep23423712-21grep2
34236802141,9sleep23423712-21grep2
38001692131,8sleep23800182-21sh2
37089682131,7sleep03444703-21diskmemload0
36633482131,7sleep00-21swapper/00
36042342131,7sleep23603871-21sendmail-msp2
35855312130,8sleep03444703-21diskmemload0
35834342131,7sleep23444703-21diskmemload2
35694122131,7sleep03570062-21grep0
35397362132,7sleep03444703-21diskmemload0
35384292131,7sleep23533146-21sendmail-msp2
35319382131,8sleep13531950-21ssh1
33491912131,8sleep23349332-21switchtime2
331656599131,9cyclictest3402955-21chrt3
331656599130,1cyclictest0-21swapper/33
37829772121,7sleep1483560-21systemd-journal1
37574692121,7sleep03758021-21tr0
37351442121,6sleep13444703-21diskmemload1
37103232121,5sleep13444703-21diskmemload1
36997202121,7sleep13699735-21ssh1
36888602121,7sleep03688875-21ssh0
36805382120,8sleep13680552-21ssh1
36731042121,4sleep10-21swapper/11
36455572120,2sleep20-21swapper/22
36091762124,5sleep1205-21jbd2/sda2-81
36011022121,6sleep13444703-21diskmemload1
35757732121,7sleep13575784-21ssh1
35571162121,2sleep10-21swapper/11
35511372121,7sleep03551150-21ssh0
35037852121,7sleep13503798-21ssh1
34805132120,1sleep10-21swapper/11
34539102122,4sleep23453523-21apt-get2
34391062121,6sleep0483560-21systemd-journal0
33976872121,5sleep23397945-21df_inode2
33759812121,7sleep23371081-21sendmail-msp2
331656599129,1cyclictest0-21swapper/33
38150872111,6sleep13815100-21ssh1
38058572111,2sleep10-21swapper/11
37701122111,3sleep00-21swapper/00
37364852111,3sleep20-21swapper/22
37274112115,2sleep00-21swapper/00
37158282111,4sleep20-21swapper/22
37097782111,4sleep10-21swapper/11
37057322111,6sleep23705890-21/usr/sbin/munin2
36654872111,4sleep23444703-21diskmemload2
36536182111,7sleep13653632-21ssh1
36485072111,5sleep23648532-21apt-get2
36381792113,4sleep23600587-21kworker/u16:0+nfsiod2
36362942111,5sleep03636309-21ssh0
35956572111,6sleep23595696-21fschecks_count2
35595642111,5sleep23559609-21munin-run2
35481652110,2sleep23548180-21ssh2
35246452112,5sleep23524618-21/usr/sbin/munin2
35046422111,3sleep20-21swapper/22
34863722111,3sleep20-21swapper/22
34791252110,6sleep03479136-21ssh0
34534062111,4sleep23444703-21diskmemload2
34134472112,4sleep03413466-21apt-get0
34134472112,4sleep03413466-21apt-get0
34072172110,2sleep10-21swapper/11
34070772111,6sleep03407216-21switchtime0
33966612111,7sleep13392108-21sendmail-msp1
33549652111,6sleep13350066-21sendmail-msp1
33490282111,6sleep03349093-21ntp_offset0
38157942101,4sleep2421rcuc/22
38011052101,3sleep00-21swapper/00
38002122101,6sleep13444703-21diskmemload1
37893452101,4sleep03444703-21diskmemload0
37707502101,2sleep20-21swapper/22
37626022101,4sleep13444703-21diskmemload1
37532612101,4sleep23444703-21diskmemload2
37444582101,4sleep03444703-21diskmemload0
37335442100,1sleep00-21swapper/00
37247372101,6sleep20-21swapper/22
36868542101,4sleep13687857-21memory1
36805532101,6sleep23680564-21ssh2
36777242101,5sleep03674636-21sendmail-msp0
36671622101,5sleep23668704-21cut2
36486112101,4sleep03648817-21diskstats0
36452152100,1sleep00-21swapper/00
36396222100,4sleep13639650-21ssh1
36376802101,4sleep13444703-21diskmemload1
36285132100,1sleep20-21swapper/22
36201802101,4sleep13444703-21diskmemload1
36130652100,6sleep03613077-21ssh0
36120212101,4sleep03444703-21diskmemload0
35944092101,4sleep03444703-21diskmemload0
35683772101,4sleep11-21systemd1
35300192101,2sleep00-21swapper/00
35222022101,2sleep20-21swapper/22
35208012101,4sleep03444703-21diskmemload0
34792082100,5sleep23444703-21diskmemload2
34691892101,2sleep10-21swapper/11
34641312101,5sleep23465548-21tr2
34539492101,4sleep13453962-21apt-get1
34523712101,4sleep03444703-21diskmemload0
34341342101,4sleep03434200-21sendmail-msp0
34136182101,5sleep23413220-21sendmail-msp2
34136182101,5sleep23413220-21sendmail-msp2
33561582101,6sleep03357491-21cut0
33558752100,6sleep23356084-21hddtemp_smartct2
3805918290,1sleep20-21swapper/22
3798636290,1sleep00-21swapper/00
3765717291,4sleep13765742-21apt-get1
3715855291,3sleep00-21swapper/00
3672624290,1sleep00-21swapper/00
3613427291,4sleep23613565-21perl2
3582055290,2sleep10-21swapper/11
3564783291,2sleep20-21swapper/22
3560281291,3sleep03444703-21diskmemload0
3512464291,4sleep13444703-21diskmemload1
3511914291,4sleep03511925-21ssh0
3494859291,4sleep13494873-21ssh1
3485656290,3sleep03444703-21diskmemload0
3444054291,4sleep13444298-21users1
3434430294,2sleep23316560-21cyclictest2
3434429291,4sleep13434200-21sendmail-msp1
3428912291,4sleep13428935-21munin-run1
3413469291,4sleep13413616-21cstates1
3413469291,4sleep13413616-21cstates1
3387089291,3sleep13387093-21apt-get1
3387072290,1sleep00-21swapper/00
3357493291,4sleep13359243-21cut1
3335117291,4sleep13335531-21kthreadcore1
3334294291,4sleep13334490-21date1
3600292281,2sleep03444703-21diskmemload0
3429184280,2sleep10-21swapper/11
3428852280,1sleep20-21swapper/22
3423678280,3sleep00-21swapper/00
3423678280,3sleep00-21swapper/00
3412646280,1sleep00-21swapper/00
3412646280,1sleep00-21swapper/00
3408723281,3sleep13409412-21kthreadcore1
3408723281,3sleep13409412-21kthreadcore1
3394132281,3sleep00-21swapper/00
3392370281,1sleep20-21swapper/22
3386608280,1sleep00-21swapper/00
3371309281,2sleep10-21swapper/11
3360842280,1sleep00-21swapper/00
3350866281,3sleep23351768-21cut2
3349831280,2sleep10-21swapper/11
3344489280,1sleep20-21swapper/22
3342044281,3sleep13343671-21cat1
3335533281,3sleep23337153-21kthreadcore2
3333943281,4sleep20-21swapper/22
3324589281,3sleep03325843-21kthreadcore0
3324306281,3sleep23324515-21hddtemp_smartct2
3318294281,3sleep13319995-21tr1
3317308281,3sleep03318291-21kthreadcore0
3317025281,4sleep23317182-21gltestperf2
3429787270,3sleep23431282-21ps2
3428702270,1sleep00-21swapper/00
3419705270,3sleep13421340-21cut1
3419705270,3sleep13421340-21cut1
3409415271,3sleep20-21swapper/22
3409415271,3sleep20-21swapper/22
3402933270,2sleep20-21swapper/22
3402391270,1sleep10-21swapper/11
3388015271,3sleep23389628-21kthreadcore2
3381339270,1sleep10-21swapper/11
3378603271,3sleep20-21swapper/22
3376602271,2sleep00-21swapper/00
3376270270,1sleep00-21swapper/00
3370654270,5sleep20-21swapper/22
3362880271,2sleep10-21swapper/11
3353289271,2sleep00-21swapper/00
3344611270,4sleep00-21swapper/00
3339526271,3sleep00-21swapper/00
3329269271,2sleep00-21swapper/00
3439966261,2sleep00-21swapper/00
3397663260,1sleep00-21swapper/00
3386459260,1sleep20-21swapper/22
3381867260,1sleep10-21swapper/11
3367029261,2sleep00-21swapper/00
3364626260,2sleep23364808-21strings2
3322941261,2sleep10-21swapper/11
3366331240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional