You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 23:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Mon May 25, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3283463212164,53sleep30-21swapper/33
3283463212164,53sleep30-21swapper/33
328358828460,7sleep00-21swapper/00
328358828460,7sleep00-21swapper/00
328348628454,11sleep10-21swapper/11
328348628454,11sleep10-21swapper/11
328368828155,10sleep20-21swapper/22
328368828155,10sleep20-21swapper/22
33239962470,3sleep03324002-21gltestperf0
328382299242,8cyclictest3590504-21taskset3
328382299220,13cyclictest0-21swapper/33
34827622210,4sleep03414549-21diskmemload0
328382299211,16cyclictest3446618-21taskset3
328382299211,16cyclictest0-21swapper/33
328382299207,11cyclictest0-21swapper/33
3283822992018,1cyclictest0-21swapper/33
3283822992012,5cyclictest3296066-21taskset3
328382299200,18cyclictest0-21swapper/33
37547722191,2sleep30-21swapper/33
35807432190,2sleep244-21ksoftirqd/22
34028852191,6sleep03402937-21ntpq0
328382299193,13cyclictest66950irq/132-enp1s0-TxRx-33
3283822991914,2cyclictest0-21swapper/33
328382299191,2cyclictest0-21swapper/33
3283822991912,5cyclictest0-21swapper/33
328382299191,15cyclictest0-21swapper/33
328382299191,14cyclictest66950irq/132-enp1s0-TxRx-33
328382299191,14cyclictest0-21swapper/33
328382299191,14cyclictest0-21swapper/33
328382299191,14cyclictest0-21swapper/33
328382299191,14cyclictest0-21swapper/33
328382299191,14cyclictest0-21swapper/33
328382299191,14cyclictest0-21swapper/33
328382299191,13cyclictest0-21swapper/33
328382299190,17cyclictest0-21swapper/33
328382299190,15cyclictest0-21swapper/33
37196222181,3sleep10-21swapper/11
36656172181,9sleep23665639-21sensors2
34821732181,3sleep20-21swapper/22
34318332181,8sleep23431847-21ssh2
3283822991814,3cyclictest66950irq/132-enp1s0-TxRx-33
3283822991814,3cyclictest66950irq/132-enp1s0-TxRx-33
3283822991814,2cyclictest0-21swapper/33
3283822991814,2cyclictest0-21swapper/33
3283822991812,4cyclictest0-21swapper/33
328382299181,14cyclictest66950irq/132-enp1s0-TxRx-33
3283822991811,4cyclictest0-21swapper/33
328382299181,14cyclictest0-21swapper/33
328382299181,14cyclictest0-21swapper/33
328382299181,14cyclictest0-21swapper/33
328382299181,14cyclictest0-21swapper/33
328382299181,14cyclictest0-21swapper/33
328382299181,13cyclictest0-21swapper/33
328382299181,13cyclictest0-21swapper/33
328382299181,13cyclictest0-21swapper/33
328382299180,15cyclictest0-21swapper/33
37401632171,2sleep00-21swapper/00
35703702171,3sleep10-21swapper/11
35609282171,3sleep20-21swapper/22
34409102170,2sleep20-21swapper/22
3283822991713,2cyclictest0-21swapper/33
3283822991712,2cyclictest0-21swapper/33
328382299171,14cyclictest0-21swapper/33
328382299171,13cyclictest0-21swapper/33
328382299171,13cyclictest0-21swapper/33
328382299171,13cyclictest0-21swapper/33
328382299170,14cyclictest0-21swapper/33
328382299170,13cyclictest0-21swapper/33
328382299170,13cyclictest0-21swapper/33
328382299170,11cyclictest0-21swapper/33
36513352161,3sleep00-21swapper/00
35435682161,2sleep20-21swapper/22
35349652161,4sleep23534979-21ssh2
35193722161,3sleep20-21swapper/22
35178902160,3sleep00-21swapper/00
34995182161,5sleep03414549-21diskmemload0
34752842161,10sleep23414549-21diskmemload2
33176352160,11sleep00-21swapper/00
328382299161,13cyclictest0-21swapper/33
328382299161,13cyclictest0-21swapper/33
328382299161,12cyclictest0-21swapper/33
328382299161,11cyclictest0-21swapper/33
3283822991610,4cyclictest0-21swapper/33
328382299160,14cyclictest0-21swapper/33
36914272151,8sleep03691519-21ntpq0
36049402151,2sleep10-21swapper/11
34486722151,9sleep13414549-21diskmemload1
33383292151,9sleep23338386-21ntp_states2
328382299151,11cyclictest33068862sleep33
328382299150,13cyclictest0-21swapper/33
328382299150,13cyclictest0-21swapper/33
328382299150,12cyclictest0-21swapper/33
328382299150,12cyclictest0-21swapper/33
328382299150,12cyclictest0-21swapper/33
36651532141,7sleep03665254-21ntpq0
36332782141,2sleep10-21swapper/11
36103942141,9sleep23611981-21wc2
36050822141,3sleep03414549-21diskmemload0
35876412141,7sleep20-21swapper/22
35641762141,10sleep03564186-21ssh0
35291132141,2sleep00-21swapper/00
34457202141,9sleep23445784-21ntpq2
328382299148,3cyclictest33659222sleep33
3283822991412,1cyclictest0-21swapper/33
328382299140,12cyclictest0-21swapper/33
328382299140,12cyclictest0-21swapper/33
328382299140,11cyclictest0-21swapper/33
36757402131,5sleep00-21swapper/00
36606732130,3sleep13414549-21diskmemload1
36588972131,8sleep03658911-21ssh0
36327612131,3sleep03632775-21ssh0
36068692131,9sleep23606884-21ssh2
35803222131,3sleep03580325-21ssh0
33922082131,8sleep23392254-21ntpq2
37834122121,5sleep20-21swapper/22
37394732121,5sleep03739500-21/usr/sbin/munin0
37291892121,8sleep03729203-21ssh0
37194882121,5sleep20-21swapper/22
35534112121,7sleep23553414-21ssh2
35030702121,4sleep13503102-21ssh1
34574132121,6sleep13414549-21diskmemload1
34369652122,5sleep13437021-21ntpq1
34199422121,6sleep00-21swapper/00
33815462121,6sleep13381595-21ntpq1
33294522121,7sleep23330399-21cut2
33187382121,8sleep20-21swapper/22
37636582111,3sleep20-21swapper/22
37617822111,5sleep13761844-21ntpq1
37542402111,7sleep13754251-21sh1
37426972111,6sleep13744135-21ssh1
37360332111,6sleep13736045-21ssh1
37265302111,6sleep23726583-21ntpq2
37002702111,4sleep10-21swapper/11
37002702111,4sleep10-21swapper/11
36966532111,2sleep00-21swapper/00
36966532111,2sleep00-21swapper/00
36670922112,4sleep13414549-21diskmemload1
36581592111,4sleep20-21swapper/22
36487562111,4sleep13414549-21diskmemload1
36400102111,3sleep10-21swapper/11
36341762110,7sleep00-21swapper/00
36237112111,4sleep20-21swapper/22
36121422111,5sleep03612204-21ntpq0
35981912110,1sleep00-21swapper/00
35737022112,5sleep13575274-21tr1
35615272110,1sleep10-21swapper/11
35451642111,5sleep03414549-21diskmemload0
35341942111,3sleep10-21swapper/11
35118352111,7sleep13511941-21tr1
35102852111,5sleep23414549-21diskmemload2
35096422110,7sleep03414549-21diskmemload0
35024462111,3sleep10-21swapper/11
35010922111,6sleep23501105-21sh2
34905432112,6sleep23490550-21sh2
34852862111,4sleep03485316-21apt-get0
34848012111,4sleep13414549-21diskmemload1
34659462111,4sleep20-21swapper/22
34655042111,7sleep03465516-21rm0
34501672110,7sleep03450178-21ssh0
34396682111,7sleep03439679-21sh0
34313572111,3sleep00-21swapper/00
34236952113,4sleep13423898-21cat1
34149412112,4sleep13414955-21apt-get1
33934552112,5sleep13393474-21apt-get1
33166372110,2sleep20-21swapper/22
33114862111,5sleep23311539-21ntp_states2
33114382111,5sleep13311484-21ntpq1
37821172101,4sleep03414549-21diskmemload0
37815232101,3sleep10-21swapper/11
37746672101,2sleep20-21swapper/22
37736412100,5sleep13414549-21diskmemload1
37705842101,5sleep03770645-21ntpq0
37562802101,4sleep23414549-21diskmemload2
37562012101,4sleep03414549-21diskmemload0
37367532101,2sleep20-21swapper/22
37281342100,1sleep10-21swapper/11
37126602101,3sleep10-21swapper/11
37052882101,4sleep23705412-21irqstats2
37048842101,4sleep03414549-21diskmemload0
37021232101,3sleep20-21swapper/22
37021232101,3sleep20-21swapper/22
36933332101,4sleep23414549-21diskmemload2
36842702101,3sleep10-21swapper/11
36407322101,2sleep20-21swapper/22
36326922101,2sleep20-21swapper/22
36169062101,3sleep10-21swapper/11
36139972101,3sleep10-21swapper/11
35946472101,4sleep23594702-21ntpq2
35867162101,5sleep03586727-21ssh0
35693922101,5sleep23569403-21ssh2
35557672101,5sleep03555849-21/usr/sbin/munin0
35431512100,2sleep10-21swapper/11
34909832101,2sleep13490996-21diskmemload1
34656142101,5sleep13465629-21ssh1
34501942101,4sleep23450219-21apt-get2
34481072101,3sleep00-21swapper/00
34207222101,3sleep20-21swapper/22
34086412101,4sleep13408831-21users1
34041342101,4sleep20-21swapper/22
33504782101,4sleep03350497-21apt-get0
33251192101,5sleep23326877-21kthreadcore2
33184602101,5sleep03318567-21sort0
33073552101,3sleep03307374-21apt-get0
32953252101,4sleep23295414-21ntpq2
3763438291,3sleep00-21swapper/00
3740010291,2sleep20-21swapper/22
3717809291,4sleep03717875-21ntpq0
3694800291,2sleep10-21swapper/11
3682849291,3sleep03682900-21ntpq0
3675314290,1sleep20-21swapper/22
3669717291,2sleep10-21swapper/11
3651045291,3sleep23414549-21diskmemload2
3620942291,4sleep03414549-21diskmemload0
3598004291,3sleep13414549-21diskmemload1
3582024291,4sleep13582225-21head1
3554548291,4sleep13554558-21ssh1
3552982291,4sleep03552993-21ssh0
3527617291,2sleep10-21swapper/11
3525580291,2sleep20-21swapper/22
3525553291,4sleep03525567-21ssh0
3475419291,4sleep13475433-21ssh1
3474605291,2sleep00-21swapper/00
3392973290,1sleep10-21swapper/11
3383402291,4sleep23384956-21tr2
3360197290,6sleep23360268-21find2
3359844291,4sleep03359892-21ntpq0
3345420291,4sleep13345898-21cut1
3343598290,1sleep20-21swapper/22
3305937291,4sleep13306077-21/usr/sbin/munin1
3300732291,4sleep23300780-21ntpq2
3678568281,2sleep23414549-21diskmemload2
3386844281,3sleep13386901-21ntpq1
3377450281,2sleep00-21swapper/00
3376176281,3sleep03376222-21ntpq0
3366757280,2sleep00-21swapper/00
3349287281,4sleep03344872-21/usr/sbin/munin0
3342458281,3sleep03343457-21memory0
3338503280,1sleep00-21swapper/00
3317506281,3sleep11-21systemd1
3288103281,4sleep03288148-21ld0
3414504270,2sleep10-21swapper/11
3410031271,2sleep20-21swapper/22
3402720270,3sleep20-21swapper/22
3394078270,3sleep23395744-21tr2
3382164270,1sleep20-21swapper/22
3376961270,1sleep20-21swapper/22
3372194271,2sleep10-21swapper/11
3370953271,3sleep10-21swapper/11
3366767270,1sleep20-21swapper/22
3355483270,1sleep20-21swapper/22
3345900271,2sleep20-21swapper/22
3344449270,1sleep10-21swapper/11
3334195270,4sleep10-21swapper/11
3323567271,3sleep1321rcuc/11
3302037270,2sleep20-21swapper/22
3288426271,3sleep23288653-21unixbench_multi2
3408511261,2sleep00-21swapper/00
3393178260,1sleep00-21swapper/00
3383092261,2sleep03383306-21smartctl0
3366068260,1sleep20-21swapper/22
3361171260,1sleep00-21swapper/00
3356475261,2sleep10-21swapper/11
3351452261,2sleep10-21swapper/11
3333661260,4sleep00-21swapper/00
3306804260,1sleep00-21swapper/00
3300553260,2sleep13300726-21strings1
3296126260,1sleep00-21swapper/00
3289161261,2sleep10-21swapper/11
3285549261,2sleep10-21swapper/11
3413610250,1sleep00-21swapper/00
3402062250,1sleep10-21swapper/11
3398240250,1sleep00-21swapper/00
3365266250,1sleep10-21swapper/11
3333454250,1sleep10-21swapper/11
3301690250,3sleep00-21swapper/00
3318176240,1sleep10-21swapper/11
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional