You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 11:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Sat May 16, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1194922530,2sleep10-21swapper/11
1194922530,2sleep10-21swapper/11
415013821360,2sleep0151ktimers/00
3762175212857,66sleep30-21swapper/33
376224528853,10sleep20-21swapper/22
376238728060,12sleep10-21swapper/11
376218227352,15sleep00-21swapper/00
376263399231,19cyclictest0-21swapper/33
40712942221,10sleep13893055-21diskmemload1
376263399211,6cyclictest4002164-21taskset3
3762633992116,3cyclictest0-21swapper/33
376263399211,16cyclictest66950irq/132-enp1s0-TxRx-33
376263399211,16cyclictest3960358-21taskset3
376263399211,16cyclictest0-21swapper/33
376263399202,15cyclictest66950irq/132-enp1s0-TxRx-33
376263399202,14cyclictest33563-21turbostat3
3762633992017,2cyclictest0-21swapper/33
40047732197,8sleep134-21ksoftirqd/11
3762633991916,1cyclictest0-21swapper/33
3762633991914,3cyclictest0-21swapper/33
376263399191,15cyclictest66950irq/132-enp1s0-TxRx-33
376263399191,14cyclictest66950irq/132-enp1s0-TxRx-33
376263399191,14cyclictest3780636-21chrt3
376263399191,14cyclictest0-21swapper/33
376263399191,14cyclictest0-21swapper/33
376263399191,14cyclictest0-21swapper/33
376263399191,14cyclictest0-21swapper/33
376263399191,14cyclictest0-21swapper/33
376263399191,14cyclictest0-21swapper/33
376263399190,15cyclictest4192437-21taskset3
376263399181,14cyclictest0-21swapper/33
376263399181,14cyclictest0-21swapper/33
376263399181,14cyclictest0-21swapper/33
376263399181,14cyclictest0-21swapper/33
376263399181,14cyclictest0-21swapper/33
376263399181,14cyclictest0-21swapper/33
376263399181,13cyclictest0-21swapper/33
376263399180,16cyclictest0-21swapper/33
376263399180,16cyclictest0-21swapper/33
376263399180,15cyclictest0-21swapper/33
40996542172,9sleep04099677-21apt-get0
40440432171,10sleep14044104-21ntpq1
39815992171,3sleep00-21swapper/00
39332192171,2sleep20-21swapper/22
376263399178,6cyclictest3807833-21turbostat3
376263399178,5cyclictest3861070-21turbostat3
376263399171,14cyclictest0-21swapper/33
376263399171,13cyclictest0-21swapper/33
376263399171,13cyclictest0-21swapper/33
376263399171,13cyclictest0-21swapper/33
376263399171,13cyclictest0-21swapper/33
376263399171,12cyclictest0-21swapper/33
376263399170,14cyclictest0-21swapper/33
376263399170,14cyclictest0-21swapper/33
376263399170,13cyclictest0-21swapper/33
376263399170,13cyclictest0-21swapper/33
41556132161,2sleep00-21swapper/00
40816212161,2sleep20-21swapper/22
40366482161,3sleep00-21swapper/00
39749852161,10sleep13975050-21ntpq1
39663422161,5sleep13966442-21ntpq1
39170142161,7sleep03917024-21ssh0
376263399161,3cyclictest0-21swapper/33
376263399161,3cyclictest0-21swapper/33
3762633991613,1cyclictest0-21swapper/33
3762633991613,1cyclictest0-21swapper/33
3762633991613,1cyclictest0-21swapper/33
3762633991612,2cyclictest0-21swapper/33
3762633991611,3cyclictest0-21swapper/33
376263399161,12cyclictest0-21swapper/33
376263399161,12cyclictest0-21swapper/33
376263399160,14cyclictest0-21swapper/33
376263399160,13cyclictest0-21swapper/33
376263399160,13cyclictest0-21swapper/33
376263399160,13cyclictest0-21swapper/33
376263399160,12cyclictest0-21swapper/33
376263399160,12cyclictest0-21swapper/33
306742160,4sleep20-21swapper/22
41917462151,2sleep10-21swapper/11
40992852151,10sleep14099326-21awk1
40878062151,9sleep03893055-21diskmemload0
40195922151,3sleep10-21swapper/11
39934462151,11sleep03893055-21diskmemload0
39256452151,2sleep00-21swapper/00
37910072151,8sleep272-21kcompactd02
376263399155,6cyclictest38658422sleep33
3762633991512,2cyclictest0-21swapper/33
3762633991512,2cyclictest0-21swapper/33
3762633991512,2cyclictest0-21swapper/33
376263399150,12cyclictest0-21swapper/33
41215682141,3sleep14121574-21ssh1
40559212141,9sleep03893055-21diskmemload0
40353512141,7sleep14035450-21ntpq1
40133802141,9sleep04013415-21munin-run0
39960812141,1sleep20-21swapper/22
39702652141,2sleep20-21swapper/22
39274982141,4sleep13893055-21diskmemload1
376263399141,1cyclictest0-21swapper/33
3762633991411,2cyclictest0-21swapper/33
376263399140,2cyclictest0-21swapper/33
376263399140,12cyclictest0-21swapper/33
376263399140,12cyclictest0-21swapper/33
376263399140,11cyclictest0-21swapper/33
345132141,8sleep135060-21cut1
170242141,9sleep217056-21ssh2
170242141,9sleep217056-21ssh2
41759402132,4sleep0895-21cron0
41399932130,3sleep1321rcuc/11
41172131,6sleep14151-21ntpq1
41123962131,8sleep04112458-21ntpq0
41070552131,8sleep14107066-21ssh1
40398352131,8sleep04039866-21apt-get0
40111842130,2sleep20-21swapper/22
39846382131,7sleep23893055-21diskmemload2
39526262131,4sleep13893055-21diskmemload1
39170772130,8sleep10-21swapper/11
39162552131,2sleep20-21swapper/22
38979992131,7sleep23893055-21diskmemload2
38183492131,4sleep20-21swapper/22
329152131,8sleep132926-21ssh1
71412121,7sleep27148-21ssh2
589212121,6sleep258953-21munin-run2
41745662121,7sleep14174576-21ssh1
41738112121,3sleep20-21swapper/22
41414162120,1sleep20-21swapper/22
40954472121,4sleep23893055-21diskmemload2
40886892121,6sleep13893055-21diskmemload1
40722082121,8sleep00-21swapper/00
40640202121,6sleep03893055-21diskmemload0
40269092121,6sleep04026968-21ntpq0
40217802121,3sleep24021791-21ssh2
39598952121,7sleep23959905-21ssh2
39501752121,4sleep20-21swapper/22
39423052121,7sleep23942316-21ssh2
39075242121,6sleep23893055-21diskmemload2
38687822121,3sleep03870530-21sed0
493602111,6sleep20-21swapper/22
41813762111,7sleep04181389-21sh0
41660052111,5sleep03893055-21diskmemload0
41546732111,4sleep24154733-21ntpq2
41414812111,6sleep04141493-21ssh0
41296792111,7sleep14129905-21grep1
41220122111,5sleep20-21swapper/22
41208262111,5sleep04120885-21ntpq0
40917702111,5sleep00-21swapper/00
40832932111,4sleep24083420-21irqstats2
40742652111,6sleep04074389-21tr0
40722712111,3sleep20-21swapper/22
40399442111,5sleep24040157-21diskstats2
40372982110,1sleep20-21swapper/22
40286462111,5sleep13893055-21diskmemload1
40007382111,5sleep24000795-21ntpq2
39850202111,5sleep10-21swapper/11
39764502111,3sleep20-21swapper/22
39693052110,2sleep03969316-21ssh0
39599842111,3sleep10-21swapper/11
39504782111,6sleep03950488-21ssh0
39308102110,5sleep03931530-21/usr/sbin/munin0
38988062111,6sleep13898816-21ssh1
38865262111,7sleep03882653-21/usr/sbin/munin0
38820392111,3sleep272-21kcompactd02
38722832111,7sleep23872424-21expr2
38653612110,2sleep00-21swapper/00
38508642111,5sleep13850975-21diskstats1
38508642111,5sleep13850975-21diskstats1
38240752111,5sleep13824333-21df_inode1
37962522111,6sleep23796335-21ps2
37758062112,4sleep13775825-21apt-get1
37740832111,5sleep13774224-21ntpq1
66042101,4sleep03893055-21diskmemload0
561672101,5sleep156177-21ssh1
508622101,4sleep03893055-21diskmemload0
489592101,4sleep03893055-21diskmemload0
464552101,4sleep146557-21ntpq1
41930122101,5sleep04193023-21ssh0
41905612101,4sleep23893055-21diskmemload2
418652101,4sleep23893055-21diskmemload2
41826692101,3sleep14182678-21pool-udisksd1
41823052101,3sleep20-21swapper/22
41593562101,4sleep24159561-21diskstats2
41471442101,3sleep10-21swapper/11
41461062101,4sleep24146168-21ntpq2
41329342101,3sleep00-21swapper/00
41068342101,3sleep23893055-21diskmemload2
40810372101,4sleep13893055-21diskmemload1
40643712101,3sleep10-21swapper/11
40635722101,4sleep23893055-21diskmemload2
40543122101,4sleep23893055-21diskmemload2
40101322100,1sleep10-21swapper/11
39965082100,6sleep03893055-21diskmemload0
39757882101,4sleep03893055-21diskmemload0
39535192101,4sleep03953733-21diskstats0
39422292101,3sleep00-21swapper/00
39239932101,2sleep20-21swapper/22
38991212100,1sleep00-21swapper/00
389422101,4sleep03893055-21diskmemload0
38813192100,5sleep03881367-21ntpq0
38512682101,5sleep03852771-21kthreadcore0
38512682101,5sleep03852771-21kthreadcore0
38440462101,4sleep03844094-21ntpq0
38346842101,3sleep23834703-21apt-get2
38293802101,4sleep23829398-21apt-get2
38237932101,4sleep13823841-21munin-run1
38161282101,4sleep03817281-21memory0
37799152101,5sleep23779968-21collect22
37690102101,4sleep03770009-21ntpq0
37672982101,5sleep23767515-21users2
37669682101,4sleep13766998-21ntp_states1
307942100,1sleep00-21swapper/00
222282101,4sleep03893055-21diskmemload0
222282101,4sleep03893055-21diskmemload0
173502101,4sleep117569-21hddtemp_smartct1
173502101,4sleep117569-21hddtemp_smartct1
8432291,2sleep20-21swapper/22
8432291,2sleep20-21swapper/22
4164386290,2sleep10-21swapper/11
4155574291,3sleep13893055-21diskmemload1
4125685291,4sleep24125992-21cat2
4108070291,3sleep20-21swapper/22
4054911291,3sleep13893055-21diskmemload1
4027409291,4sleep24027589-21users2
4014025291,3sleep00-21swapper/00
3993706290,1sleep10-21swapper/11
3924074291,4sleep13924086-21ssh1
3908927291,4sleep13908937-21ssh1
3906995291,2sleep00-21swapper/00
3887690291,4sleep13887720-21perf1
3882674291,4sleep23882900-21cstates2
3876835290,2sleep10-21swapper/11
3817282291,4sleep13817422-21ntp_192.168.1141
3803044291,4sleep23803253-21/usr/sbin/munin2
3802776291,4sleep03802850-21tr0
3801874290,4sleep23802118-21users2
3790860291,4sleep03790917-21ntpq0
3785175291,4sleep03785221-21ntpq0
15350290,1sleep00-21swapper/00
15350290,1sleep00-21swapper/00
4108431281,2sleep10-21swapper/11
3942292281,3sleep13942304-21ssh1
3870692281,3sleep23870743-21ntpq2
3865714281,3sleep23865841-21sed2
3856012281,3sleep13856033-21http1
3849521280,1sleep20-21swapper/22
3845361282,3sleep03845377-21cpu0
3840109280,3sleep23840325-21diskstats2
3833766281,4sleep03834024-21grep0
3824053281,2sleep00-21swapper/00
3786700280,4sleep10-21swapper/11
3776107280,1sleep00-21swapper/00
3892698271,2sleep13892701-21modprobe1
3877893271,3sleep13879095-21kthreadcore1
3857190270,3sleep2421rcuc/22
3850375270,1sleep10-21swapper/11
3844982270,1sleep10-21swapper/11
3828974270,1sleep20-21swapper/22
3820577271,2sleep20-21swapper/22
3819225271,2sleep00-21swapper/00
3802496270,4sleep10-21swapper/11
3799378271,3sleep10-21swapper/11
3785497271,3sleep13781147-21/usr/sbin/munin1
3770152270,2sleep20-21swapper/22
3764444270,3sleep03766243-21kthreadcore0
3892910260,1sleep20-21swapper/22
3888977260,2sleep03890699-21grep0
3876063260,2sleep00-21swapper/00
3866274260,1sleep10-21swapper/11
3859896261,1sleep00-21swapper/00
3854526260,2sleep23854699-21strings2
3854526260,2sleep23854699-21strings2
3839739260,1sleep00-21swapper/00
3839521260,4sleep10-21swapper/11
3834284260,4sleep10-21swapper/11
3812825260,1sleep00-21swapper/00
3812801260,4sleep10-21swapper/11
3812617260,2sleep20-21swapper/22
3797999261,2sleep00-21swapper/00
3797044260,4sleep10-21swapper/11
3796850260,1sleep00-21swapper/00
3871143250,1sleep10-21swapper/11
3786093250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional