You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 22:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Thu Apr 09, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3257342213765,68sleep30-21swapper/33
325743528555,11sleep20-21swapper/22
325727028464,14sleep00-21swapper/00
325754928265,12sleep10-21swapper/11
325767699222,15cyclictest36839682chrt3
325767699222,14cyclictest3424007-21chrt3
3257676992220,1cyclictest0-21swapper/33
3257676992212,7cyclictest3615089-21taskset3
3257676992118,2cyclictest0-21swapper/33
325767699210,18cyclictest0-21swapper/33
35205722207,8sleep13520704-21ssh1
34317632201,7sleep13388289-21diskmemload1
325767699201,17cyclictest66950irq/132-enp1s0-TxRx-33
325767699200,17cyclictest0-21swapper/33
325767699200,16cyclictest3377585-21taskset3
325767699199,3cyclictest0-21swapper/33
325767699191,7cyclictest3527610-21taskset3
325767699191,15cyclictest0-21swapper/33
325767699191,15cyclictest0-21swapper/33
325767699191,15cyclictest0-21swapper/33
325767699191,15cyclictest0-21swapper/33
325767699191,14cyclictest0-21swapper/33
325767699191,14cyclictest0-21swapper/33
325767699191,14cyclictest0-21swapper/33
325767699191,14cyclictest0-21swapper/33
325767699191,13cyclictest3388314-21sleep3
325767699191,13cyclictest0-21swapper/33
325767699190,6cyclictest3270906-21taskset3
37477612181,2sleep20-21swapper/22
35507502181,5sleep03550851-21ntpq0
325767699188,7cyclictest3447894-21taskset3
325767699182,11cyclictest3529464-21taskset3
3257676991815,2cyclictest0-21swapper/33
3257676991815,1cyclictest0-21swapper/33
3257676991815,1cyclictest0-21swapper/33
3257676991814,2cyclictest0-21swapper/33
325767699181,15cyclictest0-21swapper/33
325767699181,14cyclictest0-21swapper/33
325767699181,14cyclictest0-21swapper/33
325767699181,14cyclictest0-21swapper/33
325767699181,14cyclictest0-21swapper/33
325767699181,14cyclictest0-21swapper/33
325767699181,14cyclictest0-21swapper/33
325767699181,13cyclictest0-21swapper/33
325767699181,13cyclictest0-21swapper/33
325767699180,15cyclictest0-21swapper/33
37290152171,3sleep20-21swapper/22
36238042171,3sleep00-21swapper/00
325767699175,10cyclictest3475651-21chrt3
3257676991713,2cyclictest66950irq/132-enp1s0-TxRx-33
3257676991712,3cyclictest0-21swapper/33
325767699171,14cyclictest0-21swapper/33
325767699171,13cyclictest0-21swapper/33
325767699171,13cyclictest0-21swapper/33
325767699171,13cyclictest0-21swapper/33
325767699171,13cyclictest0-21swapper/33
325767699171,12cyclictest0-21swapper/33
325767699170,14cyclictest0-21swapper/33
325767699170,13cyclictest0-21swapper/33
37099932161,3sleep00-21swapper/00
37035662161,2sleep20-21swapper/22
37001852161,8sleep13700245-21ntpq1
36506242161,3sleep20-21swapper/22
36398262161,4sleep13388289-21diskmemload1
361366821611,2sleep23553353-21kworker/2:1+events_freezable2
35866382161,10sleep03586835-21users0
35382332161,4sleep03538445-21hddtemp_smartct0
35010252161,3sleep20-21swapper/22
34846492161,3sleep0171rcu_preempt0
325767699161,13cyclictest0-21swapper/33
325767699160,3cyclictest0-21swapper/33
325767699160,13cyclictest0-21swapper/33
325767699160,13cyclictest0-21swapper/33
37316222151,9sleep13731844-21hddtemp_smartct1
36842542151,2sleep20-21swapper/22
36765402151,4sleep23388289-21diskmemload2
36674882151,10sleep03667499-21ssh0
36326312150,1sleep00-21swapper/00
35969262150,2sleep10-21swapper/11
35291932152,7sleep23529463-21df_inode2
35262342150,3sleep20-21swapper/22
34933682151,8sleep00-21swapper/00
34489462151,2sleep20-21swapper/22
33731082151,2sleep00-21swapper/00
33080572150,3sleep10-21swapper/11
3257676991513,1cyclictest0-21swapper/33
3257676991510,3cyclictest0-21swapper/33
325767699150,12cyclictest0-21swapper/33
325767699150,12cyclictest0-21swapper/33
325767699150,12cyclictest0-21swapper/33
325767699150,12cyclictest0-21swapper/33
325767699150,11cyclictest0-21swapper/33
37488302141,7sleep03749094-21df_inode0
36913512141,6sleep13691407-21ntpq1
36770352141,9sleep13388289-21diskmemload1
36690182141,3sleep13388289-21diskmemload1
35535302140,1sleep20-21swapper/22
34990672140,2sleep10-21swapper/11
34761342141,9sleep13476147-21sh1
34381352141,9sleep23438149-21ssh2
34229332140,2sleep10-21swapper/11
34227942141,2sleep20-21swapper/22
34043952141,3sleep13388289-21diskmemload1
34043952141,3sleep13388289-21diskmemload1
33899462141,9sleep10-21swapper/11
33672072141,3sleep03367226-21apt-get0
325767699148,3cyclictest0-21swapper/33
3257676991411,2cyclictest0-21swapper/33
325767699141,10cyclictest0-21swapper/33
325767699140,13cyclictest0-21swapper/33
325767699140,12cyclictest0-21swapper/33
325767699140,11cyclictest0-21swapper/33
37533472131,7sleep13753499-21wc1
36685792135,3sleep23388289-21diskmemload2
36137872131,8sleep03613801-21ssh0
35808012131,2sleep00-21swapper/00
35719652131,3sleep13571976-21ssh1
35681012131,8sleep03568265-21cut0
35420152131,7sleep13542077-21ntpq1
35203402131,3sleep03520352-21ssh0
34120852131,3sleep13388289-21diskmemload1
33871822131,6sleep13387271-21ntpq1
3257676991311,1cyclictest0-21swapper/33
37467972121,1sleep10-21swapper/11
37405462121,7sleep03740651-21/usr/sbin/munin0
37281322121,7sleep03728143-21ssh0
37192202121,4sleep20-21swapper/22
37124872121,7sleep13712501-21ssh1
36592862120,9sleep03659298-21sh0
36485862120,3sleep03648597-21ssh0
35956012121,6sleep20-21swapper/22
35871652120,8sleep23388289-21diskmemload2
35791132121,6sleep20-21swapper/22
35633142121,7sleep13388289-21diskmemload1
35360732121,3sleep10-21swapper/11
34843602121,5sleep13388289-21diskmemload1
34315462121,7sleep03431557-21ssh0
34107962121,6sleep23411040-21unixbench_multi2
33659682121,5sleep13366019-21ntpq1
32917742120,8sleep13291710-31find1
32799032121,5sleep23280024-21ntpq2
32746702121,5sleep03274711-21ntpq0
32581482121,3sleep23258237-21fschecks_time2
37355522111,5sleep03735619-21ntpq0
37353922111,5sleep23735488-21ntpq2
37303782111,2sleep13730389-21ssh1
37210312111,6sleep03721044-21ssh0
36802432111,6sleep13681939-21kthreadcore1
36522012111,6sleep13388289-21diskmemload1
36080362110,1sleep10-21swapper/11
35878072111,4sleep13388289-21diskmemload1
35605182111,3sleep00-21swapper/00
35516382111,3sleep10-21swapper/11
35353542111,3sleep00-21swapper/00
35167322111,5sleep03388289-21diskmemload0
34831092111,3sleep20-21swapper/22
34677942111,4sleep23388289-21diskmemload2
34326212111,6sleep13432632-21ssh1
34308102111,5sleep23388289-21diskmemload2
33776022111,6sleep23377605-21cron2
33726532111,5sleep13372824-21diskstats1
33603532111,4sleep23360402-21ntpq2
33545332111,3sleep10-21swapper/11
33388812111,5sleep03339018-21ntpq0
33239892111,5sleep03324006-21munin-run0
33127142111,5sleep03312962-21users0
33079842111,6sleep03308056-21latency_hist0
33026442111,6sleep13302659-21latency_hist1
32917862110,7sleep03291710-31find0
32640762111,5sleep13264956-21df1
37205952101,2sleep10-21swapper/11
37102222100,2sleep20-21swapper/22
37029342101,3sleep00-21swapper/00
36944802101,3sleep00-21swapper/00
36940472101,3sleep23388289-21diskmemload2
36421932101,2sleep00-21swapper/00
36307682101,4sleep23388289-21diskmemload2
36249492101,3sleep20-21swapper/22
36210232101,5sleep13621092-21ntpq1
36047152101,4sleep13388289-21diskmemload1
35992842101,3sleep00-21swapper/00
35907152101,5sleep03590750-21grep0
35784352101,2sleep10-21swapper/11
35606032100,1sleep20-21swapper/22
35453292101,2sleep20-21swapper/22
35180252101,4sleep13388289-21diskmemload1
35152672101,3sleep20-21swapper/22
35109362100,4sleep0151ktimers/00
35069892101,4sleep23507044-21ntpq2
35008482101,4sleep00-21swapper/00
34911692101,2sleep20-21swapper/22
34734262101,2sleep00-21swapper/00
34642652101,2sleep00-21swapper/00
34596242101,5sleep13460664-21ssh1
34591022101,4sleep23459319-21diskstats2
34524062101,5sleep13454164-21grep1
34506082101,5sleep23450832-21hddtemp_smartct2
34472512100,1sleep00-21swapper/00
34414772100,1sleep10-21swapper/11
34228782101,3sleep00-21swapper/00
34144632101,2sleep00-21swapper/00
33965282101,3sleep20-21swapper/22
33944362101,3sleep00-21swapper/00
33822672100,2sleep20-21swapper/22
33778862101,3sleep10-21swapper/11
33712942101,4sleep13371341-21ntpq1
33390762101,4sleep23339121-21ntpq2
32857112101,5sleep03285741-21switchtime0
32619932101,4sleep13262042-21ntpq1
3756131290,3sleep23388289-21diskmemload2
3674824291,3sleep03388289-21diskmemload0
3657434290,1sleep20-21swapper/22
3640294291,4sleep23640305-21ssh2
3630656291,2sleep10-21swapper/11
3605644291,2sleep20-21swapper/22
3564041291,2sleep20-21swapper/22
3511197291,3sleep10-21swapper/11
3485225291,2sleep10-21swapper/11
3450925291,4sleep03452405-21cut0
3432716291,2sleep00-21swapper/00
3403677290,1sleep00-21swapper/00
3403677290,1sleep00-21swapper/00
3401464291,4sleep23401588-21ntpq2
3401464291,4sleep23401588-21ntpq2
3383779291,4sleep23384729-21kthreadcore2
3371580291,5sleep23371753-21timerwakeupswit2
3344382291,4sleep23344432-21ntpq2
3340298290,3sleep13340317-21apt-get1
3333715291,4sleep03333767-21/usr/sbin/munin0
3328413291,4sleep13328416-21ntpq1
3325467291,4sleep03327191-21cut0
3318412290,1sleep10-21swapper/11
3314177291,4sleep23315244-21cat2
3308775291,4sleep23309099-21cut2
3285279291,4sleep23285392-21ntpq2
3284547293,3sleep13285277-21missed_timers1
3275557290,1sleep20-21swapper/22
3265790291,5sleep23266301-21kthreadcore2
3258418291,4sleep03259102-21cat0
3683982280,3sleep00-21swapper/00
3644315281,3sleep13645997-21tr1
3361862281,2sleep00-21swapper/00
3356808281,3sleep13357124-21kthreadcore1
3334969280,2sleep10-21swapper/11
3334666281,3sleep13334667-21sshd1
3319477281,3sleep13320019-21kthreadcore1
3297300281,3sleep23297543-21cat2
3293858281,3sleep03295659-21kthreadcore0
3277775281,3sleep03279580-21kthreadcore0
3382685270,1sleep00-21swapper/00
3366250271,3sleep23366445-21/usr/sbin/munin2
3355901270,1sleep20-21swapper/22
3355643270,1sleep00-21swapper/00
3350674271,3sleep014-21ksoftirqd/00
3287236271,3sleep20-21swapper/22
3275620270,1sleep10-21swapper/11
3387953260,1sleep00-21swapper/00
3361306260,3sleep03361307-21sshd0
3349784261,2sleep13349903-21grep1
3349623260,2sleep20-21swapper/22
3329925260,2sleep20-21swapper/22
3329027260,1sleep20-21swapper/22
3320022261,2sleep20-21swapper/22
3318470260,1sleep00-21swapper/00
3312291260,2sleep10-21swapper/11
3306848260,2sleep20-21swapper/22
3302325260,4sleep00-21swapper/00
3301685260,1sleep20-21swapper/22
3297141260,4sleep10-21swapper/11
3280781260,1sleep10-21swapper/11
3263019260,2sleep00-21swapper/00
3344831250,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional