You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-23 - 02:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Wed Sep 23, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3041926212065,51sleep30-21swapper/33
304189428567,12sleep10-21swapper/11
304179028162,13sleep20-21swapper/22
304201727454,14sleep00-21swapper/00
30605652380,3sleep1321rcuc/11
3042292992319,2cyclictest0-21swapper/33
304229299211,17cyclictest0-21swapper/33
304229299210,19cyclictest0-21swapper/33
34383492201,13sleep20-21swapper/22
304229299204,13cyclictest0-21swapper/33
304229299201,15cyclictest3101829-21taskset3
304229299201,15cyclictest0-21swapper/33
304229299201,15cyclictest0-21swapper/33
304229299201,15cyclictest0-21swapper/33
304229299201,15cyclictest0-21swapper/33
304229299201,15cyclictest0-21swapper/33
304229299201,14cyclictest0-21swapper/33
304229299200,2cyclictest0-21swapper/33
34317142191,5sleep01-21systemd0
304229299198,8cyclictest3446107-21taskset3
304229299198,8cyclictest3070601-21turbostat3
3042292991916,2cyclictest0-21swapper/33
304229299191,3cyclictest0-21swapper/33
3042292991912,5cyclictest0-21swapper/33
304229299191,14cyclictest0-21swapper/33
304229299191,14cyclictest0-21swapper/33
304229299191,14cyclictest0-21swapper/33
304229299191,14cyclictest0-21swapper/33
304229299191,14cyclictest0-21swapper/33
304229299191,13cyclictest3164989-21chrt3
35166002181,3sleep20-21swapper/22
337229821813,1sleep2421rcuc/22
304229299187,8cyclictest3133640-21turbostat3
3042292991813,3cyclictest66950irq/132-enp1s0-TxRx-33
3042292991812,3cyclictest0-21swapper/33
304229299181,14cyclictest0-21swapper/33
304229299181,14cyclictest0-21swapper/33
304229299181,14cyclictest0-21swapper/33
304229299181,14cyclictest0-21swapper/33
304229299181,14cyclictest0-21swapper/33
304229299181,13cyclictest0-21swapper/33
304229299181,13cyclictest0-21swapper/33
304229299181,13cyclictest0-21swapper/33
304229299180,15cyclictest0-21swapper/33
304229299180,15cyclictest0-21swapper/33
304229299180,14cyclictest3387198-21taskset3
304229299180,14cyclictest0-21swapper/33
304229299180,14cyclictest0-21swapper/33
32545682171,4sleep03170473-21diskmemload0
31239792171,12sleep23124662-21cut2
304229299172,10cyclictest3170731-21taskset3
304229299171,4cyclictest0-21swapper/33
3042292991713,2cyclictest0-21swapper/33
3042292991711,3cyclictest0-21swapper/33
304229299171,13cyclictest0-21swapper/33
304229299171,13cyclictest0-21swapper/33
304229299171,12cyclictest0-21swapper/33
304229299171,10cyclictest0-21swapper/33
304229299170,14cyclictest0-21swapper/33
304229299170,14cyclictest0-21swapper/33
304229299170,13cyclictest0-21swapper/33
35180632160,1sleep00-21swapper/00
35075382161,2sleep00-21swapper/00
33290352160,1sleep20-21swapper/22
33121312160,8sleep13312145-21ssh1
32183102161,3sleep00-21swapper/00
30543512161,2sleep20-21swapper/22
304229299161,3cyclictest0-21swapper/33
304229299161,3cyclictest0-21swapper/33
304229299161,13cyclictest0-21swapper/33
304229299160,13cyclictest0-21swapper/33
304229299160,12cyclictest0-21swapper/33
304229299160,12cyclictest0-21swapper/33
34151672151,4sleep03415180-21ssh0
33959972151,2sleep00-21swapper/00
32935822151,3sleep00-21swapper/00
31648482151,9sleep23159968-21sendmail-msp2
30684142151,7sleep03065621-21/usr/sbin/munin0
3042292991512,2cyclictest0-21swapper/33
304229299151,12cyclictest0-21swapper/33
304229299151,11cyclictest30473292sleep33
304229299150,13cyclictest0-21swapper/33
304229299150,12cyclictest0-21swapper/33
304229299150,11cyclictest31545152sleep33
35077522141,8sleep23170473-21diskmemload2
34817232141,2sleep1171rcu_preempt1
34667432141,3sleep03170473-21diskmemload0
34045962141,8sleep13404610-21ssh1
34036572141,2sleep20-21swapper/22
33612382141,8sleep23355891-21sendmail-msp2
33404562142,4sleep23342048-21grep2
32882862141,9sleep13288575-21ssh1
32368422140,2sleep20-21swapper/22
32106092140,3sleep03170473-21diskmemload0
31947532140,9sleep10-21swapper/11
30600572141,8sleep03060164-21grep0
3042292991411,2cyclictest0-21swapper/33
304229299140,12cyclictest0-21swapper/33
304229299140,11cyclictest0-21swapper/33
34455792131,2sleep2171rcu_preempt2
34412292131,8sleep03442529-21tr0
33730742130,2sleep10-21swapper/11
33278282131,8sleep03170473-21diskmemload0
33211242130,3sleep03170473-21diskmemload0
32789672131,8sleep23278980-21sh2
32712392131,8sleep03271249-21ssh0
32685572133,7sleep23170473-21diskmemload2
32611512131,7sleep13170473-21diskmemload1
32355192131,3sleep13235531-21ssh1
32263582130,5sleep10-21swapper/11
31664132135,4sleep13168048-21cut1
31439362130,1sleep10-21swapper/11
31437842131,7sleep23138903-21sendmail-msp2
31024082130,2sleep20-21swapper/22
30708572130,8sleep20-21swapper/22
30695002131,8sleep13069640-21ntp_192.168.1141
304229299130,2cyclictest0-21swapper/33
34982612120,1sleep13498273-21ssh1
34910672121,7sleep23491078-21sh2
33958332121,7sleep23395844-21ssh2
33394022122,4sleep13339398-21apt-get1
33119492121,7sleep23311962-21ssh2
33065492121,7sleep03308105-21grep0
32879672121,2sleep23170473-21diskmemload2
32871642121,5sleep00-21swapper/00
32708172120,1sleep10-21swapper/11
32447772120,1sleep10-21swapper/11
32433672121,5sleep03170473-21diskmemload0
32084142120,2sleep23208569-21strings2
32029812121,7sleep13202996-21ssh1
31756022121,3sleep13175632-21ssh1
31704282121,4sleep00-21swapper/00
31289442121,7sleep03129032-21tune2fs0
31227952121,7sleep23117922-21sendmail-msp2
35195722111,5sleep13521066-21ssh1
34997632111,5sleep23457162-21kworker/u16:1+events_power_efficient2
34982482111,5sleep03170473-21diskmemload0
34757852111,4sleep10-21swapper/11
34647262112,5sleep20-21swapper/22
34647152111,4sleep10-21swapper/11
34395992110,2sleep10-21swapper/11
34140262111,5sleep20-21swapper/22
33725702111,3sleep00-21swapper/00
33701092111,3sleep10-21swapper/11
33633822111,6sleep13363393-21ssh1
33552172111,4sleep00-21swapper/00
33358722111,5sleep13170473-21diskmemload1
33269222111,5sleep13322111-21sendmail-msp1
33140472115,3sleep13314217-21/usr/sbin/munin1
32948802111,6sleep23170473-21diskmemload2
32859012111,5sleep13170473-21diskmemload1
32778382111,6sleep13277852-21ssh1
32466922112,4sleep13246715-21apt-get1
32301462112,5sleep03230260-21perl0
32274302110,2sleep23227441-21ssh2
32188712111,5sleep23170473-21diskmemload2
31874442111,6sleep03187455-21ssh0
31444312111,4sleep03144450-21apt-get0
30811402111,6sleep03081315-21latency_hist0
30710252111,5sleep03071148-21diskstats0
30556292116,2sleep10-21swapper/11
30502872110,7sleep13050860-21grep1
35255762100,2sleep20-21swapper/22
35192402101,6sleep03170473-21diskmemload0
35176422101,3sleep10-21swapper/11
35017742101,4sleep13170473-21diskmemload1
34907422101,4sleep03170473-21diskmemload0
34897852100,1sleep10-21swapper/11
34837572101,2sleep20-21swapper/22
34745602100,1sleep20-21swapper/22
34739202100,1sleep00-21swapper/00
34554522101,3sleep20-21swapper/22
34543782101,4sleep13170473-21diskmemload1
34542722101,5sleep03454284-21rm0
34458432100,3sleep10-21swapper/11
34385272101,4sleep03170473-21diskmemload0
34306042100,2sleep1171rcu_preempt1
34265252101,3sleep23427644-21memory2
34208412101,4sleep23170473-21diskmemload2
34191172101,3sleep13419272-21strings1
34037752101,2sleep00-21swapper/00
33898762100,2sleep10-21swapper/11
33890702100,2sleep10-21swapper/11
33888882101,4sleep23170473-21diskmemload2
33810752100,6sleep03381238-21sed0
33738002100,3sleep2421rcuc/22
33628132101,4sleep03170473-21diskmemload0
33527462101,3sleep20-21swapper/22
33478542101,3sleep10-21swapper/11
33371192101,4sleep23170473-21diskmemload2
33203352100,1sleep20-21swapper/22
33035512101,3sleep10-21swapper/11
33023872101,2sleep00-21swapper/00
33023232100,1sleep20-21swapper/22
32780992101,3sleep00-21swapper/00
32610982101,2sleep00-21swapper/00
32603602100,6sleep23260371-21ssh2
32524112101,4sleep23170473-21diskmemload2
32452682101,3sleep20-21swapper/22
32213582102,3sleep03221378-21apt-get0
32196602101,4sleep13170473-21diskmemload1
32115992102,4sleep1331ktimers/11
31926252101,2sleep20-21swapper/22
31846412101,3sleep10-21swapper/11
31840732101,2sleep20-21swapper/22
31760302100,1sleep00-21swapper/00
31555082101,5sleep03156625-21kthreadcore0
31386272100,1sleep00-21swapper/00
31227932102,4sleep00-21swapper/00
31169762101,5sleep2555-21dbus-daemon2
31133472101,4sleep03113458-21irqstats0
31120252101,4sleep03112235-21users0
31064962101,2sleep00-21swapper/00
30972552101,4sleep13097402-21diskstats1
30971352101,5sleep03096886-21sendmail-msp0
30958472101,4sleep13095923-21ntp_states1
30869272101,5sleep13086999-21grep1
30866692101,4sleep03086926-21df0
30424652101,3sleep10-21swapper/11
3481367291,3sleep00-21swapper/00
3413426291,3sleep10-21swapper/11
3411554291,3sleep03170473-21diskmemload0
3345107290,1sleep00-21swapper/00
3330978291,4sleep03331234-21expr0
3202557291,2sleep20-21swapper/22
3198110291,5sleep03199783-21kthreadcore0
3183480293,2sleep00-21swapper/00
3171832291,4sleep23173358-21grep2
3156626291,4sleep13158352-21grep1
3128679291,2sleep20-21swapper/22
3096819291,4sleep03097036-21cut0
3057126291,4sleep23058735-21cut2
3386338280,3sleep03170473-21diskmemload0
3164876281,4sleep10-21swapper/11
3154324280,1sleep10-21swapper/11
3153726280,1sleep20-21swapper/22
3145985281,3sleep23147687-21cut2
3144453281,3sleep13144482-21grep1
3128354280,1sleep00-21swapper/00
3112433280,1sleep10-21swapper/11
3107103280,1sleep10-21swapper/11
3101771281,3sleep23096886-21sendmail-msp2
3078145281,3sleep23079750-21cut2
3076720280,4sleep13076114-21/usr/sbin/munin1
3043721281,3sleep23045371-21kthreadcore2
3160191271,2sleep00-21swapper/00
3139153271,3sleep03139313-21ls0
3133892271,2sleep20-21swapper/22
3128057270,1sleep10-21swapper/11
3118136271,2sleep10-21swapper/11
3112598270,1sleep20-21swapper/22
3091874270,1sleep20-21swapper/22
3086328270,1sleep20-21swapper/22
3081408270,2sleep10-21swapper/11
3075565270,1sleep10-21swapper/11
3066188271,2sleep20-21swapper/22
3060351271,2sleep00-21swapper/00
3170201260,4sleep20-21swapper/22
3159584260,1sleep20-21swapper/22
3152615260,3sleep00-21swapper/00
3138106260,2sleep10-21swapper/11
3133565260,1sleep10-21swapper/11
3113459261,2sleep10-21swapper/11
3086012260,1sleep00-21swapper/00
3065212260,1sleep20-21swapper/22
3047865261,2sleep00-21swapper/00
3046328260,2sleep00-21swapper/00
3086645240,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional