You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-17 - 12:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot3s.osadl.org (updated Tue Mar 17, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3858512212255,62sleep30-21swapper/33
385846527955,12sleep10-21swapper/11
385828427861,11sleep20-21swapper/22
385846427552,18sleep00-21swapper/00
41648862270,2sleep20-21swapper/22
41820372231,2sleep10-21swapper/11
405038522313,7sleep23989220-21diskmemload2
385876799228,10cyclictest4103361-21turbostat3
385876799221,17cyclictest102251-21chrt3
40396262211,8sleep13989220-21diskmemload1
385876799211,17cyclictest83518-21chrt3
385876799211,16cyclictest66950irq/132-enp1s0-TxRx-33
385876799211,16cyclictest4092960-21taskset3
385876799205,4cyclictest4006200-21taskset3
385876799205,4cyclictest4006200-21taskset3
3858767992016,2cyclictest0-21swapper/33
385876799201,16cyclictest0-21swapper/33
385876799201,15cyclictest66950irq/132-enp1s0-TxRx-33
385876799201,15cyclictest0-21swapper/33
385876799201,15cyclictest0-21swapper/33
385876799201,15cyclictest0-21swapper/33
385876799201,15cyclictest0-21swapper/33
40927942190,7sleep23989220-21diskmemload2
385876799191,15cyclictest0-21swapper/33
385876799191,14cyclictest0-21swapper/33
385876799191,14cyclictest0-21swapper/33
385876799191,14cyclictest0-21swapper/33
385876799191,14cyclictest0-21swapper/33
385876799191,14cyclictest0-21swapper/33
3858767991910,6cyclictest3881779-21taskset3
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,14cyclictest0-21swapper/33
385876799181,13cyclictest4183161-21chrt3
385876799181,13cyclictest0-21swapper/33
385876799181,13cyclictest0-21swapper/33
385876799181,13cyclictest0-21swapper/33
385876799181,13cyclictest0-21swapper/33
385876799181,13cyclictest0-21swapper/33
385876799180,14cyclictest0-21swapper/33
1567332182,9sleep2156999-21df2
41532992171,2sleep20-21swapper/22
41258772171,3sleep20-21swapper/22
3858767991715,1cyclictest0-21swapper/33
385876799171,14cyclictest0-21swapper/33
385876799171,14cyclictest0-21swapper/33
3858767991711,3cyclictest0-21swapper/33
385876799171,13cyclictest0-21swapper/33
385876799171,13cyclictest0-21swapper/33
385876799171,12cyclictest0-21swapper/33
1454072171,5sleep13989220-21diskmemload1
1293702171,3sleep20-21swapper/22
1175872171,5sleep1117816-21users1
958462161,4sleep095929-21irqstats0
844692161,3sleep13989220-21diskmemload1
41540552160,2sleep14154070-21ssh1
41300852161,2sleep00-21swapper/00
385876799160,13cyclictest0-21swapper/33
385876799160,13cyclictest0-21swapper/33
385876799160,12cyclictest0-21swapper/33
41883402151,3sleep03989220-21diskmemload0
41272432151,3sleep03989220-21diskmemload0
412632151,2sleep00-21swapper/00
40407352151,2sleep00-21swapper/00
40042732151,2sleep20-21swapper/22
40042732151,2sleep20-21swapper/22
39403492151,9sleep23940566-21users2
385876799151,3cyclictest0-21swapper/33
3858767991512,2cyclictest0-21swapper/33
385876799151,12cyclictest0-21swapper/33
385876799151,11cyclictest39191172sleep33
3858767991510,2cyclictest0-21swapper/33
385876799150,13cyclictest0-21swapper/33
385876799150,13cyclictest0-21swapper/33
385876799150,12cyclictest0-21swapper/33
385876799150,12cyclictest0-21swapper/33
385876799150,12cyclictest0-21swapper/33
385876799150,12cyclictest0-21swapper/33
308452151,3sleep23989220-21diskmemload2
1212792151,9sleep2121329-21munin-run2
959302142,7sleep197191-21grep1
924832141,3sleep20-21swapper/22
855692141,4sleep085583-21ssh0
743732141,8sleep03989220-21diskmemload0
41831292142,6sleep24183153-21apt-get2
41204082141,2sleep10-21swapper/11
40137752141,9sleep24013786-21ssh2
40049022141,8sleep13989220-21diskmemload1
40049022141,8sleep13989220-21diskmemload1
39249262143,5sleep1331ktimers/11
38855772141,7sleep03886243-21memory0
38719442141,9sleep13872143-21cut1
385876799141,9cyclictest3929036-21chrt3
3858767991411,2cyclictest0-21swapper/33
3858767991411,1cyclictest0-21swapper/33
385876799140,2cyclictest0-21swapper/33
385876799140,12cyclictest0-21swapper/33
205112141,5sleep220755-21awk2
1019362140,1sleep20-21swapper/22
478962130,3sleep20-21swapper/22
442082131,8sleep13989220-21diskmemload1
41810972131,8sleep04181112-21ssh0
41716352131,5sleep10-21swapper/11
40912131,2sleep23989220-21diskmemload2
40857602131,8sleep24085818-21munin-run2
40315292131,3sleep04031543-21ssh0
40199892131,6sleep14020048-21ntpq1
39954792130,2sleep20-21swapper/22
38640372135,4sleep13864172-21munin-node1
3858767991310,2cyclictest0-21swapper/33
130152131,8sleep03989220-21diskmemload0
674472121,7sleep03989220-21diskmemload0
570722121,7sleep157085-21sh1
553312121,5sleep055391-21ntpq0
41730302121,5sleep20-21swapper/22
41645032121,7sleep04164513-21ssh0
41543952121,2sleep04154407-21ssh0
41192462121,6sleep23989220-21diskmemload2
41179442126,1sleep00-21swapper/00
40861612121,8sleep14086326-21cstates1
40509932121,6sleep24051017-21apt-get2
40397872121,7sleep24039801-21ssh2
40242452121,5sleep24024309-21munin-run2
40120712121,7sleep10-21swapper/11
39675292121,3sleep2802-21snmpd2
39666222121,7sleep13966671-21/usr/sbin/munin1
39342802121,5sleep23934326-21ntpq2
39244582120,1sleep10-21swapper/11
38920032121,7sleep03892027-21tr0
172302121,8sleep018860-21kthreadcore0
1115612121,3sleep0111575-21ssh0
1115612121,3sleep0111575-21ssh0
858472111,5sleep285905-21munin-run2
598892110,1sleep10-21swapper/11
41895282111,4sleep13989220-21diskmemload1
41383112111,3sleep10-21swapper/11
41033992110,2sleep10-21swapper/11
41001162111,3sleep00-21swapper/00
40999762111,4sleep13989220-21diskmemload1
40853842111,4sleep13989220-21diskmemload1
40753372110,7sleep04075351-21ssh0
40499412110,4sleep00-21swapper/00
39734202111,5sleep03973438-21apt-get0
39571702111,5sleep13957431-21df_inode1
39200962111,5sleep03920167-21irqstats0
39130852111,5sleep23913139-21ntpq2
286962111,5sleep028851-21ntpq0
1650492111,4sleep1165130-21munin-run1
1546972111,4sleep23989220-21diskmemload2
149292111,4sleep23989220-21diskmemload2
1474792111,6sleep0147493-21ssh0
1463822111,3sleep20-21swapper/22
1364912111,6sleep2136502-21ssh2
1269032111,5sleep03989220-21diskmemload0
120122111,4sleep13989220-21diskmemload1
933582101,4sleep093372-21ssh0
915552100,1sleep10-21swapper/11
732242101,2sleep20-21swapper/22
687192101,3sleep168748-21apt-get1
59912101,2sleep00-21swapper/00
591212101,3sleep20-21swapper/22
478212101,3sleep00-21swapper/00
41927662101,5sleep1393-21cut1
41803022101,2sleep20-21swapper/22
41704582101,3sleep00-21swapper/00
41399132102,3sleep04141554-21grep0
41356822101,2sleep20-21swapper/22
41213302101,4sleep14121596-21df1
41115312101,2sleep20-21swapper/22
41037592101,3sleep00-21swapper/00
40830132101,2sleep00-21swapper/00
40739192101,3sleep13989220-21diskmemload1
40604432100,7sleep14061951-21cut1
40569832101,5sleep04056997-21ssh0
40425312101,4sleep13989220-21diskmemload1
40322082101,2sleep10-21swapper/11
40235582101,4sleep03989220-21diskmemload0
40079902101,5sleep04009594-21grep0
40034722101,3sleep00-21swapper/00
40034722101,3sleep00-21swapper/00
39948702100,1sleep10-21swapper/11
39790842101,4sleep13979294-21hddtemp_smartct1
39076632101,4sleep23907720-21ntpq2
39068922101,4sleep03907549-21memory0
38902902101,4sleep23891567-21memory2
38885892101,5sleep13890289-21tr1
38810732100,6sleep23881128-21ld2
38757772101,4sleep03875834-21ntp_states0
1613942101,4sleep0161590-21users0
156962101,2sleep10-21swapper/11
1354082101,3sleep10-21swapper/11
1259362101,4sleep1126000-21ntp_states1
1193802101,3sleep00-21swapper/00
1083402101,4sleep2108400-21ntpq2
1083402101,4sleep2108400-21ntpq2
59922291,4sleep260043-21tr2
4162783291,3sleep13989220-21diskmemload1
4143866291,2sleep20-21swapper/22
4143145291,3sleep13989220-21diskmemload1
4095268291,4sleep24095347-21ssh2
4092918290,1sleep00-21swapper/00
4074230290,2sleep20-21swapper/22
4064822291,2sleep00-21swapper/00
4064355291,4sleep24064442-21ssh2
4055010291,3sleep13989220-21diskmemload1
4029924291,2sleep20-21swapper/22
3994596291,2sleep00-21swapper/00
3984307290,4sleep03984430-21diskstats0
3966567291,4sleep03966621-21ld0
3941218291,4sleep23941467-21expr2
3935150290,2sleep00-21swapper/00
3925943291,4sleep23927006-21kthreadcore2
3919681290,1sleep20-21swapper/22
3917684291,4sleep13918187-21grep1
3914390291,4sleep03914606-21diskstats0
3902263291,3sleep13902388-21ntpq1
3881489290,1sleep00-21swapper/00
3876981291,3sleep13877000-21apt-get1
37700291,3sleep13989220-21diskmemload1
33145291,4sleep233353-21ssh2
31236291,3sleep13989220-21diskmemload1
153655291,3sleep13989220-21diskmemload1
152990291,3sleep0153004-21ssh0
130449291,4sleep0130520-21ls0
109541290,1sleep10-21swapper/11
109541290,1sleep10-21swapper/11
3974862281,3sleep13976644-21cut1
3973043280,1sleep00-21swapper/00
3957715281,3sleep03958802-21cat0
3951809281,2sleep03951828-21apt-get0
3909538281,3sleep13910591-21kthreadcore1
3908541280,2sleep10-21swapper/11
3897833280,2sleep00-21swapper/00
3887404282,3sleep1331ktimers/11
3886383280,4sleep20-21swapper/22
3859511281,4sleep13860989-21tr1
3859511281,4sleep13860989-21tr1
3858939280,3sleep03858958-21apt-get0
3858939280,3sleep03858958-21apt-get0
3984140270,2sleep20-21swapper/22
3973048270,1sleep20-21swapper/22
3957432271,3sleep20-21swapper/22
3952390271,2sleep13953903-21ps1
3951321270,1sleep00-21swapper/00
3947466271,3sleep13949183-21tr1
3941196270,2sleep10-21swapper/11
3940578270,1sleep00-21swapper/00
3925251271,3sleep03925459-21if_enp1s00
3908970271,3sleep03908985-21acpi0
3898340270,2sleep20-21swapper/22
3893362270,1sleep20-21swapper/22
3876417270,1sleep20-21swapper/22
3871023270,1sleep20-21swapper/22
3863737270,1sleep20-21swapper/22
3863737270,1sleep20-21swapper/22
3983534260,1sleep00-21swapper/00
3978791260,1sleep20-21swapper/22
3973700261,2sleep20-21swapper/22
3955902261,2sleep20-21swapper/22
3951209260,1sleep20-21swapper/22
3941496261,2sleep00-21swapper/00
3935482260,1sleep10-21swapper/11
3934138260,2sleep10-21swapper/11
3903378260,2sleep00-21swapper/00
3897742260,1sleep10-21swapper/11
3866885261,2sleep00-21swapper/00
3987965250,2sleep13988154-21strings1
3968078250,1sleep10-21swapper/11
3918189250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional