You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 22:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sun Jul 26, 2026 12:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4056356211654,57sleep30-21swapper/33
405624828668,11sleep10-21swapper/11
405637228354,8sleep00-21swapper/00
405630428353,12sleep20-21swapper/22
855152370,2sleep10-21swapper/11
1207232350,2sleep0221rcuc/00
2068402242,18sleep14184295-21diskmemload1
4056633992112,5cyclictest0-21swapper/33
405663399211,17cyclictest4056503-21turbostat3
4056633992111,7cyclictest172306-21chrt3
80702201,14sleep08104-21ssh0
405663399206,2cyclictest0-21swapper/33
405663399202,4cyclictest484802chrt3
4056633992016,2cyclictest181685-21taskset3
405663399201,15cyclictest0-21swapper/33
405663399201,15cyclictest0-21swapper/33
405663399192,11cyclictest329695-21taskset3
4056633991917,1cyclictest0-21swapper/33
4056633991915,2cyclictest0-21swapper/33
4056633991913,4cyclictest0-21swapper/33
4056633991912,4cyclictest0-21swapper/33
405663399191,15cyclictest66950irq/132-enp1s0-TxRx-33
405663399191,15cyclictest0-21swapper/33
405663399191,14cyclictest0-21swapper/33
405663399191,14cyclictest0-21swapper/33
405663399191,14cyclictest0-21swapper/33
405663399191,14cyclictest0-21swapper/33
405663399190,17cyclictest0-21swapper/33
405663399182,14cyclictest66950irq/132-enp1s0-TxRx-33
4056633991811,4cyclictest216384-21taskset3
405663399181,14cyclictest0-21swapper/33
405663399181,14cyclictest0-21swapper/33
405663399181,14cyclictest0-21swapper/33
405663399181,14cyclictest0-21swapper/33
405663399181,14cyclictest0-21swapper/33
405663399181,13cyclictest0-21swapper/33
405663399181,13cyclictest0-21swapper/33
405663399181,13cyclictest0-21swapper/33
405663399181,13cyclictest0-21swapper/33
405663399181,12cyclictest4184323-21turbostat3
4056633991810,5cyclictest249785-21taskset3
405663399180,15cyclictest66950irq/132-enp1s0-TxRx-33
405663399180,15cyclictest66950irq/132-enp1s0-TxRx-33
405663399180,14cyclictest0-21swapper/33
255532182,5sleep125575-21apt-get1
41584112171,5sleep04158414-21apt-get0
4056633991713,2cyclictest0-21swapper/33
405663399171,14cyclictest0-21swapper/33
4056633991711,3cyclictest0-21swapper/33
4056633991711,3cyclictest0-21swapper/33
405663399171,13cyclictest0-21swapper/33
405663399171,13cyclictest0-21swapper/33
405663399171,13cyclictest0-21swapper/33
405663399170,7cyclictest4074133-21chrt3
405663399170,15cyclictest0-21swapper/33
405663399170,14cyclictest0-21swapper/33
405663399170,14cyclictest0-21swapper/33
3519382171,2sleep00-21swapper/00
2138372171,3sleep00-21swapper/00
1717522171,3sleep0171763-21ssh0
1450542171,12sleep2145067-21ssh2
1218892170,2sleep0221rcuc/00
941932161,3sleep20-21swapper/22
940282161,6sleep194039-21ssh1
565652161,2sleep00-21swapper/00
414502161,3sleep00-21swapper/00
41427592160,1sleep00-21swapper/00
4056633991612,2cyclictest0-21swapper/33
405663399161,11cyclictest0-21swapper/33
405663399160,13cyclictest0-21swapper/33
405663399160,13cyclictest0-21swapper/33
405663399160,13cyclictest0-21swapper/33
405663399160,13cyclictest0-21swapper/33
405663399160,13cyclictest0-21swapper/33
405663399151,2cyclictest0-21swapper/33
4056633991512,1cyclictest0-21swapper/33
405663399151,12cyclictest0-21swapper/33
405663399151,12cyclictest0-21swapper/33
405663399150,1cyclictest0-21swapper/33
405663399150,13cyclictest0-21swapper/33
405663399150,13cyclictest0-21swapper/33
405663399150,13cyclictest0-21swapper/33
405663399150,12cyclictest0-21swapper/33
2584572150,1sleep20-21swapper/22
2075802151,9sleep2207591-21ssh2
1786222151,2sleep00-21swapper/00
1533502150,3sleep00-21swapper/00
41677892141,9sleep24167962-21cat2
41322122141,6sleep24131978-21sendmail-msp2
405663399140,12cyclictest0-21swapper/33
405663399140,12cyclictest0-21swapper/33
405663399140,11cyclictest0-21swapper/33
3456952140,3sleep24184295-21diskmemload2
3253132141,9sleep1325463-21/usr/sbin/munin1
2912822141,9sleep2291296-21ssh2
2595042141,8sleep04184295-21diskmemload0
2505712141,7sleep04184295-21diskmemload0
1891512141,9sleep2189159-21ssh2
490812131,2sleep10-21swapper/11
41847602131,3sleep10-21swapper/11
41481872131,8sleep24148290-21perl2
41231132130,2sleep20-21swapper/22
405663399137,3cyclictest4110079-21chrt3
3296612133,4sleep2329688-21apt-get2
3204512131,5sleep00-21swapper/00
3080472131,7sleep0308303-21tail0
2595712131,2sleep10-21swapper/11
223162131,3sleep24184295-21diskmemload2
2224772132,6sleep24184295-21diskmemload2
1643972131,8sleep2164612-21ssh2
1096442131,8sleep24184295-21diskmemload2
73472121,6sleep17350-21ssh1
662312121,7sleep066238-21ssh0
41272462125,3sleep24127374-21tr2
41217282121,6sleep04121747-21apt-get0
41012742121,7sleep14101450-21tr1
40943492121,7sleep04094400-21cut0
347852121,5sleep234867-21irqstats2
3361872121,3sleep10-21swapper/11
3348382121,7sleep0334849-21sh0
2670022125,3sleep1267016-21ssh1
2448512122,6sleep10-21swapper/11
1555632121,6sleep14184295-21diskmemload1
1465312121,6sleep14184295-21diskmemload1
1141072121,7sleep1115749-21cut1
693792111,6sleep069516-21perl0
478442110,1sleep00-21swapper/00
429212111,5sleep242953-21ssh2
41936862111,5sleep24193910-21/usr/sbin/munin2
41913192111,6sleep04191329-21ssh0
41842812111,6sleep14184526-21latency_hist1
41693312111,5sleep24169402-21irqstats2
41689172111,5sleep04169120-21diskstats0
41414322111,5sleep24141502-21ntp_states2
41214232111,6sleep14121498-21latency_hist1
41115402111,5sleep24111753-21hddtemp_smartct2
41004892110,1sleep10-21swapper/11
40952562111,5sleep24095312-21munin-run2
40904972111,5sleep14090620-21diskstats1
3084442111,6sleep2308457-21sh2
3030302110,1sleep20-21swapper/22
3030302110,1sleep20-21swapper/22
2781492111,2sleep00-21swapper/00
2763792111,4sleep14184295-21diskmemload1
2678502111,6sleep04184295-21diskmemload0
2670582111,5sleep2267072-21ssh2
2322382110,2sleep2232251-21ssh2
232182110,4sleep00-21swapper/00
2243502110,1sleep10-21swapper/11
2212342111,6sleep0221414-21wc0
2149262110,2sleep1214937-21ssh1
2049862111,5sleep04184295-21diskmemload0
1824212111,6sleep1182530-21fschecks_time1
1813712111,3sleep20-21swapper/22
1785802110,2sleep10-21swapper/11
1713592111,3sleep10-21swapper/11
1367632111,6sleep10-21swapper/11
951692102,4sleep195168-21apt-get1
921722101,4sleep04184295-21diskmemload0
81062101,4sleep18117-21ssh1
770192101,2sleep20-21swapper/22
654162101,4sleep14184295-21diskmemload1
595622101,3sleep20-21swapper/22
583172101,4sleep14184295-21diskmemload1
41932772101,4sleep00-21swapper/00
41636272101,3sleep00-21swapper/00
41316462100,1sleep00-21swapper/00
41062802101,5sleep04106407-21grep0
40745652101,3sleep24074584-21apt-get2
40567912101,2sleep10-21swapper/11
3540552101,3sleep10-21swapper/11
345622101,4sleep134784-21hddtemp_smartct1
3430002101,4sleep04184295-21diskmemload0
3266682101,3sleep00-21swapper/00
3213902101,2sleep20-21swapper/22
3172422101,6sleep10-21swapper/11
3113972101,4sleep10-21swapper/11
308732101,4sleep04184295-21diskmemload0
303332100,6sleep230346-21ssh2
3008772101,3sleep10-21swapper/11
3008772101,3sleep10-21swapper/11
2991682101,4sleep00-21swapper/00
2991682101,4sleep00-21swapper/00
2939112100,1sleep00-21swapper/00
2689502101,4sleep0268964-21ssh0
2393402101,3sleep00-21swapper/00
2331292101,3sleep00-21swapper/00
2253812100,1sleep10-21swapper/11
222062101,3sleep10-21swapper/11
2148902101,4sleep24184295-21diskmemload2
1969562101,3sleep04184295-21diskmemload0
1956492101,4sleep20-21swapper/22
1884132100,5sleep00-21swapper/00
1625932101,3sleep20-21swapper/22
1560322102,4sleep0156034-21apt-get0
141232101,4sleep24184295-21diskmemload2
1327772100,1sleep00-21swapper/00
1261842101,4sleep24184295-21diskmemload2
1211442100,1sleep10-21swapper/11
1175642100,1sleep20-21swapper/22
1115592100,1sleep00-21swapper/00
1087182101,3sleep10-21swapper/11
1004322100,1sleep00-21swapper/00
95058291,2sleep20-21swapper/22
85010291,3sleep285024-21ssh2
84879291,2sleep00-21swapper/00
74285291,2sleep10-21swapper/11
65881291,3sleep24184295-21diskmemload2
4174074291,4sleep10-21swapper/11
4164468291,4sleep14166099-21kthreadcore1
4154993291,4sleep04156735-21cut0
4116485290,4sleep04116743-21df_inode0
4069353291,2sleep00-21swapper/00
352572291,2sleep20-21swapper/22
345888290,1sleep10-21swapper/11
312305291,3sleep2312300-21apt-get2
293045290,5sleep10-21swapper/11
282876291,2sleep20-21swapper/22
281755290,2sleep10-21swapper/11
249828290,1sleep20-21swapper/22
240550291,2sleep10-21swapper/11
239844291,4sleep2239859-21ssh2
198046291,3sleep14184295-21diskmemload1
162334291,3sleep14184295-21diskmemload1
147327291,3sleep2146975-21sendmail-msp2
138631291,3sleep0138665-21apt-get0
136471291,4sleep2136474-21ssh2
4186802281,3sleep20-21swapper/22
4184269280,2sleep00-21swapper/00
4178829280,2sleep20-21swapper/22
4159038281,3sleep14160650-21cut1
4153152280,4sleep20-21swapper/22
4147926281,2sleep00-21swapper/00
4142673280,2sleep20-21swapper/22
4132502281,3sleep10-21swapper/11
4132013280,4sleep00-21swapper/00
4100782280,4sleep2421rcuc/22
4089684280,2sleep20-21swapper/22
4086080281,3sleep14087749-21cut1
4084485280,2sleep20-21swapper/22
4080084281,3sleep10-21swapper/11
4064046281,2sleep00-21swapper/00
268856280,4sleep20-21swapper/22
4175520271,2sleep00-21swapper/00
4163072270,1sleep20-21swapper/22
4153161271,2sleep10-21swapper/11
4149121270,3sleep14150762-21kthreadcore1
4142322270,1sleep10-21swapper/11
4131593270,1sleep10-21swapper/11
4111246271,2sleep10-21swapper/11
4106015270,3sleep24106063-21grep2
4105993270,2sleep10-21swapper/11
4101059271,3sleep04101270-21idleruntime0
4097068271,2sleep20-21swapper/22
4085060270,2sleep00-21swapper/00
4080604271,2sleep00-21swapper/00
4075823271,3sleep04077480-21cut0
4074267270,1sleep10-21swapper/11
4068748270,1sleep20-21swapper/22
4064068271,2sleep14064224-21cstates1
4184121260,1sleep20-21swapper/22
4172352261,2sleep10-21swapper/11
4146216260,2sleep14146658-21strings1
4116460260,1sleep20-21swapper/22
4095525260,2sleep00-21swapper/00
4073526261,2sleep20-21swapper/22
4142251250,2sleep04142252-21pool-udisksd0
4121715250,1sleep10-21swapper/11
4111035250,1sleep00-21swapper/00
4079172250,1sleep10-21swapper/11
4060864250,1sleep20-21swapper/22
4060609250,1sleep04060782-21strings0
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional