You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 02:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Mon Mar 23, 2026 00:43:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1503227212052,63sleep30-21swapper/33
150321428260,16sleep00-21swapper/00
150316927859,12sleep20-21swapper/22
150338227759,11sleep10-21swapper/11
150359799261,15cyclictest0-21swapper/33
1503597992320,2cyclictest0-21swapper/33
150359799231,18cyclictest0-21swapper/33
1503597992219,1cyclictest0-21swapper/33
150359799221,14cyclictest0-21swapper/33
150359799220,18cyclictest1675413-21chrt3
150359799211,12cyclictest0-21swapper/33
1503597992017,1cyclictest0-21swapper/33
1503597992017,1cyclictest0-21swapper/33
1503597992013,4cyclictest1537821-21sleep3
150359799201,15cyclictest66950irq/132-enp1s0-TxRx-33
150359799201,14cyclictest0-21swapper/33
150359799201,13cyclictest0-21swapper/33
150359799200,2cyclictest0-21swapper/33
19407762192,4sleep11634048-21diskmemload1
150359799193,11cyclictest1656525-21taskset3
150359799191,5cyclictest0-21swapper/33
150359799191,5cyclictest0-21swapper/33
1503597991915,2cyclictest0-21swapper/33
1503597991914,2cyclictest0-21swapper/33
150359799191,2cyclictest0-21swapper/33
150359799191,2cyclictest0-21swapper/33
150359799191,15cyclictest66950irq/132-enp1s0-TxRx-33
150359799191,15cyclictest16405772sleep33
150359799191,15cyclictest0-21swapper/33
150359799191,14cyclictest1683465-21taskset3
150359799191,14cyclictest0-21swapper/33
150359799191,14cyclictest0-21swapper/33
150359799191,14cyclictest0-21swapper/33
1503597991910,6cyclictest1710233-21taskset3
19908072181,2sleep00-21swapper/00
17912322181,3sleep00-21swapper/00
17887232181,3sleep20-21swapper/22
17634332181,3sleep00-21swapper/00
150359799185,9cyclictest1532172-21turbostat3
150359799184,12cyclictest0-21swapper/33
150359799184,11cyclictest0-21swapper/33
1503597991814,2cyclictest0-21swapper/33
1503597991813,2cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,14cyclictest0-21swapper/33
150359799181,13cyclictest0-21swapper/33
150359799180,11cyclictest0-21swapper/33
17629882171,3sleep10-21swapper/11
16827152171,8sleep11634048-21diskmemload1
150359799178,6cyclictest1623277-21taskset3
1503597991715,1cyclictest0-21swapper/33
150359799171,14cyclictest0-21swapper/33
150359799171,13cyclictest0-21swapper/33
150359799170,13cyclictest1516076-21taskset3
17983702161,3sleep20-21swapper/22
17983702161,3sleep20-21swapper/22
16420072161,2sleep00-21swapper/00
1503597991614,1cyclictest0-21swapper/33
150359799161,3cyclictest0-21swapper/33
1503597991613,1cyclictest0-21swapper/33
1503597991612,2cyclictest0-21swapper/33
150359799161,12cyclictest0-21swapper/33
150359799160,14cyclictest0-21swapper/33
150359799160,13cyclictest0-21swapper/33
150359799160,13cyclictest0-21swapper/33
150359799160,12cyclictest0-21swapper/33
19663262151,6sleep01966340-21ssh0
19394632151,3sleep01634048-21diskmemload0
19024332150,2sleep20-21swapper/22
18440342151,5sleep21844046-21diskmemload2
17373072151,2sleep00-21swapper/00
17017532151,11sleep11701764-21sh1
16223812151,5sleep21622433-21ld2
150359799151,2cyclictest0-21swapper/33
1503597991512,2cyclictest0-21swapper/33
1503597991512,1cyclictest0-21swapper/33
150359799150,13cyclictest0-21swapper/33
150359799150,13cyclictest0-21swapper/33
150359799150,12cyclictest0-21swapper/33
19575322140,9sleep11634048-21diskmemload1
19293172141,2sleep10-21swapper/11
18090212141,8sleep11634048-21diskmemload1
17741522140,1sleep2171rcu_preempt2
17662112141,2sleep10-21swapper/11
17023382141,3sleep01634048-21diskmemload0
16942862141,4sleep11694299-21ssh1
16942862141,4sleep11694299-21ssh1
1503597991413,1cyclictest0-21swapper/33
150359799140,12cyclictest0-21swapper/33
150359799140,12cyclictest0-21swapper/33
19036012131,9sleep10-21swapper/11
18225112130,8sleep11822575-21ntpq1
17360642130,5sleep11736077-21ssh1
17231392132,6sleep11724758-21grep1
16949862131,8sleep01695000-21ssh0
16949862131,8sleep01695000-21ssh0
16737882131,7sleep21673933-21netstat2
16604472131,9sleep00-21swapper/00
16510822131,8sleep21651097-21ssh2
15319652130,1sleep10-21swapper/11
150359799139,2cyclictest0-21swapper/33
150359799130,1cyclictest0-21swapper/33
19994982120,3sleep01999509-21ssh0
19987612121,5sleep20-21swapper/22
19562832121,7sleep21634048-21diskmemload2
19460452120,8sleep01946059-21ssh0
19389812121,2sleep21938993-21sh2
19129512121,2sleep10-21swapper/11
18964302125,4sleep11896442-21sh1
18964302125,4sleep11896442-21sh1
18840022121,5sleep11884058-21ntpq1
18699152121,7sleep01869929-21ssh0
18158582121,7sleep0802-21snmpd0
17902472121,6sleep11634048-21diskmemload1
17437672121,7sleep21743820-21ld2
17263152121,7sleep01726359-21ssh0
17112442121,2sleep00-21swapper/00
17109762121,7sleep21710985-21ssh2
16564632121,5sleep21656521-21ntpq2
15548052121,7sleep21556491-21tr2
15266912120,1sleep00-21swapper/00
19994152111,5sleep11634048-21diskmemload1
19624612111,4sleep20-21swapper/22
19384632111,6sleep11938473-21ssh1
19037352111,2sleep0171rcu_preempt0
18926992111,5sleep01892764-21ntpq0
18926992111,5sleep01892764-21ntpq0
18865062111,3sleep00-21swapper/00
18861332111,4sleep21634048-21diskmemload2
18768242111,4sleep00-21swapper/00
18611052111,4sleep21634048-21diskmemload2
18437762111,7sleep11843789-21ssh1
18414302111,4sleep00-21swapper/00
18335442111,4sleep20-21swapper/22
18271772111,5sleep01827439-21df0
18096282111,5sleep10-21swapper/11
18002942111,3sleep10-21swapper/11
18002942111,3sleep10-21swapper/11
17812172111,3sleep20-21swapper/22
17547102111,4sleep11634048-21diskmemload1
17539882110,2sleep00-21swapper/00
17503962111,6sleep21752125-21kthreadcore2
17442892111,5sleep11744517-21users1
17210702111,5sleep11634048-21diskmemload1
17010112111,5sleep21634048-21diskmemload2
16679402111,4sleep11634048-21diskmemload1
16673452111,4sleep20-21swapper/22
16510152111,5sleep11634048-21diskmemload1
16351842111,5sleep11635302-21irqstats1
16340392111,6sleep01634480-21latency_hist0
15962862110,2sleep20-21swapper/22
15611462114,3sleep21562966-21tr2
15540192111,5sleep11554038-21apt-get1
15380872111,5sleep11538342-21df1
15367572111,4sleep11536798-21ntpq1
15116102111,5sleep11511681-21irqstats1
19896682101,3sleep20-21swapper/22
19845212101,3sleep11634048-21diskmemload1
19832072101,4sleep11634048-21diskmemload1
19761072101,5sleep01976222-21perl0
19670562101,4sleep11634048-21diskmemload1
19648162101,3sleep11634048-21diskmemload1
19287992101,3sleep00-21swapper/00
19227712101,3sleep00-21swapper/00
19201942101,4sleep21634048-21diskmemload2
18938602101,2sleep20-21swapper/22
18938602101,2sleep20-21swapper/22
18769562101,3sleep11634048-21diskmemload1
18711772101,4sleep21871206-21apt-get2
18624552101,5sleep21862494-21grep2
18578092101,4sleep11857861-21ntpq1
18528582101,4sleep21634048-21diskmemload2
18500232101,3sleep11634048-21diskmemload1
18445172100,3sleep00-21swapper/00
18331702101,4sleep11634048-21diskmemload1
18257332101,4sleep00-21swapper/00
18247062101,4sleep21634048-21diskmemload2
18146702101,3sleep20-21swapper/22
17983432101,6sleep01798356-21rm0
17983432101,6sleep01798356-21rm0
17821792101,3sleep11634048-21diskmemload1
17745762101,4sleep01774605-21apt-get0
17700972101,4sleep01770160-21ntpq0
17479082100,2sleep00-21swapper/00
17362812101,2sleep20-21swapper/22
17285232101,3sleep20-21swapper/22
17206592101,3sleep00-21swapper/00
17189652101,4sleep21634048-21diskmemload2
17089202101,4sleep11708986-21ntp_states1
16871142101,3sleep20-21swapper/22
16871142101,3sleep20-21swapper/22
16835322101,2sleep00-21swapper/00
16779642101,4sleep01634048-21diskmemload0
16778252100,7sleep11634048-21diskmemload1
16586842101,3sleep11634048-21diskmemload1
16508472100,1sleep00-21swapper/00
16400542101,4sleep21634048-21diskmemload2
16114402101,5sleep01611494-21ntpq0
15954572101,4sleep01595511-21ntpq0
15478662101,4sleep21548083-21users2
15380652101,4sleep01538084-21apt-get0
15315042101,5sleep01531762-21grep0
15204842101,4sleep11520522-21ntpq1
15037802101,3sleep00-21swapper/00
1982714291,2sleep20-21swapper/22
1972992291,2sleep00-21swapper/00
1966654291,2sleep20-21swapper/22
1950960291,4sleep01952603-21grep0
1946625291,4sleep21946635-21ssh2
1928326291,2sleep20-21swapper/22
1914635291,2sleep10-21swapper/11
1912637291,2sleep00-21swapper/00
1911803290,2sleep20-21swapper/22
1866494291,4sleep11866617-21ntpq1
1806282290,1sleep00-21swapper/00
1761724291,3sleep21634048-21diskmemload2
1686134291,2sleep20-21swapper/22
1666200291,2sleep00-21swapper/00
1628364290,1sleep20-21swapper/22
1591638291,4sleep11591708-21fschecks_time1
1587828291,4sleep21589586-21cut2
1581726291,4sleep11583438-21cut1
1558214291,4sleep01558358-21mailstats0
1525888291,4sleep11525945-21/usr/sbin/munin1
1504054291,4sleep21504101-21fschecks_count2
1857659281,3sleep01857790-21ssh0
1800860281,2sleep20-21swapper/22
1602801281,3sleep11604503-21kthreadcore1
1602551281,3sleep01602800-21cut0
1597814281,3sleep21599549-21kthreadcore2
1586053280,5sleep01586071-21apt0
1580705281,3sleep00-21swapper/00
1579550280,1sleep10-21swapper/11
1574832280,1sleep00-21swapper/00
1570023280,3sleep21570042-21apt-get2
1564720281,3sleep11564875-21cstates1
1550549281,3sleep01552382-21cut0
1532163281,3sleep21532631-21base642
1633783270,1sleep10-21swapper/11
1624216271,3sleep10-21swapper/11
1623644270,2sleep00-21swapper/00
1623336270,1sleep10-21swapper/11
1617891270,1sleep10-21swapper/11
1612164270,1sleep20-21swapper/22
1601475270,1sleep00-21swapper/00
1596685270,2sleep10-21swapper/11
1575899271,2sleep21575953-21kthreadcore2
1575634271,3sleep00-21swapper/00
1574975270,1sleep10-21swapper/11
1564698270,2sleep00-21swapper/00
1564437271,3sleep01564461-21grep0
1543962271,2sleep01545383-21cut0
1537692270,1sleep00-21swapper/00
1527096270,2sleep20-21swapper/22
1521212270,1sleep20-21swapper/22
1511682271,2sleep20-21swapper/22
1630675261,2sleep20-21swapper/22
1618300260,4sleep00-21swapper/00
1612271260,4sleep10-21swapper/11
1607053260,4sleep20-21swapper/22
1590807260,1sleep10-21swapper/11
1566991261,2sleep20-21swapper/22
1559941261,2sleep10-21swapper/11
1553710260,4sleep20-21swapper/22
1552873261,2sleep10-21swapper/11
1538343261,2sleep20-21swapper/22
1520041261,2sleep00-21swapper/00
1509261261,2sleep00-21swapper/00
1508501260,4sleep10-21swapper/11
1613540250,2sleep00-21swapper/00
1612937250,1sleep20-21swapper/22
1583439250,1sleep20-21swapper/22
1545385250,1sleep10-21swapper/11
1525605250,1sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional