You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 17:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Fri Apr 03, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1470652212058,58sleep30-21swapper/33
147080328455,11sleep10-21swapper/11
147080727757,14sleep00-21swapper/00
147069027658,12sleep20-21swapper/22
1471136992723,2cyclictest0-21swapper/33
147113699231,17cyclictest1889592-21taskset3
19512302221,16sleep01601829-21diskmemload0
147113699221,8cyclictest1610817-21chrt3
1471136992211,8cyclictest0-21swapper/33
147113699211,16cyclictest1733841-21taskset3
147113699205,13cyclictest0-21swapper/33
1471136992011,6cyclictest1633777-21taskset3
1471136992011,6cyclictest0-21swapper/33
147113699201,15cyclictest0-21swapper/33
147113699201,15cyclictest0-21swapper/33
147113699191,15cyclictest0-21swapper/33
147113699191,15cyclictest0-21swapper/33
147113699191,15cyclictest0-21swapper/33
147113699191,15cyclictest0-21swapper/33
147113699191,15cyclictest0-21swapper/33
147113699191,14cyclictest1476581-21taskset3
147113699191,14cyclictest0-21swapper/33
147113699191,14cyclictest0-21swapper/33
147113699191,14cyclictest0-21swapper/33
147113699191,14cyclictest0-21swapper/33
147113699191,14cyclictest0-21swapper/33
147113699191,14cyclictest0-21swapper/33
147113699191,14cyclictest0-21swapper/33
147113699190,15cyclictest0-21swapper/33
18403172181,5sleep01840445-21irqstats0
147113699182,13cyclictest0-21swapper/33
1471136991814,2cyclictest0-21swapper/33
147113699181,3cyclictest16658032sleep33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,14cyclictest0-21swapper/33
147113699181,13cyclictest0-21swapper/33
147113699180,15cyclictest0-21swapper/33
19611392171,3sleep00-21swapper/00
17484082171,3sleep00-21swapper/00
16958002171,2sleep00-21swapper/00
16073042171,3sleep00-21swapper/00
147113699174,10cyclictest0-21swapper/33
1471136991713,2cyclictest0-21swapper/33
1471136991713,2cyclictest0-21swapper/33
1471136991712,3cyclictest0-21swapper/33
147113699171,13cyclictest1839703-21taskset3
147113699171,13cyclictest0-21swapper/33
147113699171,13cyclictest0-21swapper/33
147113699171,13cyclictest0-21swapper/33
147113699171,13cyclictest0-21swapper/33
147113699170,14cyclictest0-21swapper/33
147113699170,14cyclictest0-21swapper/33
147113699170,13cyclictest0-21swapper/33
147113699170,13cyclictest0-21swapper/33
147113699170,13cyclictest0-21swapper/33
19694242161,3sleep11601829-21diskmemload1
18736472161,7sleep21873659-21sh2
18615012161,10sleep21861559-21ntpq2
18039432160,3sleep10-21swapper/11
17743092161,5sleep11774529-21users1
16709812160,1sleep10-21swapper/11
16431612161,4sleep11601829-21diskmemload1
14958082161,11sleep01496858-21cut0
1471136991614,1cyclictest0-21swapper/33
147113699161,3cyclictest0-21swapper/33
147113699160,13cyclictest0-21swapper/33
147113699160,13cyclictest0-21swapper/33
19706562151,2sleep20-21swapper/22
19074442151,11sleep11601829-21diskmemload1
18716962151,2sleep00-21swapper/00
18616852151,4sleep11601829-21diskmemload1
18463382151,4sleep11601829-21diskmemload1
18277022151,10sleep11601829-21diskmemload1
18177012151,10sleep11601829-21diskmemload1
17662982150,3sleep00-21swapper/00
17232432151,4sleep01723254-21ssh0
17133072150,1sleep00-21swapper/00
16729892151,2sleep20-21swapper/22
16285292151,9sleep11628563-21ssh1
16090362151,2sleep10-21swapper/11
16008492152,9sleep01600901-21ldconfig0
147113699156,6cyclictest1564504-21turbostat3
147113699153,8cyclictest0-21swapper/33
147113699150,13cyclictest0-21swapper/33
147113699150,12cyclictest0-21swapper/33
147113699150,12cyclictest0-21swapper/33
19172802141,3sleep21601829-21diskmemload2
17681852141,6sleep10-21swapper/11
17670822141,8sleep21601829-21diskmemload2
16818972140,2sleep20-21swapper/22
16266552141,7sleep20-21swapper/22
15054672141,9sleep01505412-31find0
14904412141,2sleep10-21swapper/11
14904412141,2sleep10-21swapper/11
147113699140,11cyclictest0-21swapper/33
19534332131,5sleep20-21swapper/22
19511352131,8sleep11601829-21diskmemload1
19435572130,9sleep01943571-21ssh0
19425992131,3sleep11942610-21ssh1
19077412132,3sleep00-21swapper/00
19072072130,2sleep20-21swapper/22
18804412131,7sleep11601829-21diskmemload1
18280262131,6sleep21601829-21diskmemload2
17924952131,6sleep00-21swapper/00
17871292130,2sleep20-21swapper/22
17308052131,3sleep01730817-21ssh0
17146292131,8sleep11714639-21ssh1
17081922132,5sleep21708216-21apt-get2
16895302130,2sleep11601829-21diskmemload1
16508942131,6sleep21650955-21ntpq2
16360822131,8sleep21601829-21diskmemload2
1471136991310,1cyclictest0-21swapper/33
147113699130,2cyclictest0-21swapper/33
19629242121,6sleep00-21swapper/00
19446512121,7sleep21601829-21diskmemload2
19193452121,6sleep21919436-21grep2
18913382121,6sleep00-21swapper/00
18646462121,6sleep00-21swapper/00
18479262121,7sleep21847941-21ssh2
18351872121,6sleep11835246-21ntpq1
18125242121,6sleep11601829-21diskmemload1
18109562123,5sleep21810968-21rm2
17862772121,6sleep21601829-21diskmemload2
17753452121,3sleep21775359-21ssh2
17571022121,5sleep20-21swapper/22
17499012121,6sleep21601829-21diskmemload2
17332022121,7sleep11733215-21ssh1
16702842122,4sleep21601829-21diskmemload2
16531882121,5sleep00-21swapper/00
16508282121,7sleep11650893-21ld1
16450782121,7sleep01645092-21ssh0
16261202121,4sleep01626134-21ssh0
15599522121,7sleep11560048-21cut1
14836712122,7sleep1802-21snmpd1
19584302111,5sleep21958495-21ntpq2
19359332111,4sleep00-21swapper/00
19354812111,4sleep11601829-21diskmemload1
19262242111,3sleep10-21swapper/11
19160462111,7sleep11601829-21diskmemload1
18389042111,4sleep00-21swapper/00
18203052111,4sleep00-21swapper/00
17851932111,5sleep11601829-21diskmemload1
17741912111,7sleep01774308-21wc0
17588682111,3sleep10-21swapper/11
17071112111,5sleep21601829-21diskmemload2
16967662110,2sleep11696780-21ssh1
16904752112,4sleep21690499-21apt-get2
16701072111,4sleep00-21swapper/00
16610562111,4sleep11601829-21diskmemload1
16596902111,5sleep01659746-21ntpq0
16426732111,3sleep20-21swapper/22
16078802111,4sleep21601829-21diskmemload2
15970312111,5sleep11597155-21perl1
15647522112,4sleep01564771-21apt-get0
15535202112,6sleep0802-21snmpd0
15218722111,5sleep21521936-21sed2
15154102111,4sleep11515523-21ntpq1
14952632111,5sleep11495524-21df_inode1
19336722101,2sleep20-21swapper/22
19158372101,2sleep00-21swapper/00
18986142100,2sleep00-21swapper/00
18924142101,4sleep11892447-21apt-get1
18887592101,4sleep11601829-21diskmemload1
18806532101,4sleep21601829-21diskmemload2
18791192101,3sleep01601829-21diskmemload0
18560952101,2sleep10-21swapper/11
18537282101,2sleep20-21swapper/22
18212502101,6sleep21821263-21rm2
18100792101,3sleep00-21swapper/00
18016542100,2sleep00-21swapper/00
17959312101,4sleep21795955-21apt-get2
17933172101,4sleep11601829-21diskmemload1
17418202101,4sleep11601829-21diskmemload1
17347932101,3sleep00-21swapper/00
17262142100,1sleep20-21swapper/22
17231492100,1sleep10-21swapper/11
17223612101,3sleep20-21swapper/22
17059702100,1sleep00-21swapper/00
17056282101,4sleep11601829-21diskmemload1
16798062101,4sleep11601829-21diskmemload1
16793812101,2sleep00-21swapper/00
16554312101,3sleep20-21swapper/22
16350492101,3sleep00-21swapper/00
16224852101,6sleep11623774-21/usr/sbin/munin1
16192792100,1sleep00-21swapper/00
16175662100,1sleep20-21swapper/22
15957942101,5sleep21596000-21grep2
15754272101,4sleep11575446-21apt-get1
15751702101,5sleep01575192-21/usr/sbin/munin0
15635092101,4sleep21563558-21ntpq2
15272222101,5sleep01527293-21munin-run0
15055012100,4sleep11505412-31find1
14795912101,6sleep01481266-21grep0
14791662101,6sleep21479380-21basename2
14756202101,4sleep21475670-21ntpq2
1954184291,3sleep11954199-21apt-get1
1925351291,4sleep01925361-21ssh0
1872514291,3sleep11601829-21diskmemload1
1855333291,2sleep00-21swapper/00
1838418290,1sleep20-21swapper/22
1822188291,2sleep00-21swapper/00
1782564291,4sleep01782625-21ntpq0
1756098291,4sleep01756156-21ssh0
1750589291,3sleep11601829-21diskmemload1
1734380290,3sleep20-21swapper/22
1686613291,2sleep00-21swapper/00
1616427291,3sleep11601829-21diskmemload1
1600712291,4sleep21600795-21ntpq2
1591139291,4sleep1321rcuc/11
1584917291,5sleep01585000-21/usr/sbin/munin0
1581317291,4sleep21582159-21grep2
1571878291,4sleep11573677-21grep1
1551041291,4sleep11548815-21/usr/sbin/munin1
1538137291,3sleep21538156-21apt-get2
1529073291,4sleep01530856-21cut0
1526269291,3sleep11526322-21ntpq1
1510530290,1sleep20-21swapper/22
1506630291,5sleep01507828-21kthreadcore0
1504951291,4sleep21505120-21grep2
1488263291,4sleep21488320-21ntpq2
1892450280,3sleep21601829-21diskmemload2
1889075281,2sleep20-21swapper/22
1592326282,3sleep11594028-21kthreadcore1
1570391280,1sleep20-21swapper/22
1565773281,3sleep11567495-21cut1
1558025280,4sleep11558165-21ntp_192.168.1141
1554664281,3sleep21555192-21cat2
1549107281,3sleep21549321-21smartctl2
1533373281,3sleep21534387-21cut2
1527001280,2sleep272-21kcompactd02
1516803283,1sleep00-21swapper/00
1511459280,1sleep20-21swapper/22
1489867281,3sleep21489368-21apt-get2
1489867281,3sleep21489368-21apt-get2
1476405280,4sleep00-21swapper/00
1591422270,3sleep00-21swapper/00
1586070270,2sleep00-21swapper/00
1585453270,2sleep10-21swapper/11
1554396271,3sleep01554454-21cut0
1548479270,4sleep10-21swapper/11
1547553271,2sleep00-21swapper/00
1543058270,1sleep10-21swapper/11
1536927271,3sleep1321rcuc/11
1536873271,3sleep00-21swapper/00
1532256270,1sleep10-21swapper/11
1531450271,2sleep20-21swapper/22
1516341270,1sleep00-21swapper/00
1494833270,1sleep00-21swapper/00
1494833270,1sleep00-21swapper/00
1489097270,2sleep10-21swapper/11
1471506270,3sleep10-21swapper/11
1579509260,2sleep00-21swapper/00
1567496260,2sleep20-21swapper/22
1559738260,2sleep00-21swapper/00
1548242260,4sleep20-21swapper/22
1542946260,4sleep00-21swapper/00
1517375261,2sleep11517407-21kthreadcore1
1507832261,2sleep10-21swapper/11
1498645261,2sleep21499198-21/usr/sbin/munin2
1484410260,3sleep00-21swapper/00
1590845250,1sleep20-21swapper/22
1576202250,2sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional