You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 18:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot3s.osadl.org (updated Sun Apr 12, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2073078212654,67sleep30-21swapper/33
207302328957,12sleep10-21swapper/11
207310228054,11sleep20-21swapper/22
207297927854,7sleep00-21swapper/00
24034362260,2sleep10-21swapper/11
21654012221,10sleep12165448-21ntpq1
2073328992212,6cyclictest23967242chrt3
207332899221,17cyclictest0-21swapper/33
2073328992211,6cyclictest0-21swapper/33
207332899221,16cyclictest0-21swapper/33
207332899217,1cyclictest66950irq/132-enp1s0-TxRx-33
2073328992017,2cyclictest0-21swapper/33
2073328992015,3cyclictest0-21swapper/33
207332899201,16cyclictest0-21swapper/33
207332899201,14cyclictest23507102chrt3
207332899200,1cyclictest0-21swapper/33
25537992191,3sleep12553813-21ssh1
23454832191,2sleep20-21swapper/22
207332899199,6cyclictest2256962-21turbostat3
207332899195,2cyclictest0-21swapper/33
2073328991917,1cyclictest0-21swapper/33
2073328991917,1cyclictest0-21swapper/33
2073328991915,2cyclictest0-21swapper/33
207332899191,15cyclictest2204243-21taskset3
207332899191,15cyclictest0-21swapper/33
207332899191,15cyclictest0-21swapper/33
207332899191,14cyclictest66950irq/132-enp1s0-TxRx-33
207332899191,14cyclictest66950irq/132-enp1s0-TxRx-33
207332899191,14cyclictest0-21swapper/33
207332899191,14cyclictest0-21swapper/33
207332899191,14cyclictest0-21swapper/33
207332899191,12cyclictest0-21swapper/33
25388472181,13sleep22538861-21ssh2
23626342181,5sleep02362674-21munin-run0
21347272181,5sleep12134985-21df_inode1
207332899187,6cyclictest2134454-21turbostat3
207332899181,5cyclictest0-21swapper/33
2073328991812,3cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,14cyclictest0-21swapper/33
207332899181,13cyclictest0-21swapper/33
207332899181,13cyclictest0-21swapper/33
207332899181,13cyclictest0-21swapper/33
207332899180,1cyclictest0-21swapper/33
207332899180,15cyclictest0-21swapper/33
207332899180,15cyclictest0-21swapper/33
207332899180,14cyclictest0-21swapper/33
24465482171,10sleep12446607-21ntpq1
2073328991714,1cyclictest0-21swapper/33
207332899171,14cyclictest0-21swapper/33
207332899171,14cyclictest0-21swapper/33
207332899171,14cyclictest0-21swapper/33
207332899171,14cyclictest0-21swapper/33
207332899171,13cyclictest0-21swapper/33
207332899171,13cyclictest0-21swapper/33
207332899171,13cyclictest0-21swapper/33
207332899171,12cyclictest0-21swapper/33
207332899170,14cyclictest0-21swapper/33
207332899170,14cyclictest0-21swapper/33
207332899170,13cyclictest0-21swapper/33
25563372165,7sleep02556348-21ssh0
25180662161,2sleep20-21swapper/22
23865902160,1sleep00-21swapper/00
23261222161,10sleep12204304-21diskmemload1
23013962161,2sleep00-21swapper/00
22032512161,7sleep12203309-21modprobe1
207332899169,4cyclictest21560162sleep33
2073328991613,1cyclictest0-21swapper/33
207332899160,13cyclictest0-21swapper/33
207332899160,13cyclictest0-21swapper/33
25727792150,1sleep10-21swapper/11
24217932150,1sleep20-21swapper/22
24208142151,3sleep12204304-21diskmemload1
23806102150,2sleep10-21swapper/11
22455202151,2sleep00-21swapper/00
22228802151,10sleep12224132-21grep1
21600962151,4sleep02160143-21ntpq0
207332899151,1cyclictest0-21swapper/33
207332899150,12cyclictest0-21swapper/33
207332899150,11cyclictest0-21swapper/33
25027222140,2sleep10-21swapper/11
24942622141,8sleep22204304-21diskmemload2
24749872141,9sleep02475001-21ssh0
24394942141,2sleep20-21swapper/22
24388032141,1sleep00-21swapper/00
23984862141,2sleep20-21swapper/22
23267192141,4sleep02326729-21ssh0
21075312140,8sleep12107480-31find1
207332899148,3cyclictest21821882sleep33
2073328991411,2cyclictest0-21swapper/33
207332899140,12cyclictest0-21swapper/33
207332899140,12cyclictest0-21swapper/33
25475752131,8sleep22547589-21ssh2
25292822131,8sleep22529296-21ssh2
25204452131,7sleep02204304-21diskmemload0
25054862131,8sleep22507039-21kthreadcore2
24852792131,5sleep20-21swapper/22
23759922131,6sleep12376046-21ntpq1
23684222131,8sleep12204304-21diskmemload1
23308752137,2sleep20-21swapper/22
22826182131,8sleep12282631-21ssh1
22184252137,2sleep12204304-21diskmemload1
21390942131,8sleep22139354-21sed2
21075402130,3sleep02107480-31find0
207332899131,9cyclictest2152859-21chrt3
207332899130,10cyclictest0-21swapper/33
207332899130,10cyclictest0-21swapper/33
25642992121,7sleep12564310-21ssh1
24488662121,3sleep02448878-21ssh0
24485332121,7sleep22448546-21ssh2
24398342121,5sleep10-21swapper/11
24325942121,7sleep12432599-21modprobe1
24318482121,5sleep20-21swapper/22
24309022120,3sleep02430916-21ssh0
24129082120,4sleep02412923-21ssh0
24129082120,4sleep02412923-21ssh0
24058102121,8sleep02405824-21sh0
23972612121,3sleep12397273-21ssh1
23760552120,8sleep22376107-21ntpq2
23292122122,5sleep12330873-21kthreadcore1
23166432121,3sleep22316658-21ssh2
23166432121,3sleep22316658-21ssh2
22988232120,5sleep10-21swapper/11
22986582121,7sleep02298672-21ssh0
22853412121,7sleep22287025-21grep2
22569342121,3sleep12204304-21diskmemload1
22550082120,7sleep22204304-21diskmemload2
22363782121,7sleep22236391-21sh2
21770842124,5sleep10-21swapper/11
21563102121,5sleep22156520-21hddtemp_smartct2
21334222121,5sleep12133465-21ntpq1
21240442121,7sleep12124108-21ls1
21230752121,7sleep02123084-21/usr/sbin/munin0
20957242121,5sleep22095865-21ntpq2
25658032111,5sleep02204304-21diskmemload0
25188942111,4sleep12204304-21diskmemload1
25045612110,3sleep02504572-21ssh0
25016292111,6sleep22501642-21ssh2
24587682111,5sleep10-21swapper/11
24564982112,4sleep22204304-21diskmemload2
24118722111,3sleep20-21swapper/22
24118722111,3sleep20-21swapper/22
24114882111,7sleep12411566-21find1
24114882111,7sleep12411566-21find1
23674262111,6sleep22367558-21rm2
23614902111,5sleep12204304-21diskmemload1
23428552111,5sleep12204304-21diskmemload1
23174432111,6sleep02317454-21ssh0
23174432111,6sleep02317454-21ssh0
22895052111,5sleep12204304-21diskmemload1
22656192111,3sleep10-21swapper/11
22652992111,3sleep00-21swapper/00
22569452111,6sleep22257227-21ssh2
22557022111,3sleep00-21swapper/00
22472642110,7sleep22247278-21ssh2
22448072111,3sleep10-21swapper/11
22365162111,6sleep12236527-21ssh1
22274352111,5sleep00-21swapper/00
22189972111,3sleep20-21swapper/22
22033102111,5sleep22203359-21ntpq2
21778992111,7sleep02178555-21kthreadcore0
21494312111,5sleep22149480-21ntpq2
21450762111,4sleep22145097-21munin-run2
21450152111,3sleep072-21kcompactd00
20974352111,5sleep02097644-21hddtemp_smartct0
20971662110,7sleep22097295-21tr2
25660362101,3sleep20-21swapper/22
25645192100,3sleep20-21swapper/22
25576762100,4sleep00-21swapper/00
25547882101,3sleep20-21swapper/22
25464942101,4sleep12204304-21diskmemload1
25379222101,4sleep12204304-21diskmemload1
25353682101,4sleep02535431-21ntp_states0
25222412101,4sleep12204304-21diskmemload1
25088972101,4sleep12508957-21ntpq1
24822052101,5sleep02482275-21ntpq0
24767952101,2sleep20-21swapper/22
24691312100,4sleep12468584-21apt-get1
24679282101,3sleep12204304-21diskmemload1
24652052101,2sleep00-21swapper/00
24613372101,5sleep22462963-21kthreadcore2
24222742101,2sleep00-21swapper/00
23971912101,2sleep00-21swapper/00
23955852101,3sleep20-21swapper/22
23542942101,4sleep22354557-21df2
23454502101,4sleep12345480-21apt-get1
23410402101,2sleep00-21swapper/00
23194082101,4sleep22204304-21diskmemload2
23104662101,4sleep12310488-21apt-get1
23104662101,4sleep12310488-21apt-get1
23067932101,3sleep12204304-21diskmemload1
22833952101,3sleep20-21swapper/22
22734082101,4sleep12204304-21diskmemload1
22711422101,4sleep22204304-21diskmemload2
22703112101,5sleep02270371-21ntpq0
22098932101,2sleep20-21swapper/22
22086722101,4sleep02204304-21diskmemload0
22046582101,4sleep12204304-21diskmemload1
21871682101,4sleep12187369-21users1
21706862101,4sleep12170734-21ntpq1
21547802101,4sleep22154829-21ntpq2
21347052101,4sleep02134726-21http0
21174762101,5sleep12117522-21ntpq1
21021812100,4sleep10-21swapper/11
2544203291,2sleep00-21swapper/00
2522175291,4sleep02522186-21ssh0
2501495290,2sleep00-21swapper/00
2491991290,1sleep00-21swapper/00
2491803291,2sleep12204304-21diskmemload1
2451380291,4sleep02451481-21ssh0
2385856291,2sleep20-21swapper/22
2367998290,1sleep00-21swapper/00
2350047291,2sleep00-21swapper/00
2344157291,4sleep22344170-21ssh2
2334325291,2sleep00-21swapper/00
2307067291,2sleep20-21swapper/22
2297614290,1sleep20-21swapper/22
2284332290,2sleep00-21swapper/00
2282965291,2sleep00-21swapper/00
2235991291,2sleep00-21swapper/00
2224133291,5sleep22225863-21tr2
2220849291,3sleep02220863-21ssh0
2193892291,3sleep22193911-21apt-get2
2182672291,3sleep22182691-21apt-get2
2124109291,4sleep22124311-21diskstats2
2112068291,4sleep02112116-21ntpq0
2081138291,4sleep12081307-21expr1
2079440291,4sleep02080903-21cut0
2077478291,4sleep22077572-21ld2
2482277281,3sleep12482330-21ssh1
2371760281,2sleep00-21swapper/00
2194169281,4sleep02194217-21fschecks_count0
2188275281,2sleep20-21swapper/22
2178559281,3sleep12180302-21kthreadcore1
2145885281,3sleep12146416-21cut1
2130317281,3sleep22132011-21cut2
2107993281,3sleep12108246-21df1
2199516270,3sleep02199730-21smartctl0
2198607270,2sleep10-21swapper/11
2193088270,1sleep00-21swapper/00
2187049271,3sleep02187167-21timerandwakeup0
2177029270,1sleep20-21swapper/22
2176904270,1sleep00-21swapper/00
2167235271,2sleep20-21swapper/22
2161339270,2sleep00-21swapper/00
2155522270,1sleep00-21swapper/00
2144946270,1sleep10-21swapper/11
2129074270,1sleep00-21swapper/00
2123679270,1sleep10-21swapper/11
2123587270,1sleep20-21swapper/22
2113394271,2sleep02113413-21apt-get0
2107547271,1sleep20-21swapper/22
2096682270,1sleep00-21swapper/00
2095976271,2sleep10-21swapper/11
2091423270,1sleep20-21swapper/22
2086486270,2sleep00-21swapper/00
2086477270,1sleep10-21swapper/11
2078539270,1sleep10-21swapper/11
2188601261,2sleep10-21swapper/11
2158183261,2sleep10-21swapper/11
2150692260,2sleep12150711-21apt-get1
2085509260,3sleep22085644-21timerwakeupswit2
2074964261,2sleep00-21swapper/00
2182304250,1sleep20-21swapper/22
2166953250,1sleep00-21swapper/00
2161505250,1sleep20-21swapper/22
2150357251,2sleep00-21swapper/00
2133857250,1sleep00-21swapper/00
2113560250,1sleep20-21swapper/22
2112781250,3sleep20-21swapper/22
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional