You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 14:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Tue May 12, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1788420212556,64sleep30-21swapper/33
212182721150,1sleep10-21swapper/11
178835428858,11sleep20-21swapper/22
178841328757,12sleep10-21swapper/11
178842727858,14sleep00-21swapper/00
22679062241,8sleep02267919-21sh0
178871099221,17cyclictest1959537-21taskset3
178871099216,1cyclictest0-21swapper/33
178871099216,12cyclictest2208555-21turbostat3
178871099211,16cyclictest0-21swapper/33
178871099201,15cyclictest0-21swapper/33
178871099201,15cyclictest0-21swapper/33
178871099201,15cyclictest0-21swapper/33
178871099201,15cyclictest0-21swapper/33
178871099201,14cyclictest66950irq/132-enp1s0-TxRx-33
178871099201,13cyclictest0-21swapper/33
178871099200,17cyclictest0-21swapper/33
178871099200,16cyclictest2036371-21chrt3
178871099200,16cyclictest1977771-21taskset3
21963272192,3sleep00-21swapper/00
21740492191,14sleep01919042-21diskmemload0
178871099199,6cyclictest0-21swapper/33
178871099191,14cyclictest66950irq/132-enp1s0-TxRx-33
178871099191,14cyclictest0-21swapper/33
1788710991910,6cyclictest20026912sleep33
20537242181,2sleep12053736-21rm1
1788710991815,2cyclictest0-21swapper/33
178871099181,4cyclictest0-21swapper/33
1788710991812,3cyclictest0-21swapper/33
1788710991811,5cyclictest66950irq/132-enp1s0-TxRx-33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,14cyclictest0-21swapper/33
178871099181,13cyclictest0-21swapper/33
178871099181,13cyclictest0-21swapper/33
178871099181,13cyclictest0-21swapper/33
178871099181,13cyclictest0-21swapper/33
178871099181,13cyclictest0-21swapper/33
178871099181,12cyclictest1913665-21taskset3
178871099180,15cyclictest0-21swapper/33
178871099180,15cyclictest0-21swapper/33
20612992170,3sleep10-21swapper/11
178871099177,6cyclictest1903042-21turbostat3
1788710991715,1cyclictest0-21swapper/33
1788710991713,2cyclictest0-21swapper/33
178871099171,14cyclictest0-21swapper/33
178871099171,14cyclictest0-21swapper/33
178871099171,13cyclictest0-21swapper/33
178871099171,13cyclictest0-21swapper/33
178871099171,13cyclictest0-21swapper/33
178871099170,14cyclictest0-21swapper/33
178871099170,14cyclictest0-21swapper/33
22570732161,4sleep21919042-21diskmemload2
22568222161,2sleep10-21swapper/11
22507752161,4sleep21919042-21diskmemload2
21912122161,2sleep20-21swapper/22
21448452162,8sleep02144901-21ntpq0
21062432161,2sleep00-21swapper/00
20700122160,1sleep10-21swapper/11
20627172161,2sleep00-21swapper/00
178871099160,13cyclictest0-21swapper/33
178871099160,13cyclictest0-21swapper/33
178871099160,13cyclictest0-21swapper/33
178871099160,12cyclictest0-21swapper/33
178871099160,12cyclictest0-21swapper/33
22753922150,2sleep00-21swapper/00
22667442151,4sleep11919042-21diskmemload1
20447522151,2sleep10-21swapper/11
20351972152,7sleep02035344-21/usr/sbin/munin0
19341902151,3sleep10-21swapper/11
19263272151,2sleep20-21swapper/22
18647862151,7sleep00-21swapper/00
18330452150,1sleep10-21swapper/11
178871099153,8cyclictest0-21swapper/33
178871099150,12cyclictest0-21swapper/33
178871099150,12cyclictest0-21swapper/33
178871099150,12cyclictest0-21swapper/33
178871099150,12cyclictest0-21swapper/33
22241542140,4sleep20-21swapper/22
21782922141,4sleep11919042-21diskmemload1
20903572141,8sleep10-21swapper/11
19695372141,4sleep11969548-21ssh1
19498422141,4sleep11949852-21ssh1
178871099141,11cyclictest0-21swapper/33
178871099140,13cyclictest0-21swapper/33
178871099140,11cyclictest0-21swapper/33
178871099140,10cyclictest0-21swapper/33
22737312130,4sleep12273748-21ssh1
22726262131,7sleep21919042-21diskmemload2
22601362131,8sleep22260162-21apt-get2
22490772131,8sleep01919042-21diskmemload0
22342742132,5sleep22234300-21apt-get2
22232072131,4sleep12223221-21ssh1
21898662131,6sleep00-21swapper/00
21892182131,2sleep10-21swapper/11
21829462131,3sleep02182960-21ssh0
21627662130,6sleep00-21swapper/00
21559252131,9sleep00-21swapper/00
21546442131,3sleep12154652-21ssh1
21127502131,3sleep02112762-21ssh0
21056342131,3sleep12105644-21ssh1
20884972131,3sleep22088511-21ssh2
20871432131,3sleep11919042-21diskmemload1
20700762131,8sleep22070088-21rm2
20033642131,8sleep22003374-21ssh2
20030822131,8sleep01919042-21diskmemload0
19855512131,8sleep21919042-21diskmemload2
19855512131,8sleep21919042-21diskmemload2
19520462131,2sleep2171rcu_preempt2
19423012131,2sleep10-21swapper/11
18227812131,7sleep11822701-31find1
18054992131,6sleep11805630-21ntpq1
178871099139,3cyclictest0-21swapper/33
1788710991310,1cyclictest0-21swapper/33
22413012121,7sleep12241312-21ssh1
22142722122,6sleep11919042-21diskmemload1
22080472120,2sleep22208052-21ssh2
22072662121,7sleep02207277-21ssh0
21983732121,6sleep11919042-21diskmemload1
20965012121,3sleep20-21swapper/22
20780782121,6sleep21919042-21diskmemload2
20476872122,5sleep22047711-21apt-get2
20265702121,5sleep12026631-21ntpq1
20124382121,6sleep01919042-21diskmemload0
19934522121,2sleep00-21swapper/00
19647512120,2sleep014-21ksoftirqd/00
19584832120,2sleep00-21swapper/00
18609542122,7sleep11861119-21grep1
18446882122,4sleep21844707-21apt-get2
178871099120,12cyclictest0-21swapper/33
22558992111,5sleep02255959-21ntpq0
22392452111,3sleep00-21swapper/00
22325912111,4sleep21919042-21diskmemload2
22318502111,6sleep02231861-21ssh0
22146462111,4sleep20-21swapper/22
22091222111,5sleep02209252-21diskstats0
21621082111,6sleep12162166-21ntpq1
21487812111,5sleep22148867-21munin-run2
21474442110,7sleep12147455-21ssh1
21388082111,3sleep20-21swapper/22
21383672110,1sleep10-21swapper/11
21279712110,7sleep02128077-21cut0
21278502111,5sleep22127910-21ntpq2
21232682111,4sleep21919042-21diskmemload2
21226502111,4sleep01919042-21diskmemload0
20806942111,5sleep11919042-21diskmemload1
20003342111,2sleep10-21swapper/11
19950422111,5sleep11919042-21diskmemload1
19936162113,4sleep21970133-21kworker/u16:3+xprtiod2
19851842111,3sleep00-21swapper/00
19851842111,3sleep00-21swapper/00
19604442111,3sleep10-21swapper/11
19434732111,7sleep21943481-21ssh2
19421952112,3sleep01919042-21diskmemload0
19321502111,5sleep01932216-21ntp_states0
19250342111,4sleep01919042-21diskmemload0
19136992111,5sleep11913747-21munin-run1
18873282112,4sleep11887347-21apt-get1
18819492111,4sleep11881968-21apt-get1
18705482111,1sleep20-21swapper/22
18501272111,5sleep11850298-21diskstats1
18398832110,3sleep11840551-21cut1
18393562111,5sleep21839611-21df2
18219912111,5sleep01822048-21ntp_states0
18164962111,5sleep01816585-21ntpq0
18110892111,6sleep01811209-21grep0
18045732111,7sleep00-21swapper/00
17967982111,2sleep20-21swapper/22
17933862111,5sleep21793603-21users2
22472192101,5sleep12247267-21ntpq1
22330882101,4sleep11919042-21diskmemload1
22253332101,4sleep01919042-21diskmemload0
21974902101,3sleep20-21swapper/22
21806982101,4sleep21919042-21diskmemload2
21738362101,3sleep20-21swapper/22
21660692101,4sleep12165940-21apt-get1
21635762101,2sleep20-21swapper/22
21544202101,4sleep21919042-21diskmemload2
21294822101,3sleep10-21swapper/11
20890452101,3sleep00-21swapper/00
20723902101,4sleep01919042-21diskmemload0
20614032101,4sleep20-21swapper/22
20534772101,6sleep02053487-21ssh0
20445692100,1sleep20-21swapper/22
20397582101,5sleep02041239-21cut0
20369832100,3sleep20-21swapper/22
20355912101,2sleep10-21swapper/11
20286072101,2sleep00-21swapper/00
20197822101,3sleep10-21swapper/11
20177822101,4sleep02017880-21ntpq0
20138582101,4sleep22013991-21diskstats2
20123992101,2sleep10-21swapper/11
19795252101,4sleep11979700-21diskstats1
19795252101,4sleep11979700-21diskstats1
19766182101,4sleep21919042-21diskmemload2
19763642101,2sleep10-21swapper/11
19686722101,4sleep21919042-21diskmemload2
19586532101,4sleep21919042-21diskmemload2
19502742101,4sleep01919042-21diskmemload0
19346412101,3sleep20-21swapper/22
19190272101,5sleep01919080-21unin-run0
19086352101,2sleep20-21swapper/22
19073302101,5sleep21907378-21ntpq2
19060942101,4sleep01907189-21memory0
18992242101,5sleep11900956-21kthreadcore1
18666282101,2sleep00-21swapper/00
18593572101,4sleep21859405-21ntpq2
18380542101,4sleep01838095-21ntpq0
18327952101,4sleep21832846-21ntpq2
18074792101,5sleep21808797-21cut2
18064522101,6sleep21806454-21modprobe2
2206129291,2sleep10-21swapper/11
2138354291,4sleep02138366-21ssh0
2112357291,3sleep21919042-21diskmemload2
2112256291,2sleep10-21swapper/11
2105736291,3sleep21919042-21diskmemload2
2095359291,3sleep01919042-21diskmemload0
2078763291,3sleep02078774-21ssh0
2026895290,5sleep22022297-21/usr/sbin/munin2
2012803291,2sleep20-21swapper/22
1970724291,3sleep01919042-21diskmemload0
1925856291,4sleep11925870-21ssh1
1880715291,3sleep21880763-21ntpq2
1871341291,2sleep00-21swapper/00
1861122291,4sleep21861233-21irqstats2
1850033291,4sleep01850123-21grep0
1796515291,4sleep01796725-21hddtemp_smartct0
1795738291,4sleep11794127-21munin-node1
1793653290,4sleep00-21swapper/00
1913981281,3sleep11914242-21df_inode1
1912749281,3sleep01912805-21ntpq0
1881971281,3sleep20-21swapper/22
1871922281,3sleep11873423-21ps1
1871081281,3sleep11-21systemd1
1823348280,3sleep11823367-21apt-get1
1813081281,3sleep11814027-21cut1
1918885270,1sleep20-21swapper/22
1908111270,1sleep10-21swapper/11
1903007270,1sleep20-21swapper/22
1898536271,3sleep01899222-21kthreadcore0
1893219271,2sleep00-21swapper/00
1857222270,3sleep01859019-21kthreadcore0
1854814270,1sleep20-21swapper/22
1849683270,1sleep10-21swapper/11
1828097270,1sleep20-21swapper/22
1827554271,3sleep00-21swapper/00
1817357270,1sleep20-21swapper/22
1811773270,1sleep10-21swapper/11
1894180261,2sleep11894746-21kthreadcore1
1888349261,2sleep20-21swapper/22
1885833260,1sleep00-21swapper/00
1876633260,2sleep10-21swapper/11
1871586260,1sleep20-21swapper/22
1849447260,1sleep00-21swapper/00
1843241260,2sleep00-21swapper/00
1834743261,2sleep10-21swapper/11
1833535260,1sleep00-21swapper/00
1818352261,2sleep20-21swapper/22
1896824250,1sleep20-21swapper/22
1891235250,2sleep00-21swapper/00
1859518250,2sleep10-21swapper/11
1836417250,1sleep20-21swapper/22
1793904250,1sleep10-21swapper/11
1876414240,1sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional