You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 09:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot3s.osadl.org (updated Sun May 17, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
206804121590,2sleep00-21swapper/00
1934440212462,57sleep30-21swapper/33
218989121180,1sleep20-21swapper/22
193430128454,12sleep10-21swapper/11
193431127954,11sleep20-21swapper/22
193432927354,13sleep00-21swapper/00
23831812281,14sleep22065498-21diskmemload2
1934834992212,7cyclictest2299666-21taskset3
1934834992212,7cyclictest2299666-21taskset3
193483499212,14cyclictest0-21swapper/33
193483499211,17cyclictest0-21swapper/33
193483499211,15cyclictest66950irq/132-enp1s0-TxRx-33
193483499201,16cyclictest0-21swapper/33
193483499200,2cyclictest23395432sleep33
193483499200,16cyclictest2164681-21taskset3
19734042191,6sleep01973445-21ntpq0
193483499192,13cyclictest66950irq/132-enp1s0-TxRx-33
1934834991916,1cyclictest0-21swapper/33
1934834991916,1cyclictest0-21swapper/33
193483499191,2cyclictest0-21swapper/33
193483499191,16cyclictest0-21swapper/33
193483499191,15cyclictest2200278-21taskset3
193483499191,15cyclictest0-21swapper/33
193483499191,14cyclictest2315855-21taskset3
193483499191,14cyclictest0-21swapper/33
193483499191,14cyclictest0-21swapper/33
193483499191,12cyclictest0-21swapper/33
193483499190,13cyclictest0-21swapper/33
21961662181,5sleep02196224-21ntpq0
21468692181,3sleep10-21swapper/11
19637542181,6sleep11963791-21awk1
193483499188,7cyclictest2017307-21taskset3
1934834991815,2cyclictest0-21swapper/33
193483499181,4cyclictest2266206-21taskset3
1934834991812,3cyclictest0-21swapper/33
193483499181,14cyclictest66950irq/132-enp1s0-TxRx-33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,14cyclictest0-21swapper/33
193483499181,13cyclictest0-21swapper/33
193483499180,2cyclictest0-21swapper/33
193483499180,16cyclictest0-21swapper/33
193483499180,15cyclictest0-21swapper/33
193483499180,15cyclictest0-21swapper/33
193483499180,14cyclictest20724162sleep33
23229542171,3sleep20-21swapper/22
22479982171,3sleep20-21swapper/22
21744462171,12sleep22174461-21ssh2
193483499171,13cyclictest0-21swapper/33
193483499171,13cyclictest0-21swapper/33
193483499171,13cyclictest0-21swapper/33
193483499171,12cyclictest0-21swapper/33
193483499170,14cyclictest0-21swapper/33
193483499170,14cyclictest0-21swapper/33
193483499170,13cyclictest0-21swapper/33
23998672161,4sleep12065498-21diskmemload1
23980012161,3sleep02398099-21ps0
23915482161,4sleep22391562-21ssh2
22748752161,5sleep02065498-21diskmemload0
22296632161,10sleep02229718-21ntpq0
21312232161,4sleep22065498-21diskmemload2
20497542162,4sleep22049773-21apt-get2
1934834991613,1cyclictest0-21swapper/33
193483499161,13cyclictest0-21swapper/33
193483499161,13cyclictest0-21swapper/33
193483499160,13cyclictest0-21swapper/33
193483499160,13cyclictest0-21swapper/33
193483499160,13cyclictest0-21swapper/33
193483499160,12cyclictest0-21swapper/33
23140502151,9sleep12314305-21users1
22578852150,2sleep10-21swapper/11
22202932150,2sleep10-21swapper/11
21060522151,2sleep10-21swapper/11
20644872151,9sleep12064536-21ntpq1
20444732151,2sleep10-21swapper/11
20338672151,3sleep02033885-21apt-get0
193483499157,5cyclictest2065491-21turbostat3
193483499151,3cyclictest0-21swapper/33
193483499150,13cyclictest0-21swapper/33
193483499150,13cyclictest0-21swapper/33
193483499150,12cyclictest0-21swapper/33
193483499150,12cyclictest0-21swapper/33
193483499150,12cyclictest0-21swapper/33
193483499150,12cyclictest0-21swapper/33
23735252140,7sleep20-21swapper/22
23410092141,3sleep12065498-21diskmemload1
23327762148,1sleep00-21swapper/00
22930052140,2sleep2421rcuc/22
22930052140,2sleep2421rcuc/22
21838562141,6sleep12184074-21hddtemp_smartct1
21155912141,3sleep22065498-21diskmemload2
20879472141,2sleep22065498-21diskmemload2
19480522141,9sleep01948233-21ls0
193483499148,3cyclictest19914922sleep33
193483499141,10cyclictest1980025-21taskset3
193483499140,12cyclictest0-21swapper/33
193483499140,11cyclictest0-21swapper/33
23736922131,7sleep02065498-21diskmemload0
23563262131,8sleep22356328-21ssh2
23116082130,2sleep0221rcuc/00
23014022131,8sleep22301514-21/usr/sbin/munin2
22821102131,3sleep12282122-21ssh1
22724612131,6sleep12065498-21diskmemload1
22058402131,7sleep22065498-21diskmemload2
21159702131,3sleep02115980-21ssh0
21073652131,2sleep20-21swapper/22
20961952131,7sleep22065498-21diskmemload2
20598132130,1sleep00-21swapper/00
20234722131,8sleep12023682-21hddtemp_smartct1
193483499130,10cyclictest0-21swapper/33
24146082121,7sleep12414657-21ssh1
23850682121,7sleep12385074-21sh1
23818662120,3sleep12381880-21ssh1
23135522121,4sleep20-21swapper/22
22970002121,5sleep12297060-21ntpq1
22970002121,5sleep12297060-21ntpq1
22823142121,7sleep22282328-21ssh2
22639302120,5sleep12263940-21ssh1
22500022121,6sleep12065498-21diskmemload1
22326462121,2sleep20-21swapper/22
22139482121,7sleep12065498-21diskmemload1
21742962121,5sleep00-21swapper/00
21731192121,6sleep12065498-21diskmemload1
21659212121,7sleep10-21swapper/11
21559392121,3sleep02065498-21diskmemload0
21382752121,7sleep22138289-21ssh2
20556562124,4sleep12057031-21cat1
20016292121,6sleep12001870-21df_inode1
24108232111,6sleep02410474-21/usr/sbin/munin0
24024592111,3sleep20-21swapper/22
23936752111,6sleep22393910-21expr2
23685262111,6sleep12368690-21ssh1
23408802110,5sleep20-21swapper/22
23290542111,5sleep22330077-21memory2
23239542111,5sleep10-21swapper/11
22896312111,2sleep20-21swapper/22
22844942111,5sleep12284518-21apt-get1
22665872110,3sleep02266598-21ssh0
22335842111,3sleep10-21swapper/11
22087102111,5sleep02208983-21df_inode0
22063822110,7sleep12065498-21diskmemload1
21822472111,2sleep20-21swapper/22
21638312111,6sleep02065498-21diskmemload0
21585062111,4sleep22158527-21apt-get2
21250942111,4sleep12125315-21hddtemp_smartct1
21247432115,3sleep02065498-21diskmemload0
21228132111,6sleep02122829-21sshd0
21206932111,5sleep12120753-21ntpq1
20801172111,5sleep22065498-21diskmemload2
20799102111,4sleep02065498-21diskmemload0
20716992113,4sleep22059806-21kworker/u16:0+xprtiod2
20396462111,5sleep22039737-21irqstats2
19917762111,6sleep01993462-21grep0
19693632111,5sleep11969624-21df_inode1
24176422100,5sleep20-21swapper/22
24086152101,4sleep02065498-21diskmemload0
23839322101,4sleep02065498-21diskmemload0
23678072101,4sleep12065498-21diskmemload1
23640882101,5sleep02364139-21ntpq0
23598562101,2sleep20-21swapper/22
23577832101,6sleep12357794-21ssh1
23564822101,2sleep00-21swapper/00
23475892101,4sleep22065498-21diskmemload2
23430892101,5sleep12343238-21tail1
23413402101,4sleep02065498-21diskmemload0
23316162100,3sleep10-21swapper/11
23223272101,5sleep02322573-21grep0
23078712101,4sleep02065498-21diskmemload0
23077472101,5sleep12065498-21diskmemload1
22988832101,4sleep02065498-21diskmemload0
22988832101,4sleep02065498-21diskmemload0
22804392101,6sleep02065498-21diskmemload0
22734812101,3sleep22065498-21diskmemload2
22660872101,4sleep22065498-21diskmemload2
22505842101,5sleep22250596-21ssh2
22473192101,3sleep02065498-21diskmemload0
22219172101,2sleep20-21swapper/22
22138652101,3sleep20-21swapper/22
22064712101,4sleep02065498-21diskmemload0
21988322101,3sleep10-21swapper/11
21979052101,3sleep20-21swapper/22
21878022101,4sleep00-21swapper/00
21813212101,4sleep00-21swapper/00
21564802101,3sleep20-21swapper/22
21474992101,3sleep20-21swapper/22
21469602101,3sleep02065498-21diskmemload0
21407632101,3sleep10-21swapper/11
21383022101,4sleep02065498-21diskmemload0
21088102101,5sleep12108847-21kthreadcore1
20982582101,3sleep10-21swapper/11
20963082101,4sleep02065498-21diskmemload0
20885982101,4sleep12065498-21diskmemload1
20884482101,3sleep00-21swapper/00
20809252100,4sleep10-21swapper/11
20716402100,2sleep10-21swapper/11
20408952101,6sleep02042691-21cut0
20109542101,4sleep02011005-21ntpq0
19860682100,1sleep00-21swapper/00
19628112102,3sleep21962865-21ntpq2
2406344291,4sleep12406401-21ssh1
2391742291,4sleep02391753-21ssh0
2349938291,4sleep02349949-21ssh0
2290211290,1sleep00-21swapper/00
2254917291,4sleep02254985-21ntpq0
2239556291,2sleep20-21swapper/22
2238162291,4sleep190-21kswapd01
2233984291,3sleep02234010-21apt-get0
2222715291,2sleep00-21swapper/00
2182141290,1sleep10-21swapper/11
2155102291,2sleep10-21swapper/11
2116774290,1sleep20-21swapper/22
2105035291,2sleep00-21swapper/00
2057032291,4sleep22058862-21cut2
2045795291,4sleep22047531-21cut2
2039457291,4sleep12039641-21grep1
2025084291,4sleep02026893-21tr0
2017574290,3sleep20-21swapper/22
2006544290,2sleep072-21kcompactd00
1980290291,2sleep20-21swapper/22
1954693291,4sleep11956448-21grep1
1953359291,2sleep00-21swapper/00
1940322291,4sleep21941840-21cut2
1938871290,5sleep11939052-21cut1
2029081281,3sleep02030164-21cat0
2011632280,1sleep10-21swapper/11
1996144280,1sleep10-21swapper/11
1984664280,1sleep00-21swapper/00
1974944280,3sleep21974963-21apt-get2
1958425281,3sleep2255-21systemd-journal2
2060920271,2sleep02061042-21kthreadcore0
2054509270,1sleep00-21swapper/00
2049374270,1sleep00-21swapper/00
2031958271,3sleep20-21swapper/22
2023182270,2sleep20-21swapper/22
2022307270,1sleep10-21swapper/11
2021948271,3sleep00-21swapper/00
2013156270,4sleep12014850-21cut1
2012250270,2sleep00-21swapper/00
1997060270,4sleep01998353-21kthreadcore0
1964013270,2sleep00-21swapper/00
1948027270,1sleep10-21swapper/11
1947454270,1sleep00-21swapper/00
1934977270,2sleep20-21swapper/22
2054692260,1sleep10-21swapper/11
2030165260,2sleep10-21swapper/11
2016985260,1sleep20-21swapper/22
2011063260,2sleep22011154-21ps2
2001161262,1sleep20-21swapper/22
1995810260,2sleep10-21swapper/11
1987324261,2sleep20-21swapper/22
1985637260,3sleep10-21swapper/11
1985309260,1sleep10-21swapper/11
1974914260,2sleep10-21swapper/11
1968885260,1sleep20-21swapper/22
1968073260,2sleep10-21swapper/11
1963424260,1sleep00-21swapper/00
1952967260,1sleep20-21swapper/22
1942692260,1sleep10-21swapper/11
2064538250,1sleep20-21swapper/22
2038674250,3sleep10-21swapper/11
2034147250,1sleep20-21swapper/22
2005942250,1sleep20-21swapper/22
1995708250,3sleep20-21swapper/22
1977837250,1sleep00-21swapper/00
1972725250,1sleep20-21swapper/22
1939167250,2sleep00-21swapper/00
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional