You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 18:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Thu Dec 25, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
167713999577826,5748cyclictest1676772-21kworker/2:0+events19:11:282
167713299282511,2811cyclictest1668492-21kworker/0:0+events19:11:500
167713299258410,2570cyclictest1688427-21kworker/0:1+events19:55:130
167714299249712,2481cyclictest1733244-21kworker/3:1+events22:05:113
167713299248811,2473cyclictest1778197-21kworker/0:2+events00:25:180
167714299248612,2470cyclictest1781289-21kworker/3:2+events00:35:153
167713299247812,2463cyclictest1680290-21kworker/0:2+events19:25:510
167714299247211,2459cyclictest1694738-21kworker/3:1+events20:10:213
167713999243512,2419cyclictest1699954-21kworker/2:1+events20:30:132
167713999243512,2419cyclictest1699954-21kworker/2:1+events20:30:132
167714299239511,2380cyclictest1733244-21kworker/3:1+events22:13:353
167713799239112,2375cyclictest1708035-21kworker/1:1+events20:55:171
167714299238211,2368cyclictest1767173-21kworker/3:2+events23:58:353
167714299238112,2366cyclictest1685253-21kworker/3:0+events19:35:203
16771379923769,2363cyclictest1770320-21kworker/1:1+events00:01:591
167713799233111,2318cyclictest1779831-21kworker/1:2+events00:30:171
167713999230810,2295cyclictest1757605-21kworker/2:0+events23:19:112
16771399923079,2296cyclictest1763820-21kworker/2:2+events00:00:062
167713299230310,2290cyclictest1693442-21kworker/0:0+events20:03:540
167713299229510,2282cyclictest1750641-21kworker/0:2+events23:07:000
167713299227310,2261cyclictest1698029-21kworker/0:2+events20:45:030
167713299227310,2260cyclictest1750641-21kworker/0:2+events23:03:550
16771329922729,2259cyclictest1763878-21kworker/0:0+events23:42:070
167713299227110,2258cyclictest1774929-21kworker/0:0+events00:18:450
167713999226911,2256cyclictest1711001-21kworker/2:2+events21:10:062
167713299226811,2254cyclictest1750641-21kworker/0:2+events23:19:560
167713299226711,2253cyclictest1730317-21kworker/0:2+events21:59:530
16771329922668,2255cyclictest1693442-21kworker/0:0+events20:06:550
16771329922659,2253cyclictest1715533-21kworker/0:0+events21:22:360
167713299226511,2252cyclictest1738254-21kworker/0:0+events22:50:100
167713299226411,2250cyclictest1715533-21kworker/0:0+events21:36:200
167713299226211,2248cyclictest1765508-21kworker/0:2+events23:47:540
16771329922589,2246cyclictest1715533-21kworker/0:0+events21:31:260
167713999225411,2240cyclictest1720710-21kworker/2:3+events21:29:542
167713799223111,2217cyclictest1678336-21kworker/1:2+events19:15:171
167713799222811,2215cyclictest1712427-21kworker/1:0+events21:01:201
167713799222710,2214cyclictest1731856-21kworker/1:2+events22:07:301
167714299222511,2211cyclictest1699835-21kworker/3:1+events20:20:403
167713799222510,2211cyclictest1776499-21kworker/1:0+events00:25:401
167714299222211,2208cyclictest1706362-21kworker/3:2+events20:40:273
167714299222010,2206cyclictest1688640-21kworker/3:2+events19:50:133
167714299221711,2203cyclictest1778260-21kworker/3:1+events00:34:083
167713799221410,2200cyclictest1776499-21kworker/1:0+events00:22:381
167713799221311,2199cyclictest1742914-21kworker/1:0+events22:45:121
167713799221110,2199cyclictest1728452-21kworker/1:0+events22:00:161
167713799220410,2191cyclictest1768660-21kworker/1:2+events23:54:241
167713799220311,2189cyclictest1676278-21kworker/1:0+events19:21:001
167713299220211,2189cyclictest1725341-21kworker/0:2+events21:45:060
167713999219510,2182cyclictest1706059-21kworker/2:2+events20:42:012
16771379921918,2180cyclictest1723920-21kworker/1:0+events21:34:491
167714299217810,2164cyclictest1752562-21kworker/3:0+events23:12:173
167713299217211,2158cyclictest1701575-21kworker/0:1+events20:24:480
16771399921637,2153cyclictest1741337-21kworker/2:0+events22:30:012
167714299214911,2135cyclictest1704756-21kworker/3:1+events20:46:303
167713999214411,2129cyclictest1709373-21kworker/2:0+events20:51:252
16771399921407,2130cyclictest1763820-21kworker/2:2+events23:48:392
167714299213911,2125cyclictest1718763-21kworker/3:0+events21:30:403
16771329921387,2128cyclictest1778197-21kworker/0:2+events00:38:400
167713299213610,2123cyclictest1715533-21kworker/0:0+events21:10:510
167713999213310,2119cyclictest1741337-21kworker/2:0+events22:38:472
167714299212310,2109cyclictest1693115-21kworker/3:0+events19:57:523
16771329921149,2102cyclictest1773325-21kworker/0:1+events00:10:200
167713999211311,2099cyclictest1706059-21kworker/2:2+events20:37:032
167713299211313,2097cyclictest1683715-21kworker/0:1+events19:34:320
16771399921118,2100cyclictest1737612-21kworker/2:0+events22:17:432
167713999211110,2097cyclictest1773530-21kworker/2:2+events00:19:072
16771329921119,2099cyclictest1680290-21kworker/0:2+events19:20:130
167713299211110,2098cyclictest1742886-21kworker/0:1+events22:38:000
167713299211110,2097cyclictest1730317-21kworker/0:2+events22:13:580
167713299210710,2094cyclictest1757789-21kworker/0:0+events23:23:220
16771329921067,2096cyclictest1738254-21kworker/0:0+events22:33:030
16771329921064,2099cyclictest1698029-21kworker/0:2+events20:54:060
167713299210610,2093cyclictest1698029-21kworker/0:2+events20:59:490
16771399921055,2097cyclictest1744610-21kworker/2:1+events23:03:322
167713299210410,2091cyclictest1762234-21kworker/0:1+events23:38:370
16771329921038,2092cyclictest1715533-21kworker/0:0+events21:17:400
16771329921038,2092cyclictest1706210-21kworker/0:1+events20:42:250
16771329921026,2093cyclictest1750641-21kworker/0:2+events23:31:000
16771329921018,2090cyclictest1675001-21kworker/0:1+events19:19:280
167713299210110,2088cyclictest1778197-21kworker/0:2+events00:34:520
167713999210010,2087cyclictest1744610-21kworker/2:1+events22:43:422
167713299210010,2087cyclictest1754400-21kworker/0:0+events23:11:560
16771399920988,2087cyclictest1779684-21kworker/2:2+events00:30:402
167713299209810,2085cyclictest1698029-21kworker/0:2+events20:34:000
167713299209810,2085cyclictest1698029-21kworker/0:2+events20:34:000
167713799209711,2083cyclictest1728452-21kworker/1:0+events21:53:241
16771399920968,2085cyclictest1693320-21kworker/2:2+events20:28:152
167713999209610,2084cyclictest1711001-21kworker/2:2+events21:05:102
167713999209610,2083cyclictest1733422-21kworker/2:1+events22:09:452
167713999209510,2082cyclictest1735110-21kworker/2:2+events22:12:032
167713799209510,2082cyclictest1736382-21kworker/1:0+events22:16:361
167713299209510,2083cyclictest1712696-21kworker/0:1+events21:05:320
167713999209310,2080cyclictest1718973-21kworker/2:1+events21:41:432
16771329920896,2080cyclictest1701575-21kworker/0:1+events20:26:200
167714299208811,2074cyclictest1712396-21kworker/3:2+events20:58:423
167713299208510,2073cyclictest1768808-21kworker/0:0+events00:05:020
16771429920819,2067cyclictest1771815-21kworker/3:0+events00:06:323
167714299208111,2067cyclictest1759325-21kworker/3:1+events23:33:423
167714299208010,2067cyclictest1752562-21kworker/3:0+events23:02:453
16771329920807,2070cyclictest1750641-21kworker/0:2+events22:59:180
167713999207610,2063cyclictest1727282-21kworker/2:0+events21:57:152
167713999207510,2062cyclictest1763820-21kworker/2:2+events23:56:162
167713999207510,2062cyclictest1763820-21kworker/2:2+events23:41:212
16771329920756,2066cyclictest1776528-21kworker/0:1+events00:22:130
16771329920734,2066cyclictest1715533-21kworker/0:0+events21:26:040
167713299207310,2060cyclictest1698029-21kworker/0:2+events21:01:440
167713799207210,2059cyclictest1752806-21kworker/1:2+events23:15:401
16771329920729,2060cyclictest1738254-21kworker/0:0+events22:41:040
16771379920718,2060cyclictest1693203-21kworker/1:0+events19:59:231
16771379920715,2063cyclictest1712427-21kworker/1:0+events21:10:291
16771329920717,2061cyclictest1728683-21kworker/0:0+events22:01:480
167713299207010,2057cyclictest1696394-21kworker/0:1+events20:10:440
16771329920687,2058cyclictest1738254-21kworker/0:0+events22:48:170
16771329920679,2055cyclictest1727001-21kworker/0:1+events21:42:510
167713299206710,2054cyclictest1750641-21kworker/0:2+events23:27:590
16771329920669,2053cyclictest1768808-21kworker/0:0+events23:55:520
167713999206410,2051cyclictest1711001-21kworker/2:2+events20:59:262
16771329920649,2052cyclictest1690059-21kworker/0:0+events19:47:370
16771329920645,2056cyclictest1698029-21kworker/0:2+events20:16:040
16771399920587,2048cyclictest1762205-21kworker/2:0+events23:39:462
16771429920555,2047cyclictest1741397-21kworker/3:2+events22:40:413
167713999205310,2040cyclictest1693320-21kworker/2:2+events20:11:052
16771399920529,2040cyclictest1771930-21kworker/2:0+events00:07:172
167713999205210,2039cyclictest1739640-21kworker/2:1+events22:23:052
167713299205210,2039cyclictest1738254-21kworker/0:0+events22:21:080
167713299205110,2038cyclictest1680290-21kworker/0:2+events19:41:070
167713299204410,2031cyclictest1685657-21kworker/0:0+events19:38:250
16771329920414,2034cyclictest1691722-21kworker/0:2+events19:54:270
16771329920413,2035cyclictest1768808-21kworker/0:0+events00:02:440
16771329920409,2028cyclictest1730317-21kworker/0:2+events22:16:120
167713799203910,2026cyclictest1749370-21kworker/1:2+events22:54:001
167713799203710,2024cyclictest1698147-21kworker/1:2+events20:40:501
16771329920379,2025cyclictest1704545-21kworker/0:0+events20:36:160
16771399920368,2025cyclictest1751116-21kworker/2:2+events23:10:482
167713799203610,2023cyclictest1721159-21kworker/1:2+events21:47:431
167713799203610,2022cyclictest1742914-21kworker/1:0+events22:57:001
16771399920356,2026cyclictest1720710-21kworker/2:3+events21:35:332
16771399920348,2023cyclictest1681809-21kworker/2:1+events19:33:022
167713999203410,2021cyclictest1699954-21kworker/2:1+events20:19:542
16771399920339,2021cyclictest1706059-21kworker/2:2+events20:46:532
167713799203310,2020cyclictest1693203-21kworker/1:0+events20:10:001
167714299203211,2018cyclictest1686978-21kworker/3:1+events19:42:403
16771399920329,2019cyclictest1778078-21kworker/2:1+events00:26:052
16771379920325,2024cyclictest1708035-21kworker/1:1+events20:48:001
16771379920324,2024cyclictest1693203-21kworker/1:0+events20:14:091
167714299203110,2019cyclictest1678426-21kworker/3:1+events19:25:063
16771379920319,2019cyclictest1691569-21kworker/1:1+events19:52:081
16771379920316,2021cyclictest1741307-21kworker/1:1+events22:33:261
167713799203110,2018cyclictest1719035-21kworker/1:1+events21:25:181
167713799203110,2018cyclictest1703001-21kworker/1:1+events20:29:261
167714299203010,2017cyclictest1756063-21kworker/3:2+events23:28:203
167714299203010,2017cyclictest1723980-21kworker/3:2+events21:48:053
167714299203010,2016cyclictest1756063-21kworker/3:2+events23:41:433
16771399920303,2023cyclictest1693320-21kworker/2:2+events20:00:322
16771379920309,2017cyclictest1781531-21kworker/1:1+events00:37:561
16771379920303,2024cyclictest1708035-21kworker/1:1+events20:51:031
167714299202910,2016cyclictest1730286-21kworker/3:0+events22:03:403
16771399920298,2018cyclictest1781351-21kworker/2:0+events00:36:012
16771379920298,2017cyclictest1750966-21kworker/1:1+events23:01:121
167714299202810,2015cyclictest1763907-21kworker/3:0+events23:45:123
16771379920286,2019cyclictest1742914-21kworker/1:0+events22:39:101
16771429920278,2016cyclictest1701515-21kworker/3:2+events20:28:403
16771429920278,2016cyclictest1694738-21kworker/3:1+events20:08:053
16771429920278,2015cyclictest1739762-21kworker/3:1+events22:25:213
167714299202710,2014cyclictest1738135-21kworker/3:0+events22:24:593
16771399920279,2015cyclictest1681809-21kworker/2:1+events19:56:212
16771379920276,2018cyclictest1719035-21kworker/1:1+events21:23:001
16771329920279,2015cyclictest1728683-21kworker/0:0+events21:54:120
16771429920268,2015cyclictest1767173-21kworker/3:2+events00:21:283
167713999202610,2013cyclictest1735110-21kworker/2:2+events22:31:082
16771379920269,2014cyclictest1685516-21kworker/1:0+events19:44:591
167713799202610,2013cyclictest1762488-21kworker/1:0+events23:36:211
167713799202610,2013cyclictest1736382-21kworker/1:0+events22:26:551
16771429920258,2014cyclictest1696334-21kworker/3:2+events20:16:283
16771429920258,2013cyclictest1767173-21kworker/3:2+events23:50:113
167714299202510,2012cyclictest1744279-21kworker/3:1+events22:38:233
167714299202510,2012cyclictest1741397-21kworker/3:2+events22:32:403
167714299202510,2012cyclictest1738135-21kworker/3:0+events22:19:153
167714299202510,2012cyclictest1723980-21kworker/3:2+events21:35:563
16771379920258,2013cyclictest1767052-21kworker/1:0+events23:58:121
167713799202511,2011cyclictest1698147-21kworker/1:2+events20:15:191
167713799202510,2011cyclictest1693203-21kworker/1:0+events20:20:161
167714299202410,2011cyclictest1741397-21kworker/3:2+events22:55:543
16771379920248,2013cyclictest1708035-21kworker/1:1+events21:08:581
16771379920244,2017cyclictest1752806-21kworker/1:2+events23:28:431
167713799202410,2011cyclictest1752806-21kworker/1:2+events23:23:001
167713799202410,2011cyclictest1721159-21kworker/1:2+events21:42:301
167713799202410,2011cyclictest1682003-21kworker/1:2+events19:27:231
16771429920239,2011cyclictest1745887-21kworker/3:0+events22:45:573
16771429920238,2012cyclictest1693115-21kworker/3:0+events20:00:543
167714299202310,2010cyclictest1723980-21kworker/3:2+events21:55:433
16771379920238,2012cyclictest1685516-21kworker/1:0+events19:47:581
16771429920228,2011cyclictest1718763-21kworker/3:0+events21:17:193
167714299202210,2010cyclictest1745887-21kworker/3:0+events22:50:573
16771429920219,2009cyclictest1778260-21kworker/3:1+events00:26:253
167714299202110,2009cyclictest1704756-21kworker/3:1+events20:35:083
167714299202110,2008cyclictest1756063-21kworker/3:2+events23:24:083
167714299202110,2008cyclictest1709816-21kworker/3:0+events20:53:433
167714299202110,2008cyclictest1704756-21kworker/3:1+events21:00:123
16771429920209,2008cyclictest1767173-21kworker/3:2+events00:01:353
167714299202010,2007cyclictest1773501-21kworker/3:1+events00:10:433
167714299202010,2007cyclictest1718763-21kworker/3:0+events21:22:153
167714299201910,2006cyclictest1756063-21kworker/3:2+events23:39:003
16771429920188,2007cyclictest1723980-21kworker/3:2+events21:52:163
167714299201810,2006cyclictest1685253-21kworker/3:0+events19:33:473
16771379920169,2003cyclictest1752806-21kworker/1:2+events23:05:521
16771379920167,2006cyclictest1752806-21kworker/1:2+events23:40:331
16771429920159,2003cyclictest1725764-21kworker/3:0+events21:44:433
16771379920157,2005cyclictest1771962-21kworker/1:2+events00:06:091
167713799201210,1999cyclictest1676278-21kworker/1:0+events19:12:121
16771379920119,1999cyclictest1752806-21kworker/1:2+events23:32:081
16771379920098,1998cyclictest1736382-21kworker/1:0+events22:13:111
16771429920087,1998cyclictest1776560-21kworker/3:0+events00:17:573
16771399920059,1993cyclictest1681809-21kworker/2:1+events19:22:292
167713999200410,1991cyclictest1691629-21kworker/2:0+events19:52:322
16771329920029,1990cyclictest1765508-21kworker/0:2+events23:50:580
16771329920027,1992cyclictest1738254-21kworker/0:0+events22:27:410
167713799199810,1985cyclictest1771962-21kworker/1:2+events00:13:251
16771379919867,1976cyclictest1767052-21kworker/1:0+events23:47:301
16771429919846,1975cyclictest1754429-21kworker/3:1+events23:09:403
16771379919778,1967cyclictest1691569-21kworker/1:1+events20:00:071
167713999197410,1962cyclictest1747682-21kworker/2:0+events22:55:072
16771329919736,1964cyclictest1730317-21kworker/0:2+events22:09:000
167713999197210,1959cyclictest1727282-21kworker/2:0+events21:50:212
167714299197110,1958cyclictest1685253-21kworker/3:0+events19:47:123
16771379919677,1956cyclictest1752806-21kworker/1:2+events23:10:251
16771379919668,1955cyclictest1739670-21kworker/1:2+events22:23:511
16771379919667,1956cyclictest1698147-21kworker/1:2+events20:30:341
16771379919667,1956cyclictest1698147-21kworker/1:2+events20:30:341
16771379919648,1953cyclictest1712427-21kworker/1:0+events21:19:571
167713799196410,1951cyclictest1744547-21kworker/1:2+events22:43:201
16771429919634,1956cyclictest1722286-21kworker/3:1+events21:29:083
16771399919629,1950cyclictest1681809-21kworker/2:1+events19:45:422
16771379919627,1952cyclictest1685516-21kworker/1:0+events19:37:371
167713799196210,1949cyclictest1698147-21kworker/1:2+events20:39:211
16771379919618,1950cyclictest1723920-21kworker/1:0+events21:37:281
16771379919614,1954cyclictest1683624-21kworker/1:1+events19:31:551
16771399919589,1946cyclictest1720710-21kworker/2:3+events21:46:362
16771429919562,1951cyclictest1680529-21kworker/3:0+events19:23:383
16771379919562,1951cyclictest1728452-21kworker/1:0+events21:58:451
16771429919549,1943cyclictest1701515-21kworker/3:2+events20:30:563
16771429919549,1943cyclictest1701515-21kworker/3:2+events20:30:553
16771429919539,1941cyclictest1678426-21kworker/3:1+events19:19:503
167714299195310,1940cyclictest1757667-21kworker/3:0+events23:19:323
16771399919527,1941cyclictest1718973-21kworker/2:1+events21:20:202
16771429919508,1939cyclictest1715683-21kworker/3:2+events21:09:193
16771399919509,1938cyclictest1773530-21kworker/2:2+events00:14:102
16771399919506,1941cyclictest1712663-21kworker/2:0+events21:02:522
16771399919496,1940cyclictest1711001-21kworker/2:2+events21:19:122
16771399919486,1939cyclictest1720710-21kworker/2:3+events21:31:482
16771399919479,1935cyclictest1754070-21kworker/2:0+events23:06:152
167713999194510,1932cyclictest1727282-21kworker/2:0+events22:03:192
16771399919399,1927cyclictest1778078-21kworker/2:1+events00:21:512
16771399919398,1928cyclictest1755885-21kworker/2:1+events23:23:452
16771399919378,1926cyclictest1693320-21kworker/2:2+events20:23:382
167713999193710,1924cyclictest1676772-21kworker/2:0+events19:15:392
167713999192810,1915cyclictest1683595-21kworker/2:0+events19:29:152
16771399919189,1906cyclictest1681809-21kworker/2:1+events19:36:532
16771429919177,1907cyclictest1704756-21kworker/3:1+events21:12:003
167713999190010,1887cyclictest1755885-21kworker/2:1+events23:30:382
16771429918887,1878cyclictest1676627-21kworker/3:2+events19:13:233
16771379918879,1875cyclictest1771962-21kworker/1:2+events00:16:011
167713999188210,1869cyclictest1695113-21kworker/2:1+events20:05:472
16771399918789,1866cyclictest1744610-21kworker/2:1+events22:48:392
16771399918787,1869cyclictest1683595-21kworker/2:0+events19:40:442
16771399918543,1848cyclictest1759294-21kworker/2:2+events23:25:182
16769012152109,23sleep10-21swapper/119:09:551
16768732149105,25sleep30-21swapper/319:09:333
16768702145111,28sleep00-21swapper/019:09:290
16766682139104,29sleep20-21swapper/219:06:562
167713999170,15cyclictest1768901-21cron23:55:002
167713999156,5cyclictest1748304-21apt-get22:50:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional