You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 22:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Sun Nov 23, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32675599265913,2642cyclictest347670-21kworker/1:0+events20:25:011
32675599253212,2516cyclictest358753-21kworker/1:1+events20:55:141
32676399249613,2480cyclictest365374-21kworker/3:0+events21:10:143
32675599248310,2469cyclictest403812-21kworker/1:1+events23:11:021
32675399247812,2462cyclictest429926-21kworker/0:2+events00:30:140
32676399247612,2460cyclictest402102-21kworker/3:2+events23:05:183
32675999244611,2432cyclictest418691-21kworker/2:0+events23:55:152
32676399239112,2376cyclictest352739-21kworker/3:2+events20:47:523
32675399229611,2282cyclictest381383-21kworker/0:0+events22:00:220
32675999228111,2267cyclictest330199-21kworker/2:1+events19:36:432
32675599227711,2262cyclictest409024-21kworker/1:0+events23:29:411
32675599227511,2260cyclictest415163-21kworker/1:0+events23:45:191
32675599227410,2260cyclictest347670-21kworker/1:0+events20:28:461
32675599227111,2257cyclictest372443-21kworker/1:1+events21:36:441
32675599227011,2256cyclictest393966-21kworker/1:2+events22:46:131
3267559922679,2255cyclictest409024-21kworker/1:0+events23:34:151
32675599226611,2252cyclictest423837-21kworker/1:2+events00:13:301
32675599226110,2248cyclictest421947-21kworker/1:0+events00:04:221
3267539922619,2249cyclictest387396-21kworker/0:0+events22:22:560
32675599225211,2238cyclictest384433-21kworker/1:0+events22:21:241
32675999223512,2220cyclictest357423-21kworker/2:2+events20:49:022
3267559922349,2222cyclictest377938-21kworker/1:2+events21:51:141
32675599223410,2221cyclictest347670-21kworker/1:0+events20:48:391
32675999222810,2216cyclictest400066-21kworker/2:2+events23:10:392
32675999222711,2213cyclictest330199-21kworker/2:1+events19:31:222
32675999222611,2212cyclictest371599-21kworker/2:1+events21:28:532
32675999222110,2208cyclictest426748-21kworker/2:1+events00:21:542
32675999221910,2206cyclictest389028-21kworker/2:1+events22:26:442
32675999221811,2204cyclictest354100-21kworker/2:0+events20:38:162
3267559922097,2198cyclictest331523-21kworker/1:2+events19:22:111
32675999220111,2187cyclictest430044-21kworker/2:0+events00:37:032
32675999219811,2184cyclictest381226-21kworker/2:2+events22:16:002
32676399219711,2183cyclictest381107-21kworker/3:1+events22:15:143
3267559921967,2185cyclictest333390-21kworker/1:0+events19:37:531
3267559921947,2183cyclictest362200-21kworker/1:0+events21:08:411
32675599219410,2181cyclictest355547-21kworker/1:2+events20:40:141
32675999218511,2171cyclictest346243-21kworker/2:2+events20:12:062
32675599218310,2169cyclictest423837-21kworker/1:2+events00:16:361
3267639921829,2170cyclictest424407-21kworker/3:2+events00:27:593
32675999218210,2169cyclictest379569-21kworker/2:0+events22:00:002
32675599217211,2158cyclictest372443-21kworker/1:1+events21:33:411
32675999216510,2151cyclictest405657-21kworker/2:0+events23:26:372
32676399216211,2147cyclictest381107-21kworker/3:1+events22:22:333
32676399216011,2146cyclictest420263-21kworker/3:0+events00:14:403
32676399215811,2144cyclictest367160-21kworker/3:1+events21:15:123
32675599215410,2141cyclictest327863-21kworker/1:0+events19:11:471
32676399215311,2140cyclictest365374-21kworker/3:0+events21:20:553
3267559921483,2142cyclictest358753-21kworker/1:1+events20:53:191
32675599214810,2134cyclictest384433-21kworker/1:0+events22:37:061
32675599214611,2132cyclictest421947-21kworker/1:0+events00:26:511
32675399214211,2128cyclictest355577-21kworker/0:0+events20:37:290
3267599921418,2130cyclictest396978-21kworker/2:0+events22:47:232
3267639921409,2128cyclictest418631-21kworker/3:2+events23:54:513
3267599921403,2133cyclictest365343-21kworker/2:0+events21:23:302
32675399213511,2121cyclictest400364-21kworker/0:2+events23:00:210
3267559921339,2121cyclictest353923-21kworker/1:1+events20:33:171
32675599213111,2117cyclictest347670-21kworker/1:0+events20:17:471
32675999213010,2118cyclictest430044-21kworker/2:0+events00:31:192
3267599921293,2123cyclictest346243-21kworker/2:2+events20:32:552
32676399212711,2113cyclictest413807-21kworker/3:2+events23:40:233
32675599212310,2110cyclictest362200-21kworker/1:0+events21:02:321
32676399212110,2108cyclictest430133-21kworker/3:1+events00:33:113
32675599212110,2108cyclictest384433-21kworker/1:0+events22:09:091
32675599211910,2106cyclictest384433-21kworker/1:0+events22:13:211
32675599211810,2105cyclictest415163-21kworker/1:0+events23:56:021
32675399211811,2104cyclictest387396-21kworker/0:0+events22:19:530
32675599211710,2104cyclictest362200-21kworker/1:0+events21:12:081
32675599211710,2103cyclictest392362-21kworker/1:1+events22:34:251
32675599211610,2103cyclictest412266-21kworker/1:1+events23:38:501
32675599211610,2103cyclictest407343-21kworker/1:1+events23:18:381
32675399211611,2101cyclictest346031-21kworker/0:2+events20:09:220
32675599211511,2101cyclictest417083-21kworker/1:1+events23:52:351
32675599211510,2102cyclictest344748-21kworker/1:3+events20:07:281
32675599211410,2101cyclictest341444-21kworker/1:2+events19:59:471
32675399211411,2100cyclictest379744-21kworker/0:2+events22:25:330
32675599211310,2100cyclictest339836-21kworker/1:0+events19:49:241
32675399211311,2099cyclictest338233-21kworker/0:0+events19:49:000
3267559921129,2100cyclictest334995-21kworker/1:1+events19:40:581
32675599211210,2099cyclictest407343-21kworker/1:1+events23:23:551
32675599211210,2099cyclictest341444-21kworker/1:2+events20:02:491
32675599211210,2099cyclictest341444-21kworker/1:2+events20:02:491
32675599211110,2098cyclictest393966-21kworker/1:2+events22:51:561
32675599211010,2098cyclictest381169-21kworker/1:1+events22:04:571
32676399210910,2096cyclictest400184-21kworker/3:0+events22:58:243
3267559921098,2098cyclictest333390-21kworker/1:0+events19:29:511
32675599210910,2096cyclictest367101-21kworker/1:1+events21:21:151
3267559921089,2095cyclictest372443-21kworker/1:1+events21:42:281
3267559921076,2098cyclictest381169-21kworker/1:1+events21:58:271
32675599210710,2093cyclictest417083-21kworker/1:1+events00:06:591
3267559921065,2098cyclictest401954-21kworker/1:2+events23:08:451
3267559921018,2091cyclictest431636-21kworker/1:1+events00:35:071
3267539921013,2095cyclictest349304-21kworker/0:1+events20:31:250
32675599210010,2087cyclictest429984-21kworker/1:2+events00:31:441
32675599210010,2087cyclictest325097-21kworker/1:1+events19:17:571
32675599209910,2086cyclictest392362-21kworker/1:1+events22:41:171
32675399209911,2085cyclictest412845-21kworker/0:1+events23:39:590
3267559920976,2088cyclictest372443-21kworker/1:1+events21:48:341
32675599209610,2083cyclictest428346-21kworker/1:1+events00:24:331
32676399209511,2081cyclictest405569-21kworker/3:0+events23:14:303
32675599209510,2082cyclictest398763-21kworker/1:1+events22:58:461
3267559920927,2081cyclictest367101-21kworker/1:1+events21:18:581
32675399209010,2077cyclictest363892-21kworker/0:2+events21:04:050
3267559920859,2073cyclictest384433-21kworker/1:0+events22:27:511
32675599208310,2070cyclictest395584-21kworker/1:0+events23:04:561
32675999207910,2066cyclictest330199-21kworker/2:1+events19:27:112
3267639920779,2065cyclictest339685-21kworker/3:2+events19:53:153
32675999207710,2064cyclictest415104-21kworker/2:1+events23:47:132
3267599920769,2063cyclictest365343-21kworker/2:0+events21:08:172
3267599920754,2068cyclictest362228-21kworker/2:2+events21:11:232
3267599920745,2066cyclictest428404-21kworker/2:2+events00:27:362
32675999207410,2061cyclictest389028-21kworker/2:1+events22:21:472
3267599920739,2061cyclictest338291-21kworker/2:2+events19:59:252
3267599920738,2062cyclictest412320-21kworker/2:2+events23:39:142
32675999207210,2059cyclictest381226-21kworker/2:2+events22:00:442
3267599920719,2059cyclictest338291-21kworker/2:2+events19:45:322
3267599920716,2062cyclictest346243-21kworker/2:2+events20:27:162
32675999207110,2058cyclictest376607-21kworker/2:1+events21:53:272
3267599920704,2063cyclictest405657-21kworker/2:0+events23:40:452
32675999207010,2057cyclictest420382-21kworker/2:2+events00:03:142
32675999207010,2057cyclictest322913-21kworker/2:2+events19:17:332
3267559920705,2062cyclictest334995-21kworker/1:1+events19:52:511
3267639920699,2057cyclictest428524-21kworker/3:0+events00:35:303
3267599920699,2057cyclictest359128-21kworker/2:0+events20:52:102
32675999206810,2055cyclictest381226-21kworker/2:2+events22:11:032
32675999206810,2055cyclictest374918-21kworker/2:0+events21:42:072
32675999206810,2055cyclictest366978-21kworker/2:1+events21:16:412
32675399206810,2055cyclictest350985-21kworker/0:0+events20:24:380
3267599920668,2055cyclictest362228-21kworker/2:2+events21:00:122
3267599920667,2056cyclictest386218-21kworker/2:0+events22:35:572
3267599920652,2060cyclictest347879-21kworker/2:1+events20:18:542
3267639920645,2056cyclictest378237-21kworker/3:2+events21:50:273
3267599920649,2052cyclictest400066-21kworker/2:2+events22:56:322
3267599920645,2056cyclictest422125-21kworker/2:0+events00:10:472
32675999206410,2052cyclictest415104-21kworker/2:1+events00:07:222
3267599920639,2051cyclictest350777-21kworker/2:0+events20:21:352
3267559920609,2047cyclictest410659-21kworker/1:2+events23:44:101
32676399205610,2043cyclictest370033-21kworker/3:2+events21:32:573
32676399205511,2041cyclictest428524-21kworker/3:0+events00:24:123
3267599920553,2049cyclictest371599-21kworker/2:1+events21:31:072
32675399205510,2042cyclictest416995-21kworker/0:1+events23:50:190
32675999205110,2039cyclictest389028-21kworker/2:1+events22:30:102
32676399205010,2037cyclictest370033-21kworker/3:2+events21:38:153
3267559920449,2032cyclictest384433-21kworker/1:0+events22:19:291
3267559920399,2027cyclictest331523-21kworker/1:2+events19:30:121
3267599920389,2026cyclictest400066-21kworker/2:2+events23:02:122
3267559920388,2027cyclictest341444-21kworker/1:2+events20:11:431
3267559920339,2021cyclictest370408-21kworker/1:2+events21:28:071
3267599920318,2020cyclictest408786-21kworker/2:2+events23:24:402
3267599920308,2019cyclictest373205-21kworker/2:2+events21:37:512
3267639920278,2016cyclictest381107-21kworker/3:1+events22:06:313
32675399202410,2011cyclictest421708-21kworker/0:1+events00:06:380
3267599920219,2009cyclictest415104-21kworker/2:1+events23:52:572
3267639920186,2010cyclictest334978-21kworker/3:0+events19:55:103
3267539920179,2005cyclictest381383-21kworker/0:0+events22:08:460
3267599920169,2004cyclictest382889-21kworker/2:1+events22:08:242
3267599920169,2004cyclictest376607-21kworker/2:1+events21:47:032
3267639920145,2006cyclictest334978-21kworker/3:0+events19:34:023
32676399201210,1999cyclictest421979-21kworker/3:1+events00:06:153
32676399201210,1999cyclictest417023-21kworker/3:0+events23:49:313
3267639920119,1999cyclictest410568-21kworker/3:2+events23:31:353
32676399201110,1998cyclictest412173-21kworker/3:1+events23:39:363
3267639920107,2000cyclictest362113-21kworker/3:2+events21:02:103
3267639920107,2000cyclictest362113-21kworker/3:2+events20:56:453
3267639920107,2000cyclictest351046-21kworker/3:1+events20:26:293
3267639920084,2001cyclictest352739-21kworker/3:2+events20:34:033
32676399200810,1995cyclictest381107-21kworker/3:1+events22:35:333
3267639920076,1998cyclictest334978-21kworker/3:0+events19:40:113
32675999200710,1994cyclictest322913-21kworker/2:2+events19:24:522
32675399200710,1994cyclictest392422-21kworker/0:2+events22:36:440
32676399200610,1993cyclictest346334-21kworker/3:0+events20:42:323
3267639920059,1993cyclictest370033-21kworker/3:2+events21:42:523
3267639920056,1996cyclictest381107-21kworker/3:1+events21:58:033
32676399200510,1992cyclictest381107-21kworker/3:1+events22:11:273
3267639920046,1995cyclictest346334-21kworker/3:0+events20:35:573
3267639920044,1996cyclictest326335-21kworker/3:0+events19:23:423
32676399200410,1991cyclictest407462-21kworker/3:1+events23:23:103
3267599920038,1992cyclictest338291-21kworker/2:2+events19:50:112
3267599920036,1994cyclictest354100-21kworker/2:0+events20:40:362
32675399200310,1990cyclictest357212-21kworker/0:1+events20:43:180
32676399200210,1990cyclictest365374-21kworker/3:0+events21:25:013
32676399200110,1988cyclictest405569-21kworker/3:0+events23:28:323
3267599920018,1990cyclictest336538-21kworker/2:0+events19:43:392
32675999200110,1988cyclictest402039-21kworker/2:1+events23:19:462
32675999200110,1988cyclictest342604-21kworker/2:0+events20:01:402
32675999200110,1988cyclictest342604-21kworker/2:0+events20:01:402
3267599920008,1990cyclictest394052-21kworker/2:1+events22:50:022
3267599920007,1990cyclictest425141-21kworker/2:2+events00:15:272
32675999199910,1986cyclictest400066-21kworker/2:2+events23:08:222
3267639919985,1990cyclictest334978-21kworker/3:0+events19:48:373
3267599919989,1986cyclictest392332-21kworker/2:2+events22:44:382
3267539919986,1989cyclictest409053-21kworker/0:1+events23:28:100
3267639919975,1989cyclictest357392-21kworker/3:1+events21:05:383
3267639919957,1985cyclictest374950-21kworker/3:1+events21:48:583
32676399199510,1982cyclictest342900-21kworker/3:1+events20:13:353
32675999199410,1981cyclictest342604-21kworker/2:0+events20:05:302
32676399199310,1980cyclictest330107-21kworker/3:1+events19:26:253
32675399199111,1977cyclictest378056-21kworker/0:1+events21:50:500
3267639919904,1982cyclictest420263-21kworker/3:0+events23:58:403
3267639919869,1974cyclictest334978-21kworker/3:0+events20:00:563
3267639919869,1974cyclictest334978-21kworker/3:0+events20:00:563
32676399198510,1972cyclictest393996-21kworker/3:0+events22:42:223
32675399198510,1972cyclictest349304-21kworker/0:1+events20:25:230
32675399198410,1970cyclictest379744-21kworker/0:2+events22:13:430
3267539919828,1971cyclictest396352-21kworker/0:1+events22:53:510
32675399197910,1966cyclictest403753-21kworker/0:0+events23:18:150
3267539919754,1968cyclictest376425-21kworker/0:2+events21:43:160
3267639919737,1963cyclictest346334-21kworker/3:0+events20:15:533
32675399197110,1958cyclictest400364-21kworker/0:2+events23:05:410
32675399197010,1957cyclictest363892-21kworker/0:2+events21:23:530
32675399196910,1956cyclictest339899-21kworker/0:2+events19:54:460
3267599919689,1956cyclictest355703-21kworker/2:1+events20:57:312
3267539919688,1957cyclictest349304-21kworker/0:1+events20:18:100
3267639919677,1957cyclictest358996-21kworker/3:0+events20:50:593
3267639919669,1954cyclictest405569-21kworker/3:0+events23:19:223
32676399196610,1954cyclictest420263-21kworker/3:0+events00:00:563
3267559919667,1956cyclictest347670-21kworker/1:0+events20:36:201
32675399196610,1954cyclictest334906-21kworker/0:2+events19:39:500
32675399196410,1951cyclictest363892-21kworker/0:2+events21:17:480
3267539919635,1955cyclictest330167-21kworker/0:1+events19:26:010
3267539919634,1956cyclictest415136-21kworker/0:0+events23:49:090
32675399196310,1950cyclictest423628-21kworker/0:2+events00:17:420
32675399196310,1950cyclictest357212-21kworker/0:1+events20:55:370
32675399196310,1950cyclictest328136-21kworker/0:0+events19:19:300
3267539919628,1951cyclictest407373-21kworker/0:2+events23:41:080
3267539919627,1952cyclictest403753-21kworker/0:0+events23:22:480
32675399196210,1949cyclictest370268-21kworker/0:0+events21:35:570
3267539919617,1950cyclictest405415-21kworker/0:1+events23:13:200
3267539919617,1950cyclictest339899-21kworker/0:2+events19:58:390
3267539919615,1953cyclictest394025-21kworker/0:0+events22:56:080
3267539919606,1951cyclictest334906-21kworker/0:2+events19:34:260
32675399196010,1947cyclictest429926-21kworker/0:2+events00:28:210
3267539919589,1946cyclictest418906-21kworker/0:2+events23:59:020
32675399195810,1945cyclictest336603-21kworker/0:1+events19:42:530
3267539919549,1942cyclictest365657-21kworker/0:0+events21:13:170
3267539919519,1939cyclictest426928-21kworker/0:1+events00:22:160
32675399195110,1938cyclictest363892-21kworker/0:2+events21:06:230
32675399194910,1936cyclictest396352-21kworker/0:1+events22:47:430
32675399194910,1936cyclictest379744-21kworker/0:2+events21:59:380
3267639919438,1932cyclictest395613-21kworker/3:1+events22:52:203
3267639919406,1931cyclictest390811-21kworker/3:2+events22:30:353
32676399193910,1926cyclictest424407-21kworker/3:2+events00:18:043
32676399193910,1926cyclictest400184-21kworker/3:0+events23:01:503
3267639919387,1928cyclictest326335-21kworker/3:0+events19:18:443
32676399193810,1925cyclictest331762-21kworker/3:2+events19:35:553
3267539919388,1927cyclictest390781-21kworker/0:1+events22:34:010
3267599919368,1925cyclictest326424-21kworker/2:0+events19:12:342
3267639919336,1924cyclictest381107-21kworker/3:1+events22:28:373
3267639919309,1918cyclictest393996-21kworker/3:0+events22:49:153
3267639919289,1916cyclictest342900-21kworker/3:1+events20:09:463
3267639919208,1910cyclictest346334-21kworker/3:0+events20:24:143
3267539919189,1906cyclictest370268-21kworker/0:0+events21:47:260
3267539919047,1894cyclictest407373-21kworker/0:2+events23:31:120
32675399190010,1887cyclictest330167-21kworker/0:1+events19:21:020
3267539918995,1891cyclictest370268-21kworker/0:0+events21:31:530
3267539918949,1882cyclictest363892-21kworker/0:2+events21:27:210
3267539918933,1887cyclictest423628-21kworker/0:2+events00:12:440
3267639918873,1881cyclictest324738-21kworker/3:2+events19:12:103
3267539918847,1874cyclictest324862-21kworker/0:1+events19:12:570
3267539918838,1872cyclictest425290-21kworker/0:0+events00:36:150
3267539918829,1870cyclictest343207-21kworker/0:1+events20:10:330
3267539918797,1869cyclictest421708-21kworker/0:1+events00:04:430
3267639918626,1853cyclictest381107-21kworker/3:1+events22:02:393
3264642146112,28sleep30-21swapper/319:08:463
326254214697,26sleep10-21swapper/119:06:081
3264122141111,25sleep00-21swapper/019:08:070
3262082138106,27sleep20-21swapper/219:05:332
326753998785,1cyclictest338233-21kworker/0:0+pm20:04:590
326753998785,1cyclictest338233-21kworker/0:0+pm20:04:590
32675399174,6cyclictest394979-21cut22:40:190
326759991611,4cyclictest412093-21seq23:32:442
32675399160,14cyclictest360529-21runrttasks20:54:050
32675399151,3cyclictest612-21rs:main0
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional