You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-26 - 18:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot7s.osadl.org (updated Fri Dec 26, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
215707299572827,5697cyclictest2156417-21kworker/0:0+events19:11:250
215708399342715,3409cyclictest2153457-21kworker/3:1+events19:11:493
215707299322714,3209cyclictest2163655-21kworker/0:0+events19:30:000
215708399272210,2707cyclictest2242561-21kworker/3:0+events23:35:133
215707299266912,2653cyclictest2178605-21kworker/0:0+events20:55:190
215708399248912,2475cyclictest2237760-21kworker/3:2+events23:25:013
215708199248111,2466cyclictest2241075-21kworker/2:2+events23:30:202
215708399244212,2424cyclictest2158306-21kworker/3:0+events19:15:143
215708199239912,2382cyclictest2244337-21kworker/2:1+events23:40:132
215708399239512,2379cyclictest2260490-21kworker/3:0+events00:30:163
21570729923927,2381cyclictest2258564-21kworker/0:0+events00:25:200
215708199234110,2328cyclictest2236396-21kworker/2:2+events23:18:112
215707299232710,2314cyclictest2202397-21kworker/0:2+events21:28:590
215708199231212,2297cyclictest2176843-21kworker/2:1+events20:15:192
215708399229712,2283cyclictest2207702-21kworker/3:2+events21:55:183
215707299226711,2253cyclictest2240985-21kworker/0:2+events23:35:360
215707299226611,2252cyclictest2202397-21kworker/0:2+events21:34:000
215707299226310,2250cyclictest2178605-21kworker/0:0+events20:48:490
21570729922609,2248cyclictest2224703-21kworker/0:2+events22:39:440
215707299226011,2246cyclictest2178605-21kworker/0:0+events20:17:110
21570729922583,2252cyclictest2250855-21kworker/0:3+events00:12:230
215707299225411,2240cyclictest2196343-21kworker/0:2+events21:09:520
215707299224011,2226cyclictest2256933-21kworker/0:1+events00:21:310
215707299224011,2226cyclictest2256933-21kworker/0:1+events00:21:300
215707299223510,2222cyclictest2176950-21kworker/0:2+events20:10:210
215708199221611,2202cyclictest2212239-21kworker/2:0+events22:11:492
21570729922129,2200cyclictest2169820-21kworker/0:0+events19:50:360
215708199220810,2195cyclictest2172131-21kworker/2:2+events20:00:512
215707299220311,2189cyclictest2220594-21kworker/0:0+events22:33:570
215708199219710,2184cyclictest2217161-21kworker/2:2+events22:15:122
215708199219311,2178cyclictest2228583-21kworker/2:0+events22:55:202
215707299218810,2175cyclictest2178605-21kworker/0:0+events20:37:200
21570839921819,2171cyclictest2186727-21kworker/3:0+events20:40:013
215708199217711,2163cyclictest2253943-21kworker/2:2+events00:17:202
215708199216510,2151cyclictest2212239-21kworker/2:0+events21:57:382
215708399216411,2150cyclictest2190061-21kworker/3:0+events20:52:153
215708399215810,2145cyclictest2168809-21kworker/3:2+events20:12:583
215708199214210,2128cyclictest2228583-21kworker/2:0+events23:02:152
21570729921364,2128cyclictest2220594-21kworker/0:0+events22:24:470
215708399213410,2121cyclictest2245835-21kworker/3:1+events23:47:483
21570729921348,2123cyclictest2171805-21kworker/0:1+events20:08:520
215707299212010,2108cyclictest2212359-21kworker/0:0+events22:05:150
215708199211510,2102cyclictest2253943-21kworker/2:2+events00:12:442
215708399211211,2098cyclictest2228430-21kworker/3:1+events22:59:583
215708199211110,2098cyclictest2248195-21kworker/2:2+events00:00:572
21570779921046,2095cyclictest2176983-21kworker/1:1+events20:10:441
21570729921039,2091cyclictest2250855-21kworker/0:3+events00:33:440
21570729921038,2092cyclictest2235021-21kworker/0:0+events23:16:380
21570729921018,2090cyclictest2163655-21kworker/0:0+events19:31:320
21570729921018,2090cyclictest2163655-21kworker/0:0+events19:31:320
215707299210010,2087cyclictest2228310-21kworker/0:1+events22:56:310
215708399209711,2083cyclictest2167130-21kworker/3:0+events19:41:013
215708399209710,2085cyclictest2180182-21kworker/3:1+events20:35:023
215707299209410,2081cyclictest2235021-21kworker/0:0+events23:20:490
215707299208810,2075cyclictest2231634-21kworker/0:2+events23:14:190
215707299208310,2070cyclictest2220594-21kworker/0:0+events22:29:200
215707299208110,2068cyclictest2199849-21kworker/0:0+events21:20:350
215708399208010,2067cyclictest2165232-21kworker/3:1+events19:47:323
21570729920789,2066cyclictest2205901-21kworker/0:1+events21:40:310
21570729920779,2065cyclictest2250855-21kworker/0:3+events00:07:040
21570779920764,2069cyclictest2236365-21kworker/1:2+events23:15:291
21570729920744,2066cyclictest2189787-21kworker/0:1+events20:52:380
21570729920739,2061cyclictest2250855-21kworker/0:3+events00:38:400
21570729920733,2067cyclictest2224703-21kworker/0:2+events22:42:030
21570729920709,2058cyclictest2235021-21kworker/0:0+events23:28:470
21570729920704,2063cyclictest2205901-21kworker/0:1+events21:57:150
215707299207010,2057cyclictest2244308-21kworker/0:0+events23:42:100
215707299207010,2057cyclictest2242708-21kworker/0:1+events23:34:500
215707299206910,2056cyclictest2180244-21kworker/0:2+events20:23:200
21570729920688,2057cyclictest2207524-21kworker/0:2+events21:46:070
215707299206610,2053cyclictest2210753-21kworker/0:2+events22:03:220
21570729920659,2053cyclictest2158366-21kworker/0:1+events19:16:230
21570729920654,2058cyclictest2180244-21kworker/0:2+events20:25:360
215707299206510,2052cyclictest2153128-21kworker/0:2+events19:23:500
21570729920648,2053cyclictest2183556-21kworker/0:1+events20:34:410
215707299206410,2052cyclictest2216925-21kworker/0:2+events22:13:430
215707299206210,2049cyclictest2231634-21kworker/0:2+events23:01:070
215708199206010,2046cyclictest2252335-21kworker/2:1+events00:06:202
21570839920559,2043cyclictest2217103-21kworker/3:0+events22:17:313
215708399205010,2037cyclictest2249119-21kworker/3:1+events00:07:493
21570729920507,2040cyclictest2162063-21kworker/0:1+events19:38:280
21570729920493,2043cyclictest2175085-21kworker/0:0+events20:03:300
21570729920492,2044cyclictest2196343-21kworker/0:2+events21:18:420
215707299204910,2036cyclictest2162063-21kworker/0:1+events19:40:170
215708199204610,2032cyclictest2207672-21kworker/2:1+events22:00:162
21570729920456,2036cyclictest2178605-21kworker/0:0+events21:02:350
21570729920447,2034cyclictest2231634-21kworker/0:2+events23:06:460
21570729920446,2035cyclictest2224703-21kworker/0:2+events22:46:360
21570729920428,2031cyclictest2171805-21kworker/0:1+events19:56:200
21570729920415,2033cyclictest2245968-21kworker/0:1+events23:59:480
21570729920407,2030cyclictest2228310-21kworker/0:1+events22:54:590
215707299203910,2026cyclictest2247619-21kworker/0:2+events23:51:130
21570839920378,2025cyclictest2196224-21kworker/3:0+events21:10:133
21570729920369,2024cyclictest2167214-21kworker/0:2+events19:49:280
21570729920348,2023cyclictest2205901-21kworker/0:1+events21:38:130
21570839920337,2023cyclictest2183498-21kworker/3:2+events20:33:093
21570779920329,2020cyclictest2241016-21kworker/1:1+events23:32:571
21570819920269,2014cyclictest2196471-21kworker/2:2+events21:12:552
215708199202410,2012cyclictest2204065-21kworker/2:0+events21:40:082
215708199202310,2010cyclictest2168484-21kworker/2:1+events19:52:292
215708399202110,2008cyclictest2183498-21kworker/3:2+events21:02:133
215708399202110,2008cyclictest2175147-21kworker/3:1+events20:09:583
215708399202010,2007cyclictest2180182-21kworker/3:1+events20:24:293
21570839920199,2007cyclictest2202756-21kworker/3:1+events21:48:483
21570839920194,2012cyclictest2196224-21kworker/3:0+events21:07:593
215708199201710,2004cyclictest2132323-21kworker/2:1+events19:21:582
215708199201610,2003cyclictest2199223-21kworker/2:1+events21:26:212
21570839920149,2001cyclictest2225109-21kworker/3:1+events22:38:123
21570819920148,2003cyclictest2213896-21kworker/2:2+events22:06:492
21570839920138,2002cyclictest2226707-21kworker/3:2+events23:00:213
21570729920134,2006cyclictest2250855-21kworker/0:3+events00:01:410
21570819920129,2000cyclictest2260285-21kworker/2:2+events00:28:462
21570819920128,2001cyclictest2162138-21kworker/2:2+events19:27:402
21570819920125,2004cyclictest2189821-21kworker/2:0+events21:15:372
215708199201110,1998cyclictest2181658-21kworker/2:0+events20:30:292
21570839920108,1999cyclictest2153457-21kworker/3:1+events19:22:193
21570839920106,2001cyclictest2217103-21kworker/3:0+events22:29:443
215708399201010,1997cyclictest2226707-21kworker/3:2+events22:46:113
21570819920108,1999cyclictest2244337-21kworker/2:1+events23:52:422
21570839920099,1997cyclictest2161990-21kworker/3:0+events19:31:563
21570839920099,1997cyclictest2161990-21kworker/3:0+events19:31:563
21570819920097,1999cyclictest2162138-21kworker/2:2+events19:46:482
215708199200910,1996cyclictest2215528-21kworker/2:1+events22:28:592
215708199200910,1996cyclictest2204065-21kworker/2:0+events21:37:282
21570729920099,1997cyclictest2216925-21kworker/0:2+events22:19:250
21570839920089,1999cyclictest2239388-21kworker/3:1+events23:26:103
21570839920089,1995cyclictest2197860-21kworker/3:2+events21:17:083
21570839920084,2001cyclictest2181872-21kworker/3:0+events20:27:073
215708399200810,1995cyclictest2228430-21kworker/3:1+events23:05:113
215708399200810,1994cyclictest2207702-21kworker/3:2+events21:52:373
21570819920089,1996cyclictest2242677-21kworker/2:0+events23:48:592
21570819920089,1996cyclictest2225078-21kworker/2:1+events22:43:132
215708199200810,1994cyclictest2209390-21kworker/2:2+events21:51:042
21570839920079,1995cyclictest2239388-21kworker/3:1+events23:31:513
215708399200710,1994cyclictest2253787-21kworker/3:0+events00:15:483
215708399200710,1994cyclictest2228430-21kworker/3:1+events22:51:123
215708399200710,1994cyclictest2215469-21kworker/3:2+events22:11:273
21570819920078,1996cyclictest2183320-21kworker/2:2+events20:41:112
21570839920069,1994cyclictest2175147-21kworker/3:1+events20:03:543
215708399200610,1993cyclictest2255386-21kworker/3:2+events00:26:523
21570819920068,1995cyclictest2191423-21kworker/2:2+events20:54:552
21570819920067,1996cyclictest2162138-21kworker/2:2+events19:41:482
21570729920068,1995cyclictest2210753-21kworker/0:2+events21:53:460
21570839920058,1994cyclictest2196224-21kworker/3:0+events21:26:443
215708399200510,1992cyclictest2236120-21kworker/3:0+events23:11:193
215708399200510,1992cyclictest2220728-21kworker/3:2+events22:30:523
21570819920054,1998cyclictest2220623-21kworker/2:0+events22:38:362
21570729920058,1995cyclictest2255329-21kworker/0:0+events00:15:020
21570839920047,1994cyclictest2217103-21kworker/3:0+events22:41:163
215708399200410,1991cyclictest2249119-21kworker/3:1+events00:10:513
21570819920046,1995cyclictest2166834-21kworker/2:0+events19:36:552
21570819920039,1990cyclictest2176843-21kworker/2:1+events20:12:372
21570819920038,1992cyclictest2132323-21kworker/2:1+events19:19:242
21570819920029,1990cyclictest2239357-21kworker/2:1+events23:22:202
21570729920029,1990cyclictest2185624-21kworker/0:2+events20:43:280
21570819920018,1990cyclictest2168484-21kworker/2:1+events19:58:582
21570839919999,1987cyclictest2237760-21kworker/3:2+events23:17:023
215708399199910,1986cyclictest2249119-21kworker/3:1+events00:01:183
215708199199910,1986cyclictest2236396-21kworker/2:2+events23:14:422
21570729919999,1987cyclictest2244308-21kworker/0:0+events23:47:040
21570839919989,1986cyclictest2262122-21kworker/3:2+events00:35:363
21570839919984,1991cyclictest2161990-21kworker/3:0+events19:29:363
21570819919986,1989cyclictest2191423-21kworker/2:2+events21:01:052
21570819919969,1984cyclictest2189821-21kworker/2:0+events20:47:192
21570819919958,1984cyclictest2200883-21kworker/2:2+events21:24:022
21570819919928,1981cyclictest2241075-21kworker/2:2+events23:37:062
215708199198910,1976cyclictest2233111-21kworker/2:2+events23:05:352
21570839919886,1979cyclictest2255386-21kworker/3:2+events00:23:243
21570839919886,1979cyclictest2255386-21kworker/3:2+events00:23:243
21570779919877,1977cyclictest2156538-21kworker/1:1+events19:35:221
215708399198510,1971cyclictest2249119-21kworker/3:1+events23:55:183
215708399198210,1969cyclictest2168809-21kworker/3:2+events19:57:283
21570819919809,1968cyclictest2199223-21kworker/2:1+events21:31:412
21570729919804,1973cyclictest2196343-21kworker/0:2+events21:14:500
215708399197610,1963cyclictest2168809-21kworker/3:2+events20:18:203
215708399197510,1964cyclictest2201153-21kworker/3:2+events21:30:083
21570819919759,1963cyclictest2207672-21kworker/2:1+events21:47:392
21570839919749,1962cyclictest2217103-21kworker/3:0+events22:22:493
21570839919749,1962cyclictest2199497-21kworker/3:1+events21:22:073
21570819919738,1962cyclictest2222259-21kworker/2:2+events22:31:162
215708399197110,1958cyclictest2213863-21kworker/3:0+events22:04:553
21570819919718,1960cyclictest2215528-21kworker/2:1+events22:24:232
21570819919709,1957cyclictest2189821-21kworker/2:0+events21:06:502
21570779919707,1961cyclictest2165205-21kworker/1:0+events19:44:321
21570779919693,1963cyclictest2173670-21kworker/1:2+events20:01:141
215707799196910,1956cyclictest2204185-21kworker/1:0+events22:14:501
21570819919677,1957cyclictest2183320-21kworker/2:2+events20:28:582
21570839919635,1955cyclictest2165232-21kworker/3:1+events19:39:563
21570779919638,1952cyclictest2165205-21kworker/1:0+events19:59:201
21570779919628,1951cyclictest2156538-21kworker/1:1+events19:33:511
21570779919628,1951cyclictest2156538-21kworker/1:1+events19:33:501
21570779919615,1953cyclictest2217222-21kworker/1:2+events22:26:421
21570839919598,1949cyclictest2165232-21kworker/3:1+events19:52:533
21570779919597,1949cyclictest2220412-21kworker/1:1+events22:22:271
21570779919579,1945cyclictest2226829-21kworker/1:0+events22:48:301
215708199195610,1943cyclictest2176843-21kworker/2:1+events20:06:572
21570819919529,1938cyclictest2228583-21kworker/2:0+events22:51:352
21570779919517,1940cyclictest2226829-21kworker/1:0+events22:54:361
21570779919508,1939cyclictest2204185-21kworker/1:0+events21:34:221
21570839919486,1939cyclictest2213863-21kworker/3:0+events22:06:273
21570779919489,1936cyclictest2241016-21kworker/1:1+events23:29:571
21570779919489,1936cyclictest2168710-21kworker/1:1+events19:54:241
21570779919484,1941cyclictest2241016-21kworker/1:1+events00:02:041
21570819919469,1934cyclictest2263633-21kworker/2:0+events00:39:472
21570839919459,1933cyclictest2244216-21kworker/3:2+events23:51:353
21570819919459,1933cyclictest2189821-21kworker/2:0+events20:55:432
21570819919458,1934cyclictest2180031-21kworker/2:2+events20:21:032
21570779919455,1937cyclictest2168710-21kworker/1:1+events19:45:401
21570839919449,1932cyclictest2183498-21kworker/3:2+events20:45:463
215708199194410,1931cyclictest2258378-21kworker/2:1+events00:21:532
215708199194410,1931cyclictest2258378-21kworker/2:1+events00:21:532
21570839919437,1933cyclictest2202756-21kworker/3:1+events21:35:073
21570779919428,1931cyclictest2153217-21kworker/1:2+events19:25:221
21570819919419,1929cyclictest2162138-21kworker/2:2+events19:31:102
21570819919419,1929cyclictest2162138-21kworker/2:2+events19:31:102
215707799194010,1927cyclictest2247543-21kworker/1:3+events00:16:131
215708199193910,1925cyclictest2183320-21kworker/2:2+events20:36:112
21570839919389,1926cyclictest2244216-21kworker/3:2+events23:40:363
21570839919383,1932cyclictest2192967-21kworker/3:1+events20:59:313
21570779919375,1929cyclictest2165205-21kworker/1:0+events20:07:451
21570819919367,1926cyclictest2225078-21kworker/2:1+events22:47:452
21570819919329,1920cyclictest2248195-21kworker/2:2+events23:58:392
215707799193210,1918cyclictest2188233-21kworker/1:1+events20:45:211
21570819919298,1918cyclictest2153395-21kworker/2:2+events19:14:052
21570819919239,1911cyclictest2228583-21kworker/2:0+events23:25:462
21570779919238,1912cyclictest2206053-21kworker/1:2+events21:42:451
21570779919069,1894cyclictest2198086-21kworker/1:2+events21:15:141
21570819919059,1895cyclictest2260285-21kworker/2:2+events00:30:402
215707799190510,1892cyclictest2226829-21kworker/1:0+events23:13:331
215707799189610,1883cyclictest2186575-21kworker/1:2+events20:53:471
21570779918958,1884cyclictest2165205-21kworker/1:0+events20:26:201
215707799189410,1881cyclictest2200972-21kworker/1:1+events21:25:121
21570779918929,1880cyclictest2217222-21kworker/1:2+events22:42:501
21570779918889,1876cyclictest2247543-21kworker/1:3+events00:31:041
215707799188810,1875cyclictest2186575-21kworker/1:2+events20:41:331
21570779918876,1877cyclictest2186575-21kworker/1:2+events21:03:231
215707799188510,1872cyclictest2206053-21kworker/1:2+events21:46:321
215707799188510,1872cyclictest2204185-21kworker/1:0+events21:38:361
21570779918848,1873cyclictest2242645-21kworker/1:2+events23:35:581
21570779918824,1875cyclictest2210783-21kworker/1:1+events21:54:551
21570779918823,1876cyclictest2193371-21kworker/1:0+events21:09:291
21570839918519,1839cyclictest2202756-21kworker/3:1+events21:44:153
21570779918309,1819cyclictest2165205-21kworker/1:0+events20:35:481
21570779918307,1820cyclictest2196377-21kworker/1:1+events21:10:381
21570779918259,1813cyclictest2220412-21kworker/1:1+events22:31:391
21570779918249,1812cyclictest2156538-21kworker/1:1+events19:15:371
21570779918159,1805cyclictest2230122-21kworker/1:2+events22:59:101
21570779917967,1786cyclictest2198086-21kworker/1:2+events21:22:301
21570779917698,1758cyclictest2153217-21kworker/1:2+events19:10:391
21565022153112,25sleep20-21swapper/219:08:102
21566122148103,25sleep00-21swapper/019:09:320
21565842141108,28sleep10-21swapper/119:09:131
21564362140107,27sleep30-21swapper/319:07:183
215707799271,24cyclictest2214106-21idleruntime-cro22:05:001
215707799230,21cyclictest2218895-21systemctl22:20:001
215707799220,20cyclictest2212526-21sendmail22:00:011
215707799210,8cyclictest2180829-21df_inode20:20:131
215707799201,17cyclictest2249225-21awk23:55:001
215707799201,16cyclictest2250790-21munin-run00:00:001
215707799201,16cyclictest2183523-21apt-get20:30:031
215707799201,14cyclictest2160858-21apt-get19:20:121
215707799200,17cyclictest2254255-21apt-get00:10:141
215707799196,11cyclictest2238961-21sshd23:20:181
215707799193,14cyclictest0-21swapper/100:10:001
215707799190,17cyclictest2263761-21awk00:40:001
215707799190,17cyclictest2258740-21latency_hist00:25:001
215707799190,17cyclictest2258740-21latency_hist00:25:001
215707799190,17cyclictest2225348-21taskset22:39:101
215707799181,15cyclictest2233365-21idleruntime-cro23:05:001
215707799181,15cyclictest0-21swapper/121:00:001
215707799171,14cyclictest1-21systemd20:20:011
215707799170,16cyclictest2245704-21chrt23:41:161
215707799170,16cyclictest2215641-21taskset22:09:361
215707799170,15cyclictest2259394-21ls00:25:141
215707799170,15cyclictest2246277-21apt-get23:45:131
215707799170,15cyclictest2233834-21/usr/sbin/munin23:05:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional