You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 17:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackfslot7s.osadl.org (updated Wed Dec 17, 2025 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
203146999288112,2864cyclictest2065382-21kworker/2:0+events20:55:192
203146399281313,2797cyclictest2032933-21kworker/0:0+events19:30:000
203146999280813,2790cyclictest2044480-21kworker/2:2+events19:55:172
203146399280811,2792cyclictest2128215-21kworker/0:0+events00:10:200
203146799280513,2788cyclictest2036806-21kworker/1:1+events19:45:191
203146799277213,2756cyclictest2102676-21kworker/1:2+events22:55:021
203147399270413,2687cyclictest2121558-21kworker/3:0+events23:50:123
203147399268813,2671cyclictest2063868-21kworker/3:0+events20:50:183
203146799258310,2569cyclictest2055739-21kworker/1:1+events20:25:191
203147399257112,2555cyclictest2079659-21kworker/3:0+events21:45:183
203146999254012,2524cyclictest2090739-21kworker/2:2+events22:20:202
203146999252812,2513cyclictest2038012-21kworker/2:1+events19:40:212
203146999252212,2507cyclictest2058807-21kworker/2:2+events20:35:112
203146799250212,2486cyclictest2078087-21kworker/1:0+events22:05:131
203147399249212,2475cyclictest2119919-21kworker/3:1+events23:45:123
203147399249212,2475cyclictest2119919-21kworker/3:1+events23:45:123
203146399248612,2471cyclictest2134626-21kworker/0:1+events00:32:190
203146799248211,2468cyclictest2121706-21kworker/1:0+events00:00:261
203146399247911,2465cyclictest2084734-21kworker/0:1+events22:00:170
203146799245912,2444cyclictest2108846-21kworker/1:1+events23:08:041
203146399243912,2424cyclictest2090857-21kworker/0:1+events22:13:550
203146399238211,2368cyclictest2113559-21kworker/0:2+events23:22:520
203146799236912,2354cyclictest2067012-21kworker/1:2+events21:09:281
203146999236610,2353cyclictest2100446-21kworker/2:1+events22:58:522
203147399236310,2350cyclictest2053321-21kworker/3:1+events20:20:193
203147399235712,2343cyclictest2068401-21kworker/3:0+events21:05:143
20314739923528,2341cyclictest2105653-21kworker/3:0+events23:00:463
203147399234112,2326cyclictest2128126-21kworker/3:1+events00:36:323
203146399234110,2328cyclictest2047716-21kworker/0:2+events20:11:150
203147399234012,2324cyclictest2049709-21kworker/3:0+events20:13:313
20314639923359,2322cyclictest2099107-21kworker/0:2+events22:53:090
203147399232611,2312cyclictest2095877-21kworker/3:2+events22:42:143
203146799231311,2298cyclictest2115064-21kworker/1:1+events23:41:441
203146799231211,2297cyclictest2100879-21kworker/1:0+events22:50:541
203146799231111,2296cyclictest2060466-21kworker/1:2+events20:47:431
20314679923108,2299cyclictest2100879-21kworker/1:0+events23:01:091
203146799230911,2295cyclictest2068705-21kworker/1:1+events21:10:111
203146799230911,2294cyclictest2121706-21kworker/1:0+events00:18:431
203146399230911,2295cyclictest2116964-21kworker/0:2+events23:36:290
20314679923089,2295cyclictest2116672-21kworker/1:2+events23:36:051
203146399230810,2294cyclictest2082791-21kworker/0:2+events21:55:170
203146799230711,2293cyclictest2035008-21kworker/1:0+events19:28:501
203146799230710,2294cyclictest2073083-21kworker/1:0+events21:17:411
203146799230511,2290cyclictest2113468-21kworker/1:0+events23:25:521
203146799230510,2292cyclictest2052782-21kworker/1:0+events20:19:121
203146799230411,2290cyclictest2062320-21kworker/1:0+events21:04:051
203146799230410,2291cyclictest2093934-21kworker/1:0+events22:36:351
203146399230410,2291cyclictest2047716-21kworker/0:2+events20:18:500
203146799230311,2289cyclictest2078087-21kworker/1:0+events22:04:271
203146799230310,2290cyclictest2128094-21kworker/1:1+events00:13:231
20314679923029,2290cyclictest2078087-21kworker/1:0+events22:11:581
20314679923029,2290cyclictest2049608-21kworker/1:2+events20:09:241
203146399230211,2288cyclictest2055679-21kworker/0:0+events20:24:560
203147399230112,2286cyclictest2102185-21kworker/3:0+events22:48:593
203146999230111,2287cyclictest2128005-21kworker/2:0+events00:06:292
20314679923019,2288cyclictest2121706-21kworker/1:0+events23:56:591
203146799230110,2288cyclictest2076456-21kworker/1:2+events21:32:041
203146799229811,2284cyclictest2121706-21kworker/1:0+events00:08:031
203146799229711,2282cyclictest2078087-21kworker/1:0+events21:43:471
203146799229611,2282cyclictest2055739-21kworker/1:1+events20:36:431
203146799228811,2273cyclictest2039673-21kworker/1:2+events19:44:121
203146999228712,2272cyclictest2114721-21kworker/2:1+events00:01:342
203146999227912,2264cyclictest2060436-21kworker/2:0+events20:44:362
20314639922799,2266cyclictest2059014-21kworker/0:0+events20:49:140
203146799227610,2263cyclictest2115064-21kworker/1:1+events23:32:421
203146399227610,2262cyclictest2097285-21kworker/0:1+events22:34:190
203146399227510,2262cyclictest2041341-21kworker/0:1+events19:39:130
203146399227410,2261cyclictest2111927-21kworker/0:0+events23:17:310
203146399227313,2257cyclictest2036175-21kworker/0:1+events19:31:090
203146399227211,2259cyclictest2123251-21kworker/0:2+events00:08:250
203146399227111,2256cyclictest2070034-21kworker/0:2+events21:26:230
203146399226811,2253cyclictest2134626-21kworker/0:1+events00:27:260
203146799226710,2254cyclictest2082585-21kworker/1:2+events21:51:011
203146399226711,2253cyclictest2047716-21kworker/0:2+events20:04:020
203146399226611,2252cyclictest2065441-21kworker/0:2+events20:59:060
203146399226611,2251cyclictest2102096-21kworker/0:0+events22:47:280
203147399226510,2252cyclictest2084218-21kworker/3:2+events21:52:563
203146999226511,2251cyclictest2081132-21kworker/2:0+events21:54:072
203146399226511,2251cyclictest2070034-21kworker/0:2+events21:31:420
20314699922649,2252cyclictest2082821-21kworker/2:2+events21:58:472
203146399226410,2252cyclictest2123251-21kworker/0:2+events23:55:090
20314699922639,2251cyclictest2114721-21kworker/2:1+events23:33:492
203146399226211,2248cyclictest2043116-21kworker/0:0+events19:54:530
20314639922620,2259cyclictest2077883-21kworker/0:0+events21:39:380
203147399226011,2246cyclictest2039885-21kworker/3:1+events19:37:433
203146399225911,2245cyclictest2136313-21kworker/0:2+events00:36:540
20314639922558,2244cyclictest2082791-21kworker/0:2+events21:49:530
203146399225410,2241cyclictest2111927-21kworker/0:0+events23:47:090
203146399225410,2241cyclictest2111927-21kworker/0:0+events23:47:090
203146999225310,2240cyclictest2133014-21kworker/2:0+events00:26:432
203147399225011,2236cyclictest2085889-21kworker/3:0+events22:10:293
203146399225011,2236cyclictest2105564-21kworker/0:0+events23:03:070
203147399224811,2234cyclictest2084218-21kworker/3:2+events21:56:043
203146799224710,2234cyclictest2039673-21kworker/1:2+events19:52:391
203146399224311,2228cyclictest2077883-21kworker/0:0+events21:52:100
20314699922428,2230cyclictest2071903-21kworker/2:0+events21:24:082
203147399224110,2228cyclictest2119919-21kworker/3:1+events23:43:183
20314699922409,2228cyclictest2068492-21kworker/2:2+events21:03:432
203146799223910,2226cyclictest2082585-21kworker/1:2+events21:48:191
203146999223811,2225cyclictest2017032-21kworker/2:2+events19:26:572
203146999223810,2224cyclictest2104252-21kworker/2:0+events23:09:112
20314639922389,2226cyclictest2130082-21kworker/0:1+events00:16:050
203146999223711,2223cyclictest2097163-21kworker/2:2+events22:32:472
203146799223610,2223cyclictest2121706-21kworker/1:0+events23:50:581
203146999223511,2221cyclictest2098797-21kworker/2:0+events22:43:202
20314699922347,2224cyclictest2038012-21kworker/2:1+events19:49:352
203146999223111,2217cyclictest2136370-21kworker/2:2+events00:33:532
20314739922289,2215cyclictest2037980-21kworker/3:2+events19:30:223
20314699922235,2215cyclictest2110622-21kworker/2:2+events23:17:542
203146999222011,2206cyclictest2060436-21kworker/2:0+events20:47:192
203146999222010,2207cyclictest2098797-21kworker/2:0+events22:38:282
203146999221510,2202cyclictest2044480-21kworker/2:2+events20:09:462
20314639922145,2206cyclictest2109052-21kworker/0:1+events23:10:190
203147399220311,2189cyclictest2123159-21kworker/3:2+events00:06:073
203146799220310,2190cyclictest2107179-21kworker/1:2+events23:16:001
203147399219911,2185cyclictest2058926-21kworker/3:2+events20:35:583
203147399219611,2182cyclictest2039885-21kworker/3:1+events19:52:163
203147399219411,2180cyclictest2068401-21kworker/3:0+events21:25:393
203147399219411,2179cyclictest2058926-21kworker/3:2+events20:32:563
203146399219410,2181cyclictest2057289-21kworker/0:1+events20:29:320
203147399219310,2180cyclictest2042848-21kworker/3:2+events19:44:563
203147399219210,2179cyclictest2060554-21kworker/3:1+events21:00:403
203147399218310,2170cyclictest2047951-21kworker/3:1+events20:03:383
203146799218110,2168cyclictest2060466-21kworker/1:2+events20:44:591
203147399217710,2164cyclictest2100271-21kworker/3:1+events23:26:143
203146799217210,2158cyclictest2074771-21kworker/1:1+events21:22:391
203147399216111,2147cyclictest2095877-21kworker/3:2+events22:35:493
203147399216011,2146cyclictest2085889-21kworker/3:0+events22:04:053
20314699921608,2149cyclictest2110622-21kworker/2:2+events23:28:092
203147399215611,2142cyclictest2100271-21kworker/3:1+events22:54:403
203146399215610,2143cyclictest2092489-21kworker/0:0+events22:29:220
20314739921549,2142cyclictest2039885-21kworker/3:1+events19:47:373
203147399215411,2140cyclictest2128126-21kworker/3:1+events00:12:593
20314739921528,2141cyclictest2090947-21kworker/3:1+events22:27:543
203147399215210,2139cyclictest2116704-21kworker/3:0+events23:32:213
203147399214711,2133cyclictest2090947-21kworker/3:1+events22:17:433
20314679921387,2128cyclictest2107179-21kworker/1:2+events23:20:361
203147399213211,2118cyclictest2126467-21kworker/3:0+events00:02:423
203147399212310,2110cyclictest2070004-21kworker/3:1+events21:16:313
20314679921208,2109cyclictest2046032-21kworker/1:0+events20:00:581
203146799211810,2105cyclictest2115064-21kworker/1:1+events23:49:481
203146799211810,2105cyclictest2115064-21kworker/1:1+events23:49:481
203146799211810,2105cyclictest2091775-21kworker/1:1+events22:21:061
203146799211710,2104cyclictest2078087-21kworker/1:0+events21:37:001
203147399211410,2101cyclictest2109021-21kworker/3:2+events23:14:073
203146399211410,2100cyclictest2111927-21kworker/0:0+events23:28:530
20314739921139,2101cyclictest2128126-21kworker/3:1+events00:18:223
203146799211310,2100cyclictest2095564-21kworker/1:2+events22:29:001
203146399211310,2101cyclictest2070034-21kworker/0:2+events21:13:090
20314699921118,2100cyclictest2102425-21kworker/2:2+events22:53:332
20314679921116,2102cyclictest2091775-21kworker/1:1+events22:15:491
20314739921108,2099cyclictest2105653-21kworker/3:0+events23:06:103
203146999211010,2097cyclictest2086347-21kworker/2:1+events22:03:202
20314679921107,2100cyclictest2097315-21kworker/1:1+events22:45:361
20314679921099,2097cyclictest2049608-21kworker/1:2+events20:14:411
203146799210910,2097cyclictest2049608-21kworker/1:2+events20:24:081
203146799210910,2096cyclictest2031145-21kworker/1:1+events19:13:151
20314699921085,2100cyclictest2125233-21kworker/2:4+events00:11:272
20314679921089,2096cyclictest2107179-21kworker/1:2+events23:14:281
20314679921089,2096cyclictest2093934-21kworker/1:0+events22:33:561
203146799210810,2095cyclictest2031145-21kworker/1:1+events19:15:571
20314639921089,2096cyclictest2124849-21kworker/0:1+events00:03:520
20314639921088,2097cyclictest2103700-21kworker/0:1+events22:56:340
20314679921076,2098cyclictest2036806-21kworker/1:1+events19:38:501
203146399210710,2093cyclictest2047716-21kworker/0:2+events19:57:120
20314679921067,2096cyclictest2046032-21kworker/1:0+events19:58:191
20314679921059,2094cyclictest2062320-21kworker/1:0+events20:50:421
203146799210510,2092cyclictest2121706-21kworker/1:0+events00:22:291
203146799210510,2092cyclictest2058837-21kworker/1:0+events20:34:481
203146799210410,2091cyclictest2074771-21kworker/1:1+events21:28:411
20314639921049,2092cyclictest2089172-21kworker/0:0+events22:09:440
20314639921047,2094cyclictest2123251-21kworker/0:2+events00:22:530
20314679921023,2095cyclictest2084280-21kworker/1:1+events21:57:131
20314639921029,2090cyclictest2090857-21kworker/0:1+events22:18:050
203147399210111,2087cyclictest2105653-21kworker/3:0+events22:59:173
20314679921019,2089cyclictest2134943-21kworker/1:2+events00:38:481
203146399210110,2088cyclictest2041341-21kworker/0:1+events19:41:310
20314739921009,2088cyclictest2087759-21kworker/3:2+events22:06:243
20314679920988,2088cyclictest2098973-21kworker/1:2+events22:44:511
20314739920976,2088cyclictest2090947-21kworker/3:1+events22:34:433
203146999209610,2083cyclictest2076816-21kworker/2:1+events21:45:402
20314679920955,2087cyclictest2039673-21kworker/1:2+events19:34:151
20314639920958,2084cyclictest2062264-21kworker/0:1+events21:04:290
203146399209510,2082cyclictest2107333-21kworker/0:2+events23:09:560
20314639920949,2082cyclictest2097285-21kworker/0:1+events22:43:450
203147399208711,2072cyclictest2053321-21kworker/3:1+events20:16:113
203146399208610,2073cyclictest2079514-21kworker/0:1+events21:41:320
20314739920769,2064cyclictest2128126-21kworker/3:1+events00:23:153
203146999207610,2063cyclictest2104252-21kworker/2:0+events23:14:522
203146999207610,2063cyclictest2036317-21kworker/2:0+events19:32:422
203146999207511,2061cyclictest2081132-21kworker/2:0+events22:10:522
203146399207510,2062cyclictest2036175-21kworker/0:1+events19:22:020
203146399207310,2060cyclictest2071661-21kworker/0:1+events21:17:160
20314739920728,2061cyclictest2079659-21kworker/3:0+events21:41:093
203147399207210,2059cyclictest2128126-21kworker/3:1+events00:28:343
203146399207210,2059cyclictest2049431-21kworker/0:0+events20:06:420
203147399207110,2058cyclictest2060554-21kworker/3:1+events20:46:563
20314699920718,2060cyclictest2049369-21kworker/2:1+events20:17:422
203146999207111,2057cyclictest2079392-21kworker/2:2+events21:40:232
203146999207110,2058cyclictest2125233-21kworker/2:4+events00:24:012
20314699920708,2058cyclictest2070152-21kworker/2:1+events21:11:392
20314639920709,2058cyclictest2057289-21kworker/0:1+events20:37:060
20314639920708,2059cyclictest2119860-21kworker/0:1+events23:42:310
20314639920706,2061cyclictest2067334-21kworker/0:0+events21:07:320
20314739920699,2057cyclictest2049709-21kworker/3:0+events20:08:133
20314699920698,2058cyclictest2052549-21kworker/2:0+events20:12:242
20314699920694,2062cyclictest2114721-21kworker/2:1+events23:40:372
203146999206910,2056cyclictest2058807-21kworker/2:2+events20:33:412
203146999206910,2055cyclictest2032971-21kworker/2:1+events19:17:272
20314699920689,2056cyclictest2133014-21kworker/2:0+events00:37:392
20314699920688,2057cyclictest2065382-21kworker/2:0+events21:06:222
20314699920687,2058cyclictest2092776-21kworker/2:1+events22:26:242
20314699920687,2058cyclictest2056085-21kworker/2:0+events20:27:592
20314699920682,2063cyclictest2076816-21kworker/2:1+events21:35:522
20314699920678,2055cyclictest2044480-21kworker/2:2+events20:04:482
20314699920674,2060cyclictest2036317-21kworker/2:0+events19:24:402
203146999206610,2053cyclictest2086347-21kworker/2:1+events22:08:592
203146999206610,2053cyclictest2039940-21kworker/2:2+events19:36:332
203146799206510,2052cyclictest2121706-21kworker/1:0+events00:32:431
20314699920649,2052cyclictest2070152-21kworker/2:1+events21:16:562
203146399206410,2051cyclictest2039733-21kworker/0:2+events19:45:420
203146399206310,2050cyclictest2060637-21kworker/0:2+events20:41:130
20314699920629,2050cyclictest2098797-21kworker/2:0+events22:46:432
203146399206110,2048cyclictest2073378-21kworker/0:0+events21:21:050
20314699920606,2052cyclictest2054210-21kworker/2:2+events20:22:352
20314679920498,2038cyclictest2032858-21kworker/1:2+events19:24:161
203146999204110,2029cyclictest2104252-21kworker/2:0+events23:01:552
20314739920409,2028cyclictest2110689-21kworker/3:0+events23:20:133
20314639920359,2023cyclictest2047716-21kworker/0:2+events20:30:180
20314639920357,2025cyclictest2059014-21kworker/0:0+events20:53:010
20314699920349,2022cyclictest2123069-21kworker/2:2+events23:58:562
203146999203310,2020cyclictest2063746-21kworker/2:2+events20:52:162
20314739920321,2028cyclictest2046060-21kworker/3:2+events19:56:273
203146799203210,2019cyclictest2133160-21kworker/1:1+events00:27:051
203146399203210,2019cyclictest2119860-21kworker/0:1+events23:50:340
20314679920244,2017cyclictest2062320-21kworker/1:0+events20:59:291
20314739920219,2009cyclictest2068401-21kworker/3:0+events21:13:313
20314639920123,2006cyclictest2023133-21kworker/0:2+events19:16:200
203147399201010,1997cyclictest2060554-21kworker/3:1+events20:59:543
20314739920069,1994cyclictest2119919-21kworker/3:1+events23:57:243
20314699920059,1993cyclictest2074709-21kworker/2:2+events21:25:142
203147399200310,1990cyclictest2029049-21kworker/3:3+events19:20:293
20314699920034,1996cyclictest2121406-21kworker/2:0+events23:49:032
20314699920034,1996cyclictest2121406-21kworker/2:0+events23:49:022
20314739920018,1988cyclictest2055709-21kworker/3:0+events20:29:543
203147399200110,1989cyclictest2116704-21kworker/3:0+events23:38:253
203147399200010,1987cyclictest2090947-21kworker/3:1+events22:21:273
203147399199910,1986cyclictest2110689-21kworker/3:0+events23:16:473
20314699919989,1986cyclictest2027926-21kworker/2:0+events19:14:222
20314639919988,1987cyclictest2115301-21kworker/0:1+events23:30:260
20314739919978,1986cyclictest2073229-21kworker/3:2+events21:33:563
20314699919977,1987cyclictest2071903-21kworker/2:0+events21:30:112
20314739919959,1983cyclictest2073229-21kworker/3:2+events21:39:153
20314739919955,1987cyclictest2032623-21kworker/3:1+events19:15:093
203147399199510,1982cyclictest2036348-21kworker/3:1+events19:25:473
203146999199510,1982cyclictest2114721-21kworker/2:1+events23:52:052
20314739919868,1975cyclictest2073229-21kworker/3:2+events21:20:433
20314739919849,1972cyclictest2128126-21kworker/3:1+events00:34:163
20314739919839,1971cyclictest2060554-21kworker/3:1+events20:43:523
20314739919546,1945cyclictest2029049-21kworker/3:3+events19:11:433
20314639919549,1942cyclictest2090857-21kworker/0:1+events22:22:110
20299022148105,23sleep20-21swapper/219:05:052
20308722142108,28sleep10-21swapper/119:05:241
20309402141108,28sleep30-21swapper/319:06:153
20309992139105,29sleep00-21swapper/019:06:590
2031469991912,1cyclictest0-21swapper/200:15:192
2031469991710,1cyclictest2092072-21/usr/sbin/munin22:15:182
203146999159,4cyclictest2113512-21sshd23:20:582
2031469991511,2cyclictest2045098-21cat19:50:142
2031463991511,3cyclictest732-21runrttasks19:10:110
2031463991510,4cyclictest2098986-21sshd22:39:590
203146999140,12cyclictest2117372-21expr23:35:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional