OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Dec 25, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1677139	99	5778	26,5748	cyclictest	1676772	-21	kworker/2:0+events	19:11:28	2
1677132	99	2825	11,2811	cyclictest	1668492	-21	kworker/0:0+events	19:11:50	0
1677132	99	2584	10,2570	cyclictest	1688427	-21	kworker/0:1+events	19:55:13	0
1677142	99	2497	12,2481	cyclictest	1733244	-21	kworker/3:1+events	22:05:11	3
1677132	99	2488	11,2473	cyclictest	1778197	-21	kworker/0:2+events	00:25:18	0
1677142	99	2486	12,2470	cyclictest	1781289	-21	kworker/3:2+events	00:35:15	3
1677132	99	2478	12,2463	cyclictest	1680290	-21	kworker/0:2+events	19:25:51	0
1677142	99	2472	11,2459	cyclictest	1694738	-21	kworker/3:1+events	20:10:21	3
1677139	99	2435	12,2419	cyclictest	1699954	-21	kworker/2:1+events	20:30:13	2
1677139	99	2435	12,2419	cyclictest	1699954	-21	kworker/2:1+events	20:30:13	2
1677142	99	2395	11,2380	cyclictest	1733244	-21	kworker/3:1+events	22:13:35	3
1677137	99	2391	12,2375	cyclictest	1708035	-21	kworker/1:1+events	20:55:17	1
1677142	99	2382	11,2368	cyclictest	1767173	-21	kworker/3:2+events	23:58:35	3
1677142	99	2381	12,2366	cyclictest	1685253	-21	kworker/3:0+events	19:35:20	3
1677137	99	2376	9,2363	cyclictest	1770320	-21	kworker/1:1+events	00:01:59	1
1677137	99	2331	11,2318	cyclictest	1779831	-21	kworker/1:2+events	00:30:17	1
1677139	99	2308	10,2295	cyclictest	1757605	-21	kworker/2:0+events	23:19:11	2
1677139	99	2307	9,2296	cyclictest	1763820	-21	kworker/2:2+events	00:00:06	2
1677132	99	2303	10,2290	cyclictest	1693442	-21	kworker/0:0+events	20:03:54	0
1677132	99	2295	10,2282	cyclictest	1750641	-21	kworker/0:2+events	23:07:00	0
1677132	99	2273	10,2261	cyclictest	1698029	-21	kworker/0:2+events	20:45:03	0
1677132	99	2273	10,2260	cyclictest	1750641	-21	kworker/0:2+events	23:03:55	0
1677132	99	2272	9,2259	cyclictest	1763878	-21	kworker/0:0+events	23:42:07	0
1677132	99	2271	10,2258	cyclictest	1774929	-21	kworker/0:0+events	00:18:45	0
1677139	99	2269	11,2256	cyclictest	1711001	-21	kworker/2:2+events	21:10:06	2
1677132	99	2268	11,2254	cyclictest	1750641	-21	kworker/0:2+events	23:19:56	0
1677132	99	2267	11,2253	cyclictest	1730317	-21	kworker/0:2+events	21:59:53	0
1677132	99	2266	8,2255	cyclictest	1693442	-21	kworker/0:0+events	20:06:55	0
1677132	99	2265	9,2253	cyclictest	1715533	-21	kworker/0:0+events	21:22:36	0
1677132	99	2265	11,2252	cyclictest	1738254	-21	kworker/0:0+events	22:50:10	0
1677132	99	2264	11,2250	cyclictest	1715533	-21	kworker/0:0+events	21:36:20	0
1677132	99	2262	11,2248	cyclictest	1765508	-21	kworker/0:2+events	23:47:54	0
1677132	99	2258	9,2246	cyclictest	1715533	-21	kworker/0:0+events	21:31:26	0
1677139	99	2254	11,2240	cyclictest	1720710	-21	kworker/2:3+events	21:29:54	2
1677137	99	2231	11,2217	cyclictest	1678336	-21	kworker/1:2+events	19:15:17	1
1677137	99	2228	11,2215	cyclictest	1712427	-21	kworker/1:0+events	21:01:20	1
1677137	99	2227	10,2214	cyclictest	1731856	-21	kworker/1:2+events	22:07:30	1
1677142	99	2225	11,2211	cyclictest	1699835	-21	kworker/3:1+events	20:20:40	3
1677137	99	2225	10,2211	cyclictest	1776499	-21	kworker/1:0+events	00:25:40	1
1677142	99	2222	11,2208	cyclictest	1706362	-21	kworker/3:2+events	20:40:27	3
1677142	99	2220	10,2206	cyclictest	1688640	-21	kworker/3:2+events	19:50:13	3
1677142	99	2217	11,2203	cyclictest	1778260	-21	kworker/3:1+events	00:34:08	3
1677137	99	2214	10,2200	cyclictest	1776499	-21	kworker/1:0+events	00:22:38	1
1677137	99	2213	11,2199	cyclictest	1742914	-21	kworker/1:0+events	22:45:12	1
1677137	99	2211	10,2199	cyclictest	1728452	-21	kworker/1:0+events	22:00:16	1
1677137	99	2204	10,2191	cyclictest	1768660	-21	kworker/1:2+events	23:54:24	1
1677137	99	2203	11,2189	cyclictest	1676278	-21	kworker/1:0+events	19:21:00	1
1677132	99	2202	11,2189	cyclictest	1725341	-21	kworker/0:2+events	21:45:06	0
1677139	99	2195	10,2182	cyclictest	1706059	-21	kworker/2:2+events	20:42:01	2
1677137	99	2191	8,2180	cyclictest	1723920	-21	kworker/1:0+events	21:34:49	1
1677142	99	2178	10,2164	cyclictest	1752562	-21	kworker/3:0+events	23:12:17	3
1677132	99	2172	11,2158	cyclictest	1701575	-21	kworker/0:1+events	20:24:48	0
1677139	99	2163	7,2153	cyclictest	1741337	-21	kworker/2:0+events	22:30:01	2
1677142	99	2149	11,2135	cyclictest	1704756	-21	kworker/3:1+events	20:46:30	3
1677139	99	2144	11,2129	cyclictest	1709373	-21	kworker/2:0+events	20:51:25	2
1677139	99	2140	7,2130	cyclictest	1763820	-21	kworker/2:2+events	23:48:39	2
1677142	99	2139	11,2125	cyclictest	1718763	-21	kworker/3:0+events	21:30:40	3
1677132	99	2138	7,2128	cyclictest	1778197	-21	kworker/0:2+events	00:38:40	0
1677132	99	2136	10,2123	cyclictest	1715533	-21	kworker/0:0+events	21:10:51	0
1677139	99	2133	10,2119	cyclictest	1741337	-21	kworker/2:0+events	22:38:47	2
1677142	99	2123	10,2109	cyclictest	1693115	-21	kworker/3:0+events	19:57:52	3
1677132	99	2114	9,2102	cyclictest	1773325	-21	kworker/0:1+events	00:10:20	0
1677139	99	2113	11,2099	cyclictest	1706059	-21	kworker/2:2+events	20:37:03	2
1677132	99	2113	13,2097	cyclictest	1683715	-21	kworker/0:1+events	19:34:32	0
1677139	99	2111	8,2100	cyclictest	1737612	-21	kworker/2:0+events	22:17:43	2
1677139	99	2111	10,2097	cyclictest	1773530	-21	kworker/2:2+events	00:19:07	2
1677132	99	2111	9,2099	cyclictest	1680290	-21	kworker/0:2+events	19:20:13	0
1677132	99	2111	10,2098	cyclictest	1742886	-21	kworker/0:1+events	22:38:00	0
1677132	99	2111	10,2097	cyclictest	1730317	-21	kworker/0:2+events	22:13:58	0
1677132	99	2107	10,2094	cyclictest	1757789	-21	kworker/0:0+events	23:23:22	0
1677132	99	2106	7,2096	cyclictest	1738254	-21	kworker/0:0+events	22:33:03	0
1677132	99	2106	4,2099	cyclictest	1698029	-21	kworker/0:2+events	20:54:06	0
1677132	99	2106	10,2093	cyclictest	1698029	-21	kworker/0:2+events	20:59:49	0
1677139	99	2105	5,2097	cyclictest	1744610	-21	kworker/2:1+events	23:03:32	2
1677132	99	2104	10,2091	cyclictest	1762234	-21	kworker/0:1+events	23:38:37	0
1677132	99	2103	8,2092	cyclictest	1715533	-21	kworker/0:0+events	21:17:40	0
1677132	99	2103	8,2092	cyclictest	1706210	-21	kworker/0:1+events	20:42:25	0
1677132	99	2102	6,2093	cyclictest	1750641	-21	kworker/0:2+events	23:31:00	0
1677132	99	2101	8,2090	cyclictest	1675001	-21	kworker/0:1+events	19:19:28	0
1677132	99	2101	10,2088	cyclictest	1778197	-21	kworker/0:2+events	00:34:52	0
1677139	99	2100	10,2087	cyclictest	1744610	-21	kworker/2:1+events	22:43:42	2
1677132	99	2100	10,2087	cyclictest	1754400	-21	kworker/0:0+events	23:11:56	0
1677139	99	2098	8,2087	cyclictest	1779684	-21	kworker/2:2+events	00:30:40	2
1677132	99	2098	10,2085	cyclictest	1698029	-21	kworker/0:2+events	20:34:00	0
1677132	99	2098	10,2085	cyclictest	1698029	-21	kworker/0:2+events	20:34:00	0
1677137	99	2097	11,2083	cyclictest	1728452	-21	kworker/1:0+events	21:53:24	1
1677139	99	2096	8,2085	cyclictest	1693320	-21	kworker/2:2+events	20:28:15	2
1677139	99	2096	10,2084	cyclictest	1711001	-21	kworker/2:2+events	21:05:10	2
1677139	99	2096	10,2083	cyclictest	1733422	-21	kworker/2:1+events	22:09:45	2
1677139	99	2095	10,2082	cyclictest	1735110	-21	kworker/2:2+events	22:12:03	2
1677137	99	2095	10,2082	cyclictest	1736382	-21	kworker/1:0+events	22:16:36	1
1677132	99	2095	10,2083	cyclictest	1712696	-21	kworker/0:1+events	21:05:32	0
1677139	99	2093	10,2080	cyclictest	1718973	-21	kworker/2:1+events	21:41:43	2
1677132	99	2089	6,2080	cyclictest	1701575	-21	kworker/0:1+events	20:26:20	0
1677142	99	2088	11,2074	cyclictest	1712396	-21	kworker/3:2+events	20:58:42	3
1677132	99	2085	10,2073	cyclictest	1768808	-21	kworker/0:0+events	00:05:02	0
1677142	99	2081	9,2067	cyclictest	1771815	-21	kworker/3:0+events	00:06:32	3
1677142	99	2081	11,2067	cyclictest	1759325	-21	kworker/3:1+events	23:33:42	3
1677142	99	2080	10,2067	cyclictest	1752562	-21	kworker/3:0+events	23:02:45	3
1677132	99	2080	7,2070	cyclictest	1750641	-21	kworker/0:2+events	22:59:18	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00