OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Wed Nov 26, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1753356	99	2806	9,2793	cyclictest	1791526	-21	kworker/2:0+events	21:10:18	2
1753352	99	2668	13,2651	cyclictest	1820555	-21	kworker/1:1+events	22:50:10	1
1753360	99	2631	13,2614	cyclictest	1823657	-21	kworker/3:1+events	23:00:18	3
1753352	99	2614	13,2599	cyclictest	1830162	-21	kworker/1:0+events	23:10:16	1
1753352	99	2594	12,2577	cyclictest	1767815	-21	kworker/1:2+events	20:20:12	1
1753350	99	2587	12,2572	cyclictest	1817265	-21	kworker/0:0+events	22:45:18	0
1753360	99	2579	12,2564	cyclictest	1847713	-21	kworker/3:2+events	00:05:19	3
1753352	99	2555	9,2542	cyclictest	1850755	-21	kworker/1:1+events	00:35:19	1
1753352	99	2488	10,2475	cyclictest	1767815	-21	kworker/1:2+events	19:58:44	1
1753352	99	2487	10,2474	cyclictest	1783799	-21	kworker/1:0+events	20:50:15	1
1753360	99	2486	12,2471	cyclictest	1820317	-21	kworker/3:2+events	22:45:41	3
1753352	99	2479	12,2463	cyclictest	1758454	-21	kworker/1:2+events	19:30:13	1
1753352	99	2479	11,2465	cyclictest	1794719	-21	kworker/1:1+events	21:25:30	1
1753352	99	2453	11,2439	cyclictest	1783799	-21	kworker/1:0+events	21:04:18	1
1753352	99	2407	10,2393	cyclictest	1798211	-21	kworker/1:2+events	21:45:16	1
1753352	99	2381	12,2366	cyclictest	1798211	-21	kworker/1:2+events	21:33:53	1
1753352	99	2376	9,2365	cyclictest	1804642	-21	kworker/1:1+events	21:55:06	1
1753360	99	2355	12,2338	cyclictest	1809323	-21	kworker/3:0+events	22:04:17	3
1753350	99	2354	12,2339	cyclictest	1834866	-21	kworker/0:0+events	23:53:31	0
1753356	99	2343	11,2328	cyclictest	1809228	-21	kworker/2:2+events	22:25:14	2
1753350	99	2324	11,2309	cyclictest	1831615	-21	kworker/0:1+events	23:18:10	0
1753356	99	2322	9,2309	cyclictest	1759873	-21	kworker/2:2+events	19:26:47	2
1753360	99	2315	12,2300	cyclictest	1823657	-21	kworker/3:1+events	22:58:03	3
1753352	99	2310	11,2296	cyclictest	1780598	-21	kworker/1:2+events	20:41:56	1
1753352	99	2283	11,2268	cyclictest	1828524	-21	kworker/1:1+events	23:05:16	1
1753352	99	2272	11,2258	cyclictest	1818897	-21	kworker/1:2+events	23:03:45	1
1753352	99	2272	11,2258	cyclictest	1788629	-21	kworker/1:2+events	21:21:21	1
1753352	99	2269	10,2256	cyclictest	1761750	-21	kworker/1:0+events	19:46:11	1
1753352	99	2267	11,2253	cyclictest	1746834	-21	kworker/1:1+events	19:14:19	1
1753352	99	2267	10,2254	cyclictest	1831762	-21	kworker/1:1+events	23:16:42	1
1753352	99	2267	10,2254	cyclictest	1798211	-21	kworker/1:2+events	21:38:03	1
1753352	99	2266	9,2254	cyclictest	1850755	-21	kworker/1:1+events	00:33:49	1
1753352	99	2266	11,2252	cyclictest	1817201	-21	kworker/1:0+events	22:29:47	1
1753352	99	2265	9,2253	cyclictest	1780598	-21	kworker/1:2+events	20:33:51	1
1753352	99	2265	11,2251	cyclictest	1830162	-21	kworker/1:0+events	23:20:28	1
1753352	99	2264	10,2250	cyclictest	1780598	-21	kworker/1:2+events	20:38:07	1
1753352	99	2262	10,2248	cyclictest	1798211	-21	kworker/1:2+events	21:51:18	1
1753360	99	2258	11,2245	cyclictest	1806119	-21	kworker/3:1+events	22:05:03	3
1753350	99	2257	11,2243	cyclictest	1825579	-21	kworker/0:2+events	22:59:55	0
1753360	99	2256	8,2245	cyclictest	1783739	-21	kworker/3:1+events	20:47:57	3
1753360	99	2255	11,2240	cyclictest	1769539	-21	kworker/3:1+events	20:04:05	3
1753360	99	2254	8,2243	cyclictest	1845967	-21	kworker/3:1+events	23:58:03	3
1753360	99	2252	6,2243	cyclictest	1758421	-21	kworker/3:1+events	19:23:46	3
1753352	99	2250	10,2237	cyclictest	1818897	-21	kworker/1:2+events	22:38:07	1
1753352	99	2249	11,2235	cyclictest	1793118	-21	kworker/1:0+events	21:12:11	1
1753352	99	2241	9,2229	cyclictest	1763418	-21	kworker/1:2+events	19:41:10	1
1753352	99	2237	10,2224	cyclictest	1767815	-21	kworker/1:2+events	20:15:56	1
1753360	99	2235	7,2225	cyclictest	1830128	-21	kworker/3:1+events	23:08:45	3
1753352	99	2235	11,2221	cyclictest	1837977	-21	kworker/1:2+events	23:39:54	1
1753356	99	2226	10,2213	cyclictest	1759873	-21	kworker/2:2+events	19:37:31	2
1753350	99	2225	10,2212	cyclictest	1817265	-21	kworker/0:0+events	23:10:40	0
1753356	99	2222	11,2207	cyclictest	1850641	-21	kworker/2:0+events	00:18:09	2
1753356	99	2222	10,2209	cyclictest	1798152	-21	kworker/2:1+events	21:44:31	2
1753356	99	2219	10,2206	cyclictest	1799784	-21	kworker/2:2+events	21:36:35	2
1753356	99	2217	6,2207	cyclictest	1841349	-21	kworker/2:1+events	00:03:03	2
1753356	99	2217	10,2204	cyclictest	1759873	-21	kworker/2:2+events	19:31:46	2
1753356	99	2216	11,2202	cyclictest	1835018	-21	kworker/2:1+events	23:30:00	2
1753356	99	2215	7,2205	cyclictest	1777363	-21	kworker/2:0+events	20:22:49	2
1753356	99	2214	8,2203	cyclictest	1850641	-21	kworker/2:0+events	00:29:55	2
1753356	99	2214	8,2203	cyclictest	1841349	-21	kworker/2:1+events	23:46:41	2
1753352	99	2212	9,2200	cyclictest	1788629	-21	kworker/1:2+events	21:08:26	1
1753352	99	2206	10,2193	cyclictest	1817201	-21	kworker/1:0+events	22:33:55	1
1753352	99	2201	11,2188	cyclictest	1850755	-21	kworker/1:1+events	00:25:01	1
1753356	99	2199	11,2185	cyclictest	1828703	-21	kworker/2:0+events	23:06:49	2
1753356	99	2197	9,2185	cyclictest	1772583	-21	kworker/2:1+events	20:19:49	2
1753356	99	2196	7,2187	cyclictest	1795311	-21	kworker/2:2+events	21:25:07	2
1753356	99	2196	11,2182	cyclictest	1798152	-21	kworker/2:1+events	22:05:48	2
1753356	99	2196	10,2183	cyclictest	1766570	-21	kworker/2:0+events	19:53:24	2
1753356	99	2195	10,2182	cyclictest	1825308	-21	kworker/2:0+events	22:54:18	2
1753356	99	2194	11,2180	cyclictest	1820284	-21	kworker/2:2+events	22:42:14	2
1753356	99	2191	10,2178	cyclictest	1815879	-21	kworker/2:0+events	22:36:33	2
1753352	99	2189	10,2175	cyclictest	1769448	-21	kworker/1:1+events	20:12:05	1
1753350	99	2189	11,2174	cyclictest	1855842	-21	kworker/0:2+events	00:32:16	0
1753356	99	2183	10,2170	cyclictest	1826969	-21	kworker/2:1+events	23:11:03	2
1753350	99	2178	11,2165	cyclictest	1836652	-21	kworker/0:3+events	23:35:20	0
1753352	99	2176	11,2162	cyclictest	1812344	-21	kworker/1:1+events	22:18:43	1
1753356	99	2171	9,2159	cyclictest	1810860	-21	kworker/2:0+events	22:13:01	2
1753350	99	2167	10,2154	cyclictest	1775892	-21	kworker/0:0+events	20:29:39	0
1753360	99	2165	8,2154	cyclictest	1804435	-21	kworker/3:0+events	21:48:16	3
1753352	99	2165	10,2152	cyclictest	1809591	-21	kworker/1:2+events	22:08:03	1
1753356	99	2164	10,2151	cyclictest	1841349	-21	kworker/2:1+events	23:58:49	2
1753356	99	2162	11,2148	cyclictest	1775736	-21	kworker/2:2+events	20:32:39	2
1753350	99	2162	7,2152	cyclictest	1806376	-21	kworker/0:2+events	22:15:42	0
1753350	99	2162	11,2149	cyclictest	1772678	-21	kworker/0:1+events	20:15:10	0
1753350	99	2161	10,2148	cyclictest	1828403	-21	kworker/0:1+events	23:02:35	0
1753356	99	2160	7,2150	cyclictest	1785492	-21	kworker/2:2+events	20:50:39	2
1753356	99	2160	6,2151	cyclictest	1815879	-21	kworker/2:0+events	22:30:32	2
1753356	99	2160	11,2146	cyclictest	1775736	-21	kworker/2:2+events	20:39:39	2
1753356	99	2160	10,2147	cyclictest	1803133	-21	kworker/2:2+events	21:47:31	2
1753352	99	2159	10,2146	cyclictest	1852362	-21	kworker/1:2+events	00:22:44	1
1753350	99	2159	11,2145	cyclictest	1839819	-21	kworker/0:1+events	23:40:16	0
1753350	99	2158	8,2147	cyclictest	1772678	-21	kworker/0:1+events	20:11:43	0
1753350	99	2157	10,2144	cyclictest	1817265	-21	kworker/0:0+events	22:43:01	0
1753350	99	2155	10,2142	cyclictest	1793385	-21	kworker/0:0+events	21:27:02	0
1753350	99	2154	11,2140	cyclictest	1847860	-21	kworker/0:1+events	00:09:28	0
1753350	99	2153	6,2144	cyclictest	1788598	-21	kworker/0:1+events	21:11:47	0
1753350	99	2153	11,2139	cyclictest	1752962	-21	kworker/0:2+events	19:33:20	0
1753350	99	2153	10,2140	cyclictest	1757008	-21	kworker/0:1+events	19:24:07	0
1753350	99	2152	11,2138	cyclictest	1763320	-21	kworker/0:1+events	20:00:41	0
1753350	99	2152	10,2139	cyclictest	1855842	-21	kworker/0:2+events	00:38:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00