OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Wed Dec 10, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4165864	99	2905	14,2885	cyclictest	50202	-21	kworker/2:0+events	23:15:14	2
4165856	99	2778	13,2762	cyclictest	56873	-21	kworker/0:2+events	23:35:00	0
4165864	99	2755	13,2737	cyclictest	53789	-21	kworker/2:0+events	23:55:16	2
4165864	99	2718	9,2705	cyclictest	4175368	-21	kworker/2:1+events	19:40:14	2
4165864	99	2707	13,2691	cyclictest	4172074	-21	kworker/2:2+events	19:35:15	2
4165864	99	2670	13,2653	cyclictest	58567	-21	kworker/2:1+events	23:50:17	2
4165864	99	2654	12,2638	cyclictest	24534	-21	kworker/2:0+events	21:58:43	2
4165856	99	2560	12,2544	cyclictest	20133	-21	kworker/0:2+events	22:05:14	0
4165859	99	2559	12,2543	cyclictest	4165519	-21	kworker/1:2+events	19:30:20	1
4165859	99	2527	12,2512	cyclictest	64895	-21	kworker/1:0+events	00:20:01	1
4165864	99	2491	9,2480	cyclictest	58567	-21	kworker/2:1+events	23:41:03	2
4165859	99	2483	11,2469	cyclictest	58270	-21	kworker/1:1+events	23:41:48	1
4165859	99	2476	12,2460	cyclictest	2624	-21	kworker/1:2+events	21:02:03	1
4165866	99	2473	12,2457	cyclictest	768	-21	kworker/3:1+events	20:41:10	3
4165864	99	2470	9,2458	cyclictest	39196	-21	kworker/2:1+events	22:45:16	2
4165859	99	2460	8,2448	cyclictest	23025	-21	kworker/1:2+events	21:48:26	1
4165864	99	2452	11,2437	cyclictest	71114	-21	kworker/2:1+events	00:25:18	2
4165856	99	2431	11,2417	cyclictest	4191574	-21	kworker/0:0+events	20:40:01	0
4165864	99	2419	12,2403	cyclictest	39196	-21	kworker/2:1+events	22:43:46	2
4165859	99	2408	12,2392	cyclictest	2624	-21	kworker/1:2+events	20:50:15	1
4165859	99	2403	12,2387	cyclictest	4177055	-21	kworker/1:2+events	19:57:31	1
4165856	99	2400	12,2385	cyclictest	15110	-21	kworker/0:1+events	21:26:26	0
4165864	99	2397	12,2381	cyclictest	55393	-21	kworker/2:2+events	23:31:11	2
4165856	99	2395	12,2380	cyclictest	10243	-21	kworker/0:2+events	21:06:18	0
4165856	99	2394	12,2379	cyclictest	13450	-21	kworker/0:0+events	21:17:45	0
4165856	99	2390	12,2375	cyclictest	72923	-21	kworker/0:2+events	00:31:21	0
4165864	99	2383	12,2368	cyclictest	66273	-21	kworker/2:0+events	00:02:35	2
4165864	99	2383	11,2368	cyclictest	45723	-21	kworker/2:0+events	23:03:00	2
4165864	99	2382	12,2367	cyclictest	4178689	-21	kworker/2:2+events	19:50:11	2
4165864	99	2364	12,2348	cyclictest	4175368	-21	kworker/2:1+events	20:03:17	2
4165859	99	2363	8,2352	cyclictest	59921	-21	kworker/1:0+events	23:51:48	1
4165859	99	2354	11,2342	cyclictest	70534	-21	kworker/1:2+events	00:21:09	1
4165859	99	2354	10,2340	cyclictest	4165519	-21	kworker/1:2+events	19:26:36	1
4165866	99	2347	10,2334	cyclictest	67848	-21	kworker/3:2+events	00:25:41	3
4165864	99	2340	9,2328	cyclictest	24534	-21	kworker/2:0+events	21:53:48	2
4165866	99	2337	9,2325	cyclictest	30961	-21	kworker/3:2+events	22:13:52	3
4165859	99	2337	11,2323	cyclictest	10301	-21	kworker/1:0+events	21:21:31	1
4165864	99	2333	12,2317	cyclictest	26168	-21	kworker/2:1+events	22:01:00	2
4165859	99	2327	12,2312	cyclictest	4193064	-21	kworker/1:1+events	20:38:30	1
4165864	99	2289	11,2275	cyclictest	24534	-21	kworker/2:0+events	22:05:36	2
4165866	99	2285	10,2272	cyclictest	8728	-21	kworker/3:0+events	21:13:57	3
4165859	99	2280	10,2266	cyclictest	59921	-21	kworker/1:0+events	23:45:19	1
4165866	99	2279	9,2266	cyclictest	39104	-21	kworker/3:0+events	22:47:10	3
4165859	99	2267	10,2253	cyclictest	4165519	-21	kworker/1:2+events	19:21:59	1
4165866	99	2266	12,2251	cyclictest	29332	-21	kworker/3:1+events	22:18:48	3
4165859	99	2265	11,2251	cyclictest	46969	-21	kworker/1:1+events	23:02:40	1
4165866	99	2264	10,2251	cyclictest	4189820	-21	kworker/3:2+events	20:26:59	3
4165859	99	2262	8,2251	cyclictest	58270	-21	kworker/1:1+events	00:10:13	1
4165859	99	2259	10,2245	cyclictest	4181664	-21	kworker/1:0+events	20:01:22	1
4165859	99	2257	9,2245	cyclictest	4163874	-21	kworker/1:0+events	19:16:39	1
4165859	99	2256	8,2245	cyclictest	74223	-21	kworker/1:0+events	00:30:11	1
4165859	99	2246	10,2233	cyclictest	64895	-21	kworker/1:0+events	00:04:51	1
4165864	99	2244	11,2230	cyclictest	66273	-21	kworker/2:0+events	00:11:21	2
4165866	99	2242	12,2227	cyclictest	24864	-21	kworker/3:2+events	21:56:49	3
4165864	99	2241	12,2226	cyclictest	4178689	-21	kworker/2:2+events	19:58:18	2
4165859	99	2239	10,2226	cyclictest	34392	-21	kworker/1:1+events	22:25:58	1
4165859	99	2238	10,2225	cyclictest	15227	-21	kworker/1:1+events	21:34:26	1
4165864	99	2237	11,2224	cyclictest	42473	-21	kworker/2:2+events	22:50:32	2
4165859	99	2236	7,2225	cyclictest	21361	-21	kworker/1:0+events	21:43:35	1
4165859	99	2231	10,2218	cyclictest	26317	-21	kworker/1:0+events	22:00:38	1
4165859	99	2230	10,2217	cyclictest	4191423	-21	kworker/1:0+events	20:32:23	1
4165859	99	2230	10,2217	cyclictest	4191423	-21	kworker/1:0+events	20:32:23	1
4165856	99	2230	10,2217	cyclictest	2384	-21	kworker/0:2+events	20:51:03	0
4165859	99	2226	7,2216	cyclictest	46969	-21	kworker/1:1+events	23:18:18	1
4165859	99	2224	9,2212	cyclictest	4173766	-21	kworker/1:0+events	19:36:00	1
4165859	99	2224	10,2211	cyclictest	28096	-21	kworker/1:2+events	22:08:12	1
4165859	99	2223	10,2210	cyclictest	58270	-21	kworker/1:1+events	23:59:52	1
4165859	99	2214	10,2200	cyclictest	70534	-21	kworker/1:2+events	00:27:10	1
4165859	99	2213	7,2203	cyclictest	64895	-21	kworker/1:0+events	00:09:03	1
4165856	99	2212	11,2198	cyclictest	39048	-21	kworker/0:2+events	22:40:00	0
4165859	99	2205	11,2191	cyclictest	7073	-21	kworker/1:1+events	20:56:42	1
4165856	99	2202	10,2188	cyclictest	45407	-21	kworker/0:1+events	23:11:25	0
4165856	99	2201	11,2187	cyclictest	53636	-21	kworker/0:1+events	23:25:51	0
4165856	99	2200	11,2186	cyclictest	67789	-21	kworker/0:1+events	00:08:19	0
4165866	99	2199	10,2186	cyclictest	4183412	-21	kworker/3:0+events	20:08:13	3
4165856	99	2199	11,2184	cyclictest	10243	-21	kworker/0:2+events	21:11:14	0
4165856	99	2199	10,2186	cyclictest	31021	-21	kworker/0:2+events	22:19:59	0
4165856	99	2198	10,2185	cyclictest	51631	-21	kworker/0:2+events	23:16:47	0
4165856	99	2198	10,2185	cyclictest	4181633	-21	kworker/0:2+events	20:32:47	0
4165856	99	2198	10,2185	cyclictest	4181633	-21	kworker/0:2+events	20:32:46	0
4165866	99	2196	11,2182	cyclictest	67848	-21	kworker/3:2+events	00:20:23	3
4165856	99	2196	9,2184	cyclictest	58507	-21	kworker/0:0+events	23:42:35	0
4165856	99	2196	6,2187	cyclictest	4181633	-21	kworker/0:2+events	20:29:16	0
4165856	99	2196	10,2183	cyclictest	53636	-21	kworker/0:1+events	23:39:08	0
4165856	99	2195	11,2181	cyclictest	4167187	-21	kworker/0:0+events	19:25:27	0
4165856	99	2191	11,2177	cyclictest	40906	-21	kworker/0:0+events	22:45:37	0
4165864	99	2190	5,2181	cyclictest	4175368	-21	kworker/2:1+events	20:12:25	2
4165864	99	2189	11,2174	cyclictest	50202	-21	kworker/2:0+events	23:13:19	2
4165859	99	2189	11,2175	cyclictest	4183352	-21	kworker/1:1+events	20:07:05	1
4165856	99	2187	10,2174	cyclictest	4177086	-21	kworker/0:1+events	20:00:58	0
4165856	99	2187	10,2174	cyclictest	18464	-21	kworker/0:0+events	21:36:19	0
4165864	99	2186	5,2177	cyclictest	71114	-21	kworker/2:1+events	00:34:46	2
4165864	99	2185	11,2171	cyclictest	4186498	-21	kworker/2:0+events	20:18:13	2
4165864	99	2185	11,2171	cyclictest	4186498	-21	kworker/2:0+events	20:18:13	2
4165859	99	2185	10,2172	cyclictest	32686	-21	kworker/1:0+events	22:21:52	1
4165859	99	2185	10,2172	cyclictest	28096	-21	kworker/1:2+events	22:19:35	1
4165856	99	2185	10,2172	cyclictest	34215	-21	kworker/0:1+events	22:30:11	0
4165864	99	2184	10,2171	cyclictest	2475	-21	kworker/2:2+events	20:50:39	2
4165856	99	2184	9,2172	cyclictest	4175398	-21	kworker/0:0+events	19:44:27	0
4165864	99	2183	11,2169	cyclictest	37538	-21	kworker/2:2+events	22:33:59	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00