OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun Feb 01, 2026 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
112331	99	2870	13,2851	cyclictest	212243	-21	kworker/1:2+events	00:20:13	1
112327	99	2821	14,2802	cyclictest	128923	-21	kworker/0:0+events	20:00:12	0
112337	99	2797	13,2780	cyclictest	137219	-21	kworker/3:2+events	20:25:18	3
112327	99	2704	10,2691	cyclictest	213887	-21	kworker/0:2+events	00:30:22	0
112331	99	2677	13,2661	cyclictest	215496	-21	kworker/1:2+events	00:29:59	1
112335	99	2617	10,2603	cyclictest	145278	-21	kworker/2:2+events	21:10:15	2
112331	99	2564	11,2549	cyclictest	185390	-21	kworker/1:1+events	22:56:30	1
112327	99	2530	11,2517	cyclictest	177205	-21	kworker/0:2+events	22:35:02	0
112335	99	2500	11,2484	cyclictest	187141	-21	kworker/2:0+events	23:00:13	2
112331	99	2494	12,2479	cyclictest	154550	-21	kworker/1:2+events	21:25:28	1
112335	99	2488	12,2474	cyclictest	166391	-21	kworker/2:1+events	22:03:11	2
112335	99	2484	12,2469	cyclictest	185454	-21	kworker/2:1+events	22:55:20	2
112327	99	2480	12,2465	cyclictest	186903	-21	kworker/0:2+events	22:56:52	0
112331	99	2478	11,2464	cyclictest	148736	-21	kworker/1:2+events	21:01:28	1
112331	99	2478	11,2464	cyclictest	148736	-21	kworker/1:2+events	21:01:27	1
112335	99	2477	11,2462	cyclictest	198763	-21	kworker/2:2+events	23:39:43	2
112331	99	2476	11,2461	cyclictest	141940	-21	kworker/1:2+events	20:43:40	1
112331	99	2473	12,2458	cyclictest	154550	-21	kworker/1:2+events	21:19:21	1
112331	99	2468	13,2453	cyclictest	103362	-21	kworker/1:1+events	19:15:02	1
112335	99	2452	11,2439	cyclictest	183759	-21	kworker/2:0+events	22:50:02	2
112327	99	2451	12,2436	cyclictest	210575	-21	kworker/0:0+events	00:17:35	0
112327	99	2444	12,2428	cyclictest	213887	-21	kworker/0:2+events	00:24:21	0
112327	99	2443	12,2429	cyclictest	173983	-21	kworker/0:2+events	22:20:37	0
112327	99	2442	9,2429	cyclictest	149866	-21	kworker/0:1+events	21:20:53	0
112331	99	2441	12,2425	cyclictest	148736	-21	kworker/1:2+events	21:05:20	1
112337	99	2437	12,2421	cyclictest	208026	-21	kworker/3:0+events	00:15:16	3
112337	99	2427	12,2411	cyclictest	153455	-21	kworker/3:2+events	21:35:18	3
112327	99	2421	10,2407	cyclictest	122245	-21	kworker/0:0+events	19:43:50	0
112337	99	2407	12,2391	cyclictest	159350	-21	kworker/3:0+events	21:45:14	3
112337	99	2405	11,2390	cyclictest	151618	-21	kworker/3:1+events	21:15:12	3
112327	99	2405	12,2390	cyclictest	130724	-21	kworker/0:1+events	20:11:14	0
112337	99	2399	11,2384	cyclictest	146818	-21	kworker/3:0+events	21:08:21	3
112335	99	2397	11,2383	cyclictest	153099	-21	kworker/2:1+events	21:18:11	2
112331	99	2397	12,2381	cyclictest	122013	-21	kworker/1:2+events	19:50:14	1
112337	99	2395	11,2381	cyclictest	151618	-21	kworker/3:1+events	21:12:08	3
112335	99	2393	6,2383	cyclictest	198763	-21	kworker/2:2+events	23:52:25	2
112335	99	2390	0,2386	cyclictest	174199	-21	kworker/2:0+events	22:31:34	2
112337	99	2388	11,2374	cyclictest	208026	-21	kworker/3:0+events	00:27:46	3
112335	99	2383	12,2367	cyclictest	197043	-21	kworker/2:0+events	23:29:03	2
112335	99	2371	11,2356	cyclictest	174199	-21	kworker/2:0+events	22:29:43	2
112327	99	2354	12,2338	cyclictest	208643	-21	kworker/0:2+events	00:14:08	0
112331	99	2351	11,2335	cyclictest	188731	-21	kworker/1:1+events	23:25:15	1
112337	99	2350	11,2335	cyclictest	201695	-21	kworker/3:2+events	23:53:11	3
112337	99	2325	10,2311	cyclictest	208026	-21	kworker/3:0+events	00:11:29	3
112337	99	2303	12,2287	cyclictest	128985	-21	kworker/3:0+events	20:00:36	3
112331	99	2302	11,2288	cyclictest	181471	-21	kworker/1:2+events	22:46:37	1
112331	99	2291	11,2278	cyclictest	156211	-21	kworker/1:0+events	21:35:39	1
112327	99	2290	10,2276	cyclictest	182369	-21	kworker/0:2+events	22:44:42	0
112331	99	2288	11,2273	cyclictest	179101	-21	kworker/1:0+events	22:38:29	1
112331	99	2278	11,2263	cyclictest	137070	-21	kworker/1:1+events	20:36:47	1
112331	99	2277	11,2263	cyclictest	188731	-21	kworker/1:1+events	23:05:12	1
112335	99	2276	11,2262	cyclictest	187141	-21	kworker/2:0+events	23:16:12	2
112331	99	2276	11,2261	cyclictest	103362	-21	kworker/1:1+events	19:33:15	1
112331	99	2275	10,2262	cyclictest	154550	-21	kworker/1:2+events	21:22:49	1
112335	99	2273	11,2259	cyclictest	206544	-21	kworker/2:0+events	00:01:37	2
112335	99	2273	11,2259	cyclictest	204942	-21	kworker/2:1+events	23:57:45	2
112331	99	2273	11,2259	cyclictest	161393	-21	kworker/1:1+events	21:54:50	1
112331	99	2273	11,2258	cyclictest	197223	-21	kworker/1:0+events	23:31:20	1
112335	99	2272	11,2258	cyclictest	213987	-21	kworker/2:1+events	00:30:42	2
112335	99	2272	11,2257	cyclictest	203268	-21	kworker/2:0+events	23:49:43	2
112335	99	2271	10,2257	cyclictest	105065	-21	kworker/2:2+events	19:13:55	2
112331	99	2271	11,2256	cyclictest	183791	-21	kworker/1:0+events	23:04:01	1
112335	99	2270	11,2256	cyclictest	180291	-21	kworker/2:2+events	22:40:50	2
112331	99	2270	10,2257	cyclictest	156211	-21	kworker/1:0+events	21:31:52	1
112331	99	2270	10,2256	cyclictest	122013	-21	kworker/1:2+events	19:41:54	1
112335	99	2269	11,2256	cyclictest	120840	-21	kworker/2:2+events	19:40:23	2
112335	99	2269	11,2255	cyclictest	160922	-21	kworker/2:0+events	21:39:30	2
112335	99	2269	10,2255	cyclictest	218512	-21	kworker/2:2+events	00:38:21	2
112331	99	2269	9,2257	cyclictest	143623	-21	kworker/1:1+events	20:45:32	1
112331	99	2269	11,2256	cyclictest	201664	-21	kworker/1:2+events	00:00:03	1
112335	99	2268	11,2254	cyclictest	208912	-21	kworker/2:2+events	00:08:04	2
112331	99	2268	9,2255	cyclictest	145219	-21	kworker/1:0+events	20:56:54	1
112331	99	2268	10,2255	cyclictest	172565	-21	kworker/1:0+events	22:18:25	1
112331	99	2267	10,2254	cyclictest	215496	-21	kworker/1:2+events	00:39:31	1
112331	99	2267	10,2254	cyclictest	197223	-21	kworker/1:0+events	23:38:58	1
112335	99	2266	11,2251	cyclictest	210513	-21	kworker/2:1+events	00:16:02	2
112335	99	2266	10,2253	cyclictest	151348	-21	kworker/2:0+events	21:09:31	2
112331	99	2265	8,2253	cyclictest	125579	-21	kworker/1:0+events	19:59:04	1
112331	99	2265	11,2250	cyclictest	208880	-21	kworker/1:1+events	00:17:12	1
112335	99	2264	8,2253	cyclictest	195384	-21	kworker/2:1+events	23:30:56	2
112335	99	2264	10,2251	cyclictest	174199	-21	kworker/2:0+events	22:19:31	2
112335	99	2264	10,2251	cyclictest	160922	-21	kworker/2:0+events	21:53:16	2
112335	99	2264	10,2251	cyclictest	115973	-21	kworker/2:1+events	19:23:48	2
112331	99	2264	10,2251	cyclictest	164235	-21	kworker/1:2+events	21:56:21	1
112331	99	2264	10,2250	cyclictest	137070	-21	kworker/1:1+events	20:34:06	1
112335	99	2263	8,2251	cyclictest	156356	-21	kworker/2:1+events	21:31:28	2
112335	99	2263	11,2249	cyclictest	120840	-21	kworker/2:2+events	19:46:26	2
112331	99	2263	11,2249	cyclictest	135186	-21	kworker/1:2+events	20:29:27	1
112335	99	2262	10,2249	cyclictest	180291	-21	kworker/2:2+events	23:21:27	2
112331	99	2262	10,2248	cyclictest	215496	-21	kworker/1:2+events	00:31:51	1
112327	99	2262	11,2247	cyclictest	154459	-21	kworker/0:0+events	21:17:49	0
112335	99	2261	10,2248	cyclictest	156356	-21	kworker/2:1+events	21:29:55	2
112337	99	2257	10,2243	cyclictest	192112	-21	kworker/3:2+events	23:30:11	3
112335	99	2257	10,2243	cyclictest	141907	-21	kworker/2:2+events	20:39:51	2
112337	99	2256	10,2242	cyclictest	183853	-21	kworker/3:1+events	22:58:21	3
112335	99	2253	9,2241	cyclictest	127409	-21	kworker/2:0+events	20:08:12	2
112331	99	2253	11,2239	cyclictest	164235	-21	kworker/1:2+events	22:00:31	1
112331	99	2253	10,2240	cyclictest	170929	-21	kworker/1:1+events	22:13:06	1
112327	99	2253	10,2239	cyclictest	194346	-21	kworker/0:2+events	23:24:06	0
112335	99	2251	11,2237	cyclictest	174199	-21	kworker/2:0+events	22:24:22	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00