OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Feb 16, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3047414	99	3564	17,3543	cyclictest	3060091	-21	kworker/3:1+events	19:59:59	3
3047404	99	3106	15,3088	cyclictest	3074480	-21	kworker/0:0+events	20:35:19	0
3047407	99	3033	15,3013	cyclictest	3105087	-21	kworker/1:1+events	22:25:14	1
3047414	99	2798	7,2787	cyclictest	3053810	-21	kworker/3:0+events	19:35:20	3
3047407	99	2798	13,2781	cyclictest	3064790	-21	kworker/1:2+events	20:05:14	1
3047407	99	2733	14,2715	cyclictest	3096854	-21	kworker/1:2+events	21:45:01	1
3047412	99	2721	13,2704	cyclictest	3102156	-21	kworker/2:0+events	22:20:14	2
3047412	99	2621	12,2606	cyclictest	3143990	-21	kworker/2:0+events	00:10:00	2
3047412	99	2609	13,2592	cyclictest	3148893	-21	kworker/2:0+events	00:35:12	2
3047412	99	2596	12,2581	cyclictest	3071302	-21	kworker/2:1+events	20:45:12	2
3047412	99	2590	12,2574	cyclictest	3148893	-21	kworker/2:0+events	00:25:18	2
3047407	99	2534	10,2520	cyclictest	3147141	-21	kworker/1:1+events	00:20:17	1
3047407	99	2518	12,2502	cyclictest	3096854	-21	kworker/1:2+events	22:02:13	1
3047407	99	2497	12,2482	cyclictest	3145538	-21	kworker/1:0+events	00:15:19	1
3047407	99	2483	12,2467	cyclictest	3069743	-21	kworker/1:0+events	20:34:08	1
3047414	99	2480	12,2465	cyclictest	3061862	-21	kworker/3:0+events	20:04:54	3
3047412	99	2480	12,2464	cyclictest	3116118	-21	kworker/2:0+events	23:08:54	2
3047407	99	2478	11,2463	cyclictest	3087092	-21	kworker/1:1+events	21:28:03	1
3047407	99	2473	11,2458	cyclictest	3075873	-21	kworker/1:2+events	20:40:15	1
3047412	99	2460	12,2445	cyclictest	3050673	-21	kworker/2:1+events	19:36:06	2
3047412	99	2457	12,2441	cyclictest	3126223	-21	kworker/2:1+events	23:21:09	2
3047407	99	2453	11,2438	cyclictest	3064790	-21	kworker/1:2+events	20:03:01	1
3047414	99	2451	12,2436	cyclictest	3136268	-21	kworker/3:2+events	23:52:02	3
3047414	99	2451	12,2436	cyclictest	3136268	-21	kworker/3:2+events	23:45:29	3
3047414	99	2451	11,2437	cyclictest	3119546	-21	kworker/3:2+events	23:09:18	3
3047412	99	2449	12,2433	cyclictest	3102156	-21	kworker/2:0+events	22:06:50	2
3047407	99	2449	12,2434	cyclictest	3105087	-21	kworker/1:1+events	22:45:48	1
3047404	99	2448	13,2432	cyclictest	3069622	-21	kworker/0:1+events	20:26:57	0
3047407	99	2447	12,2432	cyclictest	3043963	-21	kworker/1:2+events	19:16:19	1
3047414	99	2446	12,2431	cyclictest	3103629	-21	kworker/3:1+events	22:17:07	3
3047412	99	2444	12,2429	cyclictest	3145661	-21	kworker/2:2+events	00:18:44	2
3047412	99	2444	11,2429	cyclictest	3060122	-21	kworker/2:0+events	19:49:04	2
3047407	99	2444	12,2429	cyclictest	3105087	-21	kworker/1:1+events	22:39:41	1
3047407	99	2444	12,2428	cyclictest	3069743	-21	kworker/1:0+events	20:22:00	1
3047407	99	2441	12,2425	cyclictest	3145538	-21	kworker/1:0+events	00:12:42	1
3047407	99	2441	11,2427	cyclictest	3071947	-21	kworker/1:2+events	20:29:59	1
3047414	99	2436	10,2423	cyclictest	3064849	-21	kworker/3:2+events	20:06:47	3
3047412	99	2425	10,2412	cyclictest	3077558	-21	kworker/2:0+events	20:56:10	2
3047414	99	2421	12,2406	cyclictest	3142360	-21	kworker/3:1+events	00:05:45	3
3047407	99	2421	10,2409	cyclictest	3077501	-21	kworker/1:1+events	20:56:33	1
3047412	99	2420	11,2406	cyclictest	3111528	-21	kworker/2:2+events	22:34:19	2
3047404	99	2419	11,2405	cyclictest	3092126	-21	kworker/0:0+events	21:30:18	0
3047412	99	2415	12,2400	cyclictest	3102156	-21	kworker/2:0+events	22:00:21	2
3047414	99	2406	11,2391	cyclictest	3108474	-21	kworker/3:2+events	22:25:37	3
3047414	99	2396	12,2381	cyclictest	3097200	-21	kworker/3:2+events	21:59:58	3
3047412	99	2396	10,2383	cyclictest	3137803	-21	kworker/2:2+events	00:01:10	2
3047407	99	2396	12,2380	cyclictest	3127915	-21	kworker/1:0+events	23:20:01	1
3047404	99	2393	12,2378	cyclictest	3150531	-21	kworker/0:2+events	00:33:17	0
3047414	99	2390	9,2378	cyclictest	3088816	-21	kworker/3:0+events	21:17:51	3
3047414	99	2376	12,2361	cyclictest	3068018	-21	kworker/3:1+events	20:17:04	3
3047407	99	2367	11,2353	cyclictest	3087092	-21	kworker/1:1+events	21:51:57	1
3047407	99	2354	12,2339	cyclictest	3056893	-21	kworker/1:2+events	19:46:25	1
3047412	99	2345	10,2331	cyclictest	3058429	-21	kworker/2:2+events	19:52:47	2
3047414	99	2333	11,2319	cyclictest	3082354	-21	kworker/3:1+events	21:00:18	3
3047404	99	2331	12,2315	cyclictest	3107040	-21	kworker/0:2+events	22:38:54	0
3047404	99	2329	12,2314	cyclictest	3145630	-21	kworker/0:1+events	00:17:57	0
3047404	99	2328	12,2313	cyclictest	3152168	-21	kworker/0:1+events	00:39:25	0
3047404	99	2327	12,2313	cyclictest	3131116	-21	kworker/0:2+events	23:41:14	0
3047404	99	2326	12,2310	cyclictest	3090410	-21	kworker/0:1+events	21:48:06	0
3047404	99	2324	12,2309	cyclictest	3084239	-21	kworker/0:2+events	21:10:13	0
3047404	99	2315	12,2300	cyclictest	3137653	-21	kworker/0:0+events	23:48:58	0
3047407	99	2306	10,2293	cyclictest	3053605	-21	kworker/1:0+events	19:30:50	1
3047412	99	2297	12,2282	cyclictest	3116118	-21	kworker/2:0+events	22:57:41	2
3047407	99	2294	8,2283	cyclictest	3087092	-21	kworker/1:1+events	21:22:02	1
3047407	99	2285	11,2270	cyclictest	3082680	-21	kworker/1:0+events	21:07:11	1
3047414	99	2284	10,2270	cyclictest	3093665	-21	kworker/3:2+events	21:38:35	3
3047412	99	2276	10,2262	cyclictest	3050673	-21	kworker/2:1+events	19:26:18	2
3047404	99	2273	10,2260	cyclictest	3143959	-21	kworker/0:0+events	00:07:41	0
3047414	99	2269	11,2254	cyclictest	3053810	-21	kworker/3:0+events	19:45:19	3
3047412	99	2269	10,2256	cyclictest	3117826	-21	kworker/2:1+events	22:49:58	2
3047412	99	2265	9,2253	cyclictest	3024526	-21	kworker/2:2+events	19:22:08	2
3047407	99	2261	8,2249	cyclictest	3116182	-21	kworker/1:0+events	22:52:38	1
3047407	99	2260	12,2245	cyclictest	3139378	-21	kworker/1:0+events	00:00:01	1
3047407	99	2258	11,2244	cyclictest	3150439	-21	kworker/1:1+events	00:29:29	1
3047407	99	2253	10,2240	cyclictest	3152099	-21	kworker/1:2+events	00:35:58	1
3047414	99	2250	11,2235	cyclictest	3114551	-21	kworker/3:0+events	22:46:58	3
3047414	99	2242	10,2229	cyclictest	3072995	-21	kworker/3:0+events	20:49:42	3
3047407	99	2241	10,2228	cyclictest	3105087	-21	kworker/1:1+events	22:14:26	1
3047404	99	2240	9,2227	cyclictest	3124728	-21	kworker/0:1+events	23:21:56	0
3047412	99	2239	10,2226	cyclictest	3082649	-21	kworker/2:2+events	21:24:16	2
3047404	99	2238	11,2224	cyclictest	3098448	-21	kworker/0:2+events	22:01:51	0
3047414	99	2236	11,2222	cyclictest	3142360	-21	kworker/3:1+events	00:12:19	3
3047414	99	2235	11,2220	cyclictest	3079246	-21	kworker/3:2+events	21:21:41	3
3047407	99	2235	10,2223	cyclictest	3074244	-21	kworker/1:1+events	20:35:40	1
3047414	99	2233	8,2222	cyclictest	3072995	-21	kworker/3:0+events	20:38:43	3
3047414	99	2231	11,2217	cyclictest	3136268	-21	kworker/3:2+events	23:58:31	3
3047414	99	2231	11,2217	cyclictest	3101946	-21	kworker/3:0+events	22:04:55	3
3047407	99	2231	10,2217	cyclictest	3096854	-21	kworker/1:2+events	21:56:07	1
3047414	99	2230	10,2216	cyclictest	3134660	-21	kworker/3:0+events	23:40:29	3
3047412	99	2230	11,2216	cyclictest	3116118	-21	kworker/2:0+events	23:01:07	2
3047412	99	2230	11,2216	cyclictest	3065085	-21	kworker/2:0+events	20:10:35	2
3047407	99	2230	11,2216	cyclictest	3126015	-21	kworker/1:2+events	23:33:53	1
3047412	99	2229	8,2218	cyclictest	3053931	-21	kworker/2:2+events	19:34:13	2
3047412	99	2229	11,2215	cyclictest	3085912	-21	kworker/2:0+events	21:14:48	2
3047414	99	2227	11,2213	cyclictest	3148955	-21	kworker/3:1+events	00:25:42	3
3047414	99	2227	10,2214	cyclictest	3127822	-21	kworker/3:2+events	23:17:18	3
3047412	99	2227	11,2213	cyclictest	3088781	-21	kworker/2:1+events	21:18:14	2
3047412	99	2227	11,2213	cyclictest	3058429	-21	kworker/2:2+events	19:44:09	2
3047412	99	2227	11,2212	cyclictest	3132667	-21	kworker/2:2+events	23:41:37	2
3047412	99	2227	10,2214	cyclictest	3126223	-21	kworker/2:1+events	23:35:49	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00