OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Jan 29, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2875210	99	2762	13,2744	cyclictest	2949339	-21	kworker/1:1+events	23:30:16	1
2875210	99	2758	13,2741	cyclictest	2886265	-21	kworker/1:0+events	19:45:19	1
2875214	99	2755	13,2740	cyclictest	2879919	-21	kworker/2:1+events	19:25:16	2
2875214	99	2737	13,2718	cyclictest	2897403	-21	kworker/2:2+events	20:20:12	2
2875214	99	2736	11,2721	cyclictest	2973875	-21	kworker/2:2+events	00:15:18	2
2875210	99	2720	13,2703	cyclictest	2929643	-21	kworker/1:0+events	22:00:16	1
2875214	99	2682	13,2665	cyclictest	2958823	-21	kworker/2:1+events	23:35:15	2
2875214	99	2680	13,2664	cyclictest	2929552	-21	kworker/2:2+events	22:04:26	2
2875219	99	2582	9,2567	cyclictest	2895772	-21	kworker/3:2+events	20:19:26	3
2875210	99	2525	12,2509	cyclictest	2873292	-21	kworker/1:1+events	19:20:18	1
2875210	99	2504	12,2488	cyclictest	2947603	-21	kworker/1:2+events	22:55:21	1
2875214	99	2489	12,2475	cyclictest	2937699	-21	kworker/2:2+events	22:45:07	2
2875219	99	2469	12,2453	cyclictest	2942774	-21	kworker/3:1+events	22:41:20	3
2875219	99	2467	12,2452	cyclictest	2936452	-21	kworker/3:2+events	22:34:24	3
2875210	99	2447	12,2432	cyclictest	2909521	-21	kworker/1:2+events	21:38:59	1
2875219	99	2426	12,2411	cyclictest	2921791	-21	kworker/3:0+events	21:35:11	3
2875210	99	2426	12,2413	cyclictest	2954403	-21	kworker/1:0+events	23:20:01	1
2875210	99	2425	12,2409	cyclictest	2909521	-21	kworker/1:2+events	21:05:56	1
2875210	99	2416	11,2402	cyclictest	2939398	-21	kworker/1:0+events	22:31:23	1
2875208	99	2398	12,2383	cyclictest	2905831	-21	kworker/0:2+events	20:58:41	0
2875210	99	2392	11,2378	cyclictest	2923425	-21	kworker/1:0+events	21:49:37	1
2875219	99	2391	11,2376	cyclictest	2934588	-21	kworker/3:1+events	22:22:15	3
2875210	99	2391	11,2376	cyclictest	2949339	-21	kworker/1:1+events	23:18:06	1
2875210	99	2383	11,2368	cyclictest	2931329	-21	kworker/1:1+events	22:37:30	1
2875219	99	2381	11,2367	cyclictest	2929675	-21	kworker/3:2+events	22:13:11	3
2875214	99	2380	12,2364	cyclictest	2886383	-21	kworker/2:1+events	19:43:47	2
2875210	99	2380	12,2366	cyclictest	2931329	-21	kworker/1:1+events	22:21:05	1
2875219	99	2379	12,2365	cyclictest	2884235	-21	kworker/3:0+events	20:01:13	3
2875219	99	2372	10,2360	cyclictest	2884235	-21	kworker/3:0+events	20:06:07	3
2875210	99	2372	12,2356	cyclictest	2884641	-21	kworker/1:2+events	19:44:10	1
2875219	99	2363	12,2348	cyclictest	2884235	-21	kworker/3:0+events	19:52:31	3
2875214	99	2362	12,2347	cyclictest	2937699	-21	kworker/2:2+events	22:26:26	2
2875210	99	2360	12,2345	cyclictest	2899081	-21	kworker/1:0+events	20:23:35	1
2875208	99	2359	12,2344	cyclictest	2890949	-21	kworker/0:0+events	19:58:10	0
2875219	99	2357	12,2344	cyclictest	2980458	-21	kworker/3:2+events	00:35:04	3
2875214	99	2357	3,2350	cyclictest	2939331	-21	kworker/2:1+events	22:33:16	2
2875214	99	2357	11,2343	cyclictest	2965935	-21	kworker/2:0+events	23:53:16	2
2875214	99	2353	10,2340	cyclictest	2947540	-21	kworker/2:2+events	22:54:12	2
2875214	99	2351	11,2336	cyclictest	2977046	-21	kworker/2:1+events	00:32:46	2
2875214	99	2349	11,2334	cyclictest	2873189	-21	kworker/2:2+events	19:14:55	2
2875214	99	2349	11,2334	cyclictest	2873189	-21	kworker/2:2+events	19:14:55	2
2875208	99	2342	9,2330	cyclictest	2883448	-21	kworker/0:0+events	19:40:00	0
2875219	99	2339	12,2324	cyclictest	2952478	-21	kworker/3:2+events	23:13:29	3
2875208	99	2339	12,2324	cyclictest	2975662	-21	kworker/0:1+events	00:20:16	0
2875208	99	2337	12,2321	cyclictest	2936071	-21	kworker/0:2+events	22:29:29	0
2875208	99	2337	11,2323	cyclictest	2937761	-21	kworker/0:0+events	22:33:38	0
2875208	99	2336	12,2320	cyclictest	2978948	-21	kworker/0:0+events	00:38:26	0
2875208	99	2331	8,2319	cyclictest	2950902	-21	kworker/0:0+events	23:06:41	0
2875208	99	2321	9,2309	cyclictest	2919064	-21	kworker/0:1+events	21:28:22	0
2875219	99	2317	12,2302	cyclictest	2954160	-21	kworker/3:1+events	23:23:26	3
2875214	99	2311	12,2296	cyclictest	2973875	-21	kworker/2:2+events	00:13:47	2
2875210	99	2299	12,2284	cyclictest	2969058	-21	kworker/1:0+events	00:27:04	1
2875214	99	2293	11,2278	cyclictest	2942447	-21	kworker/2:0+events	22:56:50	2
2875210	99	2293	12,2278	cyclictest	2895710	-21	kworker/1:0+events	20:12:55	1
2875210	99	2282	11,2267	cyclictest	2881467	-21	kworker/1:1+events	19:36:13	1
2875208	99	2280	11,2266	cyclictest	2955416	-21	kworker/0:1+events	23:33:44	0
2875208	99	2272	11,2257	cyclictest	2955416	-21	kworker/0:1+events	23:19:15	0
2875214	99	2266	11,2252	cyclictest	2914022	-21	kworker/2:2+events	21:11:17	2
2875214	99	2262	11,2248	cyclictest	2873189	-21	kworker/2:2+events	19:24:30	2
2875208	99	2260	11,2246	cyclictest	2944429	-21	kworker/0:1+events	22:49:40	0
2875210	99	2247	12,2231	cyclictest	2931329	-21	kworker/1:1+events	22:40:33	1
2875219	99	2229	11,2214	cyclictest	2915510	-21	kworker/3:1+events	21:33:18	3
2875214	99	2221	11,2207	cyclictest	2884725	-21	kworker/2:2+events	19:37:42	2
2875210	99	2219	11,2205	cyclictest	2927980	-21	kworker/1:2+events	22:05:35	1
2875219	99	2209	11,2195	cyclictest	2934588	-21	kworker/3:1+events	22:25:19	3
2875210	99	2199	8,2187	cyclictest	2891242	-21	kworker/1:2+events	20:03:05	1
2875210	99	2199	10,2185	cyclictest	2892862	-21	kworker/1:1+events	20:33:37	1
2875210	99	2197	10,2184	cyclictest	2875305	-21	kworker/1:0+events	19:16:50	1
2875210	99	2196	7,2185	cyclictest	2969058	-21	kworker/1:0+events	00:19:28	1
2875210	99	2196	11,2182	cyclictest	2873292	-21	kworker/1:1+events	19:13:46	1
2875210	99	2196	11,2182	cyclictest	2873292	-21	kworker/1:1+events	19:13:46	1
2875210	99	2196	11,2181	cyclictest	2963862	-21	kworker/1:1+events	23:50:33	1
2875210	99	2196	10,2182	cyclictest	2918617	-21	kworker/1:0+events	21:24:14	1
2875210	99	2194	10,2181	cyclictest	2909521	-21	kworker/1:2+events	21:15:32	1
2875219	99	2193	10,2179	cyclictest	2921791	-21	kworker/3:0+events	21:44:17	3
2875210	99	2193	11,2179	cyclictest	2909521	-21	kworker/1:2+events	21:25:44	1
2875210	99	2191	9,2179	cyclictest	2965724	-21	kworker/1:2+events	00:01:39	1
2875210	99	2191	11,2177	cyclictest	2973392	-21	kworker/1:2+events	00:14:57	1
2875210	99	2191	10,2178	cyclictest	2909521	-21	kworker/1:2+events	21:33:38	1
2875219	99	2189	10,2176	cyclictest	2958852	-21	kworker/3:2+events	23:27:36	3
2875210	99	2189	10,2176	cyclictest	2945880	-21	kworker/1:0+events	22:52:45	1
2875214	99	2187	10,2173	cyclictest	2883102	-21	kworker/2:0+events	19:51:22	2
2875219	99	2186	11,2172	cyclictest	2903838	-21	kworker/3:1+events	20:42:21	3
2875210	99	2186	10,2173	cyclictest	2969058	-21	kworker/1:0+events	00:32:01	1
2875210	99	2185	11,2172	cyclictest	2957336	-21	kworker/1:2+events	23:27:14	1
2875219	99	2184	10,2171	cyclictest	2942774	-21	kworker/3:1+events	23:07:05	3
2875210	99	2184	11,2170	cyclictest	2958971	-21	kworker/1:0+events	23:45:34	1
2875210	99	2184	10,2170	cyclictest	2945880	-21	kworker/1:0+events	23:02:26	1
2875208	99	2184	10,2171	cyclictest	2902208	-21	kworker/0:1+events	20:46:57	0
2875219	99	2183	10,2170	cyclictest	2905585	-21	kworker/3:0+events	20:50:43	3
2875214	99	2183	9,2170	cyclictest	2952449	-21	kworker/2:2+events	23:23:49	2
2875219	99	2182	12,2167	cyclictest	2880131	-21	kworker/3:0+events	19:27:54	3
2875210	99	2182	11,2168	cyclictest	2981196	-21	kworker/1:2+events	00:36:56	1
2875219	99	2181	8,2170	cyclictest	2926678	-21	kworker/3:1+events	21:53:47	3
2875210	99	2181	11,2166	cyclictest	2905462	-21	kworker/1:1+events	20:57:32	1
2875219	99	2180	11,2166	cyclictest	2888047	-21	kworker/3:2+events	19:58:35	3
2875219	99	2179	11,2165	cyclictest	2942774	-21	kworker/3:1+events	22:50:47	3
2875214	99	2179	11,2164	cyclictest	2977046	-21	kworker/2:1+events	00:38:04	2
2875219	99	2178	11,2164	cyclictest	2931297	-21	kworker/3:1+events	22:07:55	3
2875219	99	2177	11,2163	cyclictest	2978794	-21	kworker/3:0+events	00:32:22	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00