OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sat Nov 29, 2025 00:44:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3174659	99	3043	10,3028	cyclictest	3206661	-21	kworker/1:0+events	21:05:14	1
3174659	99	3002	14,2982	cyclictest	3221092	-21	kworker/1:0+events	21:35:23	1
3174654	99	2968	13,2951	cyclictest	3241991	-21	kworker/0:2+events	23:05:20	0
3174664	99	2906	14,2887	cyclictest	3216259	-21	kworker/3:0+events	21:40:17	3
3174661	99	2804	11,2789	cyclictest	3184289	-21	kworker/2:0+events	19:50:01	2
3174654	99	2804	13,2785	cyclictest	3241991	-21	kworker/0:2+events	22:50:13	0
3174664	99	2728	12,2711	cyclictest	3188889	-21	kworker/3:1+events	20:00:15	3
3174661	99	2624	13,2607	cyclictest	3209834	-21	kworker/2:1+events	21:10:14	2
3174659	99	2592	12,2576	cyclictest	3189184	-21	kworker/1:1+events	20:05:16	1
3174654	99	2567	12,2551	cyclictest	3251907	-21	kworker/0:1+events	23:10:19	0
3174661	99	2494	12,2479	cyclictest	3263226	-21	kworker/2:2+events	23:46:57	2
3174659	99	2494	12,2478	cyclictest	3275746	-21	kworker/1:2+events	00:27:56	1
3174661	99	2492	12,2477	cyclictest	3278811	-21	kworker/2:2+events	00:39:48	2
3174661	99	2471	11,2457	cyclictest	3220796	-21	kworker/2:0+events	21:39:55	2
3174661	99	2449	12,2434	cyclictest	3258366	-21	kworker/2:0+events	23:44:15	2
3174654	99	2448	11,2433	cyclictest	3274302	-21	kworker/0:2+events	00:21:06	0
3174654	99	2448	11,2433	cyclictest	3253508	-21	kworker/0:2+events	23:27:08	0
3174654	99	2445	11,2431	cyclictest	3178087	-21	kworker/0:2+events	19:33:30	0
3174661	99	2437	11,2423	cyclictest	3190893	-21	kworker/2:2+events	20:04:52	2
3174661	99	2430	11,2416	cyclictest	3272698	-21	kworker/2:2+events	00:17:41	2
3174659	99	2426	9,2414	cyclictest	3235498	-21	kworker/1:2+events	22:20:57	1
3174654	99	2424	9,2412	cyclictest	3240390	-21	kworker/0:0+events	22:34:33	0
3174661	99	2421	8,2410	cyclictest	3250360	-21	kworker/2:2+events	23:22:56	2
3174654	99	2412	10,2398	cyclictest	3178087	-21	kworker/0:2+events	19:30:00	0
3174661	99	2406	14,2389	cyclictest	3240450	-21	kworker/2:1+events	22:40:19	2
3174661	99	2403	11,2388	cyclictest	3222395	-21	kworker/2:1+events	22:10:21	2
3174664	99	2395	11,2381	cyclictest	3260065	-21	kworker/3:0+events	23:48:52	3
3174664	99	2391	12,2376	cyclictest	3254841	-21	kworker/3:0+events	23:22:32	3
3174664	99	2389	11,2375	cyclictest	3270946	-21	kworker/3:0+events	00:14:59	3
3174664	99	2386	12,2371	cyclictest	3200144	-21	kworker/3:0+events	20:49:22	3
3174664	99	2371	12,2356	cyclictest	3227944	-21	kworker/3:2+events	22:14:48	3
3174654	99	2354	12,2338	cyclictest	3214743	-21	kworker/0:0+events	21:18:11	0
3174659	99	2342	12,2328	cyclictest	3180534	-21	kworker/1:1+events	19:36:35	1
3174664	99	2332	11,2317	cyclictest	3222367	-21	kworker/3:1+events	21:50:11	3
3174661	99	2332	11,2318	cyclictest	3243645	-21	kworker/2:0+events	23:13:46	2
3174661	99	2328	8,2316	cyclictest	3164785	-21	kworker/2:1+events	19:15:11	2
3174659	99	2322	10,2308	cyclictest	3244035	-21	kworker/1:2+events	23:02:22	1
3174659	99	2316	11,2302	cyclictest	3189184	-21	kworker/1:1+events	19:56:06	1
3174659	99	2309	11,2295	cyclictest	3195436	-21	kworker/1:0+events	20:18:31	1
3174664	99	2299	12,2284	cyclictest	3240509	-21	kworker/3:1+events	22:44:29	3
3174659	99	2296	10,2283	cyclictest	3184168	-21	kworker/1:2+events	19:40:24	1
3174659	99	2293	10,2280	cyclictest	3238781	-21	kworker/1:0+events	22:41:49	1
3174661	99	2287	11,2273	cyclictest	3198573	-21	kworker/2:2+events	20:26:52	2
3174659	99	2281	12,2266	cyclictest	3225617	-21	kworker/1:0+events	21:57:25	1
3174659	99	2278	11,2264	cyclictest	3251664	-21	kworker/1:1+events	23:41:35	1
3174661	99	2276	10,2263	cyclictest	3206571	-21	kworker/2:2+events	20:57:44	2
3174654	99	2276	10,2263	cyclictest	3209745	-21	kworker/0:2+events	21:03:43	0
3174661	99	2275	11,2260	cyclictest	3263226	-21	kworker/2:2+events	23:50:23	2
3174659	99	2274	11,2259	cyclictest	3230770	-21	kworker/1:0+events	22:17:27	1
3174661	99	2272	11,2257	cyclictest	3200234	-21	kworker/2:1+events	20:35:37	2
3174661	99	2272	11,2257	cyclictest	3164785	-21	kworker/2:1+events	19:28:28	2
3174659	99	2272	11,2259	cyclictest	3232691	-21	kworker/1:1+events	22:11:27	1
3174659	99	2272	10,2258	cyclictest	3219398	-21	kworker/1:1+events	21:35:00	1
3174659	99	2271	11,2257	cyclictest	3238781	-21	kworker/1:0+events	22:34:57	1
3174661	99	2270	11,2256	cyclictest	3259972	-21	kworker/2:2+events	23:34:02	2
3174659	99	2270	11,2256	cyclictest	3263256	-21	kworker/1:0+events	23:54:58	1
3174659	99	2270	11,2256	cyclictest	3238781	-21	kworker/1:0+events	22:39:33	1
3174659	99	2270	11,2256	cyclictest	3230770	-21	kworker/1:0+events	22:09:58	1
3174659	99	2269	9,2257	cyclictest	3195436	-21	kworker/1:0+events	20:28:46	1
3174659	99	2269	10,2256	cyclictest	3187553	-21	kworker/1:2+events	19:54:55	1
3174661	99	2268	9,2255	cyclictest	3254780	-21	kworker/2:1+events	23:29:52	2
3174661	99	2268	11,2254	cyclictest	3243645	-21	kworker/2:0+events	22:57:29	2
3174661	99	2268	10,2255	cyclictest	3259972	-21	kworker/2:2+events	23:35:54	2
3174659	99	2268	9,2256	cyclictest	3275746	-21	kworker/1:2+events	00:31:22	1
3174661	99	2267	9,2255	cyclictest	3203340	-21	kworker/2:0+events	20:53:36	2
3174659	99	2267	8,2256	cyclictest	3266433	-21	kworker/1:1+events	00:03:17	1
3174659	99	2267	11,2253	cyclictest	3206661	-21	kworker/1:0+events	21:13:39	1
3174659	99	2267	10,2254	cyclictest	3205029	-21	kworker/1:1+events	20:45:34	1
3174661	99	2265	10,2251	cyclictest	3270859	-21	kworker/2:0+events	00:25:17	2
3174659	99	2265	10,2252	cyclictest	3219398	-21	kworker/1:1+events	21:29:38	1
3174661	99	2264	8,2253	cyclictest	3220796	-21	kworker/2:0+events	21:32:42	2
3174661	99	2264	10,2251	cyclictest	3190893	-21	kworker/2:2+events	20:15:28	2
3174661	99	2263	11,2249	cyclictest	3200234	-21	kworker/2:1+events	20:32:57	2
3174659	99	2263	11,2249	cyclictest	3246761	-21	kworker/1:1+events	22:57:51	1
3174661	99	2262	6,2252	cyclictest	3263226	-21	kworker/2:2+events	00:04:27	2
3174661	99	2262	10,2249	cyclictest	3270859	-21	kworker/2:0+events	00:13:53	2
3174661	99	2260	11,2246	cyclictest	3224079	-21	kworker/2:2+events	21:43:20	2
3174661	99	2260	10,2246	cyclictest	3203340	-21	kworker/2:0+events	20:46:19	2
3174661	99	2259	11,2245	cyclictest	3229151	-21	kworker/2:0+events	22:31:33	2
3174661	99	2255	10,2241	cyclictest	3250360	-21	kworker/2:2+events	23:19:52	2
3174661	99	2255	10,2241	cyclictest	3179416	-21	kworker/2:0+events	19:23:57	2
3174659	99	2254	11,2240	cyclictest	3251664	-21	kworker/1:1+events	23:25:14	1
3174664	99	2251	10,2239	cyclictest	3184351	-21	kworker/3:0+events	19:40:01	3
3174659	99	2249	10,2236	cyclictest	3227512	-21	kworker/1:1+events	22:03:08	1
3174654	99	2241	10,2228	cyclictest	3272666	-21	kworker/0:1+events	00:19:11	0
3174654	99	2239	10,2226	cyclictest	3181282	-21	kworker/0:0+events	19:48:04	0
3174654	99	2238	10,2224	cyclictest	3241991	-21	kworker/0:2+events	23:03:52	0
3174661	99	2237	9,2224	cyclictest	3196921	-21	kworker/2:1+events	20:22:19	2
3174654	99	2236	9,2224	cyclictest	3234109	-21	kworker/0:0+events	22:16:20	0
3174654	99	2234	10,2221	cyclictest	3256352	-21	kworker/0:1+events	23:42:21	0
3174654	99	2234	10,2220	cyclictest	3220976	-21	kworker/0:1+events	21:52:02	0
3174654	99	2231	10,2218	cyclictest	3263075	-21	kworker/0:0+events	00:08:09	0
3174654	99	2229	10,2216	cyclictest	3245220	-21	kworker/0:1+events	22:58:36	0
3174654	99	2229	10,2216	cyclictest	3230654	-21	kworker/0:0+events	22:04:15	0
3174661	99	2227	11,2213	cyclictest	3164785	-21	kworker/2:1+events	19:30:47	2
3174654	99	2226	10,2212	cyclictest	3277808	-21	kworker/0:1+events	00:35:11	0
3174661	99	2224	9,2212	cyclictest	3229151	-21	kworker/2:0+events	22:15:57	2
3174654	99	2223	11,2208	cyclictest	3187337	-21	kworker/0:2+events	19:59:53	0
3174654	99	2222	11,2208	cyclictest	3274302	-21	kworker/0:2+events	00:33:17	0
3174654	99	2221	11,2207	cyclictest	3217443	-21	kworker/0:2+events	21:25:49	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00