OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Mar 30, 2026 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2023891	99	3145	15,3126	cyclictest	2033808	-21	kworker/0:1+events	19:45:21	0
2023901	99	2999	15,2980	cyclictest	2079192	-21	kworker/3:2+events	22:00:00	3
2023897	99	2889	7,2878	cyclictest	2082421	-21	kworker/2:1+events	22:10:13	2
2023901	99	2769	13,2752	cyclictest	2038545	-21	kworker/3:1+events	19:55:12	3
2023901	99	2768	12,2750	cyclictest	2088488	-21	kworker/3:0+events	22:35:11	3
2023891	99	2754	11,2738	cyclictest	2063229	-21	kworker/0:1+events	21:10:47	0
2023891	99	2671	13,2654	cyclictest	2069632	-21	kworker/0:0+events	21:40:12	0
2023895	99	2656	8,2644	cyclictest	2064657	-21	kworker/1:0+events	21:20:21	1
2023901	99	2645	13,2628	cyclictest	2069577	-21	kworker/3:0+events	21:30:15	3
2023901	99	2630	10,2615	cyclictest	2046820	-21	kworker/3:2+events	20:20:15	3
2023901	99	2625	13,2609	cyclictest	2025437	-21	kworker/3:2+events	19:25:16	3
2023895	99	2592	12,2574	cyclictest	2115955	-21	kworker/1:2+events	00:05:15	1
2023895	99	2542	13,2525	cyclictest	2064657	-21	kworker/1:0+events	21:18:08	1
2023901	99	2536	12,2520	cyclictest	2082545	-21	kworker/3:2+events	22:16:16	3
2023901	99	2525	10,2511	cyclictest	2128481	-21	kworker/3:2+events	00:37:42	3
2023901	99	2525	10,2511	cyclictest	2128481	-21	kworker/3:2+events	00:37:42	3
2023891	99	2508	9,2495	cyclictest	2053132	-21	kworker/0:1+events	20:44:19	0
2023901	99	2500	7,2489	cyclictest	2117903	-21	kworker/3:0+events	00:03:00	3
2023897	99	2497	12,2482	cyclictest	2075889	-21	kworker/2:1+events	21:47:22	2
2023891	99	2493	12,2477	cyclictest	2046850	-21	kworker/0:0+events	20:21:25	0
2023895	99	2491	11,2477	cyclictest	2046611	-21	kworker/1:0+events	20:51:57	1
2023895	99	2490	12,2474	cyclictest	2127056	-21	kworker/1:1+events	00:31:36	1
2023895	99	2490	12,2474	cyclictest	2127056	-21	kworker/1:1+events	00:31:36	1
2023901	99	2487	12,2473	cyclictest	2038545	-21	kworker/3:1+events	20:05:06	3
2023901	99	2487	12,2471	cyclictest	2056334	-21	kworker/3:0+events	20:52:21	3
2023891	99	2486	10,2473	cyclictest	2089084	-21	kworker/0:1+events	22:40:52	0
2023891	99	2483	12,2468	cyclictest	2122083	-21	kworker/0:0+events	00:31:12	0
2023891	99	2483	12,2468	cyclictest	2122083	-21	kworker/0:0+events	00:31:11	0
2023891	99	2480	10,2467	cyclictest	2097998	-21	kworker/0:0+events	23:06:29	0
2023891	99	2467	12,2451	cyclictest	2106463	-21	kworker/0:2+events	23:30:17	0
2023901	99	2460	11,2445	cyclictest	2077558	-21	kworker/3:0+events	22:12:30	3
2023901	99	2456	12,2442	cyclictest	2040494	-21	kworker/3:0+events	20:01:18	3
2023901	99	2456	12,2440	cyclictest	2117903	-21	kworker/3:0+events	00:17:50	3
2023891	99	2455	6,2445	cyclictest	2115688	-21	kworker/0:1+events	00:09:44	0
2023897	99	2454	11,2440	cyclictest	2109501	-21	kworker/2:0+events	23:43:33	2
2023901	99	2453	12,2438	cyclictest	2059607	-21	kworker/3:1+events	21:02:22	3
2023901	99	2453	12,2437	cyclictest	2091842	-21	kworker/3:1+events	22:42:47	3
2023901	99	2453	10,2439	cyclictest	2061301	-21	kworker/3:0+events	21:16:35	3
2023901	99	2451	12,2436	cyclictest	2028741	-21	kworker/3:1+events	19:22:58	3
2023901	99	2451	12,2435	cyclictest	2103255	-21	kworker/3:2+events	23:17:10	3
2023901	99	2451	12,2435	cyclictest	2095130	-21	kworker/3:1+events	23:35:35	3
2023901	99	2450	11,2436	cyclictest	2093495	-21	kworker/3:2+events	22:52:22	3
2023901	99	2449	12,2434	cyclictest	2079192	-21	kworker/3:2+events	22:02:38	3
2023901	99	2447	11,2432	cyclictest	2120662	-21	kworker/3:1+events	00:09:22	3
2023901	99	2446	10,2433	cyclictest	2074353	-21	kworker/3:2+events	21:50:49	3
2023901	99	2442	11,2427	cyclictest	2099990	-21	kworker/3:2+events	23:07:15	3
2023901	99	2439	12,2424	cyclictest	2051624	-21	kworker/3:0+events	20:36:38	3
2023891	99	2437	10,2424	cyclictest	2117377	-21	kworker/0:0+events	00:04:53	0
2023891	99	2435	12,2419	cyclictest	2068032	-21	kworker/0:2+events	21:25:20	0
2023897	99	2427	12,2412	cyclictest	2002823	-21	kworker/2:1+events	19:20:19	2
2023897	99	2426	12,2411	cyclictest	2104558	-21	kworker/2:2+events	23:16:48	2
2023891	99	2422	12,2407	cyclictest	2089084	-21	kworker/0:1+events	22:33:19	0
2023891	99	2422	10,2409	cyclictest	2115688	-21	kworker/0:1+events	00:11:38	0
2023895	99	2420	12,2405	cyclictest	2046611	-21	kworker/1:0+events	20:39:40	1
2023891	99	2420	11,2405	cyclictest	2066048	-21	kworker/0:0+events	21:20:43	0
2023891	99	2419	12,2404	cyclictest	2054850	-21	kworker/0:2+events	20:58:30	0
2023891	99	2419	12,2403	cyclictest	2063229	-21	kworker/0:1+events	21:19:16	0
2023891	99	2418	12,2402	cyclictest	2103167	-21	kworker/0:2+events	23:15:15	0
2023891	99	2412	11,2399	cyclictest	2108342	-21	kworker/0:0+events	23:40:10	0
2023897	99	2408	12,2393	cyclictest	2104558	-21	kworker/2:2+events	23:22:35	2
2023895	99	2402	11,2388	cyclictest	2117559	-21	kworker/1:1+events	00:03:46	1
2023891	99	2398	11,2383	cyclictest	2095073	-21	kworker/0:1+events	22:57:01	0
2023891	99	2392	12,2377	cyclictest	2122083	-21	kworker/0:0+events	00:17:27	0
2023901	99	2388	9,2375	cyclictest	2025437	-21	kworker/3:2+events	19:46:28	3
2023901	99	2384	10,2370	cyclictest	2063196	-21	kworker/3:1+events	21:42:05	3
2023901	99	2383	12,2368	cyclictest	2048533	-21	kworker/3:1+events	20:30:12	3
2023891	99	2381	11,2368	cyclictest	2095073	-21	kworker/0:1+events	22:50:06	0
2023891	99	2376	10,2363	cyclictest	2077646	-21	kworker/0:1+events	22:06:28	0
2023901	99	2372	11,2357	cyclictest	2046820	-21	kworker/3:2+events	20:25:13	3
2023895	99	2371	11,2357	cyclictest	2053431	-21	kworker/1:1+events	20:41:13	1
2023891	99	2365	12,2350	cyclictest	2108342	-21	kworker/0:0+events	23:39:26	0
2023895	99	2363	8,2351	cyclictest	2082302	-21	kworker/1:0+events	22:09:49	1
2023895	99	2363	12,2348	cyclictest	2059454	-21	kworker/1:2+events	21:00:27	1
2023897	99	2357	11,2343	cyclictest	2041986	-21	kworker/2:2+events	20:13:27	2
2023891	99	2351	11,2337	cyclictest	2115688	-21	kworker/0:1+events	23:52:18	0
2023895	99	2350	12,2334	cyclictest	2046611	-21	kworker/1:0+events	20:24:27	1
2023897	99	2349	12,2333	cyclictest	2056577	-21	kworker/2:1+events	21:12:22	2
2023897	99	2349	10,2334	cyclictest	2069782	-21	kworker/2:0+events	21:38:39	2
2023897	99	2348	12,2333	cyclictest	2085657	-21	kworker/2:1+events	22:21:36	2
2023895	99	2345	9,2333	cyclictest	2122113	-21	kworker/1:0+events	00:23:33	1
2023895	99	2344	12,2329	cyclictest	2043376	-21	kworker/1:0+events	20:10:51	1
2023897	99	2343	12,2328	cyclictest	2109501	-21	kworker/2:0+events	23:34:26	2
2023897	99	2335	10,2322	cyclictest	2116284	-21	kworker/2:2+events	00:12:23	2
2023897	99	2330	12,2315	cyclictest	2084047	-21	kworker/2:0+events	22:34:28	2
2023897	99	2330	12,2314	cyclictest	2106222	-21	kworker/2:1+events	23:27:11	2
2023897	99	2329	12,2313	cyclictest	2091718	-21	kworker/2:1+events	22:49:19	2
2023895	99	2329	11,2314	cyclictest	2106160	-21	kworker/1:1+events	23:47:41	1
2023897	99	2328	12,2313	cyclictest	2125441	-21	kworker/2:0+events	00:28:54	2
2023897	99	2328	12,2313	cyclictest	2123784	-21	kworker/2:1+events	00:22:00	2
2023897	99	2328	11,2313	cyclictest	2056577	-21	kworker/2:1+events	21:24:13	2
2023901	99	2327	11,2312	cyclictest	2120662	-21	kworker/3:1+events	00:12:47	3
2023897	99	2327	10,2314	cyclictest	2091718	-21	kworker/2:1+events	23:00:27	2
2023897	99	2325	12,2310	cyclictest	2109501	-21	kworker/2:0+events	23:38:38	2
2023897	99	2325	12,2310	cyclictest	2051563	-21	kworker/2:1+events	20:32:07	2
2023895	99	2325	12,2309	cyclictest	2117559	-21	kworker/1:1+events	00:12:01	1
2023897	99	2324	12,2309	cyclictest	2098454	-21	kworker/2:2+events	23:08:00	2
2023891	99	2323	12,2308	cyclictest	2058091	-21	kworker/0:1+events	20:54:15	0
2023901	99	2322	10,2308	cyclictest	2088488	-21	kworker/3:0+events	22:31:47	3
2023895	99	2321	12,2306	cyclictest	2106160	-21	kworker/1:1+events	23:23:46	1
2023897	99	2320	11,2306	cyclictest	2080789	-21	kworker/2:2+events	22:05:18	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00