OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun Jan 04, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2286116	99	5880	19,5857	cyclictest	2280986	-21	kworker/1:2+events	19:12:05	1
2286127	99	5811	27,5782	cyclictest	2279802	-21	kworker/3:1+events	19:11:42	3
2286114	99	2843	14,2825	cyclictest	2345187	-21	kworker/0:1+events	22:15:14	0
2286120	99	2570	12,2555	cyclictest	2287201	-21	kworker/2:2+events	19:12:28	2
2286120	99	2515	12,2498	cyclictest	2351447	-21	kworker/2:1+events	22:40:01	2
2286116	99	2469	11,2456	cyclictest	2291212	-21	kworker/1:2+events	19:35:01	1
2286116	99	2447	11,2434	cyclictest	2343733	-21	kworker/1:2+events	22:10:17	1
2286116	99	2422	12,2407	cyclictest	2293205	-21	kworker/1:0+events	19:45:21	1
2286114	99	2393	11,2379	cyclictest	2351598	-21	kworker/0:2+events	22:45:17	0
2286114	99	2361	9,2348	cyclictest	2351598	-21	kworker/0:2+events	22:33:56	0
2286127	99	2344	12,2329	cyclictest	2385295	-21	kworker/3:0+events	00:25:13	3
2286127	99	2341	10,2327	cyclictest	2287262	-21	kworker/3:2+events	20:00:13	3
2286114	99	2335	12,2320	cyclictest	2329288	-21	kworker/0:2+events	21:35:24	0
2286116	99	2267	12,2252	cyclictest	2389985	-21	kworker/1:1+events	00:32:04	1
2286120	99	2259	11,2244	cyclictest	2322891	-21	kworker/2:1+events	21:15:17	2
2286116	99	2246	9,2234	cyclictest	2319603	-21	kworker/1:2+events	21:08:04	1
2286120	99	2240	11,2226	cyclictest	2356651	-21	kworker/2:2+events	22:49:27	2
2286120	99	2240	11,2225	cyclictest	2311614	-21	kworker/2:1+events	20:42:59	2
2286120	99	2240	11,2225	cyclictest	2311614	-21	kworker/2:1+events	20:42:59	2
2286120	99	2239	11,2224	cyclictest	2374392	-21	kworker/2:1+events	23:47:15	2
2286116	99	2236	11,2221	cyclictest	2335595	-21	kworker/1:1+events	21:48:38	1
2286120	99	2235	10,2222	cyclictest	2299067	-21	kworker/2:1+events	19:53:48	2
2286114	99	2219	10,2206	cyclictest	2375903	-21	kworker/0:1+events	23:52:13	0
2286120	99	2214	10,2201	cyclictest	2294113	-21	kworker/2:2+events	19:39:36	2
2286114	99	2204	10,2191	cyclictest	2351598	-21	kworker/0:2+events	22:40:47	0
2286114	99	2204	10,2191	cyclictest	2351598	-21	kworker/0:2+events	22:40:47	0
2286114	99	2201	11,2187	cyclictest	2383634	-21	kworker/0:1+events	00:24:03	0
2286114	99	2185	11,2170	cyclictest	2383634	-21	kworker/0:1+events	00:38:09	0
2286114	99	2183	10,2170	cyclictest	2322801	-21	kworker/0:1+events	21:03:07	0
2286114	99	2182	11,2167	cyclictest	2363317	-21	kworker/0:2+events	23:14:18	0
2286114	99	2178	10,2165	cyclictest	2367757	-21	kworker/0:2+events	23:26:03	0
2286116	99	2171	11,2157	cyclictest	2305440	-21	kworker/1:0+events	20:14:24	1
2286120	99	2168	9,2156	cyclictest	2377266	-21	kworker/2:2+events	23:51:51	2
2286127	99	2156	8,2144	cyclictest	2353369	-21	kworker/3:1+events	22:49:04	3
2286127	99	2151	11,2137	cyclictest	2319840	-21	kworker/3:2+events	21:04:38	3
2286116	99	2138	11,2124	cyclictest	2369450	-21	kworker/1:0+events	23:41:58	1
2286127	99	2137	9,2125	cyclictest	2338905	-21	kworker/3:0+events	22:05:16	3
2286127	99	2135	11,2121	cyclictest	2324372	-21	kworker/3:0+events	21:23:14	3
2286116	99	2129	10,2115	cyclictest	2356620	-21	kworker/1:2+events	23:06:12	1
2286114	99	2120	10,2107	cyclictest	2361678	-21	kworker/0:1+events	23:05:49	0
2286127	99	2109	10,2096	cyclictest	2355108	-21	kworker/3:0+events	23:30:56	3
2286114	99	2107	10,2094	cyclictest	2340735	-21	kworker/0:1+events	22:01:53	0
2286120	99	2098	11,2084	cyclictest	2354961	-21	kworker/2:0+events	22:43:03	2
2286120	99	2098	11,2084	cyclictest	2354961	-21	kworker/2:0+events	22:43:02	2
2286116	99	2098	8,2087	cyclictest	2326153	-21	kworker/1:0+events	21:24:46	1
2286114	99	2095	7,2085	cyclictest	2343582	-21	kworker/0:0+events	22:09:54	0
2286120	99	2094	11,2080	cyclictest	2332212	-21	kworker/2:1+events	21:45:35	2
2286114	99	2094	10,2081	cyclictest	2377562	-21	kworker/0:2+events	00:11:13	0
2286120	99	2083	10,2070	cyclictest	2332212	-21	kworker/2:1+events	21:32:01	2
2286114	99	2082	6,2072	cyclictest	2365408	-21	kworker/0:0+events	23:24:08	0
2286120	99	2079	10,2066	cyclictest	2351447	-21	kworker/2:1+events	22:55:54	2
2286120	99	2072	10,2059	cyclictest	2303480	-21	kworker/2:1+events	20:06:42	2
2286116	99	2072	5,2064	cyclictest	2289458	-21	kworker/1:0+events	19:21:20	1
2286114	99	2072	7,2062	cyclictest	2321172	-21	kworker/0:0+events	21:11:07	0
2286114	99	2072	11,2058	cyclictest	2386888	-21	kworker/0:2+events	00:26:20	0
2286120	99	2069	6,2060	cyclictest	2313221	-21	kworker/2:2+events	20:35:24	2
2286116	99	2069	9,2057	cyclictest	2303690	-21	kworker/1:1+events	20:17:53	1
2286120	99	2068	10,2056	cyclictest	2358274	-21	kworker/2:0+events	23:15:03	2
2286116	99	2068	10,2055	cyclictest	2322923	-21	kworker/1:1+events	21:11:29	1
2286120	99	2067	10,2054	cyclictest	2330623	-21	kworker/2:2+events	21:28:37	2
2286120	99	2066	7,2056	cyclictest	2306688	-21	kworker/2:0+events	20:15:56	2
2286120	99	2066	10,2053	cyclictest	2309984	-21	kworker/2:0+events	20:29:20	2
2286116	99	2065	5,2057	cyclictest	2391584	-21	kworker/1:2+events	00:37:01	1
2286127	99	2063	9,2052	cyclictest	2338905	-21	kworker/3:0+events	22:20:10	3
2286127	99	2062	11,2048	cyclictest	2385295	-21	kworker/3:0+events	00:31:43	3
2286120	99	2061	10,2048	cyclictest	2356651	-21	kworker/2:2+events	22:52:04	2
2286120	99	2060	8,2048	cyclictest	2343673	-21	kworker/2:2+events	22:19:49	2
2286116	99	2060	9,2048	cyclictest	2309803	-21	kworker/1:0+events	20:39:59	1
2286116	99	2059	7,2049	cyclictest	2369450	-21	kworker/1:0+events	23:38:29	1
2286116	99	2059	10,2049	cyclictest	2293205	-21	kworker/1:0+events	19:37:20	1
2286120	99	2054	8,2043	cyclictest	2343673	-21	kworker/2:2+events	22:13:44	2
2286120	99	2052	10,2039	cyclictest	2332212	-21	kworker/2:1+events	21:41:50	2
2286116	99	2051	10,2038	cyclictest	2337187	-21	kworker/1:0+events	22:16:00	1
2286120	99	2049	9,2037	cyclictest	2388470	-21	kworker/2:0+events	00:29:01	2
2286120	99	2049	8,2038	cyclictest	2367814	-21	kworker/2:0+events	23:22:14	2
2286116	99	2049	8,2038	cyclictest	2298767	-21	kworker/1:2+events	19:54:58	1
2286116	99	2049	8,2037	cyclictest	2311675	-21	kworker/1:2+events	20:32:00	1
2286120	99	2048	7,2037	cyclictest	2385203	-21	kworker/2:0+events	00:20:17	2
2286120	99	2047	9,2035	cyclictest	2322891	-21	kworker/2:1+events	21:09:14	2
2286120	99	2047	9,2035	cyclictest	2297430	-21	kworker/2:0+events	20:01:23	2
2286120	99	2047	6,2038	cyclictest	2372763	-21	kworker/2:2+events	23:43:52	2
2286120	99	2046	6,2036	cyclictest	2340353	-21	kworker/2:0+events	21:59:11	2
2286116	99	2046	10,2032	cyclictest	2375809	-21	kworker/1:1+events	23:59:28	1
2286120	99	2045	7,2035	cyclictest	2385203	-21	kworker/2:0+events	00:16:53	2
2286120	99	2045	7,2034	cyclictest	2311614	-21	kworker/2:1+events	20:33:31	2
2286116	99	2045	9,2033	cyclictest	2337187	-21	kworker/1:0+events	22:01:07	1
2286116	99	2045	5,2037	cyclictest	2326153	-21	kworker/1:0+events	21:26:41	1
2286116	99	2044	7,2034	cyclictest	2329086	-21	kworker/1:2+events	21:32:47	1
2286120	99	2043	9,2031	cyclictest	2332212	-21	kworker/2:1+events	21:39:35	2
2286120	99	2043	10,2030	cyclictest	2341983	-21	kworker/2:1+events	22:07:57	2
2286116	99	2043	7,2033	cyclictest	2349957	-21	kworker/1:2+events	22:28:11	1
2286116	99	2043	6,2033	cyclictest	2287292	-21	kworker/1:1+events	19:19:23	1
2286114	99	2043	9,2030	cyclictest	2359935	-21	kworker/0:2+events	22:58:11	0
2286120	99	2042	10,2029	cyclictest	2380618	-21	kworker/2:0+events	00:03:42	2
2286116	99	2042	8,2031	cyclictest	2354932	-21	kworker/1:1+events	22:48:19	1
2286116	99	2042	8,2031	cyclictest	2349957	-21	kworker/1:2+events	22:30:53	1
2286116	99	2042	10,2029	cyclictest	2383696	-21	kworker/1:1+events	00:22:56	1
2286116	99	2042	10,2029	cyclictest	2297129	-21	kworker/1:1+events	19:43:03	1
2286120	99	2041	10,2027	cyclictest	2313221	-21	kworker/2:2+events	20:48:13	2
2286116	99	2041	9,2029	cyclictest	2337187	-21	kworker/1:0+events	22:06:26	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00