OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun Dec 28, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3119117	99	5891	27,5860	cyclictest	3115364	-21	kworker/2:2+events	19:11:50	2
3119113	99	5748	26,5719	cyclictest	3118958	-21	kworker/1:2+events	19:11:27	1
3119108	99	3817	18,3796	cyclictest	3113806	-21	kworker/0:2+events	19:11:05	0
3119113	99	3336	18,3314	cyclictest	3146289	-21	kworker/1:0+events	20:35:19	1
3119113	99	2944	11,2928	cyclictest	3170519	-21	kworker/1:1+events	22:00:17	1
3119119	99	2826	13,2810	cyclictest	3118735	-21	kworker/3:0+events	19:12:14	3
3119119	99	2580	11,2566	cyclictest	3159115	-21	kworker/3:2+events	21:15:01	3
3119108	99	2510	10,2496	cyclictest	3168830	-21	kworker/0:2+events	21:55:20	0
3119113	99	2456	10,2444	cyclictest	3202971	-21	kworker/1:2+events	23:50:04	1
3119113	99	2442	12,2427	cyclictest	3139835	-21	kworker/1:0+events	20:20:16	1
3119117	99	2366	12,2351	cyclictest	3146204	-21	kworker/2:1+events	20:40:15	2
3119108	99	2364	12,2349	cyclictest	3160893	-21	kworker/0:1+events	21:34:45	0
3119119	99	2349	12,2334	cyclictest	3196544	-21	kworker/3:1+events	23:10:13	3
3119108	99	2334	12,2318	cyclictest	3136671	-21	kworker/0:1+events	20:15:19	0
3119117	99	2312	11,2298	cyclictest	3219161	-21	kworker/2:1+events	00:36:05	2
3119113	99	2304	11,2290	cyclictest	3223823	-21	kworker/1:0+events	00:37:34	1
3119117	99	2275	10,2261	cyclictest	3120416	-21	kworker/2:1+events	19:15:19	2
3119113	99	2275	12,2260	cyclictest	3215818	-21	kworker/1:0+events	00:09:23	1
3119113	99	2275	12,2260	cyclictest	3215818	-21	kworker/1:0+events	00:09:23	1
3119113	99	2272	10,2258	cyclictest	3163681	-21	kworker/1:0+events	21:44:14	1
3119113	99	2271	11,2257	cyclictest	3183819	-21	kworker/1:0+events	22:43:14	1
3119113	99	2267	11,2253	cyclictest	3157631	-21	kworker/1:0+events	21:10:48	1
3119113	99	2266	9,2254	cyclictest	3217710	-21	kworker/1:1+events	00:17:43	1
3119113	99	2264	10,2251	cyclictest	3170519	-21	kworker/1:1+events	22:10:53	1
3119117	99	2257	11,2243	cyclictest	3166887	-21	kworker/2:0+events	21:50:21	2
3119113	99	2248	10,2235	cyclictest	3128581	-21	kworker/1:2+events	20:07:18	1
3119117	99	2241	5,2233	cyclictest	3170278	-21	kworker/2:1+events	21:59:57	2
3119117	99	2239	10,2227	cyclictest	3214333	-21	kworker/2:2+events	00:15:05	2
3119108	99	2237	6,2228	cyclictest	3194801	-21	kworker/0:1+events	23:05:19	0
3119108	99	2237	11,2222	cyclictest	3165342	-21	kworker/0:0+events	21:45:23	0
3119117	99	2236	11,2221	cyclictest	3170278	-21	kworker/2:1+events	22:02:14	2
3119108	99	2229	11,2215	cyclictest	3196396	-21	kworker/0:2+events	23:11:21	0
3119117	99	2226	8,2215	cyclictest	3199750	-21	kworker/2:0+events	23:22:21	2
3119108	99	2217	11,2203	cyclictest	3168830	-21	kworker/0:2+events	22:04:54	0
3119113	99	2190	11,2177	cyclictest	3202971	-21	kworker/1:2+events	23:30:20	1
3119113	99	2176	9,2164	cyclictest	3117253	-21	kworker/1:0+events	19:35:19	1
3119108	99	2153	8,2142	cyclictest	3160893	-21	kworker/0:1+events	21:37:05	0
3119119	99	2146	11,2132	cyclictest	3190033	-21	kworker/3:1+events	22:54:20	3
3119119	99	2136	11,2122	cyclictest	3139715	-21	kworker/3:2+events	20:22:09	3
3119108	99	2119	9,2107	cyclictest	3204846	-21	kworker/0:1+events	23:40:14	0
3119113	99	2112	11,2098	cyclictest	3170519	-21	kworker/1:1+events	21:54:12	1
3119117	99	2110	10,2097	cyclictest	3210416	-21	kworker/2:2+events	23:51:34	2
3119108	99	2108	5,2100	cyclictest	3199688	-21	kworker/0:2+events	23:19:44	0
3119113	99	2107	9,2095	cyclictest	3152749	-21	kworker/1:1+events	21:06:59	1
3119108	99	2106	11,2092	cyclictest	3201373	-21	kworker/0:0+events	23:47:01	0
3119113	99	2103	9,2091	cyclictest	3181929	-21	kworker/1:2+events	22:27:00	1
3119113	99	2103	10,2089	cyclictest	3157631	-21	kworker/1:0+events	21:15:21	1
3119117	99	2102	10,2088	cyclictest	3148179	-21	kworker/2:0+events	21:14:16	2
3119113	99	2102	8,2091	cyclictest	3180153	-21	kworker/1:1+events	22:31:56	1
3119113	99	2102	7,2091	cyclictest	3146289	-21	kworker/1:0+events	20:43:21	1
3119113	99	2101	10,2087	cyclictest	3199659	-21	kworker/1:0+events	23:25:25	1
3119113	99	2099	7,2090	cyclictest	3202971	-21	kworker/1:2+events	23:45:09	1
3119113	99	2098	8,2087	cyclictest	3214153	-21	kworker/1:2+events	00:04:48	1
3119113	99	2098	6,2089	cyclictest	3117253	-21	kworker/1:0+events	19:28:03	1
3119108	99	2097	10,2084	cyclictest	3142915	-21	kworker/0:2+events	20:23:40	0
3119117	99	2096	10,2082	cyclictest	3180310	-21	kworker/2:1+events	22:23:57	2
3119119	99	2095	5,2088	cyclictest	3219255	-21	kworker/3:0+events	00:20:04	3
3119113	99	2090	9,2078	cyclictest	3163681	-21	kworker/1:0+events	21:26:51	1
3119108	99	2084	9,2072	cyclictest	3168830	-21	kworker/0:2+events	22:18:36	0
3119108	99	2084	9,2072	cyclictest	3142915	-21	kworker/0:2+events	20:31:11	0
3119113	99	2083	10,2070	cyclictest	3183819	-21	kworker/1:0+events	22:58:31	1
3119113	99	2079	8,2068	cyclictest	3199659	-21	kworker/1:0+events	23:18:33	1
3119113	99	2078	3,2072	cyclictest	3163681	-21	kworker/1:0+events	21:48:06	1
3119117	99	2077	7,2067	cyclictest	3124187	-21	kworker/2:0+events	19:29:14	2
3119117	99	2076	7,2066	cyclictest	3133565	-21	kworker/2:0+events	20:01:35	2
3119108	99	2076	10,2063	cyclictest	3168830	-21	kworker/0:2+events	22:06:47	0
3119108	99	2076	10,2063	cyclictest	3168830	-21	kworker/0:2+events	22:06:47	0
3119117	99	2075	10,2062	cyclictest	3182000	-21	kworker/2:0+events	22:28:29	2
3119108	99	2075	7,2066	cyclictest	3160893	-21	kworker/0:1+events	21:40:06	0
3119117	99	2074	10,2061	cyclictest	3152686	-21	kworker/2:1+events	20:56:59	2
3119117	99	2073	4,2065	cyclictest	3148179	-21	kworker/2:0+events	21:02:21	2
3119113	99	2073	10,2060	cyclictest	3180153	-21	kworker/1:1+events	22:18:12	1
3119108	99	2073	10,2060	cyclictest	3168830	-21	kworker/0:2+events	22:24:42	0
3119113	99	2072	6,2063	cyclictest	3183819	-21	kworker/1:0+events	22:47:27	1
3119117	99	2071	9,2058	cyclictest	3128612	-21	kworker/2:1+events	19:55:56	2
3119117	99	2071	10,2058	cyclictest	3160809	-21	kworker/2:2+events	21:31:22	2
3119108	99	2071	5,2063	cyclictest	3220966	-21	kworker/0:2+events	00:28:26	0
3119108	99	2071	10,2058	cyclictest	3212678	-21	kworker/0:2+events	00:13:33	0
3119117	99	2070	10,2057	cyclictest	3204311	-21	kworker/2:1+events	23:34:32	2
3119113	99	2070	10,2057	cyclictest	3202971	-21	kworker/1:2+events	23:43:16	1
3119108	99	2070	8,2059	cyclictest	3201373	-21	kworker/0:0+events	23:57:14	0
3119119	99	2069	10,2055	cyclictest	3159115	-21	kworker/3:2+events	21:30:15	3
3119113	99	2069	9,2056	cyclictest	3214153	-21	kworker/1:2+events	00:33:23	1
3119113	99	2069	10,2056	cyclictest	3161099	-21	kworker/1:1+events	21:21:04	1
3119117	99	2068	9,2056	cyclictest	3204311	-21	kworker/2:1+events	23:45:32	2
3119117	99	2068	7,2058	cyclictest	3160809	-21	kworker/2:2+events	21:36:42	2
3119117	99	2068	4,2061	cyclictest	3144574	-21	kworker/2:2+events	20:37:59	2
3119117	99	2067	5,2059	cyclictest	3130232	-21	kworker/2:0+events	19:42:50	2
3119117	99	2067	4,2060	cyclictest	3126987	-21	kworker/2:2+events	19:36:48	2
3119117	99	2067	10,2055	cyclictest	3128612	-21	kworker/2:1+events	19:50:32	2
3119117	99	2067	10,2054	cyclictest	3136521	-21	kworker/2:2+events	20:16:27	2
3119117	99	2067	10,2054	cyclictest	3133565	-21	kworker/2:0+events	20:27:51	2
3119113	99	2067	10,2053	cyclictest	3117253	-21	kworker/1:0+events	19:24:36	1
3119108	99	2067	10,2054	cyclictest	3222612	-21	kworker/0:1+events	00:32:59	0
3119117	99	2066	9,2054	cyclictest	3191580	-21	kworker/2:0+events	22:57:43	2
3119117	99	2066	4,2059	cyclictest	3196481	-21	kworker/2:2+events	23:13:38	2
3119117	99	2065	8,2054	cyclictest	3219161	-21	kworker/2:1+events	00:29:32	2
3119117	99	2064	9,2052	cyclictest	3133565	-21	kworker/2:0+events	20:11:50	2
3119108	99	2064	10,2051	cyclictest	3209100	-21	kworker/0:1+events	23:53:27	0
3119113	99	2063	7,2053	cyclictest	3152749	-21	kworker/1:1+events	20:54:22	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00