OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Fri May 09, 2025 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
987428	99	4177	20,4150	cyclictest	1003892	-21	kworker/2:1+events	20:30:00	2
987421	99	2780	13,2761	cyclictest	1054024	-21	kworker/0:1+events	22:35:14	0
987428	99	2775	11,2759	cyclictest	1028680	-21	kworker/2:2+events	21:45:13	2
987421	99	2756	13,2740	cyclictest	1087732	-21	kworker/0:2+events	00:20:01	0
987431	99	2753	13,2735	cyclictest	995923	-21	kworker/3:0+events	20:00:12	3
987426	99	2719	12,2703	cyclictest	1060410	-21	kworker/1:0+events	22:55:19	1
987426	99	2697	12,2681	cyclictest	1016094	-21	kworker/1:2+events	20:35:18	1
987428	99	2696	11,2681	cyclictest	987557	-21	kworker/2:2+events	19:20:15	2
987421	99	2692	10,2679	cyclictest	1047367	-21	kworker/0:0+events	22:25:22	0
987421	99	2682	11,2667	cyclictest	1019242	-21	kworker/0:2+events	20:55:20	0
987431	99	2672	12,2655	cyclictest	1019186	-21	kworker/3:1+events	21:05:13	3
987431	99	2672	12,2655	cyclictest	1019186	-21	kworker/3:1+events	21:05:13	3
987426	99	2661	12,2647	cyclictest	1002179	-21	kworker/1:0+events	19:55:16	1
987426	99	2654	13,2636	cyclictest	1066786	-21	kworker/1:2+events	23:15:11	1
987431	99	2653	13,2637	cyclictest	1019186	-21	kworker/3:1+events	20:50:01	3
987426	99	2645	11,2629	cyclictest	1051000	-21	kworker/1:2+events	22:30:18	1
987421	99	2552	12,2537	cyclictest	1087732	-21	kworker/0:2+events	00:30:18	0
987421	99	2550	11,2535	cyclictest	1086108	-21	kworker/0:0+events	00:25:22	0
987431	99	2540	12,2524	cyclictest	1031636	-21	kworker/3:1+events	21:25:18	3
987426	99	2489	12,2473	cyclictest	1016094	-21	kworker/1:2+events	20:42:27	1
987421	99	2479	12,2463	cyclictest	1058931	-21	kworker/0:1+events	22:51:11	0
987426	99	2478	11,2463	cyclictest	1047637	-21	kworker/1:2+events	22:18:55	1
987428	99	2475	11,2460	cyclictest	1062155	-21	kworker/2:2+events	23:14:49	2
987421	99	2457	12,2442	cyclictest	1084511	-21	kworker/0:1+events	00:13:16	0
987421	99	2439	12,2424	cyclictest	1073166	-21	kworker/0:2+events	23:35:19	0
987426	99	2434	11,2419	cyclictest	1027025	-21	kworker/1:1+events	21:35:37	1
987431	99	2422	12,2406	cyclictest	1042627	-21	kworker/3:0+events	22:05:19	3
987426	99	2420	12,2404	cyclictest	1051000	-21	kworker/1:2+events	23:00:18	1
987431	99	2403	10,2389	cyclictest	1055915	-21	kworker/3:2+events	22:42:06	3
987428	99	2397	12,2381	cyclictest	1014114	-21	kworker/2:0+events	20:52:40	2
987428	99	2396	11,2382	cyclictest	1054084	-21	kworker/2:2+events	22:45:52	2
987428	99	2389	12,2374	cyclictest	1003892	-21	kworker/2:1+events	20:39:49	2
987428	99	2387	10,2374	cyclictest	1047429	-21	kworker/2:1+events	22:28:26	2
987421	99	2387	12,2371	cyclictest	1048969	-21	kworker/0:1+events	22:23:51	0
987421	99	2353	12,2337	cyclictest	1081210	-21	kworker/0:1+events	23:58:07	0
987428	99	2346	6,2337	cyclictest	1071502	-21	kworker/2:2+events	23:43:16	2
987431	99	2341	11,2326	cyclictest	1069843	-21	kworker/3:2+events	23:27:42	3
987426	99	2340	10,2327	cyclictest	1063600	-21	kworker/1:1+events	23:09:01	1
987431	99	2339	12,2324	cyclictest	1015827	-21	kworker/3:2+events	20:36:46	3
987431	99	2328	12,2314	cyclictest	1078248	-21	kworker/3:1+events	23:50:11	3
987431	99	2328	12,2312	cyclictest	995923	-21	kworker/3:0+events	20:18:11	3
987431	99	2325	1,2320	cyclictest	1034837	-21	kworker/3:2+events	21:40:13	3
987431	99	2325	12,2310	cyclictest	1019186	-21	kworker/3:1+events	21:02:08	3
987431	99	2320	12,2304	cyclictest	1073138	-21	kworker/3:0+events	23:40:38	3
987426	99	2320	11,2305	cyclictest	1046013	-21	kworker/1:1+events	22:26:54	1
987421	99	2320	10,2307	cyclictest	1047367	-21	kworker/0:0+events	22:15:50	0
987428	99	2319	10,2307	cyclictest	1076616	-21	kworker/2:0+events	00:00:49	2
987426	99	2319	12,2304	cyclictest	1014173	-21	kworker/1:0+events	20:29:35	1
987426	99	2316	12,2300	cyclictest	1027025	-21	kworker/1:1+events	21:17:21	1
987431	99	2309	12,2294	cyclictest	1055915	-21	kworker/3:2+events	22:50:49	3
987421	99	2298	11,2284	cyclictest	1019242	-21	kworker/0:2+events	20:49:12	0
987431	99	2297	12,2282	cyclictest	1069843	-21	kworker/3:2+events	23:37:34	3
987431	99	2295	12,2279	cyclictest	1029987	-21	kworker/3:0+events	21:16:36	3
987431	99	2279	12,2265	cyclictest	1020870	-21	kworker/3:0+events	20:54:56	3
987426	99	2271	11,2256	cyclictest	1041158	-21	kworker/1:1+events	21:57:47	1
987421	99	2268	11,2254	cyclictest	1015887	-21	kworker/0:2+events	20:33:26	0
987421	99	2264	10,2251	cyclictest	995546	-21	kworker/0:1+events	19:34:21	0
987426	99	2262	11,2247	cyclictest	1082947	-21	kworker/1:0+events	00:25:44	1
987421	99	2261	11,2247	cyclictest	1060555	-21	kworker/0:2+events	22:59:31	0
987426	99	2259	11,2245	cyclictest	1004018	-21	kworker/1:2+events	20:09:25	1
987426	99	2256	9,2244	cyclictest	1087791	-21	kworker/1:1+events	00:21:08	1
987426	99	2256	11,2242	cyclictest	1033494	-21	kworker/1:2+events	21:31:03	1
987426	99	2253	10,2239	cyclictest	1016094	-21	kworker/1:2+events	20:49:37	1
987426	99	2253	10,2239	cyclictest	1008995	-21	kworker/1:0+events	20:17:05	1
987426	99	2252	9,2240	cyclictest	995588	-21	kworker/1:0+events	19:33:10	1
987426	99	2251	10,2238	cyclictest	1079652	-21	kworker/1:2+events	00:06:29	1
987421	99	2247	10,2233	cyclictest	1038208	-21	kworker/0:2+events	21:57:24	0
987431	99	2234	11,2220	cyclictest	994303	-21	kworker/3:2+events	19:48:49	3
987431	99	2226	11,2213	cyclictest	979035	-21	kworker/3:1+events	19:30:10	3
987431	99	2225	11,2210	cyclictest	1007282	-21	kworker/3:1+events	20:11:41	3
987428	99	2222	11,2207	cyclictest	1084364	-21	kworker/2:1+events	00:06:51	2
987426	99	2220	10,2207	cyclictest	1077983	-21	kworker/1:0+events	23:45:58	1
987431	99	2218	10,2203	cyclictest	1042627	-21	kworker/3:0+events	22:00:49	3
987431	99	2216	10,2203	cyclictest	995923	-21	kworker/3:0+events	19:56:01	3
987426	99	2210	10,2197	cyclictest	988842	-21	kworker/1:2+events	19:36:41	1
987428	99	2202	12,2188	cyclictest	1066650	-21	kworker/2:0+events	23:20:06	2
987428	99	2201	11,2187	cyclictest	1003892	-21	kworker/2:1+events	20:12:27	2
987421	99	2196	11,2181	cyclictest	1019242	-21	kworker/0:2+events	21:04:51	0
987421	99	2195	10,2181	cyclictest	1073166	-21	kworker/0:2+events	23:47:53	0
987428	99	2186	10,2173	cyclictest	1085960	-21	kworker/2:0+events	00:14:21	2
987421	99	2186	11,2171	cyclictest	1007518	-21	kworker/0:2+events	20:23:06	0
987428	99	2185	8,2174	cyclictest	1042921	-21	kworker/2:1+events	22:01:57	2
987428	99	2185	10,2171	cyclictest	1057210	-21	kworker/2:0+events	22:58:44	2
987421	99	2185	9,2173	cyclictest	1019242	-21	kworker/0:2+events	21:34:51	0
987428	99	2184	11,2170	cyclictest	1049059	-21	kworker/2:0+events	22:18:10	2
987428	99	2183	4,2175	cyclictest	1014114	-21	kworker/2:0+events	20:32:39	2
987428	99	2183	12,2167	cyclictest	1035013	-21	kworker/2:0+events	21:43:39	2
987428	99	2183	11,2169	cyclictest	1028680	-21	kworker/2:2+events	21:52:50	2
987428	99	2183	10,2170	cyclictest	1044627	-21	kworker/2:0+events	22:06:48	2
987428	99	2183	10,2169	cyclictest	1035013	-21	kworker/2:0+events	21:37:33	2
987421	99	2183	9,2170	cyclictest	1044691	-21	kworker/0:2+events	22:07:56	0
987421	99	2183	11,2169	cyclictest	997361	-21	kworker/0:0+events	19:48:28	0
987421	99	2183	11,2168	cyclictest	1015887	-21	kworker/0:2+events	20:35:41	0
987428	99	2180	11,2167	cyclictest	1092552	-21	kworker/2:1+events	00:37:07	2
987421	99	2180	7,2170	cyclictest	1047367	-21	kworker/0:0+events	22:34:06	0
987421	99	2180	10,2166	cyclictest	1025426	-21	kworker/0:0+events	21:13:12	0
987428	99	2179	11,2164	cyclictest	1089236	-21	kworker/2:1+events	00:24:13	2
987426	99	2179	11,2165	cyclictest	1027025	-21	kworker/1:1+events	21:10:33	1
987421	99	2179	10,2166	cyclictest	995546	-21	kworker/0:1+events	20:02:30	0
987421	99	2178	11,2164	cyclictest	1065404	-21	kworker/0:1+events	23:11:46	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00