OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Dec 04, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1331371	99	3010	15,2991	cyclictest	1381916	-21	kworker/0:0+events	21:45:00	0
1331376	99	2774	5,2764	cyclictest	1373852	-21	kworker/2:1+events	21:25:12	2
1331374	99	2684	12,2668	cyclictest	1407701	-21	kworker/1:0+events	23:10:17	1
1331383	99	2677	12,2661	cyclictest	1414120	-21	kworker/3:2+events	23:25:15	3
1331376	99	2661	13,2645	cyclictest	1371144	-21	kworker/2:0+events	21:10:15	2
1331376	99	2580	12,2565	cyclictest	1358125	-21	kworker/2:2+events	20:40:15	2
1331383	99	2530	9,2517	cyclictest	1414120	-21	kworker/3:2+events	23:35:19	3
1331371	99	2510	11,2494	cyclictest	1372275	-21	kworker/0:1+events	21:15:17	0
1331376	99	2498	12,2482	cyclictest	1356526	-21	kworker/2:1+events	20:34:12	2
1331374	99	2498	12,2482	cyclictest	1350113	-21	kworker/1:2+events	20:05:18	1
1331374	99	2496	12,2480	cyclictest	1351751	-21	kworker/1:0+events	20:10:18	1
1331371	99	2496	12,2480	cyclictest	1428303	-21	kworker/0:0+events	00:08:45	0
1331383	99	2490	12,2475	cyclictest	1390234	-21	kworker/3:1+events	22:28:39	3
1331383	99	2484	12,2468	cyclictest	1402948	-21	kworker/3:2+events	22:55:42	3
1331371	99	2483	11,2470	cyclictest	1309997	-21	kworker/0:2+events	19:25:00	0
1331371	99	2477	11,2463	cyclictest	1393163	-21	kworker/0:1+events	22:25:15	0
1331371	99	2471	12,2455	cyclictest	1348054	-21	kworker/0:0+events	19:58:04	0
1331376	99	2461	10,2448	cyclictest	1375600	-21	kworker/2:0+events	21:40:48	2
1331371	99	2419	12,2404	cyclictest	1393163	-21	kworker/0:1+events	22:37:46	0
1331383	99	2410	12,2396	cyclictest	1412369	-21	kworker/3:0+events	23:20:18	3
1331371	99	2376	10,2363	cyclictest	1433550	-21	kworker/0:1+events	00:25:31	0
1331383	99	2356	12,2341	cyclictest	1338053	-21	kworker/3:1+events	19:37:34	3
1331376	99	2350	12,2334	cyclictest	1410550	-21	kworker/2:1+events	23:37:33	2
1331374	99	2327	10,2314	cyclictest	1402857	-21	kworker/1:1+events	22:55:19	1
1331376	99	2323	11,2309	cyclictest	1398026	-21	kworker/2:2+events	22:54:13	2
1331383	99	2311	12,2297	cyclictest	1370975	-21	kworker/3:0+events	21:20:14	3
1331374	99	2307	10,2295	cyclictest	1430115	-21	kworker/1:0+events	00:15:09	1
1331376	99	2305	11,2291	cyclictest	1393558	-21	kworker/2:2+events	22:20:20	2
1331371	99	2290	10,2278	cyclictest	1388721	-21	kworker/0:0+events	22:10:04	0
1331383	99	2287	11,2273	cyclictest	1428333	-21	kworker/3:1+events	00:12:30	3
1331371	99	2286	12,2270	cyclictest	1418486	-21	kworker/0:0+events	23:39:27	0
1331383	99	2283	10,2269	cyclictest	1356798	-21	kworker/3:0+events	20:34:35	3
1331374	99	2278	10,2264	cyclictest	1394885	-21	kworker/1:0+events	22:34:43	1
1331376	99	2275	10,2262	cyclictest	1341731	-21	kworker/2:0+events	19:42:09	2
1331371	99	2275	10,2261	cyclictest	1343245	-21	kworker/0:1+events	19:45:13	0
1331371	99	2272	11,2258	cyclictest	1349971	-21	kworker/0:1+events	20:09:07	0
1331383	99	2270	11,2255	cyclictest	1361200	-21	kworker/3:1+events	20:37:13	3
1331383	99	2269	11,2255	cyclictest	1369389	-21	kworker/3:2+events	21:07:58	3
1331383	99	2269	11,2254	cyclictest	1346197	-21	kworker/3:0+events	20:01:31	3
1331383	99	2269	10,2256	cyclictest	1430053	-21	kworker/3:0+events	00:17:31	3
1331371	99	2268	11,2254	cyclictest	1401074	-21	kworker/0:0+events	22:59:33	0
1331383	99	2267	10,2253	cyclictest	1428333	-21	kworker/3:1+events	00:07:59	3
1331371	99	2267	9,2254	cyclictest	1369564	-21	kworker/0:0+events	21:12:11	0
1331371	99	2267	8,2255	cyclictest	1349971	-21	kworker/0:1+events	20:14:51	0
1331383	99	2266	11,2252	cyclictest	1391862	-21	kworker/3:2+events	22:19:34	3
1331376	99	2266	10,2253	cyclictest	1410550	-21	kworker/2:1+events	23:34:57	2
1331371	99	2264	10,2251	cyclictest	1383873	-21	kworker/0:2+events	22:08:30	0
1331371	99	2263	10,2250	cyclictest	1438077	-21	kworker/0:1+events	00:37:44	0
1331376	99	2262	10,2248	cyclictest	1364412	-21	kworker/2:1+events	21:05:21	2
1331371	99	2262	10,2249	cyclictest	1364476	-21	kworker/0:2+events	20:48:08	0
1331383	99	2261	9,2249	cyclictest	1430053	-21	kworker/3:0+events	00:32:04	3
1331371	99	2261	11,2247	cyclictest	1431663	-21	kworker/0:2+events	00:33:34	0
1331383	99	2260	11,2246	cyclictest	1426710	-21	kworker/3:2+events	00:04:35	3
1331383	99	2260	11,2246	cyclictest	1426710	-21	kworker/3:2+events	00:04:34	3
1331376	99	2260	10,2246	cyclictest	1410550	-21	kworker/2:1+events	23:14:55	2
1331371	99	2260	10,2247	cyclictest	1361229	-21	kworker/0:0+events	20:37:59	0
1331383	99	2259	11,2245	cyclictest	1425055	-21	kworker/3:0+events	23:57:46	3
1331383	99	2258	10,2244	cyclictest	1334691	-21	kworker/3:0+events	19:23:26	3
1331383	99	2257	9,2244	cyclictest	1386892	-21	kworker/3:0+events	22:09:17	3
1331383	99	2257	10,2244	cyclictest	1414120	-21	kworker/3:2+events	23:33:24	3
1331383	99	2254	6,2245	cyclictest	1397868	-21	kworker/3:0+events	22:43:52	3
1331376	99	2254	11,2240	cyclictest	1385206	-21	kworker/2:0+events	21:54:54	2
1331376	99	2254	11,2239	cyclictest	1413965	-21	kworker/2:2+events	23:24:31	2
1331376	99	2254	11,2239	cyclictest	1385206	-21	kworker/2:0+events	22:17:15	2
1331376	99	2254	10,2241	cyclictest	1406423	-21	kworker/2:2+events	23:01:06	2
1331383	99	2253	10,2240	cyclictest	1399565	-21	kworker/3:2+events	22:38:09	3
1331376	99	2253	11,2239	cyclictest	1421304	-21	kworker/2:1+events	23:49:41	2
1331376	99	2253	10,2240	cyclictest	1436711	-21	kworker/2:0+events	00:34:43	2
1331383	99	2252	11,2238	cyclictest	1354931	-21	kworker/3:1+events	20:28:55	3
1331376	99	2252	9,2240	cyclictest	1375600	-21	kworker/2:0+events	21:24:27	2
1331376	99	2252	6,2243	cyclictest	1344940	-21	kworker/2:0+events	19:59:35	2
1331383	99	2251	10,2238	cyclictest	1386892	-21	kworker/3:0+events	22:13:07	3
1331383	99	2249	10,2236	cyclictest	1346197	-21	kworker/3:0+events	19:57:17	3
1331383	99	2248	10,2234	cyclictest	1361200	-21	kworker/3:1+events	21:01:56	3
1331376	99	2248	9,2235	cyclictest	1423514	-21	kworker/2:0+events	23:57:22	2
1331371	99	2248	11,2233	cyclictest	1367838	-21	kworker/0:2+events	21:00:47	0
1331371	99	2238	10,2225	cyclictest	1412153	-21	kworker/0:2+events	23:51:37	0
1331371	99	2237	10,2224	cyclictest	1426678	-21	kworker/0:2+events	00:01:56	0
1331371	99	2237	10,2224	cyclictest	1426678	-21	kworker/0:2+events	00:01:56	0
1331371	99	2234	10,2221	cyclictest	1337943	-21	kworker/0:0+events	19:38:44	0
1331383	99	2232	11,2218	cyclictest	1382194	-21	kworker/3:2+events	21:53:23	3
1331383	99	2232	10,2219	cyclictest	1420254	-21	kworker/3:2+events	23:54:41	3
1331383	99	2227	11,2213	cyclictest	1338053	-21	kworker/3:1+events	19:31:57	3
1331376	99	2225	10,2212	cyclictest	1369284	-21	kworker/2:2+events	21:15:41	2
1331374	99	2223	7,2212	cyclictest	1377237	-21	kworker/1:1+events	21:44:14	1
1331371	99	2215	6,2206	cyclictest	1409274	-21	kworker/0:1+events	23:17:59	0
1331383	99	2212	11,2198	cyclictest	1370975	-21	kworker/3:0+events	21:12:32	3
1331383	99	2206	8,2195	cyclictest	1354931	-21	kworker/3:1+events	20:22:28	3
1331371	99	2206	10,2193	cyclictest	1353233	-21	kworker/0:0+events	20:16:48	0
1331371	99	2205	9,2193	cyclictest	1349971	-21	kworker/0:1+events	20:03:23	0
1331374	99	2196	8,2185	cyclictest	1389274	-21	kworker/1:0+events	22:07:22	1
1331374	99	2195	11,2181	cyclictest	1383662	-21	kworker/1:2+events	22:21:08	1
1331371	99	2193	10,2180	cyclictest	1361229	-21	kworker/0:0+events	20:41:21	0
1331374	99	2190	11,2175	cyclictest	1351751	-21	kworker/1:0+events	20:42:28	1
1331376	99	2186	11,2172	cyclictest	1351572	-21	kworker/2:0+events	20:15:14	2
1331374	99	2185	7,2176	cyclictest	1418786	-21	kworker/1:0+events	23:55:02	1
1331376	99	2183	11,2169	cyclictest	1367629	-21	kworker/2:0+events	20:59:15	2
1331374	99	2183	11,2169	cyclictest	1412121	-21	kworker/1:2+events	23:24:08	1
1331374	99	2182	11,2167	cyclictest	1436658	-21	kworker/1:3+events	00:35:29	1
1331376	99	2181	10,2168	cyclictest	1385206	-21	kworker/2:0+events	21:56:24	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00