OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Wed Nov 05, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
181817	99	3161	9,3147	cyclictest	191751	-21	kworker/0:0+events	19:40:14	0
181829	99	3000	14,2982	cyclictest	184954	-21	kworker/3:2+events	19:20:01	3
181821	99	2838	11,2823	cyclictest	209392	-21	kworker/1:0+events	20:55:17	1
181817	99	2786	13,2769	cyclictest	233893	-21	kworker/0:1+events	21:55:00	0
181821	99	2717	13,2701	cyclictest	247267	-21	kworker/1:2+events	22:35:13	1
181821	99	2681	13,2664	cyclictest	268088	-21	kworker/1:1+events	23:45:13	1
181821	99	2681	13,2664	cyclictest	268088	-21	kworker/1:1+events	23:45:13	1
181829	99	2659	13,2641	cyclictest	232378	-21	kworker/3:1+events	22:05:20	3
181829	99	2542	12,2526	cyclictest	207850	-21	kworker/3:2+events	20:30:16	3
181825	99	2503	12,2488	cyclictest	187323	-21	kworker/2:0+events	19:35:15	2
181825	99	2503	11,2488	cyclictest	279273	-21	kworker/2:2+events	00:26:38	2
181829	99	2495	12,2480	cyclictest	245249	-21	kworker/3:2+events	22:29:03	3
181829	99	2492	11,2478	cyclictest	274605	-21	kworker/3:0+events	00:09:07	3
181829	99	2486	12,2471	cyclictest	222617	-21	kworker/3:0+events	21:22:42	3
181825	99	2474	12,2458	cyclictest	190029	-21	kworker/2:2+events	20:05:44	2
181829	99	2473	12,2458	cyclictest	207850	-21	kworker/3:2+events	20:39:20	3
181829	99	2453	12,2437	cyclictest	193079	-21	kworker/3:2+events	19:41:22	3
181817	99	2444	12,2429	cyclictest	267880	-21	kworker/0:1+events	23:40:12	0
181829	99	2427	11,2413	cyclictest	248809	-21	kworker/3:2+events	22:58:03	3
181817	99	2425	10,2412	cyclictest	201821	-21	kworker/0:1+events	20:18:50	0
181829	99	2423	8,2412	cyclictest	248809	-21	kworker/3:2+events	22:39:44	3
181821	99	2422	12,2406	cyclictest	220857	-21	kworker/1:0+events	21:31:23	1
181825	99	2421	11,2406	cyclictest	204406	-21	kworker/2:0+events	20:25:18	2
181821	99	2417	11,2403	cyclictest	266399	-21	kworker/1:0+events	23:43:17	1
181821	99	2416	12,2400	cyclictest	274457	-21	kworker/1:2+events	00:05:20	1
181817	99	2410	10,2397	cyclictest	261665	-21	kworker/0:1+events	23:25:50	0
181817	99	2409	12,2393	cyclictest	263321	-21	kworker/0:0+events	23:54:45	0
181821	99	2408	12,2393	cyclictest	247267	-21	kworker/1:2+events	23:33:22	1
181829	99	2406	10,2393	cyclictest	258272	-21	kworker/3:2+events	23:10:33	3
181821	99	2401	10,2387	cyclictest	217652	-21	kworker/1:1+events	21:08:16	1
181821	99	2400	8,2389	cyclictest	229428	-21	kworker/1:2+events	21:41:37	1
181829	99	2396	12,2381	cyclictest	242015	-21	kworker/3:1+events	22:20:14	3
181817	99	2396	10,2383	cyclictest	258421	-21	kworker/0:0+events	23:13:38	0
181821	99	2395	9,2383	cyclictest	222462	-21	kworker/1:2+events	21:20:50	1
181817	99	2394	9,2382	cyclictest	188394	-21	kworker/0:2+events	19:33:44	0
181821	99	2392	10,2379	cyclictest	196369	-21	kworker/1:1+events	19:53:57	1
181817	99	2392	11,2377	cyclictest	214068	-21	kworker/0:1+events	20:51:30	0
181817	99	2389	12,2373	cyclictest	195789	-21	kworker/0:1+events	19:58:07	0
181817	99	2388	12,2373	cyclictest	282858	-21	kworker/0:0+events	00:37:38	0
181817	99	2388	10,2374	cyclictest	217948	-21	kworker/0:1+events	21:04:26	0
181817	99	2386	11,2371	cyclictest	245282	-21	kworker/0:0+events	22:32:09	0
181821	99	2384	12,2369	cyclictest	198122	-21	kworker/1:2+events	20:04:58	1
181817	99	2381	12,2366	cyclictest	207670	-21	kworker/0:2+events	20:34:26	0
181817	99	2375	12,2359	cyclictest	251704	-21	kworker/0:1+events	22:48:34	0
181825	99	2362	12,2347	cyclictest	217213	-21	kworker/2:0+events	20:59:07	2
181829	99	2355	11,2341	cyclictest	266193	-21	kworker/3:1+events	23:32:16	3
181825	99	2354	12,2340	cyclictest	245160	-21	kworker/2:2+events	22:30:35	2
181825	99	2347	12,2332	cyclictest	227607	-21	kworker/2:0+events	21:37:25	2
181817	99	2344	11,2329	cyclictest	215654	-21	kworker/0:0+events	21:13:59	0
181825	99	2340	12,2325	cyclictest	279273	-21	kworker/2:2+events	00:31:35	2
181825	99	2338	10,2325	cyclictest	266623	-21	kworker/2:1+events	23:40:34	2
181825	99	2337	12,2322	cyclictest	255205	-21	kworker/2:0+events	23:22:26	2
181821	99	2324	10,2311	cyclictest	204502	-21	kworker/1:2+events	20:18:03	1
181829	99	2321	8,2309	cyclictest	235911	-21	kworker/3:0+events	22:12:15	3
181829	99	2314	10,2301	cyclictest	200246	-21	kworker/3:1+events	20:24:07	3
181829	99	2309	8,2298	cyclictest	215788	-21	kworker/3:2+events	21:00:58	3
181829	99	2303	11,2289	cyclictest	266193	-21	kworker/3:1+events	23:39:04	3
181825	99	2302	12,2287	cyclictest	266623	-21	kworker/2:1+events	23:37:30	2
181817	99	2302	12,2286	cyclictest	261665	-21	kworker/0:1+events	23:18:58	0
181825	99	2298	11,2284	cyclictest	221188	-21	kworker/2:1+events	21:19:18	2
181821	99	2297	10,2284	cyclictest	240784	-21	kworker/1:2+events	22:23:19	1
181821	99	2292	10,2279	cyclictest	234160	-21	kworker/1:1+events	21:57:41	1
181821	99	2292	10,2279	cyclictest	234160	-21	kworker/1:1+events	21:57:40	1
181829	99	2281	11,2266	cyclictest	253808	-21	kworker/3:0+events	22:54:59	3
181825	99	2280	10,2267	cyclictest	256853	-21	kworker/2:2+events	23:04:27	2
181829	99	2278	11,2264	cyclictest	193079	-21	kworker/3:2+events	19:59:39	3
181829	99	2275	11,2261	cyclictest	215788	-21	kworker/3:2+events	21:14:45	3
181829	99	2273	11,2259	cyclictest	214034	-21	kworker/3:0+events	20:51:54	3
181829	99	2272	11,2258	cyclictest	280880	-21	kworker/3:0+events	00:22:25	3
181829	99	2272	10,2259	cyclictest	267820	-21	kworker/3:0+events	23:47:30	3
181829	99	2272	10,2259	cyclictest	267820	-21	kworker/3:0+events	23:47:30	3
181829	99	2271	11,2257	cyclictest	224266	-21	kworker/3:1+events	21:31:02	3
181829	99	2271	11,2256	cyclictest	274605	-21	kworker/3:0+events	00:02:20	3
181829	99	2271	10,2258	cyclictest	229002	-21	kworker/3:2+events	21:51:34	3
181817	99	2270	10,2257	cyclictest	245282	-21	kworker/0:0+events	22:52:19	0
181829	99	2269	11,2255	cyclictest	229002	-21	kworker/3:2+events	21:48:05	3
181829	99	2268	11,2254	cyclictest	245249	-21	kworker/3:2+events	22:31:46	3
181829	99	2268	10,2258	cyclictest	186880	-21	kworker/3:1+events	19:23:50	3
181829	99	2268	10,2255	cyclictest	232378	-21	kworker/3:1+events	22:04:35	3
181829	99	2268	10,2254	cyclictest	280880	-21	kworker/3:0+events	00:19:01	3
181829	99	2266	9,2254	cyclictest	191451	-21	kworker/3:0+events	19:36:24	3
181821	99	2266	9,2254	cyclictest	268088	-21	kworker/1:1+events	23:58:31	1
181829	99	2262	10,2249	cyclictest	255398	-21	kworker/3:1+events	23:02:11	3
181829	99	2259	11,2244	cyclictest	267820	-21	kworker/3:0+events	23:42:31	3
181829	99	2255	7,2246	cyclictest	207850	-21	kworker/3:2+events	20:45:01	3
181829	99	2253	9,2241	cyclictest	260148	-21	kworker/3:0+events	23:15:10	3
181829	99	2253	10,2240	cyclictest	188576	-21	kworker/3:2+events	19:32:58	3
181829	99	2250	11,2235	cyclictest	282769	-21	kworker/3:2+events	00:38:49	3
181829	99	2250	10,2236	cyclictest	212404	-21	kworker/3:1+events	20:44:15	3
181829	99	2235	11,2221	cyclictest	269507	-21	kworker/3:2+events	23:58:53	3
181829	99	2229	10,2215	cyclictest	202831	-21	kworker/3:2+events	20:11:54	3
181817	99	2229	9,2217	cyclictest	227670	-21	kworker/0:2+events	21:43:52	0
181829	99	2226	10,2213	cyclictest	217452	-21	kworker/3:0+events	21:09:03	3
181829	99	2224	11,2210	cyclictest	197941	-21	kworker/3:0+events	20:05:21	3
181821	99	2221	11,2206	cyclictest	186941	-21	kworker/1:2+events	19:28:03	1
181829	99	2219	9,2207	cyclictest	229002	-21	kworker/3:2+events	21:55:47	3
181829	99	2219	9,2207	cyclictest	229002	-21	kworker/3:2+events	21:55:47	3
181825	99	2218	12,2203	cyclictest	279273	-21	kworker/2:2+events	00:24:44	2
181821	99	2215	9,2203	cyclictest	193047	-21	kworker/1:1+events	19:44:21	1
181821	99	2205	8,2194	cyclictest	247267	-21	kworker/1:2+events	22:53:28	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00