OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Feb 09, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3909504	99	2670	8,2658	cyclictest	3936345	-21	kworker/3:0+events	20:45:12	3
3909496	99	2653	13,2635	cyclictest	3919170	-21	kworker/1:2+events	20:10:11	1
3909496	99	2639	13,2623	cyclictest	3935169	-21	kworker/1:2+events	20:35:17	1
3909500	99	2570	12,2554	cyclictest	3989939	-21	kworker/2:0+events	23:20:22	2
3909491	99	2510	11,2496	cyclictest	3951148	-21	kworker/0:1+events	21:25:01	0
3909496	99	2492	12,2476	cyclictest	3954372	-21	kworker/1:2+events	21:33:02	1
3909491	99	2491	12,2476	cyclictest	3986844	-21	kworker/0:1+events	23:23:07	0
3909496	99	2489	12,2474	cyclictest	4005710	-21	kworker/1:1+events	00:10:44	1
3909496	99	2489	12,2474	cyclictest	4005710	-21	kworker/1:1+events	00:10:44	1
3909496	99	2486	12,2471	cyclictest	3943140	-21	kworker/1:1+events	20:54:52	1
3909496	99	2464	11,2449	cyclictest	3962035	-21	kworker/1:2+events	21:55:01	1
3909496	99	2454	11,2440	cyclictest	3959226	-21	kworker/1:1+events	21:46:37	1
3909500	99	2450	12,2434	cyclictest	4010758	-21	kworker/2:2+events	00:30:13	2
3909500	99	2443	12,2427	cyclictest	3954252	-21	kworker/2:2+events	21:42:47	2
3909491	99	2435	11,2421	cyclictest	3983958	-21	kworker/0:2+events	23:05:13	0
3909500	99	2424	12,2408	cyclictest	3967470	-21	kworker/2:0+events	22:07:04	2
3909504	99	2422	12,2406	cyclictest	4002580	-21	kworker/3:2+events	00:00:26	3
3909500	99	2422	12,2407	cyclictest	3934923	-21	kworker/2:0+events	20:38:22	2
3909504	99	2421	11,2407	cyclictest	3914363	-21	kworker/3:2+events	19:25:20	3
3909500	99	2420	12,2405	cyclictest	3946470	-21	kworker/2:1+events	21:24:13	2
3909504	99	2418	12,2403	cyclictest	4005922	-21	kworker/3:2+events	00:25:15	3
3909504	99	2409	10,2395	cyclictest	3912716	-21	kworker/3:0+events	19:20:26	3
3909500	99	2409	10,2396	cyclictest	3980463	-21	kworker/2:1+events	22:48:02	2
3909504	99	2407	12,2391	cyclictest	3962544	-21	kworker/3:0+events	21:53:07	3
3909504	99	2404	12,2390	cyclictest	3944474	-21	kworker/3:1+events	21:02:08	3
3909500	99	2399	12,2384	cyclictest	3982067	-21	kworker/2:2+events	22:57:55	2
3909504	99	2390	0,2387	cyclictest	3944474	-21	kworker/3:1+events	21:05:08	3
3909504	99	2383	12,2368	cyclictest	3919322	-21	kworker/3:0+events	19:49:18	3
3909500	99	2366	10,2352	cyclictest	4002791	-21	kworker/2:2+events	00:14:57	2
3909500	99	2366	10,2352	cyclictest	4002791	-21	kworker/2:2+events	00:14:56	2
3909504	99	2351	11,2337	cyclictest	3999316	-21	kworker/3:2+events	23:50:32	3
3909491	99	2351	12,2336	cyclictest	3924500	-21	kworker/0:0+events	20:08:01	0
3909504	99	2349	12,2333	cyclictest	3926865	-21	kworker/3:0+events	20:07:15	3
3909504	99	2345	10,2332	cyclictest	4005922	-21	kworker/3:2+events	00:11:53	3
3909504	99	2345	10,2332	cyclictest	4005922	-21	kworker/3:2+events	00:11:53	3
3909504	99	2341	12,2326	cyclictest	3982005	-21	kworker/3:0+events	22:54:04	3
3909496	99	2330	12,2315	cyclictest	3994702	-21	kworker/1:2+events	23:33:06	1
3909491	99	2328	11,2313	cyclictest	3982096	-21	kworker/0:0+events	23:04:29	0
3909491	99	2326	11,2311	cyclictest	3957546	-21	kworker/0:1+events	22:00:18	0
3909496	99	2322	12,2307	cyclictest	4002609	-21	kworker/1:2+events	00:34:00	1
3909500	99	2319	11,2305	cyclictest	3994885	-21	kworker/2:2+events	23:39:15	2
3909491	99	2313	8,2302	cyclictest	3999439	-21	kworker/0:1+events	00:01:13	0
3909491	99	2311	12,2294	cyclictest	3957546	-21	kworker/0:1+events	21:55:22	0
3909504	99	2309	8,2298	cyclictest	3974098	-21	kworker/3:0+events	22:28:19	3
3909491	99	2308	11,2295	cyclictest	3946223	-21	kworker/0:2+events	21:40:07	0
3909500	99	2306	12,2292	cyclictest	3982067	-21	kworker/2:2+events	23:07:34	2
3909496	99	2305	11,2291	cyclictest	3957605	-21	kworker/1:0+events	22:11:58	1
3909491	99	2304	11,2290	cyclictest	3993920	-21	kworker/0:1+events	23:32:42	0
3909491	99	2303	11,2288	cyclictest	3942929	-21	kworker/0:2+events	20:52:08	0
3909496	99	2300	6,2291	cyclictest	3919170	-21	kworker/1:2+events	19:50:49	1
3909496	99	2300	11,2286	cyclictest	4002609	-21	kworker/1:2+events	00:26:46	1
3909491	99	2290	12,2274	cyclictest	3980496	-21	kworker/0:2+events	22:52:10	0
3909500	99	2276	10,2262	cyclictest	3954252	-21	kworker/2:2+events	21:46:15	2
3909504	99	2271	11,2257	cyclictest	3917599	-21	kworker/3:1+events	19:36:24	3
3909496	99	2269	10,2255	cyclictest	3933440	-21	kworker/1:0+events	20:28:49	1
3909496	99	2265	11,2251	cyclictest	4002609	-21	kworker/1:2+events	00:02:43	1
3909496	99	2260	11,2247	cyclictest	3935169	-21	kworker/1:2+events	20:47:34	1
3909491	99	2260	12,2245	cyclictest	3957546	-21	kworker/0:1+events	22:15:45	0
3909496	99	2258	11,2244	cyclictest	3957605	-21	kworker/1:0+events	21:39:46	1
3909496	99	2258	11,2244	cyclictest	3941476	-21	kworker/1:0+events	21:02:53	1
3909496	99	2256	9,2243	cyclictest	3919170	-21	kworker/1:2+events	20:02:17	1
3909496	99	2255	10,2242	cyclictest	3931755	-21	kworker/1:1+events	20:21:36	1
3909496	99	2254	8,2242	cyclictest	3976942	-21	kworker/1:0+events	22:36:39	1
3909496	99	2252	8,2241	cyclictest	3957605	-21	kworker/1:0+events	21:57:17	1
3909496	99	2252	10,2238	cyclictest	3914184	-21	kworker/1:0+events	19:23:27	1
3909496	99	2251	10,2237	cyclictest	3949241	-21	kworker/1:0+events	21:24:37	1
3909496	99	2250	11,2236	cyclictest	3997905	-21	kworker/1:0+events	23:59:18	1
3909496	99	2250	10,2237	cyclictest	3978924	-21	kworker/1:2+events	22:45:46	1
3909500	99	2249	11,2235	cyclictest	3912681	-21	kworker/2:0+events	19:35:15	2
3909504	99	2246	11,2231	cyclictest	3938275	-21	kworker/3:1+events	20:42:08	3
3909500	99	2240	12,2224	cyclictest	3931389	-21	kworker/2:1+events	20:30:43	2
3909491	99	2240	8,2228	cyclictest	3997843	-21	kworker/0:2+events	23:45:12	0
3909500	99	2233	10,2220	cyclictest	3914607	-21	kworker/2:2+events	19:30:15	2
3909500	99	2232	8,2221	cyclictest	3974311	-21	kworker/2:1+events	22:30:58	2
3909496	99	2231	11,2217	cyclictest	3974410	-21	kworker/1:2+events	22:34:21	1
3909496	99	2230	8,2219	cyclictest	3941476	-21	kworker/1:0+events	20:57:29	1
3909496	99	2229	9,2217	cyclictest	3991456	-21	kworker/1:0+events	23:29:39	1
3909496	99	2229	11,2215	cyclictest	3980559	-21	kworker/1:1+events	23:01:46	1
3909500	99	2227	11,2213	cyclictest	3951246	-21	kworker/2:0+events	21:27:42	2
3909504	99	2226	11,2212	cyclictest	3989892	-21	kworker/3:1+events	23:42:17	3
3909500	99	2226	11,2211	cyclictest	3936660	-21	kworker/2:2+events	20:42:31	2
3909500	99	2224	11,2210	cyclictest	4002791	-21	kworker/2:2+events	00:01:59	2
3909500	99	2224	11,2209	cyclictest	3989939	-21	kworker/2:0+events	23:18:05	2
3909491	99	2224	11,2210	cyclictest	3938244	-21	kworker/0:1+events	20:39:52	0
3909500	99	2223	10,2210	cyclictest	3936660	-21	kworker/2:2+events	20:49:53	2
3909500	99	2223	10,2209	cyclictest	4006108	-21	kworker/2:1+events	00:15:41	2
3909500	99	2221	9,2208	cyclictest	3967470	-21	kworker/2:0+events	22:11:34	2
3909504	99	2217	10,2203	cyclictest	3930127	-21	kworker/3:2+events	20:27:18	3
3909491	99	2216	10,2202	cyclictest	3931843	-21	kworker/0:2+events	20:29:34	0
3909496	99	2214	10,2201	cyclictest	3926956	-21	kworker/1:1+events	20:06:29	1
3909504	99	2212	3,2206	cyclictest	3952887	-21	kworker/3:2+events	21:26:08	3
3909500	99	2212	9,2199	cyclictest	4014257	-21	kworker/2:0+events	00:39:48	2
3909500	99	2208	11,2194	cyclictest	3942990	-21	kworker/2:1+events	20:55:15	2
3909504	99	2206	8,2194	cyclictest	3940343	-21	kworker/3:2+events	20:50:15	3
3909504	99	2205	11,2190	cyclictest	3994914	-21	kworker/3:0+events	23:58:56	3
3909500	99	2205	10,2192	cyclictest	3906492	-21	kworker/2:1+events	19:21:12	2
3909504	99	2203	11,2188	cyclictest	3962544	-21	kworker/3:0+events	22:02:11	3
3909504	99	2203	10,2189	cyclictest	3936345	-21	kworker/3:0+events	21:12:43	3
3909504	99	2202	11,2188	cyclictest	3972436	-21	kworker/3:2+events	22:46:30	3
3909500	99	2202	10,2188	cyclictest	3926834	-21	kworker/2:1+events	20:01:32	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00