OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun Feb 08, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3434637	99	3342	14,3324	cyclictest	3476592	-21	kworker/2:2+events	21:20:16	2
3434630	99	2749	13,2732	cyclictest	3522900	-21	kworker/0:0+events	23:50:14	0
3434630	99	2718	13,2701	cyclictest	3459114	-21	kworker/0:2+events	20:27:12	0
3434635	99	2694	13,2679	cyclictest	3455379	-21	kworker/1:2+events	20:15:02	1
3434635	99	2670	12,2653	cyclictest	3464053	-21	kworker/1:0+events	20:40:14	1
3434637	99	2662	12,2647	cyclictest	3470334	-21	kworker/2:0+events	21:25:14	2
3434640	99	2628	13,2612	cyclictest	3441075	-21	kworker/3:0+events	19:34:44	3
3434635	99	2618	13,2601	cyclictest	3489387	-21	kworker/1:2+events	22:15:19	1
3434635	99	2564	10,2551	cyclictest	3468877	-21	kworker/1:0+events	20:57:19	1
3434630	99	2562	11,2546	cyclictest	3499188	-21	kworker/0:2+events	22:35:14	0
3434640	99	2496	12,2481	cyclictest	3519765	-21	kworker/3:2+events	23:46:49	3
3434635	99	2494	12,2478	cyclictest	3506903	-21	kworker/1:2+events	23:04:58	1
3434635	99	2485	13,2470	cyclictest	3439562	-21	kworker/1:0+events	19:30:12	1
3434635	99	2482	12,2466	cyclictest	3459145	-21	kworker/1:1+events	20:33:44	1
3434635	99	2478	12,2463	cyclictest	3467279	-21	kworker/1:2+events	20:51:17	1
3434635	99	2478	12,2463	cyclictest	3444583	-21	kworker/1:1+events	19:36:38	1
3434635	99	2472	12,2457	cyclictest	3537415	-21	kworker/1:1+events	00:33:52	1
3434635	99	2467	10,2453	cyclictest	3447878	-21	kworker/1:1+events	19:49:41	1
3434640	99	2463	11,2448	cyclictest	3525981	-21	kworker/3:1+events	00:01:41	3
3434635	99	2458	13,2441	cyclictest	3455379	-21	kworker/1:2+events	20:25:18	1
3434640	99	2452	8,2440	cyclictest	3444957	-21	kworker/3:2+events	19:48:53	3
3434640	99	2452	11,2438	cyclictest	3500462	-21	kworker/3:0+events	22:31:48	3
3434640	99	2451	14,2433	cyclictest	3510094	-21	kworker/3:0+events	23:18:14	3
3434640	99	2446	11,2432	cyclictest	3522602	-21	kworker/3:0+events	23:55:34	3
3434640	99	2445	12,2429	cyclictest	3489113	-21	kworker/3:1+events	21:57:03	3
3434637	99	2439	12,2424	cyclictest	3474932	-21	kworker/2:1+events	21:15:20	2
3434630	99	2435	12,2419	cyclictest	3532381	-21	kworker/0:0+events	00:20:16	0
3434637	99	2409	12,2394	cyclictest	3505380	-21	kworker/2:1+events	23:22:03	2
3434630	99	2399	11,2384	cyclictest	3460749	-21	kworker/0:0+events	20:42:08	0
3434630	99	2396	12,2381	cyclictest	3460749	-21	kworker/0:0+events	20:39:51	0
3434630	99	2391	12,2376	cyclictest	3459114	-21	kworker/0:2+events	20:31:51	0
3434635	99	2389	11,2375	cyclictest	3486003	-21	kworker/1:2+events	21:49:28	1
3434630	99	2387	12,2371	cyclictest	3501031	-21	kworker/0:1+events	22:42:43	0
3434630	99	2385	11,2371	cyclictest	3460749	-21	kworker/0:0+events	20:52:25	0
3434630	99	2384	11,2370	cyclictest	3511844	-21	kworker/0:1+events	23:29:19	0
3434630	99	2375	12,2360	cyclictest	3452915	-21	kworker/0:2+events	20:13:31	0
3434630	99	2375	11,2362	cyclictest	3532381	-21	kworker/0:0+events	00:31:33	0
3434630	99	2366	12,2351	cyclictest	3470302	-21	kworker/0:2+events	20:59:15	0
3434630	99	2363	10,2349	cyclictest	3455631	-21	kworker/0:1+events	20:18:51	0
3434637	99	2341	12,2325	cyclictest	3444648	-21	kworker/2:0+events	19:37:46	2
3434637	99	2340	12,2324	cyclictest	3505380	-21	kworker/2:1+events	23:17:04	2
3434637	99	2336	12,2320	cyclictest	3468613	-21	kworker/2:2+events	20:56:11	2
3434637	99	2324	11,2310	cyclictest	3518068	-21	kworker/2:1+events	23:32:44	2
3434637	99	2324	11,2310	cyclictest	3518068	-21	kworker/2:1+events	23:32:44	2
3434637	99	2320	11,2307	cyclictest	3446425	-21	kworker/2:2+events	20:10:06	2
3434630	99	2310	12,2295	cyclictest	3522900	-21	kworker/0:0+events	00:00:55	0
3434640	99	2304	11,2289	cyclictest	3479726	-21	kworker/3:2+events	21:54:47	3
3434635	99	2298	7,2288	cyclictest	3508562	-21	kworker/1:1+events	22:59:59	1
3434630	99	2291	12,2276	cyclictest	3519645	-21	kworker/0:2+events	23:44:33	0
3434637	99	2282	11,2268	cyclictest	3456026	-21	kworker/2:0+events	20:25:40	2
3434635	99	2282	10,2269	cyclictest	3532136	-21	kworker/1:0+events	00:37:41	1
3434630	99	2282	10,2268	cyclictest	3476561	-21	kworker/0:1+events	21:24:51	0
3434635	99	2281	11,2266	cyclictest	3478158	-21	kworker/1:0+events	21:24:28	1
3434635	99	2278	11,2264	cyclictest	3451167	-21	kworker/1:0+events	20:14:16	1
3434635	99	2275	11,2261	cyclictest	3499127	-21	kworker/1:2+events	22:33:17	1
3434635	99	2275	11,2260	cyclictest	3478158	-21	kworker/1:0+events	21:53:16	1
3434635	99	2274	11,2260	cyclictest	3527645	-21	kworker/1:1+events	00:14:57	1
3434635	99	2274	11,2260	cyclictest	3502358	-21	kworker/1:2+events	22:43:30	1
3434635	99	2271	10,2258	cyclictest	3482782	-21	kworker/1:1+events	21:42:41	1
3434640	99	2270	9,2258	cyclictest	3494058	-21	kworker/3:0+events	22:21:23	3
3434635	99	2269	11,2255	cyclictest	3532136	-21	kworker/1:0+events	00:22:53	1
3434635	99	2269	11,2255	cyclictest	3514743	-21	kworker/1:2+events	23:17:49	1
3434635	99	2268	11,2253	cyclictest	3478158	-21	kworker/1:0+events	21:30:31	1
3434635	99	2267	11,2253	cyclictest	3527645	-21	kworker/1:1+events	00:05:31	1
3434635	99	2266	10,2253	cyclictest	3519815	-21	kworker/1:0+events	23:36:37	1
3434640	99	2265	10,2252	cyclictest	3468764	-21	kworker/3:1+events	21:11:10	3
3434635	99	2265	11,2250	cyclictest	3446216	-21	kworker/1:0+events	19:43:11	1
3434635	99	2265	10,2251	cyclictest	3494445	-21	kworker/1:1+events	22:21:47	1
3434635	99	2263	10,2250	cyclictest	3449538	-21	kworker/1:2+events	19:59:29	1
3434640	99	2262	10,2250	cyclictest	3530631	-21	kworker/3:0+events	00:30:03	3
3434630	99	2262	8,2251	cyclictest	3470302	-21	kworker/0:2+events	21:18:43	0
3434640	99	2261	11,2247	cyclictest	3468764	-21	kworker/3:1+events	21:18:21	3
3434640	99	2259	12,2245	cyclictest	3479726	-21	kworker/3:2+events	21:35:05	3
3434640	99	2259	11,2245	cyclictest	3516522	-21	kworker/3:1+events	23:33:07	3
3434640	99	2259	11,2245	cyclictest	3516522	-21	kworker/3:1+events	23:33:06	3
3434640	99	2259	10,2246	cyclictest	3460905	-21	kworker/3:0+events	20:34:06	3
3434635	99	2259	11,2245	cyclictest	3514743	-21	kworker/1:2+events	23:28:56	1
3434635	99	2259	10,2246	cyclictest	3478158	-21	kworker/1:0+events	21:56:43	1
3434630	99	2259	11,2245	cyclictest	3505226	-21	kworker/0:2+events	22:50:27	0
3434640	99	2258	11,2244	cyclictest	3479726	-21	kworker/3:2+events	21:41:34	3
3434635	99	2258	10,2245	cyclictest	3513149	-21	kworker/1:1+events	23:12:11	1
3434635	99	2256	10,2243	cyclictest	3514743	-21	kworker/1:2+events	00:04:46	1
3434635	99	2255	12,2239	cyclictest	3514743	-21	kworker/1:2+events	23:43:29	1
3434635	99	2255	11,2240	cyclictest	3497371	-21	kworker/1:0+events	22:29:06	1
3434635	99	2255	11,2240	cyclictest	3449538	-21	kworker/1:2+events	20:01:22	1
3434635	99	2255	10,2242	cyclictest	3518099	-21	kworker/1:1+events	23:31:57	1
3434635	99	2255	10,2242	cyclictest	3518099	-21	kworker/1:1+events	23:31:57	1
3434640	99	2254	10,2241	cyclictest	3460905	-21	kworker/3:0+events	20:38:20	3
3434640	99	2251	11,2236	cyclictest	3530631	-21	kworker/3:0+events	00:39:09	3
3434635	99	2251	10,2238	cyclictest	3459145	-21	kworker/1:1+events	20:36:25	1
3434635	99	2250	9,2237	cyclictest	3473511	-21	kworker/1:0+events	21:09:43	1
3434630	99	2249	11,2235	cyclictest	3479832	-21	kworker/0:2+events	21:29:00	0
3434635	99	2247	11,2233	cyclictest	3479787	-21	kworker/1:2+events	21:29:45	1
3434635	99	2245	10,2232	cyclictest	3532136	-21	kworker/1:0+events	00:17:41	1
3434635	99	2243	8,2232	cyclictest	3471749	-21	kworker/1:2+events	21:14:34	1
3434635	99	2243	11,2230	cyclictest	3514743	-21	kworker/1:2+events	23:59:47	1
3434635	99	2243	10,2230	cyclictest	3516433	-21	kworker/1:0+events	23:23:32	1
3434635	99	2241	6,2232	cyclictest	3478158	-21	kworker/1:0+events	22:06:53	1
3434640	99	2240	10,2227	cyclictest	3444957	-21	kworker/3:2+events	19:55:20	3
3434640	99	2240	10,2227	cyclictest	3443025	-21	kworker/3:1+events	19:39:42	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00