OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun Nov 30, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3630723	99	2814	13,2797	cyclictest	3700161	-21	kworker/0:0+events	22:55:22	0
3630723	99	2790	10,2775	cyclictest	3648880	-21	kworker/0:2+events	20:10:14	0
3630723	99	2728	13,2710	cyclictest	3653366	-21	kworker/0:0+events	20:20:14	0
3630723	99	2713	12,2699	cyclictest	3687360	-21	kworker/0:2+events	22:15:23	0
3630726	99	2690	11,2677	cyclictest	3669506	-21	kworker/1:1+events	21:50:02	1
3630731	99	2656	11,2641	cyclictest	3640540	-21	kworker/2:1+events	19:40:23	2
3630733	99	2577	13,2560	cyclictest	3659950	-21	kworker/3:1+events	20:50:18	3
3630733	99	2566	12,2551	cyclictest	3690527	-21	kworker/3:0+events	22:32:27	3
3630733	99	2565	12,2550	cyclictest	3648759	-21	kworker/3:2+events	20:05:16	3
3630726	99	2532	9,2519	cyclictest	3687199	-21	kworker/1:2+events	22:25:11	1
3630733	99	2522	8,2510	cyclictest	3719103	-21	kworker/3:2+events	23:45:17	3
3630726	99	2477	10,2463	cyclictest	3647286	-21	kworker/1:2+events	20:11:23	1
3630733	99	2476	12,2461	cyclictest	3647041	-21	kworker/3:0+events	19:57:34	3
3630726	99	2474	12,2460	cyclictest	3653462	-21	kworker/1:2+events	20:40:22	1
3630731	99	2464	12,2448	cyclictest	3644234	-21	kworker/2:1+events	20:05:39	2
3630731	99	2451	12,2435	cyclictest	3695204	-21	kworker/2:0+events	22:40:52	2
3630731	99	2447	12,2431	cyclictest	3715978	-21	kworker/2:1+events	23:37:44	2
3630726	99	2446	12,2430	cyclictest	3709761	-21	kworker/1:2+events	23:39:12	1
3630731	99	2445	12,2429	cyclictest	3706408	-21	kworker/2:2+events	23:27:30	2
3630733	99	2444	11,2430	cyclictest	3651701	-21	kworker/3:0+events	20:19:07	3
3630731	99	2444	12,2429	cyclictest	3656596	-21	kworker/2:1+events	20:30:55	2
3630726	99	2432	12,2416	cyclictest	3653462	-21	kworker/1:2+events	21:08:06	1
3630723	99	2405	12,2389	cyclictest	3664448	-21	kworker/0:1+events	20:54:29	0
3630733	99	2401	11,2387	cyclictest	3703362	-21	kworker/3:2+events	23:00:16	3
3630726	99	2399	11,2384	cyclictest	3664540	-21	kworker/1:1+events	20:55:37	1
3630723	99	2398	12,2382	cyclictest	3706348	-21	kworker/0:0+events	23:04:47	0
3630726	99	2393	12,2378	cyclictest	3709761	-21	kworker/1:2+events	23:16:34	1
3630723	99	2388	10,2375	cyclictest	3656718	-21	kworker/0:1+events	20:32:28	0
3630733	99	2383	12,2368	cyclictest	3647041	-21	kworker/3:0+events	20:00:16	3
3630733	99	2382	11,2368	cyclictest	3730512	-21	kworker/3:1+events	00:25:58	3
3630733	99	2380	12,2365	cyclictest	3709550	-21	kworker/3:0+events	23:27:54	3
3630723	99	2369	11,2355	cyclictest	3637277	-21	kworker/0:1+events	19:31:14	0
3630726	99	2362	10,2349	cyclictest	3669506	-21	kworker/1:1+events	21:57:37	1
3630733	99	2352	12,2337	cyclictest	3630397	-21	kworker/3:1+events	19:20:33	3
3630726	99	2352	12,2336	cyclictest	3719163	-21	kworker/1:0+events	23:45:38	1
3630726	99	2351	12,2336	cyclictest	3687199	-21	kworker/1:2+events	22:22:35	1
3630723	99	2349	12,2333	cyclictest	3683706	-21	kworker/0:0+events	22:08:30	0
3630726	99	2347	12,2332	cyclictest	3650214	-21	kworker/1:1+events	20:15:59	1
3630733	99	2327	11,2312	cyclictest	3720734	-21	kworker/3:1+events	23:55:22	3
3630733	99	2325	10,2313	cyclictest	3713219	-21	kworker/3:1+events	23:40:41	3
3630726	99	2324	7,2315	cyclictest	3680216	-21	kworker/1:0+events	21:45:06	1
3630723	99	2319	12,2304	cyclictest	3685686	-21	kworker/0:1+events	22:03:34	0
3630733	99	2313	10,2299	cyclictest	3722620	-21	kworker/3:2+events	00:03:38	3
3630726	99	2309	11,2294	cyclictest	3720795	-21	kworker/1:2+events	23:53:31	1
3630731	99	2283	10,2271	cyclictest	3732204	-21	kworker/2:1+events	00:30:08	2
3630733	99	2282	10,2269	cyclictest	3662814	-21	kworker/3:2+events	20:57:07	3
3630723	99	2277	10,2264	cyclictest	3673981	-21	kworker/0:1+events	21:24:02	0
3630733	99	2275	11,2261	cyclictest	3672478	-21	kworker/3:1+events	21:19:54	3
3630733	99	2275	10,2262	cyclictest	3701552	-21	kworker/3:0+events	22:53:48	3
3630731	99	2275	10,2262	cyclictest	3690795	-21	kworker/2:1+events	22:19:56	2
3630733	99	2274	11,2259	cyclictest	3713219	-21	kworker/3:1+events	23:30:34	3
3630733	99	2273	11,2260	cyclictest	3690527	-21	kworker/3:0+events	22:35:08	3
3630733	99	2273	11,2258	cyclictest	3687036	-21	kworker/3:1+events	22:09:39	3
3630733	99	2273	10,2260	cyclictest	3636953	-21	kworker/3:0+events	19:34:39	3
3630733	99	2272	10,2258	cyclictest	3644101	-21	kworker/3:1+events	19:50:16	3
3630733	99	2271	11,2257	cyclictest	3651701	-21	kworker/3:0+events	20:27:06	3
3630733	99	2271	10,2258	cyclictest	3687036	-21	kworker/3:1+events	22:11:34	3
3630733	99	2270	11,2256	cyclictest	3636953	-21	kworker/3:0+events	19:48:45	3
3630733	99	2270	10,2257	cyclictest	3681936	-21	kworker/3:0+events	22:02:07	3
3630733	99	2269	8,2258	cyclictest	3730512	-21	kworker/3:1+events	00:23:40	3
3630733	99	2268	11,2254	cyclictest	3674455	-21	kworker/3:2+events	21:37:03	3
3630733	99	2268	11,2254	cyclictest	3662814	-21	kworker/3:2+events	21:12:40	3
3630733	99	2267	9,2254	cyclictest	3730512	-21	kworker/3:1+events	00:34:43	3
3630733	99	2267	11,2252	cyclictest	3717455	-21	kworker/3:0+events	23:52:22	3
3630733	99	2267	10,2254	cyclictest	3703362	-21	kworker/3:2+events	23:09:42	3
3630733	99	2264	11,2250	cyclictest	3680333	-21	kworker/3:1+events	21:47:44	3
3630733	99	2264	11,2250	cyclictest	3656567	-21	kworker/3:2+events	20:36:36	3
3630733	99	2264	10,2251	cyclictest	3727310	-21	kworker/3:1+events	00:11:33	3
3630733	99	2264	10,2251	cyclictest	3636953	-21	kworker/3:0+events	19:43:46	3
3630733	99	2260	11,2246	cyclictest	3681936	-21	kworker/3:0+events	21:50:46	3
3630733	99	2255	10,2242	cyclictest	3703362	-21	kworker/3:2+events	23:17:43	3
3630733	99	2254	11,2240	cyclictest	3717455	-21	kworker/3:0+events	23:38:07	3
3630733	99	2254	11,2240	cyclictest	3672478	-21	kworker/3:1+events	21:26:44	3
3630733	99	2254	11,2239	cyclictest	3664477	-21	kworker/3:0+events	21:03:33	3
3630731	99	2253	10,2240	cyclictest	3711652	-21	kworker/2:1+events	23:24:52	2
3630726	99	2251	10,2238	cyclictest	3642120	-21	kworker/1:1+events	19:48:21	1
3630733	99	2248	11,2234	cyclictest	3703362	-21	kworker/3:2+events	23:12:02	3
3630731	99	2247	10,2234	cyclictest	3725659	-21	kworker/2:2+events	00:02:56	2
3630731	99	2247	10,2234	cyclictest	3715978	-21	kworker/2:1+events	23:33:57	2
3630723	99	2247	11,2232	cyclictest	3642029	-21	kworker/0:2+events	19:45:41	0
3630733	99	2245	10,2232	cyclictest	3690527	-21	kworker/3:0+events	22:24:28	3
3630731	99	2245	9,2232	cyclictest	3695204	-21	kworker/2:0+events	22:28:15	2
3630723	99	2244	12,2229	cyclictest	3709611	-21	kworker/0:1+events	23:18:30	0
3630731	99	2238	10,2225	cyclictest	3636921	-21	kworker/2:1+events	19:27:03	2
3630733	99	2237	11,2222	cyclictest	3630397	-21	kworker/3:1+events	19:29:19	3
3630731	99	2237	9,2225	cyclictest	3659920	-21	kworker/2:1+events	20:52:33	2
3630731	99	2237	11,2223	cyclictest	3701580	-21	kworker/2:2+events	22:55:46	2
3630733	99	2236	8,2224	cyclictest	3630397	-21	kworker/3:1+events	19:14:54	3
3630731	99	2236	11,2221	cyclictest	3648610	-21	kworker/2:0+events	20:02:12	2
3630731	99	2236	10,2222	cyclictest	3677217	-21	kworker/2:0+events	21:34:23	2
3630731	99	2233	10,2219	cyclictest	3723949	-21	kworker/2:1+events	00:13:27	2
3630726	99	2232	10,2219	cyclictest	3669506	-21	kworker/1:1+events	21:27:30	1
3630731	99	2230	11,2216	cyclictest	3717604	-21	kworker/2:0+events	23:41:53	2
3630726	99	2230	10,2217	cyclictest	3642120	-21	kworker/1:1+events	19:53:42	1
3630731	99	2228	10,2215	cyclictest	3679014	-21	kworker/2:1+events	21:51:10	2
3630731	99	2227	11,2212	cyclictest	3687216	-21	kworker/2:2+events	22:08:52	2
3630731	99	2227	11,2212	cyclictest	3669421	-21	kworker/2:2+events	21:20:18	2
3630731	99	2226	11,2212	cyclictest	3650247	-21	kworker/2:2+events	20:20:59	2
3630731	99	2226	11,2211	cyclictest	3666166	-21	kworker/2:2+events	21:01:14	2
3630731	99	2225	10,2212	cyclictest	3671291	-21	kworker/2:0+events	21:19:31	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00