OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sat Dec 27, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2638429	99	5739	7,5728	cyclictest	2639512	-21	kworker/2:0+events	19:11:27	2
2638423	99	5708	21,5683	cyclictest	2628231	-21	kworker/0:1+events	19:11:50	0
2638433	99	3819	15,3800	cyclictest	2636618	-21	kworker/3:0+events	19:11:04	3
2638426	99	3213	12,3198	cyclictest	2635463	-21	kworker/1:0+events	19:12:11	1
2638423	99	2957	14,2939	cyclictest	2694926	-21	kworker/0:1+events	22:15:01	0
2638423	99	2878	14,2859	cyclictest	2658133	-21	kworker/0:2+events	20:15:01	0
2638426	99	2791	13,2773	cyclictest	2685368	-21	kworker/1:1+events	21:35:21	1
2638426	99	2769	13,2751	cyclictest	2683764	-21	kworker/1:0+events	21:40:12	1
2638433	99	2711	13,2694	cyclictest	2740214	-21	kworker/3:0+events	00:25:17	3
2638433	99	2485	11,2471	cyclictest	2673006	-21	kworker/3:2+events	21:00:16	3
2638423	99	2445	12,2429	cyclictest	2661274	-21	kworker/0:0+events	20:30:18	0
2638433	99	2421	12,2407	cyclictest	2711120	-21	kworker/3:1+events	22:55:17	3
2638433	99	2407	11,2393	cyclictest	2702833	-21	kworker/3:0+events	22:39:45	3
2638429	99	2393	11,2379	cyclictest	2666421	-21	kworker/2:0+events	20:50:20	2
2638429	99	2362	11,2347	cyclictest	2656317	-21	kworker/2:1+events	20:24:14	2
2638429	99	2362	11,2347	cyclictest	2656317	-21	kworker/2:1+events	20:24:13	2
2638426	99	2356	12,2340	cyclictest	2733709	-21	kworker/1:1+events	00:19:36	1
2638429	99	2341	12,2326	cyclictest	2639512	-21	kworker/2:0+events	19:15:15	2
2638433	99	2304	12,2290	cyclictest	2731832	-21	kworker/3:1+events	00:30:13	3
2638429	99	2283	10,2270	cyclictest	2656317	-21	kworker/2:1+events	20:32:35	2
2638429	99	2277	11,2263	cyclictest	2730380	-21	kworker/2:0+events	00:02:24	2
2638426	99	2274	11,2260	cyclictest	2698181	-21	kworker/1:0+events	22:26:33	1
2638426	99	2274	10,2262	cyclictest	2719198	-21	kworker/1:1+events	23:25:47	1
2638426	99	2267	11,2253	cyclictest	2646312	-21	kworker/1:2+events	19:40:15	1
2638426	99	2266	11,2251	cyclictest	2744602	-21	kworker/1:2+events	00:38:11	1
2638423	99	2266	10,2253	cyclictest	2694926	-21	kworker/0:1+events	22:18:05	0
2638426	99	2263	9,2250	cyclictest	2646312	-21	kworker/1:2+events	19:34:34	1
2638423	99	2263	11,2249	cyclictest	2677567	-21	kworker/0:1+events	21:11:17	0
2638429	99	2262	11,2248	cyclictest	2701236	-21	kworker/2:0+events	22:32:52	2
2638429	99	2258	11,2244	cyclictest	2728785	-21	kworker/2:1+events	23:54:25	2
2638433	99	2244	4,2237	cyclictest	2712770	-21	kworker/3:0+events	23:11:10	3
2638423	99	2244	11,2230	cyclictest	2736829	-21	kworker/0:2+events	00:15:22	0
2638423	99	2236	10,2223	cyclictest	2701308	-21	kworker/0:0+events	22:36:21	0
2638426	99	2229	7,2219	cyclictest	2727251	-21	kworker/1:0+events	23:45:25	1
2638433	99	2226	11,2211	cyclictest	2723767	-21	kworker/3:0+events	23:40:13	3
2638433	99	2219	11,2205	cyclictest	2721439	-21	kworker/3:1+events	23:29:35	3
2638426	99	2219	5,2211	cyclictest	2669546	-21	kworker/1:2+events	20:48:05	1
2638429	99	2213	11,2199	cyclictest	2733561	-21	kworker/2:2+events	00:14:36	2
2638433	99	2203	9,2190	cyclictest	2693424	-21	kworker/3:2+events	22:12:01	3
2638423	99	2172	10,2159	cyclictest	2714671	-21	kworker/0:0+events	23:15:24	0
2638433	99	2170	9,2157	cyclictest	2723767	-21	kworker/3:0+events	23:37:10	3
2638433	99	2169	8,2157	cyclictest	2731832	-21	kworker/3:1+events	00:16:31	3
2638433	99	2154	8,2143	cyclictest	2693424	-21	kworker/3:2+events	22:27:37	3
2638433	99	2122	10,2109	cyclictest	2702833	-21	kworker/3:0+events	22:34:26	3
2638423	99	2122	9,2110	cyclictest	2711409	-21	kworker/0:2+events	23:04:44	0
2638426	99	2105	11,2091	cyclictest	2676054	-21	kworker/1:2+events	21:06:48	1
2638423	99	2105	7,2094	cyclictest	2675941	-21	kworker/0:2+events	21:03:20	0
2638429	99	2100	4,2093	cyclictest	2674430	-21	kworker/2:1+events	21:05:15	2
2638426	99	2099	4,2092	cyclictest	2696554	-21	kworker/1:1+events	22:10:54	1
2638433	99	2098	10,2085	cyclictest	2728551	-21	kworker/3:0+events	23:51:23	3
2638426	99	2098	10,2084	cyclictest	2661307	-21	kworker/1:1+events	20:18:28	1
2638429	99	2090	10,2078	cyclictest	2651546	-21	kworker/2:1+events	19:50:05	2
2638423	99	2088	8,2076	cyclictest	2685460	-21	kworker/0:2+events	21:43:13	0
2638423	99	2086	10,2073	cyclictest	2672649	-21	kworker/0:0+events	21:07:12	0
2638433	99	2084	10,2071	cyclictest	2731832	-21	kworker/3:1+events	00:20:22	3
2638429	99	2084	9,2072	cyclictest	2738753	-21	kworker/2:1+events	00:39:20	2
2638429	99	2084	9,2072	cyclictest	2676384	-21	kworker/2:0+events	21:10:56	2
2638426	99	2084	10,2070	cyclictest	2711320	-21	kworker/1:2+events	23:09:14	1
2638429	99	2083	6,2074	cyclictest	2712916	-21	kworker/2:2+events	23:01:18	2
2638429	99	2083	4,2076	cyclictest	2720831	-21	kworker/2:0+events	23:25:01	2
2638423	99	2083	6,2074	cyclictest	2646433	-21	kworker/0:2+events	19:35:43	0
2638429	99	2082	8,2071	cyclictest	2719017	-21	kworker/2:2+events	23:16:58	2
2638429	99	2082	10,2069	cyclictest	2728785	-21	kworker/2:1+events	23:56:19	2
2638426	99	2082	9,2070	cyclictest	2641914	-21	kworker/1:1+events	19:21:49	1
2638426	99	2082	6,2074	cyclictest	2698181	-21	kworker/1:0+events	22:30:12	1
2638426	99	2082	10,2069	cyclictest	2724033	-21	kworker/1:1+events	23:41:22	1
2638423	99	2082	10,2069	cyclictest	2738465	-21	kworker/0:0+events	00:22:59	0
2638429	99	2081	6,2072	cyclictest	2678960	-21	kworker/2:2+events	21:19:43	2
2638426	99	2081	6,2072	cyclictest	2662969	-21	kworker/1:2+events	20:34:52	1
2638423	99	2081	8,2070	cyclictest	2658246	-21	kworker/0:3+events	20:17:41	0
2638426	99	2080	9,2068	cyclictest	2727251	-21	kworker/1:0+events	00:02:46	1
2638426	99	2079	9,2069	cyclictest	2714738	-21	kworker/1:1+events	23:10:01	1
2638429	99	2078	6,2069	cyclictest	2730380	-21	kworker/2:0+events	00:05:49	2
2638429	99	2078	6,2069	cyclictest	2666421	-21	kworker/2:0+events	20:35:58	2
2638429	99	2078	4,2071	cyclictest	2676384	-21	kworker/2:0+events	21:27:19	2
2638429	99	2078	10,2065	cyclictest	2656317	-21	kworker/2:1+events	20:16:56	2
2638423	99	2078	9,2066	cyclictest	2691653	-21	kworker/0:2+events	22:09:45	0
2638423	99	2078	7,2068	cyclictest	2705890	-21	kworker/0:1+events	22:42:47	0
2638429	99	2077	10,2064	cyclictest	2741460	-21	kworker/2:0+events	00:26:45	2
2638426	99	2077	5,2069	cyclictest	2735315	-21	kworker/1:2+events	00:10:28	1
2638423	99	2077	6,2068	cyclictest	2687089	-21	kworker/0:1+events	21:45:56	0
2638423	99	2077	6,2068	cyclictest	2679258	-21	kworker/0:0+events	21:35:44	0
2638429	99	2076	7,2066	cyclictest	2733561	-21	kworker/2:2+events	00:24:07	2
2638426	99	2076	10,2063	cyclictest	2735315	-21	kworker/1:2+events	00:08:55	1
2638426	99	2076	10,2063	cyclictest	2719198	-21	kworker/1:1+events	23:23:06	1
2638426	99	2076	10,2063	cyclictest	2649834	-21	kworker/1:1+events	19:47:04	1
2638426	99	2076	10,2062	cyclictest	2707805	-21	kworker/1:2+events	22:43:09	1
2638426	99	2075	9,2063	cyclictest	2653036	-21	kworker/1:1+events	20:07:43	1
2638426	99	2075	9,2062	cyclictest	2672682	-21	kworker/1:1+events	20:57:12	1
2638426	99	2075	8,2064	cyclictest	2693804	-21	kworker/1:0+events	22:01:05	1
2638426	99	2075	10,2061	cyclictest	2667865	-21	kworker/1:0+events	20:42:03	1
2638423	99	2075	9,2063	cyclictest	2683856	-21	kworker/0:1+events	21:28:52	0
2638423	99	2075	9,2063	cyclictest	2674338	-21	kworker/0:1+events	20:59:06	0
2638423	99	2075	10,2062	cyclictest	2730292	-21	kworker/0:1+events	23:57:25	0
2638429	99	2074	9,2062	cyclictest	2656317	-21	kworker/2:1+events	20:11:55	2
2638429	99	2074	10,2061	cyclictest	2699513	-21	kworker/2:2+events	22:26:54	2
2638426	99	2074	10,2061	cyclictest	2677655	-21	kworker/1:0+events	21:19:21	1
2638423	99	2074	8,2063	cyclictest	2650079	-21	kworker/0:2+events	19:59:16	0
2638429	99	2073	10,2060	cyclictest	2649891	-21	kworker/2:0+events	19:44:03	2
2638426	99	2073	10,2060	cyclictest	2691916	-21	kworker/1:2+events	22:16:34	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00