OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun Dec 07, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2739336	99	3146	5,3136	cyclictest	2792758	-21	kworker/0:1+events	22:00:20	0
2739338	99	2810	13,2793	cyclictest	2839606	-21	kworker/1:0+events	00:23:50	1
2739338	99	2789	13,2770	cyclictest	2791184	-21	kworker/1:1+events	22:45:13	1
2739338	99	2777	13,2760	cyclictest	2759137	-21	kworker/1:2+events	20:15:00	1
2739342	99	2738	13,2721	cyclictest	2821802	-21	kworker/2:1+events	23:30:17	2
2739342	99	2719	13,2703	cyclictest	2817183	-21	kworker/2:1+events	23:10:14	2
2739336	99	2674	11,2658	cyclictest	2780015	-21	kworker/0:2+events	21:20:16	0
2739342	99	2551	7,2540	cyclictest	2837676	-21	kworker/2:1+events	00:25:21	2
2739336	99	2547	13,2531	cyclictest	2825178	-21	kworker/0:2+events	23:35:14	0
2739342	99	2545	11,2531	cyclictest	2740464	-21	kworker/2:0+events	19:15:15	2
2739338	99	2524	7,2513	cyclictest	2826514	-21	kworker/1:2+events	23:40:17	1
2739342	99	2516	12,2500	cyclictest	2765556	-21	kworker/2:1+events	20:35:17	2
2739338	99	2509	10,2494	cyclictest	2771964	-21	kworker/1:2+events	20:50:15	1
2739336	99	2497	12,2481	cyclictest	2832080	-21	kworker/0:2+events	00:19:38	0
2739336	99	2489	11,2474	cyclictest	2825178	-21	kworker/0:2+events	23:45:18	0
2739342	99	2442	10,2428	cyclictest	2837676	-21	kworker/2:1+events	00:20:02	2
2739346	99	2432	11,2419	cyclictest	2839458	-21	kworker/3:0+events	00:30:13	3
2739342	99	2428	12,2413	cyclictest	2823422	-21	kworker/2:0+events	23:58:19	2
2739342	99	2419	12,2403	cyclictest	2830055	-21	kworker/2:1+events	23:52:08	2
2739342	99	2407	12,2392	cyclictest	2785197	-21	kworker/2:0+events	22:01:27	2
2739336	99	2406	12,2391	cyclictest	2821949	-21	kworker/0:2+events	23:23:53	0
2739336	99	2406	11,2392	cyclictest	2825178	-21	kworker/0:2+events	23:34:52	0
2739338	99	2403	12,2387	cyclictest	2812044	-21	kworker/1:1+events	23:00:23	1
2739336	99	2401	12,2385	cyclictest	2807196	-21	kworker/0:0+events	22:59:17	0
2739336	99	2392	12,2377	cyclictest	2774854	-21	kworker/0:2+events	21:03:50	0
2739338	99	2380	11,2366	cyclictest	2791184	-21	kworker/1:1+events	21:49:38	1
2739336	99	2373	8,2362	cyclictest	2817031	-21	kworker/0:0+events	23:10:37	0
2739336	99	2372	12,2357	cyclictest	2792758	-21	kworker/0:1+events	22:22:47	0
2739342	99	2342	12,2326	cyclictest	2807286	-21	kworker/2:0+events	22:40:17	2
2739338	99	2313	11,2300	cyclictest	2815636	-21	kworker/1:0+events	23:05:15	1
2739342	99	2311	12,2296	cyclictest	2776895	-21	kworker/2:0+events	21:05:01	2
2739336	99	2280	7,2270	cyclictest	2845852	-21	kworker/0:0+events	00:38:16	0
2739336	99	2269	10,2257	cyclictest	2749730	-21	kworker/0:2+events	19:45:22	0
2739338	99	2238	10,2225	cyclictest	2797500	-21	kworker/1:2+events	22:12:50	1
2739338	99	2236	11,2222	cyclictest	2808581	-21	kworker/1:0+events	22:41:25	1
2739336	99	2230	10,2216	cyclictest	2783225	-21	kworker/0:1+events	21:29:20	0
2739342	99	2228	11,2214	cyclictest	2832808	-21	kworker/2:2+events	00:09:51	2
2739338	99	2228	11,2214	cyclictest	2823454	-21	kworker/1:0+events	23:37:58	1
2739342	99	2227	11,2213	cyclictest	2789641	-21	kworker/2:2+events	21:43:55	2
2739336	99	2227	11,2213	cyclictest	2826789	-21	kworker/0:0+events	23:50:14	0
2739338	99	2226	11,2212	cyclictest	2832989	-21	kworker/1:2+events	00:00:35	1
2739336	99	2226	11,2212	cyclictest	2755456	-21	kworker/0:0+events	20:18:04	0
2739342	99	2225	8,2214	cyclictest	2804035	-21	kworker/2:0+events	22:29:18	2
2739336	99	2225	11,2211	cyclictest	2783225	-21	kworker/0:1+events	21:32:02	0
2739342	99	2224	11,2210	cyclictest	2820169	-21	kworker/2:2+events	23:21:14	2
2739342	99	2224	10,2211	cyclictest	2755633	-21	kworker/2:0+events	20:05:49	2
2739342	99	2223	11,2209	cyclictest	2794423	-21	kworker/2:1+events	22:06:03	2
2739338	99	2223	11,2209	cyclictest	2821861	-21	kworker/1:1+events	23:27:14	1
2739336	99	2223	10,2209	cyclictest	2834500	-21	kworker/0:0+events	00:04:27	0
2739342	99	2222	11,2208	cyclictest	2823422	-21	kworker/2:0+events	23:39:08	2
2739336	99	2222	11,2207	cyclictest	2789942	-21	kworker/0:2+events	21:49:15	0
2739338	99	2221	10,2208	cyclictest	2791184	-21	kworker/1:1+events	21:53:05	1
2739336	99	2220	9,2208	cyclictest	2801001	-21	kworker/0:0+events	22:29:38	0
2739336	99	2220	10,2208	cyclictest	2746148	-21	kworker/0:2+events	19:30:50	0
2739342	99	2219	9,2207	cyclictest	2812072	-21	kworker/2:1+events	22:52:27	2
2739342	99	2219	11,2205	cyclictest	2765556	-21	kworker/2:1+events	20:42:32	2
2739342	99	2219	11,2204	cyclictest	2771722	-21	kworker/2:0+events	20:47:09	2
2739338	99	2219	10,2205	cyclictest	2788943	-21	kworker/1:0+events	21:42:23	1
2739336	99	2219	11,2204	cyclictest	2744549	-21	kworker/0:1+events	19:44:12	0
2739336	99	2219	10,2205	cyclictest	2762622	-21	kworker/0:1+events	20:23:02	0
2739338	99	2218	11,2203	cyclictest	2773854	-21	kworker/1:0+events	21:14:12	1
2739338	99	2217	11,2203	cyclictest	2773854	-21	kworker/1:0+events	21:33:31	1
2739338	99	2217	11,2202	cyclictest	2791184	-21	kworker/1:1+events	22:19:39	1
2739336	99	2217	8,2206	cyclictest	2826789	-21	kworker/0:0+events	23:43:20	0
2739338	99	2216	11,2201	cyclictest	2791184	-21	kworker/1:1+events	22:05:39	1
2739338	99	2216	10,2202	cyclictest	2794634	-21	kworker/1:0+events	22:00:00	1
2739338	99	2215	10,2202	cyclictest	2768610	-21	kworker/1:1+events	20:39:28	1
2739338	99	2213	11,2198	cyclictest	2834713	-21	kworker/1:1+events	00:09:04	1
2739336	99	2213	6,2204	cyclictest	2771994	-21	kworker/0:0+events	20:55:31	0
2739336	99	2213	10,2199	cyclictest	2735614	-21	kworker/0:0+events	19:17:55	0
2739338	99	2212	11,2197	cyclictest	2834713	-21	kworker/1:1+events	00:12:05	1
2739336	99	2212	10,2200	cyclictest	2799395	-21	kworker/0:2+events	22:15:52	0
2739336	99	2212	10,2198	cyclictest	2788285	-21	kworker/0:1+events	21:44:17	0
2739342	99	2211	10,2198	cyclictest	2783333	-21	kworker/2:1+events	21:33:08	2
2739338	99	2211	10,2198	cyclictest	2775787	-21	kworker/1:2+events	21:04:13	1
2739336	99	2211	8,2200	cyclictest	2832080	-21	kworker/0:2+events	00:22:19	0
2739336	99	2211	11,2197	cyclictest	2753824	-21	kworker/0:1+events	19:55:55	0
2739336	99	2210	9,2198	cyclictest	2836105	-21	kworker/0:1+events	00:11:00	0
2739342	99	2207	11,2192	cyclictest	2821802	-21	kworker/2:1+events	23:25:23	2
2739342	99	2206	11,2192	cyclictest	2837676	-21	kworker/2:1+events	00:12:28	2
2739342	99	2205	10,2191	cyclictest	2749335	-21	kworker/2:2+events	19:44:58	2
2739336	99	2205	9,2193	cyclictest	2753824	-21	kworker/0:1+events	19:54:48	0
2739342	99	2203	10,2190	cyclictest	2844251	-21	kworker/2:0+events	00:39:24	2
2739336	99	2203	11,2189	cyclictest	2821949	-21	kworker/0:2+events	23:25:45	0
2739342	99	2200	10,2186	cyclictest	2810150	-21	kworker/2:2+events	22:46:46	2
2739342	99	2200	10,2186	cyclictest	2781711	-21	kworker/2:0+events	21:20:40	2
2739336	99	2195	10,2182	cyclictest	2803900	-21	kworker/0:2+events	22:41:49	0
2739338	99	2193	10,2180	cyclictest	2773854	-21	kworker/1:0+events	21:25:33	1
2739336	99	2192	9,2180	cyclictest	2814297	-21	kworker/0:1+events	23:02:58	0
2739342	99	2190	11,2177	cyclictest	2802447	-21	kworker/2:2+events	22:30:02	2
2739338	99	2189	11,2175	cyclictest	2800754	-21	kworker/1:0+events	22:33:26	1
2739338	99	2187	10,2174	cyclictest	2818929	-21	kworker/1:2+events	23:19:19	1
2739336	99	2187	11,2172	cyclictest	2796013	-21	kworker/0:2+events	22:05:16	0
2739342	99	2186	9,2174	cyclictest	2753975	-21	kworker/2:2+events	19:54:24	2
2739338	99	2185	9,2172	cyclictest	2818929	-21	kworker/1:2+events	23:22:44	1
2739338	99	2181	10,2168	cyclictest	2759137	-21	kworker/1:2+events	20:16:55	1
2739336	99	2181	9,2169	cyclictest	2789942	-21	kworker/0:2+events	21:50:48	0
2739338	99	2178	11,2165	cyclictest	2839606	-21	kworker/1:0+events	00:26:30	1
2739336	99	2173	10,2160	cyclictest	2844192	-21	kworker/0:2+events	00:34:28	0
2739342	99	2169	8,2158	cyclictest	2744398	-21	kworker/2:1+events	19:28:32	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00