OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Wed Nov 19, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2628796	99	3088	12,3073	cyclictest	2676864	-21	kworker/2:0+events	21:45:21	2
2628800	99	3066	15,3046	cyclictest	2718245	-21	kworker/3:1+events	00:15:00	3
2628796	99	2791	13,2775	cyclictest	2657614	-21	kworker/2:1+events	20:40:23	2
2628792	99	2709	9,2695	cyclictest	2694158	-21	kworker/1:1+events	22:55:13	1
2628800	99	2613	13,2597	cyclictest	2695846	-21	kworker/3:1+events	22:50:16	3
2628800	99	2523	12,2508	cyclictest	2675117	-21	kworker/3:2+events	21:36:57	3
2628796	99	2486	12,2470	cyclictest	2684912	-21	kworker/2:1+events	22:26:26	2
2628796	99	2486	11,2472	cyclictest	2696072	-21	kworker/2:0+events	22:46:06	2
2628796	99	2482	12,2468	cyclictest	2710457	-21	kworker/2:2+events	23:25:05	2
2628800	99	2458	12,2443	cyclictest	2667183	-21	kworker/3:2+events	21:18:47	3
2628796	99	2456	12,2440	cyclictest	2655980	-21	kworker/2:2+events	20:38:04	2
2628796	99	2455	12,2439	cyclictest	2678484	-21	kworker/2:2+events	21:54:47	2
2628796	99	2452	11,2437	cyclictest	2691049	-21	kworker/2:2+events	22:44:33	2
2628796	99	2443	11,2430	cyclictest	2648210	-21	kworker/2:1+events	20:20:04	2
2628800	99	2434	12,2417	cyclictest	2692621	-21	kworker/3:1+events	22:30:15	3
2628796	99	2430	12,2415	cyclictest	2714518	-21	kworker/2:0+events	23:39:20	2
2628796	99	2415	12,2400	cyclictest	2721424	-21	kworker/2:0+events	00:05:21	2
2628796	99	2405	12,2389	cyclictest	2716577	-21	kworker/2:1+events	00:10:22	2
2628800	99	2382	9,2370	cyclictest	2688578	-21	kworker/3:0+events	22:25:15	3
2628796	99	2379	10,2366	cyclictest	2669042	-21	kworker/2:2+events	21:16:54	2
2628792	99	2362	12,2346	cyclictest	2630021	-21	kworker/1:0+events	19:31:42	1
2628792	99	2361	11,2348	cyclictest	2712063	-21	kworker/1:2+events	23:33:35	1
2628792	99	2340	12,2324	cyclictest	2708683	-21	kworker/1:1+events	23:18:39	1
2628800	99	2330	11,2315	cyclictest	2705588	-21	kworker/3:2+events	23:28:13	3
2628790	99	2328	12,2313	cyclictest	2723011	-21	kworker/0:2+events	00:06:07	0
2628796	99	2326	12,2311	cyclictest	2696072	-21	kworker/2:0+events	23:03:29	2
2628796	99	2326	11,2312	cyclictest	2635635	-21	kworker/2:2+events	19:31:18	2
2628792	99	2318	12,2302	cyclictest	2734272	-21	kworker/1:0+events	00:37:58	1
2628792	99	2317	12,2301	cyclictest	2630021	-21	kworker/1:0+events	19:15:21	1
2628796	99	2295	11,2281	cyclictest	2633749	-21	kworker/2:0+events	19:25:17	2
2628800	99	2276	11,2262	cyclictest	2670761	-21	kworker/3:0+events	21:28:17	3
2628800	99	2275	10,2261	cyclictest	2675117	-21	kworker/3:2+events	21:49:53	3
2628800	99	2274	11,2259	cyclictest	2628519	-21	kworker/3:1+events	19:33:14	3
2628800	99	2274	10,2261	cyclictest	2638499	-21	kworker/3:0+events	19:45:33	3
2628800	99	2273	10,2259	cyclictest	2681656	-21	kworker/3:1+events	22:18:04	3
2628800	99	2272	11,2258	cyclictest	2721455	-21	kworker/3:0+events	00:02:00	3
2628800	99	2272	11,2257	cyclictest	2695846	-21	kworker/3:1+events	22:47:35	3
2628800	99	2272	10,2259	cyclictest	2659300	-21	kworker/3:1+events	20:54:04	3
2628800	99	2271	10,2258	cyclictest	2660931	-21	kworker/3:0+events	21:11:34	3
2628796	99	2270	11,2256	cyclictest	2732944	-21	kworker/2:1+events	00:37:37	2
2628800	99	2269	9,2256	cyclictest	2710396	-21	kworker/3:1+events	23:33:58	3
2628800	99	2269	11,2255	cyclictest	2649513	-21	kworker/3:2+events	20:11:45	3
2628800	99	2267	10,2253	cyclictest	2688578	-21	kworker/3:0+events	22:21:52	3
2628800	99	2266	9,2254	cyclictest	2694247	-21	kworker/3:0+events	22:38:07	3
2628790	99	2266	11,2252	cyclictest	2652843	-21	kworker/0:0+events	20:24:40	0
2628800	99	2265	7,2254	cyclictest	2699427	-21	kworker/3:0+events	22:57:06	3
2628800	99	2265	10,2252	cyclictest	2628519	-21	kworker/3:1+events	19:44:00	3
2628790	99	2265	10,2252	cyclictest	2662472	-21	kworker/0:0+events	21:19:58	0
2628800	99	2264	9,2252	cyclictest	2675117	-21	kworker/3:2+events	21:41:08	3
2628796	99	2262	9,2249	cyclictest	2716577	-21	kworker/2:1+events	23:58:10	2
2628796	99	2262	10,2248	cyclictest	2665582	-21	kworker/2:1+events	21:41:53	2
2628796	99	2260	10,2246	cyclictest	2654345	-21	kworker/2:0+events	20:30:26	2
2628796	99	2258	6,2249	cyclictest	2643057	-21	kworker/2:2+events	20:04:03	2
2628796	99	2258	11,2244	cyclictest	2694421	-21	kworker/2:1+events	22:36:10	2
2628796	99	2257	8,2246	cyclictest	2710457	-21	kworker/2:2+events	23:33:11	2
2628800	99	2256	11,2242	cyclictest	2656008	-21	kworker/3:0+events	20:43:27	3
2628800	99	2255	11,2240	cyclictest	2675117	-21	kworker/3:2+events	21:52:08	3
2628800	99	2254	11,2240	cyclictest	2732671	-21	kworker/3:0+events	00:33:03	3
2628800	99	2253	11,2239	cyclictest	2656008	-21	kworker/3:0+events	20:38:48	3
2628796	99	2253	5,2245	cyclictest	2665582	-21	kworker/2:1+events	21:31:42	2
2628796	99	2253	10,2240	cyclictest	2684912	-21	kworker/2:1+events	22:08:05	2
2628800	99	2249	11,2236	cyclictest	2654377	-21	kworker/3:1+events	20:32:40	3
2628790	99	2244	12,2229	cyclictest	2689635	-21	kworker/0:1+events	22:20:45	0
2628796	99	2242	8,2230	cyclictest	2659628	-21	kworker/2:0+events	21:03:38	2
2628800	99	2241	11,2227	cyclictest	2660931	-21	kworker/3:0+events	21:08:55	3
2628796	99	2236	11,2221	cyclictest	2716577	-21	kworker/2:1+events	23:45:56	2
2628796	99	2234	7,2223	cyclictest	2716577	-21	kworker/2:1+events	00:20:47	2
2628796	99	2234	7,2223	cyclictest	2716577	-21	kworker/2:1+events	00:20:47	2
2628796	99	2230	7,2219	cyclictest	2643057	-21	kworker/2:2+events	20:11:23	2
2628796	99	2228	11,2214	cyclictest	2680088	-21	kworker/2:1+events	21:58:37	2
2628796	99	2228	11,2213	cyclictest	2663956	-21	kworker/2:2+events	20:59:03	2
2628800	99	2227	11,2213	cyclictest	2662771	-21	kworker/3:2+events	20:59:50	3
2628796	99	2227	11,2213	cyclictest	2641434	-21	kworker/2:0+events	19:49:18	2
2628796	99	2227	10,2214	cyclictest	2689422	-21	kworker/2:0+events	22:18:26	2
2628796	99	2226	9,2214	cyclictest	2655980	-21	kworker/2:2+events	20:49:28	2
2628796	99	2226	9,2214	cyclictest	2655980	-21	kworker/2:2+events	20:49:28	2
2628796	99	2226	8,2215	cyclictest	2692650	-21	kworker/2:0+events	22:31:22	2
2628796	99	2226	11,2212	cyclictest	2703798	-21	kworker/2:1+events	23:13:00	2
2628796	99	2226	11,2211	cyclictest	2632127	-21	kworker/2:1+events	19:22:14	2
2628796	99	2226	10,2213	cyclictest	2714518	-21	kworker/2:0+events	23:44:01	2
2628796	99	2225	10,2212	cyclictest	2659628	-21	kworker/2:0+events	21:08:31	2
2628796	99	2225	10,2211	cyclictest	2700432	-21	kworker/2:1+events	22:55:59	2
2628796	99	2224	11,2210	cyclictest	2726544	-21	kworker/2:2+events	00:15:46	2
2628796	99	2222	11,2208	cyclictest	2643057	-21	kworker/2:2+events	19:58:19	2
2628800	99	2221	10,2208	cyclictest	2731063	-21	kworker/3:2+events	00:37:15	3
2628796	99	2221	10,2207	cyclictest	2611025	-21	kworker/2:0+events	19:18:24	2
2628796	99	2213	11,2198	cyclictest	2691049	-21	kworker/2:2+events	22:23:01	2
2628792	99	2210	9,2198	cyclictest	2686423	-21	kworker/1:2+events	22:16:31	1
2628792	99	2194	11,2180	cyclictest	2646399	-21	kworker/1:2+events	20:22:00	1
2628800	99	2187	8,2176	cyclictest	2695846	-21	kworker/3:1+events	22:44:11	3
2628800	99	2185	8,2174	cyclictest	2683262	-21	kworker/3:2+events	22:12:18	3
2628796	99	2179	10,2166	cyclictest	2643057	-21	kworker/2:2+events	20:07:32	2
2628790	99	2174	11,2160	cyclictest	2633660	-21	kworker/0:1+events	19:27:07	0
2628796	99	2172	11,2158	cyclictest	2643057	-21	kworker/2:2+events	19:53:02	2
2628800	99	2168	10,2155	cyclictest	2675117	-21	kworker/3:2+events	21:32:28	3
2628800	99	2166	6,2158	cyclictest	2701970	-21	kworker/3:2+events	23:00:06	3
2628790	99	2164	10,2151	cyclictest	2665668	-21	kworker/0:2+events	21:09:18	0
2628792	99	2161	11,2147	cyclictest	2657844	-21	kworker/1:2+events	20:41:30	1
2628796	99	2157	10,2144	cyclictest	2654345	-21	kworker/2:0+events	20:28:55	2
2628792	99	2155	10,2142	cyclictest	2684823	-21	kworker/1:0+events	22:11:10	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00