OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Dec 08, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3216588	99	3034	15,3015	cyclictest	3301880	-21	kworker/1:1+events	23:35:01	1
3216593	99	2991	13,2974	cyclictest	3218630	-21	kworker/3:2+events	19:24:30	3
3216593	99	2853	13,2837	cyclictest	3229801	-21	kworker/3:1+events	20:15:14	3
3216591	99	2826	13,2809	cyclictest	3228139	-21	kworker/2:2+events	20:05:18	2
3216591	99	2800	13,2782	cyclictest	3287584	-21	kworker/2:0+events	22:50:00	2
3216584	99	2760	10,2746	cyclictest	3258251	-21	kworker/0:2+events	21:25:17	0
3216588	99	2705	12,2688	cyclictest	3301880	-21	kworker/1:1+events	00:30:11	1
3216593	99	2668	13,2650	cyclictest	3300263	-21	kworker/3:2+events	00:15:18	3
3216593	99	2639	13,2622	cyclictest	3289550	-21	kworker/3:0+events	23:05:19	3
3216591	99	2600	12,2583	cyclictest	3241057	-21	kworker/2:2+events	20:45:15	2
3216591	99	2600	12,2583	cyclictest	3241057	-21	kworker/2:2+events	20:45:14	2
3216584	99	2571	12,2556	cyclictest	3312977	-21	kworker/0:1+events	00:10:44	0
3216591	99	2542	12,2526	cyclictest	3266566	-21	kworker/2:2+events	21:50:17	2
3216593	99	2540	10,2525	cyclictest	3312851	-21	kworker/3:1+events	00:10:19	3
3216591	99	2530	11,2517	cyclictest	3244020	-21	kworker/2:1+events	20:55:34	2
3216584	99	2512	12,2497	cyclictest	3283951	-21	kworker/0:1+events	22:39:22	0
3216591	99	2492	13,2476	cyclictest	3306633	-21	kworker/2:2+events	23:58:23	2
3216591	99	2487	12,2472	cyclictest	3221592	-21	kworker/2:2+events	19:28:43	2
3216591	99	2482	11,2467	cyclictest	3244020	-21	kworker/2:1+events	20:50:58	2
3216591	99	2481	11,2467	cyclictest	3228139	-21	kworker/2:2+events	19:55:01	2
3216584	99	2479	12,2464	cyclictest	3261593	-21	kworker/0:1+events	21:34:22	0
3216591	99	2478	12,2463	cyclictest	3303213	-21	kworker/2:0+events	23:49:14	2
3216584	99	2475	12,2460	cyclictest	3235695	-21	kworker/0:0+events	20:17:53	0
3216591	99	2460	12,2444	cyclictest	3309921	-21	kworker/2:1+events	00:04:34	2
3216591	99	2457	11,2443	cyclictest	3321165	-21	kworker/2:0+events	00:38:34	2
3216588	99	2454	12,2437	cyclictest	3301880	-21	kworker/1:1+events	23:55:20	1
3216591	99	2453	11,2439	cyclictest	3272883	-21	kworker/2:2+events	22:01:34	2
3216591	99	2449	12,2434	cyclictest	3319535	-21	kworker/2:1+events	00:29:50	2
3216591	99	2447	12,2432	cyclictest	3263075	-21	kworker/2:1+events	21:42:43	2
3216591	99	2444	10,2430	cyclictest	3276061	-21	kworker/2:1+events	22:16:06	2
3216591	99	2421	12,2405	cyclictest	3298586	-21	kworker/2:2+events	23:40:16	2
3216588	99	2421	12,2405	cyclictest	3263107	-21	kworker/1:2+events	21:41:13	1
3216591	99	2401	11,2385	cyclictest	3292452	-21	kworker/2:2+events	23:10:16	2
3216588	99	2396	11,2381	cyclictest	3263107	-21	kworker/1:2+events	21:56:16	1
3216588	99	2388	12,2373	cyclictest	3294027	-21	kworker/1:0+events	23:15:15	1
3216591	99	2387	10,2374	cyclictest	3300341	-21	kworker/2:1+events	23:34:36	2
3216584	99	2387	12,2372	cyclictest	3240908	-21	kworker/0:1+events	20:38:44	0
3216584	99	2380	12,2365	cyclictest	3300131	-21	kworker/0:1+events	23:30:26	0
3216588	99	2350	12,2334	cyclictest	3301880	-21	kworker/1:1+events	00:24:29	1
3216584	99	2347	9,2334	cyclictest	3245681	-21	kworker/0:2+events	20:42:11	0
3216588	99	2340	12,2324	cyclictest	3280950	-21	kworker/1:2+events	23:07:14	1
3216588	99	2337	12,2322	cyclictest	3247367	-21	kworker/1:1+events	21:07:47	1
3216593	99	2325	11,2311	cyclictest	3245439	-21	kworker/3:0+events	20:56:42	3
3216593	99	2319	11,2305	cyclictest	3285601	-21	kworker/3:2+events	22:50:23	3
3216584	99	2318	12,2302	cyclictest	3312977	-21	kworker/0:1+events	00:20:16	0
3216593	99	2312	11,2298	cyclictest	3293785	-21	kworker/3:1+events	23:12:08	3
3216593	99	2311	11,2296	cyclictest	3237387	-21	kworker/3:2+events	20:30:20	3
3216593	99	2308	12,2293	cyclictest	3289550	-21	kworker/3:0+events	23:01:29	3
3216593	99	2307	12,2292	cyclictest	3300263	-21	kworker/3:2+events	00:02:40	3
3216588	99	2282	12,2266	cyclictest	3285572	-21	kworker/1:0+events	22:42:41	1
3216584	99	2272	10,2259	cyclictest	3240908	-21	kworker/0:1+events	20:33:47	0
3216584	99	2269	8,2258	cyclictest	3240908	-21	kworker/0:1+events	20:53:16	0
3216588	99	2268	7,2257	cyclictest	3309624	-21	kworker/1:0+events	00:00:21	1
3216584	99	2268	11,2254	cyclictest	3279494	-21	kworker/0:2+events	22:32:04	0
3216593	99	2267	11,2252	cyclictest	3253497	-21	kworker/3:1+events	21:07:24	3
3216591	99	2267	10,2253	cyclictest	3244020	-21	kworker/2:1+events	20:39:06	2
3216584	99	2266	10,2253	cyclictest	3249008	-21	kworker/0:0+events	21:08:58	0
3216591	99	2263	10,2250	cyclictest	3294295	-21	kworker/2:0+events	23:25:52	2
3216584	99	2263	11,2249	cyclictest	3274787	-21	kworker/0:0+events	22:26:20	0
3216584	99	2263	11,2249	cyclictest	3231224	-21	kworker/0:0+events	19:58:48	0
3216593	99	2262	10,2249	cyclictest	3234182	-21	kworker/3:0+events	20:09:57	3
3216584	99	2255	11,2240	cyclictest	3239024	-21	kworker/0:2+events	20:27:22	0
3216584	99	2254	11,2240	cyclictest	3297267	-21	kworker/0:0+events	23:21:19	0
3216593	99	2253	10,2240	cyclictest	3269466	-21	kworker/3:0+events	21:54:00	3
3216584	99	2253	9,2241	cyclictest	3274787	-21	kworker/0:0+events	22:13:02	0
3216584	99	2253	11,2239	cyclictest	3283951	-21	kworker/0:1+events	22:46:32	0
3216584	99	2252	8,2241	cyclictest	3274787	-21	kworker/0:0+events	22:17:58	0
3216584	99	2250	11,2236	cyclictest	3240908	-21	kworker/0:1+events	20:57:06	0
3216584	99	2250	10,2237	cyclictest	3239024	-21	kworker/0:2+events	20:23:14	0
3216584	99	2243	10,2229	cyclictest	3266299	-21	kworker/0:1+events	21:43:30	0
3216584	99	2242	11,2228	cyclictest	3309535	-21	kworker/0:0+events	23:56:53	0
3216584	99	2238	10,2225	cyclictest	3273151	-21	kworker/0:2+events	22:10:01	0
3216584	99	2232	10,2220	cyclictest	3232827	-21	kworker/0:2+events	20:05:42	0
3216584	99	2231	11,2217	cyclictest	3249008	-21	kworker/0:0+events	21:16:14	0
3216591	99	2230	11,2217	cyclictest	3252922	-21	kworker/2:0+events	21:10:08	2
3216591	99	2225	9,2212	cyclictest	3290825	-21	kworker/2:0+events	23:03:23	2
3216591	99	2224	11,2210	cyclictest	3264943	-21	kworker/2:0+events	21:48:26	2
3216588	99	2219	12,2204	cyclictest	3289101	-21	kworker/1:0+events	22:56:32	1
3216591	99	2216	7,2205	cyclictest	3312821	-21	kworker/2:0+events	00:23:21	2
3216584	99	2215	10,2202	cyclictest	3303313	-21	kworker/0:2+events	23:50:45	0
3216588	99	2213	11,2199	cyclictest	3289101	-21	kworker/1:0+events	22:53:30	1
3216591	99	2202	11,2187	cyclictest	3298586	-21	kworker/2:2+events	23:24:00	2
3216591	99	2201	8,2190	cyclictest	3250643	-21	kworker/2:2+events	21:00:27	2
3216593	99	2190	9,2178	cyclictest	3304865	-21	kworker/3:1+events	23:44:48	3
3216593	99	2190	11,2176	cyclictest	3258313	-21	kworker/3:0+events	21:29:01	3
3216588	99	2190	7,2180	cyclictest	3242448	-21	kworker/1:0+events	20:49:51	1
3216588	99	2190	7,2180	cyclictest	3242448	-21	kworker/1:0+events	20:49:50	1
3216584	99	2187	10,2174	cyclictest	3240908	-21	kworker/0:1+events	20:47:29	0
3216584	99	2187	10,2174	cyclictest	3240908	-21	kworker/0:1+events	20:47:29	0
3216588	99	2185	10,2172	cyclictest	3301880	-21	kworker/1:1+events	23:53:49	1
3216584	99	2184	3,2177	cyclictest	3266299	-21	kworker/0:1+events	21:46:09	0
3216591	99	2182	10,2169	cyclictest	3317929	-21	kworker/2:2+events	00:32:49	2
3216588	99	2179	11,2164	cyclictest	3301880	-21	kworker/1:1+events	00:05:19	1
3216584	99	2177	10,2165	cyclictest	3303313	-21	kworker/0:2+events	23:45:08	0
3216588	99	2176	11,2162	cyclictest	3263107	-21	kworker/1:2+events	21:37:26	1
3216591	99	2175	7,2165	cyclictest	3244020	-21	kworker/2:1+events	20:41:46	2
3216584	99	2169	10,2156	cyclictest	3290555	-21	kworker/0:2+events	23:08:46	0
3216588	99	2165	10,2152	cyclictest	3259902	-21	kworker/1:0+events	21:33:59	1
3216584	99	2164	11,2150	cyclictest	3267896	-21	kworker/0:2+events	21:52:54	0
3216584	99	2157	8,2146	cyclictest	3256653	-21	kworker/0:1+events	21:13:12	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00