OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Feb 19, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
280133	99	3337	16,3316	cyclictest	312852	-21	kworker/3:0+events	21:00:15	3
280121	99	3104	15,3084	cyclictest	289917	-21	kworker/0:1+events	20:00:17	0
280127	99	2738	14,2719	cyclictest	306297	-21	kworker/2:1+events	20:30:14	2
280121	99	2721	13,2703	cyclictest	360202	-21	kworker/0:2+events	23:15:12	0
280133	99	2719	13,2703	cyclictest	304609	-21	kworker/3:1+events	20:35:12	3
280133	99	2717	13,2698	cyclictest	355389	-21	kworker/3:2+events	23:05:11	3
280121	99	2676	13,2661	cyclictest	289917	-21	kworker/0:1+events	19:55:21	0
280121	99	2667	13,2650	cyclictest	346381	-21	kworker/0:0+events	22:35:12	0
280123	99	2636	13,2619	cyclictest	366458	-21	kworker/1:0+events	23:40:14	1
280127	99	2559	12,2543	cyclictest	376016	-21	kworker/2:0+events	00:10:16	2
280121	99	2522	12,2507	cyclictest	333473	-21	kworker/0:0+events	21:55:16	0
280121	99	2505	12,2491	cyclictest	289917	-21	kworker/0:1+events	19:50:00	0
280123	99	2497	11,2482	cyclictest	308188	-21	kworker/1:0+events	20:40:30	1
280123	99	2494	12,2479	cyclictest	366458	-21	kworker/1:0+events	23:49:21	1
280127	99	2493	12,2478	cyclictest	349953	-21	kworker/2:2+events	22:53:23	2
280127	99	2488	11,2474	cyclictest	377647	-21	kworker/2:1+events	00:25:11	2
280123	99	2488	12,2473	cyclictest	374249	-21	kworker/1:0+events	00:08:00	1
280123	99	2488	12,2472	cyclictest	296532	-21	kworker/1:1+events	20:17:50	1
280123	99	2485	12,2469	cyclictest	361768	-21	kworker/1:0+events	23:22:46	1
280127	99	2482	13,2466	cyclictest	317318	-21	kworker/2:0+events	21:07:11	2
280127	99	2482	12,2468	cyclictest	322190	-21	kworker/2:2+events	21:30:41	2
280123	99	2482	12,2467	cyclictest	377675	-21	kworker/1:2+events	00:18:17	1
280123	99	2482	12,2467	cyclictest	377675	-21	kworker/1:2+events	00:18:17	1
280123	99	2478	12,2462	cyclictest	308188	-21	kworker/1:0+events	21:09:50	1
280123	99	2476	12,2461	cyclictest	328590	-21	kworker/1:2+events	21:39:47	1
280133	99	2471	12,2455	cyclictest	382306	-21	kworker/3:1+events	00:26:43	3
280123	99	2471	10,2457	cyclictest	324436	-21	kworker/1:1+events	21:34:29	1
280123	99	2470	11,2456	cyclictest	333176	-21	kworker/1:1+events	22:02:55	1
280127	99	2468	11,2454	cyclictest	288467	-21	kworker/2:1+events	19:45:20	2
280133	99	2466	12,2451	cyclictest	315814	-21	kworker/3:2+events	21:05:15	3
280123	99	2463	10,2450	cyclictest	363589	-21	kworker/1:2+events	23:37:38	1
280127	99	2461	8,2449	cyclictest	358530	-21	kworker/2:0+events	23:10:11	2
280127	99	2456	12,2441	cyclictest	288467	-21	kworker/2:1+events	20:09:29	2
280127	99	2456	10,2442	cyclictest	283818	-21	kworker/2:2+events	19:26:50	2
280123	99	2452	10,2438	cyclictest	341435	-21	kworker/1:0+events	22:21:29	1
280123	99	2446	10,2432	cyclictest	322612	-21	kworker/1:2+events	21:21:59	1
280123	99	2445	12,2431	cyclictest	308188	-21	kworker/1:0+events	20:53:07	1
280133	99	2434	12,2418	cyclictest	304609	-21	kworker/3:1+events	20:48:34	3
280127	99	2431	10,2417	cyclictest	372945	-21	kworker/2:2+events	00:06:05	2
280127	99	2419	12,2404	cyclictest	377647	-21	kworker/2:1+events	00:31:19	2
280123	99	2416	11,2402	cyclictest	298154	-21	kworker/1:0+events	20:05:14	1
280121	99	2402	11,2387	cyclictest	312943	-21	kworker/0:2+events	20:55:26	0
280133	99	2400	8,2389	cyclictest	336371	-21	kworker/3:1+events	22:21:06	3
280133	99	2394	12,2378	cyclictest	353419	-21	kworker/3:1+events	22:55:21	3
280121	99	2393	12,2377	cyclictest	368000	-21	kworker/0:0+events	23:53:58	0
280121	99	2392	12,2377	cyclictest	303011	-21	kworker/0:2+events	20:25:00	0
280133	99	2389	12,2373	cyclictest	359959	-21	kworker/3:1+events	23:14:26	3
280121	99	2389	11,2375	cyclictest	289917	-21	kworker/0:1+events	20:15:54	0
280121	99	2386	12,2371	cyclictest	361830	-21	kworker/0:1+events	23:38:47	0
280121	99	2384	9,2372	cyclictest	289917	-21	kworker/0:1+events	19:37:48	0
280133	99	2382	10,2370	cyclictest	382306	-21	kworker/3:1+events	00:30:10	3
280121	99	2380	11,2365	cyclictest	374670	-21	kworker/0:3+events	00:19:29	0
280121	99	2380	11,2365	cyclictest	374670	-21	kworker/0:3+events	00:19:28	0
280121	99	2374	11,2360	cyclictest	348101	-21	kworker/0:1+events	22:42:19	0
280133	99	2361	12,2346	cyclictest	304609	-21	kworker/3:1+events	20:52:22	3
280121	99	2361	12,2346	cyclictest	355075	-21	kworker/0:2+events	22:59:34	0
280121	99	2360	12,2344	cyclictest	325413	-21	kworker/0:0+events	21:40:31	0
280133	99	2349	10,2336	cyclictest	294897	-21	kworker/3:1+events	19:59:32	3
280123	99	2343	10,2330	cyclictest	369794	-21	kworker/1:2+events	23:58:54	1
280133	99	2341	12,2325	cyclictest	374310	-21	kworker/3:0+events	00:19:04	3
280133	99	2341	12,2325	cyclictest	374310	-21	kworker/3:0+events	00:19:04	3
280123	99	2324	9,2312	cyclictest	339775	-21	kworker/1:1+events	22:14:20	1
280133	99	2323	11,2310	cyclictest	304609	-21	kworker/3:1+events	20:55:02	3
280127	99	2323	12,2308	cyclictest	298092	-21	kworker/2:0+events	20:02:57	2
280133	99	2317	11,2303	cyclictest	368292	-21	kworker/3:1+events	23:41:24	3
280123	99	2317	12,2302	cyclictest	294835	-21	kworker/1:2+events	19:57:18	1
280133	99	2316	9,2304	cyclictest	377736	-21	kworker/3:1+events	00:11:47	3
280123	99	2316	12,2300	cyclictest	341435	-21	kworker/1:0+events	22:18:47	1
280123	99	2316	12,2300	cyclictest	341435	-21	kworker/1:0+events	22:18:47	1
280127	99	2313	11,2298	cyclictest	372945	-21	kworker/2:2+events	23:55:29	2
280127	99	2311	10,2298	cyclictest	290068	-21	kworker/2:0+events	19:50:22	2
280123	99	2300	12,2284	cyclictest	301616	-21	kworker/1:0+events	20:14:21	1
280123	99	2298	11,2284	cyclictest	381179	-21	kworker/1:0+events	00:20:36	1
280121	99	2292	12,2276	cyclictest	382367	-21	kworker/0:1+events	00:24:03	0
280127	99	2283	11,2269	cyclictest	330320	-21	kworker/2:1+events	21:46:57	2
280127	99	2281	11,2266	cyclictest	341523	-21	kworker/2:0+events	22:30:13	2
280123	99	2281	10,2268	cyclictest	372644	-21	kworker/1:1+events	23:52:01	1
280127	99	2276	11,2262	cyclictest	349953	-21	kworker/2:2+events	22:58:24	2
280127	99	2274	9,2262	cyclictest	336493	-21	kworker/2:0+events	22:07:09	2
280127	99	2274	12,2258	cyclictest	288467	-21	kworker/2:1+events	19:41:57	2
280127	99	2268	11,2253	cyclictest	341523	-21	kworker/2:0+events	22:20:44	2
280127	99	2267	9,2255	cyclictest	367883	-21	kworker/2:2+events	23:47:04	2
280127	99	2267	10,2253	cyclictest	372945	-21	kworker/2:2+events	00:03:04	2
280127	99	2266	8,2254	cyclictest	334860	-21	kworker/2:1+events	22:03:42	2
280127	99	2266	11,2253	cyclictest	330320	-21	kworker/2:1+events	21:50:01	2
280127	99	2266	11,2252	cyclictest	346472	-21	kworker/2:1+events	22:36:43	2
280127	99	2265	11,2251	cyclictest	334860	-21	kworker/2:1+events	22:19:11	2
280127	99	2265	11,2251	cyclictest	334860	-21	kworker/2:1+events	22:19:11	2
280127	99	2265	11,2251	cyclictest	315671	-21	kworker/2:1+events	20:59:29	2
280127	99	2264	9,2252	cyclictest	363485	-21	kworker/2:0+events	23:35:45	2
280123	99	2264	11,2250	cyclictest	285112	-21	kworker/1:0+events	19:25:18	1
280127	99	2263	11,2249	cyclictest	288467	-21	kworker/2:1+events	19:56:31	2
280127	99	2263	10,2250	cyclictest	265457	-21	kworker/2:1+events	19:23:25	2
280123	99	2263	11,2249	cyclictest	344984	-21	kworker/1:1+events	22:34:49	1
280127	99	2262	10,2249	cyclictest	334860	-21	kworker/2:1+events	22:13:34	2
280123	99	2262	10,2249	cyclictest	336521	-21	kworker/1:2+events	22:07:54	1
280127	99	2261	9,2249	cyclictest	349953	-21	kworker/2:2+events	23:07:30	2
280127	99	2261	11,2247	cyclictest	369620	-21	kworker/2:1+events	23:43:40	2
280127	99	2261	11,2247	cyclictest	363485	-21	kworker/2:0+events	23:34:14	2
280127	99	2261	10,2248	cyclictest	304639	-21	kworker/2:2+events	20:29:07	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00