OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Tue Dec 09, 2025 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3690849	99	2951	15,2931	cyclictest	3754342	-21	kworker/2:0+events	22:35:16	2
3690852	99	2810	11,2793	cyclictest	3756064	-21	kworker/3:1+events	22:45:12	3
3690842	99	2805	13,2788	cyclictest	3702192	-21	kworker/0:2+events	20:05:19	0
3690852	99	2794	11,2779	cyclictest	3746859	-21	kworker/3:1+events	22:10:18	3
3690847	99	2749	13,2731	cyclictest	3735780	-21	kworker/1:1+events	21:55:20	1
3690849	99	2700	12,2684	cyclictest	3703585	-21	kworker/2:2+events	20:00:20	2
3690849	99	2654	13,2638	cyclictest	3733844	-21	kworker/2:1+events	21:30:17	2
3690849	99	2548	11,2534	cyclictest	3733844	-21	kworker/2:1+events	21:25:00	2
3690849	99	2544	12,2530	cyclictest	3728053	-21	kworker/2:0+events	21:10:06	2
3690849	99	2544	12,2530	cyclictest	3728053	-21	kworker/2:0+events	21:10:05	2
3690852	99	2530	11,2515	cyclictest	3685457	-21	kworker/3:0+events	19:20:21	3
3690852	99	2529	12,2513	cyclictest	3694576	-21	kworker/3:1+events	19:25:17	3
3690842	99	2472	11,2456	cyclictest	3737133	-21	kworker/0:2+events	21:35:35	0
3690842	99	2461	12,2446	cyclictest	3738739	-21	kworker/0:1+events	21:41:43	0
3690842	99	2460	12,2445	cyclictest	3722432	-21	kworker/0:2+events	20:46:23	0
3690849	99	2451	12,2436	cyclictest	3788954	-21	kworker/2:2+events	00:20:21	2
3690849	99	2451	12,2435	cyclictest	3748335	-21	kworker/2:2+events	22:15:14	2
3690842	99	2447	12,2432	cyclictest	3702192	-21	kworker/0:2+events	19:52:20	0
3690842	99	2445	11,2431	cyclictest	3702192	-21	kworker/0:2+events	19:56:08	0
3690849	99	2443	10,2429	cyclictest	3741899	-21	kworker/2:0+events	22:12:14	2
3690852	99	2442	12,2426	cyclictest	3727358	-21	kworker/3:1+events	21:06:16	3
3690852	99	2441	11,2427	cyclictest	3710014	-21	kworker/3:1+events	20:19:51	3
3690849	99	2440	11,2426	cyclictest	3719481	-21	kworker/2:2+events	20:39:13	2
3690852	99	2439	12,2423	cyclictest	3685457	-21	kworker/3:0+events	19:18:05	3
3690852	99	2439	11,2424	cyclictest	3790525	-21	kworker/3:2+events	00:35:33	3
3690849	99	2437	12,2421	cyclictest	3695939	-21	kworker/2:1+events	19:38:35	2
3690852	99	2436	12,2420	cyclictest	3746859	-21	kworker/3:1+events	22:26:11	3
3690852	99	2434	9,2421	cyclictest	3729279	-21	kworker/3:0+events	21:13:11	3
3690852	99	2434	9,2421	cyclictest	3729279	-21	kworker/3:0+events	21:13:11	3
3690849	99	2428	11,2414	cyclictest	3757541	-21	kworker/2:2+events	22:40:15	2
3690852	99	2410	12,2394	cyclictest	3730884	-21	kworker/3:2+events	21:17:47	3
3690852	99	2410	10,2397	cyclictest	3746859	-21	kworker/3:1+events	22:16:46	3
3690849	99	2410	12,2395	cyclictest	3788954	-21	kworker/2:2+events	00:25:15	2
3690849	99	2407	11,2393	cyclictest	3695939	-21	kworker/2:1+events	19:40:30	2
3690842	99	2399	12,2381	cyclictest	3793641	-21	kworker/0:1+events	00:31:00	0
3690842	99	2387	10,2373	cyclictest	3732190	-21	kworker/0:0+events	21:17:01	0
3690842	99	2372	10,2359	cyclictest	3788661	-21	kworker/0:2+events	00:14:00	0
3690849	99	2365	10,2352	cyclictest	3738586	-21	kworker/2:0+events	21:39:25	2
3690849	99	2359	10,2345	cyclictest	3741899	-21	kworker/2:0+events	21:52:38	2
3690852	99	2348	12,2334	cyclictest	3775748	-21	kworker/3:1+events	23:45:24	3
3690852	99	2341	12,2326	cyclictest	3720951	-21	kworker/3:2+events	20:50:59	3
3690849	99	2328	11,2314	cyclictest	3714526	-21	kworker/2:2+events	20:30:52	2
3690842	99	2327	12,2312	cyclictest	3749760	-21	kworker/0:0+events	22:36:01	0
3690842	99	2321	11,2307	cyclictest	3749760	-21	kworker/0:0+events	22:13:46	0
3690852	99	2319	9,2306	cyclictest	3735381	-21	kworker/3:0+events	21:26:53	3
3690847	99	2307	12,2293	cyclictest	3700294	-21	kworker/1:0+events	19:40:06	1
3690849	99	2289	7,2278	cyclictest	3728053	-21	kworker/2:0+events	21:05:53	2
3690849	99	2286	11,2272	cyclictest	3757541	-21	kworker/2:2+events	22:48:38	2
3690852	99	2277	5,2269	cyclictest	3714913	-21	kworker/3:0+events	20:37:42	3
3690842	99	2270	11,2256	cyclictest	3697302	-21	kworker/0:2+events	19:32:09	0
3690849	99	2265	10,2253	cyclictest	3787357	-21	kworker/2:1+events	00:15:05	2
3690849	99	2260	12,2245	cyclictest	3745135	-21	kworker/2:1+events	22:09:09	2
3690849	99	2258	11,2244	cyclictest	3763822	-21	kworker/2:2+events	22:58:55	2
3690852	99	2257	11,2243	cyclictest	3741930	-21	kworker/3:0+events	21:51:07	3
3690849	99	2257	10,2244	cyclictest	3719481	-21	kworker/2:2+events	20:52:55	2
3690849	99	2254	5,2246	cyclictest	3785721	-21	kworker/2:2+events	00:09:02	2
3690849	99	2254	11,2240	cyclictest	3714526	-21	kworker/2:2+events	20:22:07	2
3690849	99	2254	10,2240	cyclictest	3750174	-21	kworker/2:1+events	22:34:30	2
3690852	99	2250	11,2236	cyclictest	3702221	-21	kworker/3:0+events	19:55:20	3
3690842	99	2250	10,2237	cyclictest	3763940	-21	kworker/0:1+events	23:06:06	0
3690852	99	2249	11,2235	cyclictest	3765533	-21	kworker/3:2+events	23:21:45	3
3690842	99	2249	10,2235	cyclictest	3698991	-21	kworker/0:1+events	19:40:53	0
3690852	99	2248	11,2234	cyclictest	3720951	-21	kworker/3:2+events	20:45:59	3
3690849	99	2247	11,2233	cyclictest	3783778	-21	kworker/2:0+events	00:14:20	2
3690849	99	2245	12,2230	cyclictest	3714526	-21	kworker/2:2+events	20:27:49	2
3690849	99	2245	11,2231	cyclictest	3772582	-21	kworker/2:2+events	23:56:52	2
3690852	99	2239	9,2227	cyclictest	3730884	-21	kworker/3:2+events	21:38:14	3
3690849	99	2239	10,2226	cyclictest	3790818	-21	kworker/2:0+events	00:35:54	2
3690849	99	2238	9,2226	cyclictest	3721130	-21	kworker/2:1+events	20:44:52	2
3690842	99	2238	11,2223	cyclictest	3722432	-21	kworker/0:2+events	20:50:35	0
3690852	99	2236	11,2222	cyclictest	3793610	-21	kworker/3:0+events	00:30:35	3
3690842	99	2236	10,2223	cyclictest	3774383	-21	kworker/0:0+events	23:48:28	0
3690852	99	2234	9,2222	cyclictest	3775748	-21	kworker/3:1+events	23:33:54	3
3690842	99	2234	10,2222	cyclictest	3774383	-21	kworker/0:0+events	23:40:05	0
3690852	99	2233	11,2219	cyclictest	3782210	-21	kworker/3:0+events	00:09:23	3
3690842	99	2233	11,2218	cyclictest	3749760	-21	kworker/0:0+events	22:21:40	0
3690852	99	2232	11,2217	cyclictest	3745168	-21	kworker/3:0+events	22:08:24	3
3690852	99	2232	11,2217	cyclictest	3743557	-21	kworker/3:1+events	21:55:43	3
3690849	99	2232	10,2218	cyclictest	3772582	-21	kworker/2:2+events	23:50:47	2
3690842	99	2232	7,2222	cyclictest	3714820	-21	kworker/0:2+events	20:27:27	0
3690852	99	2231	10,2218	cyclictest	3756064	-21	kworker/3:1+events	22:39:06	3
3690852	99	2230	10,2217	cyclictest	3788924	-21	kworker/3:1+events	00:22:35	3
3690852	99	2230	10,2217	cyclictest	3780611	-21	kworker/3:2+events	23:53:25	3
3690852	99	2230	10,2217	cyclictest	3756064	-21	kworker/3:1+events	23:00:24	3
3690842	99	2230	11,2216	cyclictest	3729206	-21	kworker/0:2+events	21:08:35	0
3690852	99	2229	11,2215	cyclictest	3752804	-21	kworker/3:2+events	22:24:41	3
3690852	99	2229	11,2215	cyclictest	3717305	-21	kworker/3:2+events	20:33:09	3
3690852	99	2229	10,2216	cyclictest	3756064	-21	kworker/3:1+events	22:41:23	3
3690852	99	2229	10,2216	cyclictest	3752804	-21	kworker/3:2+events	22:31:09	3
3690849	99	2229	10,2216	cyclictest	3765504	-21	kworker/2:1+events	23:06:29	2
3690849	99	2229	10,2216	cyclictest	3763822	-21	kworker/2:2+events	23:00:47	2
3690849	99	2229	10,2216	cyclictest	3724334	-21	kworker/2:1+events	20:55:34	2
3690842	99	2229	10,2216	cyclictest	3735471	-21	kworker/0:0+events	21:49:38	0
3690852	99	2228	11,2214	cyclictest	3767129	-21	kworker/3:0+events	23:17:34	3
3690842	99	2228	9,2216	cyclictest	3772523	-21	kworker/0:1+events	23:26:43	0
3690842	99	2228	10,2214	cyclictest	3711532	-21	kworker/0:0+events	20:31:38	0
3690852	99	2227	11,2213	cyclictest	3759513	-21	kworker/3:2+events	22:54:45	3
3690849	99	2227	11,2213	cyclictest	3776064	-21	kworker/2:0+events	23:36:36	2
3690849	99	2227	10,2214	cyclictest	3703585	-21	kworker/2:2+events	19:56:31	2
3690842	99	2227	11,2213	cyclictest	3711532	-21	kworker/0:0+events	20:24:24	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00