OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Tue Jul 15, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3465788	99	3620	18,3596	cyclictest	3524761	-21	kworker/3:0+events	22:20:15	3
3465788	99	3334	15,3313	cyclictest	3568389	-21	kworker/3:2+events	00:35:20	3
3465780	99	3089	6,3078	cyclictest	3522005	-21	kworker/1:2+events	22:10:18	1
3465780	99	2891	13,2875	cyclictest	3553909	-21	kworker/1:2+events	00:05:00	1
3465780	99	2796	13,2779	cyclictest	3560577	-21	kworker/1:1+events	00:15:20	1
3465783	99	2780	13,2761	cyclictest	3526647	-21	kworker/2:2+events	22:30:13	2
3465788	99	2778	11,2764	cyclictest	3533078	-21	kworker/3:1+events	22:47:32	3
3465775	99	2703	14,2687	cyclictest	3526462	-21	kworker/0:2+events	22:45:13	0
3465780	99	2668	10,2653	cyclictest	3531406	-21	kworker/1:2+events	22:40:12	1
3465775	99	2664	13,2648	cyclictest	3504319	-21	kworker/0:0+events	21:20:14	0
3465780	99	2652	13,2636	cyclictest	3512269	-21	kworker/1:0+events	21:50:24	1
3465775	99	2646	13,2629	cyclictest	3555116	-21	kworker/0:2+events	23:50:14	0
3465775	99	2554	12,2539	cyclictest	3526462	-21	kworker/0:2+events	22:52:29	0
3465780	99	2537	13,2519	cyclictest	3564713	-21	kworker/1:0+events	00:20:13	1
3465780	99	2503	0,2499	cyclictest	3505598	-21	kworker/1:2+events	21:23:38	1
3465775	99	2494	12,2479	cyclictest	3547254	-21	kworker/0:2+events	23:24:40	0
3465780	99	2493	12,2478	cyclictest	3560577	-21	kworker/1:1+events	00:10:21	1
3465780	99	2492	12,2476	cyclictest	3481057	-21	kworker/1:2+events	19:56:36	1
3465775	99	2492	12,2476	cyclictest	3504319	-21	kworker/0:0+events	21:11:32	0
3465775	99	2491	12,2475	cyclictest	3529982	-21	kworker/0:1+events	22:30:58	0
3465775	99	2486	10,2472	cyclictest	3488446	-21	kworker/0:2+events	20:20:53	0
3465788	99	2477	9,2464	cyclictest	3520639	-21	kworker/3:2+events	22:05:17	3
3465775	99	2477	10,2463	cyclictest	3511970	-21	kworker/0:2+events	21:33:56	0
3465788	99	2467	7,2458	cyclictest	3563201	-21	kworker/3:0+events	00:30:06	3
3465780	99	2462	12,2446	cyclictest	3531406	-21	kworker/1:2+events	22:51:19	1
3465775	99	2461	11,2446	cyclictest	3491400	-21	kworker/0:1+events	20:44:29	0
3465783	99	2444	10,2430	cyclictest	3520202	-21	kworker/2:0+events	22:04:55	2
3465780	99	2438	12,2423	cyclictest	3478701	-21	kworker/1:0+events	20:01:13	1
3465783	99	2433	12,2417	cyclictest	3520202	-21	kworker/2:0+events	22:16:04	2
3465783	99	2430	10,2416	cyclictest	3496165	-21	kworker/2:0+events	21:18:45	2
3465783	99	2428	12,2412	cyclictest	3534561	-21	kworker/2:0+events	22:49:02	2
3465783	99	2427	12,2411	cyclictest	3473779	-21	kworker/2:0+events	19:32:58	2
3465783	99	2422	12,2407	cyclictest	3473779	-21	kworker/2:0+events	19:47:02	2
3465780	99	2412	12,2396	cyclictest	3485035	-21	kworker/1:2+events	20:59:25	1
3465783	99	2410	11,2396	cyclictest	3496165	-21	kworker/2:0+events	20:55:56	2
3465783	99	2399	12,2383	cyclictest	3549056	-21	kworker/2:2+events	00:14:10	2
3465783	99	2397	13,2381	cyclictest	3486508	-21	kworker/2:1+events	20:31:51	2
3465788	99	2388	12,2373	cyclictest	3540844	-21	kworker/3:0+events	23:05:33	3
3465780	99	2388	12,2372	cyclictest	3537791	-21	kworker/1:0+events	23:00:56	1
3465788	99	2383	12,2368	cyclictest	3493064	-21	kworker/3:1+events	20:37:37	3
3465788	99	2364	12,2349	cyclictest	3553782	-21	kworker/3:2+events	23:56:39	3
3465788	99	2362	11,2347	cyclictest	3506326	-21	kworker/3:2+events	21:16:06	3
3465788	99	2361	11,2347	cyclictest	3473811	-21	kworker/3:2+events	19:49:43	3
3465788	99	2357	11,2342	cyclictest	3480065	-21	kworker/3:1+events	20:06:28	3
3465780	99	2356	12,2341	cyclictest	3568179	-21	kworker/1:1+events	00:31:34	1
3465788	99	2353	12,2338	cyclictest	3488171	-21	kworker/3:1+events	20:19:21	3
3465788	99	2348	12,2333	cyclictest	3513628	-21	kworker/3:0+events	21:38:51	3
3465783	99	2336	10,2323	cyclictest	3492941	-21	kworker/2:0+events	20:36:30	2
3465775	99	2334	12,2319	cyclictest	3540905	-21	kworker/0:0+events	23:10:28	0
3465780	99	2326	12,2312	cyclictest	3539489	-21	kworker/1:2+events	23:20:03	1
3465780	99	2326	12,2311	cyclictest	3522005	-21	kworker/1:2+events	22:15:41	1
3465780	99	2326	11,2312	cyclictest	3515292	-21	kworker/1:2+events	21:49:37	1
3465780	99	2321	12,2307	cyclictest	3556688	-21	kworker/1:1+events	23:55:09	1
3465788	99	2314	11,2297	cyclictest	3518747	-21	kworker/3:0+events	21:59:12	3
3465788	99	2313	11,2298	cyclictest	3510394	-21	kworker/3:2+events	21:34:18	3
3465780	99	2308	11,2295	cyclictest	3470751	-21	kworker/1:0+events	19:40:55	1
3465780	99	2303	11,2289	cyclictest	3539489	-21	kworker/1:2+events	23:25:47	1
3465783	99	2300	9,2287	cyclictest	3518566	-21	kworker/2:1+events	21:55:24	2
3465780	99	2300	11,2286	cyclictest	3502745	-21	kworker/1:0+events	21:13:25	1
3465775	99	2290	10,2276	cyclictest	3469154	-21	kworker/0:1+events	19:27:35	0
3465788	99	2289	11,2274	cyclictest	3463957	-21	kworker/3:0+events	19:18:25	3
3465775	99	2285	9,2273	cyclictest	3502664	-21	kworker/0:2+events	21:07:22	0
3465775	99	2283	8,2272	cyclictest	3510278	-21	kworker/0:1+events	21:28:35	0
3465783	99	2277	11,2262	cyclictest	3549056	-21	kworker/2:2+events	23:45:14	2
3465775	99	2276	11,2262	cyclictest	3507083	-21	kworker/0:2+events	21:16:29	0
3465775	99	2275	11,2262	cyclictest	3473692	-21	kworker/0:2+events	19:37:32	0
3465775	99	2275	11,2260	cyclictest	3534923	-21	kworker/0:1+events	22:57:53	0
3465783	99	2274	10,2261	cyclictest	3549056	-21	kworker/2:2+events	23:31:29	2
3465775	99	2272	11,2258	cyclictest	3526462	-21	kworker/0:2+events	22:40:34	0
3465788	99	2271	10,2257	cyclictest	3493064	-21	kworker/3:1+events	20:43:21	3
3465775	99	2271	11,2257	cyclictest	3555116	-21	kworker/0:2+events	23:46:46	0
3465775	99	2271	10,2257	cyclictest	3568300	-21	kworker/0:1+events	00:29:42	0
3465775	99	2270	11,2256	cyclictest	3476945	-21	kworker/0:1+events	20:00:49	0
3465783	99	2269	12,2254	cyclictest	3558707	-21	kworker/2:3+events	00:01:34	2
3465780	99	2269	10,2255	cyclictest	3485035	-21	kworker/1:2+events	20:26:08	1
3465775	99	2269	7,2258	cyclictest	3469154	-21	kworker/0:1+events	19:31:49	0
3465775	99	2269	11,2255	cyclictest	3513858	-21	kworker/0:3+events	21:59:57	0
3465775	99	2269	11,2254	cyclictest	3486839	-21	kworker/0:1+events	20:18:56	0
3465775	99	2269	10,2255	cyclictest	3548916	-21	kworker/0:0+events	23:42:11	0
3465775	99	2269	10,2255	cyclictest	3520348	-21	kworker/0:0+events	22:04:07	0
3465775	99	2268	9,2256	cyclictest	3555116	-21	kworker/0:2+events	00:08:47	0
3465775	99	2268	9,2256	cyclictest	3498032	-21	kworker/0:2+events	20:54:48	0
3465775	99	2268	11,2254	cyclictest	3480127	-21	kworker/0:0+events	19:54:42	0
3465775	99	2267	7,2256	cyclictest	3526462	-21	kworker/0:2+events	22:29:49	0
3465775	99	2267	11,2253	cyclictest	3520348	-21	kworker/0:0+events	22:14:08	0
3465775	99	2266	11,2252	cyclictest	3483586	-21	kworker/0:2+events	20:11:19	0
3465775	99	2266	10,2253	cyclictest	3564622	-21	kworker/0:2+events	00:16:50	0
3465775	99	2265	11,2251	cyclictest	3571228	-21	kworker/0:0+events	00:39:34	0
3465775	99	2264	11,2250	cyclictest	3485239	-21	kworker/0:0+events	20:27:18	0
3465775	99	2263	11,2249	cyclictest	3473692	-21	kworker/0:2+events	19:42:49	0
3465775	99	2262	6,2253	cyclictest	3491400	-21	kworker/0:1+events	20:36:53	0
3465783	99	2260	11,2246	cyclictest	3545805	-21	kworker/2:0+events	23:23:31	2
3465775	99	2260	11,2245	cyclictest	3526462	-21	kworker/0:2+events	22:36:46	0
3465775	99	2259	10,2246	cyclictest	3516928	-21	kworker/0:0+events	21:47:41	0
3465788	99	2258	13,2242	cyclictest	3470450	-21	kworker/3:2+events	19:22:37	3
3465775	99	2255	10,2241	cyclictest	3540905	-21	kworker/0:0+events	23:02:05	0
3465775	99	2250	9,2238	cyclictest	3473692	-21	kworker/0:2+events	19:49:22	0
3465783	99	2244	12,2228	cyclictest	3510257	-21	kworker/2:0+events	21:30:32	2
3465783	99	2242	10,2228	cyclictest	3496165	-21	kworker/2:0+events	21:11:08	2
3465775	99	2240	8,2229	cyclictest	3511970	-21	kworker/0:2+events	21:36:33	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00