OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Jul 30, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1258160	99	3104	6,3092	cyclictest	1287244	-21	kworker/2:2+events	20:40:15	2
1258153	99	3095	15,3075	cyclictest	1303191	-21	kworker/0:1+events	21:40:16	0
1258153	99	3049	10,3033	cyclictest	1336663	-21	kworker/0:1+events	23:15:11	0
1258156	99	2951	14,2932	cyclictest	1285652	-21	kworker/1:0+events	20:35:15	1
1258156	99	2924	13,2907	cyclictest	1285652	-21	kworker/1:0+events	20:50:32	1
1258160	99	2919	13,2902	cyclictest	1326243	-21	kworker/2:1+events	23:08:21	2
1258153	99	2898	14,2881	cyclictest	1340261	-21	kworker/0:0+events	23:35:01	0
1258153	99	2880	11,2866	cyclictest	1352954	-21	kworker/0:1+events	00:15:16	0
1258153	99	2880	11,2866	cyclictest	1352954	-21	kworker/0:1+events	00:15:16	0
1258156	99	2870	12,2854	cyclictest	1303111	-21	kworker/1:1+events	21:30:01	1
1258160	99	2869	13,2852	cyclictest	1277199	-21	kworker/2:2+events	20:20:18	2
1258153	99	2860	14,2842	cyclictest	1309368	-21	kworker/0:1+events	22:05:16	0
1258160	99	2835	14,2816	cyclictest	1354375	-21	kworker/2:2+events	00:10:19	2
1258160	99	2830	11,2815	cyclictest	1270832	-21	kworker/2:0+events	19:55:56	2
1258160	99	2822	12,2806	cyclictest	1278984	-21	kworker/2:1+events	20:19:32	2
1258156	99	2818	13,2803	cyclictest	1275830	-21	kworker/1:2+events	20:21:04	1
1258160	99	2805	13,2788	cyclictest	1343183	-21	kworker/2:2+events	23:44:14	2
1258160	99	2804	13,2787	cyclictest	1351105	-21	kworker/2:0+events	00:01:41	2
1258160	99	2799	13,2784	cyclictest	1354375	-21	kworker/2:2+events	00:19:04	2
1258160	99	2799	13,2784	cyclictest	1354375	-21	kworker/2:2+events	00:19:04	2
1258160	99	2797	13,2780	cyclictest	1307798	-21	kworker/2:0+events	21:43:39	2
1258163	99	2794	12,2778	cyclictest	1317602	-21	kworker/3:0+events	22:16:21	3
1258156	99	2787	13,2770	cyclictest	1327588	-21	kworker/1:2+events	22:50:14	1
1258160	99	2780	13,2763	cyclictest	1331907	-21	kworker/2:0+events	23:12:11	2
1258153	99	2780	11,2766	cyclictest	1295112	-21	kworker/0:0+events	21:03:55	0
1258160	99	2779	13,2762	cyclictest	1311025	-21	kworker/2:0+events	22:00:14	2
1258160	99	2775	13,2758	cyclictest	1290671	-21	kworker/2:0+events	21:25:29	2
1258160	99	2774	12,2760	cyclictest	1293425	-21	kworker/2:2+events	21:00:10	2
1258160	99	2769	13,2752	cyclictest	1328715	-21	kworker/2:2+events	22:56:59	2
1258160	99	2769	13,2752	cyclictest	1285508	-21	kworker/2:1+events	20:31:50	2
1258156	99	2767	13,2750	cyclictest	1275830	-21	kworker/1:2+events	20:25:17	1
1258160	99	2762	13,2745	cyclictest	1270832	-21	kworker/2:0+events	19:51:47	2
1258163	99	2761	12,2745	cyclictest	1296681	-21	kworker/3:1+events	21:10:27	3
1258156	99	2761	13,2746	cyclictest	1275830	-21	kworker/1:2+events	20:16:05	1
1258156	99	2760	13,2743	cyclictest	1285652	-21	kworker/1:0+events	21:02:50	1
1258156	99	2758	12,2742	cyclictest	1312738	-21	kworker/1:0+events	21:56:52	1
1258156	99	2758	11,2743	cyclictest	1327588	-21	kworker/1:2+events	23:02:42	1
1258163	99	2757	13,2740	cyclictest	1325668	-21	kworker/3:2+events	22:57:45	3
1258163	99	2756	8,2744	cyclictest	1275801	-21	kworker/3:2+events	20:05:22	3
1258163	99	2756	13,2739	cyclictest	1298430	-21	kworker/3:0+events	21:31:31	3
1258163	99	2755	9,2741	cyclictest	1351414	-21	kworker/3:1+events	00:05:23	3
1258163	99	2753	13,2736	cyclictest	1320880	-21	kworker/3:0+events	22:38:09	3
1258163	99	2753	13,2736	cyclictest	1267809	-21	kworker/3:0+events	19:45:41	3
1258163	99	2752	13,2735	cyclictest	1285629	-21	kworker/3:2+events	20:35:37	3
1258163	99	2751	8,2738	cyclictest	1357401	-21	kworker/3:1+events	00:38:31	3
1258156	99	2750	13,2733	cyclictest	1296617	-21	kworker/1:1+events	21:20:58	1
1258156	99	2749	11,2736	cyclictest	1323819	-21	kworker/1:0+events	22:45:20	1
1258163	99	2748	13,2731	cyclictest	1334981	-21	kworker/3:0+events	23:12:33	3
1258160	99	2742	13,2726	cyclictest	1251479	-21	kworker/2:2+events	19:19:54	2
1258153	99	2742	13,2725	cyclictest	1344820	-21	kworker/0:2+events	00:09:12	0
1258153	99	2742	13,2724	cyclictest	1283927	-21	kworker/0:1+events	20:31:27	0
1258163	99	2741	13,2724	cyclictest	1298430	-21	kworker/3:0+events	21:27:46	3
1258156	99	2741	13,2724	cyclictest	1274043	-21	kworker/1:0+events	20:03:04	1
1258160	99	2740	13,2724	cyclictest	1343183	-21	kworker/2:2+events	23:47:37	2
1258163	99	2738	13,2721	cyclictest	1311173	-21	kworker/3:1+events	22:02:09	3
1258156	99	2727	13,2710	cyclictest	1309267	-21	kworker/1:1+events	21:47:26	1
1258153	99	2727	13,2710	cyclictest	1267103	-21	kworker/0:2+events	19:54:03	0
1258156	99	2726	13,2709	cyclictest	1351047	-21	kworker/1:1+events	00:02:26	1
1258163	99	2724	11,2709	cyclictest	1277675	-21	kworker/3:0+events	20:19:55	3
1258153	99	2724	13,2707	cyclictest	1295112	-21	kworker/0:0+events	21:06:11	0
1258163	99	2723	6,2713	cyclictest	1290537	-21	kworker/3:1+events	20:51:42	3
1258163	99	2722	13,2705	cyclictest	1287307	-21	kworker/3:0+events	20:43:42	3
1258163	99	2719	11,2704	cyclictest	1341695	-21	kworker/3:2+events	23:28:52	3
1258156	99	2719	13,2702	cyclictest	1274043	-21	kworker/1:0+events	20:14:12	1
1258156	99	2719	13,2702	cyclictest	1274043	-21	kworker/1:0+events	20:08:25	1
1258156	99	2717	13,2699	cyclictest	1252979	-21	kworker/1:0+events	19:20:16	1
1258153	99	2717	13,2699	cyclictest	1263017	-21	kworker/0:0+events	19:37:42	0
1258163	99	2716	13,2699	cyclictest	1338207	-21	kworker/3:2+events	23:22:05	3
1258163	99	2715	12,2699	cyclictest	1348082	-21	kworker/3:0+events	23:49:56	3
1258156	99	2713	13,2696	cyclictest	1327588	-21	kworker/1:2+events	23:09:53	1
1258156	99	2713	13,2696	cyclictest	1285652	-21	kworker/1:0+events	20:41:01	1
1258156	99	2713	13,2696	cyclictest	1252979	-21	kworker/1:0+events	19:15:20	1
1258163	99	2712	13,2697	cyclictest	1295047	-21	kworker/3:0+events	21:05:06	3
1258163	99	2712	13,2695	cyclictest	1304586	-21	kworker/3:1+events	21:36:47	3
1258156	99	2712	13,2695	cyclictest	1303111	-21	kworker/1:1+events	21:35:40	1
1258156	99	2712	13,2695	cyclictest	1252979	-21	kworker/1:0+events	19:38:03	1
1258153	99	2712	10,2698	cyclictest	1305122	-21	kworker/0:0+events	21:39:07	0
1258163	99	2711	13,2694	cyclictest	1290537	-21	kworker/3:1+events	20:55:10	3
1258156	99	2711	13,2694	cyclictest	1349414	-21	kworker/1:0+events	23:55:40	1
1258156	99	2711	13,2694	cyclictest	1339999	-21	kworker/1:0+events	23:35:23	1
1258156	99	2711	12,2696	cyclictest	1272443	-21	kworker/1:2+events	19:54:26	1
1258156	99	2710	12,2694	cyclictest	1319342	-21	kworker/1:1+events	22:30:48	1
1258163	99	2709	13,2692	cyclictest	1307973	-21	kworker/3:0+events	21:59:53	3
1258156	99	2709	13,2692	cyclictest	1355946	-21	kworker/1:2+events	00:16:47	1
1258156	99	2709	13,2692	cyclictest	1355946	-21	kworker/1:2+events	00:16:46	1
1258163	99	2708	13,2691	cyclictest	1360692	-21	kworker/3:2+events	00:32:46	3
1258163	99	2708	13,2691	cyclictest	1272467	-21	kworker/3:1+events	20:04:36	3
1258156	99	2708	13,2691	cyclictest	1285652	-21	kworker/1:0+events	20:59:46	1
1258153	99	2708	13,2691	cyclictest	1344820	-21	kworker/0:2+events	23:52:14	0
1258163	99	2707	8,2695	cyclictest	1292248	-21	kworker/3:3+events	21:00:54	3
1258163	99	2706	13,2689	cyclictest	1272467	-21	kworker/3:1+events	19:53:16	3
1258153	99	2706	13,2689	cyclictest	1307768	-21	kworker/0:2+events	21:46:40	0
1258163	99	2705	13,2688	cyclictest	1344694	-21	kworker/3:1+events	23:42:43	3
1258163	99	2705	13,2688	cyclictest	1341695	-21	kworker/3:2+events	23:31:31	3
1258163	99	2705	13,2688	cyclictest	1284018	-21	kworker/3:1+events	20:34:52	3
1258163	99	2705	13,2688	cyclictest	1284018	-21	kworker/3:1+events	20:28:21	3
1258163	99	2705	13,2688	cyclictest	1280550	-21	kworker/3:2+events	20:24:54	3
1258163	99	2705	13,2688	cyclictest	1272467	-21	kworker/3:1+events	20:10:19	3
1258163	99	2705	12,2689	cyclictest	1287307	-21	kworker/3:0+events	20:47:29	3
1258156	99	2705	13,2688	cyclictest	1319342	-21	kworker/1:1+events	22:27:44	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00