OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Jul 16, 2026 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2982009	99	3975	19,3952	cyclictest	2978557	-21	kworker/1:2+events	19:40:00	1
2982009	99	3966	14,3946	cyclictest	3026383	-21	kworker/1:2+events	21:30:12	1
2982009	99	3570	18,3548	cyclictest	3028984	-21	kworker/1:1+events	21:45:44	1
2982012	99	3311	14,3293	cyclictest	3037132	-21	kworker/2:0+events	22:10:14	2
2982015	99	3287	10,3270	cyclictest	3075650	-21	kworker/3:0+events	00:00:11	3
2982012	99	3181	12,3165	cyclictest	3048055	-21	kworker/2:0+events	23:00:01	2
2982015	99	3109	16,3091	cyclictest	3035564	-21	kworker/3:2+events	22:05:13	3
2982009	99	3087	13,3069	cyclictest	3011163	-21	kworker/1:0+events	20:40:16	1
2982009	99	3018	15,3000	cyclictest	2999845	-21	kworker/1:1+events	20:15:02	1
2982005	99	3007	15,2987	cyclictest	2983217	-21	kworker/0:1+events	19:15:12	0
2982009	99	3003	10,2989	cyclictest	3022640	-21	kworker/1:2+events	21:15:20	1
2982012	99	2928	14,2912	cyclictest	3052968	-21	kworker/2:2+events	23:10:12	2
2982009	99	2845	13,2828	cyclictest	3072450	-21	kworker/1:1+events	23:53:21	1
2982015	99	2844	13,2827	cyclictest	3037163	-21	kworker/3:0+events	22:00:13	3
2982012	99	2842	14,2823	cyclictest	2993472	-21	kworker/2:0+events	19:45:19	2
2982012	99	2836	9,2822	cyclictest	3044795	-21	kworker/2:1+events	22:30:18	2
2982009	99	2828	13,2813	cyclictest	3054273	-21	kworker/1:0+events	23:05:11	1
2982012	99	2819	11,2806	cyclictest	2993472	-21	kworker/2:0+events	20:00:09	2
2982009	99	2817	13,2800	cyclictest	3016388	-21	kworker/1:2+events	20:55:36	1
2982015	99	2812	13,2795	cyclictest	3075650	-21	kworker/3:0+events	00:25:16	3
2982015	99	2812	13,2795	cyclictest	3050712	-21	kworker/3:0+events	22:45:47	3
2982005	99	2812	12,2796	cyclictest	3032146	-21	kworker/0:2+events	21:44:34	0
2982005	99	2809	13,2792	cyclictest	3025674	-21	kworker/0:2+events	21:26:29	0
2982012	99	2807	13,2790	cyclictest	3048055	-21	kworker/2:0+events	22:37:53	2
2982012	99	2807	13,2790	cyclictest	2985531	-21	kworker/2:3+events	19:40:22	2
2982012	99	2802	13,2785	cyclictest	3006670	-21	kworker/2:1+events	20:28:04	2
2982009	99	2802	13,2785	cyclictest	3007854	-21	kworker/1:1+events	20:34:11	1
2982005	99	2801	13,2785	cyclictest	2996564	-21	kworker/0:1+events	19:55:14	0
2982009	99	2800	13,2783	cyclictest	3057847	-21	kworker/1:1+events	23:14:25	1
2982015	99	2799	13,2782	cyclictest	3078174	-21	kworker/3:1+events	00:10:22	3
2982009	99	2799	13,2784	cyclictest	3004646	-21	kworker/1:0+events	20:26:12	1
2982009	99	2797	13,2780	cyclictest	3030588	-21	kworker/1:2+events	21:39:38	1
2982009	99	2797	13,2780	cyclictest	2998132	-21	kworker/1:0+events	20:07:49	1
2982009	99	2796	13,2779	cyclictest	2998132	-21	kworker/1:0+events	19:59:01	1
2982009	99	2795	12,2779	cyclictest	3075898	-21	kworker/1:1+events	00:09:14	1
2982009	99	2794	13,2777	cyclictest	2996535	-21	kworker/1:1+events	19:52:13	1
2982009	99	2787	13,2772	cyclictest	3045385	-21	kworker/1:0+events	22:32:33	1
2982015	99	2785	13,2768	cyclictest	3085437	-21	kworker/3:1+events	00:39:39	3
2982015	99	2779	13,2762	cyclictest	3022579	-21	kworker/3:0+events	21:18:01	3
2982005	99	2778	13,2761	cyclictest	3062695	-21	kworker/0:1+events	23:17:25	0
2982009	99	2776	12,2760	cyclictest	3067865	-21	kworker/1:1+events	23:37:28	1
2982015	99	2775	13,2758	cyclictest	3070672	-21	kworker/3:1+events	23:57:55	3
2982009	99	2774	12,2758	cyclictest	3075898	-21	kworker/1:1+events	00:02:27	1
2982012	99	2773	13,2756	cyclictest	2985101	-21	kworker/2:2+events	19:19:03	2
2982012	99	2772	13,2757	cyclictest	3017743	-21	kworker/2:0+events	21:00:05	2
2982005	99	2772	13,2755	cyclictest	3080730	-21	kworker/0:0+events	00:16:51	0
2982015	99	2771	13,2753	cyclictest	3061366	-21	kworker/3:2+events	23:27:11	3
2982012	99	2771	13,2754	cyclictest	3025584	-21	kworker/2:2+events	21:41:57	2
2982005	99	2771	13,2754	cyclictest	3027678	-21	kworker/0:0+events	21:33:36	0
2982005	99	2771	13,2754	cyclictest	2978508	-21	kworker/0:2+events	19:13:43	0
2982015	99	2770	13,2753	cyclictest	3054304	-21	kworker/3:1+events	22:54:17	3
2982012	99	2769	13,2752	cyclictest	3051358	-21	kworker/2:1+events	22:48:30	2
2982005	99	2769	12,2754	cyclictest	3030182	-21	kworker/0:1+events	21:40:01	0
2982012	99	2768	13,2751	cyclictest	2988619	-21	kworker/2:0+events	19:30:51	2
2982005	99	2768	13,2751	cyclictest	3014415	-21	kworker/0:2+events	20:58:59	0
2982012	99	2767	13,2750	cyclictest	3046450	-21	kworker/2:2+events	22:29:09	2
2982012	99	2767	12,2752	cyclictest	2993472	-21	kworker/2:0+events	20:23:06	2
2982012	99	2766	11,2751	cyclictest	3027536	-21	kworker/2:1+events	21:31:40	2
2982005	99	2766	12,2750	cyclictest	3077239	-21	kworker/0:2+events	00:24:09	0
2982005	99	2766	11,2751	cyclictest	3037103	-21	kworker/0:0+events	22:04:04	0
2982005	99	2765	13,2748	cyclictest	2998339	-21	kworker/0:0+events	20:02:48	0
2982012	99	2763	13,2746	cyclictest	3059765	-21	kworker/2:0+events	23:25:39	2
2982005	99	2763	9,2750	cyclictest	2998339	-21	kworker/0:0+events	20:42:57	0
2982005	99	2763	11,2748	cyclictest	3087219	-21	kworker/0:1+events	00:36:36	0
2982012	99	2762	13,2745	cyclictest	3009396	-21	kworker/2:2+events	20:37:12	2
2982012	99	2762	13,2745	cyclictest	3009396	-21	kworker/2:2+events	20:37:12	2
2982005	99	2762	9,2749	cyclictest	2994958	-21	kworker/0:2+events	19:51:50	0
2982005	99	2762	13,2745	cyclictest	2998339	-21	kworker/0:0+events	20:23:30	0
2982005	99	2762	12,2746	cyclictest	3023961	-21	kworker/0:1+events	21:17:38	0
2982005	99	2762	11,2747	cyclictest	3035415	-21	kworker/0:2+events	22:08:40	0
2982012	99	2761	14,2743	cyclictest	3011102	-21	kworker/2:1+events	21:10:23	2
2982005	99	2761	13,2744	cyclictest	3033750	-21	kworker/0:1+events	21:50:19	0
2982005	99	2761	12,2745	cyclictest	3064384	-21	kworker/0:2+events	23:22:42	0
2982015	99	2760	13,2743	cyclictest	3070672	-21	kworker/3:1+events	23:52:58	3
2982005	99	2760	13,2743	cyclictest	3078868	-21	kworker/0:1+events	00:13:25	0
2982005	99	2760	11,2745	cyclictest	3008119	-21	kworker/0:2+events	20:33:48	0
2982005	99	2759	13,2742	cyclictest	3009741	-21	kworker/0:1+events	20:39:29	0
2982005	99	2759	13,2742	cyclictest	3009741	-21	kworker/0:1+events	20:39:29	0
2982005	99	2759	13,2742	cyclictest	2998339	-21	kworker/0:0+events	20:17:22	0
2982015	99	2758	13,2741	cyclictest	2986937	-21	kworker/3:1+events	19:26:11	3
2982015	99	2757	13,2740	cyclictest	3004739	-21	kworker/3:1+events	20:47:54	3
2982015	99	2757	13,2740	cyclictest	3004739	-21	kworker/3:1+events	20:47:54	3
2982015	99	2757	12,2741	cyclictest	3057878	-21	kworker/3:1+events	23:06:42	3
2982015	99	2756	13,2739	cyclictest	2995078	-21	kworker/3:1+events	20:00:56	3
2982005	99	2755	13,2738	cyclictest	3041594	-21	kworker/0:0+events	22:19:43	0
2982015	99	2754	13,2737	cyclictest	3041656	-21	kworker/3:0+events	22:15:34	3
2982015	99	2753	13,2736	cyclictest	3075650	-21	kworker/3:0+events	00:30:11	3
2982015	99	2753	12,2737	cyclictest	2986937	-21	kworker/3:1+events	19:41:29	3
2982015	99	2752	13,2735	cyclictest	3017683	-21	kworker/3:1+events	21:02:49	3
2982015	99	2750	13,2733	cyclictest	3050712	-21	kworker/3:0+events	22:41:35	3
2982009	99	2750	11,2735	cyclictest	2990173	-21	kworker/1:0+events	19:32:23	1
2982015	99	2749	13,2734	cyclictest	3004739	-21	kworker/3:1+events	20:20:03	3
2982005	99	2749	11,2734	cyclictest	3070917	-21	kworker/0:1+events	00:00:34	0
2982015	99	2748	12,2732	cyclictest	3061366	-21	kworker/3:2+events	23:41:17	3
2982015	99	2747	13,2730	cyclictest	3008032	-21	kworker/3:2+events	20:29:13	3
2982015	99	2746	12,2730	cyclictest	3017683	-21	kworker/3:1+events	21:11:32	3
2982015	99	2744	13,2727	cyclictest	3041656	-21	kworker/3:0+events	22:31:49	3
2982015	99	2744	12,2728	cyclictest	2996681	-21	kworker/3:0+events	19:57:30	3
2982012	99	2744	13,2728	cyclictest	3037132	-21	kworker/2:0+events	22:20:51	2
2982015	99	2743	13,2726	cyclictest	3027506	-21	kworker/3:0+events	21:49:11	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00