OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Tue Jan 06, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3248140	99	5790	27,5759	cyclictest	3239495	-21	kworker/2:0+events	19:11:09	2
3248143	99	5789	27,5758	cyclictest	3238141	-21	kworker/3:2+events	19:11:32	3
3248133	99	5763	28,5730	cyclictest	3246218	-21	kworker/0:1+events	19:12:16	0
3248136	99	2795	9,2781	cyclictest	3276860	-21	kworker/1:2+events	20:40:16	1
3248136	99	2694	13,2677	cyclictest	3260952	-21	kworker/1:2+events	19:50:14	1
3248136	99	2658	13,2641	cyclictest	3342843	-21	kworker/1:0+events	00:15:18	1
3248140	99	2637	11,2624	cyclictest	3247870	-21	kworker/2:2+events	19:15:20	2
3248140	99	2597	12,2581	cyclictest	3299260	-21	kworker/2:1+events	22:00:17	2
3248133	99	2549	11,2534	cyclictest	3313620	-21	kworker/0:2+events	22:40:00	0
3248133	99	2526	12,2512	cyclictest	3320407	-21	kworker/0:1+events	23:25:18	0
3248133	99	2487	11,2472	cyclictest	3278548	-21	kworker/0:0+events	21:15:18	0
3248140	99	2302	10,2288	cyclictest	3267291	-21	kworker/2:2+events	20:14:16	2
3248133	99	2299	11,2284	cyclictest	3262519	-21	kworker/0:0+events	20:00:53	0
3248140	99	2297	7,2287	cyclictest	3318164	-21	kworker/2:2+events	22:55:34	2
3248133	99	2269	11,2254	cyclictest	3260895	-21	kworker/0:2+events	19:53:12	0
3248133	99	2267	11,2253	cyclictest	3308822	-21	kworker/0:0+events	22:23:14	0
3248133	99	2229	11,2214	cyclictest	3262519	-21	kworker/0:0+events	20:07:25	0
3248133	99	2222	8,2211	cyclictest	3320407	-21	kworker/0:1+events	23:23:43	0
3248140	99	2220	9,2208	cyclictest	3326402	-21	kworker/2:1+events	23:13:08	2
3248136	99	2180	8,2169	cyclictest	3244339	-21	kworker/1:0+events	19:13:25	1
3248140	99	2154	11,2140	cyclictest	3267291	-21	kworker/2:2+events	20:22:19	2
3248143	99	2144	9,2132	cyclictest	3259408	-21	kworker/3:1+events	19:46:06	3
3248140	99	2121	10,2107	cyclictest	3256070	-21	kworker/2:2+events	19:46:30	2
3248140	99	2120	10,2107	cyclictest	3318164	-21	kworker/2:2+events	22:51:26	2
3248140	99	2119	10,2106	cyclictest	3319819	-21	kworker/2:0+events	23:05:32	2
3248140	99	2119	10,2105	cyclictest	3282887	-21	kworker/2:1+events	20:58:28	2
3248140	99	2119	10,2105	cyclictest	3282887	-21	kworker/2:1+events	20:58:28	2
3248143	99	2115	10,2102	cyclictest	3347389	-21	kworker/3:1+events	00:36:31	3
3248133	99	2115	10,2101	cyclictest	3302351	-21	kworker/0:2+events	22:08:13	0
3248140	99	2114	10,2102	cyclictest	3268924	-21	kworker/2:1+events	20:15:03	2
3248140	99	2114	10,2101	cyclictest	3331337	-21	kworker/2:2+events	23:46:04	2
3248140	99	2113	8,2101	cyclictest	3314813	-21	kworker/2:1+events	22:44:36	2
3248133	99	2113	10,2100	cyclictest	3337797	-21	kworker/0:1+events	23:52:11	0
3248140	99	2112	9,2100	cyclictest	3261138	-21	kworker/2:1+events	20:05:27	2
3248140	99	2112	5,2104	cyclictest	3332973	-21	kworker/2:1+events	23:43:51	2
3248140	99	2111	9,2099	cyclictest	3253162	-21	kworker/2:1+events	19:37:46	2
3248133	99	2111	8,2100	cyclictest	3324968	-21	kworker/0:0+events	23:17:16	0
3248133	99	2111	10,2098	cyclictest	3340724	-21	kworker/0:2+events	00:07:16	0
3248133	99	2111	10,2098	cyclictest	3330187	-21	kworker/0:0+events	23:31:17	0
3248140	99	2110	3,2104	cyclictest	3329619	-21	kworker/2:1+events	23:23:20	2
3248140	99	2110	10,2097	cyclictest	3297653	-21	kworker/2:0+events	21:44:35	2
3248136	99	2110	6,2101	cyclictest	3315022	-21	kworker/1:2+events	22:39:37	1
3248133	99	2110	8,2099	cyclictest	3330187	-21	kworker/0:0+events	00:01:12	0
3248133	99	2110	5,2102	cyclictest	3324968	-21	kworker/0:0+events	23:12:21	0
3248133	99	2110	10,2097	cyclictest	3286763	-21	kworker/0:2+events	21:24:01	0
3248140	99	2109	8,2097	cyclictest	3308517	-21	kworker/2:0+events	22:45:45	2
3248136	99	2108	10,2095	cyclictest	3348898	-21	kworker/1:2+events	00:21:47	1
3248133	99	2104	7,2094	cyclictest	3262519	-21	kworker/0:0+events	20:11:08	0
3248140	99	2103	10,2091	cyclictest	3319819	-21	kworker/2:0+events	23:00:07	2
3248140	99	2103	10,2091	cyclictest	3319819	-21	kworker/2:0+events	23:00:07	2
3248133	99	2103	9,2091	cyclictest	3308822	-21	kworker/0:0+events	22:32:02	0
3248136	99	2100	9,2088	cyclictest	3291189	-21	kworker/1:0+events	21:22:54	1
3248133	99	2100	8,2089	cyclictest	3297474	-21	kworker/0:1+events	21:42:39	0
3248136	99	2099	10,2085	cyclictest	3337556	-21	kworker/1:1+events	23:47:13	1
3248133	99	2099	9,2087	cyclictest	3253430	-21	kworker/0:0+events	19:41:55	0
3248140	99	2097	9,2085	cyclictest	3286444	-21	kworker/2:2+events	21:33:09	2
3248140	99	2097	5,2089	cyclictest	3282887	-21	kworker/2:1+events	21:10:21	2
3248140	99	2097	4,2090	cyclictest	3331337	-21	kworker/2:2+events	00:02:00	2
3248143	99	2095	10,2082	cyclictest	3282980	-21	kworker/3:1+events	21:14:57	3
3248140	99	2095	10,2083	cyclictest	3290091	-21	kworker/2:1+events	21:25:08	2
3248140	99	2094	11,2080	cyclictest	3344269	-21	kworker/2:1+events	00:09:10	2
3248140	99	2092	8,2081	cyclictest	3286444	-21	kworker/2:2+events	21:08:03	2
3248133	99	2090	8,2079	cyclictest	3282919	-21	kworker/0:2+events	21:00:24	0
3248133	99	2088	8,2077	cyclictest	3278548	-21	kworker/0:0+events	20:50:52	0
3248133	99	2087	8,2076	cyclictest	3344332	-21	kworker/0:0+events	00:28:13	0
3248140	99	2086	4,2079	cyclictest	3256070	-21	kworker/2:2+events	19:44:34	2
3248140	99	2084	4,2077	cyclictest	3278383	-21	kworker/2:1+events	20:44:24	2
3248133	99	2081	6,2072	cyclictest	3286763	-21	kworker/0:2+events	21:36:16	0
3248133	99	2081	10,2067	cyclictest	3262519	-21	kworker/0:0+events	20:16:33	0
3248140	99	2078	7,2068	cyclictest	3306911	-21	kworker/2:2+events	22:18:37	2
3248140	99	2076	8,2064	cyclictest	3301003	-21	kworker/2:2+events	21:57:12	2
3248133	99	2076	8,2065	cyclictest	3351163	-21	kworker/0:1+events	00:36:07	0
3248133	99	2076	7,2066	cyclictest	3330187	-21	kworker/0:0+events	23:56:36	0
3248136	99	2075	10,2062	cyclictest	3249589	-21	kworker/1:2+events	19:25:59	1
3248133	99	2074	10,2061	cyclictest	3270289	-21	kworker/0:2+events	20:21:56	0
3248133	99	2073	9,2061	cyclictest	3336197	-21	kworker/0:2+events	23:48:43	0
3248133	99	2072	7,2061	cyclictest	3291067	-21	kworker/0:1+events	21:25:33	0
3248140	99	2071	9,2059	cyclictest	3331337	-21	kworker/2:2+events	23:39:43	2
3248133	99	2071	7,2061	cyclictest	3342670	-21	kworker/0:1+events	00:12:59	0
3248133	99	2071	10,2058	cyclictest	3316467	-21	kworker/0:0+events	22:48:24	0
3248133	99	2068	9,2056	cyclictest	3286763	-21	kworker/0:2+events	21:30:51	0
3248140	99	2067	9,2054	cyclictest	3340692	-21	kworker/2:1+events	23:58:32	2
3248136	99	2067	10,2054	cyclictest	3331486	-21	kworker/1:2+events	23:37:50	1
3248133	99	2066	10,2053	cyclictest	3253430	-21	kworker/0:0+events	19:38:08	0
3248140	99	2064	10,2051	cyclictest	3308517	-21	kworker/2:0+events	22:33:58	2
3248140	99	2063	7,2053	cyclictest	3299260	-21	kworker/2:1+events	21:50:20	2
3248143	99	2057	10,2044	cyclictest	3308790	-21	kworker/3:0+events	22:21:40	3
3248133	99	2056	8,2045	cyclictest	3282919	-21	kworker/0:2+events	20:57:20	0
3248133	99	2056	8,2045	cyclictest	3282919	-21	kworker/0:2+events	20:57:19	0
3248133	99	2055	5,2047	cyclictest	3311969	-21	kworker/0:1+events	22:44:59	0
3248133	99	2055	10,2042	cyclictest	3334400	-21	kworker/0:1+events	23:40:51	0
3248136	99	2054	9,2042	cyclictest	3308546	-21	kworker/1:0+events	22:43:25	1
3248133	99	2054	3,2048	cyclictest	3246218	-21	kworker/0:1+events	19:24:04	0
3248140	99	2051	10,2038	cyclictest	3350540	-21	kworker/2:0+events	00:37:40	2
3248133	99	2051	11,2037	cyclictest	3273541	-21	kworker/0:0+events	20:36:53	0
3248133	99	2050	10,2038	cyclictest	3332792	-21	kworker/0:2+events	23:35:09	0
3248140	99	2049	7,2039	cyclictest	3331337	-21	kworker/2:2+events	00:10:42	2
3248136	99	2048	9,2036	cyclictest	3331486	-21	kworker/1:2+events	23:42:42	1
3248140	99	2047	9,2035	cyclictest	3286444	-21	kworker/2:2+events	21:35:29	2
3248133	99	2047	8,2036	cyclictest	3295854	-21	kworker/0:0+events	21:52:15	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00