OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Wed Mar 18, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2127606	99	119	111,6	cyclictest	2209416	-21	kworker/u4:5+events_unbound	10:33:59	0
2127606	99	114	98,8	cyclictest	2301632	-21	kworker/u4:0+events_unbound	11:55:01	0
2127606	99	110	102,5	cyclictest	2174329	-21	kworker/u4:8+events_unbound	10:18:54	0
2127606	99	106	98,6	cyclictest	2275583	-21	kworker/u4:18+events_unbound	11:39:11	0
2127606	99	100	90,7	cyclictest	2169827	-21	kworker/u4:3+events_unbound	09:43:46	0
2127606	99	97	82,5	cyclictest	2205008	-21	kworker/u4:3+events_unbound	10:20:02	0
2127606	99	94	87,5	cyclictest	2205007	-21	kworker/u4:1+events_unbound	10:03:48	0
2127606	99	90	81,7	cyclictest	2341029	-21	kworker/u4:5+events_unbound	12:39:23	0
2127607	99	89	82,5	cyclictest	2174327	-21	kworker/u4:1+events_unbound	09:45:03	1
2127606	99	88	81,5	cyclictest	2306068	-21	kworker/u4:6+events_unbound	12:00:03	0
2127607	99	86	79,5	cyclictest	2297205	-21	kworker/u4:12+events_unbound	12:29:21	1
2127606	99	85	76,6	cyclictest	2125097	-21	kworker/u4:2+events_unbound	08:00:00	0
2127606	99	82	75,5	cyclictest	2239910	-21	kworker/u4:0+events_unbound	10:44:01	0
2127607	99	80	72,6	cyclictest	2218308	-21	kworker/u4:1+events_unbound	10:54:03	1
2127606	99	79	70,7	cyclictest	2227197	-21	kworker/u4:6+events_unbound	10:50:13	0
2127606	99	78	70,6	cyclictest	2183259	-21	kworker/u4:10+events_unbound	09:48:47	0
2127606	99	77	68,6	cyclictest	2266622	-21	kworker/u4:4+events_unbound	11:29:09	0
2127606	99	75	62,10	cyclictest	53	-21	kswapd0	11:15:08	0
2127606	99	73	66,5	cyclictest	2191582	-21	kworker/u4:13+events_unbound	09:58:48	0
2127606	99	73	63,7	cyclictest	53	-21	kswapd0	12:15:09	0
2127606	99	72	64,6	cyclictest	2155996	-21	kworker/u4:1+events_unbound	09:18:40	0
2127606	99	72	63,7	cyclictest	2240557	-21	kworker/u4:10+events_unbound	10:45:12	0
2127606	99	71	47,21	cyclictest	2326308	-21	kernelversion	12:20:22	0
2127607	99	69	61,6	cyclictest	2240556	-21	kworker/u4:8+events_unbound	10:49:02	1
2127606	99	68	61,5	cyclictest	2141707	-21	kworker/u4:0+xprtiod	08:30:09	0
2127607	99	67	60,5	cyclictest	2306068	-21	kworker/u4:6+events_unbound	11:59:14	1
2127606	99	67	57,8	cyclictest	2239910	-21	kworker/u4:0+events_unbound	10:55:12	0
2127606	99	65	50,12	cyclictest	53	-21	kswapd0	11:30:32	0
2127607	99	64	56,6	cyclictest	2275582	-21	kworker/u4:17+events_unbound	11:34:10	1
2127607	99	63	52,5	cyclictest	37	-21	kcompactd0	11:05:18	1
2127607	99	62	51,8	cyclictest	37	-21	kcompactd0	09:33:52	1
2127606	99	62	51,8	cyclictest	398	-21	systemd-logind	12:14:17	0
2127606	99	62	50,8	cyclictest	2225922	-21	switchtime	10:25:37	0
2127607	99	61	52,6	cyclictest	53	-21	kswapd0	11:40:11	1
2127606	99	61	54,5	cyclictest	2139141	-21	kworker/u4:11+events_unbound	09:13:39	0
2127606	99	61	52,6	cyclictest	2260264	-21	fschecks_count	11:05:18	0
2127606	99	61	37,21	cyclictest	2211602	-21	latency_hist	10:10:02	0
2127607	99	60	55,3	cyclictest	2275583	-21	kworker/u4:18+events_unbound	11:50:10	1
2127607	99	60	53,5	cyclictest	2336567	-21	kworker/u4:13+events_unbound	12:34:22	1
2127607	99	60	53,5	cyclictest	2227197	-21	kworker/u4:6+events_unbound	10:39:00	1
2127606	99	60	50,6	cyclictest	2182626	-21	kworker/u4:9+events_unbound	09:55:01	0
2127606	99	60	47,9	cyclictest	2130528	-21	df	07:20:19	0
2127606	99	59	49,8	cyclictest	53	-21	kswapd0	12:30:11	0
2127606	99	59	44,9	cyclictest	0	-21	swapper/0	09:20:24	0
2127606	99	58	46,8	cyclictest	2156412	-21	df	09:00:16	0
2127607	99	57	41,4	cyclictest	2205008	-21	kworker/u4:3+events_unbound	10:15:01	1
2127607	99	57	2,43	cyclictest	2168412	-21	ssh	09:20:24	1
2127606	99	57	47,6	cyclictest	2212159	-21	/usr/sbin/munin	10:10:20	0
2127607	99	56	50,4	cyclictest	53	-21	kswapd0	12:15:06	1
2127607	99	56	49,5	cyclictest	2306068	-21	kworker/u4:6+events_unbound	12:09:16	1
2127607	99	55	49,4	cyclictest	53	-21	kswapd0	10:40:12	1
2127606	99	55	47,5	cyclictest	2158830	-21	latency_hist	09:10:02	0
2127606	99	55	38,14	cyclictest	256	50	irq/23-42890000.ethernet	08:20:09	0
2127607	99	54	47,5	cyclictest	2275582	-21	kworker/u4:17+events_unbound	11:45:21	1
2127607	99	54	46,6	cyclictest	2314980	-21	kworker/u4:10+events_unbound	12:10:17	1
2127606	99	53	5,45	cyclictest	0	-21	swapper/0	07:45:10	0
2127606	99	53	46,5	cyclictest	2174327	-21	kworker/u4:1+events_unbound	09:39:00	0
2127606	99	53	45,5	cyclictest	2149667	-21	awk	08:35:00	0
2127606	99	53	35,10	cyclictest	2259632	-21	modprobe	11:05:00	0
2127606	99	53	31,13	cyclictest	0	-21	swapper/0	11:20:30	0
2127607	99	52	22,24	cyclictest	27	1	ktimers/1	07:45:30	1
2127606	99	52	44,6	cyclictest	2128826	-21	kworker/u4:5+events_unbound	07:17:00	0
2127606	99	52	44,6	cyclictest	2128826	-21	kworker/u4:5+events_unbound	07:17:00	0
2127606	99	52	42,6	cyclictest	2150010	-21	df	08:35:17	0
2127607	99	51	44,5	cyclictest	2227197	-21	kworker/u4:6+events_unbound	10:34:23	1
2127607	99	51	43,6	cyclictest	378	-21	dbus-daemon	11:39:11	1
2127607	99	51	43,5	cyclictest	2220771	-21	df_abs	10:20:17	1
2127607	99	51	43,5	cyclictest	2132736	-21	grep	07:30:01	1
2127607	99	51	42,6	cyclictest	2264872	-21	irqstats	11:10:22	1
2127606	99	51	44,5	cyclictest	2313865	-21	unixbench_singl	12:05:41	0
2127607	99	50	43,5	cyclictest	2339507	-21	ld	12:35:24	1
2127607	99	50	42,5	cyclictest	2217243	-21	switchtime	10:15:45	1
2127607	99	50	41,6	cyclictest	2180977	-21	dpkg	09:35:13	1
2127606	99	50	6,36	cyclictest	2172866	-21	ssh	09:25:26	0
2127606	99	50	43,5	cyclictest	2288315	-21	kworker/u4:7+events_unbound	11:44:41	0
2127606	99	50	37,6	cyclictest	2169829	-21	kworker/u4:5+events_unbound	09:32:32	0
2127607	99	49	42,5	cyclictest	2277981	-21	gltestperf	11:25:19	1
2127607	99	49	40,7	cyclictest	2159558	-21	/usr/sbin/munin	09:10:27	1
2127607	99	49	39,6	cyclictest	0	-21	swapper/1	11:15:29	1
2127606	99	49	41,5	cyclictest	0	-21	swapper/0	12:25:17	0
2127606	99	49	40,6	cyclictest	2135374	-21	latency_hist	07:40:02	0
2127606	99	49	38,8	cyclictest	2151777	-21	sshd	08:40:33	0
2127606	99	49	29,17	cyclictest	0	-21	swapper/0	10:35:21	0
2127607	99	48	41,5	cyclictest	2172258	-21	aten_r7power_cu	09:25:15	1
2127607	99	48	39,6	cyclictest	2117793	-21	kworker/u4:1+events_unbound	08:30:00	1
2127607	99	48	30,13	cyclictest	0	-21	swapper/1	07:50:35	1
2127606	99	48	39,6	cyclictest	2125097	-21	kworker/u4:2+events_unbound	08:05:01	0
2127606	99	48	31,10	cyclictest	2153477	-21	modprobe	08:50:00	0
2127606	99	48	29,6	cyclictest	2305428	-21	kworker/u4:5+events_unbound	11:56:43	0
2127607	99	47	40,5	cyclictest	2227199	-21	kworker/u4:9+events_unbound	10:28:58	1
2127607	99	47	39,6	cyclictest	2199369	-21	ntp_offset	09:55:29	1
2127607	99	47	36,6	cyclictest	0	-21	swapper/1	12:00:30	1
2127606	99	47	40,5	cyclictest	2127537	-21	kworker/u4:3+events_unbound	08:18:31	0
2127606	99	47	38,6	cyclictest	2264354	-21	/usr/sbin/munin	11:10:16	0
2127606	99	47	28,12	cyclictest	2133968	-21	kworker/u4:13	07:35:00	0
2127607	99	46	40,4	cyclictest	2195341	-21	timerwakeupswit	09:50:38	1
2127607	99	46	39,5	cyclictest	2326344	-21	netstat	12:20:23	1
2127607	99	46	38,5	cyclictest	2255632	-21	aten_r7power_en	11:00:15	1
2127607	99	46	37,6	cyclictest	2239910	-21	kworker/u4:0-rpciod	11:20:38	1
2127607	99	46	2,32	cyclictest	2251778	-21	ssh	10:55:24	1
2127606	99	46	37,7	cyclictest	2143565	-21	gltestperf	08:10:20	0
2127606	99	46	27,16	cyclictest	0	-21	swapper/0	08:50:15	0
2127606	99	45	37,6	cyclictest	2298859	-21	sshd	11:49:33	0
2127607	99	44	37,5	cyclictest	2178793	-21	kworker/u4:4+events_unbound	09:40:03	1
2127607	99	44	37,5	cyclictest	2154954	-21	aten2__	08:55:15	1
2127607	99	44	37,5	cyclictest	2142648	-21	sendmail_mailqu	08:05:33	1
2127607	99	44	36,5	cyclictest	2140690	-21	aten_r7power_cu	08:00:15	1
2127606	99	44	34,7	cyclictest	2127866	-21	aten_r7power_po	07:10:16	0
2127606	99	44	24,6	cyclictest	2128830	-21	kworker/u4:6+rpciod	07:50:15	0
2127607	99	43	37,4	cyclictest	2163826	-21	gltestperf	09:15:20	1
2127607	99	43	36,5	cyclictest	2152625	-21	fschecks_count	08:45:20	1
2127607	99	43	36,5	cyclictest	2149150	-21	sshd	08:30:32	1
2127607	99	43	36,5	cyclictest	2127603	-21	cyclictest	07:35:00	1
2127607	99	43	36,4	cyclictest	0	-21	swapper/1	08:20:00	1
2127607	99	43	34,7	cyclictest	2152269	-21	latency_hist	08:45:01	1
2127607	99	42	37,3	cyclictest	2157290	-21	kworker/u4:3+events_unbound	09:03:38	1
2127607	99	42	35,5	cyclictest	2140408	-21	kworker/u4:16+events_unbound	07:58:28	1
2127607	99	42	35,5	cyclictest	2128462	-21	proc_pri	07:10:39	1
2127607	99	42	33,6	cyclictest	0	-21	swapper/1	10:05:26	1
2127607	99	42	31,7	cyclictest	0	-21	swapper/1	10:00:26	1
2127606	99	42	34,6	cyclictest	2131902	-21	fschecks_time	07:25:19	0
2127607	99	41	33,5	cyclictest	2153992	-21	fschecks_time	08:50:19	1
2127606	99	41	31,7	cyclictest	2135565	-21	aten_r7power_vo	07:40:16	0
2127607	99	40	34,4	cyclictest	0	-21	swapper/1	08:10:29	1
2127607	99	40	33,5	cyclictest	0	-21	swapper/1	08:25:00	1
2127607	99	40	32,5	cyclictest	2136512	-21	192.168.115.60-manager	07:42:34	1
2127607	99	40	32,5	cyclictest	2130162	-21	munin-plugin-st	07:20:00	1
2127607	99	40	32,5	cyclictest	2130162	-21	munin-plugin-st	07:20:00	1
2127606	99	40	32,6	cyclictest	2155165	-21	fschecks_count	08:55:19	0
2127607	99	39	33,4	cyclictest	2131414	-21	systemd	07:23:24	1
2127607	99	39	32,5	cyclictest	2158648	-21	apt-config	09:10:01	1
2127607	99	39	29,7	cyclictest	2150646	-21	switchtime	08:35:36	1
2127606	99	39	30,7	cyclictest	2142198	-21	fschecks_time	08:05:17	0
2127607	99	37	29,6	cyclictest	0	-21	swapper/1	07:35:15	1
2127606	99	33	24,6	cyclictest	0	-21	swapper/0	07:10:01	0
2127607	99	29	19,6	cyclictest	0	-21	swapper/1	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17