OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Sat May 30, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1957320	99	89	80,7	cyclictest	2078600	-21	kworker/u4:3+events_unbound	11:00:01	1
1957318	99	85	48,33	cyclictest	1957315	-21	cyclictest	11:09:12	0
1957318	99	77	68,6	cyclictest	2065177	-21	kworker/u4:3+events_unbound	10:41:02	0
1957320	99	76	37,36	cyclictest	1073	-21	snmpd	12:05:10	1
1957318	99	76	69,5	cyclictest	1959816	-21	kworker/u4:10+events_unbound	07:30:00	0
1957318	99	76	69,5	cyclictest	1959816	-21	kworker/u4:10+events_unbound	07:29:59	0
1957320	99	74	41,29	cyclictest	1971443	-21	kworker/u4:17	08:05:00	1
1957320	99	73	58,11	cyclictest	1956044	-21	kworker/u4:9+events_unbound	07:10:14	1
1957320	99	73	39,30	cyclictest	0	-21	swapper/1	10:00:54	1
1957320	99	72	39,30	cyclictest	2129499	-21	/usr/sbin/munin	11:50:23	1
1957320	99	71	3,25	cyclictest	2107006	-21	apt-get	11:25:17	1
1957320	99	71	1,31	cyclictest	2147004	-21	ntpq	12:10:26	1
1957320	99	70	33,33	cyclictest	0	-21	swapper/1	12:15:39	1
1957318	99	70	62,6	cyclictest	2034593	-21	kworker/u4:10+events_unbound	10:25:59	0
1957318	99	70	55,6	cyclictest	2034590	-21	kworker/u4:0+events_unbound	10:31:01	0
1957320	99	69	42,25	cyclictest	2161120	-21	sshd	12:26:16	1
1957320	99	69	35,31	cyclictest	2106769	-21	latency_hist	11:25:01	1
1957320	99	69	33,34	cyclictest	0	-21	swapper/1	11:45:35	1
1957320	99	68	37,28	cyclictest	2089169	-21	munin-plugin-st	11:05:00	1
1957320	99	68	32,33	cyclictest	0	-21	swapper/1	10:40:33	1
1957318	99	68	60,6	cyclictest	2091990	-21	kworker/u4:13+events_unbound	11:11:07	0
1957320	99	67	34,30	cyclictest	2014893	-21	aten_r7power_cu	09:40:15	1
1957320	99	66	31,32	cyclictest	0	-21	swapper/1	12:20:31	1
1957320	99	66	30,34	cyclictest	2011604	-21	timerwakeupswit	09:35:41	1
1957318	99	66	60,4	cyclictest	2030079	-21	kworker/u4:4+events_unbound	10:00:56	0
1957320	99	65	34,29	cyclictest	2062838	-21	kworker/u4:6	10:34:59	1
1957320	99	65	29,8	cyclictest	2111887	-21	ssh	11:30:22	1
1957320	99	65	28,7	cyclictest	0	-21	swapper/1	12:35:15	1
1957320	99	65	28,5	cyclictest	0	-21	swapper/1	09:20:37	1
1957320	99	64	32,5	cyclictest	1965986	-21	sendmail_mailqu	07:40:34	1
1957320	99	64	31,30	cyclictest	0	-21	swapper/1	10:20:31	1
1957320	99	63	34,4	cyclictest	1996986	-21	munin-run	09:20:01	1
1957320	99	63	33,5	cyclictest	1967973	-21	df_abs	07:50:20	1
1957320	99	63	33,4	cyclictest	2019352	-21	wget	09:45:16	1
1957320	99	63	31,7	cyclictest	0	-21	swapper/1	10:25:23	1
1957320	99	63	29,6	cyclictest	0	-21	swapper/1	08:10:35	1
1957320	99	63	27,7	cyclictest	0	-21	swapper/1	10:15:23	1
1957318	99	63	54,6	cyclictest	1958544	-21	kworker/u4:5+events_unbound	09:40:53	0
1957320	99	62	50,8	cyclictest	1959817	-21	kworker/u4:11+events_unbound	07:20:14	1
1957320	99	62	29,6	cyclictest	0	-21	swapper/1	07:15:19	1
1957320	99	62	27,8	cyclictest	1988148	-21	diskmemload	10:08:41	1
1957318	99	62	53,7	cyclictest	2161751	-21	kworker/u4:2+events_unbound	12:31:17	0
1957318	99	62	53,7	cyclictest	2161751	-21	kworker/u4:2+events_unbound	12:31:16	0
1957318	99	62	53,6	cyclictest	1981649	-21	kworker/u4:8+events_unbound	08:45:47	0
1957320	99	61	27,6	cyclictest	0	-21	swapper/1	09:58:08	1
1957320	99	61	27,6	cyclictest	0	-21	swapper/1	08:35:19	1
1957320	99	61	26,7	cyclictest	0	-21	swapper/1	09:05:29	1
1957320	99	61	26,7	cyclictest	0	-21	swapper/1	08:20:40	1
1957320	99	61	26,6	cyclictest	0	-21	swapper/1	11:35:20	1
1957318	99	61	51,7	cyclictest	2003387	-21	kworker/u4:9+events_unbound	09:50:13	0
1957320	99	59	52,5	cyclictest	2121270	-21	timerandwakeup	11:40:40	1
1957320	99	59	29,5	cyclictest	0	-21	swapper/1	08:50:28	1
1957320	99	59	28,6	cyclictest	0	-21	swapper/1	08:45:21	1
1957320	99	59	26,7	cyclictest	0	-21	swapper/1	09:30:40	1
1957318	99	59	51,6	cyclictest	2130688	-21	kworker/u4:12+events_unbound	12:06:13	0
1957320	99	58	4,16	cyclictest	2098569	-21	tune2fs	11:15:20	1
1957318	99	58	50,6	cyclictest	2039055	-21	kworker/u4:3+events_unbound	10:15:57	0
1957318	99	58	36,20	cyclictest	1960346	-21	fschecks_time	07:20:20	0
1957320	99	57	51,4	cyclictest	0	-21	swapper/1	11:55:26	1
1957318	99	57	48,7	cyclictest	1958546	-21	kworker/u4:8+events_unbound	08:00:01	0
1957318	99	57	47,8	cyclictest	1998718	-21	systemd	09:20:49	0
1957320	99	56	28,5	cyclictest	2065179	-21	kworker/u4:5-rpciod	10:48:03	1
1957320	99	56	23,7	cyclictest	0	-21	swapper/1	07:30:41	1
1957318	99	56	49,5	cyclictest	1979078	-21	kworker/u4:2+events_unbound	09:30:00	0
1957318	99	55	40,12	cyclictest	0	-21	swapper/0	11:15:13	0
1957318	99	54	41,10	cyclictest	2081044	-21	fschecks_count	10:55:20	0
1957320	99	53	24,6	cyclictest	2041908	-21	ntp_kernel_pll_	10:10:29	1
1957318	99	53	45,6	cyclictest	2042151	-21	/usr/sbin/munin	10:10:37	0
1957318	99	53	45,6	cyclictest	2030079	-21	kthreadd	09:56:53	0
1957318	99	53	42,7	cyclictest	2138554	-21	find	12:00:35	0
1957320	99	52	43,7	cyclictest	2094465	-21	/usr/sbin/munin	11:10:23	1
1957320	99	52	39,11	cyclictest	1981395	-21	switchtime	08:40:35	1
1957318	99	52	41,8	cyclictest	2130839	-21	ssh	11:51:41	0
1957320	99	51	44,5	cyclictest	1977470	-21	sendmail_mailqu	08:25:34	1
1957320	99	51	41,6	cyclictest	0	-21	swapper/1	09:00:40	1
1957318	99	51	29,6	cyclictest	2007828	-21	kworker/u4:10+events_unbound	09:45:53	0
1957320	99	50	43,5	cyclictest	2001785	-21	aten_r7power_en	09:25:15	1
1957318	99	50	43,5	cyclictest	2072202	-21	/usr/sbin/munin	10:45:19	0
1957318	99	50	42,5	cyclictest	2124862	-21	fschecks_time	11:45:17	0
1957318	99	50	41,6	cyclictest	1979078	-21	kworker/u4:2+events_unbound	09:30:52	0
1957318	99	50	40,7	cyclictest	1954808	-21	kworker/u4:3+events_unbound	07:14:59	0
1957318	99	50	29,17	cyclictest	0	-21	swapper/0	12:20:38	0
1957318	99	50	27,20	cyclictest	1983496	-21	fschecks_time	08:50:24	0
1957318	99	50	21,24	cyclictest	2139572	-21	kworker/u4:15+rpciod	12:10:15	0
1957320	99	49	41,6	cyclictest	1976540	-21	kworker/u4:20+events_unbound	08:55:46	1
1957318	99	49	39,8	cyclictest	1988099	-21	systemd	09:05:47	0
1957320	99	48	40,5	cyclictest	1970255	-21	latency_hist	08:00:00	1
1957320	99	48	37,9	cyclictest	2024168	-21	kernelversion	09:50:23	1
1957318	99	48	40,6	cyclictest	2065180	-21	kworker/u4:7+events_unbound	10:40:01	0
1957318	99	48	38,7	cyclictest	2106723	-21	dpkg	11:25:01	0
1957318	99	48	38,7	cyclictest	1980351	-21	kworker/u4:3+events_unbound	08:40:47	0
1957318	99	48	37,8	cyclictest	1993107	-21	aten_r7power_po	09:15:22	0
1957318	99	48	29,5	cyclictest	2047981	-21	kworker/u4:12+rpciod	10:22:30	0
1957320	99	47	38,7	cyclictest	2076397	-21	aten_r7power_en	10:50:17	1
1957320	99	47	37,7	cyclictest	2078604	-21	kworker/u4:7+events_unbound	11:06:06	1
1957318	99	47	38,6	cyclictest	0	-21	swapper/0	08:05:36	0
1957318	99	47	37,8	cyclictest	2150742	-21	cut	12:15:14	0
1957318	99	47	37,8	cyclictest	1976377	-21	timerwakeupswit	08:20:38	0
1957318	99	47	37,7	cyclictest	2160483	-21	switchtime	12:25:40	0
1957318	99	47	37,7	cyclictest	2117962	-21	kworker/u4:0+events_unbound	11:41:12	0
1957318	99	47	35,9	cyclictest	2133383	-21	aten_r7power_vo	11:55:16	0
1957320	99	46	39,5	cyclictest	1957315	-21	cyclictest	10:35:24	1
1957320	99	46	35,8	cyclictest	0	-21	swapper/1	07:45:20	1
1957318	99	46	4,30	cyclictest	2011176	-21	ssh	09:35:29	0
1957318	99	46	39,5	cyclictest	2115759	-21	/usr/sbin/munin	11:35:16	0
1957318	99	46	39,5	cyclictest	2037780	-21	find	10:05:38	0
1957318	99	46	38,6	cyclictest	1973962	-21	kworker/u4:15+events_unbound	08:15:41	0
1957318	99	46	37,6	cyclictest	1980351	-21	kworker/u4:3-rpciod	09:10:18	0
1957318	99	46	36,8	cyclictest	1966646	-21	aten_r7power_vo	07:45:16	0
1957318	99	45	37,6	cyclictest	2168758	-21	netstat	12:35:23	0
1957318	99	45	37,5	cyclictest	1978266	-21	fschecks_count	08:30:18	0
1957318	99	45	37,5	cyclictest	1978266	-21	fschecks_count	08:30:17	0
1957318	99	45	35,8	cyclictest	53	-21	kswapd0	11:25:07	0
1957318	99	45	35,6	cyclictest	2115416	-21	kworker/u4:4	11:34:59	0
1957318	99	45	33,8	cyclictest	2085148	-21	aten_r7power_cu	11:00:16	0
1957318	99	45	23,19	cyclictest	1943547	-21	kworker/u4:13-rpciod	07:55:00	0
1957320	99	44	37,5	cyclictest	2163809	-21	aten2__	12:30:16	1
1957320	99	44	37,5	cyclictest	2163809	-21	aten2__	12:30:15	1
1957320	99	44	35,7	cyclictest	317	-21	systemd-journal	12:01:13	1
1957320	99	44	33,8	cyclictest	1971990	-21	gltestperf	08:05:22	1
1957318	99	44	34,6	cyclictest	0	-21	swapper/0	08:10:38	0
1957320	99	43	36,5	cyclictest	1964187	-21	fschecks_count	07:35:18	1
1957320	99	43	34,7	cyclictest	1957376	-21	latency_hist	07:10:01	1
1957318	99	43	37,4	cyclictest	1970373	-21	aten2__	08:00:16	0
1957318	99	43	36,4	cyclictest	1964218	-21	fschecks_count	07:35:17	0
1957318	99	43	35,5	cyclictest	1965509	-21	fschecks_count	07:40:18	0
1957320	99	42	34,6	cyclictest	1961516	-21	sed	07:25:17	1
1957320	99	42	34,6	cyclictest	1961516	-21	sed	07:25:16	1
1957320	99	42	32,7	cyclictest	1992659	-21	latency_hist	09:15:02	1
1957318	99	42	34,6	cyclictest	1984869	-21	gltestperf	08:55:19	0
1957318	99	42	32,6	cyclictest	1986505	-21	sendmail_mailqu	09:00:40	0
1957318	99	42	31,8	cyclictest	1979514	-21	fschecks_count	08:35:18	0
1957318	99	42	27,13	cyclictest	1963006	-21	fschecks_time	07:30:25	0
1957318	99	41	32,6	cyclictest	0	-21	swapper/0	10:50:17	0
1957320	99	40	33,5	cyclictest	1975028	-21	timerandwakeup	08:15:37	1
1957318	99	40	33,4	cyclictest	0	-21	swapper/0	07:15:12	0
1957318	99	39	31,4	cyclictest	1976540	-21	kworker/u4:20-rpciod	08:25:19	0
1957320	99	38	30,6	cyclictest	1959816	-21	kworker/u4:10+events_unbound	08:30:41	1
1957320	99	38	30,6	cyclictest	1959816	-21	kworker/u4:10+events_unbound	08:30:41	1
1957318	99	32	21,7	cyclictest	1957379	-21	ls	07:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17