OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Mar 30, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1928758	99	90	72,8	cyclictest	1980041	-21	kworker/u4:11+events_unbound	09:35:29	0
1928758	99	89	81,6	cyclictest	2117005	-21	kworker/u4:2+events_unbound	12:15:57	0
1928758	99	89	80,6	cyclictest	2134463	-21	kworker/u4:13+events_unbound	12:30:59	0
1928758	99	87	78,6	cyclictest	2103385	-21	kworker/u4:5+events_unbound	11:55:53	0
1928761	99	85	74,8	cyclictest	1956823	-21	kworker/u4:18+events_unbound	09:15:28	1
1928761	99	85	74,8	cyclictest	1956823	-21	kworker/u4:18+events_unbound	09:15:27	1
1928758	99	84	75,7	cyclictest	2015131	-21	kworker/u4:0+events_unbound	10:35:37	0
1928758	99	83	64,6	cyclictest	1926252	-21	kworker/u4:10+events_unbound	07:50:00	0
1928758	99	81	74,5	cyclictest	2023431	-21	kworker/u4:8+events_unbound	10:50:44	0
1928758	99	79	69,7	cyclictest	2019619	-21	kworker/u4:6+events_unbound	10:20:34	0
1928761	99	78	4,62	cyclictest	2053465	-21	ssh	10:55:36	1
1928761	99	77	67,6	cyclictest	1940211	-21	kworker/u4:7+events_unbound	07:55:01	1
1928758	99	74	66,6	cyclictest	1966384	-21	kworker/u4:2+events_unbound	09:20:01	0
1928758	99	74	66,6	cyclictest	1966384	-21	kworker/u4:2+events_unbound	09:20:01	0
1928758	99	73	65,6	cyclictest	1951714	-21	kworker/u4:10+events_unbound	08:59:59	0
1928761	99	72	62,8	cyclictest	1970956	-21	kworker/u4:5+events_unbound	09:25:27	1
1928761	99	71	63,6	cyclictest	2059218	-21	kworker/u4:5+events_unbound	11:10:46	1
1928758	99	70	55,12	cyclictest	53	-21	kswapd0	11:45:07	0
1928761	99	69	55,6	cyclictest	2006259	-21	kworker/u4:2+events_unbound	10:15:32	1
1928758	99	69	60,7	cyclictest	2072669	-21	kworker/u4:8+events_unbound	11:20:49	0
1928758	99	69	57,5	cyclictest	2068159	-21	kworker/u4:1+events_unbound	11:25:47	0
1928761	99	68	53,6	cyclictest	2103385	-21	kworker/u4:5+events_unbound	12:00:56	1
1928758	99	67	60,5	cyclictest	2063691	-21	kworker/u4:7+events_unbound	11:41:27	0
1928758	99	66	58,6	cyclictest	2077169	-21	kworker/u4:11+events_unbound	11:35:50	0
1928758	99	66	38,8	cyclictest	1970958	-21	kworker/u4:7+events_unbound	09:30:29	0
1928761	99	65	56,6	cyclictest	2072667	-21	kworker/u4:3+events_unbound	11:30:48	1
1928758	99	65	58,5	cyclictest	1989078	-21	kworker/u4:19+events_unbound	10:00:32	0
1928758	99	65	58,5	cyclictest	1926249	-21	kworker/u4:5+events_unbound	07:10:02	0
1928758	99	64	41,21	cyclictest	2061844	-21	gltestperf	11:05:21	0
1928758	99	63	48,5	cyclictest	1945325	-21	kworker/u4:12+events_unbound	08:40:01	0
1928758	99	61	53,6	cyclictest	1953475	-21	fschecks_count	08:45:19	0
1928758	99	60	52,6	cyclictest	1931270	-21	kworker/u4:17+events_unbound	07:20:00	0
1928758	99	60	5,21	cyclictest	1960712	-21	ssh	09:10:35	0
1928761	99	59	51,6	cyclictest	1989079	-21	kworker/u4:20+events_unbound	09:50:32	1
1928761	99	59	49,7	cyclictest	1941484	-21	kworker/u4:2+events_unbound	08:00:09	1
1928758	99	59	51,6	cyclictest	1995158	-21	munin-plugin-st	09:50:01	0
1928758	99	59	39,12	cyclictest	0	-21	swapper/0	12:05:26	0
1928761	99	58	49,7	cyclictest	1989077	-21	kworker/u4:18+events_unbound	10:05:33	1
1928761	99	58	41,13	cyclictest	0	-21	swapper/1	10:40:11	1
1928758	99	58	49,6	cyclictest	2101884	-21	diskmemload	11:50:31	0
1928758	99	58	47,8	cyclictest	53	-21	kswapd0	12:25:01	0
1928761	99	57	50,4	cyclictest	0	-21	swapper/1	11:15:28	1
1928758	99	57	51,4	cyclictest	0	-21	swapper/0	11:15:32	0
1928758	99	55	43,8	cyclictest	1987391	-21	diskmemload	09:40:28	0
1928758	99	55	36,12	cyclictest	0	-21	swapper/0	07:15:01	0
1928761	99	54	46,6	cyclictest	1931270	-21	kworker/u4:17+events_unbound	07:20:02	1
1928761	99	54	46,5	cyclictest	1945324	-21	kworker/u4:6+events_unbound	08:50:24	1
1928758	99	54	46,6	cyclictest	1953014	-21	kworker/u4:14+events_unbound	09:25:04	0
1928758	99	54	29,18	cyclictest	0	-21	swapper/0	10:05:16	0
1928761	99	53	46,5	cyclictest	2092026	-21	sendmail	11:40:01	1
1928761	99	53	44,6	cyclictest	2021446	-21	apt-get	10:20:15	1
1928761	99	53	43,7	cyclictest	2103385	-21	kworker/u4:5-rpciod	11:55:18	1
1928758	99	53	43,7	cyclictest	2083786	-21	fschecks_count	11:30:18	0
1928758	99	53	36,15	cyclictest	1969491	-21	ssh	09:20:25	0
1928761	99	52	44,6	cyclictest	1933835	-21	kworker/u4:1+events_unbound	08:15:13	1
1928761	99	52	44,5	cyclictest	1933508	-21	sendmail_mailqu	07:25:33	1
1928758	99	52	44,6	cyclictest	1931887	-21	gltestperf	07:20:20	0
1928758	99	52	38,10	cyclictest	1935123	-21	kworker/u4:10	07:34:59	0
1928761	99	51	44,5	cyclictest	2065559	-21	ssh	11:10:01	1
1928761	99	51	44,5	cyclictest	2015135	-21	kworker/u4:7+events_unbound	10:45:40	1
1928761	99	51	43,5	cyclictest	2124729	-21	/usr/sbin/munin	12:15:40	1
1928761	99	51	42,7	cyclictest	1942959	-21	systemd	08:05:09	1
1928758	99	51	41,6	cyclictest	0	-21	swapper/0	11:00:01	0
1928761	99	50	44,4	cyclictest	2116027	-21	systemd	12:05:55	1
1928761	99	50	42,5	cyclictest	2035853	-21	/usr/sbin/munin	10:35:37	1
1928761	99	50	41,7	cyclictest	1931324	-21	sendmail	07:20:01	1
1928758	99	50	43,5	cyclictest	2044841	-21	xargs	10:45:38	0
1928758	99	50	29,19	cyclictest	1948367	-21	fschecks_count	08:25:16	0
1928761	99	49	41,6	cyclictest	340	-21	systemd-udevd	08:36:41	1
1928761	99	49	41,5	cyclictest	0	-21	swapper/1	10:00:31	1
1928758	99	49	43,4	cyclictest	1953015	-21	kworker/u4:15+events_unbound	09:00:13	0
1928758	99	49	42,5	cyclictest	256	50	irq/23-42890000.ethernet	10:15:34	0
1928758	99	49	41,6	cyclictest	2061137	-21	ssh	11:05:01	0
1928758	99	49	40,6	cyclictest	1958541	-21	aten_r7power_vo	09:05:16	0
1928758	99	49	33,12	cyclictest	0	-21	swapper/0	12:35:06	0
1928761	99	48	41,5	cyclictest	2049448	-21	unixbench_multi	10:50:41	1
1928758	99	48	41,5	cyclictest	53	-21	kswapd0	11:15:01	0
1928758	99	48	37,8	cyclictest	1996565	-21	timerandwakeup	09:50:38	0
1928761	99	47	39,6	cyclictest	2058378	-21	sd-accept	11:00:43	1
1928761	99	47	39,6	cyclictest	0	-21	swapper/1	09:20:27	1
1928761	99	47	38,6	cyclictest	2145295	-21	sendmail	12:40:00	1
1928761	99	47	38,6	cyclictest	0	-21	swapper/1	08:45:21	1
1928761	99	47	37,7	cyclictest	2129939	-21	kworker/u4:12+rpciod	12:25:18	1
1928761	99	47	36,7	cyclictest	0	-21	swapper/1	09:35:11	1
1928758	99	47	41,4	cyclictest	2119754	-21	ntp_offset	12:10:30	0
1928758	99	47	40,5	cyclictest	1942835	-21	latency_hist	08:05:02	0
1928758	99	47	36,9	cyclictest	2030877	-21	fschecks_count	10:30:19	0
1928758	99	47	33,8	cyclictest	0	-21	swapper/0	10:40:25	0
1928758	99	47	3,20	cyclictest	2133232	-21	ssh	12:25:37	0
1928761	99	46	39,5	cyclictest	1978133	-21	ssh	09:30:19	1
1928758	99	46	39,5	cyclictest	1935104	-21	kworker/u4:9+events_unbound	08:00:02	0
1928758	99	46	35,8	cyclictest	2110977	-21	/usr/sbin/munin	12:00:37	0
1928761	99	45	36,6	cyclictest	0	-21	swapper/1	09:40:29	1
1928761	99	45	36,6	cyclictest	0	-21	swapper/1	09:05:24	1
1928761	99	45	33,8	cyclictest	2083176	-21	cron	11:30:01	1
1928758	99	45	38,5	cyclictest	1943246	-21	fschecks_count	08:05:18	0
1928758	99	45	37,6	cyclictest	2026635	-21	tail	10:25:24	0
1928758	99	45	35,7	cyclictest	1954747	-21	fschecks_count	08:50:18	0
1928758	99	45	35,7	cyclictest	1949637	-21	fschecks_count	08:30:21	0
1928758	99	45	26,16	cyclictest	1989085	-21	kworker/u4:26-rpciod	10:00:00	0
1928761	99	44	37,5	cyclictest	2063691	-21	kworker/u4:7-rpciod	11:40:28	1
1928761	99	44	37,5	cyclictest	2030858	-21	fschecks_count	10:30:18	1
1928761	99	44	37,5	cyclictest	2003905	-21	munin-plugin-st	10:00:00	1
1928761	99	44	37,5	cyclictest	1945325	-21	kworker/u4:12+rpciod	08:40:14	1
1928761	99	44	37,5	cyclictest	1936345	-21	unixbench_singl	07:35:37	1
1928761	99	44	37,5	cyclictest	1926253	-21	kworker/u4:11+events_unbound	07:30:06	1
1928761	99	44	35,6	cyclictest	1992969	-21	sshd	09:46:36	1
1928761	99	44	35,6	cyclictest	1961167	-21	uptime	09:10:41	1
1928761	99	44	34,7	cyclictest	2075110	-21	gltestperf	11:20:20	1
1928758	99	44	33,8	cyclictest	0	-21	swapper/0	08:45:01	0
1928761	99	43	36,5	cyclictest	2027105	-21	proc_pri	10:25:41	1
1928761	99	43	34,6	cyclictest	2128240	-21	fschecks_time	12:20:19	1
1928758	99	43	34,6	cyclictest	1936443	-21	modprobe	07:40:00	0
1928758	99	43	33,8	cyclictest	2013316	-21	fschecks_time	10:10:19	0
1928758	99	43	30,11	cyclictest	1933588	-21	switchtime	07:25:35	0
1928761	99	42	36,4	cyclictest	524	-21	in:imuxsock	12:34:36	1
1928761	99	42	36,4	cyclictest	2119907	-21	proc_pri	12:10:38	1
1928761	99	42	36,4	cyclictest	1944797	-21	ntp_kernel_err	08:10:24	1
1928761	99	42	35,4	cyclictest	0	-21	swapper/1	11:55:00	1
1928761	99	42	34,6	cyclictest	1936738	-21	aten_r7power_vo	07:40:16	1
1928761	99	42	34,5	cyclictest	2097204	-21	gltestperf	11:45:25	1
1928758	99	42	33,7	cyclictest	1936728	-21	aten_r7power_vo	07:40:17	0
1928758	99	42	31,9	cyclictest	1945611	-21	aten_r7power_po	08:15:16	0
1928758	99	42	29,8	cyclictest	1945208	-21	sed	08:10:39	0
1928761	99	41	32,6	cyclictest	0	-21	swapper/1	08:25:13	1
1928761	99	41	32,6	cyclictest	0	-21	swapper/1	08:25:02	1
1928761	99	41	31,8	cyclictest	1929029	-21	aten_r7power_vo	07:10:20	1
1928761	99	41	31,8	cyclictest	1928821	-21	latency_hist	07:10:01	1
1928758	99	41	33,5	cyclictest	1062	-21	lldpd	07:54:24	0
1928758	99	41	19,18	cyclictest	0	-21	swapper/0	08:20:16	0
1928761	99	40	33,4	cyclictest	0	-21	swapper/1	07:45:39	1
1928761	99	40	31,6	cyclictest	2013700	-21	collect2	10:10:29	1
1928761	99	40	27,7	cyclictest	27	1	ktimers/1	07:55:15	1
1928761	99	39	32,5	cyclictest	1956502	-21	sendmail_mailst	08:55:35	1
1928761	99	38	28,6	cyclictest	0	-21	swapper/1	08:35:02	1
1928761	99	37	29,5	cyclictest	0	-21	swapper/1	09:00:08	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17