OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Wed Feb 25, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1900605	99	121	105,7	cyclictest	2007711	-21	kworker/u4:11+events_unbound	10:39:37	0
1900605	99	117	109,6	cyclictest	1892035	-21	kworker/u4:2+events_unbound	07:13:58	0
1900606	99	105	97,6	cyclictest	1885447	-21	kworker/u4:1+events_unbound	07:29:02	1
1900605	99	101	93,6	cyclictest	1955246	-21	kworker/u4:6+events_unbound	09:54:29	0
1900605	99	97	90,5	cyclictest	1906937	-21	kworker/u4:0+events_unbound	07:49:07	0
1900606	99	93	85,6	cyclictest	1901823	-21	kworker/u4:11+events_unbound	07:24:01	1
1900606	99	88	80,6	cyclictest	1912041	-21	kworker/u4:16+events_unbound	07:54:07	1
1900605	99	87	80,5	cyclictest	1838727	-21	kworker/u4:6+events_unbound	08:04:11	0
1900605	99	83	76,5	cyclictest	1918421	-21	kworker/u4:2+events_unbound	08:39:16	0
1900606	99	82	74,6	cyclictest	1923629	-21	kworker/u4:18+events_unbound	08:54:18	1
1900605	99	82	75,5	cyclictest	1919733	-21	kworker/u4:12+events_unbound	08:24:15	0
1900606	99	79	74,3	cyclictest	2007077	-21	kworker/u4:9+events_unbound	10:38:41	1
1900605	99	77	66,5	cyclictest	1922358	-21	kworker/u4:15+events_unbound	08:44:16	0
1900605	99	76	69,5	cyclictest	1918422	-21	kworker/u4:3+events_unbound	08:19:14	0
1900606	99	72	63,6	cyclictest	1886753	-21	kworker/u4:18+events_unbound	07:18:59	1
1900606	99	71	64,5	cyclictest	1918423	-21	kworker/u4:5+events_unbound	08:30:02	1
1900606	99	68	61,5	cyclictest	2002688	-21	kworker/u4:7+events_unbound	10:49:40	1
1900605	99	63	52,7	cyclictest	2082102	-21	ssh	12:05:13	0
1900605	99	62	55,5	cyclictest	1969190	-21	kworker/u4:16+events_unbound	10:05:56	0
1900606	99	61	48,9	cyclictest	1944585	-21	grep	09:25:01	1
1900605	99	61	49,6	cyclictest	2007711	-21	kworker/u4:11+events_unbound	11:01:43	0
1900605	99	60	52,6	cyclictest	2015925	-21	kworker/u4:17+events_unbound	10:51:43	0
1900605	99	60	12,25	cyclictest	1900578	-21	munin-run	07:10:01	0
1900606	99	59	54,3	cyclictest	2101207	-21	kworker/u4:3+events_unbound	12:30:00	1
1900606	99	59	52,5	cyclictest	1642855	-21	kworker/u4:5+events_unbound	07:44:03	1
1900606	99	59	46,6	cyclictest	1919733	-21	kworker/u4:12+events_unbound	09:05:44	1
1900605	99	59	46,6	cyclictest	1969190	-21	kworker/u4:16+events_unbound	09:59:59	0
1900606	99	58	47,8	cyclictest	2010460	-21	ps	10:40:35	1
1900606	99	58	45,6	cyclictest	1914609	-21	kworker/u4:5+events_unbound	08:10:03	1
1900605	99	58	46,6	cyclictest	1919731	-21	kworker/u4:9+events_unbound	08:57:44	0
1900606	99	57	49,6	cyclictest	2054470	-21	kworker/u4:14+events_unbound	11:33:00	1
1900606	99	57	48,7	cyclictest	2026326	-21	systemd	10:59:41	1
1900606	99	56	49,5	cyclictest	2024700	-21	kworker/u4:4+events_unbound	11:23:01	1
1900605	99	56	37,17	cyclictest	2049284	-21	timerandwakeup	11:25:38	0
1900606	99	55	47,6	cyclictest	2036266	-21	/usr/sbin/munin	11:10:37	1
1900606	99	55	44,9	cyclictest	1981512	-21	kworker/u4:6+events_unbound	10:10:04	1
1900606	99	55	42,6	cyclictest	1918420	-21	kworker/u4:1+events_unbound	08:38:02	1
1900605	99	55	48,5	cyclictest	1985766	-21	kworker/u4:0+events_unbound	10:13:00	0
1900605	99	55	47,6	cyclictest	2053520	-21	/usr/sbin/munin	11:30:44	0
1900605	99	55	43,6	cyclictest	1915880	-21	kworker/u4:8+events_unbound	08:09:01	0
1900606	99	54	47,5	cyclictest	1912609	-21	gltestperf	07:55:19	1
1900605	99	54	47,5	cyclictest	2058796	-21	kworker/u4:1+events_unbound	11:42:00	0
1900605	99	54	47,5	cyclictest	1977422	-21	kworker/u4:3+events_unbound	10:03:44	0
1900605	99	54	44,4	cyclictest	1918424	-21	kworker/u4:6+events_unbound	08:32:02	0
1900605	99	54	43,5	cyclictest	1901821	-21	kworker/u4:8+events_unbound	07:25:42	0
1900605	99	54	39,13	cyclictest	1918420	-21	kworker/u4:1+events_unbound	09:10:01	0
1900605	99	54	32,19	cyclictest	1990174	-21	kworker/u4:4-rpciod	10:25:18	0
1900605	99	54	32,19	cyclictest	1990174	-21	kworker/u4:4-rpciod	10:25:18	0
1900606	99	53	44,6	cyclictest	0	-21	swapper/1	12:10:12	1
1900606	99	53	43,7	cyclictest	1951445	-21	kworker/u4:4-rpciod	09:50:22	1
1900606	99	53	42,7	cyclictest	2086033	-21	kworker/u4:3	12:10:01	1
1900605	99	53	46,5	cyclictest	1900601	-21	cyclictest	12:00:34	0
1900605	99	53	45,6	cyclictest	1918422	-21	kworker/u4:3+events_unbound	08:25:44	0
1900605	99	53	45,6	cyclictest	1918422	-21	kworker/u4:3+events_unbound	08:25:43	0
1900605	99	53	39,6	cyclictest	1985775	-21	kworker/u4:13+events_unbound	10:20:00	0
1900605	99	53	34,15	cyclictest	54	-21	kswapd0	11:05:11	0
1900606	99	52	45,4	cyclictest	0	-21	swapper/1	10:25:01	1
1900606	99	52	45,4	cyclictest	0	-21	swapper/1	09:35:26	1
1900606	99	52	44,6	cyclictest	2076002	-21	kworker/u4:12+events_unbound	12:17:00	1
1900606	99	52	44,6	cyclictest	1919733	-21	kworker/u4:12+events_unbound	08:21:43	1
1900605	99	52	45,5	cyclictest	1903092	-21	kworker/u4:12+events_unbound	07:59:01	0
1900605	99	52	44,5	cyclictest	2066450	-21	unixbench_multi	11:45:41	0
1900605	99	52	43,6	cyclictest	2002111	-21	sed	10:30:40	0
1900605	99	52	42,4	cyclictest	1914605	-21	kworker/u4:0+events_unbound	08:46:02	0
1900606	99	51	45,4	cyclictest	2069485	-21	aten_r7power_cu	11:50:15	1
1900605	99	51	44,5	cyclictest	2084610	-21	kworker/u4:0+events_unbound	12:18:43	0
1900605	99	51	44,5	cyclictest	2076000	-21	kworker/u4:11+events_unbound	12:34:43	0
1900605	99	51	44,5	cyclictest	1993181	-21	/usr/sbin/munin	10:20:39	0
1900605	99	51	41,8	cyclictest	1901823	-21	kworker/u4:11+events_unbound	07:39:03	0
1900605	99	51	41,8	cyclictest	1901823	-21	kworker/u4:11+events_unbound	07:39:03	0
1900605	99	51	41,7	cyclictest	2010334	-21	sh	10:40:30	0
1900605	99	51	41,4	cyclictest	1885447	-21	kworker/u4:1+events_unbound	07:30:03	0
1900606	99	50	43,5	cyclictest	1975202	-21	latency_hist	10:00:02	1
1900606	99	50	42,6	cyclictest	1989228	-21	unixbench_singl	10:15:44	1
1900606	99	50	42,5	cyclictest	0	-21	swapper/1	12:35:39	1
1900606	99	50	42,5	cyclictest	0	-21	swapper/1	11:15:35	1
1900605	99	50	43,5	cyclictest	2105468	-21	kworker/u4:7+events_unbound	12:40:00	0
1900605	99	50	43,5	cyclictest	1962554	-21	df_abs	09:45:18	0
1900605	99	50	43,5	cyclictest	1914605	-21	kworker/u4:0+events_unbound	08:50:05	0
1900605	99	50	42,6	cyclictest	1928991	-21	aten_r7power_cu	09:00:17	0
1900605	99	50	41,7	cyclictest	2099370	-21	fschecks_count	12:25:20	0
1900605	99	50	41,7	cyclictest	2058805	-21	kworker/u4:11+events_unbound	11:39:48	0
1900605	99	50	38,6	cyclictest	1915880	-21	kworker/u4:8+events_unbound	08:11:01	0
1900606	99	49	42,5	cyclictest	1915551	-21	sendmail_mailqu	08:05:36	1
1900606	99	49	42,5	cyclictest	1886753	-21	kworker/u4:18+events_unbound	07:11:01	1
1900606	99	49	41,6	cyclictest	2033456	-21	kworker/u4:2+events_unbound	11:09:44	1
1900606	99	49	14,19	cyclictest	0	-21	swapper/1	10:25:27	1
1900606	99	49	14,19	cyclictest	0	-21	swapper/1	10:25:27	1
1900605	99	49	42,5	cyclictest	1954629	-21	switchtime	09:35:38	0
1900605	99	49	41,6	cyclictest	1903417	-21	aten_r7power_po	07:20:17	0
1900605	99	49	40,7	cyclictest	1948990	-21	latency_hist	09:30:02	0
1900605	99	49	31,16	cyclictest	1940518	-21	aten_r7power_en	09:20:16	0
1900606	99	48	42,4	cyclictest	2050135	-21	kworker/u4:9+events_unbound	11:36:00	1
1900606	99	48	41,5	cyclictest	1938068	-21	kworker/u4:2+events_unbound	09:33:43	1
1900606	99	48	41,5	cyclictest	1923629	-21	kworker/u4:18+events_unbound	08:57:01	1
1900606	99	48	40,5	cyclictest	0	-21	swapper/1	10:05:32	1
1900606	99	48	40,5	cyclictest	0	-21	swapper/1	09:40:33	1
1900606	99	48	37,5	cyclictest	1838727	-21	kworker/u4:6+events_unbound	08:00:42	1
1900606	99	48	23,12	cyclictest	0	-21	swapper/1	09:10:27	1
1900606	99	48	23,12	cyclictest	0	-21	swapper/1	09:10:26	1
1900605	99	48	42,4	cyclictest	2032833	-21	kworker/u4:0+events_unbound	11:17:01	0
1900605	99	48	42,4	cyclictest	2007711	-21	kworker/u4:11+events_unbound	10:55:03	0
1900605	99	48	41,5	cyclictest	2086611	-21	fschecks_count	12:10:18	0
1900605	99	48	41,5	cyclictest	2024700	-21	kworker/u4:4+events_unbound	11:11:13	0
1900605	99	48	41,5	cyclictest	1940131	-21	lockfile-remove	09:20:01	0
1900605	99	48	41,5	cyclictest	1642858	-21	kworker/u4:9+events_unbound	07:43:59	0
1900605	99	48	40,6	cyclictest	1932859	-21	unixbench-2d	09:10:41	0
1900605	99	48	40,6	cyclictest	1932859	-21	unixbench-2d	09:10:41	0
1900605	99	48	40,5	cyclictest	2070661	-21	unixbench_multi	11:50:40	0
1900605	99	48	39,7	cyclictest	2095195	-21	fschecks_count	12:20:20	0
1900606	99	47	41,4	cyclictest	2103785	-21	if_eth0	12:30:21	1
1900606	99	47	40,5	cyclictest	2061375	-21	gltestperf	11:40:20	1
1900606	99	47	40,5	cyclictest	0	-21	swapper/1	12:20:19	1
1900606	99	47	36,9	cyclictest	1910811	-21	munin-run	07:50:00	1
1900606	99	47	22,22	cyclictest	27	1	ktimers/1	11:00:10	1
1900605	99	47	38,7	cyclictest	2015042	-21	timerwakeupswit	10:45:39	0
1900605	99	47	37,8	cyclictest	2044095	-21	cpu	11:20:15	0
1900605	99	47	36,9	cyclictest	1958135	-21	cpu	09:40:19	0
1900605	99	47	15,8	cyclictest	0	-21	swapper/0	09:30:19	0
1900606	99	46	39,5	cyclictest	0	-21	swapper/1	12:00:28	1
1900606	99	46	36,8	cyclictest	2073802	-21	cpu	11:55:16	1
1900606	99	46	35,8	cyclictest	0	-21	swapper/1	10:30:37	1
1900606	99	46	26,14	cyclictest	1924950	-21	modprobe	08:44:59	1
1900606	99	45	38,5	cyclictest	2019113	-21	proc_pri	10:50:37	1
1900606	99	45	38,5	cyclictest	1936756	-21	ld	09:15:31	1
1900606	99	45	37,6	cyclictest	1920722	-21	proc_pri	08:25:40	1
1900606	99	45	37,6	cyclictest	1920722	-21	proc_pri	08:25:39	1
1900606	99	45	32,6	cyclictest	1906937	-21	kworker/u4:0+events_unbound	07:36:42	1
1900606	99	45	32,6	cyclictest	1906937	-21	kworker/u4:0+events_unbound	07:36:42	1
1900605	99	45	38,5	cyclictest	2074134	-21	/usr/sbin/munin	11:55:20	0
1900606	99	44	37,5	cyclictest	2065692	-21	gltestperf	11:45:22	1
1900606	99	44	29,6	cyclictest	1919733	-21	kworker/u4:12+events_unbound	08:46:41	1
1900606	99	43	36,5	cyclictest	0	-21	swapper/1	11:25:33	1
1900606	99	43	36,5	cyclictest	0	-21	swapper/1	09:45:32	1
1900606	99	43	22,18	cyclictest	27	1	ktimers/1	10:01:38	1
1900605	99	43	35,6	cyclictest	1902098	-21	aten_r7power_en	07:15:17	0
1900606	99	42	36,4	cyclictest	1917487	-21	aten_r7power_vo	08:15:16	1
1900606	99	42	36,4	cyclictest	0	-21	swapper/1	09:25:42	1
1900606	99	42	12,16	cyclictest	26	1	rcuc/1	09:00:13	1
1900605	99	42	35,5	cyclictest	1911885	-21	timerwakeupswit	07:50:37	0
1900606	99	41	35,4	cyclictest	1906301	-21	gltestperf	07:30:22	1
1900606	99	29	22,5	cyclictest	1900711	-21	cat	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17