OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Tue Dec 30, 2025 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1877987	99	127	117,7	cyclictest	1936695	-21	kworker/u4:9+events_unbound	22:02:53	1
1877987	99	126	119,5	cyclictest	1979012	-21	kworker/u4:11+events_unbound	22:43:00	1
1877987	99	96	86,7	cyclictest	1905883	-21	kworker/u4:1+events_unbound	21:32:48	1
1877987	99	95	83,5	cyclictest	1949561	-21	kworker/u4:3+events_unbound	22:12:54	1
1877986	99	93	87,4	cyclictest	54	-21	kswapd0	00:30:08	0
1877986	99	91	83,4	cyclictest	54	-21	kswapd0	23:00:08	0
1877987	99	90	82,6	cyclictest	1995526	-21	kworker/u4:2+events_unbound	22:53:02	1
1877987	99	90	82,6	cyclictest	1995526	-21	kworker/u4:2+events_unbound	22:53:02	1
1877987	99	83	75,6	cyclictest	2029089	-21	kworker/u4:0+events_unbound	23:55:03	1
1877987	99	81	72,6	cyclictest	1903369	-21	kworker/u4:10+events_unbound	21:12:43	1
1877986	99	79	69,8	cyclictest	54	-21	kswapd0	21:35:15	0
1877986	99	79	68,7	cyclictest	0	-21	swapper/0	23:55:36	0
1877987	99	77	69,6	cyclictest	2050386	-21	kworker/u4:6+events_unbound	00:05:13	1
1877987	99	77	68,5	cyclictest	1979013	-21	kworker/u4:12+events_unbound	22:40:00	1
1877987	99	76	69,5	cyclictest	2012660	-21	kworker/u4:11+events_unbound	23:18:06	1
1877986	99	75	25,42	cyclictest	0	-21	swapper/0	21:00:10	0
1877986	99	74	63,8	cyclictest	1877984	-21	cyclictest	00:22:29	0
1877986	99	73	54,12	cyclictest	0	-21	swapper/0	21:50:11	0
1877987	99	72	65,5	cyclictest	1940984	-21	kworker/u4:12+events_unbound	21:57:52	1
1877986	99	72	53,13	cyclictest	1879222	-21	modprobe	19:15:01	0
1877987	99	71	63,6	cyclictest	1888048	-21	kworker/u4:7+events_unbound	20:32:39	1
1877986	99	70	4,57	cyclictest	1964622	-21	ssh	22:15:23	0
1877987	99	68	61,5	cyclictest	2058949	-21	kworker/u4:1+events_unbound	00:30:14	1
1877987	99	68	61,5	cyclictest	1888045	-21	kworker/u4:0+events_unbound	20:00:02	1
1877987	99	68	53,5	cyclictest	1961851	-21	kworker/u4:0+events_unbound	22:22:56	1
1877986	99	68	52,12	cyclictest	2044343	-21	fschecks_count	23:50:20	0
1877987	99	67	49,6	cyclictest	1932413	-21	kworker/u4:8+events_unbound	21:40:02	1
1877986	99	67	1,64	cyclictest	0	-21	swapper/0	22:50:36	0
1877986	99	67	1,64	cyclictest	0	-21	swapper/0	22:50:36	0
1877986	99	66	54,9	cyclictest	1923759	-21	kworker/u4:6+events_unbound	21:27:45	0
1877987	99	65	47,5	cyclictest	1949561	-21	kworker/u4:3+events_unbound	22:15:04	1
1877986	99	65	5,24	cyclictest	1932413	-21	kworker/u4:8+rpciod	21:55:30	0
1877987	99	64	50,9	cyclictest	37	-21	kcompactd0	00:24:48	1
1877987	99	63	58,4	cyclictest	2012660	-21	kworker/u4:11+events_unbound	23:15:01	1
1877987	99	62	54,6	cyclictest	2050386	-21	kworker/u4:6+events_unbound	00:03:13	1
1877986	99	62	49,8	cyclictest	1885923	-21	df	19:40:16	0
1877986	99	62	26,13	cyclictest	1888213	-21	sed	19:50:01	0
1877987	99	61	54,5	cyclictest	1812918	-21	kworker/u4:12+events_unbound	20:45:02	1
1877986	99	61	51,6	cyclictest	2015895	-21	/usr/sbin/munin	23:15:42	0
1877986	99	61	50,8	cyclictest	388	-21	dbus-daemon	23:38:06	0
1877986	99	61	45,9	cyclictest	0	-21	swapper/0	22:40:25	0
1877987	99	60	52,6	cyclictest	2071141	-21	kworker/u4:13+events_unbound	00:25:15	1
1877987	99	60	51,7	cyclictest	1877984	-21	cyclictest	21:00:01	1
1877986	99	60	16,16	cyclictest	1960542	-21	ntpq	22:10:29	0
1877987	99	58	52,4	cyclictest	0	-21	swapper/1	23:00:16	1
1877987	99	58	51,5	cyclictest	1961851	-21	kworker/u4:0+events_unbound	22:27:57	1
1877987	99	58	50,6	cyclictest	2019755	-21	/usr/sbin/munin	23:20:37	1
1877987	99	57	50,5	cyclictest	2058951	-21	kworker/u4:4+events_unbound	00:15:03	1
1877986	99	57	5,19	cyclictest	1993246	-21	modprobe	22:50:00	0
1877986	99	57	47,6	cyclictest	1936693	-21	kworker/u4:1+events_unbound	21:45:02	0
1877986	99	57	43,7	cyclictest	0	-21	swapper/0	22:00:35	0
1877987	99	56	38,6	cyclictest	2037669	-21	kworker/u4:6+events_unbound	23:50:48	1
1877987	99	56	38,5	cyclictest	2058951	-21	kworker/u4:4+events_unbound	00:13:52	1
1877986	99	56	4,43	cyclictest	1890847	-21	/usr/sbin/munin	20:00:11	0
1877986	99	56	18,11	cyclictest	1968220	-21	apt-get	22:20:16	0
1877987	99	55	47,6	cyclictest	1913747	-21	/usr/sbin/munin	21:15:23	1
1877987	99	55	46,6	cyclictest	0	-21	swapper/1	23:40:35	1
1877987	99	55	4,37	cyclictest	1930345	-21	ssh	21:35:23	1
1877986	99	55	8,27	cyclictest	2035576	-21	apt-get	23:40:12	0
1877986	99	55	47,5	cyclictest	2028131	-21	/usr/sbin/munin	23:30:39	0
1877986	99	55	44,6	cyclictest	0	-21	swapper/0	20:30:29	0
1877986	99	55	43,7	cyclictest	1972763	-21	/usr/sbin/munin	22:25:21	0
1877986	99	55	39,9	cyclictest	1883019	-21	modprobe	19:30:01	0
1877986	99	55	18,14	cyclictest	1888775	-21	nfs4_client	19:50:22	0
1877986	99	55	16,12	cyclictest	2006881	-21	ntpq	23:05:29	0
1877986	99	55	13,21	cyclictest	2043695	-21	cron	23:50:01	0
1877987	99	54	42,7	cyclictest	0	-21	swapper/1	23:25:23	1
1877987	99	54	42,7	cyclictest	0	-21	swapper/1	23:25:23	1
1877986	99	54	43,9	cyclictest	1997875	-21	aten_r7power_po	22:55:17	0
1877986	99	54	12,19	cyclictest	1908543	-21	diskmemload	23:20:23	0
1877987	99	53	46,5	cyclictest	1888048	-21	kworker/u4:7+events_unbound	20:05:00	1
1877987	99	53	37,7	cyclictest	1866958	-21	kworker/u4:14+events_unbound	19:37:00	1
1877986	99	53	45,6	cyclictest	1974697	-21	kworker/u4:9+events_unbound	22:35:18	0
1877986	99	53	37,7	cyclictest	1877984	-21	cyclictest	19:09:59	0
1877986	99	53	33,17	cyclictest	2085650	-21	idleruntime-cro	00:40:01	0
1877986	99	53	26,23	cyclictest	2061699	-21	ps	00:10:37	0
1877987	99	52	35,6	cyclictest	2037669	-21	kworker/u4:6+events_unbound	23:46:39	1
1877986	99	52	9,22	cyclictest	1913999	-21	ssh	21:15:34	0
1877986	99	52	21,21	cyclictest	1884777	-21	fschecks_time	19:35:21	0
1877986	99	52	13,16	cyclictest	1896466	-21	ntpq	20:20:25	0
1877987	99	51	44,6	cyclictest	2008383	-21	kworker/u4:2+events_unbound	23:31:43	1
1877987	99	51	42,7	cyclictest	1961854	-21	kworker/u4:4+events_unbound	22:31:42	1
1877987	99	51	40,6	cyclictest	0	-21	swapper/1	22:55:33	1
1877987	99	51	1,6	cyclictest	17	1	rcu_preempt	21:45:23	1
1877986	99	51	5,32	cyclictest	2012963	-21	ssh	23:12:44	0
1877986	99	51	5,28	cyclictest	2074128	-21	ssh	00:25:31	0
1877986	99	51	41,8	cyclictest	1904710	-21	latency_hist	20:55:01	0
1877986	99	51	40,8	cyclictest	2059419	-21	sshd	00:08:12	0
1877986	99	51	22,8	cyclictest	0	-21	swapper/0	21:30:36	0
1877987	99	50	44,4	cyclictest	1987619	-21	kworker/u4:13+events_unbound	22:48:00	1
1877987	99	50	42,6	cyclictest	1879193	-21	kworker/u4:4+events_unbound	19:52:32	1
1877987	99	50	42,6	cyclictest	1812918	-21	kworker/u4:12+events_unbound	21:00:04	1
1877987	99	50	37,9	cyclictest	1893201	-21	kworker/u4:15	20:10:00	1
1877987	99	50	37,10	cyclictest	1900900	-21	awk	20:39:59	1
1877986	99	50	9,20	cyclictest	0	-21	swapper/0	20:40:00	0
1877986	99	50	13,11	cyclictest	1883735	-21	ntpq	19:30:24	0
1877986	99	50	12,10	cyclictest	2024601	-21	ssh	23:26:09	0
1877986	99	50	12,10	cyclictest	2024601	-21	ssh	23:26:09	0
1877987	99	49	43,4	cyclictest	1869504	-21	kworker/u4:2+events_unbound	19:22:04	1
1877987	99	49	41,6	cyclictest	1885507	-21	kworker/u4:3+events_unbound	20:47:41	1
1877987	99	49	41,5	cyclictest	1956105	-21	gltestperf	22:05:24	1
1877986	99	49	6,33	cyclictest	255	50	irq/23-42890000.ethernet	21:20:25	0
1877986	99	49	5,26	cyclictest	0	-21	swapper/0	22:30:34	0
1877986	99	49	3,23	cyclictest	0	-21	swapper/0	00:00:23	0
1877987	99	48	41,5	cyclictest	1943055	-21	aten_r7power_vo	21:50:16	1
1877987	99	48	41,5	cyclictest	1907249	-21	kworker/u4:2+events_unbound	21:23:58	1
1877987	99	48	39,7	cyclictest	2004132	-21	kworker/u4:5+events_unbound	23:05:23	1
1877986	99	48	7,21	cyclictest	1892361	-21	cut	20:05:19	0
1877986	99	48	41,5	cyclictest	1877984	-21	cyclictest	21:10:02	0
1877986	99	48	31,12	cyclictest	0	-21	swapper/0	20:25:09	0
1877986	99	48	11,10	cyclictest	1957343	-21	ssh	22:06:26	0
1877986	99	48	10,13	cyclictest	1941817	-21	ssh	21:48:44	0
1877987	99	47	40,4	cyclictest	1907741	-21	fschecks_time	21:05:20	1
1877987	99	47	39,5	cyclictest	1898243	-21	unixbench_multi	20:25:42	1
1877987	99	47	38,7	cyclictest	1904643	-21	cron	20:54:59	1
1877987	99	47	2,26	cyclictest	2032163	-21	ssh	23:35:33	1
1877986	99	47	8,19	cyclictest	1895228	-21	ntpq	20:15:30	0
1877986	99	47	6,23	cyclictest	1905801	-21	unixbench_multi	20:55:37	0
1877986	99	47	11,13	cyclictest	1890039	-21	ntpq	19:55:24	0
1877986	99	47	11,12	cyclictest	1901605	-21	ntpq	20:40:25	0
1877987	99	46	37,6	cyclictest	2079650	-21	kworker/u4:0+events_unbound	00:35:26	1
1877986	99	46	12,10	cyclictest	1903272	-21	awk	20:45:38	0
1877987	99	45	36,7	cyclictest	1922408	-21	sshd	21:25:29	1
1877986	99	45	35,8	cyclictest	2065055	-21	aten_r7power_cu	00:15:18	0
1877986	99	45	26,14	cyclictest	1893377	-21	apt-get	20:10:13	0
1877986	99	45	10,13	cyclictest	1910293	-21	ssh	21:10:53	0
1877987	99	44	38,5	cyclictest	1869504	-21	kworker/u4:2+events_unbound	19:41:01	1
1877987	99	44	38,4	cyclictest	1880472	-21	kworker/u4:9+events_unbound	19:18:00	1
1877987	99	44	35,7	cyclictest	1887197	-21	df_abs	19:45:16	1
1877986	99	44	24,12	cyclictest	1881774	-21	modprobe	19:24:59	0
1877986	99	43	36,5	cyclictest	1879412	-21	aten2__	19:15:17	0
1877987	99	42	34,6	cyclictest	1894469	-21	ls	20:15:00	1
1877987	99	42	33,7	cyclictest	1879028	-21	timerwakeupswit	19:10:36	1
1877987	99	40	34,4	cyclictest	1883225	-21	aten2__	19:30:15	1
1877987	99	40	31,6	cyclictest	0	-21	swapper/1	20:20:17	1
1877987	99	38	31,5	cyclictest	1893180	-21	kworker/u4:17+events_unbound	20:17:36	1
1877987	99	37	29,6	cyclictest	1882051	-21	aten_r7power_po	19:25:19	1
1877987	99	32	25,5	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17