OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Wed Aug 19, 2026 00:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1972584	99	111	103,6	cyclictest	2103988	-21	kworker/u4:3+events_unbound	23:46:46	1
1972584	99	103	96,5	cyclictest	1998185	-21	kworker/u4:15+events_unbound	20:51:16	1
1972584	99	102	95,5	cyclictest	2148490	-21	kworker/u4:11+events_unbound	23:56:50	1
1972584	99	97	90,5	cyclictest	1990492	-21	kworker/u4:2+events_unbound	20:31:14	1
1972584	99	96	89,5	cyclictest	1996915	-21	kworker/u4:12+events_unbound	20:46:15	1
1972584	99	95	88,5	cyclictest	1973814	-21	kworker/u4:14+events_unbound	19:15:54	1
1972583	99	95	88,5	cyclictest	2050353	-21	kworker/u4:15+events_unbound	22:11:27	0
1972584	99	94	87,5	cyclictest	1986691	-21	kworker/u4:9+events_unbound	20:36:14	1
1972583	99	94	87,5	cyclictest	2023965	-21	kworker/u4:8+events_unbound	21:36:22	0
1972584	99	89	81,6	cyclictest	1995612	-21	kworker/u4:0+events_unbound	20:41:14	1
1972583	99	88	64,11	cyclictest	2103989	-21	kworker/u4:4+events_unbound	23:31:44	0
1972583	99	87	50,30	cyclictest	53	-21	kswapd0	00:30:08	0
1972583	99	86	79,5	cyclictest	2076806	-21	kworker/u4:2+events_unbound	22:36:32	0
1972584	99	85	77,6	cyclictest	1973813	-21	kworker/u4:12+events_unbound	19:36:04	1
1972583	99	85	78,5	cyclictest	1999454	-21	kworker/u4:16+events_unbound	21:16:21	0
1972583	99	84	76,5	cyclictest	2082007	-21	kworker/u4:0+events_unbound	22:41:32	0
1972584	99	83	76,5	cyclictest	2000724	-21	kworker/u4:17+events_unbound	21:06:18	1
1972584	99	81	74,5	cyclictest	1982767	-21	kworker/u4:2+events_unbound	20:06:10	1
1972583	99	81	74,5	cyclictest	2059393	-21	kworker/u4:7+events_unbound	22:16:29	0
1972583	99	80	75,3	cyclictest	2103987	-21	kworker/u4:0+events_unbound	23:16:38	0
1972583	99	80	63,9	cyclictest	2059391	-21	kworker/u4:4+events_unbound	22:51:36	0
1972584	99	79	72,5	cyclictest	1963719	-21	kworker/u4:4+events_unbound	19:31:02	1
1972583	99	78	70,5	cyclictest	1963719	-21	kworker/u4:4+events_unbound	19:25:55	0
1972583	99	78	70,5	cyclictest	0	-21	swapper/0	00:05:28	0
1972583	99	73	66,5	cyclictest	2134970	-21	kworker/u4:7+events_unbound	23:41:47	0
1972583	99	72	58,12	cyclictest	2032978	-21	kworker/u4:10+events_unbound	22:06:29	0
1972583	99	71	50,17	cyclictest	0	-21	swapper/0	21:25:10	0
1972584	99	69	61,6	cyclictest	0	-21	swapper/1	21:10:27	1
1972583	99	67	54,6	cyclictest	1995614	-21	kworker/u4:2+events_unbound	20:56:16	0
1972583	99	65	58,5	cyclictest	2157525	-21	kworker/u4:13+events_unbound	00:16:56	0
1972583	99	64	52,6	cyclictest	2054862	-21	kworker/u4:5+events_unbound	22:26:31	0
1972584	99	61	53,6	cyclictest	1981498	-21	kworker/u4:1+events_unbound	19:45:02	1
1972583	99	60	52,6	cyclictest	2032979	-21	kworker/u4:12+events_unbound	21:46:25	0
1972584	99	59	9,46	cyclictest	2124714	-21	ssh	23:25:29	1
1972584	99	59	36,19	cyclictest	0	-21	swapper/1	22:55:15	1
1972583	99	59	51,6	cyclictest	1982768	-21	kworker/u4:4+events_unbound	20:26:13	0
1972584	99	57	42,11	cyclictest	0	-21	swapper/1	21:50:39	1
1972583	99	57	49,6	cyclictest	1990493	-21	kworker/u4:3+events_unbound	20:50:02	0
1972584	99	56	48,6	cyclictest	1972580	-21	cyclictest	00:17:18	1
1972584	99	56	43,8	cyclictest	0	-21	swapper/1	20:25:25	1
1972584	99	56	42,8	cyclictest	0	-21	swapper/1	22:30:30	1
1972583	99	56	47,6	cyclictest	2119790	-21	/usr/sbin/munin	23:20:17	0
1972584	99	55	46,6	cyclictest	2026759	-21	/usr/sbin/munin	21:35:29	1
1972584	99	55	44,9	cyclictest	2111958	-21	unixbench_singl	23:10:42	1
1972583	99	55	47,6	cyclictest	2187404	-21	vmstat	00:35:41	0
1972583	99	55	43,9	cyclictest	0	-21	swapper/0	22:30:39	0
1972584	99	54	47,5	cyclictest	1982769	-21	kworker/u4:5+events_unbound	20:00:03	1
1972583	99	54	47,5	cyclictest	2103991	-21	kworker/u4:6+events_unbound	23:05:04	0
1972584	99	53	39,7	cyclictest	2162005	-21	kworker/u4:4+events_unbound	00:11:10	1
1972583	99	53	44,6	cyclictest	2178172	-21	sh	00:25:40	0
1972583	99	53	43,8	cyclictest	2165991	-21	systemd	00:11:55	0
1972584	99	52	45,5	cyclictest	1985395	-21	kworker/u4:7+events_unbound	21:04:17	1
1972584	99	52	44,5	cyclictest	2088674	-21	/usr/sbin/munin	22:45:19	1
1972584	99	52	43,6	cyclictest	2106238	-21	aten2__	23:05:15	1
1972583	99	52	35,15	cyclictest	2031602	-21	awk	21:40:41	0
1972583	99	52	24,24	cyclictest	256	50	irq/23-42890000.ethernet	19:50:09	0
1972584	99	51	45,4	cyclictest	27	1	ktimers/1	23:01:57	1
1972584	99	51	44,5	cyclictest	2174878	-21	kworker/u4:16+events_unbound	00:35:46	1
1972584	99	51	40,7	cyclictest	1990493	-21	kworker/u4:3+events_unbound	21:20:03	1
1972584	99	50	41,7	cyclictest	1981486	-21	systemd	19:41:05	1
1972584	99	50	40,8	cyclictest	1977810	-21	latency_hist	19:30:01	1
1972584	99	50	37,8	cyclictest	0	-21	swapper/1	23:15:25	1
1972584	99	50	33,13	cyclictest	53	-21	kswapd0	00:30:10	1
1972583	99	50	29,7	cyclictest	1985395	-21	kworker/u4:7-xprtiod	20:35:01	0
1972584	99	49	42,5	cyclictest	1995612	-21	kworker/u4:0+events_unbound	20:56:05	1
1972584	99	49	41,6	cyclictest	2009385	-21	unixbench-2d	21:15:41	1
1972584	99	49	41,5	cyclictest	2178500	-21	unixbench_singl	00:25:43	1
1972584	99	49	41,5	cyclictest	2085013	-21	switchtime	22:40:39	1
1972584	99	49	39,5	cyclictest	0	-21	swapper/1	21:40:14	1
1972584	99	49	36,7	cyclictest	0	-21	swapper/1	22:25:00	1
1972583	99	49	42,5	cyclictest	2151052	-21	gltestperf	23:55:22	0
1972583	99	49	41,6	cyclictest	2044503	-21	/usr/sbin/munin	21:55:26	0
1972583	99	49	41,6	cyclictest	2044503	-21	/usr/sbin/munin	21:55:25	0
1972583	99	49	40,7	cyclictest	2067494	-21	unixbench_singl	22:20:45	0
1972584	99	48	41,5	cyclictest	2159608	-21	aten_r7power_en	00:05:20	1
1972584	99	48	41,5	cyclictest	2155928	-21	ld	00:00:40	1
1972584	99	48	41,4	cyclictest	2093077	-21	sed	22:50:18	1
1972584	99	48	37,8	cyclictest	0	-21	swapper/1	22:10:35	1
1972583	99	48	40,6	cyclictest	2157523	-21	ssh	00:02:28	0
1972583	99	48	38,8	cyclictest	2133417	-21	uname	23:35:23	0
1972583	99	48	32,5	cyclictest	2107841	-21	kworker/u4:8+events_unbound	23:11:07	0
1972583	99	48	30,15	cyclictest	0	-21	swapper/0	21:50:44	0
1972583	99	48	27,19	cyclictest	1978938	-21	cron	19:35:01	0
1972584	99	47	40,5	cyclictest	2146518	-21	fschecks_time	23:50:19	1
1972584	99	47	40,5	cyclictest	2070930	-21	fschecks_time	22:25:21	1
1972584	99	47	40,5	cyclictest	1973814	-21	kworker/u4:14+events_unbound	19:13:56	1
1972584	99	47	34,9	cyclictest	37	-21	kcompactd0	19:50:31	1
1972584	99	47	34,8	cyclictest	0	-21	swapper/1	21:31:33	1
1972584	99	47	1,40	cyclictest	2017195	-21	ssh	21:25:09	1
1972583	99	47	41,4	cyclictest	2173792	-21	switchtime	00:20:38	0
1972583	99	47	40,5	cyclictest	1972580	-21	cyclictest	21:10:38	0
1972583	99	47	26,19	cyclictest	1982015	-21	fschecks_time	19:45:21	0
1972584	99	46	40,4	cyclictest	2045170	-21	unixbench_singl	21:55:41	1
1972584	99	46	40,4	cyclictest	2045170	-21	unixbench_singl	21:55:41	1
1972584	99	46	39,5	cyclictest	2036059	-21	switchtime	21:45:42	1
1972584	99	46	36,7	cyclictest	2141489	-21	latency_hist	23:45:02	1
1972583	99	46	40,4	cyclictest	2001035	-21	aten_r7power_po	21:00:17	0
1972583	99	46	38,6	cyclictest	1963720	-21	kworker/u4:6+events_unbound	20:01:09	0
1972583	99	46	37,6	cyclictest	1987980	-21	kworker/u4:0	20:09:59	0
1972583	99	46	34,10	cyclictest	0	-21	swapper/0	22:45:14	0
1972583	99	46	3,28	cyclictest	2142513	-21	ssh	23:45:32	0
1972583	99	46	1,33	cyclictest	2102439	-21	ntpq	23:00:27	0
1972584	99	45	38,5	cyclictest	2120589	-21	switchtime	23:20:36	1
1972584	99	45	38,5	cyclictest	1972580	-21	cyclictest	22:09:59	1
1972584	99	45	37,6	cyclictest	2048901	-21	kernelversion	22:00:24	1
1972584	99	45	37,6	cyclictest	2048901	-21	kernelversion	22:00:23	1
1972584	99	45	35,7	cyclictest	0	-21	swapper/1	22:15:36	1
1972584	99	45	31,6	cyclictest	2130448	-21	kworker/u4:2+events_unbound	23:38:18	1
1972583	99	45	38,5	cyclictest	1981465	-21	grep	19:40:40	0
1972583	99	45	37,6	cyclictest	2146312	-21	aten_r7power_vo	23:50:16	0
1972583	99	45	37,6	cyclictest	2017113	-21	latency_hist	21:25:01	0
1972583	99	45	37,5	cyclictest	1994775	-21	fschecks_count	20:35:20	0
1972583	99	45	35,7	cyclictest	2049022	-21	/usr/sbin/munin	22:00:27	0
1972583	99	45	35,7	cyclictest	2049022	-21	/usr/sbin/munin	22:00:27	0
1972583	99	45	34,8	cyclictest	2025796	-21	apt-get	21:35:07	0
1972584	99	44	37,5	cyclictest	1973814	-21	kworker/u4:14+events_unbound	20:16:11	1
1972584	99	44	36,5	cyclictest	1984346	-21	aten2__	19:55:17	1
1972584	99	44	31,9	cyclictest	37	-21	kcompactd0	22:37:17	1
1972584	99	44	29,5	cyclictest	17	1	rcu_preempt	00:20:16	1
1972583	99	44	37,5	cyclictest	2124939	-21	ssh	23:25:37	0
1972583	99	44	37,5	cyclictest	1980202	-21	kworker/u4:11+events_unbound	19:56:09	0
1972583	99	44	36,6	cyclictest	2094916	-21	kworker/u4:16+events_unbound	22:55:33	0
1972583	99	44	36,6	cyclictest	1973814	-21	kworker/u4:14+events_unbound	20:16:10	0
1972583	99	44	31,4	cyclictest	1963718	-21	kworker/u4:3+events_unbound	19:10:00	0
1972584	99	43	38,4	cyclictest	2130448	-21	kworker/u4:2+events_unbound	23:34:43	1
1972583	99	43	35,6	cyclictest	2002263	-21	aten_r7power_cu	21:05:16	0
1972584	99	42	32,7	cyclictest	0	-21	swapper/1	19:20:29	1
1972584	99	42	30,9	cyclictest	0	-21	swapper/1	20:20:16	1
1972583	99	42	35,5	cyclictest	1957294	-21	kworker/u4:5+events_unbound	19:10:53	0
1972583	99	42	33,7	cyclictest	0	-21	swapper/0	20:15:00	0
1972584	99	41	9,22	cyclictest	0	-21	swapper/1	20:10:28	1
1972583	99	41	33,6	cyclictest	1997116	-21	aten2__	20:45:15	0
1972583	99	41	33,6	cyclictest	1991721	-21	unixbench_multi	20:20:38	0
1972583	99	40	31,6	cyclictest	1995614	-21	kworker/u4:2-rpciod	20:40:21	0
1972583	99	40	31,6	cyclictest	0	-21	swapper/0	19:15:20	0
1972583	99	39	31,5	cyclictest	0	-21	swapper/0	19:35:19	0
1972583	99	38	30,6	cyclictest	0	-21	swapper/0	19:20:12	0
1972584	99	35	29,4	cyclictest	1972674	-21	latency_hist	19:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17