OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Mon Jul 06, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2046282	99	107	93,5	cyclictest	2172321	-21	kworker/u4:3+events_unbound	11:00:53	0
2046283	99	106	85,8	cyclictest	2251445	-21	kworker/u4:12+events_unbound	12:31:10	1
2046283	99	100	92,6	cyclictest	2079578	-21	kworker/u4:7+events_unbound	09:40:41	1
2046282	99	100	92,6	cyclictest	2207284	-21	kworker/u4:5+events_unbound	11:56:06	0
2046282	99	100	86,11	cyclictest	2123913	-21	kworker/u4:9+events_unbound	10:05:44	0
2046282	99	99	85,12	cyclictest	2137346	-21	kworker/u4:4+events_unbound	10:20:46	0
2046283	99	96	89,5	cyclictest	2242405	-21	kworker/u4:1+events_unbound	12:36:12	1
2046283	99	96	89,5	cyclictest	2050172	-21	kworker/u4:14+events_unbound	07:40:05	1
2046282	99	94	79,6	cyclictest	2056533	-21	kworker/u4:1+events_unbound	07:55:10	0
2046283	99	92	84,6	cyclictest	1805922	-21	kworker/u4:0+events_unbound	07:35:07	1
2046283	99	91	82,7	cyclictest	2137346	-21	kworker/u4:4+events_unbound	10:35:50	1
2046283	99	87	79,6	cyclictest	2211791	-21	kworker/u4:0+events_unbound	11:46:04	1
2046282	99	84	72,6	cyclictest	2093179	-21	kworker/u4:4+events_unbound	10:00:42	0
2046283	99	79	71,6	cyclictest	2207286	-21	kworker/u4:8+events_unbound	12:11:08	1
2046283	99	78	62,5	cyclictest	2128398	-21	kworker/u4:1+events_unbound	10:40:50	1
2046283	99	78	59,6	cyclictest	2202796	-21	kworker/u4:1+events_unbound	11:41:02	1
2046282	99	73	65,6	cyclictest	2047509	-21	kworker/u4:10+events_unbound	07:25:05	0
2046283	99	72	63,6	cyclictest	2066759	-21	kworker/u4:16+events_unbound	08:45:30	1
2046282	99	71	62,6	cyclictest	2079581	-21	kworker/u4:12+events_unbound	09:20:34	0
2046282	99	71	58,5	cyclictest	2047510	-21	kworker/u4:11+events_unbound	07:45:07	0
2046282	99	71	49,16	cyclictest	53	-21	kswapd0	09:40:09	0
2046283	99	70	52,5	cyclictest	2202796	-21	kworker/u4:1+events_unbound	12:01:09	1
2046282	99	70	63,5	cyclictest	2047510	-21	kworker/u4:11+events_unbound	07:40:08	0
2046282	99	70	44,9	cyclictest	2187146	-21	apt-get	11:15:10	0
2046283	99	65	56,7	cyclictest	2093179	-21	kworker/u4:4+events_unbound	09:55:42	1
2046283	99	65	49,5	cyclictest	2123910	-21	kworker/u4:5+events_unbound	10:10:44	1
2046282	99	65	57,6	cyclictest	2141840	-21	kworker/u4:5+events_unbound	10:25:47	0
2046283	99	64	51,6	cyclictest	2070596	-21	kworker/u4:0+events_unbound	08:50:32	1
2046282	99	64	40,15	cyclictest	2207286	-21	kworker/u4:8+events_unbound	12:10:14	0
2046283	99	63	56,5	cyclictest	2229632	-21	kworker/u4:2+events_unbound	12:16:10	1
2046282	99	63	50,9	cyclictest	2099670	-21	aten_r7power_en	09:35:14	0
2046282	99	62	40,17	cyclictest	2200450	-21	ssh	11:30:03	0
2046283	99	61	54,5	cyclictest	2068032	-21	kworker/u4:19+events_unbound	09:00:32	1
2046283	99	61	54,5	cyclictest	2059079	-21	kworker/u4:0+events_unbound	08:30:00	1
2046283	99	61	52,6	cyclictest	2242405	-21	kworker/u4:1+events_unbound	12:25:01	1
2046282	99	59	36,7	cyclictest	2088676	-21	kworker/u4:11+events_unbound	09:26:45	0
2046282	99	58	50,6	cyclictest	2211793	-21	kworker/u4:7+events_unbound	12:06:07	0
2046283	99	57	49,6	cyclictest	2205894	-21	ps	11:35:36	1
2046283	99	57	48,7	cyclictest	2079578	-21	kworker/u4:7+events_unbound	09:35:00	1
2046283	99	57	41,4	cyclictest	2119420	-21	kworker/u4:3+events_unbound	10:01:44	1
2046282	99	57	51,4	cyclictest	2050172	-21	kworker/u4:14+events_unbound	07:40:01	0
2046282	99	57	47,6	cyclictest	0	-21	swapper/0	12:15:30	0
2046282	99	56	34,19	cyclictest	2065951	-21	fschecks_count	08:25:19	0
2046283	99	55	47,5	cyclictest	2191680	-21	latency_hist	11:20:02	1
2046283	99	55	41,5	cyclictest	2066760	-21	kworker/u4:17+events_unbound	08:55:31	1
2046283	99	55	40,5	cyclictest	2207283	-21	kworker/u4:3+events_unbound	11:51:06	1
2046282	99	55	48,5	cyclictest	2132851	-21	kworker/u4:8+events_unbound	10:14:46	0
2046282	99	55	46,6	cyclictest	2192897	-21	mailstats	11:20:44	0
2046283	99	54	6,42	cyclictest	2161881	-21	ssh	10:45:25	1
2046283	99	54	46,5	cyclictest	2141840	-21	kworker/u4:5+events_unbound	10:25:01	1
2046282	99	54	46,6	cyclictest	2260406	-21	kworker/u4:6+events_unbound	12:37:46	0
2046282	99	54	42,7	cyclictest	2158419	-21	ssh	10:41:05	0
2046282	99	54	40,12	cyclictest	256	50	irq/23-42890000.ethernet	09:50:12	0
2046283	99	53	45,6	cyclictest	2097691	-21	kworker/u4:8+events_unbound	09:35:39	1
2046282	99	53	45,6	cyclictest	2207283	-21	kworker/u4:3+events_unbound	11:50:02	0
2046282	99	53	40,9	cyclictest	2068418	-21	df	08:35:18	0
2046283	99	52	44,5	cyclictest	2050148	-21	unixbench_singl	07:20:43	1
2046283	99	52	40,9	cyclictest	0	-21	swapper/1	11:10:14	1
2046282	99	52	44,6	cyclictest	2132851	-21	kworker/u4:8+events_unbound	10:15:03	0
2046282	99	52	44,6	cyclictest	2132851	-21	kworker/u4:8+events_unbound	10:15:02	0
2046282	99	52	43,6	cyclictest	2079578	-21	kworker/u4:7+events_unbound	09:17:03	0
2046282	99	52	42,7	cyclictest	2070596	-21	kworker/u4:0-rpciod	08:50:16	0
2046282	99	52	39,10	cyclictest	2253357	-21	latency_hist	12:30:03	0
2046282	99	52	37,9	cyclictest	2187214	-21	ssh	11:15:02	0
2046283	99	51	43,5	cyclictest	0	-21	swapper/1	10:15:37	1
2046283	99	51	43,5	cyclictest	0	-21	swapper/1	10:15:37	1
2046282	99	51	39,9	cyclictest	53	-21	kswapd0	10:55:16	0
2046282	99	51	33,13	cyclictest	53	-21	kswapd0	10:35:11	0
2046282	99	51	28,6	cyclictest	0	-21	swapper/0	12:30:30	0
2046282	99	51	28,20	cyclictest	0	-21	swapper/0	08:00:35	0
2046283	99	50	44,5	cyclictest	2114964	-21	kworker/u4:2+events_unbound	10:30:36	1
2046283	99	50	44,4	cyclictest	0	-21	swapper/1	08:40:27	1
2046283	99	50	39,8	cyclictest	0	-21	swapper/1	09:20:34	1
2046282	99	50	42,6	cyclictest	2096262	-21	find	09:30:39	0
2046282	99	50	39,8	cyclictest	2205985	-21	mailstats	11:35:36	0
2046282	99	50	39,8	cyclictest	2063127	-21	aten2__	08:15:18	0
2046282	99	50	35,12	cyclictest	0	-21	swapper/0	12:20:38	0
2046283	99	49	42,5	cyclictest	2196347	-21	aten_r7power_po	11:25:17	1
2046283	99	49	41,6	cyclictest	2088673	-21	kworker/u4:6+events_unbound	09:30:01	1
2046283	99	49	40,6	cyclictest	0	-21	swapper/1	11:20:30	1
2046283	99	49	2,38	cyclictest	2166338	-21	ntpq	10:50:33	1
2046282	99	49	42,5	cyclictest	2207283	-21	kworker/u4:3+events_unbound	11:41:45	0
2046282	99	49	41,6	cyclictest	2202796	-21	kworker/u4:1+events_unbound	12:00:03	0
2046282	99	49	41,6	cyclictest	2137346	-21	kworker/u4:4+events_unbound	10:31:45	0
2046282	99	49	41,6	cyclictest	2047507	-21	kworker/u4:4+events_unbound	08:30:27	0
2046282	99	49	28,5	cyclictest	2165850	-21	df_abs	10:50:21	0
2046283	99	48	42,4	cyclictest	2179830	-21	timerandwakeup	11:05:42	1
2046283	99	48	42,4	cyclictest	2179830	-21	timerandwakeup	11:05:41	1
2046283	99	48	40,6	cyclictest	2056535	-21	kworker/u4:5+events_unbound	07:50:01	1
2046283	99	48	39,6	cyclictest	2144882	-21	timerwakeupswit	10:25:41	1
2046282	99	48	40,6	cyclictest	2109352	-21	/usr/sbin/munin	09:45:39	0
2046282	99	48	40,5	cyclictest	0	-21	swapper/0	11:06:45	0
2046282	99	48	40,5	cyclictest	0	-21	swapper/0	11:06:45	0
2046282	99	48	37,7	cyclictest	2075723	-21	modprobe	09:05:01	0
2046282	99	48	37,7	cyclictest	2064780	-21	gltestperf	08:20:20	0
2046283	99	47	40,5	cyclictest	2167873	-21	kworker/u4:2+events_unbound	10:59:45	1
2046283	99	47	37,7	cyclictest	0	-21	swapper/1	12:05:36	1
2046283	99	47	26,7	cyclictest	2088673	-21	kworker/u4:6+events_unbound	09:50:24	1
2046283	99	47	26,6	cyclictest	2110478	-21	kworker/u4:13+events_unbound	09:49:09	1
2046282	99	47	40,5	cyclictest	2204681	-21	munin-plugin-st	11:35:00	0
2046282	99	47	37,7	cyclictest	2117703	-21	gltestperf	09:55:20	0
2046282	99	47	36,8	cyclictest	2052589	-21	unixbench-2d	07:30:36	0
2046283	99	46	39,5	cyclictest	2078629	-21	unixbench_singl	09:10:41	1
2046283	99	46	37,6	cyclictest	2068162	-21	latency_hist	08:35:01	1
2046283	99	46	3,33	cyclictest	2201504	-21	ssh	11:30:37	1
2046282	99	46	38,6	cyclictest	2062623	-21	cat	08:10:37	0
2046282	99	46	37,5	cyclictest	2207286	-21	kworker/u4:8-rpciod	11:45:34	0
2046282	99	46	34,8	cyclictest	0	-21	swapper/0	10:45:32	0
2046282	99	46	32,11	cyclictest	2078588	-21	unixbench_multi	09:10:41	0
2046282	99	45	37,6	cyclictest	2049851	-21	cat	07:20:41	0
2046282	99	45	37,6	cyclictest	2049047	-21	apt-key	07:20:01	0
2046282	99	45	36,6	cyclictest	2074370	-21	unixbench_singl	08:55:39	0
2046282	99	45	36,6	cyclictest	2060900	-21	fschecks_time	08:05:19	0
2046282	99	45	34,8	cyclictest	2071693	-21	timerwakeupswit	08:45:39	0
2046283	99	44	37,5	cyclictest	2249531	-21	gltestperf	12:25:21	1
2046283	99	44	37,4	cyclictest	2223500	-21	ldconfig	11:55:37	1
2046283	99	44	36,6	cyclictest	2066760	-21	kworker/u4:17+rpciod	08:35:21	1
2046283	99	44	36,5	cyclictest	2053096	-21	sed	07:35:18	1
2046283	99	44	35,6	cyclictest	2064183	-21	kworker/u4:13+rpciod	08:20:20	1
2046283	99	44	35,6	cyclictest	2048059	-21	gltestperf	07:15:22	1
2046283	99	44	35,6	cyclictest	0	-21	swapper/1	11:00:30	1
2046282	99	44	35,6	cyclictest	2069868	-21	fschecks_time	08:40:20	0
2046283	99	43	35,6	cyclictest	2076879	-21	unixbench_multi	09:05:39	1
2046283	99	43	35,6	cyclictest	0	-21	swapper/1	10:05:16	1
2046283	99	43	35,5	cyclictest	0	-21	swapper/1	09:20:01	1
2046283	99	43	29,6	cyclictest	2047507	-21	kworker/u4:4+events_unbound	07:50:07	1
2046282	99	43	31,7	cyclictest	256	50	irq/23-42890000.ethernet	09:05:37	0
2046282	99	43	24,16	cyclictest	0	-21	swapper/0	07:10:18	0
2046283	99	42	35,4	cyclictest	2047507	-21	kworker/u4:4+events_unbound	08:10:00	1
2046283	99	42	34,5	cyclictest	2063816	-21	proc_pri	08:15:37	1
2046283	99	42	33,7	cyclictest	2061870	-21	aten2__	08:10:16	1
2046282	99	42	28,11	cyclictest	0	-21	swapper/0	07:50:36	0
2046283	99	41	34,5	cyclictest	2058963	-21	unixbench-2d	07:55:39	1
2046283	99	41	33,6	cyclictest	2059592	-21	fschecks_count	08:00:18	1
2046282	99	38	29,5	cyclictest	0	-21	swapper/0	07:10:01	0
2046283	99	37	30,4	cyclictest	0	-21	swapper/1	07:10:22	1
2046283	99	37	28,6	cyclictest	0	-21	swapper/1	07:25:38	1
2046283	99	23	13,7	cyclictest	2046343	-21	wc	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17