OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Tue Feb 10, 2026 12:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2176007	99	122	103,6	cyclictest	2264964	-21	kworker/u4:3+events_unbound	10:19:47	1
2176007	99	104	96,6	cyclictest	2278078	-21	kworker/u4:10+events_unbound	10:36:43	1
2176007	99	103	95,6	cyclictest	2248085	-21	kworker/u4:6+events_unbound	10:04:47	1
2176007	99	101	87,5	cyclictest	2197672	-21	kworker/u4:9+events_unbound	09:34:39	1
2176007	99	100	93,5	cyclictest	2234957	-21	kworker/u4:5+events_unbound	09:44:43	1
2176006	99	99	22,45	cyclictest	2147880	-21	kworker/u4:9+xprtiod	07:10:01	0
2176007	99	92	85,5	cyclictest	2325371	-21	kworker/u4:5+events_unbound	12:10:03	1
2176007	99	85	77,5	cyclictest	0	-21	swapper/1	11:55:31	1
2176007	99	84	78,4	cyclictest	2187572	-21	kworker/u4:13+events_unbound	09:09:31	1
2176007	99	84	78,4	cyclictest	2187572	-21	kworker/u4:13+events_unbound	09:09:30	1
2176007	99	84	75,7	cyclictest	2190108	-21	kworker/u4:6+events_unbound	08:39:23	1
2176007	99	83	76,5	cyclictest	2147880	-21	kworker/u4:9+events_unbound	07:14:07	1
2176007	99	80	64,5	cyclictest	2191362	-21	kworker/u4:14+events_unbound	08:14:17	1
2176007	99	78	71,5	cyclictest	2179754	-21	kworker/u4:8+events_unbound	07:34:10	1
2176007	99	77	64,6	cyclictest	2316673	-21	kworker/u4:1+events_unbound	12:20:04	1
2176007	99	76	69,5	cyclictest	2179754	-21	kworker/u4:8+events_unbound	07:25:00	1
2176007	99	75	68,5	cyclictest	2329719	-21	kworker/u4:6+events_unbound	11:39:56	1
2176007	99	73	61,4	cyclictest	2186314	-21	kworker/u4:9+events_unbound	07:49:14	1
2176007	99	72	58,6	cyclictest	2186315	-21	kworker/u4:11+events_unbound	07:54:15	1
2176007	99	70	63,5	cyclictest	1870179	-21	kworker/u4:0+events_unbound	08:24:21	1
2176007	99	70	63,5	cyclictest	1870179	-21	kworker/u4:0+events_unbound	08:24:20	1
2176006	99	68	59,7	cyclictest	2312292	-21	kworker/u4:0+events_unbound	11:14:54	0
2176007	99	67	61,4	cyclictest	2196416	-21	kworker/u4:1+events_unbound	08:34:21	1
2176007	99	67	59,6	cyclictest	2314557	-21	aten_r7power_cu	11:15:15	1
2176007	99	66	59,5	cyclictest	2329718	-21	kworker/u4:4+events_unbound	11:49:59	1
2176007	99	66	56,7	cyclictest	0	-21	swapper/1	09:55:15	1
2176007	99	66	47,8	cyclictest	2273700	-21	kworker/u4:8+events_unbound	10:30:15	1
2176006	99	66	18,21	cyclictest	2323123	-21	aten_r7power_cu	11:25:16	0
2176006	99	66	17,22	cyclictest	2289440	-21	ntpq	10:45:27	0
2176006	99	64	15,28	cyclictest	2232497	-21	sendmail	09:40:01	0
2176007	99	63	57,4	cyclictest	2175934	-21	kworker/u4:3+events_unbound	07:19:08	1
2176006	99	62	5,50	cyclictest	2328153	-21	ssh	11:30:30	0
2176006	99	62	16,26	cyclictest	2320090	-21	users	11:20:42	0
2176006	99	61	3,13	cyclictest	2281008	-21	ssh	10:35:36	0
2176006	99	61	31,10	cyclictest	2201128	-21	ps	08:45:35	0
2176006	99	61	18,16	cyclictest	2361185	-21	ssh	12:09:30	0
2176007	99	60	53,5	cyclictest	2186315	-21	kworker/u4:11+events_unbound	08:09:15	1
2176007	99	60	53,5	cyclictest	2152219	-21	kworker/u4:10+events_unbound	08:49:28	1
2176006	99	60	14,40	cyclictest	2302270	-21	ntpq	11:00:24	0
2176006	99	59	40,13	cyclictest	2205284	-21	modprobe	09:04:59	0
2176006	99	59	24,14	cyclictest	2204098	-21	sed	09:00:01	0
2176006	99	59	18,17	cyclictest	2181887	-21	ntpq	07:30:36	0
2176006	99	59	15,23	cyclictest	2383615	-21	/usr/sbin/munin	12:35:20	0
2176006	99	59	15,23	cyclictest	2363040	-21	unixbench_multi	12:10:39	0
2176006	99	59	12,26	cyclictest	2375960	-21	awk	12:25:40	0
2176006	99	58	48,7	cyclictest	2316676	-21	kworker/u4:7+events_unbound	12:15:03	0
2176006	99	58	23,7	cyclictest	2201665	-21	apt-get	08:50:12	0
2176006	99	58	23,30	cyclictest	2341118	-21	ssh	11:45:34	0
2176006	99	58	19,12	cyclictest	2198413	-21	ntpq	08:35:24	0
2176006	99	58	14,20	cyclictest	2238050	-21	awk	09:45:36	0
2176007	99	57	45,6	cyclictest	2295499	-21	kworker/u4:4+events_unbound	10:55:37	1
2176007	99	57	41,5	cyclictest	2247459	-21	kworker/u4:2+events_unbound	10:09:00	1
2176007	99	57	41,5	cyclictest	2247459	-21	kworker/u4:2+events_unbound	10:08:59	1
2176007	99	57	38,6	cyclictest	2281835	-21	kworker/u4:12+events_unbound	11:04:43	1
2176006	99	57	21,7	cyclictest	2262912	-21	apt-get	10:15:13	0
2176006	99	57	19,13	cyclictest	2279040	-21	ssh	10:33:43	0
2176006	99	57	17,14	cyclictest	2296861	-21	ssh	10:54:51	0
2176006	99	57	15,15	cyclictest	2286612	-21	ssh	10:42:00	0
2176006	99	57	13,24	cyclictest	2255276	-21	processes	10:05:34	0
2176006	99	57	13,24	cyclictest	2255276	-21	processes	10:05:34	0
2176007	99	56	48,6	cyclictest	2368472	-21	kworker/u4:0+events_unbound	12:18:44	1
2176006	99	56	50,4	cyclictest	2316673	-21	kworker/u4:1+events_unbound	11:55:00	0
2176006	99	56	4,39	cyclictest	2267904	-21	ssh	10:20:26	0
2176006	99	56	39,11	cyclictest	2241707	-21	/usr/sbin/munin	09:50:20	0
2176006	99	56	28,10	cyclictest	2259416	-21	ntpq	10:10:29	0
2176006	99	56	16,16	cyclictest	2273851	-21	ssh	10:27:17	0
2176006	99	56	14,15	cyclictest	2382421	-21	ssh	12:34:02	0
2176007	99	55	48,5	cyclictest	2278077	-21	kworker/u4:9+events_unbound	11:10:02	1
2176007	99	55	42,8	cyclictest	2327075	-21	kworker/u4:1	11:30:01	1
2176006	99	55	46,7	cyclictest	2316676	-21	kworker/u4:7+events_unbound	11:44:57	0
2176006	99	55	46,6	cyclictest	2246299	-21	kernelversion	09:55:21	0
2176006	99	55	20,12	cyclictest	2298043	-21	ntpq	10:55:30	0
2176006	99	55	19,12	cyclictest	0	-21	swapper/0	09:25:30	0
2176006	99	55	17,11	cyclictest	2189641	-21	ntpq	08:00:28	0
2176006	99	55	17,11	cyclictest	2189641	-21	ntpq	08:00:27	0
2176006	99	55	16,14	cyclictest	2308117	-21	ssh	11:07:10	0
2176006	99	55	16,14	cyclictest	2308117	-21	ssh	11:07:10	0
2176006	99	55	15,15	cyclictest	2209077	-21	ssh	09:12:04	0
2176006	99	55	14,14	cyclictest	2316125	-21	ssh	11:16:14	0
2176007	99	54	46,6	cyclictest	2316676	-21	kworker/u4:7+events_unbound	11:43:59	1
2176006	99	54	44,8	cyclictest	2176345	-21	df_abs	07:10:17	0
2176006	99	54	43,7	cyclictest	2332520	-21	/usr/sbin/munin	11:35:33	0
2176006	99	54	39,9	cyclictest	2200233	-21	kworker/u4:17	08:44:59	0
2176006	99	54	16,14	cyclictest	2224980	-21	ntpq	09:30:30	0
2176006	99	54	16,14	cyclictest	2214649	-21	ssh	09:18:58	0
2176006	99	54	16,13	cyclictest	2355388	-21	ssh	12:02:01	0
2176006	99	54	16,13	cyclictest	2218487	-21	ssh	09:23:14	0
2176006	99	54	10,25	cyclictest	2250255	-21	grep	10:00:16	0
2176007	99	53	46,5	cyclictest	2197672	-21	kworker/u4:9+events_unbound	09:35:03	1
2176007	99	53	45,5	cyclictest	2357834	-21	df_inode	12:05:22	1
2176007	99	53	2,39	cyclictest	2207599	-21	ntpq	09:10:29	1
2176006	99	53	15,11	cyclictest	2190871	-21	ntpq	08:05:25	0
2176006	99	53	12,23	cyclictest	2188854	-21	modprobe	08:00:01	0
2176006	99	53	10,19	cyclictest	2193898	-21	cron	08:20:00	0
2176007	99	52	46,4	cyclictest	2357261	-21	dpkg	12:05:01	1
2176007	99	52	45,4	cyclictest	2220316	-21	gltestperf	09:25:19	1
2176007	99	52	41,8	cyclictest	2190133	-21	kworker/u4:11	08:05:01	1
2176007	99	52	41,8	cyclictest	2190133	-21	kworker/u4:11	08:05:00	1
2176006	99	52	31,19	cyclictest	2182931	-21	fschecks_time	07:35:24	0
2176006	99	52	19,29	cyclictest	255	50	irq/23-42890000.ethernet	09:40:11	0
2176006	99	52	14,11	cyclictest	2195940	-21	ntpq	08:25:27	0
2176006	99	52	11,17	cyclictest	2192333	-21	mailstats	08:10:37	0
2176007	99	51	45,4	cyclictest	2316676	-21	kworker/u4:7+events_unbound	12:28:00	1
2176006	99	51	14,12	cyclictest	2372491	-21	ssh	12:21:52	0
2176006	99	51	12,14	cyclictest	2178521	-21	munin-run	07:20:00	0
2176007	99	50	44,4	cyclictest	2383860	-21	/usr/sbin/munin	12:35:21	1
2176007	99	50	42,5	cyclictest	2379886	-21	ld	12:30:34	1
2176007	99	50	40,7	cyclictest	0	-21	swapper/1	08:50:27	1
2176007	99	50	40,4	cyclictest	2346645	-21	kworker/u4:2+events_unbound	11:55:01	1
2176007	99	50	33,6	cyclictest	2278075	-21	kworker/u4:2+events_unbound	11:06:44	1
2176007	99	50	33,6	cyclictest	2278075	-21	kworker/u4:2+events_unbound	11:06:43	1
2176007	99	50	32,6	cyclictest	2187572	-21	kworker/u4:13+events_unbound	09:17:21	1
2176006	99	50	30,16	cyclictest	2348916	-21	apt-get	11:55:12	0
2176006	99	50	17,10	cyclictest	2194646	-21	ntpq	08:20:23	0
2176006	99	50	17,10	cyclictest	2194646	-21	ntpq	08:20:23	0
2176006	99	50	15,12	cyclictest	2184545	-21	ntpq	07:40:28	0
2176007	99	49	42,5	cyclictest	2206556	-21	diskmemload	10:45:01	1
2176006	99	49	33,12	cyclictest	2186515	-21	apt-get	07:50:10	0
2176006	99	49	16,9	cyclictest	2206069	-21	ntpq	09:05:31	0
2176006	99	49	16,9	cyclictest	2206069	-21	ntpq	09:05:31	0
2176006	99	49	12,11	cyclictest	2180595	-21	ntpq	07:25:31	0
2176007	99	48	43,4	cyclictest	2321012	-21	kworker/u4:3+events_unbound	11:23:59	1
2176007	99	48	28,7	cyclictest	2234958	-21	kworker/u4:6+events_unbound	09:46:25	1
2176006	99	48	39,7	cyclictest	2178943	-21	fschecks_count	07:20:19	0
2176007	99	47	29,6	cyclictest	2230557	-21	kworker/u4:1+events_unbound	10:12:01	1
2176006	99	47	11,13	cyclictest	2196845	-21	diskstats	08:30:21	0
2176007	99	46	8,35	cyclictest	2293888	-21	ssh	10:50:35	1
2176007	99	46	39,5	cyclictest	2172337	-21	kworker/u4:1+events_unbound	07:29:11	1
2176007	99	46	37,7	cyclictest	2216110	-21	gltestperf	09:20:23	1
2176007	99	46	28,6	cyclictest	2269304	-21	kworker/u4:4+events_unbound	10:24:09	1
2176007	99	46	28,11	cyclictest	2230557	-21	kworker/u4:1+events_unbound	10:25:15	1
2176006	99	46	30,11	cyclictest	2185257	-21	apt-get	07:45:11	0
2176007	99	45	39,4	cyclictest	2203984	-21	systemd	08:59:28	1
2176007	99	45	38,5	cyclictest	2289557	-21	ntpq	10:45:32	1
2176007	99	45	37,6	cyclictest	2185141	-21	latency_hist	07:45:01	1
2176007	99	45	37,5	cyclictest	0	-21	swapper/1	09:00:28	1
2176007	99	44	37,5	cyclictest	2321012	-21	kworker/u4:3+events_unbound	11:31:43	1
2176007	99	44	36,6	cyclictest	2239330	-21	kworker/u4:4+events_unbound	09:51:00	1
2176007	99	44	35,7	cyclictest	2199262	-21	aten_r7power_po	08:40:16	1
2176007	99	43	37,4	cyclictest	2191362	-21	kworker/u4:14+events_unbound	08:15:04	1
2176007	99	42	27,4	cyclictest	2179754	-21	kworker/u4:8+events_unbound	07:35:10	1
2176007	99	40	34,4	cyclictest	2188935	-21	latency_hist	08:00:01	1
2176007	99	40	32,5	cyclictest	2195602	-21	fschecks_count	08:25:20	1
2176007	99	33	25,5	cyclictest	2152219	-21	kworker/u4:10-rpciod	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17