OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Sun Nov 30, 2025 00:44:06)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
393127	99	143	123,7	cyclictest	422899	-21	kworker/u4:4+events_unbound	21:13:02	0
393127	99	138	128,7	cyclictest	569563	-21	kworker/u4:6+events_unbound	00:23:43	0
393127	99	135	127,6	cyclictest	558449	-21	kworker/u4:3+events_unbound	00:08:41	0
393127	99	133	125,6	cyclictest	493324	-21	kworker/u4:6+events_unbound	22:53:22	0
393127	99	129	121,6	cyclictest	393048	-21	kworker/u4:7+events_unbound	19:27:38	0
393127	99	124	116,6	cyclictest	452891	-21	kworker/u4:5+events_unbound	21:58:12	0
393127	99	123	114,6	cyclictest	516631	-21	kworker/u4:7+events_unbound	23:13:29	0
393127	99	121	113,6	cyclictest	395646	-21	kworker/u4:12+events_unbound	19:47:42	0
393127	99	119	109,6	cyclictest	512791	-21	kworker/u4:2+events_unbound	23:23:30	0
393127	99	113	103,7	cyclictest	512791	-21	kworker/u4:2+events_unbound	23:08:27	0
393127	99	111	101,7	cyclictest	411111	-21	kworker/u4:8+events_unbound	20:42:56	0
393127	99	109	101,6	cyclictest	445455	-21	kworker/u4:8+events_unbound	21:43:09	0
393127	99	108	99,6	cyclictest	416345	-21	kworker/u4:9+events_unbound	20:57:58	0
393127	99	108	101,5	cyclictest	470951	-21	kworker/u4:13+events_unbound	22:23:15	0
393127	99	107	99,6	cyclictest	400798	-21	kworker/u4:1+events_unbound	20:17:48	0
393127	99	106	98,6	cyclictest	393047	-21	kworker/u4:6+events_unbound	19:22:36	0
393127	99	106	91,5	cyclictest	400799	-21	kworker/u4:3+events_unbound	19:52:44	0
393127	99	100	93,5	cyclictest	493324	-21	kworker/u4:6+events_unbound	22:58:22	0
393127	99	98	91,5	cyclictest	413786	-21	kworker/u4:6+events_unbound	20:27:53	0
393127	99	95	85,5	cyclictest	575740	-21	kworker/u4:13+events_unbound	00:33:44	0
393127	99	93	86,5	cyclictest	422899	-21	kworker/u4:4+events_unbound	21:28:06	0
393127	99	93	85,6	cyclictest	478377	-21	kworker/u4:6+events_unbound	22:33:19	0
393127	99	92	84,6	cyclictest	420221	-21	kworker/u4:2+events_unbound	20:52:54	0
393129	99	91	80,7	cyclictest	413785	-21	kworker/u4:4+events_unbound	20:37:53	1
393127	99	91	83,6	cyclictest	408538	-21	kworker/u4:3+events_unbound	20:22:52	0
393127	99	91	83,6	cyclictest	388152	-21	kworker/u4:1+events_unbound	19:17:38	0
393127	99	90	82,6	cyclictest	408538	-21	kworker/u4:3+events_unbound	20:12:48	0
393127	99	90	82,6	cyclictest	408538	-21	kworker/u4:3+events_unbound	20:12:48	0
393129	99	89	82,5	cyclictest	426841	-21	kworker/u4:11+events_unbound	21:12:59	1
393129	99	89	73,5	cyclictest	452890	-21	kworker/u4:1+events_unbound	21:48:11	1
393127	99	88	79,6	cyclictest	422899	-21	kworker/u4:4+events_unbound	21:23:03	0
393127	99	85	39,42	cyclictest	257	50	irq/23-42890000.ethernet	23:15:09	0
393127	99	84	68,13	cyclictest	53	-21	kswapd0	22:15:12	0
393129	99	83	74,6	cyclictest	482153	-21	kworker/u4:9+events_unbound	23:03:24	1
393127	99	83	76,6	cyclictest	452889	-21	kworker/u4:0+events_unbound	21:53:10	0
393129	99	78	70,6	cyclictest	388152	-21	kworker/u4:1+events_unbound	19:17:36	1
393129	99	78	68,7	cyclictest	393048	-21	kworker/u4:7+events_unbound	19:37:40	1
393129	99	76	67,7	cyclictest	441713	-21	kworker/u4:0+events_unbound	21:33:07	1
393129	99	76	45,28	cyclictest	553267	-21	if_eth0	00:00:24	1
393127	99	76	62,6	cyclictest	527841	-21	kworker/u4:0+events_unbound	23:35:01	0
393127	99	75	66,7	cyclictest	531734	-21	kworker/u4:9+events_unbound	23:40:03	0
393129	99	74	65,7	cyclictest	500631	-21	kworker/u4:4+events_unbound	23:18:28	1
393129	99	73	64,6	cyclictest	393048	-21	kworker/u4:7+events_unbound	19:32:41	1
393127	99	72	63,6	cyclictest	445455	-21	kworker/u4:8+events_unbound	21:48:08	0
393129	99	71	63,6	cyclictest	416343	-21	kworker/u4:5+events_unbound	21:08:00	1
393129	99	71	62,6	cyclictest	539488	-21	kworker/u4:4+events_unbound	23:58:38	1
393129	99	70	8,52	cyclictest	537379	-21	ssh	23:40:21	1
393129	99	70	33,34	cyclictest	455606	-21	unixbench-2d	21:50:40	1
393129	99	70	31,6	cyclictest	502946	-21	aten2__	22:55:18	1
393129	99	69	36,4	cyclictest	0	-21	swapper/1	22:05:36	1
393129	99	69	35,31	cyclictest	0	-21	swapper/1	19:30:00	1
393129	99	68	62,4	cyclictest	520032	-21	kworker/u4:11+events_unbound	23:38:33	1
393127	99	68	61,5	cyclictest	562123	-21	kworker/u4:7+events_unbound	00:35:01	0
393129	99	67	33,6	cyclictest	0	-21	swapper/1	00:15:32	1
393129	99	67	30,5	cyclictest	531734	-21	kworker/u4:9-rpciod	00:05:25	1
393129	99	66	8,8	cyclictest	424231	-21	diskmemload	21:55:35	1
393129	99	66	36,5	cyclictest	448323	-21	grep	21:40:42	1
393129	99	65	56,7	cyclictest	400797	-21	kworker/u4:0+events_unbound	20:02:45	1
393129	99	64	55,7	cyclictest	520032	-21	kworker/u4:11+events_unbound	23:28:33	1
393129	99	64	28,7	cyclictest	511656	-21	unixbench-2d	23:05:39	1
393129	99	64	28,6	cyclictest	0	-21	swapper/1	20:20:02	1
393129	99	63	54,6	cyclictest	547200	-21	kworker/u4:13+events_unbound	23:53:37	1
393129	99	63	46,6	cyclictest	482153	-21	kworker/u4:9+events_unbound	22:28:15	1
393127	99	63	57,4	cyclictest	393048	-21	kworker/u4:7+events_unbound	19:35:04	0
393129	99	62	54,6	cyclictest	391824	-21	kworker/u4:5+events_unbound	19:42:42	1
393129	99	62	27,7	cyclictest	560433	-21	df_abs	00:10:19	1
393127	99	62	50,9	cyclictest	1	-21	systemd	00:13:39	0
393127	99	62	45,12	cyclictest	460233	-21	kworker/u4:3+events_unbound	22:05:19	0
393127	99	61	52,6	cyclictest	405976	-21	cron	20:00:00	0
393127	99	61	52,6	cyclictest	405976	-21	cron	19:59:59	0
393129	99	59	50,6	cyclictest	377941	-21	kworker/u4:4+events_unbound	19:12:35	1
393127	99	57	49,6	cyclictest	490237	-21	ssh	22:38:16	0
393129	99	56	46,8	cyclictest	37	-21	kcompactd0	00:30:38	1
393129	99	55	47,5	cyclictest	469782	-21	/usr/sbin/munin	22:10:23	1
393129	99	55	44,8	cyclictest	0	-21	swapper/1	20:50:30	1
393127	99	55	48,5	cyclictest	531734	-21	kworker/u4:9+events_unbound	23:38:26	0
393127	99	55	46,7	cyclictest	572781	-21	kworker/u4:11+events_unbound	00:28:44	0
393127	99	55	40,9	cyclictest	443201	-21	modprobe	21:35:00	0
393129	99	54	46,5	cyclictest	562124	-21	kworker/u4:8+events_unbound	00:25:36	1
393129	99	54	45,6	cyclictest	487705	-21	/usr/sbin/munin	22:35:12	1
393129	99	52	43,6	cyclictest	433552	-21	diskmemload	21:20:42	1
393127	99	52	49,2	cyclictest	404669	-21	kworker/u4:14+events_unbound	20:00:02	0
393127	99	52	45,5	cyclictest	564214	-21	fschecks_time	00:15:20	0
393127	99	52	31,15	cyclictest	0	-21	swapper/0	21:35:32	0
393129	99	51	35,10	cyclictest	53	-21	kswapd0	22:15:11	1
393127	99	51	44,5	cyclictest	464329	-21	sshd	22:03:11	0
393127	99	51	44,5	cyclictest	464329	-21	sshd	22:03:10	0
393127	99	51	32,16	cyclictest	547202	-21	kworker/u4:15-rpciod	23:55:31	0
393127	99	51	1,18	cyclictest	1	-21	systemd	21:18:01	0
393129	99	50	40,6	cyclictest	0	-21	swapper/1	22:23:15	1
393129	99	50	33,5	cyclictest	482153	-21	kworker/u4:9+events_unbound	22:43:17	1
393127	99	50	43,5	cyclictest	492323	-21	diskmemload	22:40:39	0
393127	99	50	28,6	cyclictest	467705	-21	kworker/u4:12+events_unbound	22:47:33	0
393129	99	49	42,5	cyclictest	530439	-21	sh	23:30:31	1
393129	99	49	40,7	cyclictest	404678	-21	systemd	19:52:42	1
393127	99	49	41,6	cyclictest	421591	-21	kworker/u4:7+events_unbound	21:10:00	0
393127	99	49	37,10	cyclictest	548569	-21	latency_hist	23:55:01	0
393129	99	48	41,5	cyclictest	417667	-21	systemd	20:42:54	1
393129	99	48	41,5	cyclictest	407751	-21	fschecks_count	20:05:22	1
393127	99	48	41,5	cyclictest	393125	-21	cyclictest	00:03:39	0
393129	99	47	40,5	cyclictest	462546	-21	ssh	22:00:32	1
393129	99	47	40,5	cyclictest	462546	-21	ssh	22:00:31	1
393129	99	47	40,5	cyclictest	418057	-21	sed	20:45:19	1
393129	99	47	40,5	cyclictest	418057	-21	sed	20:45:18	1
393129	99	47	39,6	cyclictest	412424	-21	systemd	20:22:50	1
393129	99	47	39,6	cyclictest	400797	-21	kworker/u4:0+events_unbound	20:30:01	1
393129	99	47	38,6	cyclictest	411111	-21	kworker/u4:8+events_unbound	21:00:00	1
393127	99	47	38,7	cyclictest	520032	-21	kworker/u4:11+events_unbound	23:27:37	0
393127	99	47	38,5	cyclictest	398985	-21	sshd	19:30:26	0
393127	99	47	35,8	cyclictest	0	-21	swapper/0	23:00:31	0
393127	99	47	30,5	cyclictest	388153	-21	kworker/u4:3+events_unbound	19:12:22	0
393127	99	47	26,14	cyclictest	393048	-21	kworker/u4:7+events_unbound	19:40:33	0
393129	99	46	39,5	cyclictest	571008	-21	latency_hist	00:25:02	1
393129	99	46	39,5	cyclictest	495401	-21	grep	22:45:23	1
393129	99	46	38,6	cyclictest	515294	-21	mailstats	23:10:43	1
393127	99	46	5,16	cyclictest	469969	-21	ntpq	22:10:32	0
393127	99	46	35,9	cyclictest	541548	-21	gltestperf	23:45:22	0
393129	99	45	38,5	cyclictest	393125	-21	cyclictest	21:19:51	1
393129	99	45	38,5	cyclictest	0	-21	swapper/1	21:25:15	1
393129	99	44	35,6	cyclictest	541481	-21	fschecks_time	23:45:22	1
393127	99	44	24,17	cyclictest	0	-21	swapper/0	20:34:59	0
393127	99	44	23,17	cyclictest	0	-21	swapper/0	20:10:01	0
393129	99	43	6,30	cyclictest	498976	-21	ssh	22:50:08	1
393129	99	43	37,4	cyclictest	443542	-21	aten_r7power_cu	21:35:15	1
393129	99	43	32,9	cyclictest	525545	-21	cron	23:24:59	1
393127	99	43	36,6	cyclictest	470951	-21	kworker/u4:13+events_unbound	22:25:03	0
393129	99	42	36,4	cyclictest	396956	-21	systemd	19:22:35	1
393127	99	42	34,5	cyclictest	408538	-21	kworker/u4:3-rpciod	21:05:02	0
393129	99	41	32,6	cyclictest	0	-21	swapper/1	00:35:31	1
393129	99	41	27,10	cyclictest	37	-21	kcompactd0	19:45:35	1
393127	99	41	34,5	cyclictest	413785	-21	kworker/u4:4+events_unbound	20:39:36	0
393129	99	40	31,7	cyclictest	485076	-21	timerandwakeup	22:30:40	1
393129	99	40	29,8	cyclictest	0	-21	swapper/1	19:55:36	1
393129	99	40	29,8	cyclictest	0	-21	swapper/1	19:55:36	1
393129	99	39	30,5	cyclictest	0	-21	swapper/1	20:35:01	1
393127	99	39	28,7	cyclictest	0	-21	swapper/0	20:45:43	0
393127	99	39	28,7	cyclictest	0	-21	swapper/0	20:45:43	0
393129	99	38	31,4	cyclictest	421850	-21	aten2__	21:00:18	1
393129	99	38	28,6	cyclictest	0	-21	swapper/1	20:10:39	1
393129	99	38	28,6	cyclictest	0	-21	swapper/1	20:10:38	1
393129	99	29	22,5	cyclictest	0	-21	swapper/1	19:10:00	1
393127	99	27	6,15	cyclictest	393125	-21	cyclictest	19:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17