OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Fri Feb 06, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
826461	99	92	35,34	cyclictest	0	-21	swapper/1	09:40:12	1
826459	99	88	79,7	cyclictest	920482	-21	kworker/u4:4+events_unbound	10:29:50	0
826459	99	87	82,3	cyclictest	994317	-21	kworker/u4:12+events_unbound	11:50:01	0
826459	99	87	70,5	cyclictest	848128	-21	kworker/u4:12+events_unbound	09:19:37	0
826459	99	86	75,9	cyclictest	920482	-21	kworker/u4:4+events_unbound	10:24:45	0
826459	99	86	65,19	cyclictest	968411	-21	kworker/u4:8+events_unbound	11:30:00	0
826461	99	84	77,5	cyclictest	0	-21	swapper/1	12:25:33	1
826459	99	84	77,5	cyclictest	950770	-21	kworker/u4:9+events_unbound	11:09:57	0
826459	99	79	70,7	cyclictest	836688	-21	kworker/u4:0+events_unbound	10:04:41	0
826461	99	74	67,5	cyclictest	836689	-21	kworker/u4:8+events_unbound	07:50:01	1
826461	99	72	61,8	cyclictest	927584	-21	kworker/u4:9+events_unbound	10:39:49	1
826459	99	72	66,4	cyclictest	829020	-21	kworker/u4:15+events_unbound	07:35:01	0
826461	99	71	40,26	cyclictest	834079	-21	systemd	07:39:15	1
826461	99	71	37,28	cyclictest	958689	-21	/usr/sbin/munin	11:05:39	1
826459	99	71	63,6	cyclictest	1031769	-21	kworker/u4:0+events_unbound	12:35:07	0
826459	99	71	51,14	cyclictest	0	-21	swapper/0	11:35:25	0
826461	99	69	2,15	cyclictest	954918	-21	ssh	11:01:33	1
826459	99	69	62,5	cyclictest	914438	-21	/usr/sbin/munin	10:15:21	0
826461	99	68	35,30	cyclictest	0	-21	swapper/1	10:30:11	1
826461	99	67	32,29	cyclictest	854500	-21	sendmail-msp	09:00:01	1
826461	99	67	30,30	cyclictest	0	-21	swapper/1	11:50:24	1
826459	99	67	60,5	cyclictest	890109	-21	kworker/u4:10+events_unbound	09:49:40	0
826459	99	66	49,14	cyclictest	54	-21	kswapd0	11:45:08	0
826461	99	65	57,6	cyclictest	968408	-21	kworker/u4:5+events_unbound	11:24:58	1
826461	99	65	56,6	cyclictest	959576	-21	kworker/u4:4+events_unbound	11:14:55	1
826461	99	65	33,30	cyclictest	906154	-21	timerandwakeup	10:05:36	1
826461	99	65	33,30	cyclictest	906154	-21	timerandwakeup	10:05:35	1
826461	99	65	28,29	cyclictest	918881	-21	ssh	10:20:24	1
826459	99	65	9,16	cyclictest	826437	-21	munin-run	07:09:59	0
826459	99	65	56,6	cyclictest	15	1	ktimers/0	09:21:48	0
826461	99	64	59,3	cyclictest	927586	-21	kworker/u4:11+events_unbound	10:44:51	1
826461	99	64	4,55	cyclictest	949425	-21	ntpq	10:55:27	1
826461	99	64	35,26	cyclictest	843133	-21	grep	08:15:01	1
826461	99	64	35,26	cyclictest	1003031	-21	kworker/u4:8-rpciod	12:00:01	1
826459	99	64	57,5	cyclictest	841734	-21	kworker/u4:3+events_unbound	08:25:00	0
826459	99	63	53,7	cyclictest	896737	-21	grep	09:55:20	0
826461	99	62	58,3	cyclictest	968410	-21	kworker/u4:7+events_unbound	11:40:02	1
826461	99	61	29,28	cyclictest	0	-21	swapper/1	11:30:30	1
826461	99	61	28,30	cyclictest	1006313	-21	/usr/sbin/munin	12:00:45	1
826461	99	61	28,30	cyclictest	1006313	-21	/usr/sbin/munin	12:00:45	1
826461	99	61	2,21	cyclictest	923197	-21	ntpq	10:25:24	1
826461	99	61	1,6	cyclictest	909537	-21	ssh	10:10:13	1
826459	99	61	53,6	cyclictest	950768	-21	kworker/u4:6+events_unbound	10:57:44	0
826461	99	60	32,26	cyclictest	988547	-21	ntp_kernel_pll_	11:40:25	1
826461	99	60	31,26	cyclictest	0	-21	swapper/1	09:55:30	1
826461	99	60	2,16	cyclictest	857418	-21	apt-get	09:10:17	1
826459	99	60	50,7	cyclictest	927583	-21	kworker/u4:1+events_unbound	10:35:01	0
826459	99	60	48,7	cyclictest	1021716	-21	/usr/sbin/munin	12:20:23	0
826461	99	59	33,24	cyclictest	54	-21	kswapd0	11:15:11	1
826461	99	59	3,18	cyclictest	1068	-21	snmpd	10:53:24	1
826461	99	59	2,15	cyclictest	851465	-21	ntpq	08:45:28	1
826461	99	59	14,29	cyclictest	1011201	-21	ssh	12:06:32	1
826459	99	59	49,8	cyclictest	314	-21	systemd-journal	09:29:37	0
826459	99	59	46,6	cyclictest	0	-21	swapper/0	10:45:27	0
826461	99	58	4,5	cyclictest	875422	-21	ntpq	09:30:25	1
826461	99	58	4,50	cyclictest	940011	-21	apt-get	10:45:15	1
826461	99	58	30,24	cyclictest	834066	-21	kworker/u4:7-rpciod	09:25:02	1
826461	99	58	26,29	cyclictest	837027	-21	aten_r7power_vo	07:50:18	1
826461	99	58	26,29	cyclictest	0	-21	swapper/1	11:25:21	1
826461	99	58	24,31	cyclictest	0	-21	swapper/1	12:15:34	1
826461	99	58	1,15	cyclictest	832326	-21	ntpq	07:30:27	1
826459	99	58	50,6	cyclictest	836688	-21	kworker/u4:0+events_unbound	09:34:38	0
826459	99	58	49,6	cyclictest	1027443	-21	kworker/u4:3+events_unbound	12:30:33	0
826459	99	58	49,5	cyclictest	826456	-21	cyclictest	10:54:24	0
826459	99	58	48,6	cyclictest	1003032	-21	kworker/u4:10-rpciod	12:00:10	0
826459	99	58	48,6	cyclictest	1003032	-21	kworker/u4:10-rpciod	12:00:09	0
826461	99	57	4,7	cyclictest	843822	-21	ntpq	08:15:20	1
826461	99	57	3,12	cyclictest	879059	-21	ssh	09:35:13	1
826461	99	57	3,12	cyclictest	879059	-21	ssh	09:35:13	1
826461	99	57	25,30	cyclictest	890108	-21	kworker/u4:8-nfsiod	09:50:30	1
826461	99	57	25,28	cyclictest	0	-21	swapper/1	08:50:19	1
826461	99	57	2,12	cyclictest	1034176	-21	ssh	12:35:18	1
826461	99	57	19,34	cyclictest	0	-21	swapper/1	09:25:36	1
826459	99	57	47,8	cyclictest	54	-21	kswapd0	10:35:15	0
826461	99	56	4,48	cyclictest	1021118	-21	ssh	12:20:13	1
826461	99	56	3,8	cyclictest	846424	-21	ntpq	08:25:28	1
826461	99	56	3,7	cyclictest	913854	-21	ssh	10:15:13	1
826461	99	56	31,23	cyclictest	849670	-21	aten_r7power_en	08:40:14	1
826461	99	56	30,23	cyclictest	0	-21	swapper/1	09:15:27	1
826461	99	56	27,26	cyclictest	0	-21	swapper/1	12:30:32	1
826461	99	56	24,29	cyclictest	0	-21	swapper/1	10:00:24	1
826461	99	55	3,9	cyclictest	887718	-21	apt-get	09:45:17	1
826461	99	55	2,7	cyclictest	993065	-21	ssh	11:45:37	1
826461	99	55	2,16	cyclictest	831053	-21	ntpq	07:25:24	1
826461	99	55	10,42	cyclictest	1068	-21	snmpd	07:15:45	1
826459	99	55	46,6	cyclictest	855170	-21	gltestperf	09:00:26	0
826459	99	55	45,5	cyclictest	0	-21	swapper/0	09:10:12	0
826461	99	54	3,8	cyclictest	847077	-21	sshd	08:30:13	1
826461	99	54	2,6	cyclictest	848977	-21	ntpq	08:35:32	1
826461	99	54	26,26	cyclictest	0	-21	swapper/1	09:05:18	1
826461	99	54	21,30	cyclictest	841733	-21	kworker/u4:2-rpciod	08:07:15	1
826461	99	54	1,13	cyclictest	1015468	-21	ssh	12:13:16	1
826459	99	54	44,6	cyclictest	903362	-21	kworker/u4:7+events_unbound	10:10:01	0
826459	99	54	44,6	cyclictest	903362	-21	kworker/u4:7+events_unbound	10:10:01	0
826459	99	54	40,4	cyclictest	834066	-21	kworker/u4:7+events_unbound	08:30:02	0
826461	99	53	3,5	cyclictest	0	-21	swapper/1	07:40:11	1
826461	99	53	1,12	cyclictest	845113	-21	ntpq	08:20:25	1
826459	99	53	42,6	cyclictest	0	-21	swapper/0	07:55:00	0
826461	99	52	4,7	cyclictest	826696	-21	apt-get	07:10:19	1
826461	99	52	2,10	cyclictest	829228	-21	/usr/sbin/munin	07:20:38	1
826459	99	52	43,6	cyclictest	936317	-21	/usr/sbin/munin	10:40:23	0
826461	99	51	8,35	cyclictest	821597	-21	kworker/u4:4+rpciod	08:00:01	1
826461	99	51	20,27	cyclictest	0	-21	swapper/1	09:00:35	1
826459	99	51	7,7	cyclictest	17	1	rcu_preempt	09:35:12	0
826459	99	51	7,7	cyclictest	17	1	rcu_preempt	09:35:12	0
826459	99	51	44,5	cyclictest	826456	-21	cyclictest	11:30:20	0
826459	99	51	43,6	cyclictest	826388	-21	kworker/u4:7+events_unbound	07:10:43	0
826459	99	51	41,6	cyclictest	953463	-21	fschecks_count	11:00:20	0
826459	99	50	39,7	cyclictest	963988	-21	kworker/u4:1-rpciod	11:19:53	0
826461	99	49	23,24	cyclictest	0	-21	swapper/1	08:00:16	1
826459	99	49	42,5	cyclictest	890105	-21	kworker/u4:3+events_unbound	09:53:59	0
826459	99	48	40,6	cyclictest	1010065	-21	ntp_kernel_pll_	12:05:28	0
826459	99	48	38,7	cyclictest	1018751	-21	ssh	12:16:40	0
826459	99	47	40,5	cyclictest	1001467	-21	/usr/sbin/munin	11:55:27	0
826459	99	47	32,9	cyclictest	1016536	-21	modprobe	12:15:01	0
826459	99	47	2,12	cyclictest	835382	-21	apt-get	07:45:10	0
826459	99	46	37,7	cyclictest	849935	-21	fschecks_time	08:40:17	0
826459	99	46	35,7	cyclictest	971731	-21	ssh	11:20:38	0
826459	99	46	35,7	cyclictest	1026564	-21	/usr/sbin/munin	12:25:38	0
826459	99	45	37,6	cyclictest	826456	-21	cyclictest	11:10:25	0
826459	99	45	37,5	cyclictest	910794	-21	unixbench_singl	10:10:37	0
826459	99	45	36,7	cyclictest	884561	-21	grep	09:40:38	0
826459	99	45	36,7	cyclictest	857161	-21	latency_hist	09:10:02	0
826459	99	45	32,10	cyclictest	841973	-21	latency_hist	08:10:02	0
826459	99	44	38,4	cyclictest	834489	-21	df_abs	07:40:16	0
826459	99	44	36,6	cyclictest	988212	-21	fschecks_count	11:40:18	0
826459	99	44	36,6	cyclictest	843600	-21	fschecks_time	08:15:17	0
826459	99	44	35,6	cyclictest	843102	-21	sh	08:15:00	0
826459	99	44	35,6	cyclictest	839495	-21	aten_r7power_en	08:00:14	0
826461	99	43	1,4	cyclictest	826531	-21	cat	07:10:01	1
826459	99	43	36,5	cyclictest	852234	-21	aten_r7power_vo	08:50:15	0
826459	99	42	36,4	cyclictest	830740	-21	fschecks_count	07:25:18	0
826459	99	42	35,5	cyclictest	827981	-21	grep	07:15:14	0
826459	99	42	34,6	cyclictest	838173	-21	aten2__	07:55:16	0
826459	99	41	32,6	cyclictest	0	-21	swapper/0	07:20:13	0
826459	99	40	31,6	cyclictest	0	-21	swapper/0	07:35:16	0
826459	99	39	33,4	cyclictest	847109	-21	aten_r7power_cu	08:30:15	0
826459	99	39	32,5	cyclictest	849351	-21	unixbench_singl	08:35:37	0
826459	99	38	29,7	cyclictest	854228	-21	timerandwakeup	08:55:35	0
826459	99	37	29,5	cyclictest	0	-21	swapper/0	08:45:35	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17