OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Sat Jan 03, 2026 12:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3919173	99	106	93,9	cyclictest	3964401	-21	kworker/u4:16+events_unbound	09:30:35	1
3919173	99	89	81,6	cyclictest	4018646	-21	kworker/u4:9+events_unbound	10:35:58	1
3919172	99	88	34,29	cyclictest	4028946	-21	apt-get	10:45:11	0
3919173	99	86	76,7	cyclictest	3925440	-21	kworker/u4:8+events_unbound	07:50:12	1
3919173	99	85	77,6	cyclictest	3945821	-21	kworker/u4:3+events_unbound	09:10:49	1
3919173	99	84	74,7	cyclictest	3915442	-21	kworker/u4:1+events_unbound	08:05:28	1
3919173	99	80	73,5	cyclictest	4010190	-21	kworker/u4:0+events_unbound	10:56:01	1
3919173	99	75	63,8	cyclictest	3906828	-21	kworker/u4:9+events_unbound	07:15:00	1
3919173	99	73	64,6	cyclictest	4014415	-21	kworker/u4:5+events_unbound	10:50:01	1
3919173	99	72	51,6	cyclictest	3949611	-21	kworker/u4:6+events_unbound	10:20:55	1
3919172	99	72	28,14	cyclictest	3934643	-21	apt-get	08:10:12	0
3919172	99	70	49,15	cyclictest	54	-21	kswapd0	11:05:08	0
3919172	99	67	31,8	cyclictest	3939703	-21	apt-get	08:30:12	0
3919172	99	67	26,13	cyclictest	4001373	-21	ssh	10:11:12	0
3919173	99	66	56,7	cyclictest	4088878	-21	kworker/u4:1+events_unbound	12:05:15	1
3919172	99	66	20,25	cyclictest	0	-21	swapper/0	10:05:00	0
3919172	99	65	51,9	cyclictest	3979887	-21	ntp_states	09:45:35	0
3919172	99	65	51,9	cyclictest	3979887	-21	ntp_states	09:45:35	0
3919172	99	65	50,10	cyclictest	4072202	-21	kworker/u4:15+events_unbound	11:46:10	0
3919172	99	64	37,23	cyclictest	3958082	-21	ssh	09:20:00	0
3919172	99	64	32,3	cyclictest	3974872	-21	apt-get	09:40:11	0
3919172	99	64	25,14	cyclictest	3921155	-21	ntpq	07:15:28	0
3919172	99	64	25,14	cyclictest	3921155	-21	ntpq	07:15:27	0
3919172	99	64	24,15	cyclictest	4069868	-21	ssh	11:34:40	0
3919172	99	64	24,15	cyclictest	3964383	-21	ssh	09:26:39	0
3919172	99	63	57,4	cyclictest	54	-21	kswapd0	10:40:12	0
3919172	99	63	57,4	cyclictest	54	-21	kswapd0	10:40:12	0
3919172	99	63	26,10	cyclictest	4057154	-21	ssh	11:19:06	0
3919172	99	63	25,12	cyclictest	4021289	-21	ntpq	10:35:24	0
3919172	99	63	24,11	cyclictest	4085324	-21	ssh	11:53:05	0
3919172	99	63	23,15	cyclictest	4040227	-21	ssh	10:58:26	0
3919173	99	62	54,6	cyclictest	4088881	-21	kworker/u4:4+events_unbound	12:11:13	1
3919173	99	62	54,5	cyclictest	3915445	-21	kworker/u4:6+events_unbound	08:15:00	1
3919173	99	62	53,7	cyclictest	3975967	-21	/usr/sbin/munin	09:40:37	1
3919172	99	62	32,10	cyclictest	4116220	-21	ntpq	12:30:27	0
3919172	99	62	22,14	cyclictest	4020214	-21	ssh	10:34:50	0
3919172	99	61	24,13	cyclictest	4045074	-21	ssh	11:04:32	0
3919172	99	61	19,18	cyclictest	4004704	-21	ntpq	10:15:31	0
3919173	99	60	52,6	cyclictest	3964400	-21	kworker/u4:15+events_unbound	10:16:01	1
3919172	99	60	40,17	cyclictest	3987307	-21	apt-get	09:55:13	0
3919172	99	60	39,14	cyclictest	4099758	-21	ssh	12:10:27	0
3919172	99	60	24,14	cyclictest	4077904	-21	ssh	11:44:26	0
3919172	99	60	22,14	cyclictest	3926180	-21	ntpq	07:35:30	0
3919172	99	60	22,13	cyclictest	3984084	-21	ntpq	09:50:39	0
3919172	99	60	22,13	cyclictest	3984084	-21	ntpq	09:50:39	0
3919172	99	60	20,19	cyclictest	3966905	-21	diskstats	09:30:19	0
3919172	99	60	17,22	cyclictest	4095688	-21	sh	12:05:29	0
3919173	99	59	52,5	cyclictest	4027110	-21	kworker/u4:3+events_unbound	10:51:12	1
3919172	99	59	23,11	cyclictest	3932643	-21	ntpq	08:00:27	0
3919172	99	59	18,19	cyclictest	3971508	-21	ntpq	09:35:32	0
3919172	99	59	18,19	cyclictest	3971508	-21	ntpq	09:35:32	0
3919173	99	58	49,7	cyclictest	3984489	-21	unixbench_singl	09:50:45	1
3919173	99	58	49,7	cyclictest	3984489	-21	unixbench_singl	09:50:44	1
3919172	99	58	42,11	cyclictest	3948547	-21	apt-get	09:05:10	0
3919172	99	58	38,15	cyclictest	3928867	-21	ps	07:45:33	0
3919172	99	58	34,5	cyclictest	3919145	-21	munin-run	07:10:00	0
3919172	99	58	22,12	cyclictest	4103956	-21	ntpq	12:15:33	0
3919172	99	58	22,10	cyclictest	4121347	-21	ssh	12:36:22	0
3919172	99	58	21,10	cyclictest	3930045	-21	ntpq	07:50:29	0
3919173	99	57	49,6	cyclictest	3927975	-21	kworker/u4:13+events_unbound	08:15:32	1
3919172	99	57	50,5	cyclictest	4112704	-21	/usr/sbin/munin	12:25:40	0
3919172	99	57	40,12	cyclictest	4108034	-21	ssh	12:20:28	0
3919172	99	57	40,12	cyclictest	3926920	-21	apt-get	07:40:12	0
3919172	99	57	35,20	cyclictest	3924649	-21	fschecks_count	07:30:18	0
3919172	99	57	35,19	cyclictest	3921877	-21	apt-get	07:20:11	0
3919172	99	57	22,12	cyclictest	4050558	-21	ntpq	11:10:31	0
3919172	99	57	20,14	cyclictest	3996376	-21	ntpq	10:05:30	0
3919172	99	57	16,21	cyclictest	3923856	-21	grep	07:25:36	0
3919172	99	57	15,24	cyclictest	3959046	-21	ssh	09:20:23	0
3919173	99	56	47,7	cyclictest	4072203	-21	kworker/u4:16+events_unbound	11:42:43	1
3919173	99	56	47,7	cyclictest	3915445	-21	kworker/u4:6+events_unbound	08:05:02	1
3919172	99	56	37,15	cyclictest	4070368	-21	apt-get	11:35:12	0
3919172	99	56	37,14	cyclictest	4057978	-21	apt-get	11:20:10	0
3919172	99	56	21,13	cyclictest	4033411	-21	diskstats	10:50:19	0
3919172	99	56	20,16	cyclictest	4008959	-21	ntp_states	10:20:32	0
3919173	99	55	47,5	cyclictest	3919105	-21	kworker/u4:2+events_unbound	07:55:14	1
3919173	99	55	42,9	cyclictest	4051884	-21	kworker/u4:2+events_unbound	11:25:13	1
3919173	99	55	36,9	cyclictest	4010190	-21	kworker/u4:0-rpciod	11:05:08	1
3919172	99	55	36,15	cyclictest	3934041	-21	ntpq	08:05:36	0
3919172	99	55	3,43	cyclictest	54	-21	kswapd0	11:25:11	0
3919173	99	54	47,5	cyclictest	4047712	-21	kworker/u4:1+events_unbound	11:16:06	1
3919173	99	54	47,5	cyclictest	3998045	-21	kworker/u4:2+events_unbound	10:33:01	1
3919173	99	54	45,7	cyclictest	4010190	-21	kworker/u4:0+events_unbound	10:40:12	1
3919173	99	54	45,7	cyclictest	4010190	-21	kworker/u4:0+events_unbound	10:40:12	1
3919173	99	54	45,6	cyclictest	4013756	-21	sshd	10:25:54	1
3919172	99	54	6,38	cyclictest	0	-21	swapper/0	07:55:10	0
3919172	99	54	24,26	cyclictest	3947126	-21	sendmail	09:00:00	0
3919172	99	54	22,16	cyclictest	0	-21	swapper/0	09:10:31	0
3919172	99	54	20,12	cyclictest	4013166	-21	ntp_states	10:25:36	0
3919172	99	53	39,10	cyclictest	3942808	-21	ntpq	08:40:25	0
3919172	99	53	36,14	cyclictest	3937191	-21	apt-get	08:20:11	0
3919172	99	53	36,14	cyclictest	3936586	-21	ps	08:15:35	0
3919172	99	53	28,8	cyclictest	3943719	-21	df_inode	08:45:18	0
3919173	99	52	45,5	cyclictest	4051884	-21	kworker/u4:2+events_unbound	11:21:06	1
3919173	99	52	44,6	cyclictest	4088878	-21	kworker/u4:1+events_unbound	12:04:00	1
3919172	99	52	38,10	cyclictest	3947898	-21	ntpq	09:00:28	0
3919172	99	52	38,10	cyclictest	3919917	-21	ntpq	07:10:29	0
3919172	99	52	36,12	cyclictest	3941604	-21	ntpq	08:35:32	0
3919172	99	52	34,14	cyclictest	4091579	-21	ntpq	12:00:29	0
3919173	99	51	44,5	cyclictest	4105559	-21	kworker/u4:4+events_unbound	12:25:02	1
3919173	99	51	44,4	cyclictest	4082854	-21	df_abs	11:50:18	1
3919173	99	51	36,8	cyclictest	0	-21	swapper/1	09:49:57	1
3919173	99	51	36,8	cyclictest	0	-21	swapper/1	09:49:57	1
3919172	99	51	35,12	cyclictest	4086716	-21	apt-get	11:55:13	0
3919172	99	51	32,15	cyclictest	3945327	-21	ntpq	08:50:36	0
3919173	99	50	40,4	cyclictest	0	-21	swapper/1	09:05:32	1
3919172	99	50	18,10	cyclictest	3939542	-21	munin-run	08:30:00	0
3919173	99	49	42,5	cyclictest	4104785	-21	ssh	12:16:12	1
3919173	99	49	1,40	cyclictest	4067055	-21	ntp_states	11:30:34	1
3919173	99	48	39,6	cyclictest	3974589	-21	kworker/u4:10	09:40:00	1
3919173	99	48	39,6	cyclictest	3974589	-21	kworker/u4:10	09:39:59	1
3919173	99	48	38,7	cyclictest	4042466	-21	mailstats	11:00:38	1
3919173	99	48	37,7	cyclictest	0	-21	swapper/1	12:30:35	1
3919173	99	47	40,5	cyclictest	3942271	-21	aten2__	08:40:16	1
3919173	99	47	38,7	cyclictest	3924701	-21	fschecks_time	07:30:20	1
3919173	99	47	37,8	cyclictest	4121299	-21	sshd	12:36:18	1
3919173	99	47	37,7	cyclictest	4087437	-21	diskmemload	11:55:26	1
3919173	99	47	26,10	cyclictest	27	1	ktimers/1	11:45:35	1
3919173	99	46	38,6	cyclictest	3939508	-21	kworker/u4:14+events_unbound	09:00:46	1
3919173	99	46	36,7	cyclictest	3964400	-21	kworker/u4:15-rpciod	09:55:39	1
3919173	99	45	42,2	cyclictest	3972767	-21	kworker/u4:19+events_unbound	10:00:53	1
3919173	99	45	38,5	cyclictest	4097208	-21	kworker/u4:0+events_unbound	12:26:08	1
3919173	99	45	38,5	cyclictest	3995612	-21	dpkg	10:05:13	1
3919173	99	45	38,5	cyclictest	3981211	-21	kworker/u4:3+events_unbound	10:10:16	1
3919173	99	45	36,7	cyclictest	3944181	-21	ps	08:45:33	1
3919173	99	45	35,8	cyclictest	3924149	-21	sed	07:25:38	1
3919173	99	45	34,8	cyclictest	4051289	-21	sshd	11:11:03	1
3919173	99	45	27,14	cyclictest	0	-21	swapper/1	08:35:24	1
3919173	99	44	37,5	cyclictest	3963068	-21	uname	09:25:23	1
3919173	99	43	36,5	cyclictest	3920384	-21	kworker/u4:5+events_unbound	07:40:11	1
3919173	99	43	35,6	cyclictest	3949614	-21	kworker/u4:9+events_unbound	09:15:47	1
3919173	99	43	34,6	cyclictest	0	-21	swapper/1	08:55:27	1
3919173	99	42	36,4	cyclictest	4071318	-21	mailstats	11:35:38	1
3919173	99	42	36,4	cyclictest	3927976	-21	kworker/u4:14+events_unbound	07:45:28	1
3919173	99	42	34,6	cyclictest	3915443	-21	kworker/u4:3+events_unbound	07:35:35	1
3919173	99	42	33,6	cyclictest	0	-21	swapper/1	09:20:10	1
3919173	99	42	23,10	cyclictest	17	1	rcu_preempt	08:30:18	1
3919173	99	41	33,6	cyclictest	3934446	-21	kworker/u4:0-rpciod	08:25:17	1
3919173	99	39	31,6	cyclictest	3921691	-21	sendmail	07:20:01	1
3919173	99	39	31,6	cyclictest	3921691	-21	sendmail	07:20:01	1
3919173	99	38	30,6	cyclictest	0	-21	swapper/1	08:55:01	1
3919173	99	38	18,7	cyclictest	3915442	-21	kworker/u4:1+events_unbound	07:20:19	1
3919173	99	36	29,5	cyclictest	3937298	-21	wget	08:20:17	1
3919173	99	31	25,4	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17