OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Thu Mar 19, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3510333	99	92	83,6	cyclictest	3534749	-21	kworker/u4:3+events_unbound	08:55:40	0
3510333	99	84	76,6	cyclictest	3512932	-21	kworker/u4:12+events_unbound	08:20:29	0
3510336	99	80	70,7	cyclictest	0	-21	swapper/1	10:20:23	1
3510333	99	76	68,6	cyclictest	3723107	-21	kworker/u4:10+events_unbound	12:36:11	0
3510333	99	75	68,5	cyclictest	53	-21	kswapd0	11:55:02	0
3510333	99	72	62,7	cyclictest	53	-21	kswapd0	12:10:01	0
3510333	99	69	59,7	cyclictest	3605153	-21	kworker/u4:1+events_unbound	10:40:00	0
3510333	99	67	58,5	cyclictest	3684276	-21	kworker/u4:10+events_unbound	12:00:02	0
3510333	99	67	54,11	cyclictest	53	-21	kswapd0	09:55:11	0
3510336	99	66	34,30	cyclictest	3599622	-21	switchtime	10:15:41	1
3510336	99	66	32,31	cyclictest	3589979	-21	aten_r7power_vo	10:05:18	1
3510336	99	66	32,31	cyclictest	3589979	-21	aten_r7power_vo	10:05:17	1
3510336	99	66	27,36	cyclictest	3696007	-21	sh	12:05:29	1
3510333	99	66	57,6	cyclictest	0	-21	swapper/0	11:10:27	0
3510336	99	65	35,28	cyclictest	3652595	-21	tail	11:15:43	1
3510336	99	64	32,29	cyclictest	3572511	-21	df_abs	09:45:18	1
3510336	99	64	31,31	cyclictest	3665600	-21	timerandwakeup	11:30:36	1
3510336	99	64	30,32	cyclictest	0	-21	swapper/1	09:10:21	1
3510336	99	64	30,31	cyclictest	0	-21	swapper/1	11:10:35	1
3510336	99	64	28,33	cyclictest	0	-21	swapper/1	08:45:37	1
3510336	99	64	2,17	cyclictest	3581075	-21	apt-get	09:55:18	1
3510333	99	64	55,6	cyclictest	3524439	-21	kworker/u4:16+events_unbound	08:15:28	0
3510333	99	64	45,15	cyclictest	3594196	-21	apt-get	10:10:17	0
3510333	99	64	44,15	cyclictest	3629484	-21	ssh	10:50:15	0
3510333	99	64	44,15	cyclictest	3629484	-21	ssh	10:50:14	0
3510336	99	63	5,7	cyclictest	3576639	-21	apt-get	09:50:12	1
3510336	99	63	48,12	cyclictest	3708382	-21	apt-get	12:20:10	1
3510336	99	63	31,29	cyclictest	3633831	-21	aten2__	10:55:22	1
3510336	99	63	29,31	cyclictest	0	-21	swapper/1	11:40:27	1
3510336	99	63	28,32	cyclictest	3531153	-21	aten_r7power_vo	08:30:16	1
3510336	99	62	55,5	cyclictest	3679237	-21	ssh	11:46:03	1
3510336	99	62	50,9	cyclictest	53	-21	kswapd0	11:55:16	1
3510336	99	61	5,18	cyclictest	3629538	-21	ssh	10:50:27	1
3510336	99	61	5,18	cyclictest	3629538	-21	ssh	10:50:27	1
3510336	99	61	3,6	cyclictest	3559936	-21	ssh	09:30:37	1
3510336	99	61	31,27	cyclictest	3717504	-21	cut	12:30:17	1
3510336	99	61	31,27	cyclictest	0	-21	swapper/1	12:25:28	1
3510336	99	61	30,29	cyclictest	432	-21	systemd-network	10:49:43	1
3510336	99	61	30,29	cyclictest	0	-21	swapper/1	10:40:22	1
3510336	99	61	26,30	cyclictest	0	-21	swapper/1	08:10:21	1
3510336	99	61	2,11	cyclictest	3643182	-21	ssh	11:05:27	1
3510333	99	61	2,23	cyclictest	3651006	-21	apt-get	11:15:08	0
3510336	99	60	27,28	cyclictest	0	-21	swapper/1	09:05:40	1
3510336	99	60	25,31	cyclictest	0	-21	swapper/1	10:30:16	1
3510336	99	60	2,18	cyclictest	3655764	-21	ssh	11:20:14	1
3510336	99	60	2,11	cyclictest	3567853	-21	apt-get	09:40:11	1
3510333	99	60	49,7	cyclictest	3585761	-21	/usr/sbin/munin	10:00:23	0
3510333	99	60	31,26	cyclictest	3541151	-21	cron	09:10:00	0
3510336	99	59	52,5	cyclictest	3700661	-21	switchtime	12:10:38	1
3510336	99	59	3,6	cyclictest	3595211	-21	ps	10:10:48	1
3510336	99	59	30,26	cyclictest	0	-21	swapper/1	12:40:02	1
3510336	99	59	29,28	cyclictest	3692062	-21	unixbench_multi	12:00:39	1
3510336	99	59	28,28	cyclictest	0	-21	swapper/1	11:50:16	1
3510336	99	59	28,28	cyclictest	0	-21	swapper/1	10:25:25	1
3510336	99	59	16,39	cyclictest	0	-21	swapper/1	09:25:36	1
3510336	99	58	8,40	cyclictest	3510335	-21	kworker/u4:13	07:10:02	1
3510336	99	58	3,7	cyclictest	3638163	-21	ssh	11:00:17	1
3510336	99	58	35,20	cyclictest	3533936	-21	uniq	08:40:18	1
3510336	99	58	24,32	cyclictest	3529630	-21	latency_hist	08:25:01	1
3510336	99	58	2,16	cyclictest	3616820	-21	ntpq	10:35:23	1
3510336	99	58	1,16	cyclictest	3518859	-21	ntpq	07:40:26	1
3510336	99	57	2,15	cyclictest	3551209	-21	sh	09:20:39	1
3510333	99	57	45,8	cyclictest	3538971	-21	df	09:00:19	0
3510336	99	56	3,7	cyclictest	3517605	-21	ntpq	07:35:31	1
3510336	99	56	3,13	cyclictest	3566480	-21	ssh	09:38:20	1
3510336	99	56	28,25	cyclictest	3532343	-21	apt-key	08:35:02	1
3510336	99	56	22,31	cyclictest	0	-21	swapper/1	08:15:16	1
3510336	99	56	2,12	cyclictest	3547264	-21	ssh	09:15:45	1
3510336	99	56	19,34	cyclictest	0	-21	swapper/1	08:25:28	1
3510336	99	56	1,14	cyclictest	3513771	-21	ntpq	07:20:29	1
3510336	99	55	4,7	cyclictest	3585457	-21	ssh	10:00:14	1
3510336	99	55	2,7	cyclictest	3524024	-21	ntpq	08:00:33	1
3510336	99	55	26,26	cyclictest	0	-21	swapper/1	07:50:29	1
3510336	99	55	2,14	cyclictest	3671553	-21	ssh	11:37:46	1
3510336	99	55	2,13	cyclictest	3706150	-21	ssh	12:16:58	1
3510336	99	55	2,13	cyclictest	3706150	-21	ssh	12:16:58	1
3510336	99	55	14,38	cyclictest	3501665	-21	kworker/u4:13-rpciod	07:10:25	1
3510336	99	55	1,12	cyclictest	3660866	-21	ssh	11:25:30	1
3510333	99	55	3,42	cyclictest	3559027	-21	ssh	09:30:04	0
3510336	99	54	47,5	cyclictest	3512242	-21	gltestperf	07:15:20	1
3510336	99	54	1,12	cyclictest	3514955	-21	/usr/sbin/munin	07:25:22	1
3510336	99	54	1,12	cyclictest	3514955	-21	/usr/sbin/munin	07:25:22	1
3510333	99	54	42,9	cyclictest	3510568	-21	apt-get	07:10:14	0
3510333	99	54	33,17	cyclictest	3632036	-21	kworker/u4:8+rpciod	11:05:00	0
3510336	99	53	3,5	cyclictest	3536789	-21	ntpq	08:50:25	1
3510333	99	53	6,11	cyclictest	3655696	-21	apt-get	11:20:15	0
3510333	99	53	43,7	cyclictest	3530367	-21	sshd	08:25:30	0
3510333	99	53	38,9	cyclictest	3554488	-21	ls	09:25:02	0
3510333	99	53	38,9	cyclictest	0	-21	swapper/0	11:05:40	0
3510333	99	53	37,12	cyclictest	0	-21	swapper/0	10:20:12	0
3510333	99	53	30,19	cyclictest	0	-21	swapper/0	11:40:36	0
3510336	99	52	2,7	cyclictest	3520079	-21	ntpq	07:45:25	1
3510336	99	52	22,28	cyclictest	0	-21	swapper/1	08:05:20	1
3510336	99	52	1,11	cyclictest	3539445	-21	ntpq	09:00:37	1
3510333	99	52	44,6	cyclictest	3675356	-21	kworker/u4:1+events_unbound	11:50:00	0
3510333	99	52	42,6	cyclictest	3688752	-21	kworker/u4:2+events_unbound	12:25:02	0
3510336	99	51	2,17	cyclictest	3516358	-21	ntpq	07:30:33	1
3510333	99	51	45,4	cyclictest	3534747	-21	kworker/u4:0+events_unbound	09:28:59	0
3510333	99	51	44,5	cyclictest	3679824	-21	kworker/u4:5+events_unbound	12:25:00	0
3510333	99	51	4,14	cyclictest	3525726	-21	modprobe	08:10:00	0
3510333	99	51	38,8	cyclictest	3515877	-21	df	07:30:14	0
3510333	99	51	32,13	cyclictest	0	-21	swapper/0	11:35:24	0
3510333	99	51	30,6	cyclictest	3574580	-21	kworker/u4:10+events_unbound	09:50:03	0
3510336	99	50	2,15	cyclictest	3522605	-21	ntpq	07:55:21	1
3510333	99	50	44,4	cyclictest	3690532	-21	munin-run	12:00:00	0
3510333	99	50	39,7	cyclictest	3526091	-21	df	08:10:17	0
3510333	99	50	37,9	cyclictest	3569070	-21	unixbench-2d	09:40:40	0
3510333	99	50	3,40	cyclictest	3615858	-21	modprobe	10:35:00	0
3510333	99	50	33,10	cyclictest	0	-21	swapper/0	10:45:36	0
3510333	99	49	41,5	cyclictest	3535753	-21	switchtime	08:45:36	0
3510333	99	49	40,5	cyclictest	3516762	-21	kworker/u4:0+xprtiod	08:35:06	0
3510333	99	49	38,7	cyclictest	3546434	-21	uname	09:15:21	0
3510333	99	49	37,7	cyclictest	0	-21	swapper/0	10:40:53	0
3510336	99	48	15,29	cyclictest	0	-21	swapper/1	08:55:39	1
3510333	99	48	40,5	cyclictest	3512960	-21	cron	07:20:01	0
3510333	99	48	32,5	cyclictest	3697690	-21	kworker/u4:9+events_unbound	12:16:42	0
3510333	99	48	32,5	cyclictest	3697690	-21	kworker/u4:9+events_unbound	12:16:41	0
3510333	99	47	39,6	cyclictest	3688752	-21	kworker/u4:2+events_unbound	12:30:02	0
3510333	99	47	35,9	cyclictest	3703835	-21	latency_hist	12:15:01	0
3510333	99	46	38,6	cyclictest	3522200	-21	aten_r7power_vo	07:55:16	0
3510333	99	46	36,7	cyclictest	3573177	-21	/usr/sbin/munin	09:45:37	0
3510333	99	45	38,5	cyclictest	3534425	-21	cat	08:40:36	0
3510333	99	45	36,7	cyclictest	0	-21	swapper/0	08:00:36	0
3510333	99	45	35,8	cyclictest	3564757	-21	/usr/sbin/munin	09:35:38	0
3510333	99	44	35,7	cyclictest	3518317	-21	aten_r7power_en	07:40:15	0
3510333	99	44	35,6	cyclictest	3660983	-21	ssh	11:25:34	0
3510333	99	44	35,6	cyclictest	3565615	-21	kworker/u4:5-rpciod	10:05:23	0
3510333	99	44	35,6	cyclictest	3565615	-21	kworker/u4:5-rpciod	10:05:23	0
3510333	99	44	35,6	cyclictest	3541589	-21	aten_r7power_cu	09:10:21	0
3510333	99	44	35,6	cyclictest	0	-21	swapper/0	07:20:20	0
3510333	99	44	34,8	cyclictest	3634080	-21	fschecks_count	10:55:25	0
3510333	99	44	33,9	cyclictest	3518084	-21	awk	07:40:00	0
3510333	99	43	34,6	cyclictest	0	-21	swapper/0	10:25:25	0
3510333	99	42	36,4	cyclictest	3515526	-21	munin-plugin-st	07:30:01	0
3510333	99	42	36,4	cyclictest	3515526	-21	munin-plugin-st	07:30:00	0
3510333	99	42	35,5	cyclictest	3664791	-21	ssh	11:30:17	0
3510333	99	42	31,8	cyclictest	3599676	-21	timerandwakeup	10:15:40	0
3510333	99	41	34,5	cyclictest	3510331	-21	cyclictest	08:30:29	0
3510333	99	41	26,11	cyclictest	3520614	-21	modprobe	07:50:00	0
3510333	99	40	33,5	cyclictest	3536482	-21	fschecks_count	08:50:18	0
3510333	99	39	32,4	cyclictest	0	-21	swapper/0	07:50:29	0
3510333	99	35	27,5	cyclictest	3509066	-21	kworker/u4:6-rpciod	07:10:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17