OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Tue Sep 01, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3517836	99	142	124,14	cyclictest	53	-21	kswapd0	11:50:08	0
3517836	99	113	93,8	cyclictest	3583208	-21	kworker/u4:2+events_unbound	10:19:55	0
3517836	99	96	88,6	cyclictest	3535840	-21	kworker/u4:12+events_unbound	09:54:45	0
3517836	99	89	81,6	cyclictest	3506542	-21	kworker/u4:2+events_unbound	07:19:13	0
3517836	99	86	79,5	cyclictest	3614767	-21	kworker/u4:4+events_unbound	10:24:57	0
3517836	99	86	79,5	cyclictest	3614767	-21	kworker/u4:4+events_unbound	10:24:56	0
3517836	99	84	77,5	cyclictest	3525440	-21	kworker/u4:8+events_unbound	07:39:17	0
3517836	99	82	75,5	cyclictest	3503974	-21	kworker/u4:14+events_unbound	08:24:26	0
3517836	99	79	72,5	cyclictest	3509109	-21	kworker/u4:12+events_unbound	07:14:13	0
3517839	99	77	68,6	cyclictest	53	-21	kswapd0	12:25:16	1
3517836	99	77	71,4	cyclictest	3535839	-21	kworker/u4:9+events_unbound	08:49:30	0
3517836	99	76	69,5	cyclictest	3514042	-21	kworker/u4:3+events_unbound	07:34:17	0
3517836	99	75	55,10	cyclictest	53	-21	kswapd0	11:50:00	0
3517836	99	74	67,5	cyclictest	3535840	-21	kworker/u4:12+events_unbound	08:44:30	0
3517836	99	71	64,5	cyclictest	3538489	-21	kworker/u4:2+events_unbound	08:39:29	0
3517836	99	71	64,5	cyclictest	3538489	-21	kworker/u4:2+events_unbound	08:39:29	0
3517836	99	71	52,14	cyclictest	3728185	-21	fschecks_count	12:30:21	0
3517836	99	70	64,4	cyclictest	3672835	-21	kworker/u4:1+events_unbound	11:35:05	0
3517839	99	69	57,6	cyclictest	0	-21	swapper/1	12:20:24	1
3517836	99	69	49,15	cyclictest	53	-21	kswapd0	10:25:11	0
3517836	99	69	49,15	cyclictest	53	-21	kswapd0	10:25:10	0
3517839	99	65	53,8	cyclictest	0	-21	swapper/1	09:30:12	1
3517836	99	65	58,5	cyclictest	3506542	-21	kworker/u4:2+events_unbound	07:49:21	0
3517839	99	62	51,8	cyclictest	0	-21	swapper/1	09:00:36	1
3517839	99	61	44,11	cyclictest	3708083	-21	kworker/u4:1-events_power_efficient	12:16:28	1
3517836	99	61	53,6	cyclictest	3716391	-21	kworker/u4:14+events_unbound	12:20:15	0
3517839	99	58	50,5	cyclictest	3676693	-21	kworker/u4:3+events_unbound	11:55:01	1
3517836	99	58	52,4	cyclictest	3548700	-21	kworker/u4:19+events_unbound	09:30:01	0
3517836	99	58	51,5	cyclictest	3547429	-21	kworker/u4:2+events_unbound	09:10:03	0
3517836	99	58	50,6	cyclictest	3614767	-21	kworker/u4:4+events_unbound	10:31:45	0
3517836	99	58	43,8	cyclictest	3619351	-21	kworker/u4:9+events_unbound	10:59:46	0
3517839	99	57	49,6	cyclictest	3524210	-21	ls	07:35:01	1
3517839	99	57	20,7	cyclictest	3531562	-21	ps	08:00:37	1
3517839	99	55	46,5	cyclictest	0	-21	swapper/1	11:30:00	1
3517839	99	55	44,8	cyclictest	0	-21	swapper/1	10:00:37	1
3517839	99	55	44,8	cyclictest	0	-21	swapper/1	10:00:37	1
3517839	99	55	19,21	cyclictest	0	-21	swapper/1	09:10:22	1
3517839	99	55	17,15	cyclictest	3665354	-21	ssh	11:19:36	1
3517839	99	55	15,16	cyclictest	3565252	-21	ssh	09:27:31	1
3517839	99	55	12,16	cyclictest	3522424	-21	ntpq	07:25:27	1
3517839	99	54	41,8	cyclictest	0	-21	swapper/1	09:55:25	1
3517839	99	54	39,7	cyclictest	3554436	-21	diskmemload	09:15:35	1
3517839	99	54	19,10	cyclictest	3601758	-21	ssh	10:07:51	1
3517839	99	54	18,15	cyclictest	3660810	-21	ssh	11:14:27	1
3517839	99	54	16,10	cyclictest	3611456	-21	ssh	10:18:52	1
3517839	99	54	14,15	cyclictest	3629290	-21	ssh	10:38:46	1
3517839	99	54	12,15	cyclictest	3605703	-21	ssh	10:12:01	1
3517836	99	54	47,5	cyclictest	3668318	-21	kworker/u4:9+events_unbound	12:01:46	0
3517836	99	54	47,5	cyclictest	3559418	-21	/usr/sbin/munin	09:20:42	0
3517836	99	54	47,5	cyclictest	3519055	-21	kworker/u4:6+events_unbound	08:14:24	0
3517839	99	53	20,12	cyclictest	3539328	-21	uname	08:30:32	1
3517839	99	53	16,12	cyclictest	3638814	-21	ssh	10:49:44	1
3517839	99	53	15,14	cyclictest	3655652	-21	ssh	11:08:19	1
3517839	99	53	15,11	cyclictest	3688031	-21	ssh	11:45:08	1
3517839	99	53	13,15	cyclictest	3624474	-21	ssh	10:33:12	1
3517836	99	53	46,5	cyclictest	3614767	-21	kworker/u4:4+events_unbound	10:35:02	0
3517836	99	53	45,5	cyclictest	0	-21	swapper/0	12:05:27	0
3517836	99	53	40,7	cyclictest	3641224	-21	kworker/u4:10+events_unbound	11:17:45	0
3517836	99	53	2,40	cyclictest	3649163	-21	ps	11:00:42	0
3517839	99	52	5,37	cyclictest	3684554	-21	ssh	11:40:35	1
3517839	99	52	5,37	cyclictest	3684554	-21	ssh	11:40:34	1
3517839	99	52	45,5	cyclictest	3729110	-21	unixbench_multi	12:30:43	1
3517839	99	52	44,5	cyclictest	0	-21	swapper/1	10:55:19	1
3517839	99	52	44,4	cyclictest	3679153	-21	sshd	11:35:05	1
3517839	99	52	43,6	cyclictest	3699121	-21	kworker/u4:6+events_unbound	12:40:01	1
3517839	99	52	17,12	cyclictest	3617556	-21	perl	10:25:25	1
3517839	99	52	17,12	cyclictest	3617556	-21	perl	10:25:25	1
3517839	99	52	13,15	cyclictest	3616241	-21	ssh	10:24:14	1
3517839	99	52	13,15	cyclictest	3616241	-21	ssh	10:24:13	1
3517839	99	52	13,14	cyclictest	3580293	-21	ssh	09:44:42	1
3517839	99	52	13,11	cyclictest	3669783	-21	ssh	11:24:33	1
3517839	99	52	12,15	cyclictest	3633826	-21	ssh	10:43:52	1
3517839	99	52	12,13	cyclictest	3698468	-21	ssh	11:56:02	1
3517839	99	52	12,13	cyclictest	3698468	-21	ssh	11:56:02	1
3517836	99	52	25,9	cyclictest	3539759	-21	kworker/u4:3+events_unbound	09:41:06	0
3517839	99	51	27,13	cyclictest	3546161	-21	modprobe	08:59:59	1
3517839	99	51	14,11	cyclictest	3711373	-21	ssh	12:10:44	1
3517839	99	51	13,11	cyclictest	3676729	-21	ssh	11:31:33	1
3517839	99	51	12,15	cyclictest	3649784	-21	ssh	11:01:06	1
3517839	99	51	11,13	cyclictest	3573255	-21	ssh	09:35:56	1
3517839	99	51	10,17	cyclictest	3704231	-21	ssh	12:03:06	1
3517836	99	51	44,5	cyclictest	3653931	-21	grep	11:05:45	0
3517836	99	51	44,5	cyclictest	3604500	-21	mailstats	10:10:39	0
3517836	99	51	44,5	cyclictest	3517834	-21	cyclictest	10:48:25	0
3517836	99	51	40,5	cyclictest	3672835	-21	kworker/u4:1+events_unbound	11:40:03	0
3517836	99	51	40,5	cyclictest	3672835	-21	kworker/u4:1+events_unbound	11:40:03	0
3517839	99	50	14,12	cyclictest	3583514	-21	ssh	09:47:42	1
3517839	99	50	13,13	cyclictest	3587008	-21	ssh	09:51:08	1
3517839	99	50	12,11	cyclictest	3642902	-21	ssh	10:54:14	1
3517836	99	50	45,3	cyclictest	0	-21	swapper/0	10:00:34	0
3517836	99	50	45,3	cyclictest	0	-21	swapper/0	10:00:33	0
3517836	99	50	41,7	cyclictest	3708085	-21	kworker/u4:4+events_unbound	12:29:45	0
3517836	99	50	30,14	cyclictest	3632258	-21	kworker/u4:7+events_unbound	11:21:55	0
3517839	99	49	38,8	cyclictest	3526746	-21	systemd	07:44:17	1
3517836	99	49	41,5	cyclictest	3581517	-21	sh	09:45:27	0
3517839	99	48	22,7	cyclictest	3521169	-21	ntpq	07:20:31	1
3517839	99	48	13,10	cyclictest	3708490	-21	ssh	12:07:53	1
3517839	99	48	11,14	cyclictest	3524937	-21	ntpq	07:35:30	1
3517839	99	48	11,13	cyclictest	3519928	-21	ld	07:15:35	1
3517839	99	48	10,14	cyclictest	3541876	-21	ld	08:40:32	1
3517836	99	48	7,26	cyclictest	3710128	-21	ssh	12:10:07	0
3517836	99	48	41,5	cyclictest	3557847	-21	sendmail	09:20:00	0
3517836	99	48	41,5	cyclictest	3535536	-21	cat	08:15:44	0
3517836	99	48	40,4	cyclictest	3670684	-21	/usr/sbin/munin	11:25:19	0
3517836	99	48	29,16	cyclictest	0	-21	swapper/0	08:55:20	0
3517836	99	48	27,19	cyclictest	0	-21	swapper/0	09:35:25	0
3517839	99	47	39,5	cyclictest	3544538	-21	sendmail_mailqu	08:50:38	1
3517836	99	47	37,8	cyclictest	256	50	irq/23-42890000.ethernet	08:30:29	0
3517836	99	47	26,19	cyclictest	3599438	-21	grep	10:05:21	0
3517836	99	47	25,19	cyclictest	0	-21	swapper/0	12:39:28	0
3517839	99	46	39,5	cyclictest	3530676	-21	latency_hist	08:00:00	1
3517839	99	46	38,5	cyclictest	3528323	-21	cut	07:50:16	1
3517839	99	46	12,10	cyclictest	3535323	-21	ntpq	08:15:31	1
3517839	99	46	11,10	cyclictest	3532684	-21	ntpq	08:05:25	1
3517836	99	46	39,5	cyclictest	3715363	-21	ntpq	12:15:31	0
3517836	99	46	39,5	cyclictest	3517834	-21	cyclictest	11:10:37	0
3517836	99	46	39,5	cyclictest	3503974	-21	kworker/u4:14+events_unbound	08:05:02	0
3517836	99	46	32,10	cyclictest	3564765	-21	kworker/u4:10+rpciod	09:30:11	0
3517836	99	46	26,18	cyclictest	3546625	-21	fschecks_count	09:00:17	0
3517839	99	45	9,10	cyclictest	3543075	-21	ntpq	08:45:25	1
3517836	99	45	37,5	cyclictest	0	-21	swapper/0	11:55:08	0
3517836	99	45	37,5	cyclictest	0	-21	swapper/0	11:55:07	0
3517836	99	45	36,6	cyclictest	3539762	-21	kworker/u4:7-xprtiod	08:50:21	0
3517836	99	45	29,13	cyclictest	3526781	-21	awk	07:45:00	0
3517839	99	44	35,5	cyclictest	3533201	-21	kworker/u4:1-rpciod	09:20:17	1
3517839	99	44	12,11	cyclictest	3540473	-21	memory	08:35:26	1
3517839	99	44	12,11	cyclictest	3540473	-21	memory	08:35:25	1
3517836	99	44	35,7	cyclictest	3530038	-21	sshd	07:55:20	0
3517839	99	43	9,10	cyclictest	3527666	-21	ntpq	07:45:38	1
3517836	99	43	36,5	cyclictest	3522026	-21	df_abs	07:25:17	0
3517836	99	43	35,6	cyclictest	3547649	-21	aten2__	09:05:16	0
3517836	99	43	29,11	cyclictest	0	-21	swapper/0	09:55:20	0
3517839	99	42	35,4	cyclictest	3547435	-21	kworker/u4:18-rpciod	09:05:21	1
3517839	99	42	27,12	cyclictest	3533954	-21	ntpq	08:10:26	1
3517836	99	42	36,4	cyclictest	3630772	-21	fschecks_count	10:40:20	0
3517836	99	42	36,4	cyclictest	3506542	-21	kworker/u4:2-rpciod	07:20:20	0
3517836	99	42	35,5	cyclictest	3639790	-21	gltestperf	10:50:20	0
3517836	99	42	34,6	cyclictest	3532452	-21	fschecks_time	08:05:19	0
3517836	99	42	34,5	cyclictest	3503974	-21	kworker/u4:14-rpciod	08:25:36	0
3517836	99	42	33,6	cyclictest	0	-21	swapper/0	11:30:23	0
3517839	99	41	33,5	cyclictest	3537263	-21	munin-plugin-st	08:25:01	1
3517836	99	41	7,31	cyclictest	3517834	-21	cyclictest	07:10:00	0
3517839	99	40	32,6	cyclictest	0	-21	swapper/1	07:15:01	1
3517839	99	40	29,8	cyclictest	0	-21	swapper/1	08:25:20	1
3517836	99	38	30,5	cyclictest	0	-21	swapper/0	07:55:01	0
3517839	99	30	14,11	cyclictest	3517918	-21	latency_hist	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17