OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Fri Aug 07, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3617052	99	109	103,4	cyclictest	3712788	-21	kworker/u4:5+events_unbound	10:34:57	1
3617052	99	94	84,8	cyclictest	3774586	-21	kworker/u4:6+events_unbound	11:40:14	1
3617051	99	89	68,17	cyclictest	53	-21	kswapd0	10:35:08	0
3617052	99	87	80,5	cyclictest	3618271	-21	kworker/u4:8+events_unbound	09:14:39	1
3617052	99	83	72,7	cyclictest	3712788	-21	kworker/u4:5+events_unbound	10:29:57	1
3617052	99	77	70,5	cyclictest	3712789	-21	kworker/u4:6+events_unbound	10:24:56	1
3617051	99	74	41,18	cyclictest	53	-21	kswapd0	12:40:08	0
3617051	99	74	41,18	cyclictest	53	-21	kswapd0	12:40:08	0
3617052	99	72	59,7	cyclictest	0	-21	swapper/1	09:40:11	1
3617052	99	67	62,4	cyclictest	3792652	-21	kworker/u4:4+events_unbound	12:05:17	1
3617051	99	65	38,20	cyclictest	15	1	ktimers/0	10:55:14	0
3617052	99	63	54,6	cyclictest	3624661	-21	kworker/u4:2+events_unbound	07:59:25	1
3617051	99	62	51,9	cyclictest	3774586	-21	kworker/u4:6+events_unbound	11:55:15	0
3617052	99	61	55,4	cyclictest	3620852	-21	kworker/u4:16+events_unbound	08:40:02	1
3617052	99	61	53,6	cyclictest	3797110	-21	kworker/u4:10+events_unbound	12:10:08	1
3617051	99	61	25,26	cyclictest	256	50	irq/23-42890000.ethernet	09:30:09	0
3617052	99	60	42,5	cyclictest	3739135	-21	kworker/u4:5+events_unbound	11:25:08	1
3617051	99	59	47,8	cyclictest	0	-21	swapper/0	09:25:11	0
3617051	99	59	39,6	cyclictest	3645315	-21	sendmail	09:00:00	0
3617052	99	58	51,5	cyclictest	3672984	-21	kworker/u4:11+events_unbound	09:40:01	1
3617052	99	58	50,5	cyclictest	3631063	-21	kworker/u4:4+events_unbound	08:44:32	1
3617052	99	58	48,7	cyclictest	3819229	-21	kworker/u4:4+events_unbound	12:25:19	1
3617051	99	58	2,12	cyclictest	3636304	-21	apt-get	08:25:08	0
3617051	99	57	40,9	cyclictest	256	50	irq/23-42890000.ethernet	10:30:11	0
3617051	99	57	38,16	cyclictest	3661389	-21	munin-plugin-st	09:25:00	0
3617051	99	57	25,26	cyclictest	256	50	irq/23-42890000.ethernet	08:15:11	0
3617051	99	57	25,26	cyclictest	256	50	irq/23-42890000.ethernet	08:15:11	0
3617052	99	56	49,5	cyclictest	3604351	-21	kworker/u4:1+events_unbound	07:19:20	1
3617052	99	56	48,6	cyclictest	3618271	-21	kworker/u4:8+events_unbound	07:14:17	1
3617052	99	55	47,6	cyclictest	3624661	-21	kworker/u4:2+events_unbound	07:49:24	1
3617052	99	55	47,5	cyclictest	3823745	-21	kworker/u4:6+events_unbound	12:35:03	1
3617052	99	55	47,5	cyclictest	3823745	-21	kworker/u4:6+events_unbound	12:35:03	1
3617051	99	55	48,5	cyclictest	3649419	-21	/usr/sbin/munin	09:10:40	0
3617051	99	54	44,7	cyclictest	3822610	-21	grep	12:25:42	0
3617051	99	54	44,7	cyclictest	3733791	-21	who	10:45:40	0
3617051	99	54	4,14	cyclictest	3791016	-21	ssh	11:50:33	0
3617052	99	53	44,6	cyclictest	3615772	-21	kworker/u4:0+events_unbound	08:14:28	1
3617052	99	53	41,8	cyclictest	3617049	-21	cyclictest	10:14:56	1
3617052	99	53	36,8	cyclictest	3634961	-21	kworker/u4:6+events_unbound	08:20:27	1
3617051	99	53	45,6	cyclictest	3677472	-21	kworker/u4:0-rpciod	09:50:19	0
3617051	99	53	44,6	cyclictest	3617049	-21	cyclictest	12:10:17	0
3617051	99	53	37,10	cyclictest	3633629	-21	modprobe	08:15:01	0
3617052	99	52	44,6	cyclictest	3743649	-21	kworker/u4:8+events_unbound	11:30:13	1
3617052	99	52	41,9	cyclictest	3628322	-21	timerwakeupswit	07:50:37	1
3617052	99	52	38,8	cyclictest	0	-21	swapper/1	11:50:35	1
3617051	99	52	18,18	cyclictest	0	-21	swapper/0	11:25:20	0
3617052	99	51	5,43	cyclictest	3728725	-21	ssh	10:40:28	1
3617052	99	51	45,4	cyclictest	3652803	-21	aten_r7power_po	09:15:14	1
3617052	99	51	43,6	cyclictest	3645269	-21	kworker/u4:13+events_unbound	08:59:36	1
3617052	99	51	42,7	cyclictest	3770066	-21	kworker/u4:16+events_unbound	11:35:13	1
3617052	99	51	42,7	cyclictest	3770066	-21	kworker/u4:16+events_unbound	11:35:13	1
3617051	99	51	44,5	cyclictest	3640162	-21	kworker/u4:12+events_unbound	09:00:03	0
3617051	99	51	38,9	cyclictest	3779706	-21	sh	11:38:03	0
3617051	99	51	38,9	cyclictest	3779706	-21	sh	11:38:03	0
3617051	99	51	36,12	cyclictest	3738001	-21	timerandwakeup	10:50:37	0
3617052	99	50	42,6	cyclictest	3647844	-21	systemd	09:09:37	1
3617052	99	50	11,26	cyclictest	3683809	-21	ssh	09:50:16	1
3617051	99	50	42,6	cyclictest	3750576	-21	cut	11:05:21	0
3617051	99	50	38,9	cyclictest	3696888	-21	latency_hist	10:05:01	0
3617051	99	50	31,16	cyclictest	3799943	-21	ntpq	12:00:40	0
3617052	99	49	42,5	cyclictest	3774582	-21	kworker/u4:2+events_unbound	11:47:46	1
3617052	99	49	42,5	cyclictest	3689165	-21	sendmail_mailqu	09:55:37	1
3617052	99	49	42,5	cyclictest	3681289	-21	kworker/u4:4+events_unbound	10:50:02	1
3617052	99	49	41,5	cyclictest	3764425	-21	gcc	11:20:36	1
3617052	99	49	41,5	cyclictest	0	-21	swapper/1	08:05:40	1
3617052	99	49	40,7	cyclictest	3644008	-21	systemd	08:54:35	1
3617052	99	49	40,6	cyclictest	3665843	-21	apt-get	09:30:04	1
3617052	99	49	39,7	cyclictest	0	-21	swapper/1	09:20:31	1
3617051	99	49	6,16	cyclictest	3637824	-21	apt-get	08:30:13	0
3617051	99	49	42,5	cyclictest	3812813	-21	fschecks_count	12:15:22	0
3617051	99	49	2,38	cyclictest	3688168	-21	apt-get	09:55:12	0
3617052	99	48	41,5	cyclictest	3799247	-21	sed	12:00:16	1
3617051	99	48	42,4	cyclictest	3781420	-21	aten_r7power_po	11:40:16	0
3617051	99	48	41,5	cyclictest	3622122	-21	kworker/u4:17+events_unbound	08:23:11	0
3617051	99	48	40,6	cyclictest	3760043	-21	sendmail_mailqu	11:15:37	0
3617051	99	48	40,6	cyclictest	3652698	-21	/usr/sbin/munin	09:15:13	0
3617051	99	48	38,7	cyclictest	3626427	-21	fschecks_count	07:45:20	0
3617052	99	47	38,7	cyclictest	3707057	-21	timerandwakeup	10:15:40	1
3617052	99	47	38,7	cyclictest	3707057	-21	timerandwakeup	10:15:40	1
3617051	99	47	39,6	cyclictest	3716103	-21	/usr/sbin/munin	10:25:42	0
3617051	99	47	39,5	cyclictest	0	-21	swapper/0	12:30:16	0
3617051	99	47	38,7	cyclictest	3705504	-21	systemd	10:14:52	0
3617051	99	47	38,6	cyclictest	0	-21	swapper/0	10:24:55	0
3617051	99	47	37,8	cyclictest	3755654	-21	sendmail_mailtr	11:10:37	0
3617051	99	47	37,7	cyclictest	3772770	-21	fschecks_time	11:30:20	0
3617051	99	47	34,11	cyclictest	53	-21	kswapd0	11:20:14	0
3617052	99	46	40,4	cyclictest	3692817	-21	aten_r7power_vo	10:00:17	1
3617052	99	46	39,5	cyclictest	3757188	-21	kworker/u4:6+events_unbound	11:15:02	1
3617052	99	46	38,5	cyclictest	3638086	-21	fschecks_count	08:30:20	1
3617052	99	46	37,7	cyclictest	3742534	-21	unixbench-2d	10:55:39	1
3617052	99	46	37,7	cyclictest	3662631	-21	processes	09:25:35	1
3617052	99	46	30,4	cyclictest	3823745	-21	kworker/u4:6+events_unbound	12:35:01	1
3617052	99	46	1,12	cyclictest	17	1	rcu_preempt	12:20:35	1
3617051	99	46	40,4	cyclictest	3786125	-21	fschecks_time	11:45:20	0
3617051	99	46	36,7	cyclictest	3746520	-21	/usr/sbin/munin	11:00:28	0
3617051	99	46	27,6	cyclictest	0	-21	swapper/0	12:20:29	0
3617051	99	46	10,5	cyclictest	19	1	rcuc/0	10:19:37	0
3617051	99	46	10,5	cyclictest	19	1	rcuc/0	10:19:37	0
3617052	99	45	38,5	cyclictest	3723774	-21	aten_r7power_po	10:35:23	1
3617052	99	45	38,5	cyclictest	3631063	-21	kworker/u4:4+events_unbound	08:19:30	1
3617052	99	45	38,5	cyclictest	3631063	-21	kworker/u4:4+events_unbound	08:19:30	1
3617052	99	45	37,6	cyclictest	3798781	-21	latency_hist	12:00:02	1
3617051	99	45	38,5	cyclictest	3803550	-21	aten2__	12:05:16	0
3617051	99	45	38,5	cyclictest	3728617	-21	kernelversion	10:40:25	0
3617051	99	45	36,7	cyclictest	3698307	-21	/usr/sbin/munin	10:05:41	0
3617051	99	45	34,8	cyclictest	3672985	-21	kworker/u4:12+events_unbound	09:39:45	0
3617051	99	45	3,27	cyclictest	3680219	-21	ssh	09:45:36	0
3617051	99	45	10,17	cyclictest	19	1	rcuc/0	09:44:36	0
3617052	99	44	37,5	cyclictest	3812501	-21	aten2__	12:15:18	1
3617052	99	44	37,5	cyclictest	3746552	-21	ntp_kernel_pll_	11:00:30	1
3617052	99	44	37,5	cyclictest	3679957	-21	/usr/sbin/munin	09:45:24	1
3617052	99	44	35,7	cyclictest	3641688	-21	aten2__	08:45:15	1
3617052	99	44	35,7	cyclictest	3625968	-21	systemd	07:44:23	1
3617052	99	44	27,6	cyclictest	3752661	-21	kworker/u4:4+events_unbound	11:11:40	1
3617051	99	44	36,6	cyclictest	3627749	-21	fschecks_time	07:50:19	0
3617051	99	44	35,6	cyclictest	3618271	-21	kworker/u4:8-rpciod	07:35:25	0
3617051	99	44	35,6	cyclictest	3618271	-21	kworker/u4:8-rpciod	07:35:25	0
3617051	99	44	13,28	cyclictest	15	1	ktimers/0	08:05:46	0
3617052	99	43	37,4	cyclictest	0	-21	swapper/1	10:09:52	1
3617052	99	43	36,5	cyclictest	3641457	-21	kworker/u4:15+events_unbound	09:05:01	1
3617052	99	43	34,7	cyclictest	3750398	-21	aten_r7power_vo	11:05:18	1
3617052	99	43	34,7	cyclictest	3631175	-21	latency_hist	08:05:01	1
3617052	99	43	34,7	cyclictest	3631175	-21	latency_hist	08:05:01	1
3617052	99	43	34,6	cyclictest	0	-21	swapper/1	10:45:34	1
3617052	99	43	31,9	cyclictest	0	-21	swapper/1	07:25:23	1
3617052	99	43	26,6	cyclictest	3622122	-21	kworker/u4:17+events_unbound	07:35:01	1
3617051	99	43	34,6	cyclictest	3642980	-21	aten_r7power_cu	08:50:15	0
3617051	99	43	34,6	cyclictest	3629018	-21	fschecks_time	07:55:20	0
3617051	99	43	33,8	cyclictest	3630468	-21	kernelversion	08:00:20	0
3617051	99	43	33,8	cyclictest	3630468	-21	kernelversion	08:00:20	0
3617051	99	43	32,8	cyclictest	3624661	-21	kworker/u4:2-xprtiod	08:35:21	0
3617051	99	43	31,9	cyclictest	3617460	-21	tune2fs	07:10:18	0
3617052	99	42	29,10	cyclictest	0	-21	swapper/1	07:35:40	1
3617052	99	42	29,10	cyclictest	0	-21	swapper/1	07:35:40	1
3617051	99	42	36,4	cyclictest	3640547	-21	cpu	08:40:14	0
3617051	99	41	33,6	cyclictest	3620047	-21	fschecks_count	07:20:19	0
3617051	99	41	31,7	cyclictest	37	-21	kcompactd0	07:25:16	0
3617051	99	40	31,7	cyclictest	3646812	-21	aten_r7power_cu	09:05:14	0
3617051	99	40	31,7	cyclictest	3622409	-21	aten_r7power_po	07:30:16	0
3617052	99	39	28,9	cyclictest	0	-21	swapper/1	07:20:30	1
3617051	99	39	12,5	cyclictest	19	1	rcuc/0	07:15:29	0
3617052	99	38	27,9	cyclictest	0	-21	swapper/1	08:25:24	1
3617051	99	38	29,7	cyclictest	3624979	-21	aten_r7power_po	07:40:16	0
3617051	99	38	12,4	cyclictest	15	1	ktimers/0	08:45:25	0
3617052	99	36	26,7	cyclictest	0	-21	swapper/1	07:10:01	1
3617051	99	29	6,4	cyclictest	15	1	ktimers/0	07:10:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17