OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Mar 23, 2026 12:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
665732	99	104	92,9	cyclictest	679841	-21	kworker/u4:17+events_unbound	08:15:32	1
665732	99	103	93,8	cyclictest	834623	-21	kworker/u4:1+events_unbound	11:50:37	1
665732	99	98	92,4	cyclictest	852283	-21	kworker/u4:7+events_unbound	12:21:32	1
665732	99	94	87,5	cyclictest	821331	-21	kworker/u4:14+events_unbound	11:36:20	1
665732	99	91	67,10	cyclictest	733779	-21	kworker/u4:9+events_unbound	10:46:03	1
665732	99	86	79,4	cyclictest	667048	-21	kworker/u4:9+events_unbound	07:15:22	1
665732	99	82	74,6	cyclictest	791005	-21	kworker/u4:5+events_unbound	11:01:08	1
665731	99	82	51,29	cyclictest	53	-21	kswapd0	11:25:32	0
665732	99	81	71,7	cyclictest	786548	-21	kworker/u4:8+events_unbound	11:21:19	1
665731	99	80	47,30	cyclictest	315	-21	systemd-journal	07:15:20	0
665732	99	79	57,18	cyclictest	0	-21	swapper/1	11:10:11	1
665732	99	78	69,6	cyclictest	664459	-21	kworker/u4:4+events_unbound	07:20:21	1
665731	99	72	33,36	cyclictest	858536	-21	apt-get	12:15:12	0
665732	99	70	59,8	cyclictest	673435	-21	kworker/u4:6+events_unbound	07:40:26	1
665731	99	70	56,10	cyclictest	701259	-21	/usr/sbin/munin	09:15:14	0
665732	99	69	61,6	cyclictest	799865	-21	kworker/u4:2+events_unbound	11:16:15	1
665731	99	69	40,26	cyclictest	0	-21	swapper/0	12:00:01	0
665731	99	69	20,44	cyclictest	0	-21	swapper/0	09:26:54	0
665732	99	68	60,6	cyclictest	843433	-21	kworker/u4:11+events_unbound	12:11:31	1
665731	99	68	4,22	cyclictest	849772	-21	ssh	12:05:11	0
665731	99	67	33,32	cyclictest	823802	-21	aten_r7power_vo	11:35:17	0
665731	99	67	32,31	cyclictest	694205	-21	aten_r7power_po	09:00:17	0
665731	99	67	2,62	cyclictest	0	-21	swapper/0	10:10:29	0
665731	99	67	23,41	cyclictest	0	-21	swapper/0	09:15:06	0
665731	99	66	51,11	cyclictest	665727	-21	cyclictest	12:34:09	0
665731	99	66	2,5	cyclictest	723952	-21	ntpq	09:40:29	0
665731	99	66	1,21	cyclictest	862949	-21	ssh	12:20:13	0
665731	99	65	35,28	cyclictest	0	-21	swapper/0	10:35:29	0
665731	99	65	30,33	cyclictest	758821	-21	kernelversion	10:20:22	0
665731	99	65	30,33	cyclictest	691548	-21	aten2__	08:50:16	0
665731	99	65	27,32	cyclictest	693902	-21	modprobe	09:00:00	0
665731	99	65	2,5	cyclictest	728389	-21	grep	09:45:29	0
665731	99	65	2,14	cyclictest	740748	-21	apt-get	10:00:12	0
665731	99	65	13,8	cyclictest	0	-21	swapper/0	11:05:15	0
665731	99	64	6,8	cyclictest	867310	-21	apt-get	12:25:11	0
665731	99	64	52,9	cyclictest	664459	-21	kworker/u4:4+events_unbound	07:55:29	0
665731	99	64	52,9	cyclictest	664459	-21	kworker/u4:4+events_unbound	07:55:29	0
665731	99	64	40,21	cyclictest	767008	-21	aten_r7power_cu	10:30:14	0
665731	99	64	32,30	cyclictest	736742	-21	gltestperf	09:55:19	0
665731	99	64	3,18	cyclictest	794084	-21	ntpq	11:00:32	0
665731	99	64	28,32	cyclictest	683051	-21	kernelversion	08:15:21	0
665731	99	64	1,17	cyclictest	676196	-21	apt-get	07:50:11	0
665731	99	64	1,17	cyclictest	676196	-21	apt-get	07:50:11	0
665731	99	63	53,7	cyclictest	53	-21	kswapd0	10:45:00	0
665731	99	63	5,17	cyclictest	681124	-21	modprobe	08:10:00	0
665731	99	63	46,10	cyclictest	788845	-21	ssh	10:55:08	0
665731	99	63	32,28	cyclictest	0	-21	swapper/0	10:50:20	0
665731	99	63	3,16	cyclictest	681303	-21	apt-get	08:10:10	0
665731	99	63	29,30	cyclictest	0	-21	swapper/0	11:30:35	0
665731	99	63	2,22	cyclictest	837398	-21	ssh	11:50:27	0
665731	99	63	1,5	cyclictest	833146	-21	ntpq	11:45:29	0
665731	99	63	1,14	cyclictest	688299	-21	ntpq	08:35:29	0
665732	99	62	54,5	cyclictest	676004	-21	kworker/u4:14+events_unbound	08:05:31	1
665731	99	62	4,16	cyclictest	719248	-21	/usr/sbin/munin	09:35:19	0
665731	99	62	4,16	cyclictest	719248	-21	/usr/sbin/munin	09:35:19	0
665731	99	62	30,29	cyclictest	0	-21	swapper/0	09:30:20	0
665731	99	62	30,28	cyclictest	0	-21	swapper/0	11:15:29	0
665731	99	62	29,30	cyclictest	803632	-21	sshd	11:11:12	0
665731	99	62	29,30	cyclictest	0	-21	swapper/0	12:35:23	0
665731	99	62	26,33	cyclictest	0	-21	swapper/0	10:25:28	0
665731	99	62	2,13	cyclictest	745155	-21	apt-get	10:05:14	0
665731	99	62	2,13	cyclictest	745155	-21	apt-get	10:05:14	0
665732	99	61	52,6	cyclictest	725580	-21	kworker/u4:3+events_unbound	10:00:00	1
665731	99	61	52,6	cyclictest	677275	-21	kworker/u4:15+events_unbound	08:20:33	0
665731	99	61	29,29	cyclictest	0	-21	swapper/0	10:45:29	0
665731	99	61	27,32	cyclictest	849586	-21	latency_hist	12:05:01	0
665731	99	61	2,17	cyclictest	672951	-21	ntpq	07:35:30	0
665731	99	61	2,17	cyclictest	672951	-21	ntpq	07:35:30	0
665731	99	61	18,41	cyclictest	0	-21	swapper/0	08:25:35	0
665731	99	61	1,15	cyclictest	828856	-21	ntpq	11:40:32	0
665731	99	61	1,15	cyclictest	828856	-21	ntpq	11:40:32	0
665731	99	60	4,8	cyclictest	679325	-21	ntpq	08:00:27	0
665731	99	60	30,27	cyclictest	0	-21	swapper/0	09:20:29	0
665731	99	60	2,16	cyclictest	754780	-21	ps	10:15:36	0
665731	99	60	2,16	cyclictest	754780	-21	ps	10:15:36	0
665731	99	60	1,8	cyclictest	673695	-21	/usr/sbin/munin	07:40:15	0
665732	99	59	49,6	cyclictest	0	-21	swapper/1	10:40:29	1
665731	99	59	3,12	cyclictest	665968	-21	apt-get	07:10:16	0
665731	99	59	27,29	cyclictest	690285	-21	wget	08:45:16	0
665731	99	59	26,29	cyclictest	0	-21	swapper/0	09:05:36	0
665731	99	59	25,31	cyclictest	669978	-21	cpu	07:25:18	0
665731	99	59	24,32	cyclictest	686534	-21	aten_r7power_po	08:30:16	0
665731	99	59	21,36	cyclictest	0	-21	swapper/0	11:25:00	0
665732	99	58	51,5	cyclictest	699355	-21	kworker/u4:11+events_unbound	09:20:51	1
665732	99	58	50,6	cyclictest	691339	-21	kworker/u4:7+events_unbound	08:50:43	1
665732	99	58	47,8	cyclictest	37	-21	kcompactd0	10:30:18	1
665731	99	58	25,30	cyclictest	0	-21	swapper/0	07:20:14	0
665732	99	57	50,5	cyclictest	869228	-21	sshd	12:26:33	1
665732	99	57	44,10	cyclictest	788556	-21	apt-get	10:55:07	1
665731	99	57	26,28	cyclictest	854936	-21	ld	12:10:28	0
665732	99	56	48,6	cyclictest	725579	-21	kworker/u4:2+events_unbound	10:15:56	1
665732	99	56	48,6	cyclictest	725579	-21	kworker/u4:2+events_unbound	10:15:56	1
665732	99	56	45,8	cyclictest	850191	-21	tune2fs	12:05:18	1
665731	99	56	48,6	cyclictest	716622	-21	kworker/u4:0+events_unbound	09:50:52	0
665732	99	55	5,38	cyclictest	750348	-21	ssh	10:10:35	1
665732	99	55	48,4	cyclictest	763826	-21	grep	10:25:41	1
665731	99	55	20,32	cyclictest	0	-21	swapper/0	07:10:01	0
665731	99	55	10,7	cyclictest	672171	-21	cron	07:35:00	0
665732	99	54	45,7	cyclictest	691325	-21	systemd	08:45:40	1
665732	99	53	45,6	cyclictest	798925	-21	/usr/sbin/munin	11:05:41	1
665732	99	53	42,4	cyclictest	843432	-21	kworker/u4:10+events_unbound	12:01:26	1
665731	99	53	22,28	cyclictest	674735	-21	kworker/u4:11-xprtiod	07:50:01	0
665731	99	53	21,29	cyclictest	0	-21	swapper/0	08:40:36	0
665732	99	52	45,5	cyclictest	733150	-21	unixbench-2d	09:50:39	1
665732	99	52	45,5	cyclictest	676004	-21	kworker/u4:14+events_unbound	08:05:00	1
665732	99	51	43,6	cyclictest	664459	-21	kworker/u4:4+events_unbound	07:25:22	1
665732	99	51	43,5	cyclictest	788771	-21	cat	10:55:02	1
665732	99	51	41,7	cyclictest	670894	-21	kworker/u4:13+events_unbound	07:45:26	1
665732	99	51	22,22	cyclictest	0	-21	swapper/1	09:25:24	1
665732	99	50	43,6	cyclictest	684955	-21	kworker/u4:4+events_unbound	09:05:02	1
665732	99	49	6,31	cyclictest	859250	-21	ssh	12:15:27	1
665732	99	49	41,6	cyclictest	689305	-21	fschecks_time	08:40:19	1
665732	99	48	42,4	cyclictest	697359	-21	kernelversion	09:10:21	1
665732	99	48	40,6	cyclictest	723679	-21	fschecks_time	09:40:24	1
665732	99	48	40,5	cyclictest	684625	-21	sendmail_mailqu	08:20:35	1
665732	99	48	39,6	cyclictest	699355	-21	kworker/u4:11+events_unbound	09:20:00	1
665732	99	47	40,5	cyclictest	815355	-21	cut	11:25:20	1
665732	99	47	40,5	cyclictest	716625	-21	kworker/u4:6+events_unbound	09:35:51	1
665732	99	47	40,5	cyclictest	716625	-21	kworker/u4:6+events_unbound	09:35:51	1
665732	99	47	40,5	cyclictest	673435	-21	kworker/u4:6+events_unbound	08:25:36	1
665732	99	47	39,6	cyclictest	872048	-21	fschecks_count	12:30:19	1
665732	99	47	38,7	cyclictest	671579	-21	kernelversion	07:30:23	1
665732	99	46	40,4	cyclictest	688438	-21	sendmail_mailqu	08:35:37	1
665732	99	46	39,5	cyclictest	828216	-21	cut	11:40:17	1
665732	99	46	39,5	cyclictest	828216	-21	cut	11:40:17	1
665732	99	46	39,5	cyclictest	821331	-21	kworker/u4:14+events_unbound	11:33:59	1
665732	99	46	38,6	cyclictest	0	-21	swapper/1	07:35:23	1
665732	99	46	38,6	cyclictest	0	-21	swapper/1	07:35:23	1
665732	99	45	39,4	cyclictest	772060	-21	ntp_kernel_pll_	10:35:30	1
665732	99	45	34,8	cyclictest	0	-21	swapper/1	12:35:15	1
665732	99	45	34,7	cyclictest	714670	-21	df_abs	09:30:16	1
665732	99	44	38,4	cyclictest	741064	-21	basename	10:00:19	1
665732	99	44	37,5	cyclictest	696108	-21	sendmail_mailqu	09:05:37	1
665732	99	44	33,8	cyclictest	821331	-21	kworker/u4:14+events_unbound	11:45:14	1
665732	99	44	16,20	cyclictest	0	-21	swapper/1	10:05:28	1
665732	99	44	16,20	cyclictest	0	-21	swapper/1	10:05:28	1
665732	99	43	35,5	cyclictest	731712	-21	cron	09:50:01	1
665732	99	43	35,5	cyclictest	686616	-21	sed	08:30:16	1
665732	99	42	33,6	cyclictest	0	-21	swapper/1	08:10:31	1
665732	99	41	34,5	cyclictest	756014	-21	kworker/u4:12-rpciod	10:20:18	1
665732	99	40	33,5	cyclictest	693539	-21	sendmail_mailqu	08:55:36	1
665732	99	40	32,6	cyclictest	841521	-21	sh	11:55:19	1
665732	99	40	32,6	cyclictest	678513	-21	unixbench_singl	07:55:38	1
665732	99	40	32,6	cyclictest	678513	-21	unixbench_singl	07:55:38	1
665732	99	40	30,7	cyclictest	0	-21	swapper/1	07:50:27	1
665732	99	40	30,7	cyclictest	0	-21	swapper/1	07:50:27	1
665732	99	40	28,8	cyclictest	667074	-21	apt	07:15:00	1
665732	99	39	31,6	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17