OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Mon May 11, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3688496	99	109	99,7	cyclictest	3792608	-21	kworker/u4:4+events_unbound	22:42:44	1
3688496	99	109	99,7	cyclictest	3792608	-21	kworker/u4:4+events_unbound	22:42:44	1
3688496	99	95	87,6	cyclictest	3753026	-21	kworker/u4:3+events_unbound	22:22:42	1
3688496	99	87	77,6	cyclictest	3792608	-21	kworker/u4:4+events_unbound	22:47:47	1
3688496	99	79	71,6	cyclictest	3876003	-21	kworker/u4:10+events_unbound	00:08:13	1
3688496	99	76	70,4	cyclictest	3748585	-21	kworker/u4:5+events_unbound	22:02:38	1
3688496	99	76	68,6	cyclictest	3779179	-21	kworker/u4:0+events_unbound	23:02:51	1
3688496	99	76	68,5	cyclictest	3708912	-21	kworker/u4:3+events_unbound	20:35:01	1
3688496	99	75	67,6	cyclictest	3674398	-21	kworker/u4:1+events_unbound	20:01:32	1
3688496	99	68	61,5	cyclictest	3810528	-21	kworker/u4:5+events_unbound	22:52:48	1
3688495	99	68	50,10	cyclictest	53	-21	kswapd0	00:05:09	0
3688495	99	68	48,14	cyclictest	256	50	irq/23-42890000.ethernet	21:05:11	0
3688495	99	68	48,14	cyclictest	256	50	irq/23-42890000.ethernet	21:05:11	0
3688495	99	67	34,25	cyclictest	0	-21	swapper/0	23:10:26	0
3688496	99	65	58,5	cyclictest	3844869	-21	kworker/u4:8+events_unbound	23:42:57	1
3688495	99	62	6,43	cyclictest	3896384	-21	ssh	00:30:37	0
3688496	99	61	53,5	cyclictest	3761966	-21	kworker/u4:7+events_unbound	22:17:41	1
3688495	99	61	48,10	cyclictest	3781145	-21	ssh	22:19:56	0
3688496	99	60	51,7	cyclictest	3875381	-21	kworker/u4:7+events_unbound	00:38:42	1
3688495	99	60	14,9	cyclictest	3795366	-21	ntpq	22:35:25	0
3688495	99	60	14,9	cyclictest	3795366	-21	ntpq	22:35:25	0
3688496	99	59	46,7	cyclictest	0	-21	swapper/1	21:00:00	1
3688495	99	59	44,12	cyclictest	3847714	-21	ssh	23:35:21	0
3688496	99	58	51,5	cyclictest	3688430	-21	kworker/u4:5+events_unbound	19:12:02	1
3688496	99	57	51,4	cyclictest	3832169	-21	kworker/u4:6+events_unbound	00:26:41	1
3688495	99	57	48,6	cyclictest	3688492	-21	cyclictest	23:19:24	0
3688495	99	57	47,8	cyclictest	53	-21	kswapd0	22:20:20	0
3688495	99	57	46,8	cyclictest	3725091	-21	mailstats	21:15:39	0
3688496	99	56	49,5	cyclictest	3692303	-21	kworker/u4:3+events_unbound	20:17:00	1
3688496	99	56	40,5	cyclictest	3739556	-21	kworker/u4:2+events_unbound	21:35:00	1
3688495	99	56	47,7	cyclictest	3837008	-21	sd-accept	23:22:54	0
3688496	99	55	5,47	cyclictest	1062	-21	lldpd	20:05:25	1
3688496	99	55	5,47	cyclictest	1062	-21	lldpd	20:05:25	1
3688496	99	55	40,11	cyclictest	3879626	-21	sh	00:11:11	1
3688495	99	55	37,13	cyclictest	3865191	-21	ssh	23:55:21	0
3688495	99	55	20,7	cyclictest	3816725	-21	apt-get	23:00:13	0
3688495	99	55	17,13	cyclictest	3900682	-21	ntpq	00:35:35	0
3688495	99	54	46,6	cyclictest	378	-21	dbus-daemon	21:37:28	0
3688495	99	54	15,14	cyclictest	3769107	-21	ntpq	22:05:30	0
3688495	99	53	45,6	cyclictest	3852347	-21	/usr/sbin/munin	23:40:25	0
3688495	99	53	44,7	cyclictest	3688492	-21	cyclictest	23:07:49	0
3688495	99	53	42,8	cyclictest	53	-21	kswapd0	00:05:00	0
3688495	99	53	40,7	cyclictest	0	-21	swapper/0	00:12:16	0
3688495	99	53	11,21	cyclictest	3714967	-21	awk	20:50:35	0
3688496	99	52	45,5	cyclictest	3839074	-21	gltestperf	23:25:20	1
3688496	99	52	45,5	cyclictest	3744074	-21	kworker/u4:11+events_unbound	21:57:37	1
3688496	99	52	45,5	cyclictest	3705054	-21	kworker/u4:12+events_unbound	20:12:14	1
3688496	99	52	44,6	cyclictest	3768604	-21	/usr/sbin/munin	22:05:18	1
3688495	99	52	45,5	cyclictest	3738568	-21	switchtime	21:30:41	0
3688495	99	52	20,21	cyclictest	3773232	-21	if_eth0	22:10:21	0
3688495	99	52	11,21	cyclictest	3883230	-21	ntpq	00:15:39	0
3688496	99	51	41,8	cyclictest	3853770	-21	kworker/u4:0+events_unbound	23:50:32	1
3688496	99	51	41,8	cyclictest	3744069	-21	kworker/u4:3+events_unbound	21:37:30	1
3688495	99	51	7,20	cyclictest	3733278	-21	fschecks_count	21:25:18	0
3688495	99	51	4,40	cyclictest	3786766	-21	ntpq	22:25:33	0
3688495	99	51	33,16	cyclictest	3752051	-21	sh	21:45:40	0
3688495	99	51	32,15	cyclictest	3759511	-21	apt-get	21:55:11	0
3688495	99	51	18,13	cyclictest	3746331	-21	apt-get	21:40:12	0
3688495	99	51	13,14	cyclictest	3689276	-21	ntpq	19:10:29	0
3688495	99	51	11,15	cyclictest	3816381	-21	ssh	22:59:59	0
3688496	99	50	43,5	cyclictest	3875381	-21	kworker/u4:7+events_unbound	00:35:02	1
3688496	99	50	41,7	cyclictest	3751015	-21	/usr/sbin/munin	21:45:18	1
3688496	99	50	40,8	cyclictest	3847736	-21	fschecks_count	23:35:21	1
3688495	99	50	43,5	cyclictest	3704178	-21	df_abs	20:10:16	0
3688495	99	50	40,7	cyclictest	256	50	irq/23-42890000.ethernet	00:25:12	0
3688495	99	50	20,19	cyclictest	3814356	-21	kworker/u4:9-nfsiod	23:30:32	0
3688495	99	50	11,20	cyclictest	3712972	-21	wget	20:45:16	0
3688496	99	49	43,4	cyclictest	3869551	-21	fschecks_count	00:00:21	1
3688496	99	49	42,5	cyclictest	3757501	-21	kworker/u4:9+events_unbound	21:54:59	1
3688496	99	49	37,10	cyclictest	3844178	-21	timerwakeupswit	23:30:41	1
3688495	99	49	9,18	cyclictest	3860181	-21	ls	23:50:00	0
3688495	99	49	42,5	cyclictest	3764423	-21	gltestperf	22:00:21	0
3688495	99	49	40,6	cyclictest	3711455	-21	kworker/u4:6+events_unbound	20:40:02	0
3688495	99	49	25,21	cyclictest	0	-21	swapper/0	22:40:15	0
3688495	99	49	25,21	cyclictest	0	-21	swapper/0	22:40:15	0
3688495	99	49	14,11	cyclictest	3700760	-21	ntpq	19:55:30	0
3688495	99	49	13,13	cyclictest	3720300	-21	ssh	21:10:27	0
3688495	99	49	13,11	cyclictest	3705870	-21	ntpq	20:15:30	0
3688495	99	49	10,14	cyclictest	3755802	-21	ntpq	21:50:25	0
3688496	99	48	41,5	cyclictest	3786777	-21	ssh	22:25:34	1
3688496	99	48	40,5	cyclictest	3812854	-21	/usr/sbin/munin	22:55:20	1
3688496	99	48	37,8	cyclictest	3701249	-21	modprobe	20:00:00	1
3688496	99	48	35,10	cyclictest	3737174	-21	munin-plugin-st	21:30:00	1
3688495	99	48	37,9	cyclictest	3890772	-21	ssh	00:25:00	0
3688495	99	48	14,11	cyclictest	3703304	-21	ntpq	20:05:28	0
3688495	99	48	14,11	cyclictest	3703304	-21	ntpq	20:05:28	0
3688495	99	48	13,11	cyclictest	3804298	-21	ntpq	22:45:32	0
3688495	99	48	11,13	cyclictest	3791184	-21	ntpq	22:30:37	0
3688496	99	47	41,4	cyclictest	3729526	-21	sendmail_mailqu	21:20:37	1
3688496	99	47	40,5	cyclictest	3706344	-21	kworker/u4:15+events_unbound	20:22:15	1
3688496	99	47	36,8	cyclictest	0	-21	swapper/1	21:15:23	1
3688495	99	47	39,5	cyclictest	3839821	-21	/usr/sbin/munin	23:25:40	0
3688495	99	47	37,8	cyclictest	3861026	-21	if_eth0	23:50:22	0
3688495	99	47	29,14	cyclictest	3690619	-21	ps	19:15:35	0
3688495	99	47	10,20	cyclictest	3707072	-21	memory	20:20:21	0
3688495	99	47	10,13	cyclictest	3808634	-21	ntpq	22:50:28	0
3688496	99	46	39,5	cyclictest	3883421	-21	switchtime	00:15:41	1
3688496	99	46	38,6	cyclictest	3748587	-21	kworker/u4:8+events_unbound	21:44:00	1
3688496	99	46	37,7	cyclictest	3690176	-21	fschecks_count	19:15:18	1
3688496	99	46	37,6	cyclictest	0	-21	swapper/1	23:45:22	1
3688496	99	46	37,6	cyclictest	0	-21	swapper/1	22:30:14	1
3688495	99	46	5,23	cyclictest	0	-21	swapper/0	20:35:00	0
3688495	99	46	29,14	cyclictest	3712289	-21	ntpq	20:40:30	0
3688495	99	46	29,14	cyclictest	3712289	-21	ntpq	20:40:30	0
3688495	99	46	27,15	cyclictest	3701442	-21	apt-get	20:00:12	0
3688495	99	46	13,10	cyclictest	3691787	-21	ntpq	19:20:24	0
3688496	99	45	38,5	cyclictest	3865410	-21	uname	23:55:23	1
3688496	99	45	38,5	cyclictest	3697416	-21	kworker/u4:13+events_unbound	20:30:01	1
3688496	99	45	38,5	cyclictest	3695779	-21	sendmail_mailqu	19:35:36	1
3688495	99	45	27,14	cyclictest	3692494	-21	apt-get	19:25:13	0
3688496	99	44	38,4	cyclictest	3825502	-21	aten2__	23:10:15	1
3688496	99	44	35,7	cyclictest	3886858	-21	aten_r7power_po	00:20:17	1
3688496	99	44	33,8	cyclictest	0	-21	swapper/1	23:15:32	1
3688496	99	44	16,22	cyclictest	0	-21	swapper/1	22:35:35	1
3688496	99	44	16,22	cyclictest	0	-21	swapper/1	22:35:35	1
3688495	99	44	36,6	cyclictest	3715575	-21	aten_r7power_po	20:55:17	0
3688495	99	44	34,7	cyclictest	3732835	-21	latency_hist	21:25:02	0
3688495	99	44	28,12	cyclictest	3699449	-21	ntpq	19:50:24	0
3688495	99	44	26,14	cyclictest	3698306	-21	ps	19:45:35	0
3688496	99	43	35,6	cyclictest	3693978	-21	df_abs	19:30:17	1
3688496	99	43	34,6	cyclictest	0	-21	swapper/1	20:35:29	1
3688496	99	43	27,4	cyclictest	3697416	-21	kworker/u4:13+events_unbound	19:45:00	1
3688496	99	43	25,15	cyclictest	3773031	-21	fschecks_count	22:10:19	1
3688495	99	43	35,6	cyclictest	3695980	-21	unixbench-2d	19:35:38	0
3688495	99	43	28,12	cyclictest	3696338	-21	apt-get	19:40:12	0
3688495	99	43	28,11	cyclictest	3693769	-21	apt-get	19:30:12	0
3688495	99	43	24,12	cyclictest	3707832	-21	apt-get	20:25:12	0
3688495	99	43	22,18	cyclictest	3716564	-21	kworker/u4:12+rpciod	21:05:01	0
3688496	99	42	36,4	cyclictest	3698716	-21	munin-plugin-st	19:50:00	1
3688496	99	42	35,5	cyclictest	0	-21	swapper/1	23:20:26	1
3688496	99	42	32,6	cyclictest	0	-21	swapper/1	21:10:33	1
3688496	99	41	35,4	cyclictest	3822038	-21	proc_pri	23:05:39	1
3688496	99	41	34,5	cyclictest	0	-21	swapper/1	20:40:35	1
3688496	99	41	34,5	cyclictest	0	-21	swapper/1	20:40:35	1
3688496	99	41	33,6	cyclictest	3717163	-21	gltestperf	21:00:21	1
3688496	99	40	33,5	cyclictest	3692684	-21	df_abs	19:25:18	1
3688496	99	40	30,8	cyclictest	3708914	-21	kworker/u4:7-rpciod	20:45:26	1
3688496	99	40	28,8	cyclictest	0	-21	swapper/1	19:20:15	1
3688496	99	39	30,6	cyclictest	0	-21	swapper/1	21:05:21	1
3688496	99	39	30,6	cyclictest	0	-21	swapper/1	21:05:21	1
3688496	99	39	30,6	cyclictest	0	-21	swapper/1	19:10:01	1
3688496	99	36	29,5	cyclictest	3714409	-21	df_abs	20:50:16	1
3688496	99	36	25,9	cyclictest	0	-21	swapper/1	19:50:21	1
3688495	99	32	17,12	cyclictest	3688508	-21	latency_hist	19:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17