OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Sep 21, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4013216	99	76	11,47	cyclictest	4013215	-21	basename	19:10:01	0
4013217	99	64	53,8	cyclictest	4127319	-21	grep	22:40:38	1
4013216	99	61	21,13	cyclictest	256	50	irq/23-42890000.ethernet	23:15:42	0
4013217	99	60	50,7	cyclictest	4058093	-21	sh	21:25:17	1
4013217	99	60	50,7	cyclictest	14857	-21	kworker/u4:10+events_unbound	00:20:00	1
4013216	99	59	51,5	cyclictest	4133132	-21	kworker/u4:12+events_unbound	22:52:15	0
4013216	99	58	50,6	cyclictest	4064596	-21	kworker/u4:7+events_unbound	21:31:57	0
4013217	99	57	49,6	cyclictest	4069188	-21	kworker/u4:10+events_unbound	21:42:02	1
4013216	99	57	41,12	cyclictest	53	-21	kswapd0	00:40:01	0
4013217	99	56	39,13	cyclictest	0	-21	swapper/1	23:55:24	1
4013216	99	56	50,4	cyclictest	4009513	-21	kworker/u4:3+events_unbound	20:10:01	0
4013216	99	56	35,6	cyclictest	4049104	-21	sshd	21:15:17	0
4013217	99	55	47,5	cyclictest	4148732	-21	/usr/sbin/munin	23:05:17	1
4013216	99	55	43,8	cyclictest	0	-21	swapper/0	22:07:06	0
4013217	99	54	43,7	cyclictest	0	-21	swapper/1	22:10:31	1
4013216	99	54	40,7	cyclictest	4110073	-21	kworker/u4:16-flush-179:96	22:22:15	0
4013217	99	53	44,6	cyclictest	4177180	-21	kworker/u4:9+events_unbound	23:37:23	1
4013216	99	53	46,5	cyclictest	4168825	-21	kworker/u4:7+events_unbound	00:05:03	0
4013216	99	53	45,6	cyclictest	4131425	-21	ld	22:45:33	0
4013216	99	53	45,6	cyclictest	4077166	-21	diskmemload	21:45:38	0
4013217	99	52	45,4	cyclictest	4146557	-21	systemd	23:02:16	1
4013217	99	52	44,5	cyclictest	4014927	-21	fschecks_count	19:15:20	1
4013217	99	52	44,5	cyclictest	0	-21	swapper/1	00:00:15	1
4013217	99	52	43,6	cyclictest	0	-21	swapper/1	22:05:27	1
4013216	99	52	46,4	cyclictest	4023399	-21	kworker/u4:19+events_unbound	19:50:04	0
4013216	99	52	45,5	cyclictest	4014436	-21	kworker/u4:2+events_unbound	19:25:03	0
4013216	99	52	39,11	cyclictest	4099028	-21	ssh	22:10:18	0
4013217	99	51	44,5	cyclictest	4177840	-21	kworker/u4:12+events_unbound	23:40:14	1
4013217	99	51	44,5	cyclictest	4154350	-21	unixbench_multi	23:10:40	1
4013217	99	51	43,6	cyclictest	400	-21	systemd-logind	00:13:36	1
4013216	99	51	42,7	cyclictest	12901	-21	fschecks_time	00:10:22	0
4013217	99	50	43,5	cyclictest	4191629	-21	systemd	23:53:11	1
4013217	99	50	43,5	cyclictest	4108484	-21	if_eth0	22:20:22	1
4013217	99	50	43,5	cyclictest	4080880	-21	aten_r7power_po	21:50:19	1
4013217	99	50	43,5	cyclictest	30599	-21	fschecks_time	00:30:21	1
4013217	99	50	40,8	cyclictest	4019573	-21	cron	19:35:00	1
4013216	99	50	44,4	cyclictest	4044533	-21	sh	21:10:18	0
4013216	99	50	41,7	cyclictest	4071915	-21	fschecks_count	21:40:19	0
4013216	99	50	38,9	cyclictest	30446	-21	/usr/sbin/munin	00:30:19	0
4013216	99	50	31,8	cyclictest	4139975	-21	fschecks_count	22:55:20	0
4013216	99	50	30,18	cyclictest	21370	-21	aten2__	00:20:14	0
4013216	99	50	29,18	cyclictest	0	-21	swapper/0	00:15:27	0
4013217	99	49	41,6	cyclictest	4172228	-21	unixbench_multi	23:30:46	1
4013217	99	49	41,6	cyclictest	4164311	-21	kworker/u4:5-rpciod	23:25:33	1
4013217	99	49	41,5	cyclictest	4134860	-21	grep	22:50:01	1
4013217	99	49	40,7	cyclictest	4029780	-21	kworker/u4:11+events_unbound	21:16:56	1
4013216	99	49	41,6	cyclictest	25869	-21	aten_r7power_po	00:25:14	0
4013216	99	49	41,5	cyclictest	4044033	-21	latency_hist	21:10:02	0
4013216	99	49	40,7	cyclictest	4166921	-21	gltestperf	23:25:20	0
4013216	99	49	40,7	cyclictest	4149627	-21	sendmail_mailqu	23:05:38	0
4013216	99	49	34,10	cyclictest	4043950	-21	diskmemload	22:36:09	0
4013216	99	49	34,10	cyclictest	4043950	-21	diskmemload	22:36:08	0
4013217	99	48	42,4	cyclictest	4041385	-21	apt	21:00:01	1
4013217	99	48	41,5	cyclictest	4162289	-21	fschecks_count	23:20:18	1
4013217	99	48	40,6	cyclictest	4104277	-21	ntpq	22:15:36	1
4013217	99	48	38,7	cyclictest	0	-21	swapper/1	22:27:08	1
4013216	99	48	41,5	cyclictest	4058136	-21	/usr/sbin/munin	21:25:16	0
4013216	99	48	38,7	cyclictest	4184706	-21	gltestperf	23:45:22	0
4013216	99	48	38,7	cyclictest	4184706	-21	gltestperf	23:45:21	0
4013217	99	47	41,4	cyclictest	4029307	-21	ntpq	20:10:29	1
4013217	99	47	41,4	cyclictest	25797	-21	aten_r7power_cu	00:25:14	1
4013217	99	47	40,5	cyclictest	4035276	-21	sed	20:35:15	1
4013217	99	47	39,6	cyclictest	4020044	-21	fschecks_count	19:35:20	1
4013217	99	47	38,6	cyclictest	0	-21	swapper/1	21:55:28	1
4013217	99	47	37,8	cyclictest	4044865	-21	kernelversion	21:10:23	1
4013217	99	47	35,9	cyclictest	4135459	-21	fschecks_count	22:50:21	1
4013216	99	47	40,5	cyclictest	4013656	-21	fschecks_count	19:10:21	0
4013216	99	47	39,5	cyclictest	4180314	-21	gltestperf	23:40:25	0
4013216	99	47	38,6	cyclictest	4089933	-21	aten_r7power_en	22:00:17	0
4013216	99	47	35,10	cyclictest	4175706	-21	/usr/sbin/munin	23:35:22	0
4013217	99	46	39,5	cyclictest	4080417	-21	munin-run	21:50:00	1
4013217	99	46	38,6	cyclictest	4018290	-21	kworker/u4:11+rpciod	19:40:37	1
4013217	99	46	38,5	cyclictest	0	-21	swapper/1	22:30:23	1
4013217	99	46	36,7	cyclictest	4014523	-21	latency_hist	19:15:02	1
4013217	99	46	35,9	cyclictest	21624	-21	fschecks_count	00:20:17	1
4013216	99	46	39,5	cyclictest	4171917	-21	proc_pri	23:30:43	0
4013216	99	46	39,5	cyclictest	4026020	-21	latency_hist	20:00:00	0
4013216	99	46	38,5	cyclictest	4105446	-21	kworker/u4:15-rpciod	22:20:01	0
4013216	99	46	33,10	cyclictest	4042678	-21	ls	21:05:00	0
4013216	99	46	28,15	cyclictest	0	-21	swapper/0	19:40:35	0
4013216	99	46	27,16	cyclictest	4078480	-21	kworker/u4:4+rpciod	23:10:15	0
4013217	99	45	39,4	cyclictest	4121926	-21	fschecks_time	22:35:22	1
4013217	99	45	39,4	cyclictest	4121926	-21	fschecks_time	22:35:21	1
4013217	99	45	38,5	cyclictest	8703	-21	ntpq	00:05:24	1
4013217	99	45	38,5	cyclictest	4053505	-21	basename	21:20:15	1
4013217	99	45	38,5	cyclictest	4039160	-21	fschecks_count	20:50:19	1
4013217	99	45	35,8	cyclictest	34743	-21	sh	00:35:18	1
4013217	99	45	32,10	cyclictest	37	-21	kcompactd0	22:57:32	1
4013216	99	45	7,14	cyclictest	15	1	ktimers/0	23:58:54	0
4013216	99	45	39,4	cyclictest	4113272	-21	ntp_offset	22:25:31	0
4013216	99	45	39,4	cyclictest	4027242	-21	kworker/u4:12+events_unbound	20:35:46	0
4013216	99	45	39,4	cyclictest	4017110	-21	latency_hist	19:25:02	0
4013216	99	45	39,3	cyclictest	0	-21	swapper/0	21:50:24	0
4013216	99	45	38,5	cyclictest	4144878	-21	/usr/sbin/munin	23:00:31	0
4013216	99	45	38,5	cyclictest	4015758	-21	apt	19:20:00	0
4013216	99	45	37,6	cyclictest	4071300	-21	munin-run	21:40:01	0
4013216	99	45	37,5	cyclictest	4031324	-21	aten_r7power_cu	20:20:18	0
4013216	99	45	36,7	cyclictest	4189280	-21	kernelversion	23:50:22	0
4013216	99	45	36,7	cyclictest	3868	-21	df_abs	00:00:17	0
4013216	99	45	35,8	cyclictest	4054757	-21	unixbench_singl	21:20:40	0
4013216	99	45	34,8	cyclictest	4127321	-21	unixbench_multi	22:40:38	0
4013216	99	45	34,8	cyclictest	4018608	-21	aten_r7power_vo	19:30:19	0
4013216	99	45	16,10	cyclictest	4023426	-21	apt	19:50:00	0
4013217	99	44	37,4	cyclictest	0	-21	swapper/1	21:35:28	1
4013217	99	44	36,6	cyclictest	4090055	-21	sed	22:00:18	1
4013217	99	44	36,5	cyclictest	0	-21	swapper/1	21:30:34	1
4013217	99	44	36,5	cyclictest	0	-21	swapper/1	19:45:32	1
4013217	99	44	31,11	cyclictest	0	-21	swapper/1	23:15:36	1
4013216	99	44	37,5	cyclictest	4117171	-21	aten_r7power_vo	22:30:17	0
4013216	99	44	35,7	cyclictest	4086584	-21	unixbench_singl	21:55:41	0
4013217	99	43	35,5	cyclictest	0	-21	swapper/1	19:25:12	1
4013216	99	43	33,8	cyclictest	4162936	-21	proc_pri	23:20:36	0
4013216	99	43	33,8	cyclictest	4033856	-21	aten_r7power_cu	20:30:18	0
4013216	99	43	33,8	cyclictest	4032655	-21	aten_r7power_po	20:25:17	0
4013217	99	42	33,7	cyclictest	4184570	-21	fschecks_count	23:45:20	1
4013217	99	42	33,7	cyclictest	4184570	-21	fschecks_count	23:45:20	1
4013217	99	42	33,7	cyclictest	0	-21	swapper/1	20:25:23	1
4013216	99	42	35,5	cyclictest	4038946	-21	aten2__	20:50:16	0
4013216	99	42	35,5	cyclictest	4037254	-21	timerandwakeup	20:40:38	0
4013216	99	42	35,5	cyclictest	4037254	-21	timerandwakeup	20:40:38	0
4013216	99	42	34,5	cyclictest	4025944	-21	kworker/u4:9-rpciod	20:20:01	0
4013216	99	42	27,11	cyclictest	4041105	-21	sort	20:55:41	0
4013217	99	41	34,4	cyclictest	4023617	-21	aten2__	19:50:17	1
4013217	99	41	33,5	cyclictest	0	-21	swapper/1	19:20:40	1
4013217	99	41	31,8	cyclictest	4044014	-21	sh	21:10:01	1
4013217	99	40	32,5	cyclictest	4031071	-21	cron	20:20:00	1
4013216	99	40	34,4	cyclictest	4026194	-21	aten_r7power_cu	20:00:15	0
4013217	99	39	32,5	cyclictest	4009513	-21	kworker/u4:3-events_unbound	19:55:12	1
4013217	99	39	30,5	cyclictest	0	-21	swapper/1	20:40:20	1
4013217	99	39	30,5	cyclictest	0	-21	swapper/1	20:40:20	1
4013216	99	39	32,5	cyclictest	4037665	-21	aten2__	20:45:15	0
4013216	99	39	31,6	cyclictest	4020494	-21	grep	19:35:37	0
4013217	99	38	31,5	cyclictest	4034163	-21	fschecks_time	20:30:21	1
4013217	99	38	31,5	cyclictest	4026449	-21	fschecks_count	20:00:18	1
4013217	99	38	31,4	cyclictest	0	-21	swapper/1	20:45:36	1
4013217	99	38	29,7	cyclictest	0	-21	swapper/1	21:00:17	1
4013217	99	38	29,7	cyclictest	0	-21	swapper/1	20:20:19	1
4013217	99	37	26,8	cyclictest	0	-21	swapper/1	20:05:17	1
4013216	99	35	14,18	cyclictest	14	-21	ksoftirqd/0	20:05:19	0
4013217	99	26	20,4	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17