OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Wed Jun 10, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4021881	99	115	107,6	cyclictest	4036061	-21	kworker/u4:1+events_unbound	08:08:44	1
4021881	99	114	106,6	cyclictest	4020604	-21	kworker/u4:2+events_unbound	07:28:35	1
4021881	99	106	99,5	cyclictest	4042444	-21	kworker/u4:7+events_unbound	09:08:54	1
4021880	99	101	57,6	cyclictest	4027030	-21	kworker/u4:14+events_unbound	07:35:00	0
4021880	99	101	57,6	cyclictest	4027030	-21	kworker/u4:14+events_unbound	07:34:59	0
4021881	99	97	90,5	cyclictest	4027030	-21	kworker/u4:14+events_unbound	07:33:38	1
4021881	99	97	90,5	cyclictest	4027030	-21	kworker/u4:14+events_unbound	07:33:38	1
4021881	99	97	89,6	cyclictest	4051387	-21	kworker/u4:16+events_unbound	09:03:54	1
4021881	99	92	85,5	cyclictest	4036060	-21	kworker/u4:0+events_unbound	08:53:51	1
4021880	99	91	82,6	cyclictest	4146350	-21	kworker/u4:0+events_unbound	11:40:01	0
4021881	99	88	74,7	cyclictest	4037331	-21	kworker/u4:13+events_unbound	08:17:01	1
4021880	99	86	77,7	cyclictest	4033490	-21	kworker/u4:5+events_unbound	09:45:00	0
4021880	99	86	44,15	cyclictest	4021877	-21	cyclictest	12:00:39	0
4021881	99	84	61,20	cyclictest	0	-21	swapper/1	09:50:14	1
4021880	99	82	40,34	cyclictest	256	50	irq/23-42890000.ethernet	12:15:13	0
4021880	99	81	63,5	cyclictest	4042444	-21	kworker/u4:7+events_unbound	09:24:00	0
4021880	99	80	72,5	cyclictest	4150715	-21	kworker/u4:9+events_unbound	11:14:23	0
4021880	99	79	60,5	cyclictest	4150717	-21	kworker/u4:13+events_unbound	11:19:23	0
4021880	99	78	70,6	cyclictest	4021807	-21	kworker/u4:5+events_unbound	07:13:34	0
4021881	99	77	62,11	cyclictest	37276	-21	ntpq	12:35:35	1
4021880	99	77	69,5	cyclictest	4193868	-21	kworker/u4:4+events_unbound	12:14:35	0
4021880	99	77	56,15	cyclictest	53	-21	kswapd0	10:00:12	0
4021880	99	75	66,6	cyclictest	4129467	-21	kworker/u4:8+events_unbound	10:40:00	0
4021880	99	74	65,6	cyclictest	4048822	-21	kworker/u4:11+events_unbound	09:00:01	0
4021880	99	74	46,20	cyclictest	53	-21	kswapd0	11:55:07	0
4021881	99	73	66,5	cyclictest	27	1	ktimers/1	11:47:00	1
4021880	99	73	61,8	cyclictest	4048820	-21	kworker/u4:8+events_unbound	08:55:00	0
4021880	99	73	47,8	cyclictest	4036062	-21	kworker/u4:3+events_unbound	09:15:01	0
4021880	99	71	63,6	cyclictest	4150717	-21	kworker/u4:13+events_unbound	11:04:22	0
4021880	99	70	56,9	cyclictest	4190585	-21	ssh	11:48:50	0
4021880	99	67	56,9	cyclictest	4146354	-21	kworker/u4:6+events_unbound	11:00:02	0
4021880	99	66	47,17	cyclictest	4155093	-21	kworker/u4:1+events_unbound	12:35:00	0
4021881	99	65	50,7	cyclictest	4023100	-21	kworker/u4:7+events_unbound	07:37:45	1
4021880	99	63	55,6	cyclictest	4034759	-21	kworker/u4:6+events_unbound	08:33:49	0
4021880	99	63	55,6	cyclictest	4023100	-21	kworker/u4:7+events_unbound	07:43:39	0
4021881	99	62	48,9	cyclictest	4096468	-21	apt-get	10:00:08	1
4021881	99	60	50,7	cyclictest	4178402	-21	ssh	11:35:00	1
4021881	99	59	51,5	cyclictest	0	-21	swapper/1	12:04:33	1
4021881	99	59	41,11	cyclictest	4155093	-21	kworker/u4:1-rpciod	11:11:40	1
4021880	99	59	42,6	cyclictest	25607	-21	kworker/u4:16+events_unbound	12:39:42	0
4021880	99	57	48,7	cyclictest	4155097	-21	kworker/u4:10+events_unbound	11:29:26	0
4021880	99	56	46,7	cyclictest	4078512	-21	sshd	09:39:01	0
4021880	99	56	40,9	cyclictest	4033490	-21	kworker/u4:5-xprtiod	09:58:16	0
4021881	99	55	42,10	cyclictest	0	-21	swapper/1	12:25:11	1
4021881	99	54	47,5	cyclictest	4168242	-21	kworker/u4:4+events_unbound	11:24:59	1
4021881	99	54	47,5	cyclictest	25607	-21	kworker/u4:16+events_unbound	12:34:00	1
4021880	99	54	47,5	cyclictest	4178048	-21	sshd	11:34:25	0
4021881	99	53	44,6	cyclictest	4131265	-21	dpkg	10:40:12	1
4021881	99	53	38,13	cyclictest	0	-21	swapper/1	11:05:11	1
4021880	99	53	44,7	cyclictest	4051416	-21	sh	09:05:00	0
4021880	99	53	38,12	cyclictest	4135410	-21	latency_hist	10:45:01	0
4021881	99	52	16,18	cyclictest	1957	-21	ssh	11:55:08	1
4021880	99	52	44,6	cyclictest	4185149	-21	kworker/u4:18+events_unbound	11:43:45	0
4021880	99	52	37,10	cyclictest	0	-21	swapper/0	10:30:32	0
4021881	99	51	8,29	cyclictest	4079487	-21	ssh	09:40:14	1
4021881	99	51	44,5	cyclictest	4141976	-21	kworker/u4:4+events_unbound	10:54:20	1
4021881	99	51	44,5	cyclictest	4025761	-21	kworker/u4:13+events_unbound	07:40:46	1
4021881	99	51	40,9	cyclictest	0	-21	swapper/1	10:55:24	1
4021881	99	51	40,7	cyclictest	0	-21	swapper/1	10:05:26	1
4021880	99	51	44,5	cyclictest	4136554	-21	/usr/sbin/munin	10:45:40	0
4021881	99	50	43,5	cyclictest	4119457	-21	timerandwakeup	10:25:37	1
4021881	99	50	43,5	cyclictest	4090631	-21	kworker/u4:14+events_unbound	09:58:01	1
4021881	99	50	42,5	cyclictest	4084231	-21	grep	09:45:19	1
4021880	99	50	42,5	cyclictest	4110355	-21	rm	10:15:22	0
4021881	99	49	42,5	cyclictest	4123849	-21	unixbench-2d	10:30:39	1
4021881	99	49	42,5	cyclictest	4066456	-21	/usr/sbin/munin	09:25:15	1
4021881	99	49	41,5	cyclictest	4021877	-21	cyclictest	10:20:24	1
4021881	99	49	40,7	cyclictest	17415	-21	kworker/u4:11+events_unbound	12:19:38	1
4021881	99	49	39,7	cyclictest	4023137	-21	apt	07:14:59	1
4021881	99	49	34,7	cyclictest	4023100	-21	kworker/u4:7+events_unbound	07:49:00	1
4021880	99	49	42,5	cyclictest	1751	-21	latency_hist	11:55:02	0
4021880	99	49	42,5	cyclictest	1751	-21	latency_hist	11:55:02	0
4021880	99	49	39,7	cyclictest	4122376	-21	idleruntime-cro	10:30:00	0
4021880	99	49	39,7	cyclictest	4037856	-21	fschecks_time	08:10:19	0
4021881	99	48	39,6	cyclictest	0	-21	swapper/1	11:15:16	1
4021881	99	48	38,7	cyclictest	0	-21	swapper/1	11:53:51	1
4021881	99	48	38,7	cyclictest	0	-21	swapper/1	11:53:51	1
4021880	99	48	41,5	cyclictest	4068493	-21	kworker/u4:4+events_unbound	09:32:45	0
4021880	99	48	39,6	cyclictest	23576	-21	/usr/sbin/munin	12:20:15	0
4021880	99	48	38,8	cyclictest	4156419	-21	systemd	11:09:22	0
4021881	99	47	41,5	cyclictest	4155094	-21	kworker/u4:3+events_unbound	11:26:59	1
4021881	99	47	41,4	cyclictest	1069	-21	lldpd	09:36:59	1
4021881	99	47	40,6	cyclictest	4042444	-21	kworker/u4:7+events_unbound	08:31:01	1
4021881	99	47	40,5	cyclictest	4108887	-21	sshd	10:14:10	1
4021881	99	47	40,5	cyclictest	4025761	-21	kworker/u4:13+events_unbound	07:22:01	1
4021881	99	47	40,5	cyclictest	4006737	-21	kworker/u4:11+events_unbound	08:02:04	1
4021880	99	47	41,4	cyclictest	4141033	-21	timerwakeupswit	10:50:38	0
4021880	99	47	41,4	cyclictest	4066673	-21	fschecks_time	09:25:18	0
4021880	99	47	39,6	cyclictest	4166918	-21	/usr/sbin/munin	11:20:40	0
4021880	99	47	37,7	cyclictest	4026255	-21	fschecks_time	07:25:18	0
4021880	99	47	36,9	cyclictest	4057889	-21	fschecks_time	09:15:19	0
4021880	99	47	17,7	cyclictest	0	-21	swapper/0	09:05:12	0
4021881	99	46	40,4	cyclictest	4110799	-21	grep	10:15:36	1
4021881	99	46	39,5	cyclictest	4046719	-21	fschecks_count	08:45:20	1
4021881	99	46	39,5	cyclictest	11720	-21	threads	12:05:41	1
4021881	99	46	37,5	cyclictest	0	-21	swapper/1	08:55:34	1
4021881	99	46	36,7	cyclictest	4040161	-21	aten_r7power_cu	08:20:16	1
4021881	99	46	36,7	cyclictest	0	-21	swapper/1	09:30:36	1
4021881	99	46	16,5	cyclictest	27	1	ktimers/1	11:40:30	1
4021880	99	46	37,7	cyclictest	4035043	-21	aten_r7power_cu	08:00:14	0
4021880	99	46	37,7	cyclictest	4032163	-21	unixbench_singl	07:45:38	0
4021880	99	46	37,7	cyclictest	378	-21	dbus-daemon	12:09:35	0
4021880	99	46	37,6	cyclictest	4029656	-21	apt-config	07:40:01	0
4021880	99	46	36,7	cyclictest	4032745	-21	fschecks_time	07:50:18	0
4021880	99	46	35,7	cyclictest	0	-21	swapper/0	09:45:29	0
4021880	99	46	34,7	cyclictest	256	50	irq/23-42890000.ethernet	10:10:31	0
4021880	99	46	29,15	cyclictest	27937	-21	wget	12:25:14	0
4021880	99	46	2,33	cyclictest	0	-21	swapper/0	07:15:13	0
4021881	99	45	38,5	cyclictest	4182754	-21	sendmail-msp	11:40:01	1
4021881	99	45	38,5	cyclictest	4054235	-21	ls	09:10:37	1
4021881	99	45	38,5	cyclictest	16785	-21	kworker/u4:9+events_unbound	12:12:05	1
4021881	99	45	36,6	cyclictest	0	-21	swapper/1	10:45:40	1
4021880	99	45	38,5	cyclictest	4025761	-21	kworker/u4:13+events_unbound	07:24:59	0
4021881	99	44	38,5	cyclictest	4042444	-21	kworker/u4:7+events_unbound	08:29:02	1
4021881	99	44	38,4	cyclictest	23950	-21	gltestperf	12:20:19	1
4021881	99	44	37,5	cyclictest	4146352	-21	kworker/u4:1+events_unbound	11:01:07	1
4021881	99	44	37,5	cyclictest	4036060	-21	kworker/u4:0+events_unbound	08:37:03	1
4021881	99	44	35,7	cyclictest	4033490	-21	kworker/u4:5-rpciod	07:55:37	1
4021881	99	44	34,8	cyclictest	4062342	-21	grep	09:20:19	1
4021880	99	44	37,5	cyclictest	4041214	-21	idleruntime-cro	08:24:59	0
4021880	99	44	37,5	cyclictest	4039928	-21	idleruntime-cro	08:20:00	0
4021880	99	44	36,5	cyclictest	4033490	-21	kworker/u4:5-rpciod	09:50:15	0
4021881	99	43	35,6	cyclictest	4023798	-21	gltestperf	07:15:25	1
4021881	99	43	34,7	cyclictest	4036060	-21	kworker/u4:0+events_unbound	09:18:57	1
4021881	99	42	33,7	cyclictest	4127527	-21	kernelversion	10:35:22	1
4021880	99	42	35,5	cyclictest	4045044	-21	sendmail	08:39:59	0
4021880	99	42	33,7	cyclictest	4102272	-21	timerwakeupswit	10:05:40	0
4021880	99	42	33,6	cyclictest	4046106	-21	timerwakeupswit	08:40:45	0
4021880	99	42	31,8	cyclictest	4037181	-21	timerwakeupswit	08:05:37	0
4021881	99	41	31,7	cyclictest	0	-21	swapper/1	07:50:22	1
4021880	99	41	35,4	cyclictest	4111930	-21	kworker/u4:13-rpciod	10:20:22	0
4021880	99	41	35,4	cyclictest	4046793	-21	fschecks_time	08:45:20	0
4021880	99	41	32,6	cyclictest	4023101	-21	kworker/u4:8-rpciod	07:55:19	0
4021881	99	40	34,4	cyclictest	4038274	-21	sendmail_mailqu	08:10:35	1
4021881	99	40	26,6	cyclictest	4036062	-21	kworker/u4:3+events_unbound	08:42:46	1
4021880	99	39	29,7	cyclictest	4042470	-21	kworker/u4:13	08:30:01	0
4021880	99	29	18,6	cyclictest	4016871	-21	kworker/u4:6+rpciod	07:10:02	0
4021880	99	29	18,6	cyclictest	4016871	-21	kworker/u4:6+rpciod	07:10:01	0
4021881	99	26	14,9	cyclictest	4021955	-21	sed	07:10:01	1
4021881	99	26	14,9	cyclictest	4021955	-21	sed	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17