OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Wed Mar 11, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
714421	99	136	124,9	cyclictest	53	-21	kswapd0	11:10:10	0
714421	99	111	92,7	cyclictest	879451	-21	kworker/u4:14+events_unbound	11:33:46	0
714421	99	106	88,13	cyclictest	53	-21	kswapd0	12:00:09	0
714421	99	105	85,7	cyclictest	898353	-21	kworker/u4:12+events_unbound	11:58:51	0
714423	99	104	96,6	cyclictest	828553	-21	kworker/u4:11+events_unbound	10:43:38	1
714423	99	104	96,6	cyclictest	828553	-21	kworker/u4:11+events_unbound	10:43:37	1
714423	99	103	87,7	cyclictest	718220	-21	kworker/u4:13+events_unbound	07:47:58	1
714423	99	100	93,5	cyclictest	719495	-21	kworker/u4:19+events_unbound	08:03:00	1
714421	99	100	83,6	cyclictest	912546	-21	kworker/u4:6+events_unbound	12:23:56	0
714421	99	100	81,7	cyclictest	884178	-21	kworker/u4:0+events_unbound	11:38:48	0
714423	99	93	84,6	cyclictest	687428	-21	kworker/u4:10+events_unbound	07:53:00	1
714423	99	92	84,6	cyclictest	795864	-21	kworker/u4:7+events_unbound	10:03:28	1
714421	99	90	83,5	cyclictest	819000	-21	kworker/u4:2+events_unbound	10:40:10	0
714421	99	90	83,5	cyclictest	819000	-21	kworker/u4:2+events_unbound	10:40:10	0
714423	99	88	78,7	cyclictest	53	-21	kswapd0	10:50:13	1
714421	99	88	83,3	cyclictest	861190	-21	kworker/u4:10+events_unbound	11:25:16	0
714421	99	88	81,5	cyclictest	795862	-21	kworker/u4:3+events_unbound	10:15:38	0
714421	99	88	75,10	cyclictest	53	-21	kswapd0	12:05:07	0
714423	99	87	80,5	cyclictest	53	-21	kswapd0	11:25:15	1
714421	99	87	79,6	cyclictest	846904	-21	kworker/u4:8+events_unbound	10:58:41	0
714421	99	85	73,8	cyclictest	53	-21	kswapd0	10:25:10	0
714423	99	81	68,6	cyclictest	875412	-21	kworker/u4:1+events_unbound	11:48:51	1
714421	99	81	74,5	cyclictest	687428	-21	kworker/u4:10+events_unbound	07:17:56	0
714421	99	81	73,6	cyclictest	865944	-21	kworker/u4:11+events_unbound	12:34:28	0
714421	99	79	71,6	cyclictest	786278	-21	kworker/u4:12+events_unbound	09:53:27	0
714421	99	78	71,5	cyclictest	791056	-21	kworker/u4:2+events_unbound	09:58:27	0
714423	99	77	70,5	cyclictest	731146	-21	kworker/u4:5+events_unbound	08:33:05	1
714423	99	76	68,6	cyclictest	935446	-21	kworker/u4:0+events_unbound	12:33:58	1
714423	99	76	58,7	cyclictest	856447	-21	kworker/u4:4+events_unbound	11:10:12	1
714423	99	73	65,6	cyclictest	696813	-21	kworker/u4:11+events_unbound	07:42:58	1
714421	99	73	63,7	cyclictest	53	-21	kswapd0	11:45:31	0
714423	99	72	65,5	cyclictest	819000	-21	kworker/u4:2+events_unbound	10:34:58	1
714423	99	72	65,5	cyclictest	819000	-21	kworker/u4:2+events_unbound	10:34:57	1
714421	99	72	54,16	cyclictest	53	-21	kswapd0	10:39:59	0
714421	99	72	53,7	cyclictest	861190	-21	kworker/u4:10+events_unbound	11:18:42	0
714421	99	71	64,5	cyclictest	719495	-21	kworker/u4:19+events_unbound	07:37:57	0
714421	99	70	64,4	cyclictest	898353	-21	kworker/u4:12+events_unbound	12:15:01	0
714421	99	70	64,4	cyclictest	819003	-21	kworker/u4:6+events_unbound	10:30:31	0
714421	99	70	64,4	cyclictest	819003	-21	kworker/u4:6+events_unbound	10:30:31	0
714421	99	70	61,7	cyclictest	53	-21	kswapd0	11:50:35	0
714423	99	68	61,5	cyclictest	731146	-21	kworker/u4:5+events_unbound	08:53:12	1
714423	99	67	60,5	cyclictest	856447	-21	kworker/u4:4+events_unbound	11:09:53	1
714423	99	67	59,6	cyclictest	696813	-21	kworker/u4:11+events_unbound	07:12:56	1
714421	99	67	57,7	cyclictest	53	-21	kswapd0	11:05:36	0
714423	99	65	51,6	cyclictest	719495	-21	kworker/u4:19+events_unbound	07:27:58	1
714423	99	65	51,6	cyclictest	719495	-21	kworker/u4:19+events_unbound	07:27:58	1
714421	99	65	60,4	cyclictest	758078	-21	kworker/u4:16+events_unbound	09:28:16	0
714421	99	64	57,5	cyclictest	865945	-21	kworker/u4:12+events_unbound	11:23:45	0
714421	99	64	53,7	cyclictest	53	-21	kswapd0	12:35:33	0
714423	99	63	56,5	cyclictest	53	-21	kswapd0	12:30:01	1
714423	99	63	44,7	cyclictest	745292	-21	kworker/u4:2+events_unbound	09:27:59	1
714421	99	63	46,7	cyclictest	719495	-21	kworker/u4:19+events_unbound	08:35:01	0
714423	99	62	44,5	cyclictest	827843	-21	kworker/u4:7+events_unbound	10:47:00	1
714421	99	62	41,15	cyclictest	53	-21	kswapd0	10:00:11	0
714421	99	62	3,10	cyclictest	769636	-21	apt-get	09:35:14	0
714421	99	60	53,5	cyclictest	809443	-21	kworker/u4:4+events_unbound	10:20:34	0
714421	99	60	52,6	cyclictest	922003	-21	kworker/u4:15+events_unbound	12:18:54	0
714421	99	60	16,32	cyclictest	0	-21	swapper/0	07:40:06	0
714423	99	59	51,6	cyclictest	865944	-21	kworker/u4:11+events_unbound	12:05:12	1
714423	99	59	51,6	cyclictest	719496	-21	kworker/u4:20+events_unbound	07:32:56	1
714423	99	59	46,6	cyclictest	898353	-21	kworker/u4:12+events_unbound	11:53:59	1
714421	99	58	50,5	cyclictest	729879	-21	kworker/u4:4+events_unbound	08:40:00	0
714421	99	58	49,7	cyclictest	861189	-21	kworker/u4:9+events_unbound	11:43:49	0
714423	99	57	49,6	cyclictest	719497	-21	kworker/u4:21+events_unbound	07:58:00	1
714423	99	57	43,10	cyclictest	731783	-21	gltestperf	08:15:19	1
714423	99	56	46,6	cyclictest	0	-21	swapper/1	09:55:15	1
714421	99	55	2,18	cyclictest	737582	-21	apt-get	08:40:08	0
714423	99	54	47,5	cyclictest	714419	-21	cyclictest	09:13:13	1
714421	99	54	47,5	cyclictest	849703	-21	df_abs	11:00:15	0
714423	99	53	39,8	cyclictest	0	-21	swapper/1	08:10:24	1
714421	99	53	45,6	cyclictest	736268	-21	kworker/u4:7+events_unbound	09:03:13	0
714423	99	52	43,7	cyclictest	0	-21	swapper/1	09:40:43	1
714423	99	52	42,8	cyclictest	871606	-21	sshd	11:23:43	1
714421	99	52	44,6	cyclictest	731152	-21	kworker/u4:7+events_unbound	08:13:03	0
714421	99	52	44,6	cyclictest	729877	-21	kworker/u4:0+events_unbound	08:28:05	0
714421	99	52	43,7	cyclictest	736268	-21	kworker/u4:7+events_unbound	09:20:00	0
714421	99	52	29,8	cyclictest	736268	-21	kworker/u4:7+events_unbound	09:24:09	0
714423	99	51	8,33	cyclictest	798790	-21	ssh	10:05:33	1
714423	99	51	43,6	cyclictest	922898	-21	sshd	12:18:54	1
714423	99	51	41,7	cyclictest	886450	-21	modprobe	11:40:00	1
714423	99	51	41,6	cyclictest	865944	-21	kworker/u4:11-rpciod	12:00:17	1
714423	99	51	40,8	cyclictest	756286	-21	ps	09:20:36	1
714423	99	51	39,8	cyclictest	807036	-21	cat	10:15:02	1
714421	99	51	45,4	cyclictest	719495	-21	kworker/u4:19+events_unbound	08:00:00	0
714421	99	51	35,6	cyclictest	713140	-21	kworker/u4:1+events_unbound	07:30:01	0
714421	99	51	35,6	cyclictest	713140	-21	kworker/u4:1+events_unbound	07:30:00	0
714423	99	50	44,4	cyclictest	804716	-21	kworker/u4:0+events_unbound	10:29:00	1
714423	99	50	43,5	cyclictest	864808	-21	unixbench_singl	11:15:42	1
714423	99	50	43,5	cyclictest	765548	-21	rm	09:30:22	1
714423	99	50	42,6	cyclictest	713144	-21	kworker/u4:2+events_unbound	07:17:02	1
714423	99	50	32,15	cyclictest	0	-21	swapper/1	10:15:29	1
714421	99	50	43,5	cyclictest	795862	-21	kworker/u4:3+events_unbound	10:14:59	0
714421	99	50	41,7	cyclictest	765956	-21	mailstats	09:30:37	0
714421	99	50	29,18	cyclictest	838104	-21	kworker/u4:5+rpciod	10:50:19	0
714423	99	49	40,7	cyclictest	846051	-21	grep	10:55:41	1
714423	99	49	36,7	cyclictest	0	-21	swapper/1	12:10:24	1
714423	99	49	35,10	cyclictest	0	-21	swapper/1	07:35:25	1
714421	99	49	41,5	cyclictest	739867	-21	/usr/sbin/munin	08:45:35	0
714421	99	49	38,9	cyclictest	775100	-21	/usr/sbin/munin	09:40:29	0
714423	99	48	39,7	cyclictest	378	-21	dbus-daemon	11:33:46	1
714423	99	48	39,6	cyclictest	924375	-21	fschecks_time	12:20:18	1
714423	99	48	38,7	cyclictest	754963	-21	grep	09:19:59	1
714423	99	48	37,8	cyclictest	53	-21	kswapd0	11:40:33	1
714423	99	48	36,9	cyclictest	718330	-21	latency_hist	07:25:01	1
714423	99	48	35,9	cyclictest	826091	-21	wget	10:35:16	1
714421	99	48	40,4	cyclictest	0	-21	swapper/0	08:25:01	0
714421	99	48	3,26	cyclictest	839784	-21	latency_hist	10:50:01	0
714423	99	47	40,5	cyclictest	1	-21	systemd	11:58:50	1
714423	99	47	36,8	cyclictest	779115	-21	/usr/sbin/munin	09:45:15	1
714421	99	47	39,5	cyclictest	741519	-21	grep	08:55:01	0
714421	99	47	36,8	cyclictest	928673	-21	aten_r7power_cu	12:25:15	0
714423	99	46	38,6	cyclictest	742770	-21	apt	09:00:01	1
714423	99	46	34,9	cyclictest	738224	-21	gltestperf	08:40:24	1
714423	99	46	33,8	cyclictest	0	-21	swapper/1	09:05:40	1
714423	99	46	30,12	cyclictest	0	-21	swapper/1	10:20:18	1
714423	99	46	20,22	cyclictest	27	1	ktimers/1	08:45:25	1
714421	99	46	40,4	cyclictest	781487	-21	kworker/u4:5+events_unbound	09:47:59	0
714421	99	46	39,5	cyclictest	714419	-21	cyclictest	10:05:23	0
714421	99	46	35,9	cyclictest	714943	-21	tail	07:10:20	0
714421	99	46	24,6	cyclictest	696813	-21	kworker/u4:11+events_unbound	07:24:42	0
714423	99	45	33,7	cyclictest	935450	-21	kworker/u4:5-rpciod	12:35:25	1
714423	99	45	29,13	cyclictest	0	-21	swapper/1	08:25:17	1
714421	99	45	38,5	cyclictest	728997	-21	df_abs	08:05:17	0
714421	99	45	35,7	cyclictest	741946	-21	fschecks_count	08:55:18	0
714421	99	45	24,19	cyclictest	724615	-21	unixbench_multi	07:45:35	0
714423	99	44	36,5	cyclictest	770933	-21	rm	09:35:38	1
714423	99	44	34,7	cyclictest	850205	-21	diskmemload	11:00:27	1
714423	99	44	34,7	cyclictest	0	-21	swapper/1	09:50:25	1
714423	99	43	28,11	cyclictest	0	-21	swapper/1	08:35:37	1
714421	99	43	36,5	cyclictest	724686	-21	kworker/u4:2+events_unbound	08:18:04	0
714421	99	43	35,5	cyclictest	747010	-21	uptime	09:10:39	0
714421	99	43	35,5	cyclictest	727847	-21	tune2fs	08:00:19	0
714423	99	41	34,5	cyclictest	729895	-21	cron	08:10:00	1
714423	99	41	30,8	cyclictest	0	-21	swapper/1	09:05:00	1
714421	99	41	33,6	cyclictest	718222	-21	kworker/u4:15+events_unbound	07:32:00	0
714423	99	40	27,5	cyclictest	732430	-21	kworker/u4:8+events_unbound	08:23:01	1
714421	99	40	34,4	cyclictest	745346	-21	munin-run	09:10:00	0
714421	99	40	25,4	cyclictest	718220	-21	kworker/u4:13+events_unbound	07:50:24	0
714423	99	34	25,6	cyclictest	0	-21	swapper/1	07:10:00	1
714421	99	33	26,4	cyclictest	0	-21	swapper/0	07:10:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17