OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Sun Jan 25, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
166172	99	96	87,6	cyclictest	260228	-21	kworker/u4:11+events_unbound	22:22:52	1
166172	99	93	72,9	cyclictest	177743	-21	kworker/u4:5+events_unbound	20:52:36	1
166172	99	80	61,13	cyclictest	171291	-21	modprobe	19:30:01	1
166172	99	80	49,5	cyclictest	294186	-21	/usr/sbin/munin	23:00:30	1
166172	99	79	71,5	cyclictest	277912	-21	kworker/u4:11+events_unbound	22:53:01	1
166172	99	78	51,22	cyclictest	337591	-21	ntpq	23:50:29	1
166171	99	75	55,10	cyclictest	171292	-21	kworker/u4:2	19:30:00	0
166171	99	73	64,6	cyclictest	180280	-21	kworker/u4:14+events_unbound	21:17:40	0
166172	99	72	66,4	cyclictest	180280	-21	kworker/u4:14+events_unbound	20:22:34	1
166172	99	72	66,4	cyclictest	180280	-21	kworker/u4:14+events_unbound	20:22:34	1
166171	99	71	45,16	cyclictest	0	-21	swapper/0	23:50:28	0
166171	99	69	61,6	cyclictest	364948	-21	kworker/u4:6+events_unbound	00:33:15	0
166172	99	66	56,7	cyclictest	339097	-21	kworker/u4:9+events_unbound	23:58:10	1
166171	99	66	58,6	cyclictest	352335	-21	kworker/u4:1+events_unbound	00:08:10	0
166171	99	65	56,7	cyclictest	217083	-21	kworker/u4:10+events_unbound	21:42:44	0
166171	99	64	56,6	cyclictest	330303	-21	kworker/u4:7+events_unbound	23:48:09	0
166172	99	62	52,7	cyclictest	260227	-21	kworker/u4:10+events_unbound	22:58:00	1
166172	99	61	53,6	cyclictest	325839	-21	kworker/u4:14+events_unbound	23:43:07	1
166172	99	61	53,6	cyclictest	221588	-21	kworker/u4:2+events_unbound	21:37:44	1
166172	99	61	51,7	cyclictest	169925	-21	kworker/u4:5+events_unbound	19:22:28	1
166171	99	60	51,6	cyclictest	171268	-21	kworker/u4:8+events_unbound	19:32:30	0
166171	99	60	50,7	cyclictest	388	-21	dbus-daemon	23:13:04	0
166171	99	59	48,8	cyclictest	314	-21	systemd-journal	00:13:12	0
166171	99	58	47,9	cyclictest	54	-21	kswapd0	22:30:00	0
166171	99	57	41,10	cyclictest	180304	-21	modprobe	20:05:00	0
166172	99	56	49,5	cyclictest	269658	-21	kworker/u4:5+events_unbound	22:35:15	1
166172	99	56	49,5	cyclictest	269658	-21	kworker/u4:5+events_unbound	22:35:14	1
166171	99	56	46,7	cyclictest	171279	-21	kworker/u4:11+events_unbound	19:42:31	0
166172	99	55	46,7	cyclictest	208563	-21	systemd	21:22:39	1
166171	99	55	46,7	cyclictest	410	-21	systemd-logind	20:47:35	0
166171	99	55	46,6	cyclictest	171268	-21	kworker/u4:8+events_unbound	19:57:32	0
166171	99	55	35,18	cyclictest	228430	-21	fschecks_time	21:45:19	0
166172	99	54	45,7	cyclictest	54	-21	kswapd0	23:35:13	1
166172	99	54	44,8	cyclictest	191642	-21	systemd	20:47:35	1
166171	99	54	47,4	cyclictest	220316	-21	switchtime	21:35:36	0
166171	99	54	46,6	cyclictest	234894	-21	kworker/u4:6+events_unbound	21:52:45	0
166172	99	53	45,6	cyclictest	265259	-21	kworker/u4:0+events_unbound	22:48:01	1
166172	99	53	42,9	cyclictest	358735	-21	cpu	00:15:16	1
166172	99	53	42,9	cyclictest	358735	-21	cpu	00:15:15	1
166171	99	53	45,6	cyclictest	54	-21	kswapd0	22:10:19	0
166171	99	53	45,6	cyclictest	217468	-21	sshd	21:32:41	0
166172	99	52	44,6	cyclictest	171279	-21	kworker/u4:11+events_unbound	19:37:31	1
166172	99	52	42,8	cyclictest	167373	-21	kworker/u4:4+events_unbound	19:45:02	1
166172	99	52	34,6	cyclictest	300086	-21	kworker/u4:5+events_unbound	23:08:02	1
166171	99	52	45,5	cyclictest	261308	-21	sshd	22:22:51	0
166171	99	52	44,5	cyclictest	368552	-21	unixbench_singl	00:25:41	0
166171	99	52	43,6	cyclictest	246585	-21	/usr/sbin/munin	22:05:36	0
166172	99	51	43,6	cyclictest	216004	-21	sed	21:30:37	1
166172	99	51	42,7	cyclictest	189104	-21	systemd	20:37:34	1
166172	99	51	39,9	cyclictest	201313	-21	latency_hist	21:15:01	1
166171	99	51	44,5	cyclictest	307035	-21	/usr/sbin/munin	23:15:22	0
166172	99	50	44,4	cyclictest	302228	-21	aten2__	23:10:18	1
166172	99	50	42,6	cyclictest	166751	-21	sed	19:10:20	1
166172	99	50	42,5	cyclictest	379997	-21	ssh	00:40:00	1
166172	99	50	42,5	cyclictest	193436	-21	fschecks_time	20:55:19	1
166172	99	50	38,10	cyclictest	336541	-21	cron	23:50:00	1
166171	99	50	42,6	cyclictest	268137	-21	/usr/sbin/munin	22:30:35	0
166171	99	50	42,5	cyclictest	236795	-21	ssh	21:55:14	0
166171	99	50	40,7	cyclictest	276401	-21	fschecks_time	22:40:20	0
166172	99	49	42,5	cyclictest	177744	-21	kworker/u4:6+events_unbound	19:52:31	1
166172	99	49	39,8	cyclictest	253926	-21	apt-get	22:15:00	1
166171	99	49	42,5	cyclictest	206281	-21	fschecks_count	21:20:17	0
166171	99	49	41,5	cyclictest	298221	-21	/usr/sbin/munin	23:05:19	0
166171	99	49	40,6	cyclictest	184603	-21	fschecks_time	20:20:21	0
166171	99	49	40,6	cyclictest	184603	-21	fschecks_time	20:20:20	0
166171	99	49	34,9	cyclictest	37	-21	kcompactd0	23:00:04	0
166171	99	49	29,18	cyclictest	210878	-21	head	21:25:22	0
166172	99	48	40,6	cyclictest	365802	-21	sd-accept	00:23:12	1
166172	99	48	40,5	cyclictest	345978	-21	192.168.115.60-manager	00:00:21	1
166172	99	48	40,5	cyclictest	345978	-21	192.168.115.60-manager	00:00:20	1
166172	99	48	39,7	cyclictest	240794	-21	cron	22:00:00	1
166172	99	48	39,6	cyclictest	0	-21	swapper/1	22:05:11	1
166172	99	48	38,7	cyclictest	0	-21	swapper/1	23:20:13	1
166171	99	48	42,4	cyclictest	197641	-21	memory	21:10:26	0
166171	99	48	41,5	cyclictest	362604	-21	idleruntime-cro	00:19:59	0
166171	99	48	41,5	cyclictest	362604	-21	idleruntime-cro	00:19:59	0
166171	99	48	41,5	cyclictest	255435	-21	grep	22:15:43	0
166171	99	48	39,6	cyclictest	186810	-21	aten2__	20:30:15	0
166171	99	48	37,8	cyclictest	168886	-21	aten2__	19:20:16	0
166171	99	48	27,18	cyclictest	0	-21	swapper/0	22:45:35	0
166171	99	48	19,23	cyclictest	255	50	irq/23-42890000.ethernet	00:38:59	0
166172	99	47	41,4	cyclictest	371682	-21	hostname	00:30:16	1
166172	99	47	40,5	cyclictest	224653	-21	/usr/sbin/munin	21:40:40	1
166172	99	47	36,9	cyclictest	195685	-21	aten_r7power_cu	21:05:14	1
166172	99	47	36,7	cyclictest	349933	-21	rm	00:05:16	1
166172	99	47	27,13	cyclictest	180305	-21	kworker/u4:0	20:05:01	1
166171	99	47	40,5	cyclictest	188243	-21	df_abs	20:35:16	0
166171	99	47	40,5	cyclictest	167373	-21	kworker/u4:4+events_unbound	19:17:27	0
166171	99	47	39,6	cyclictest	272911	-21	unixbench_multi	22:35:43	0
166171	99	47	39,6	cyclictest	272911	-21	unixbench_multi	22:35:43	0
166171	99	47	38,6	cyclictest	325839	-21	kworker/u4:14+events_unbound	23:38:08	0
166171	99	47	36,7	cyclictest	313804	-21	ssh	23:23:18	0
166171	99	47	35,9	cyclictest	189375	-21	aten_r7power_cu	20:40:14	0
166172	99	46	39,5	cyclictest	183200	-21	df_abs	20:15:18	1
166172	99	46	39,4	cyclictest	0	-21	swapper/1	21:25:13	1
166172	99	46	37,6	cyclictest	186374	-21	timerandwakeup	20:25:37	1
166172	99	46	36,8	cyclictest	175571	-21	aten_r7power_vo	19:45:17	1
166171	99	46	40,4	cyclictest	345815	-21	df_abs	00:00:18	0
166171	99	46	40,4	cyclictest	345815	-21	df_abs	00:00:17	0
166171	99	46	39,5	cyclictest	363350	-21	gltestperf	00:20:21	0
166171	99	46	37,7	cyclictest	191868	-21	aten2__	20:50:15	0
166171	99	46	28,16	cyclictest	196744	-21	awk	21:10:00	0
166172	99	45	39,4	cyclictest	313301	-21	kworker/u4:8-rpciod	23:25:42	1
166172	99	45	38,5	cyclictest	313300	-21	kworker/u4:5-rpciod	23:30:30	1
166172	99	45	38,5	cyclictest	228935	-21	ntpq	21:45:35	1
166172	99	45	30,9	cyclictest	37	-21	kcompactd0	21:50:13	1
166171	99	45	39,4	cyclictest	0	-21	swapper/0	22:52:59	0
166171	99	45	38,5	cyclictest	315799	-21	/usr/sbin/munin	23:25:26	0
166171	99	45	37,5	cyclictest	181499	-21	unixbench_singl	20:05:37	0
166171	99	45	36,7	cyclictest	183045	-21	aten_r7power_cu	20:15:15	0
166171	99	45	36,7	cyclictest	174038	-21	latency_hist	19:40:01	0
166171	99	45	27,5	cyclictest	0	-21	swapper/0	22:55:22	0
166172	99	44	38,4	cyclictest	271337	-21	idleruntime-cro	22:35:00	1
166172	99	44	37,6	cyclictest	54	-21	kswapd0	00:25:15	1
166172	99	44	37,5	cyclictest	254333	-21	aten2__	22:15:21	1
166172	99	44	37,5	cyclictest	241477	-21	fschecks_time	22:00:18	1
166172	99	44	33,8	cyclictest	179161	-21	latency_hist	20:00:01	1
166172	99	44	33,8	cyclictest	172771	-21	latency_hist	19:35:02	1
166172	99	44	29,12	cyclictest	0	-21	swapper/1	20:40:36	1
166171	99	44	37,5	cyclictest	217083	-21	kworker/u4:10-rpciod	22:00:09	0
166171	99	44	37,5	cyclictest	193487	-21	grep	20:55:20	0
166171	99	44	37,4	cyclictest	0	-21	swapper/0	23:55:24	0
166171	99	44	24,16	cyclictest	0	-21	swapper/0	21:05:02	0
166172	99	43	35,6	cyclictest	263954	-21	/usr/sbin/munin	22:25:39	1
166172	99	43	33,8	cyclictest	195590	-21	latency_hist	21:05:03	1
166172	99	43	32,9	cyclictest	310529	-21	munin-run	23:20:01	1
166171	99	43	36,5	cyclictest	329122	-21	processes	23:40:35	0
166171	99	43	36,5	cyclictest	319541	-21	aten_r7power_cu	23:30:17	0
166171	99	43	32,7	cyclictest	4129175	-21	kworker/u4:0-rpciod	19:54:59	0
166172	99	42	34,6	cyclictest	182124	-21	gltestperf	20:10:19	1
166172	99	42	33,7	cyclictest	355455	-21	unixbench_singl	00:10:38	1
166172	99	42	32,8	cyclictest	187030	-21	fschecks_count	20:30:18	1
166171	99	42	34,5	cyclictest	181536	-21	kworker/u4:15-rpciod	20:10:30	0
166172	99	41	35,4	cyclictest	0	-21	swapper/1	21:15:32	1
166172	99	41	29,10	cyclictest	0	-21	swapper/1	22:40:26	1
166171	99	41	31,7	cyclictest	167211	-21	timerwakeupswit	19:10:35	0
166172	99	40	28,9	cyclictest	0	-21	swapper/1	20:05:23	1
166172	99	39	28,8	cyclictest	0	-21	swapper/1	19:15:36	1
166171	99	39	30,7	cyclictest	175793	-21	gltestperf	19:45:19	0
166171	99	38	31,5	cyclictest	186231	-21	processes	20:25:34	0
166171	99	35	27,4	cyclictest	0	-21	swapper/0	19:10:02	0
166172	99	30	23,4	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17