OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Jun 20, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
21183	99	86	42,40	cyclictest	0	-21	swapper/1	22:35:23	1
21182	99	83	71,7	cyclictest	70271	-21	apt-get	21:30:18	0
21183	99	80	43,35	cyclictest	23255	-21	ntpq	19:15:34	1
21183	99	80	43,35	cyclictest	23255	-21	ntpq	19:15:33	1
21183	99	73	65,6	cyclictest	226379	-21	kworker/u4:12+events_unbound	00:28:39	1
21183	99	72	4,30	cyclictest	106303	-21	ssh	22:10:34	1
21183	99	71	7,22	cyclictest	167843	-21	ntpq	23:20:26	1
21183	99	71	37,30	cyclictest	35559	-21	wget	20:05:15	1
21182	99	71	27,17	cyclictest	22601	-21	apt-get	19:15:11	0
21182	99	71	27,17	cyclictest	22601	-21	apt-get	19:15:10	0
21183	99	70	37,5	cyclictest	71407	-21	switchtime	21:30:48	1
21183	99	68	63,3	cyclictest	23677	-21	kworker/u4:14+events_unbound	19:55:43	1
21183	99	68	51,11	cyclictest	228914	-21	fschecks_count	00:30:19	1
21183	99	68	35,5	cyclictest	41718	-21	grep	20:30:02	1
21183	99	68	32,6	cyclictest	0	-21	swapper/1	21:25:09	1
21182	99	67	23,38	cyclictest	256	50	irq/23-42890000.ethernet	19:25:09	0
21182	99	65	25,16	cyclictest	56721	-21	apt-get	21:15:11	0
21182	99	65	23,15	cyclictest	26538	-21	apt-get	19:30:12	0
21182	99	64	22,11	cyclictest	32914	-21	apt-get	19:55:11	0
21183	99	63	52,8	cyclictest	155741	-21	systemd	23:06:24	1
21183	99	62	52,6	cyclictest	176354	-21	/usr/sbin/munin	23:30:19	1
21182	99	62	44,13	cyclictest	213730	-21	ssh	00:12:45	0
21182	99	62	26,10	cyclictest	118673	-21	apt-get	22:25:11	0
21183	99	61	53,6	cyclictest	33989	-21	kworker/u4:13+events_unbound	20:15:47	1
21182	99	61	55,3	cyclictest	0	-21	swapper/0	00:15:21	0
21182	99	61	55,3	cyclictest	0	-21	swapper/0	00:15:20	0
21183	99	60	52,6	cyclictest	112077	-21	kworker/u4:6+events_unbound	23:01:24	1
21183	99	60	52,6	cyclictest	112077	-21	kworker/u4:6+events_unbound	23:01:23	1
21183	99	59	52,5	cyclictest	85857	-21	kworker/u4:11+events_unbound	22:05:03	1
21182	99	59	11,10	cyclictest	69314	-21	ssh	21:29:03	0
21183	99	58	51,5	cyclictest	45509	-21	kworker/u4:11+events_unbound	21:25:00	1
21183	99	58	48,7	cyclictest	121057	-21	kworker/u4:7+events_unbound	22:41:22	1
21183	99	58	2,50	cyclictest	141404	-21	ssh	22:50:25	1
21182	99	58	50,5	cyclictest	31448	-21	kworker/u4:2+events_unbound	19:50:01	0
21182	99	58	12,10	cyclictest	75375	-21	ntpq	21:35:32	0
21183	99	57	50,5	cyclictest	21180	-21	cyclictest	00:38:49	1
21183	99	57	48,6	cyclictest	213085	-21	kworker/u4:9+events_unbound	00:18:33	1
21183	99	57	48,6	cyclictest	213085	-21	kworker/u4:9+events_unbound	00:18:32	1
21183	99	57	48,6	cyclictest	16267	-21	kworker/u4:5+events_unbound	21:00:57	1
21182	99	57	47,8	cyclictest	378	-21	dbus-daemon	23:41:29	0
21182	99	57	18,15	cyclictest	50090	-21	ntpq	21:00:25	0
21182	99	57	17,15	cyclictest	111433	-21	ssh	22:16:03	0
21183	99	56	46,7	cyclictest	87579	-21	basename	21:50:01	1
21183	99	56	4,32	cyclictest	57483	-21	ssh	21:15:29	1
21182	99	56	49,5	cyclictest	0	-21	swapper/0	00:35:15	0
21182	99	56	19,14	cyclictest	127130	-21	ssh	22:34:55	0
21182	99	56	19,11	cyclictest	150462	-21	ssh	23:00:41	0
21182	99	56	19,11	cyclictest	150462	-21	ssh	23:00:40	0
21182	99	56	18,11	cyclictest	200483	-21	ssh	23:57:36	0
21182	99	56	15,14	cyclictest	108860	-21	ssh	22:13:57	0
21183	99	55	47,5	cyclictest	0	-21	swapper/1	23:45:30	1
21182	99	55	48,5	cyclictest	138066	-21	sshd	22:46:21	0
21182	99	55	42,11	cyclictest	184521	-21	latency_hist	23:40:01	0
21182	99	55	37,14	cyclictest	0	-21	swapper/0	22:05:07	0
21182	99	55	34,18	cyclictest	167490	-21	cut	23:20:21	0
21182	99	55	10,21	cyclictest	228309	-21	cat	00:30:00	0
21183	99	54	47,5	cyclictest	16265	-21	kworker/u4:3+events_unbound	19:40:39	1
21183	99	54	47,5	cyclictest	145241	-21	aten_r7power_po	22:55:17	1
21183	99	54	46,6	cyclictest	209261	-21	kworker/u4:3+events_unbound	00:08:28	1
21183	99	54	43,7	cyclictest	118858	-21	/usr/sbin/munin	22:25:17	1
21182	99	54	42,9	cyclictest	132490	-21	kernelversion	22:40:22	0
21182	99	54	29,4	cyclictest	203172	-21	ntpq	00:00:32	0
21182	99	54	18,12	cyclictest	188853	-21	apt-get	23:45:07	0
21182	99	54	16,33	cyclictest	154280	-21	fschecks_count	23:05:18	0
21182	99	54	15,8	cyclictest	97159	-21	grep	22:00:19	0
21182	99	54	15,15	cyclictest	80482	-21	ssh	21:40:52	0
21183	99	53	47,4	cyclictest	211624	-21	if_eth0	00:10:22	1
21182	99	53	37,14	cyclictest	114507	-21	df_abs	22:20:17	0
21182	99	53	37,14	cyclictest	114507	-21	df_abs	22:20:16	0
21182	99	53	16,16	cyclictest	141581	-21	ld	22:50:35	0
21182	99	53	14,15	cyclictest	146805	-21	ssh	22:56:16	0
21182	99	53	11,19	cyclictest	176794	-21	ntpq	23:30:34	0
21182	99	53	10,23	cyclictest	61552	-21	fschecks_count	21:20:18	0
21183	99	52	42,6	cyclictest	93441	-21	cat	21:55:45	1
21183	99	52	41,8	cyclictest	46801	-21	sh	20:50:00	1
21182	99	52	35,13	cyclictest	36752	-21	apt-get	20:10:11	0
21182	99	52	31,17	cyclictest	42522	-21	ntpq	20:30:33	0
21182	99	52	16,10	cyclictest	94640	-21	ssh	21:57:18	0
21182	99	52	15,14	cyclictest	53048	-21	ntp_states	21:10:32	0
21182	99	52	15,14	cyclictest	39891	-21	ntpq	20:20:27	0
21182	99	52	15,11	cyclictest	164702	-21	ssh	23:16:38	0
21182	99	52	14,11	cyclictest	28443	-21	ntp_states	19:35:31	0
21183	99	51	43,6	cyclictest	169730	-21	kworker/u4:8+events_unbound	23:26:28	1
21183	99	51	42,6	cyclictest	7420	-21	kworker/u4:2+events_unbound	19:25:02	1
21182	99	51	40,9	cyclictest	53	-21	kswapd0	23:25:11	0
21182	99	51	34,10	cyclictest	221986	-21	kworker/u4:8-rpciod	00:24:24	0
21182	99	51	24,10	cyclictest	48842	-21	ntpq	20:55:29	0
21182	99	51	15,10	cyclictest	195782	-21	ssh	23:52:06	0
21182	99	51	14,16	cyclictest	38610	-21	ntpq	20:15:29	0
21182	99	51	14,12	cyclictest	84760	-21	users	21:45:39	0
21182	99	51	12,28	cyclictest	131116	-21	diskmemload	22:39:19	0
21182	99	51	12,16	cyclictest	35378	-21	sed	20:05:01	0
21182	99	51	10,22	cyclictest	44228	-21	cron	20:40:01	0
21183	99	50	43,5	cyclictest	40407	-21	kworker/u4:10+events_unbound	20:30:51	1
21183	99	50	41,6	cyclictest	0	-21	swapper/1	21:35:28	1
21182	99	50	42,6	cyclictest	21112	-21	kworker/u4:9+events_unbound	19:10:34	0
21182	99	50	17,5	cyclictest	32180	-21	ntpq	19:50:22	0
21182	99	50	12,15	cyclictest	230596	-21	ssh	00:31:47	0
21183	99	49	42,5	cyclictest	26343	-21	kworker/u4:9+events_unbound	19:45:40	1
21183	99	49	41,5	cyclictest	26832	-21	fschecks_time	19:30:20	1
21182	99	49	30,16	cyclictest	0	-21	swapper/0	21:50:38	0
21182	99	49	12,14	cyclictest	45070	-21	ntp_states	20:40:32	0
21183	99	48	37,7	cyclictest	94830	-21	kworker/u4:9-rpciod	22:00:33	1
21182	99	48	26,18	cyclictest	29743	-21	ntpq	19:40:35	0
21182	99	48	16,6	cyclictest	207392	-21	ntpq	00:05:27	0
21182	99	48	10,19	cyclictest	159047	-21	ntpq	23:10:25	0
21183	99	47	8,25	cyclictest	193546	-21	sh	23:50:13	1
21183	99	47	4,34	cyclictest	51923	-21	diskmemload	22:30:27	1
21183	99	47	40,5	cyclictest	164007	-21	unixbench_singl	23:15:37	1
21183	99	47	38,7	cyclictest	159306	-21	sendmail_mailqu	23:10:36	1
21182	99	47	37,7	cyclictest	35566	-21	aten_r7power_po	20:05:16	0
21182	99	47	29,14	cyclictest	40599	-21	apt-get	20:25:12	0
21183	99	46	39,5	cyclictest	47296	-21	fschecks_time	20:50:19	1
21183	99	46	38,6	cyclictest	79164	-21	aten_r7power_po	21:40:15	1
21183	99	46	38,5	cyclictest	25904	-21	systemd	19:25:36	1
21183	99	46	36,8	cyclictest	185189	-21	gltestperf	23:40:21	1
21183	99	46	34,5	cyclictest	88483	-21	netstat	21:50:22	1
21182	99	46	39,5	cyclictest	51546	-21	sendmail_mailqu	21:05:37	0
21182	99	45	23,14	cyclictest	23912	-21	apt-get	19:20:12	0
21182	99	45	13,9	cyclictest	46331	-21	ntpq	20:45:30	0
21183	99	44	37,5	cyclictest	51954	-21	grep	21:10:00	1
21183	99	44	37,5	cyclictest	31448	-21	kworker/u4:2+events_unbound	20:00:43	1
21183	99	44	37,5	cyclictest	198365	-21	gltestperf	23:55:21	1
21183	99	44	35,7	cyclictest	0	-21	swapper/1	00:00:11	1
21183	99	44	35,6	cyclictest	121057	-21	kworker/u4:7-rpciod	22:45:21	1
21182	99	44	34,7	cyclictest	47286	-21	fschecks_time	20:50:20	0
21182	99	44	27,12	cyclictest	0	-21	swapper/0	19:10:01	0
21183	99	43	5,26	cyclictest	220707	-21	ntpq	00:20:34	1
21183	99	43	34,6	cyclictest	0	-21	swapper/1	22:20:24	1
21183	99	43	34,6	cyclictest	0	-21	swapper/1	22:20:24	1
21183	99	43	32,8	cyclictest	22417	-21	cron	19:15:00	1
21183	99	43	27,11	cyclictest	40459	-21	wc	20:25:00	1
21183	99	42	9,18	cyclictest	180981	-21	ssh	23:35:24	1
21183	99	42	36,4	cyclictest	16267	-21	kworker/u4:5-rpciod	19:50:17	1
21183	99	42	35,5	cyclictest	56437	-21	sh	21:15:00	1
21183	99	42	33,7	cyclictest	0	-21	swapper/1	22:15:27	1
21183	99	40	34,4	cyclictest	0	-21	swapper/1	20:35:38	1
21183	99	40	30,7	cyclictest	0	-21	swapper/1	20:10:21	1
21183	99	39	29,6	cyclictest	42944	-21	kworker/u4:8-rpciod	20:40:38	1
21183	99	38	32,4	cyclictest	0	-21	swapper/1	20:55:55	1
21183	99	38	29,7	cyclictest	21214	-21	latency_hist	19:10:01	1
21183	99	37	30,5	cyclictest	0	-21	swapper/1	19:35:15	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17