OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sat Jan 10, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
469395	99	105	97,6	cyclictest	466918	-21	kworker/u4:5+events_unbound	21:36:43	0
469395	99	102	96,5	cyclictest	470608	-21	kworker/u4:12+events_unbound	20:31:32	0
469395	99	88	81,5	cyclictest	482044	-21	kworker/u4:7+events_unbound	20:01:25	0
469395	99	83	76,5	cyclictest	469332	-21	kworker/u4:8+events_unbound	19:16:21	0
469397	99	78	65,8	cyclictest	560964	-21	wget	22:20:15	1
469397	99	77	52,21	cyclictest	0	-21	swapper/1	21:25:13	1
469397	99	76	3,29	cyclictest	673590	-21	ssh	00:30:28	1
469397	99	76	3,21	cyclictest	557371	-21	ssh	22:15:31	1
469397	99	75	43,30	cyclictest	605157	-21	switchtime	23:10:36	1
469397	99	71	3,56	cyclictest	570401	-21	ssh	22:30:31	1
469397	99	71	18,48	cyclictest	499310	-21	sshd	21:05:23	1
469397	99	70	34,33	cyclictest	491882	-21	switchtime	20:35:37	1
469397	99	70	11,54	cyclictest	647292	-21	/usr/sbin/munin	00:00:23	1
469397	99	69	32,33	cyclictest	0	-21	swapper/1	19:30:34	1
469397	99	69	31,33	cyclictest	664447	-21	aten_r7power_cu	00:20:16	1
469397	99	68	35,30	cyclictest	0	-21	swapper/1	21:55:26	1
469397	99	68	28,36	cyclictest	0	-21	swapper/1	22:55:38	1
469397	99	68	2,25	cyclictest	583115	-21	irqstats	22:45:22	1
469397	99	67	56,7	cyclictest	593184	-21	kworker/u4:3+events_unbound	23:05:00	1
469397	99	67	5,18	cyclictest	587701	-21	ssh	22:50:33	1
469397	99	67	32,32	cyclictest	642744	-21	apt-get	23:55:14	1
469397	99	67	32,32	cyclictest	642744	-21	apt-get	23:55:14	1
469397	99	66	60,3	cyclictest	558621	-21	kworker/u4:2+events_unbound	22:25:03	1
469397	99	66	43,21	cyclictest	346	-21	systemd-udevd	00:15:42	1
469397	99	66	43,21	cyclictest	346	-21	systemd-udevd	00:15:42	1
469397	99	66	29,34	cyclictest	678396	-21	unixbench_singl	00:35:38	1
469397	99	66	19,6	cyclictest	601147	-21	unixbench_multi	23:05:43	1
469397	99	65	35,28	cyclictest	656962	-21	xargs	00:10:42	1
469397	99	65	34,28	cyclictest	499821	-21	kworker/u4:13-rpciod	22:05:02	1
469397	99	65	34,28	cyclictest	0	-21	swapper/1	00:05:24	1
469397	99	65	32,31	cyclictest	618320	-21	unixbench-2d	23:25:38	1
469397	99	65	31,31	cyclictest	0	-21	swapper/1	23:30:19	1
469395	99	65	58,5	cyclictest	601998	-21	kworker/u4:10+events_unbound	23:07:06	0
469397	99	64	28,33	cyclictest	0	-21	swapper/1	19:55:02	1
469397	99	64	27,35	cyclictest	522547	-21	if_err_eth0	21:35:24	1
469397	99	63	31,28	cyclictest	507081	-21	kworker/u4:0-rpciod	21:20:23	1
469397	99	63	30,30	cyclictest	0	-21	swapper/1	23:45:17	1
469397	99	63	24,36	cyclictest	0	-21	swapper/1	19:15:13	1
469397	99	63	14,11	cyclictest	552880	-21	sshd	22:10:23	1
469397	99	63	1,27	cyclictest	609140	-21	sh	23:15:27	1
469397	99	62	7,7	cyclictest	0	-21	swapper/1	00:25:24	1
469397	99	62	54,5	cyclictest	488388	-21	kworker/u4:6+events_unbound	20:26:32	1
469397	99	62	25,34	cyclictest	0	-21	swapper/1	21:50:35	1
469397	99	62	22,38	cyclictest	578573	-21	fschecks_count	22:40:21	1
469397	99	62	1,27	cyclictest	612791	-21	/usr/sbin/munin	23:20:34	1
469395	99	62	49,10	cyclictest	54	-21	kswapd0	22:05:06	0
469397	99	61	32,27	cyclictest	521724	-21	munin-run	21:35:00	1
469397	99	61	27,31	cyclictest	493373	-21	unixbench_singl	20:40:35	1
469397	99	61	27,31	cyclictest	493373	-21	unixbench_singl	20:40:35	1
469397	99	61	27,31	cyclictest	0	-21	swapper/1	19:40:13	1
469397	99	61	25,32	cyclictest	0	-21	swapper/1	21:10:18	1
469397	99	61	24,32	cyclictest	0	-21	swapper/1	21:00:02	1
469397	99	61	18,10	cyclictest	476677	-21	sed	19:35:34	1
469395	99	61	53,5	cyclictest	54	-21	kswapd0	21:30:20	0
469397	99	60	7,10	cyclictest	0	-21	swapper/1	20:45:31	1
469397	99	60	28,29	cyclictest	0	-21	swapper/1	22:05:23	1
469397	99	60	26,32	cyclictest	0	-21	swapper/1	21:15:34	1
469397	99	60	24,32	cyclictest	0	-21	swapper/1	21:40:10	1
469397	99	59	31,26	cyclictest	484970	-21	df_abs	20:10:16	1
469397	99	59	24,32	cyclictest	0	-21	swapper/1	21:45:20	1
469397	99	59	23,33	cyclictest	0	-21	swapper/1	20:00:30	1
469395	99	59	44,9	cyclictest	580655	-21	kworker/u4:3-rpciod	22:46:07	0
469397	99	58	29,27	cyclictest	631233	-21	timerandwakeup	23:40:37	1
469397	99	58	27,28	cyclictest	0	-21	swapper/1	22:35:18	1
469397	99	58	26,29	cyclictest	0	-21	swapper/1	19:55:16	1
469397	99	58	22,33	cyclictest	0	-21	swapper/1	20:30:39	1
469397	99	58	21,4	cyclictest	0	-21	swapper/1	23:50:18	1
469397	99	58	21,34	cyclictest	0	-21	swapper/1	23:35:14	1
469395	99	58	49,7	cyclictest	662563	-21	kworker/u4:11+events_unbound	00:18:34	0
469395	99	58	49,7	cyclictest	662563	-21	kworker/u4:11+events_unbound	00:18:34	0
469395	99	58	38,18	cyclictest	530999	-21	fschecks_time	21:45:18	0
469397	99	57	23,31	cyclictest	0	-21	swapper/1	20:15:22	1
469397	99	57	20,33	cyclictest	0	-21	swapper/1	20:50:27	1
469395	99	57	50,5	cyclictest	475663	-21	kworker/u4:0+events_unbound	20:45:45	0
469397	99	56	22,31	cyclictest	0	-21	swapper/1	21:00:22	1
469397	99	56	16,8	cyclictest	470522	-21	grep	19:10:35	1
469395	99	56	47,6	cyclictest	623963	-21	kworker/u4:4-rpciod	00:00:17	0
469395	99	56	43,7	cyclictest	0	-21	swapper/0	21:15:33	0
469397	99	55	28,24	cyclictest	0	-21	swapper/1	19:45:19	1
469397	99	55	12,8	cyclictest	468137	-21	kworker/u4:2-rpciod	19:20:27	1
469395	99	55	49,4	cyclictest	526367	-21	aten2__	21:40:15	0
469395	99	55	47,5	cyclictest	497692	-21	df_abs	21:00:16	0
469397	99	54	14,6	cyclictest	0	-21	swapper/1	20:20:34	1
469395	99	54	48,5	cyclictest	483330	-21	kworker/u4:11+events_unbound	20:35:04	0
469395	99	54	46,5	cyclictest	664714	-21	fschecks_count	00:20:19	0
469395	99	53	45,6	cyclictest	466918	-21	kworker/u4:5+events_unbound	20:43:44	0
469395	99	53	45,6	cyclictest	466918	-21	kworker/u4:5+events_unbound	20:43:43	0
469395	99	53	45,6	cyclictest	466918	-21	kworker/u4:5+events_unbound	19:39:02	0
469395	99	53	41,9	cyclictest	0	-21	swapper/0	00:25:33	0
469395	99	53	36,15	cyclictest	535178	-21	df_abs	21:50:16	0
469395	99	53	34,16	cyclictest	0	-21	swapper/0	22:25:35	0
469397	99	52	14,9	cyclictest	0	-21	swapper/1	20:05:22	1
469395	99	52	40,8	cyclictest	586858	-21	apt-get	22:50:12	0
469395	99	52	34,16	cyclictest	595329	-21	latency_hist	23:00:01	0
469395	99	52	31,18	cyclictest	469737	-21	df_abs	19:10:16	0
469395	99	52	28,21	cyclictest	639084	-21	fschecks_time	23:50:18	0
469395	99	51	44,5	cyclictest	548194	-21	/usr/sbin/munin	22:05:22	0
469395	99	51	43,5	cyclictest	655553	-21	idleruntime-cro	00:10:00	0
469395	99	51	41,8	cyclictest	388	-21	dbus-daemon	21:21:40	0
469395	99	50	43,5	cyclictest	643417	-21	fschecks_count	23:55:24	0
469395	99	50	43,5	cyclictest	643417	-21	fschecks_count	23:55:23	0
469395	99	50	36,11	cyclictest	656197	-21	fschecks_count	00:10:23	0
469395	99	49	42,5	cyclictest	470608	-21	kworker/u4:12+events_unbound	19:55:02	0
469395	99	49	42,5	cyclictest	468137	-21	kworker/u4:2+events_unbound	20:19:00	0
469395	99	49	39,6	cyclictest	0	-21	swapper/0	23:30:01	0
469395	99	48	42,4	cyclictest	455657	-21	kworker/u4:9+events_unbound	19:25:02	0
469395	99	48	39,7	cyclictest	631088	-21	sendmail_mailqu	23:40:35	0
469395	99	48	39,6	cyclictest	574965	-21	switchtime	22:35:36	0
469395	99	48	38,7	cyclictest	487359	-21	aten_r7power_cu	20:20:14	0
469395	99	48	38,7	cyclictest	478822	-21	fschecks_time	19:45:24	0
469395	99	48	37,5	cyclictest	470608	-21	kworker/u4:12+events_unbound	20:28:42	0
469395	99	47	40,5	cyclictest	475663	-21	kworker/u4:0+events_unbound	19:50:03	0
469395	99	47	39,5	cyclictest	613476	-21	sshd	23:20:24	0
469395	99	46	40,4	cyclictest	604803	-21	ntp_kernel_err	23:10:24	0
469395	99	46	39,5	cyclictest	565082	-21	cat	22:25:01	0
469395	99	46	39,5	cyclictest	476919	-21	kworker/u4:6+events_unbound	20:09:00	0
469395	99	46	39,5	cyclictest	466921	-21	kworker/u4:10+events_unbound	19:32:00	0
469395	99	46	37,6	cyclictest	499845	-21	sh	21:10:01	0
469395	99	46	3,6	cyclictest	14	-21	ksoftirqd/0	22:15:31	0
469395	99	46	36,7	cyclictest	477262	-21	aten_r7power_vo	19:40:14	0
469395	99	46	35,9	cyclictest	500667	-21	if_eth0	21:10:21	0
469397	99	45	38,5	cyclictest	473584	-21	fschecks_count	19:25:20	1
469395	99	45	37,6	cyclictest	595548	-21	/usr/sbin/munin	23:00:12	0
469395	99	45	37,5	cyclictest	622182	-21	ldconfig	23:30:26	0
469395	99	45	37,5	cyclictest	556321	-21	latency_hist	22:15:01	0
469395	99	45	35,6	cyclictest	0	-21	swapper/0	20:15:00	0
469395	99	45	34,7	cyclictest	513836	-21	/usr/sbin/munin	21:25:20	0
469395	99	44	23,19	cyclictest	0	-21	swapper/0	23:35:24	0
469395	99	44	14,21	cyclictest	0	-21	swapper/0	21:55:26	0
469395	99	43	37,4	cyclictest	677500	-21	grep	00:35:20	0
469395	99	43	36,5	cyclictest	609298	-21	ntp_states	23:15:33	0
469395	99	43	35,6	cyclictest	472112	-21	aten2__	19:20:13	0
469395	99	43	33,7	cyclictest	0	-21	swapper/0	00:30:28	0
469395	99	43	24,16	cyclictest	0	-21	swapper/0	22:40:27	0
469395	99	42	36,4	cyclictest	570505	-21	proc_pri	22:30:37	0
469395	99	42	11,5	cyclictest	15	1	ktimers/0	23:45:23	0
469395	99	41	35,5	cyclictest	468137	-21	kworker/u4:2+events_unbound	20:51:03	0
469395	99	39	32,5	cyclictest	488389	-21	kworker/u4:8+events_unbound	20:59:58	0
469395	99	39	19,16	cyclictest	469393	-21	cyclictest	19:09:59	0
469397	99	30	25,3	cyclictest	469461	-21	latency_hist	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17