OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Thu Jul 02, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4152028	99	139	123,14	cyclictest	80781	-21	kworker/u4:0+events_unbound	22:55:58	0
4152028	99	109	100,7	cyclictest	4190122	-21	kworker/u4:2+events_unbound	21:55:46	0
4152028	99	107	94,6	cyclictest	4158460	-21	kworker/u4:8+events_unbound	20:50:35	0
4152028	99	100	93,5	cyclictest	85293	-21	kworker/u4:4+events_unbound	23:11:01	0
4152028	99	97	88,6	cyclictest	4158460	-21	kworker/u4:8+events_unbound	19:35:21	0
4152028	99	94	86,6	cyclictest	84649	-21	kworker/u4:3+events_unbound	23:21:04	0
4152028	99	90	81,6	cyclictest	85293	-21	kworker/u4:4+events_unbound	23:01:00	0
4152028	99	89	80,6	cyclictest	4190121	-21	kworker/u4:0+events_unbound	21:25:44	0
4152028	99	89	80,6	cyclictest	4190121	-21	kworker/u4:0+events_unbound	21:25:44	0
4152029	99	87	78,6	cyclictest	40736	-21	kworker/u4:1+events_unbound	22:15:52	1
4152029	99	85	75,7	cyclictest	4159730	-21	kworker/u4:13+events_unbound	19:55:25	1
4152029	99	83	46,34	cyclictest	4168172	-21	sshd	20:10:25	1
4152028	99	82	74,6	cyclictest	120777	-21	kworker/u4:10+events_unbound	23:41:09	0
4152029	99	78	41,34	cyclictest	140280	-21	latency_hist	00:00:01	1
4152028	99	78	71,5	cyclictest	80782	-21	kworker/u4:1+events_unbound	22:55:00	0
4152028	99	78	71,5	cyclictest	80782	-21	kworker/u4:1+events_unbound	22:55:00	0
4152028	99	77	65,9	cyclictest	4192215	-21	apt-get	21:20:18	0
4152029	99	75	66,6	cyclictest	4163563	-21	kworker/u4:5+events_unbound	20:50:01	1
4152028	99	74	67,5	cyclictest	13564	-21	kworker/u4:16+events_unbound	21:50:01	0
4152029	99	73	57,12	cyclictest	4147109	-21	kworker/u4:3+events_unbound	20:20:30	1
4152028	99	73	65,6	cyclictest	156366	-21	kworker/u4:0+events_unbound	00:38:43	0
4152029	99	72	66,4	cyclictest	4175054	-21	kworker/u4:7+events_unbound	21:00:02	1
4152029	99	72	38,4	cyclictest	24849	-21	aten2__	21:50:16	1
4152029	99	72	29,10	cyclictest	0	-21	swapper/1	20:50:19	1
4152029	99	72	1,55	cyclictest	4188434	-21	ssh	21:15:30	1
4152028	99	72	60,10	cyclictest	11578	-21	aten_r7power_cu	21:35:17	0
4152029	99	71	37,5	cyclictest	11638	-21	/usr/sbin/munin	21:35:17	1
4152028	99	71	64,5	cyclictest	107181	-21	kworker/u4:9+events_unbound	23:26:04	0
4152028	99	71	62,5	cyclictest	4147110	-21	kworker/u4:4+events_unbound	20:30:01	0
4152028	99	70	62,6	cyclictest	71759	-21	kworker/u4:11+events_unbound	23:06:01	0
4152028	99	70	62,6	cyclictest	151822	-21	kworker/u4:2+events_unbound	00:13:38	0
4152028	99	70	53,15	cyclictest	107179	-21	kworker/u4:7+events_unbound	00:00:02	0
4152029	99	69	39,5	cyclictest	65621	-21	ntpq	22:35:27	1
4152029	99	69	25,11	cyclictest	0	-21	swapper/1	23:00:56	1
4152028	99	69	62,5	cyclictest	4150755	-21	kworker/u4:1+events_unbound	19:30:02	0
4152028	99	69	62,5	cyclictest	4147110	-21	kworker/u4:4+events_unbound	19:25:02	0
4152028	99	69	49,15	cyclictest	0	-21	swapper/0	22:30:12	0
4152028	99	69	48,11	cyclictest	53	-21	kswapd0	00:30:11	0
4152029	99	68	38,4	cyclictest	27111	-21	kworker/u4:1-rpciod	21:55:10	1
4152028	99	68	60,6	cyclictest	36212	-21	kworker/u4:15+events_unbound	22:10:51	0
4152028	99	68	52,13	cyclictest	53	-21	kswapd0	22:25:09	0
4152028	99	68	52,13	cyclictest	53	-21	kswapd0	22:25:09	0
4152029	99	65	56,6	cyclictest	4158460	-21	kworker/u4:8+events_unbound	19:40:22	1
4152029	99	64	57,5	cyclictest	80781	-21	kworker/u4:0+events_unbound	22:55:02	1
4152029	99	64	56,6	cyclictest	4181539	-21	kworker/u4:4+events_unbound	21:40:45	1
4152029	99	64	55,7	cyclictest	111724	-21	kworker/u4:2+events_unbound	23:36:08	1
4152028	99	64	51,9	cyclictest	145621	-21	kernelversion	00:05:28	0
4152029	99	63	53,7	cyclictest	4173780	-21	kworker/u4:3+events_unbound	21:10:00	1
4152029	99	63	51,9	cyclictest	4158461	-21	kworker/u4:12+events_unbound	20:25:30	1
4152028	99	63	55,6	cyclictest	4166127	-21	kworker/u4:11+events_unbound	20:24:59	0
4152029	99	62	55,5	cyclictest	160903	-21	kworker/u4:3+events_unbound	00:23:40	1
4152028	99	61	52,5	cyclictest	124681	-21	kworker/u4:12+events_unbound	23:55:03	0
4152028	99	61	44,10	cyclictest	53	-21	kswapd0	00:25:12	0
4152028	99	60	51,7	cyclictest	124680	-21	kworker/u4:11+events_unbound	23:47:00	0
4152028	99	60	51,6	cyclictest	53	-21	kswapd0	00:25:00	0
4152029	99	59	52,5	cyclictest	107180	-21	kworker/u4:8+events_unbound	23:30:02	1
4152029	99	59	51,6	cyclictest	156367	-21	kworker/u4:4+events_unbound	00:18:39	1
4152029	99	58	50,6	cyclictest	36211	-21	kworker/u4:13+events_unbound	22:20:53	1
4152028	99	58	51,5	cyclictest	27112	-21	kworker/u4:6+events_unbound	22:00:47	0
4152028	99	58	44,5	cyclictest	53666	-21	kworker/u4:3+events_unbound	22:40:56	0
4152029	99	57	49,6	cyclictest	142790	-21	kworker/u4:1+events_unbound	00:26:32	1
4152028	99	57	51,4	cyclictest	4168667	-21	kworker/u4:16+events_unbound	20:40:00	0
4152028	99	57	50,5	cyclictest	107181	-21	kworker/u4:9+events_unbound	23:32:59	0
4152029	99	56	49,5	cyclictest	4190122	-21	kworker/u4:2+events_unbound	21:30:43	1
4152029	99	56	46,7	cyclictest	84649	-21	kworker/u4:3+events_unbound	23:16:02	1
4152029	99	56	46,7	cyclictest	4167397	-21	kworker/u4:15+events_unbound	20:15:27	1
4152028	99	56	46,7	cyclictest	47500	-21	/usr/sbin/munin	22:15:21	0
4152029	99	55	47,6	cyclictest	9052	-21	kworker/u4:7+events_unbound	22:50:36	1
4152029	99	55	47,6	cyclictest	9052	-21	kworker/u4:7+events_unbound	22:50:35	1
4152029	99	55	47,6	cyclictest	120777	-21	kworker/u4:10+events_unbound	00:10:04	1
4152029	99	55	45,8	cyclictest	378	-21	dbus-daemon	00:38:42	1
4152029	99	55	35,7	cyclictest	4150755	-21	kworker/u4:1-rpciod	19:50:39	1
4152028	99	54	46,6	cyclictest	4168668	-21	kworker/u4:17+events_unbound	21:17:01	0
4152028	99	54	45,6	cyclictest	119147	-21	/usr/sbin/munin	23:35:37	0
4152028	99	54	41,10	cyclictest	4178889	-21	kworker/u4:1+events_unbound	21:15:00	0
4152028	99	54	15,16	cyclictest	256	50	irq/23-42890000.ethernet	19:25:13	0
4152028	99	54	15,16	cyclictest	256	50	irq/23-42890000.ethernet	19:25:13	0
4152029	99	53	45,6	cyclictest	4151963	-21	kworker/u4:10+events_unbound	19:20:17	1
4152028	99	53	46,5	cyclictest	4158460	-21	kworker/u4:8+events_unbound	20:45:01	0
4152028	99	53	46,5	cyclictest	4151963	-21	kworker/u4:10+events_unbound	19:10:02	0
4152028	99	53	34,6	cyclictest	67230	-21	kworker/u4:0+events_unbound	22:37:46	0
4152028	99	52	44,6	cyclictest	4178889	-21	kworker/u4:1+events_unbound	21:05:39	0
4152028	99	52	38,11	cyclictest	51973	-21	fschecks_time	22:20:19	0
4152029	99	51	43,6	cyclictest	36215	-21	kworker/u4:18+events_unbound	22:25:54	1
4152029	99	51	43,6	cyclictest	36215	-21	kworker/u4:18+events_unbound	22:25:53	1
4152029	99	51	43,5	cyclictest	4147109	-21	kworker/u4:3+events_unbound	20:05:01	1
4152029	99	50	42,6	cyclictest	58183	-21	kworker/u4:10+events_unbound	22:35:00	1
4152028	99	50	41,6	cyclictest	73890	-21	aten_r7power_en	22:45:15	0
4152029	99	49	43,4	cyclictest	4178889	-21	kworker/u4:1+events_unbound	21:05:01	1
4152028	99	49	42,5	cyclictest	28954	-21	idleruntime-cro	21:55:00	0
4152028	99	49	12,26	cyclictest	0	-21	swapper/0	20:55:36	0
4152029	99	48	42,4	cyclictest	132161	-21	kernelversion	23:50:21	1
4152029	99	48	41,5	cyclictest	128263	-21	awk	23:45:40	1
4152029	99	48	38,7	cyclictest	4151962	-21	kworker/u4:9+events_unbound	19:10:14	1
4152029	99	48	36,10	cyclictest	4176370	-21	cron	20:44:59	1
4152028	99	48	42,5	cyclictest	4190122	-21	kworker/u4:2+events_unbound	21:30:03	0
4152028	99	48	36,8	cyclictest	135694	-21	ssh	23:54:56	0
4152029	99	47	4,32	cyclictest	145937	-21	ssh	00:05:42	1
4152029	99	47	40,5	cyclictest	4193117	-21	ssh	21:20:41	1
4152029	99	47	40,5	cyclictest	0	-21	swapper/1	19:35:19	1
4152029	99	47	37,8	cyclictest	4161627	-21	head	19:45:22	1
4152028	99	47	28,16	cyclictest	0	-21	swapper/0	19:55:23	0
4152028	99	47	27,17	cyclictest	0	-21	swapper/0	22:05:19	0
4152029	99	46	38,5	cyclictest	38873	-21	ld	22:05:24	1
4152028	99	46	38,6	cyclictest	4161590	-21	gltestperf	19:45:21	0
4152029	99	45	36,7	cyclictest	4167172	-21	threads	20:05:36	1
4152029	99	45	36,6	cyclictest	0	-21	swapper/1	23:10:30	1
4152029	99	45	36,5	cyclictest	0	-21	swapper/1	20:35:30	1
4152029	99	45	35,7	cyclictest	0	-21	swapper/1	21:30:01	1
4152029	99	45	35,7	cyclictest	0	-21	swapper/1	21:30:00	1
4152029	99	45	35,6	cyclictest	0	-21	swapper/1	23:21:03	1
4152028	99	45	39,4	cyclictest	4169034	-21	cpu	20:15:17	0
4152028	99	45	38,5	cyclictest	4158461	-21	kworker/u4:12+events_unbound	20:03:02	0
4152028	99	45	38,5	cyclictest	4143462	-21	kworker/u4:14+events_unbound	19:50:02	0
4152028	99	45	37,6	cyclictest	17178	-21	/usr/sbin/munin	21:40:39	0
4152028	99	45	37,6	cyclictest	154990	-21	timerandwakeup	00:15:39	0
4152028	99	45	35,7	cyclictest	4167397	-21	kworker/u4:15-rpciod	20:45:21	0
4152029	99	44	38,4	cyclictest	73949	-21	aten_r7power_vo	22:45:16	1
4152029	99	44	36,6	cyclictest	34129	-21	diskmemload	22:00:18	1
4152029	99	44	36,6	cyclictest	0	-21	swapper/1	22:40:55	1
4152029	99	44	29,13	cyclictest	167628	-21	df_abs	00:30:29	1
4152029	99	43	37,4	cyclictest	140832	-21	fschecks_count	00:00:19	1
4152029	99	43	36,5	cyclictest	126914	-21	sed	23:45:01	1
4152029	99	43	35,4	cyclictest	4184017	-21	/usr/sbin/munin	21:10:32	1
4152028	99	43	35,6	cyclictest	4181539	-21	kworker/u4:4+events_unbound	21:02:59	0
4152028	99	43	33,7	cyclictest	4173725	-21	unixbench_singl	20:30:38	0
4152028	99	43	29,7	cyclictest	0	-21	swapper/0	23:15:14	0
4152029	99	42	36,4	cyclictest	0	-21	swapper/1	23:30:25	1
4152029	99	42	32,6	cyclictest	0	-21	swapper/1	21:45:26	1
4152028	99	42	32,7	cyclictest	4160828	-21	timerandwakeup	19:40:37	0
4152029	99	41	33,5	cyclictest	94416	-21	sshd	23:08:10	1
4152029	99	41	33,5	cyclictest	0	-21	swapper/1	22:10:27	1
4152029	99	41	32,6	cyclictest	0	-21	swapper/1	19:15:14	1
4152028	99	41	33,5	cyclictest	4147109	-21	kworker/u4:3-xprtiod	19:20:01	0
4152029	99	40	32,6	cyclictest	4173883	-21	latency_hist	20:35:02	1
4152029	99	40	30,7	cyclictest	0	-21	swapper/1	19:30:00	1
4152029	99	40	30,7	cyclictest	0	-21	swapper/1	19:30:00	1
4152028	99	40	31,6	cyclictest	0	-21	swapper/0	20:05:15	0
4152028	99	40	30,7	cyclictest	0	-21	swapper/0	20:10:27	0
4152029	99	38	31,5	cyclictest	0	-21	swapper/1	19:30:33	1
4152029	99	32	25,4	cyclictest	4143462	-21	kworker/u4:14-rpciod	19:10:01	1
4152028	99	32	6,16	cyclictest	4151974	-21	cron	19:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17