OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sat Sep 05, 2026 00:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3998440	99	109	101,6	cyclictest	4132093	-21	kworker/u4:8+events_unbound	23:02:11	0
3998440	99	105	88,7	cyclictest	4136630	-21	kworker/u4:9+events_unbound	23:27:14	0
3998440	99	103	95,6	cyclictest	4105341	-21	kworker/u4:4+events_unbound	22:52:09	0
3998440	99	103	95,6	cyclictest	4105341	-21	kworker/u4:4+events_unbound	22:52:09	0
3998440	99	102	95,5	cyclictest	53	-21	kswapd0	23:37:15	0
3998440	99	98	83,5	cyclictest	4172501	-21	kworker/u4:6+events_unbound	23:47:01	0
3998440	99	97	90,5	cyclictest	9965	-21	kworker/u4:5+events_unbound	00:28:36	0
3998440	99	93	87,4	cyclictest	4050245	-21	kworker/u4:4+events_unbound	21:31:58	0
3998440	99	91	82,7	cyclictest	4078147	-21	kworker/u4:1+events_unbound	22:07:03	0
3998440	99	89	84,4	cyclictest	4004774	-21	kworker/u4:11+events_unbound	19:51:46	0
3998440	99	87	78,7	cyclictest	4011244	-21	kworker/u4:10+events_unbound	20:06:48	0
3998440	99	84	76,6	cyclictest	4181591	-21	kworker/u4:9+events_unbound	00:18:32	0
3998440	99	84	76,6	cyclictest	4141189	-21	kworker/u4:0+events_unbound	23:12:11	0
3998440	99	83	74,6	cyclictest	4186203	-21	kworker/u4:12+events_unbound	00:20:14	0
3998440	99	83	65,6	cyclictest	3997163	-21	kworker/u4:3+events_unbound	19:26:42	0
3998440	99	80	72,6	cyclictest	4172499	-21	kworker/u4:3+events_unbound	23:52:26	0
3998440	99	80	72,6	cyclictest	4172499	-21	kworker/u4:3+events_unbound	23:52:25	0
3998441	99	77	41,21	cyclictest	12169	-21	apt-key	00:25:03	1
3998440	99	72	63,7	cyclictest	4104145	-21	sed	22:30:41	0
3998440	99	72	63,7	cyclictest	4104145	-21	sed	22:30:41	0
3998440	99	70	62,6	cyclictest	4064189	-21	kworker/u4:6+events_unbound	22:02:02	0
3998440	99	70	62,6	cyclictest	4012552	-21	kworker/u4:17+events_unbound	20:41:53	0
3998440	99	70	49,16	cyclictest	3998436	-21	cyclictest	22:35:11	0
3998441	99	68	31,13	cyclictest	4144243	-21	open_files	23:15:34	1
3998440	99	68	61,5	cyclictest	4004788	-21	kworker/u4:15+events_unbound	20:31:49	0
3998440	99	68	57,8	cyclictest	4036233	-21	kworker/u4:9+events_unbound	21:16:57	0
3998441	99	67	41,8	cyclictest	4102649	-21	latency_hist	22:30:01	1
3998441	99	67	33,6	cyclictest	4015822	-21	ntpq	20:15:23	1
3998440	99	67	54,6	cyclictest	4013823	-21	kworker/u4:2+events_unbound	20:11:47	0
3998441	99	66	53,7	cyclictest	0	-21	swapper/1	20:30:25	1
3998441	99	65	29,12	cyclictest	4124494	-21	ssh	22:54:07	1
3998441	99	65	29,12	cyclictest	4124494	-21	ssh	22:54:06	1
3998441	99	64	32,10	cyclictest	4176893	-21	ssh	23:51:56	1
3998441	99	64	32,10	cyclictest	4176893	-21	ssh	23:51:56	1
3998441	99	64	28,19	cyclictest	0	-21	swapper/1	23:45:26	1
3998441	99	64	25,14	cyclictest	4133727	-21	ssh	23:04:28	1
3998441	99	63	26,16	cyclictest	4072311	-21	ssh	21:55:46	1
3998441	99	63	26,16	cyclictest	4072311	-21	ssh	21:55:45	1
3998441	99	63	26,13	cyclictest	4042953	-21	ssh	21:24:46	1
3998441	99	63	25,15	cyclictest	4158717	-21	ssh	23:31:31	1
3998440	99	63	56,5	cyclictest	4015093	-21	kworker/u4:1+events_unbound	20:36:52	0
3998441	99	62	28,13	cyclictest	24270	-21	ssh	00:37:58	1
3998441	99	62	27,12	cyclictest	4135863	-21	ssh	23:05:53	1
3998441	99	62	25,13	cyclictest	4185208	-21	ssh	00:00:51	1
3998441	99	61	29,10	cyclictest	0	-21	swapper/1	21:10:23	1
3998441	99	61	28,13	cyclictest	4038438	-21	ssh	21:19:54	1
3998441	99	61	28,10	cyclictest	4054039	-21	ssh	21:35:48	1
3998441	99	61	27,18	cyclictest	0	-21	swapper/1	21:40:31	1
3998441	99	61	26,11	cyclictest	4096431	-21	ssh	22:22:39	1
3998441	99	61	25,12	cyclictest	4181430	-21	ssh	23:57:00	1
3998440	99	61	53,6	cyclictest	4054905	-21	kworker/u4:1+events_unbound	21:45:01	0
3998441	99	60	3,50	cyclictest	4067186	-21	ssh	21:50:34	1
3998441	99	60	3,50	cyclictest	4067186	-21	ssh	21:50:33	1
3998441	99	60	27,10	cyclictest	14074	-21	ssh	00:26:16	1
3998441	99	60	26,11	cyclictest	4191039	-21	ssh	00:07:50	1
3998441	99	60	25,14	cyclictest	17476	-21	ssh	00:30:22	1
3998441	99	60	25,13	cyclictest	4162788	-21	ssh	23:35:53	1
3998441	99	60	24,14	cyclictest	4106541	-21	ssh	22:34:07	1
3998441	99	60	24,14	cyclictest	4106541	-21	ssh	22:34:06	1
3998441	99	60	24,13	cyclictest	7458	-21	ssh	00:19:55	1
3998441	99	60	24,10	cyclictest	815	-21	ssh	00:11:39	1
3998440	99	60	52,6	cyclictest	4096046	-21	kworker/u4:2+events_unbound	22:27:06	0
3998441	99	59	27,11	cyclictest	0	-21	swapper/1	21:30:27	1
3998441	99	59	26,9	cyclictest	4085719	-21	find	22:10:39	1
3998441	99	59	26,11	cyclictest	4062811	-21	mailstats	21:45:39	1
3998441	99	59	26,11	cyclictest	4062811	-21	mailstats	21:45:38	1
3998441	99	59	26,10	cyclictest	4114415	-21	ssh	22:42:25	1
3998441	99	59	24,13	cyclictest	4168139	-21	ssh	23:42:12	1
3998440	99	59	53,5	cyclictest	4096047	-21	kworker/u4:3+events_unbound	22:23:45	0
3998441	99	58	28,9	cyclictest	0	-21	swapper/1	22:55:26	1
3998441	99	58	26,12	cyclictest	4151561	-21	ssh	23:24:19	1
3998441	99	58	24,12	cyclictest	4155341	-21	ssh	23:28:12	1
3998441	99	58	24,11	cyclictest	4109364	-21	ssh	22:36:34	1
3998440	99	58	51,5	cyclictest	4003504	-21	kworker/u4:9+events_unbound	19:36:43	0
3998440	99	58	47,9	cyclictest	4090424	-21	unixbench_multi	22:15:39	0
3998441	99	57	49,6	cyclictest	4002244	-21	kworker/u4:1+events_unbound	19:24:59	1
3998441	99	57	24,13	cyclictest	4142726	-21	ssh	23:14:33	1
3998441	99	57	24,12	cyclictest	4077652	-21	ssh	22:01:56	1
3998441	99	57	23,13	cyclictest	4091692	-21	ssh	22:17:25	1
3998441	99	56	43,10	cyclictest	4018585	-21	ntpq	20:25:31	1
3998441	99	56	26,7	cyclictest	4029091	-21	find	21:05:43	1
3998441	99	56	24,11	cyclictest	4119123	-21	ssh	22:47:46	1
3998441	99	56	23,10	cyclictest	4046096	-21	ssh	21:27:37	1
3998440	99	56	49,5	cyclictest	4044125	-21	ld	21:25:26	0
3998440	99	56	40,12	cyclictest	4061961	-21	cpu	21:45:15	0
3998440	99	56	40,12	cyclictest	4061961	-21	cpu	21:45:15	0
3998440	99	55	48,5	cyclictest	4004774	-21	kworker/u4:11+events_unbound	19:46:46	0
3998441	99	54	47,5	cyclictest	4081234	-21	timerwakeupswit	22:05:39	1
3998441	99	53	34,15	cyclictest	4000497	-21	sshd	19:15:33	1
3998440	99	53	43,8	cyclictest	4136709	-21	sshd	23:07:11	0
3998440	99	52	1,4	cyclictest	4116414	-21	apt-get	22:45:13	0
3998441	99	51	25,4	cyclictest	4006092	-21	apt-get	19:40:04	1
3998441	99	51	21,9	cyclictest	4020574	-21	apt-get	20:35:16	1
3998440	99	51	40,7	cyclictest	256	50	irq/23-42890000.ethernet	00:15:01	0
3998440	99	51	37,6	cyclictest	4086753	-21	kworker/u4:9+events_unbound	22:12:07	0
3998441	99	50	40,7	cyclictest	4011501	-21	aten2__	20:00:15	1
3998440	99	50	42,6	cyclictest	4064190	-21	kworker/u4:7+events_unbound	21:56:26	0
3998440	99	50	42,6	cyclictest	4064190	-21	kworker/u4:7+events_unbound	21:56:26	0
3998440	99	50	39,7	cyclictest	0	-21	swapper/0	22:55:30	0
3998441	99	49	37,10	cyclictest	4024973	-21	ntpq	20:50:26	1
3998441	99	49	32,13	cyclictest	4009193	-21	fschecks_time	19:50:19	1
3998441	99	49	20,9	cyclictest	4016676	-21	apt-get	20:20:19	1
3998440	99	49	6,39	cyclictest	0	-21	swapper/0	20:20:08	0
3998440	99	49	34,12	cyclictest	4177025	-21	kworker/u4:0+xprtiod	23:57:15	0
3998440	99	49	26,12	cyclictest	14504	-21	kworker/u4:7+events_unbound	00:32:48	0
3998441	99	48	37,9	cyclictest	4025682	-21	apt-get	20:55:11	1
3998441	99	48	30,13	cyclictest	3999605	-21	unixbench_singl	19:10:37	1
3998441	99	48	25,3	cyclictest	4010174	-21	apt-get	19:55:13	1
3998440	99	48	38,7	cyclictest	4066460	-21	aten_r7power_vo	21:50:16	0
3998440	99	48	38,7	cyclictest	4066460	-21	aten_r7power_vo	21:50:15	0
3998440	99	48	35,11	cyclictest	4086751	-21	kworker/u4:7+events_unbound	22:42:55	0
3998440	99	48	29,17	cyclictest	4029859	-21	cpu	21:10:18	0
3998441	99	47	33,9	cyclictest	4013839	-21	modprobe	20:10:00	1
3998441	99	46	36,7	cyclictest	4004173	-21	irqstats	19:30:20	1
3998441	99	46	33,11	cyclictest	4003074	-21	ntpq	19:25:30	1
3998440	99	46	39,5	cyclictest	4039189	-21	fschecks_count	21:20:19	0
3998440	99	46	37,7	cyclictest	4165954	-21	aten_r7power_po	23:40:15	0
3998440	99	46	37,7	cyclictest	4028645	-21	gltestperf	21:05:19	0
3998440	99	46	36,5	cyclictest	4091391	-21	kworker/u4:6+events_unbound	23:21:40	0
3998440	99	46	25,18	cyclictest	0	-21	swapper/0	00:00:11	0
3998440	99	46	20,11	cyclictest	17	1	rcu_preempt	20:50:26	0
3998441	99	45	36,7	cyclictest	4005268	-21	fschecks_count	19:35:18	1
3998441	99	45	35,8	cyclictest	4028050	-21	sshd	21:01:54	1
3998441	99	45	35,8	cyclictest	4028050	-21	sshd	21:01:54	1
3998441	99	45	35,8	cyclictest	4008178	-21	ntpq	19:45:31	1
3998441	99	45	34,8	cyclictest	0	-21	swapper/1	20:45:12	1
3998441	99	45	32,11	cyclictest	4014312	-21	fschecks_time	20:10:20	1
3998441	99	45	20,3	cyclictest	4021871	-21	apt-get	20:40:13	1
3998440	99	45	4,32	cyclictest	4026360	-21	/usr/sbin/munin	20:55:34	0
3998440	99	45	38,5	cyclictest	4188518	-21	df_abs	00:05:16	0
3998440	99	45	37,5	cyclictest	4011155	-21	unixbench_multi	19:55:38	0
3998440	99	45	37,5	cyclictest	21869	-21	gltestperf	00:35:19	0
3998440	99	45	35,7	cyclictest	4053494	-21	ntpq	21:35:35	0
3998440	99	45	25,8	cyclictest	4154920	-21	kworker/u4:6+events_unbound	23:31:15	0
3998440	99	44	36,5	cyclictest	4004029	-21	fschecks_time	19:30:17	0
3998440	99	44	34,7	cyclictest	0	-21	swapper/0	20:45:32	0
3998440	99	44	31,8	cyclictest	0	-21	swapper/0	19:40:07	0
3998440	99	43	35,5	cyclictest	4147685	-21	latency_hist	23:20:02	0
3998440	99	43	32,7	cyclictest	3998635	-21	aten_r7power_cu	19:10:14	0
3998440	99	42	36,4	cyclictest	4019050	-21	idleruntime-cro	20:30:01	0
3998440	99	42	34,5	cyclictest	4016588	-21	apt-key	20:20:02	0
3998440	99	41	34,5	cyclictest	4027336	-21	gltestperf	21:00:19	0
3998440	99	41	34,5	cyclictest	4027336	-21	gltestperf	21:00:18	0
3998440	99	41	31,8	cyclictest	4011244	-21	kworker/u4:10+events_unbound	20:05:01	0
3998441	99	40	27,10	cyclictest	3998453	-21	latency_hist	19:10:01	1
3998440	99	38	31,3	cyclictest	3998439	-21	modprobe	19:10:01	0
3998440	99	38	30,6	cyclictest	4002037	-21	timerandwakeup	19:20:38	0
3998440	99	38	30,6	cyclictest	4001048	-21	latency_hist	19:20:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17