OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Feb 09, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
105363	99	79	70,6	cyclictest	114166	-21	kworker/u4:6+events_unbound	19:47:00	1
105361	99	76	43,7	cyclictest	119528	-21	aten_r7power_vo	20:05:17	0
105361	99	73	44,10	cyclictest	54	-21	kswapd0	23:25:02	0
105361	99	72	65,5	cyclictest	305441	-21	kworker/u4:3+events_unbound	00:38:47	0
105361	99	72	63,7	cyclictest	130657	-21	kworker/u4:11+events_unbound	21:17:18	0
105361	99	72	57,10	cyclictest	4062336	-21	kworker/u4:2+xprtiod	19:10:01	0
105361	99	71	62,7	cyclictest	120465	-21	kworker/u4:11+events_unbound	20:22:05	0
105361	99	70	47,8	cyclictest	153465	-21	grep	21:30:02	0
105363	99	68	63,3	cyclictest	115420	-21	kworker/u4:7+events_unbound	20:07:04	1
105363	99	68	60,6	cyclictest	280008	-21	kworker/u4:4+events_unbound	23:57:27	1
105361	99	68	63,3	cyclictest	271300	-21	kworker/u4:15+events_unbound	23:52:20	0
105361	99	68	61,5	cyclictest	288708	-21	kworker/u4:3+events_unbound	00:08:10	0
105361	99	67	58,6	cyclictest	121720	-21	kworker/u4:13+events_unbound	20:52:12	0
105363	99	66	58,6	cyclictest	4063998	-21	kworker/u4:1+events_unbound	20:17:05	1
105361	99	65	56,7	cyclictest	105291	-21	kworker/u4:3+events_unbound	19:42:00	0
105361	99	64	55,7	cyclictest	215996	-21	kworker/u4:6+events_unbound	22:47:36	0
105361	99	64	55,7	cyclictest	215996	-21	kworker/u4:6+events_unbound	22:47:35	0
105363	99	63	55,5	cyclictest	202995	-21	kworker/u4:2+events_unbound	22:27:32	1
105363	99	62	57,3	cyclictest	128121	-21	kworker/u4:7+events_unbound	21:02:15	1
105363	99	61	52,7	cyclictest	258863	-21	kworker/u4:10+events_unbound	23:32:48	1
105361	99	60	52,5	cyclictest	105359	-21	cyclictest	23:05:55	0
105361	99	60	49,8	cyclictest	54	-21	kswapd0	22:10:02	0
105363	99	59	52,5	cyclictest	202997	-21	kworker/u4:5+events_unbound	22:46:43	1
105363	99	59	52,5	cyclictest	202997	-21	kworker/u4:5+events_unbound	22:46:43	1
105361	99	59	51,6	cyclictest	105291	-21	kworker/u4:3+events_unbound	20:02:03	0
105363	99	58	50,5	cyclictest	229035	-21	kworker/u4:4+events_unbound	23:02:41	1
105363	99	58	48,7	cyclictest	105296	-21	kworker/u4:9+events_unbound	20:37:10	1
105363	99	57	45,9	cyclictest	54	-21	kswapd0	22:15:01	1
105361	99	57	46,7	cyclictest	105359	-21	cyclictest	23:35:15	0
105361	99	57	45,9	cyclictest	304789	-21	sed	00:25:41	0
105363	99	56	40,13	cyclictest	0	-21	swapper/1	21:50:30	1
105361	99	56	48,6	cyclictest	205200	-21	wget	22:30:16	0
105363	99	55	46,7	cyclictest	37	-21	kcompactd0	23:40:20	1
105361	99	55	46,7	cyclictest	4063998	-21	kworker/u4:1+events_unbound	19:11:51	0
105361	99	55	45,7	cyclictest	155558	-21	kworker/u4:4+events_unbound	21:42:21	0
105361	99	55	31,22	cyclictest	282578	-21	fschecks_time	00:00:22	0
105363	99	54	44,8	cyclictest	153292	-21	apt-get	21:30:07	1
105361	99	54	46,6	cyclictest	4063998	-21	kworker/u4:1+events_unbound	20:12:06	0
105363	99	53	45,5	cyclictest	292445	-21	kworker/u4:8+events_unbound	00:30:00	1
105363	99	53	45,5	cyclictest	273315	-21	ssh	23:50:00	1
105363	99	53	44,7	cyclictest	54	-21	kswapd0	22:55:16	1
105361	99	53	45,6	cyclictest	128116	-21	kworker/u4:1+events_unbound	21:22:18	0
105361	99	53	43,8	cyclictest	188211	-21	cpu	22:10:15	0
105363	99	52	45,5	cyclictest	248709	-21	ntp_kernel_pll_	23:20:32	1
105363	99	52	45,5	cyclictest	206087	-21	processes	22:30:36	1
105363	99	52	45,5	cyclictest	162025	-21	gpgv	21:40:02	1
105363	99	52	45,5	cyclictest	142885	-21	systemd	21:17:16	1
105363	99	52	43,7	cyclictest	113187	-21	aten_r7power_en	19:40:15	1
105361	99	52	45,5	cyclictest	257753	-21	unixbench_singl	23:30:39	0
105361	99	52	44,6	cyclictest	258238	-21	kworker/u4:9+events_unbound	23:42:50	0
105361	99	52	43,7	cyclictest	105296	-21	kworker/u4:9+events_unbound	19:21:52	0
105361	99	52	43,6	cyclictest	124342	-21	kworker/u4:14+events_unbound	20:57:14	0
105363	99	51	44,5	cyclictest	286259	-21	latency_hist	00:05:01	1
105363	99	51	44,5	cyclictest	166847	-21	/usr/sbin/munin	21:45:16	1
105363	99	51	41,7	cyclictest	111632	-21	kworker/u4:18+events_unbound	19:36:57	1
105361	99	51	43,6	cyclictest	410	-21	systemd-logind	23:57:26	0
105361	99	51	43,6	cyclictest	105297	-21	kworker/u4:10+events_unbound	19:20:00	0
105361	99	51	40,9	cyclictest	124618	-21	aten_r7power_en	20:25:18	0
105361	99	51	32,17	cyclictest	129630	-21	aten_r7power_cu	20:45:16	0
105363	99	50	43,5	cyclictest	117262	-21	gltestperf	19:55:19	1
105363	99	50	41,7	cyclictest	287714	-21	unixbench_singl	00:05:38	1
105363	99	50	40,5	cyclictest	153466	-21	latency_hist	21:30:02	1
105361	99	50	43,5	cyclictest	288707	-21	kworker/u4:0+events_unbound	00:23:39	0
105361	99	50	43,5	cyclictest	288707	-21	kworker/u4:0+events_unbound	00:23:38	0
105361	99	50	43,5	cyclictest	243655	-21	apt-get	23:15:15	0
105361	99	50	41,7	cyclictest	298054	-21	sshd	00:18:29	0
105363	99	49	42,5	cyclictest	239200	-21	latency_hist	23:10:01	1
105363	99	49	39,8	cyclictest	115902	-21	fschecks_count	19:50:19	1
105361	99	49	40,7	cyclictest	254514	-21	kworker/u4:7+events_unbound	23:27:47	0
105361	99	49	28,6	cyclictest	155555	-21	kworker/u4:1+rpciod	21:35:22	0
105363	99	48	42,4	cyclictest	175560	-21	fschecks_time	21:55:21	1
105363	99	48	41,5	cyclictest	316220	-21	latency_hist	00:40:03	1
105363	99	48	41,5	cyclictest	197097	-21	gltestperf	22:20:21	1
105363	99	48	41,5	cyclictest	136367	-21	df_abs	21:10:17	1
105363	99	48	40,6	cyclictest	125924	-21	aten_r7power_vo	20:30:16	1
105361	99	48	38,8	cyclictest	192375	-21	aten2__	22:15:14	0
105361	99	48	28,7	cyclictest	176866	-21	kworker/u4:10+events_unbound	21:57:25	0
105363	99	47	41,4	cyclictest	121720	-21	kworker/u4:13+events_unbound	21:22:01	1
105363	99	47	40,5	cyclictest	274869	-21	unixbench_singl	23:50:39	1
105363	99	47	40,5	cyclictest	215997	-21	kworker/u4:8+events_unbound	22:44:25	1
105363	99	47	40,5	cyclictest	180558	-21	switchtime	22:00:42	1
105363	99	47	39,6	cyclictest	105291	-21	kworker/u4:3+events_unbound	19:16:52	1
105363	99	47	39,5	cyclictest	308109	-21	fschecks_count	00:30:17	1
105363	99	47	39,5	cyclictest	121957	-21	latency_hist	20:15:01	1
105361	99	47	40,5	cyclictest	291230	-21	gltestperf	00:10:20	0
105361	99	47	40,5	cyclictest	291230	-21	gltestperf	00:10:20	0
105361	99	47	40,5	cyclictest	140305	-21	latency_hist	21:15:01	0
105361	99	47	39,5	cyclictest	0	-21	swapper/0	22:40:16	0
105361	99	47	37,8	cyclictest	133463	-21	aten_r7power_en	21:00:18	0
105361	99	47	28,14	cyclictest	54	-21	kswapd0	23:45:11	0
105361	99	47	24,19	cyclictest	0	-21	swapper/0	21:45:16	0
105363	99	46	40,4	cyclictest	244958	-21	users	23:15:43	1
105363	99	46	39,5	cyclictest	106092	-21	ntpq	19:10:27	1
105363	99	46	39,4	cyclictest	0	-21	swapper/1	00:20:36	1
105363	99	46	39,4	cyclictest	0	-21	swapper/1	00:20:35	1
105363	99	46	37,7	cyclictest	125606	-21	kworker/u4:0+events_unbound	20:42:11	1
105361	99	46	40,4	cyclictest	200638	-21	ssh	22:25:02	0
105361	99	46	36,8	cyclictest	135724	-21	unixbench_singl	21:05:41	0
105361	99	46	36,8	cyclictest	122045	-21	aten_r7power_cu	20:15:19	0
105361	99	46	36,7	cyclictest	222586	-21	fschecks_count	22:50:21	0
105361	99	46	35,9	cyclictest	126038	-21	fschecks_count	20:30:17	0
105361	99	46	34,9	cyclictest	128715	-21	grep	20:40:20	0
105363	99	45	39,4	cyclictest	222388	-21	aten_r7power_po	22:50:17	1
105363	99	45	38,4	cyclictest	0	-21	swapper/1	00:15:17	1
105363	99	45	36,7	cyclictest	129676	-21	aten_r7power_en	20:45:15	1
105363	99	45	36,7	cyclictest	108252	-21	sed	19:20:16	1
105363	99	45	35,7	cyclictest	110528	-21	latency_hist	19:30:02	1
105361	99	45	38,5	cyclictest	180402	-21	/usr/sbin/munin	22:00:40	0
105361	99	45	38,5	cyclictest	154209	-21	uname	21:30:30	0
105361	99	45	38,5	cyclictest	116975	-21	aten_r7power_po	19:55:17	0
105361	99	45	38,5	cyclictest	112929	-21	idleruntime-cro	19:40:00	0
105361	99	45	37,5	cyclictest	171712	-21	ssh	21:50:33	0
105363	99	44	38,4	cyclictest	239860	-21	tail	23:10:22	1
105363	99	44	37,5	cyclictest	192378	-21	aten2__	22:15:14	1
105363	99	44	37,5	cyclictest	135454	-21	sendmail_mailqu	21:05:40	1
105363	99	44	37,5	cyclictest	110858	-21	fschecks_count	19:30:20	1
105363	99	44	35,7	cyclictest	125367	-21	switchtime	20:25:36	1
105363	99	44	35,6	cyclictest	0	-21	swapper/1	22:35:12	1
105361	99	44	37,5	cyclictest	128223	-21	latency_hist	20:40:01	0
105361	99	44	35,7	cyclictest	204874	-21	ssh	22:30:00	0
105361	99	44	33,9	cyclictest	308299	-21	/usr/sbin/munin	00:30:20	0
105363	99	43	37,4	cyclictest	151242	-21	kworker/u4:19-rpciod	21:40:21	1
105363	99	43	35,6	cyclictest	253255	-21	switchtime	23:25:39	1
105363	99	43	33,8	cyclictest	0	-21	swapper/1	22:05:24	1
105363	99	43	32,8	cyclictest	0	-21	swapper/1	00:10:33	1
105363	99	43	32,8	cyclictest	0	-21	swapper/1	00:10:33	1
105361	99	43	36,5	cyclictest	0	-21	swapper/0	19:26:55	0
105361	99	43	33,8	cyclictest	231952	-21	timerwakeupswit	23:00:37	0
105363	99	42	34,6	cyclictest	260861	-21	aten_r7power_po	23:35:15	1
105361	99	42	34,6	cyclictest	0	-21	swapper/0	19:50:00	0
105361	99	42	31,9	cyclictest	239740	-21	fschecks_count	23:10:20	0
105363	99	41	32,7	cyclictest	0	-21	swapper/1	20:50:36	1
105361	99	41	33,6	cyclictest	209697	-21	/usr/sbin/munin	22:35:22	0
105363	99	40	32,6	cyclictest	132596	-21	kernelversion	20:55:20	1
105361	99	40	34,4	cyclictest	224701	-21	kworker/u4:7-rpciod	22:55:19	0
105361	99	40	31,7	cyclictest	115644	-21	tr	19:50:15	0
105361	99	40	31,7	cyclictest	111376	-21	switchtime	19:30:35	0
105363	99	39	31,5	cyclictest	124116	-21	threads	20:20:36	1
105363	99	38	31,5	cyclictest	118174	-21	aten2__	20:00:15	1
105363	99	36	27,6	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17