OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Sat Jul 11, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
663281	99	115	96,5	cyclictest	680013	-21	kworker/u4:8+events_unbound	08:20:31	1
663281	99	115	96,5	cyclictest	680013	-21	kworker/u4:8+events_unbound	08:20:31	1
663281	99	106	99,5	cyclictest	723404	-21	kworker/u4:10+events_unbound	09:55:52	1
663281	99	101	81,7	cyclictest	663211	-21	kworker/u4:6+events_unbound	08:10:31	1
663281	99	100	83,4	cyclictest	785053	-21	kworker/u4:2+events_unbound	11:01:09	1
663281	99	96	81,6	cyclictest	687779	-21	kworker/u4:7+events_unbound	08:50:39	1
663281	99	94	87,5	cyclictest	665860	-21	kworker/u4:11+events_unbound	07:40:17	1
663279	99	93	85,5	cyclictest	668441	-21	kworker/u4:16+events_unbound	07:30:14	0
663281	99	92	84,6	cyclictest	850370	-21	kworker/u4:7+events_unbound	12:11:25	1
663281	99	92	84,6	cyclictest	850370	-21	kworker/u4:7+events_unbound	12:11:25	1
663281	99	91	73,5	cyclictest	811135	-21	kworker/u4:3+events_unbound	11:26:15	1
663281	99	90	83,5	cyclictest	663211	-21	kworker/u4:6+events_unbound	08:00:25	1
663281	99	87	78,6	cyclictest	849712	-21	kworker/u4:3+events_unbound	12:16:26	1
663281	99	80	70,8	cyclictest	665860	-21	kworker/u4:11+events_unbound	08:30:34	1
663281	99	80	70,8	cyclictest	665860	-21	kworker/u4:11+events_unbound	08:30:34	1
663281	99	78	69,7	cyclictest	670983	-21	kworker/u4:3+events_unbound	08:15:30	1
663281	99	78	66,4	cyclictest	745643	-21	kworker/u4:8+events_unbound	10:41:02	1
663281	99	78	54,13	cyclictest	670983	-21	kworker/u4:3+events_unbound	07:55:06	1
663279	99	78	70,6	cyclictest	828835	-21	kworker/u4:1+events_unbound	11:51:23	0
663281	99	76	65,8	cyclictest	665861	-21	kworker/u4:12+events_unbound	07:20:13	1
663281	99	72	53,7	cyclictest	664507	-21	kworker/u4:9+events_unbound	07:30:16	1
663281	99	71	63,6	cyclictest	664503	-21	kworker/u4:8+events_unbound	07:25:14	1
663281	99	70	51,8	cyclictest	667172	-21	kworker/u4:5+events_unbound	07:40:01	1
663281	99	69	62,5	cyclictest	705993	-21	kworker/u4:1+events_unbound	09:25:44	1
663279	99	69	37,7	cyclictest	53	-21	kswapd0	09:45:09	0
663281	99	68	61,5	cyclictest	670985	-21	kworker/u4:8+events_unbound	07:45:17	1
663281	99	66	61,3	cyclictest	670983	-21	kworker/u4:3+events_unbound	07:55:20	1
663279	99	66	59,5	cyclictest	765134	-21	aten_r7power_cu	10:30:17	0
663279	99	65	57,6	cyclictest	745643	-21	kworker/u4:8+events_unbound	10:46:01	0
663281	99	64	56,6	cyclictest	670983	-21	kworker/u4:3+events_unbound	09:17:45	1
663281	99	64	56,6	cyclictest	670983	-21	kworker/u4:3+events_unbound	09:17:45	1
663281	99	63	49,4	cyclictest	670984	-21	kworker/u4:4+events_unbound	09:45:48	1
663279	99	63	53,8	cyclictest	739034	-21	df_abs	10:00:18	0
663281	99	62	54,5	cyclictest	665860	-21	kworker/u4:11+events_unbound	08:25:32	1
663279	99	62	53,6	cyclictest	663211	-21	kworker/u4:6+events_unbound	08:45:37	0
663279	99	62	43,12	cyclictest	761783	-21	find	10:25:40	0
663281	99	60	52,5	cyclictest	788863	-21	kworker/u4:3+events_unbound	11:11:12	1
663281	99	60	52,5	cyclictest	745641	-21	kworker/u4:5+events_unbound	10:21:00	1
663281	99	60	51,7	cyclictest	0	-21	swapper/1	11:40:30	1
663279	99	60	52,5	cyclictest	667172	-21	kworker/u4:5+events_unbound	08:05:02	0
663279	99	60	49,8	cyclictest	673860	-21	systemd	07:50:17	0
663279	99	60	44,6	cyclictest	767231	-21	kworker/u4:5+events_unbound	10:56:08	0
663279	99	60	44,6	cyclictest	767231	-21	kworker/u4:5+events_unbound	10:56:08	0
663281	99	59	52,5	cyclictest	767227	-21	kworker/u4:0+events_unbound	10:50:04	1
663281	99	58	52,4	cyclictest	806692	-21	kworker/u4:11+events_unbound	11:20:02	1
663281	99	58	50,5	cyclictest	841482	-21	kworker/u4:5+events_unbound	12:30:03	1
663281	99	58	48,7	cyclictest	845948	-21	kworker/u4:1+events_unbound	12:21:27	1
663281	99	57	49,6	cyclictest	767227	-21	kworker/u4:0+events_unbound	10:35:02	1
663279	99	57	49,6	cyclictest	670982	-21	kworker/u4:2+events_unbound	08:15:01	0
663279	99	57	47,6	cyclictest	828835	-21	kworker/u4:1+events_unbound	11:46:21	0
663281	99	56	49,5	cyclictest	745643	-21	kworker/u4:8+events_unbound	10:25:59	1
663279	99	54	44,6	cyclictest	777903	-21	kworker/u4:6	10:45:00	0
663281	99	53	46,5	cyclictest	844354	-21	ssh	12:00:25	1
663281	99	53	46,5	cyclictest	727911	-21	kworker/u4:0+events_unbound	10:19:45	1
663281	99	53	38,5	cyclictest	815523	-21	kworker/u4:7+events_unbound	11:40:00	1
663281	99	52	45,5	cyclictest	787340	-21	fschecks_count	10:55:27	1
663281	99	52	45,5	cyclictest	787340	-21	fschecks_count	10:55:27	1
663281	99	52	45,5	cyclictest	747588	-21	aten_r7power_cu	10:10:17	1
663281	99	52	45,5	cyclictest	677387	-21	kworker/u4:0+events_unbound	08:40:37	1
663281	99	52	44,6	cyclictest	670983	-21	kworker/u4:3+events_unbound	09:20:43	1
663281	99	52	43,7	cyclictest	694148	-21	systemd	09:05:40	1
663281	99	52	40,9	cyclictest	765043	-21	apt-get	10:30:13	1
663279	99	52	46,4	cyclictest	745643	-21	kworker/u4:8+events_unbound	10:39:45	0
663279	99	52	40,5	cyclictest	808944	-21	aten_r7power_en	11:20:16	0
663279	99	52	36,5	cyclictest	686482	-21	kworker/u4:1+events_unbound	09:15:44	0
663279	99	52	36,5	cyclictest	686482	-21	kworker/u4:1+events_unbound	09:15:43	0
663279	99	52	31,19	cyclictest	0	-21	swapper/0	11:15:32	0
663279	99	51	44,5	cyclictest	747199	-21	ssh	10:10:00	0
663279	99	51	44,4	cyclictest	844042	-21	fschecks_count	12:00:21	0
663279	99	51	43,6	cyclictest	670982	-21	kworker/u4:2+events_unbound	09:00:42	0
663279	99	51	43,5	cyclictest	874689	-21	gltestperf	12:35:21	0
663279	99	51	42,7	cyclictest	663210	-21	kworker/u4:5+events_unbound	07:15:16	0
663281	99	50	42,6	cyclictest	651953	-21	kworker/u4:14+events_unbound	09:00:01	1
663281	99	50	41,7	cyclictest	841065	-21	systemd	11:56:22	1
663281	99	50	39,8	cyclictest	865912	-21	fschecks_count	12:25:20	1
663279	99	50	43,5	cyclictest	802217	-21	kworker/u4:2+events_unbound	11:40:02	0
663279	99	50	42,6	cyclictest	845948	-21	kworker/u4:1+events_unbound	12:20:15	0
663279	99	50	41,7	cyclictest	716803	-21	sh	09:35:16	0
663279	99	50	40,7	cyclictest	677990	-21	fschecks_time	08:05:25	0
663279	99	50	39,8	cyclictest	710491	-21	kworker/u4:11-rpciod	09:30:35	0
663279	99	50	32,5	cyclictest	695562	-21	mailstats	09:10:39	0
663281	99	49	42,5	cyclictest	834857	-21	apt-key	11:50:02	1
663281	99	49	38,7	cyclictest	818610	-21	ls	11:30:41	1
663279	99	49	43,4	cyclictest	817652	-21	aten_r7power_en	11:30:18	0
663279	99	49	42,5	cyclictest	736745	-21	kworker/u4:9+events_unbound	10:15:02	0
663279	99	49	42,5	cyclictest	685241	-21	sh	08:35:00	0
663279	99	49	42,5	cyclictest	685241	-21	sh	08:35:00	0
663279	99	49	40,7	cyclictest	722543	-21	grep	09:40:42	0
663279	99	49	39,6	cyclictest	708907	-21	mailstats	09:25:39	0
663281	99	48	41,5	cyclictest	722188	-21	ps	09:40:39	1
663281	99	48	41,5	cyclictest	670984	-21	kworker/u4:4+events_unbound	10:00:55	1
663281	99	48	41,4	cyclictest	797017	-21	unixbench_singl	11:05:42	1
663281	99	48	39,6	cyclictest	0	-21	swapper/1	12:05:30	1
663281	99	48	38,7	cyclictest	0	-21	swapper/1	08:35:35	1
663279	99	48	41,5	cyclictest	663278	-21	cyclictest	12:19:43	0
663279	99	48	39,7	cyclictest	791785	-21	gltestperf	11:00:21	0
663279	99	48	38,7	cyclictest	824394	-21	ssh	11:37:33	0
663279	99	48	38,7	cyclictest	671536	-21	fschecks_time	07:40:19	0
663279	99	48	35,8	cyclictest	758246	-21	ssh	10:21:39	0
663279	99	48	30,16	cyclictest	738530	-21	latency_hist	10:00:01	0
663281	99	47	41,4	cyclictest	723404	-21	kworker/u4:10-rpciod	09:50:17	1
663281	99	47	40,5	cyclictest	663278	-21	cyclictest	07:10:16	1
663279	99	47	41,4	cyclictest	850369	-21	kworker/u4:4+events_unbound	12:26:26	0
663279	99	47	40,5	cyclictest	852554	-21	aten_r7power_po	12:10:18	0
663279	99	47	40,5	cyclictest	852554	-21	aten_r7power_po	12:10:18	0
663279	99	47	40,5	cyclictest	839654	-21	fschecks_count	11:55:20	0
663279	99	47	39,6	cyclictest	871001	-21	/usr/sbin/munin	12:30:43	0
663279	99	47	38,6	cyclictest	686758	-21	aten_r7power_cu	08:40:15	0
663279	99	47	28,5	cyclictest	0	-21	swapper/0	09:20:23	0
663279	99	47	28,17	cyclictest	693378	-21	fschecks_time	09:05:18	0
663281	99	46	40,4	cyclictest	744144	-21	sendmail_mailqu	10:05:39	1
663281	99	46	39,5	cyclictest	835262	-21	df_abs	11:50:21	1
663281	99	46	38,5	cyclictest	779549	-21	/usr/sbin/munin	10:45:42	1
663281	99	46	36,7	cyclictest	692072	-21	fschecks_count	09:00:19	1
663279	99	46	39,5	cyclictest	800885	-21	/usr/sbin/munin	11:10:32	0
663279	99	46	35,8	cyclictest	675090	-21	aten_r7power_en	07:55:16	0
663281	99	45	37,5	cyclictest	698741	-21	latency_hist	09:15:00	1
663279	99	45	39,4	cyclictest	751958	-21	aten2__	10:15:17	0
663279	99	45	38,5	cyclictest	783361	-21	ssh	10:50:31	0
663279	99	45	38,5	cyclictest	666446	-21	fschecks_time	07:20:20	0
663279	99	45	37,6	cyclictest	806692	-21	kworker/u4:11+events_unbound	11:25:03	0
663279	99	45	36,7	cyclictest	849394	-21	unixbench_singl	12:05:42	0
663279	99	45	36,7	cyclictest	685543	-21	aten_r7power_vo	08:35:16	0
663279	99	45	36,7	cyclictest	672529	-21	aten_r7power_cu	07:45:18	0
663281	99	44	38,4	cyclictest	808823	-21	/usr/sbin/munin	11:20:11	1
663281	99	44	37,5	cyclictest	688290	-21	fschecks_time	08:45:21	1
663281	99	44	34,8	cyclictest	678156	-21	kernelversion	08:05:28	1
663279	99	44	37,5	cyclictest	730508	-21	gltestperf	09:50:21	0
663279	99	44	34,8	cyclictest	795794	-21	aten_r7power_cu	11:05:17	0
663279	99	44	34,8	cyclictest	689275	-21	aten2__	08:50:15	0
663279	99	44	34,8	cyclictest	682393	-21	timerandwakeup	08:20:39	0
663279	99	44	34,8	cyclictest	682393	-21	timerandwakeup	08:20:38	0
663281	99	43	36,5	cyclictest	666002	-21	latency_hist	07:20:01	1
663279	99	43	36,5	cyclictest	680448	-21	fschecks_count	08:15:19	0
663279	99	43	36,5	cyclictest	670611	-21	grep	07:35:36	0
663279	99	43	34,7	cyclictest	663522	-21	aten_r7power_po	07:10:17	0
663279	99	43	33,8	cyclictest	667562	-21	df_abs	07:25:16	0
663281	99	42	36,4	cyclictest	717301	-21	if_eth0	09:35:21	1
663281	99	42	35,5	cyclictest	713337	-21	ssh	09:30:39	1
663279	99	42	32,8	cyclictest	690797	-21	fschecks_count	08:55:21	0
663279	99	42	32,8	cyclictest	683136	-21	fschecks_count	08:25:23	0
663281	99	41	31,7	cyclictest	0	-21	swapper/1	12:35:31	1
663279	99	34	25,6	cyclictest	0	-21	swapper/0	07:10:00	0
663281	99	31	17,11	cyclictest	663392	-21	ls	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17