OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Mon May 25, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2955667	99	178	133,14	cyclictest	53	-21	kswapd0	23:00:08	0
2955667	99	94	77,14	cyclictest	53	-21	kswapd0	21:50:10	0
2955668	99	91	81,7	cyclictest	2959488	-21	kworker/u4:4+events_unbound	19:57:02	1
2955668	99	81	64,7	cyclictest	3112489	-21	kworker/u4:9+events_unbound	23:46:57	1
2955667	99	79	72,5	cyclictest	3037328	-21	kworker/u4:5+events_unbound	22:15:00	0
2955667	99	77	67,7	cyclictest	2978716	-21	kworker/u4:10+events_unbound	20:50:00	0
2955668	99	72	64,5	cyclictest	2959487	-21	kworker/u4:2+events_unbound	21:05:00	1
2955667	99	70	62,6	cyclictest	3129781	-21	kworker/u4:2+events_unbound	23:52:16	0
2955668	99	69	60,7	cyclictest	3046249	-21	kworker/u4:3+events_unbound	22:17:30	1
2955667	99	69	1,21	cyclictest	2955665	-21	awk	19:10:00	0
2955668	99	68	59,6	cyclictest	2956895	-21	kworker/u4:3+events_unbound	19:31:59	1
2955668	99	68	59,6	cyclictest	2956895	-21	kworker/u4:3+events_unbound	19:31:59	1
2955667	99	68	61,5	cyclictest	19	1	rcuc/0	22:17:30	0
2955668	99	67	57,7	cyclictest	378	-21	dbus-daemon	20:22:07	1
2955668	99	66	57,6	cyclictest	2953170	-21	kworker/u4:1+events_unbound	19:21:56	1
2955667	99	66	57,7	cyclictest	3055142	-21	kworker/u4:0+events_unbound	22:27:32	0
2955667	99	66	57,7	cyclictest	2963296	-21	kworker/u4:11+events_unbound	19:55:00	0
2955667	99	66	57,7	cyclictest	2963296	-21	kworker/u4:11+events_unbound	19:55:00	0
2955667	99	63	47,13	cyclictest	3136220	-21	munin-run	00:00:01	0
2955667	99	63	45,15	cyclictest	3070681	-21	df_abs	22:45:19	0
2955668	99	61	54,4	cyclictest	3094492	-21	kworker/u4:3+events_unbound	23:15:01	1
2955668	99	61	53,6	cyclictest	3107991	-21	kworker/u4:7+events_unbound	23:37:47	1
2955668	99	61	48,9	cyclictest	37	-21	kcompactd0	00:10:21	1
2955667	99	61	51,7	cyclictest	3002053	-21	kworker/u4:12+events_unbound	21:42:24	0
2955667	99	60	50,7	cyclictest	3015622	-21	kworker/u4:17+events_unbound	21:57:28	0
2955668	99	59	51,6	cyclictest	3002053	-21	kworker/u4:12+events_unbound	21:32:22	1
2955668	99	58	50,6	cyclictest	378	-21	dbus-daemon	23:57:47	1
2955667	99	58	46,9	cyclictest	3059536	-21	kworker/u4:5+events_unbound	22:50:16	0
2955667	99	58	46,8	cyclictest	37	-21	kcompactd0	22:56:05	0
2955668	99	57	49,6	cyclictest	2977442	-21	kworker/u4:3+events_unbound	20:57:14	1
2955667	99	57	50,5	cyclictest	2986388	-21	kworker/u4:7+events_unbound	21:26:01	0
2955667	99	57	49,6	cyclictest	2968491	-21	kworker/u4:7+events_unbound	20:22:08	0
2955668	99	56	47,7	cyclictest	3098996	-21	kworker/u4:4+events_unbound	23:22:42	1
2955667	99	56	51,3	cyclictest	3103525	-21	kworker/u4:6+events_unbound	23:27:43	0
2955667	99	56	48,6	cyclictest	2955664	-21	cyclictest	23:43:36	0
2955668	99	55	42,10	cyclictest	37	-21	kcompactd0	22:47:48	1
2955667	99	55	44,8	cyclictest	37	-21	kcompactd0	00:00:35	0
2955668	99	54	47,5	cyclictest	3152228	-21	kworker/u4:10+events_unbound	00:23:23	1
2955668	99	54	46,6	cyclictest	3002053	-21	kworker/u4:12+events_unbound	21:35:04	1
2955668	99	54	45,6	cyclictest	2955664	-21	cyclictest	22:22:43	1
2955667	99	54	47,5	cyclictest	53	-21	kswapd0	21:35:01	0
2955667	99	54	34,5	cyclictest	0	-21	swapper/0	21:12:17	0
2955668	99	53	46,5	cyclictest	3079510	-21	fschecks_time	22:55:18	1
2955667	99	53	46,5	cyclictest	3160449	-21	sshd	00:26:32	0
2955667	99	53	45,6	cyclictest	3147734	-21	kworker/u4:0+events_unbound	00:13:23	0
2955667	99	53	45,6	cyclictest	3059536	-21	kworker/u4:5+events_unbound	22:32:34	0
2955667	99	53	44,6	cyclictest	2973608	-21	kworker/u4:5+events_unbound	20:42:11	0
2955668	99	52	44,6	cyclictest	2956897	-21	kworker/u4:5+events_unbound	19:11:55	1
2955668	99	52	43,6	cyclictest	0	-21	swapper/1	21:45:13	1
2955667	99	52	37,11	cyclictest	3110351	-21	ssh	23:30:21	0
2955668	99	51	45,4	cyclictest	3097130	-21	fschecks_time	23:15:20	1
2955668	99	51	40,8	cyclictest	3120062	-21	timerwakeupswit	23:40:43	1
2955668	99	51	40,8	cyclictest	3035514	-21	aten_r7power_en	22:05:16	1
2955667	99	51	44,5	cyclictest	3101224	-21	aten2__	23:20:15	0
2955667	99	51	39,7	cyclictest	3154135	-21	apt-get	00:20:14	0
2955668	99	50	44,4	cyclictest	2987825	-21	switchtime	21:10:40	1
2955668	99	50	43,5	cyclictest	2971442	-21	sed	20:10:16	1
2955668	99	50	43,5	cyclictest	2971442	-21	sed	20:10:16	1
2955668	99	50	41,6	cyclictest	3111208	-21	unixbench-2d	23:30:40	1
2955667	99	50	40,6	cyclictest	0	-21	swapper/0	21:35:16	0
2955667	99	50	39,7	cyclictest	3138808	-21	kworker/u4:8-rpciod	00:05:23	0
2955667	99	50	32,16	cyclictest	2995424	-21	latency_hist	21:20:01	0
2955668	99	49	42,5	cyclictest	3027706	-21	ssh	21:55:38	1
2955668	99	49	41,5	cyclictest	3163882	-21	ld	00:30:36	1
2955668	99	49	41,5	cyclictest	3128963	-21	unixbench_singl	23:50:39	1
2955668	99	49	39,7	cyclictest	3109683	-21	sh	23:30:00	1
2955668	99	49	37,9	cyclictest	3068575	-21	sh	22:42:33	1
2955667	99	49	40,7	cyclictest	3049220	-21	/usr/sbin/munin	22:20:23	0
2955668	99	48	42,4	cyclictest	2977435	-21	systemd	20:32:09	1
2955668	99	48	41,5	cyclictest	3040606	-21	/usr/sbin/munin	22:10:31	1
2955668	99	48	41,5	cyclictest	2982580	-21	sh	20:55:00	1
2955668	99	48	39,7	cyclictest	0	-21	swapper/1	23:00:42	1
2955668	99	48	36,9	cyclictest	2980062	-21	grep	20:45:01	1
2955667	99	48	41,5	cyclictest	3036656	-21	ssh	22:05:40	0
2955667	99	48	39,6	cyclictest	2965487	-21	grep	19:45:34	0
2955667	99	48	37,9	cyclictest	2985553	-21	fschecks_count	21:05:19	0
2955667	99	48	37,9	cyclictest	2985553	-21	fschecks_count	21:05:19	0
2955668	99	47	41,4	cyclictest	2996069	-21	fschecks_time	21:20:20	1
2955668	99	47	40,5	cyclictest	3017518	-21	cron	21:45:00	1
2955668	99	47	39,6	cyclictest	3167984	-21	kernelversion	00:35:24	1
2955668	99	47	39,6	cyclictest	2957448	-21	fschecks_time	19:15:19	1
2955668	99	47	39,6	cyclictest	2957448	-21	fschecks_time	19:15:19	1
2955668	99	47	37,8	cyclictest	2991475	-21	/usr/sbin/munin	21:15:20	1
2955668	99	47	36,9	cyclictest	3023301	-21	sendmail_mailqu	21:50:43	1
2955667	99	47	41,4	cyclictest	3123271	-21	aten2__	23:45:14	0
2955667	99	47	40,5	cyclictest	3171507	-21	cron	00:40:00	0
2955667	99	47	38,7	cyclictest	3150066	-21	fschecks_count	00:15:21	0
2955667	99	47	38,6	cyclictest	3115253	-21	grep	23:35:35	0
2955667	99	47	37,8	cyclictest	3088131	-21	df_abs	23:05:17	0
2955667	99	47	37,8	cyclictest	3066507	-21	gltestperf	22:40:19	0
2955667	99	47	29,15	cyclictest	0	-21	swapper/0	23:10:27	0
2955667	99	47	25,20	cyclictest	2984283	-21	fschecks_count	21:00:19	0
2955668	99	46	39,5	cyclictest	2975313	-21	sed	20:25:16	1
2955668	99	46	38,5	cyclictest	2954404	-21	kworker/u4:7+events_unbound	19:10:01	1
2955668	99	46	34,8	cyclictest	0	-21	swapper/1	20:17:06	1
2955667	99	46	40,4	cyclictest	3024602	-21	kworker/u4:5+events_unbound	21:55:02	0
2955667	99	46	37,5	cyclictest	0	-21	swapper/0	22:35:15	0
2955667	99	46	36,8	cyclictest	2977494	-21	latency_hist	20:35:01	0
2955668	99	45	38,5	cyclictest	3031132	-21	aten_r7power_en	22:00:16	1
2955668	99	45	37,6	cyclictest	3156726	-21	kworker/u4:14+events_unbound	00:26:19	1
2955668	99	45	37,6	cyclictest	2962018	-21	kworker/u4:8+events_unbound	20:07:05	1
2955668	99	45	35,8	cyclictest	3149991	-21	df_abs	00:15:19	1
2955668	99	45	35,7	cyclictest	2959487	-21	kworker/u4:2+events_unbound	19:26:58	1
2955667	99	45	38,5	cyclictest	2962565	-21	fschecks_time	19:35:20	0
2955667	99	45	38,5	cyclictest	2957310	-21	df_abs	19:15:16	0
2955667	99	45	38,5	cyclictest	2957310	-21	df_abs	19:15:16	0
2955667	99	45	36,7	cyclictest	3096879	-21	aten_r7power_vo	23:15:16	0
2955667	99	45	36,7	cyclictest	2982959	-21	df_abs	20:55:16	0
2955667	99	45	36,7	cyclictest	2976172	-21	kworker/u4:1+events_unbound	20:37:11	0
2955667	99	45	35,8	cyclictest	2969081	-21	gltestperf	20:00:18	0
2955668	99	44	38,4	cyclictest	3062914	-21	unixbench_multi	22:35:40	1
2955668	99	44	37,4	cyclictest	0	-21	swapper/1	00:00:28	1
2955668	99	44	34,7	cyclictest	0	-21	swapper/1	20:40:00	1
2955667	99	44	38,4	cyclictest	0	-21	swapper/0	00:30:35	0
2955667	99	44	36,6	cyclictest	2970308	-21	cut	20:05:20	0
2955667	99	44	36,5	cyclictest	2962078	-21	latency_hist	19:35:01	0
2955667	99	44	36,5	cyclictest	2962078	-21	latency_hist	19:35:01	0
2955667	99	44	35,7	cyclictest	2971332	-21	aten_r7power_en	20:10:15	0
2955667	99	44	35,7	cyclictest	2971332	-21	aten_r7power_en	20:10:15	0
2955668	99	43	36,5	cyclictest	3059788	-21	sshd	22:32:32	1
2955668	99	43	34,7	cyclictest	3090504	-21	systemd	23:07:39	1
2955668	99	43	33,8	cyclictest	2980260	-21	aten_r7power_cu	20:45:17	1
2955668	99	43	32,9	cyclictest	3000446	-21	fschecks_count	21:25:20	1
2955667	99	43	36,5	cyclictest	3031149	-21	ssh	22:00:16	0
2955667	99	43	36,5	cyclictest	2963872	-21	tr	19:40:19	0
2955667	99	43	32,8	cyclictest	2976085	-21	unixbench_multi	20:25:37	0
2955667	99	43	31,9	cyclictest	2960537	-21	sort	19:25:37	0
2955668	99	42	36,4	cyclictest	3068426	-21	kworker/u4:0-rpciod	22:50:19	1
2955668	99	42	28,10	cyclictest	2969538	-21	sort	20:00:35	1
2955667	99	42	35,5	cyclictest	2996974	-21	unixbench_singl	21:20:40	0
2955667	99	42	34,5	cyclictest	2967739	-21	fschecks_time	19:55:24	0
2955667	99	42	31,9	cyclictest	2955937	-21	aten_r7power_po	19:10:17	0
2955668	99	41	34,5	cyclictest	2956907	-21	kworker/u4:6-xprtiod	19:45:16	1
2955668	99	41	33,6	cyclictest	2986400	-21	cron	21:10:00	1
2955668	99	41	33,6	cyclictest	2986400	-21	cron	21:10:00	1
2955668	99	41	30,9	cyclictest	3052929	-21	/usr/sbin/munin	22:25:17	1
2955668	99	41	30,8	cyclictest	3141395	-21	tail	00:05:23	1
2955667	99	41	34,5	cyclictest	2981801	-21	fschecks_time	20:50:20	0
2955667	99	41	33,5	cyclictest	2973670	-21	sendmail	20:20:00	0
2955668	99	40	32,5	cyclictest	2962252	-21	aten_r7power_cu	19:35:16	1
2955668	99	40	29,8	cyclictest	0	-21	swapper/1	19:40:18	1
2955667	99	40	34,4	cyclictest	2958735	-21	fschecks_time	19:20:19	0
2955668	99	39	30,5	cyclictest	0	-21	swapper/1	19:50:19	1
2955668	99	39	30,5	cyclictest	0	-21	swapper/1	19:50:19	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17