OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Sun Apr 12, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2973705	99	103	94,6	cyclictest	3094468	-21	kworker/u4:12+events_unbound	10:55:03	0
2973705	99	99	90,7	cyclictest	3000567	-21	kworker/u4:1+events_unbound	09:59:54	0
2973705	99	94	78,6	cyclictest	3024394	-21	kworker/u4:2+events_unbound	09:34:47	0
2973706	99	91	64,8	cyclictest	3124779	-21	kworker/u4:2+events_unbound	11:50:22	1
2973705	99	91	84,5	cyclictest	2991610	-21	kworker/u4:12+events_unbound	09:44:49	0
2973706	99	85	66,7	cyclictest	3133638	-21	kworker/u4:10+events_unbound	12:00:25	1
2973706	99	81	73,6	cyclictest	3076186	-21	kworker/u4:8+events_unbound	10:35:01	1
2973706	99	81	59,8	cyclictest	3129215	-21	kworker/u4:8+events_unbound	11:35:17	1
2973705	99	81	67,12	cyclictest	3129213	-21	kworker/u4:5+events_unbound	11:40:21	0
2973705	99	80	69,9	cyclictest	3090054	-21	kworker/u4:8+events_unbound	11:05:07	0
2973705	99	79	58,12	cyclictest	53	-21	kswapd0	11:20:07	0
2973705	99	76	63,5	cyclictest	3028771	-21	kworker/u4:10+events_unbound	10:19:57	0
2973706	99	75	56,6	cyclictest	2977506	-21	kworker/u4:10+events_unbound	09:05:00	1
2973706	99	74	64,7	cyclictest	3098885	-21	kworker/u4:15+events_unbound	11:00:07	1
2973705	99	74	67,5	cyclictest	2974927	-21	kworker/u4:8+events_unbound	08:14:30	0
2973706	99	72	67,3	cyclictest	3090054	-21	kworker/u4:8+events_unbound	11:15:09	1
2973706	99	72	67,3	cyclictest	3090054	-21	kworker/u4:8+events_unbound	11:15:08	1
2973705	99	72	64,6	cyclictest	2991610	-21	kworker/u4:12+events_unbound	09:35:23	0
2973705	99	70	62,6	cyclictest	2968629	-21	kworker/u4:4+events_unbound	08:09:31	0
2973705	99	70	61,6	cyclictest	2972342	-21	kworker/u4:1+events_unbound	07:34:24	0
2973705	99	70	61,6	cyclictest	2968627	-21	kworker/u4:2+events_unbound	07:25:01	0
2973706	99	69	52,8	cyclictest	3000563	-21	kworker/u4:0+events_unbound	09:10:04	1
2973706	99	68	61,5	cyclictest	3000563	-21	kworker/u4:0+events_unbound	09:10:01	1
2973706	99	67	49,6	cyclictest	3042023	-21	kworker/u4:5+events_unbound	09:54:52	1
2973705	99	67	47,13	cyclictest	2994220	-21	kworker/u4:14	08:30:00	0
2973705	99	66	61,3	cyclictest	2991610	-21	kworker/u4:12+events_unbound	08:54:38	0
2973706	99	65	58,5	cyclictest	3098240	-21	kworker/u4:13+events_unbound	11:30:17	1
2973705	99	65	57,6	cyclictest	3081249	-21	kworker/u4:4+events_unbound	11:10:09	0
2973705	99	65	57,5	cyclictest	3037649	-21	kworker/u4:3+events_unbound	09:49:57	0
2973705	99	65	47,6	cyclictest	3046452	-21	kworker/u4:6+events_unbound	10:05:20	0
2973706	99	64	57,5	cyclictest	3076186	-21	kworker/u4:8+events_unbound	10:39:59	1
2973706	99	63	55,5	cyclictest	2968629	-21	kworker/u4:4+events_unbound	07:15:02	1
2973705	99	63	55,6	cyclictest	3067981	-21	kworker/u4:0+events_unbound	10:24:58	0
2973705	99	63	54,7	cyclictest	2991610	-21	kworker/u4:12+events_unbound	09:55:01	0
2973705	99	63	43,6	cyclictest	3164003	-21	kworker/u4:1+events_unbound	12:36:01	0
2973706	99	62	54,6	cyclictest	2992923	-21	kworker/u4:21+events_unbound	08:29:35	1
2973705	99	62	54,5	cyclictest	2973703	-21	cyclictest	10:49:07	0
2973705	99	62	52,8	cyclictest	53	-21	kswapd0	11:00:06	0
2973706	99	61	51,6	cyclictest	2973633	-21	kworker/u4:6-rpciod	08:15:07	1
2973705	99	60	53,5	cyclictest	3167792	-21	kworker/u4:6+xprtiod	12:25:11	0
2973705	99	60	52,6	cyclictest	2759920	-21	kworker/u4:5+events_unbound	08:34:34	0
2973705	99	60	51,7	cyclictest	53	-21	kswapd0	11:55:11	0
2973705	99	60	42,6	cyclictest	2991610	-21	kworker/u4:12+events_unbound	09:18:59	0
2973705	99	59	51,6	cyclictest	2983882	-21	kworker/u4:16+events_unbound	08:24:34	0
2973706	99	58	50,6	cyclictest	3046452	-21	kworker/u4:6+events_unbound	10:04:55	1
2973706	99	58	40,5	cyclictest	3016148	-21	kworker/u4:2+events_unbound	09:24:44	1
2973705	99	58	43,12	cyclictest	0	-21	swapper/0	11:45:29	0
2973705	99	58	39,16	cyclictest	3127034	-21	/usr/sbin/munin	11:30:14	0
2973705	99	57	46,7	cyclictest	3004535	-21	apt-get	09:10:05	0
2973705	99	57	44,9	cyclictest	3081251	-21	kworker/u4:7+events_unbound	10:40:34	0
2973706	99	56	48,6	cyclictest	2972342	-21	kworker/u4:1+events_unbound	07:10:02	1
2973705	99	56	36,17	cyclictest	0	-21	swapper/0	11:15:32	0
2973705	99	56	36,17	cyclictest	0	-21	swapper/0	11:15:32	0
2973706	99	55	7,39	cyclictest	3018661	-21	ssh	09:25:26	1
2973706	99	54	46,6	cyclictest	0	-21	swapper/1	12:15:14	1
2973706	99	54	45,6	cyclictest	3109065	-21	ssh	11:10:00	1
2973706	99	54	44,6	cyclictest	3024394	-21	kworker/u4:2+events_unbound	09:45:03	1
2973705	99	54	46,5	cyclictest	3129214	-21	kworker/u4:7+xprtiod	12:00:14	0
2973706	99	53	45,5	cyclictest	3092922	-21	proc_pri	10:50:36	1
2973706	99	53	44,7	cyclictest	2995471	-21	systemd	08:34:33	1
2973706	99	53	43,6	cyclictest	3136190	-21	ntpq	11:40:25	1
2973705	99	53	47,4	cyclictest	3133638	-21	kworker/u4:10+events_unbound	11:38:41	0
2973705	99	53	45,6	cyclictest	2962401	-21	kworker/u4:9+events_unbound	07:14:21	0
2973705	99	53	35,15	cyclictest	0	-21	swapper/0	08:15:12	0
2973706	99	52	45,5	cyclictest	2985151	-21	kworker/u4:17+events_unbound	08:39:35	1
2973706	99	52	44,6	cyclictest	3085673	-21	kworker/u4:15+events_unbound	10:45:11	1
2973706	99	52	44,6	cyclictest	3050920	-21	kworker/u4:11+events_unbound	10:14:56	1
2973706	99	52	44,5	cyclictest	2983882	-21	kworker/u4:16+events_unbound	08:25:00	1
2973706	99	52	39,10	cyclictest	3126510	-21	idleruntime-cro	11:30:01	1
2973705	99	52	46,3	cyclictest	0	-21	swapper/0	10:30:10	0
2973705	99	52	41,6	cyclictest	256	50	irq/23-42890000.ethernet	09:10:01	0
2973705	99	52	30,19	cyclictest	0	-21	swapper/0	12:30:26	0
2973706	99	51	43,5	cyclictest	3067981	-21	kworker/u4:0+events_unbound	10:22:59	1
2973706	99	51	43,5	cyclictest	3027037	-21	basename	09:35:20	1
2973706	99	51	36,11	cyclictest	3009335	-21	aten_r7power_en	09:15:16	1
2973705	99	51	41,6	cyclictest	3145305	-21	sh	11:50:38	0
2973705	99	51	29,19	cyclictest	0	-21	swapper/0	09:00:07	0
2973705	99	51	28,14	cyclictest	2982635	-21	modprobe	07:45:00	0
2973706	99	50	4,41	cyclictest	3149341	-21	ssh	11:55:33	1
2973706	99	50	40,7	cyclictest	3161948	-21	fschecks_count	12:10:18	1
2973705	99	50	43,5	cyclictest	3050920	-21	kworker/u4:11+events_unbound	10:14:00	0
2973705	99	50	42,5	cyclictest	3166097	-21	hostname	12:15:16	0
2973705	99	50	41,6	cyclictest	3001904	-21	basename	09:00:00	0
2973705	99	50	40,6	cyclictest	3076186	-21	kworker/u4:8-events_unbound	10:39:59	0
2973706	99	49	38,9	cyclictest	53	-21	kswapd0	11:20:06	1
2973705	99	49	42,5	cyclictest	3124779	-21	kworker/u4:2-rpciod	12:21:58	0
2973705	99	49	42,5	cyclictest	2992923	-21	kworker/u4:21+events_unbound	08:49:37	0
2973705	99	49	42,5	cyclictest	2759920	-21	kworker/u4:5+events_unbound	08:38:02	0
2973705	99	49	40,6	cyclictest	2978816	-21	idleruntime-cro	07:30:00	0
2973705	99	49	39,7	cyclictest	3123735	-21	unixbench_singl	11:25:38	0
2973705	99	49	39,7	cyclictest	3018214	-21	sed	09:25:16	0
2973705	99	49	37,7	cyclictest	3000563	-21	kworker/u4:0+events_unbound	09:21:59	0
2973705	99	49	34,9	cyclictest	0	-21	swapper/0	10:25:27	0
2973706	99	48	42,4	cyclictest	2972342	-21	kworker/u4:1+events_unbound	07:50:00	1
2973706	99	48	40,6	cyclictest	2759920	-21	kworker/u4:5+events_unbound	07:29:24	1
2973706	99	48	40,5	cyclictest	3170607	-21	df_abs	12:20:16	1
2973706	99	48	38,7	cyclictest	3022665	-21	sh	09:30:18	1
2973706	99	48	36,10	cyclictest	3100528	-21	latency_hist	11:00:01	1
2973705	99	48	41,5	cyclictest	2977501	-21	kworker/u4:7+events_unbound	08:44:36	0
2973706	99	47	5,29	cyclictest	3110146	-21	ssh	11:10:29	1
2973706	99	47	41,4	cyclictest	3036475	-21	timerandwakeup	09:45:37	1
2973706	99	47	37,7	cyclictest	3172861	-21	kworker/u4:8+events_unbound	12:25:31	1
2973705	99	47	40,5	cyclictest	3092091	-21	aten_r7power_po	10:50:16	0
2973705	99	47	28,16	cyclictest	0	-21	swapper/0	10:00:32	0
2973706	99	46	39,5	cyclictest	53	-21	kswapd0	10:05:18	1
2973706	99	46	39,5	cyclictest	3062272	-21	/usr/sbin/munin	10:15:30	1
2973706	99	46	38,6	cyclictest	3087316	-21	sd-accept	10:45:00	1
2973706	99	46	36,7	cyclictest	3179622	-21	kernelversion	12:30:22	1
2973706	99	46	2,4	cyclictest	17	1	rcu_preempt	10:25:30	1
2973705	99	46	36,8	cyclictest	2975999	-21	timerandwakeup	07:15:36	0
2973705	99	46	35,8	cyclictest	2980045	-21	kworker/u4:14+events_unbound	07:49:26	0
2973705	99	46	31,6	cyclictest	3159565	-21	kworker/u4:4+events_unbound	12:10:43	0
2973706	99	45	38,5	cyclictest	2987388	-21	sendmail_mailqu	08:00:35	1
2973706	99	45	36,7	cyclictest	2997066	-21	aten_r7power_po	08:40:17	1
2973706	99	45	36,7	cyclictest	0	-21	swapper/1	12:05:25	1
2973705	99	45	38,5	cyclictest	2973703	-21	cyclictest	12:05:25	0
2973706	99	44	36,5	cyclictest	2977501	-21	kworker/u4:7+rpciod	08:10:20	1
2973706	99	44	35,7	cyclictest	3184691	-21	unixbench_singl	12:35:41	1
2973705	99	44	33,7	cyclictest	2986678	-21	tr	08:00:16	0
2973706	99	43	37,4	cyclictest	3139979	-21	aten_r7power_po	11:45:16	1
2973706	99	43	35,5	cyclictest	2976778	-21	fschecks_time	07:20:20	1
2973706	99	43	33,7	cyclictest	2998609	-21	gltestperf	08:45:20	1
2973706	99	43	25,7	cyclictest	2983881	-21	kworker/u4:15+events_unbound	07:50:23	1
2973705	99	43	33,6	cyclictest	2962403	-21	kworker/u4:12-rpciod	07:55:37	0
2973705	99	43	20,12	cyclictest	2985169	-21	modprobe	07:55:00	0
2973706	99	42	34,5	cyclictest	2981358	-21	ls	07:40:01	1
2973706	99	42	33,6	cyclictest	0	-21	swapper/1	08:50:30	1
2973706	99	41	34,5	cyclictest	2977500	-21	kworker/u4:0+events_unbound	07:35:01	1
2973706	99	41	33,5	cyclictest	2986422	-21	kworker/u4:18+events_unbound	08:00:00	1
2973706	99	41	31,7	cyclictest	0	-21	swapper/1	09:55:33	1
2973705	99	41	21,7	cyclictest	0	-21	swapper/0	07:40:00	0
2973706	99	40	33,4	cyclictest	0	-21	swapper/1	07:20:00	1
2973706	99	40	31,6	cyclictest	3001746	-21	unixbench_multi	08:55:39	1
2973706	99	39	30,7	cyclictest	2981957	-21	tail	07:40:20	1
2973706	99	37	26,7	cyclictest	0	-21	swapper/1	08:05:16	1
2973705	99	28	1,24	cyclictest	2973717	-21	ls	07:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17