OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Thu Sep 18, 2025 00:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3154839	99	83	75,6	cyclictest	3251204	-21	kworker/u4:3+events_unbound	22:32:26	1
3154839	99	77	69,6	cyclictest	3195069	-21	kworker/u4:9+events_unbound	21:37:16	1
3154838	99	77	67,7	cyclictest	3238904	-21	kworker/u4:6+events_unbound	22:27:25	0
3154839	99	76	55,12	cyclictest	3172908	-21	apt-get	20:20:09	1
3154838	99	71	61,7	cyclictest	3211411	-21	kworker/u4:3+events_unbound	21:52:18	0
3154838	99	71	48,20	cyclictest	3226921	-21	systemd	22:02:20	0
3154838	99	70	19,27	cyclictest	3221015	-21	gltestperf	21:55:18	0
3154839	99	68	58,7	cyclictest	3157367	-21	kworker/u4:7+events_unbound	20:07:01	1
3154839	99	65	57,6	cyclictest	3229621	-21	ssh	22:05:36	1
3154838	99	65	20,25	cyclictest	3194480	-21	users	21:20:40	0
3154838	99	64	34,19	cyclictest	3167421	-21	cat	19:55:35	0
3154839	99	63	54,7	cyclictest	3319459	-21	kworker/u4:4+events_unbound	00:17:35	1
3154838	99	63	40,18	cyclictest	3330544	-21	apt-get	00:15:15	0
3154838	99	63	32,27	cyclictest	3302159	-21	ntpq	23:35:29	0
3154839	99	62	54,6	cyclictest	3267171	-21	kworker/u4:4+events_unbound	23:32:37	1
3154838	99	62	50,8	cyclictest	37	-21	kcompactd0	23:16:38	0
3154838	99	62	50,8	cyclictest	37	-21	kcompactd0	23:16:38	0
3154838	99	61	41,10	cyclictest	3298199	-21	ssh	23:30:31	0
3154838	99	60	43,11	cyclictest	3233617	-21	ssh	22:10:31	0
3154838	99	60	40,15	cyclictest	3269352	-21	apt-get	22:55:15	0
3154838	99	60	39,16	cyclictest	3321759	-21	ssh	00:00:22	0
3154838	99	60	39,16	cyclictest	3321759	-21	ssh	00:00:22	0
3154838	99	60	39,16	cyclictest	3309459	-21	apt-get	23:45:12	0
3154838	99	60	30,27	cyclictest	3155526	-21	ntpq	19:10:26	0
3154838	99	60	27,28	cyclictest	3313802	-21	grep	23:50:19	0
3154838	99	60	26,12	cyclictest	0	-21	swapper/0	23:10:39	0
3154838	99	60	26,12	cyclictest	0	-21	swapper/0	23:10:38	0
3154839	99	59	51,6	cyclictest	3287624	-21	kworker/u4:2+events_unbound	23:17:35	1
3154839	99	59	51,6	cyclictest	3287624	-21	kworker/u4:2+events_unbound	23:17:35	1
3154838	99	59	51,6	cyclictest	3247143	-21	kworker/u4:10+events_unbound	22:37:28	0
3154838	99	59	46,9	cyclictest	0	-21	swapper/0	23:55:38	0
3154838	99	59	44,11	cyclictest	3162726	-21	apt-get	19:40:12	0
3154838	99	59	41,13	cyclictest	3257118	-21	apt-get	22:40:13	0
3154838	99	59	40,14	cyclictest	3237635	-21	ssh	22:15:28	0
3154838	99	59	38,16	cyclictest	3241583	-21	ssh	22:20:25	0
3154839	99	58	46,9	cyclictest	3343280	-21	ssh	00:35:15	1
3154838	99	58	50,6	cyclictest	3291157	-21	kworker/u4:6+events_unbound	23:27:38	0
3154838	99	58	45,7	cyclictest	3228764	-21	apt-get	22:05:18	0
3154838	99	58	42,12	cyclictest	3185016	-21	ssh	21:10:10	0
3154838	99	58	37,14	cyclictest	3202057	-21	ssh	21:30:35	0
3154838	99	58	34,20	cyclictest	3189911	-21	ntpq	21:15:32	0
3154838	99	58	30,10	cyclictest	3340163	-21	apt-get	00:30:15	0
3154838	99	58	30,10	cyclictest	3274751	-21	ssh	23:00:42	0
3154838	99	57	37,14	cyclictest	3214053	-21	ssh	21:45:24	0
3154839	99	56	47,7	cyclictest	314	-21	systemd-journal	00:12:33	1
3154839	99	56	47,6	cyclictest	3237508	-21	/usr/sbin/munin	22:15:22	1
3154838	99	56	49,5	cyclictest	3327605	-21	gltestperf	00:10:25	0
3154838	99	56	48,6	cyclictest	3279711	-21	ssh	23:07:13	0
3154838	99	56	39,12	cyclictest	3157586	-21	apt-get	19:20:12	0
3154838	99	56	39,11	cyclictest	3325217	-21	ntpq	00:05:40	0
3154838	99	56	37,15	cyclictest	3170503	-21	apt-get	20:10:13	0
3154839	99	55	47,5	cyclictest	0	-21	swapper/1	22:10:27	1
3154839	99	55	46,6	cyclictest	3222938	-21	kworker/u4:4+events_unbound	22:02:21	1
3154838	99	55	40,12	cyclictest	3169891	-21	ntpq	20:05:35	0
3154838	99	55	39,11	cyclictest	3261930	-21	ntpq	22:45:29	0
3154838	99	55	37,12	cyclictest	3265938	-21	ntpq	22:50:26	0
3154838	99	55	26,18	cyclictest	3249156	-21	aten_r7power_en	22:30:17	0
3154838	99	54	46,6	cyclictest	3333964	-21	/usr/sbin/munin	00:20:19	0
3154838	99	54	44,7	cyclictest	3344948	-21	kworker/u4:16+events_unbound	00:38:49	0
3154838	99	54	42,9	cyclictest	3197217	-21	apt-get	21:25:12	0
3154838	99	54	37,12	cyclictest	3180866	-21	apt-get	20:50:16	0
3154838	99	54	37,12	cyclictest	3175735	-21	apt-get	20:30:10	0
3154838	99	54	36,13	cyclictest	3305515	-21	apt-get	23:40:17	0
3154838	99	54	32,20	cyclictest	3165633	-21	fschecks_count	19:50:24	0
3154838	99	54	28,9	cyclictest	3290166	-21	ntpq	23:20:27	0
3154838	99	54	26,11	cyclictest	3159565	-21	wc	19:25:32	0
3154839	99	53	46,5	cyclictest	3305237	-21	sendmail	23:39:59	1
3154839	99	53	43,7	cyclictest	3335852	-21	kworker/u4:10+events_unbound	00:23:48	1
3154839	99	53	40,9	cyclictest	37	-21	kcompactd0	22:20:19	1
3154839	99	53	31,11	cyclictest	3257782	-21	ssh	22:40:26	1
3154839	99	53	29,16	cyclictest	3202045	-21	ntpq	21:30:34	1
3154838	99	53	44,7	cyclictest	379	-21	dbus-daemon	20:42:06	0
3154838	99	53	39,11	cyclictest	3183447	-21	apt-get	21:00:13	0
3154838	99	53	37,12	cyclictest	3160145	-21	apt-get	19:30:14	0
3154838	99	53	37,10	cyclictest	3209957	-21	ntpq	21:40:26	0
3154838	99	53	37,10	cyclictest	3156872	-21	ntpq	19:15:32	0
3154838	99	53	35,8	cyclictest	3337856	-21	ntpq	00:25:34	0
3154838	99	53	29,8	cyclictest	3172324	-21	ntpq	20:15:24	0
3154839	99	52	38,10	cyclictest	3324408	-21	ssh	00:05:18	1
3154839	99	52	34,11	cyclictest	3261897	-21	ssh	22:45:27	1
3154838	99	52	33,17	cyclictest	3184766	-21	munin-run	21:10:00	0
3154838	99	52	26,9	cyclictest	3180223	-21	ntpq	20:45:30	0
3154838	99	52	25,10	cyclictest	3206078	-21	ntp_states	21:35:38	0
3154839	99	51	45,4	cyclictest	3165073	-21	systemd	19:46:54	1
3154839	99	51	42,6	cyclictest	3253497	-21	/usr/sbin/munin	22:35:22	1
3154839	99	51	41,8	cyclictest	3305770	-21	df_abs	23:40:19	1
3154839	99	51	41,7	cyclictest	3193282	-21	aten_r7power_en	21:20:16	1
3154839	99	51	41,7	cyclictest	3163830	-21	modprobe	19:45:01	1
3154839	99	51	33,14	cyclictest	3309492	-21	ssh	23:45:17	1
3154838	99	51	32,15	cyclictest	3177616	-21	ntpq	20:35:29	0
3154838	99	51	31,14	cyclictest	3174462	-21	apt-get	20:25:15	0
3154838	99	51	28,16	cyclictest	3169062	-21	latency_hist	20:05:00	0
3154838	99	51	25,10	cyclictest	3161645	-21	df_inode	19:35:17	0
3154839	99	50	43,5	cyclictest	3172488	-21	uname	20:15:36	1
3154839	99	50	43,5	cyclictest	3158411	-21	switchtime	19:20:36	1
3154839	99	50	40,7	cyclictest	3215617	-21	kworker/u4:5+events_unbound	21:55:02	1
3154839	99	50	35,12	cyclictest	0	-21	swapper/1	21:40:35	1
3154838	99	50	39,8	cyclictest	3173786	-21	ntpq	20:20:39	0
3154838	99	50	36,10	cyclictest	3182687	-21	ntpq	20:55:24	0
3154839	99	49	40,7	cyclictest	53	-21	kswapd0	00:25:18	1
3154839	99	49	37,9	cyclictest	3213807	-21	gltestperf	21:45:18	1
3154839	99	49	31,13	cyclictest	3321757	-21	ntpq	00:00:22	1
3154839	99	49	31,13	cyclictest	3321757	-21	ntpq	00:00:22	1
3154839	99	49	31,13	cyclictest	3313832	-21	ssh	23:50:20	1
3154839	99	49	31,13	cyclictest	3281545	-21	ssh	23:10:16	1
3154839	99	49	31,13	cyclictest	3281545	-21	ssh	23:10:16	1
3154839	99	49	31,12	cyclictest	3273487	-21	ssh	23:00:17	1
3154839	99	49	30,16	cyclictest	3290409	-21	ps	23:20:39	1
3154838	99	49	35,10	cyclictest	3164644	-21	ntpq	19:45:30	0
3154839	99	48	40,5	cyclictest	3179436	-21	basename	20:45:00	1
3154839	99	48	39,6	cyclictest	3245899	-21	ld	22:25:38	1
3154839	99	48	31,12	cyclictest	3189950	-21	ssh	21:15:34	1
3154839	99	48	31,10	cyclictest	3340913	-21	ntp_states	00:30:36	1
3154839	99	47	40,5	cyclictest	3321005	-21	latency_hist	00:00:02	1
3154839	99	47	40,5	cyclictest	3180708	-21	idleruntime-cro	20:50:00	1
3154839	99	47	33,10	cyclictest	3182746	-21	ntpq	20:55:28	1
3154839	99	47	31,12	cyclictest	3159505	-21	ntpq	19:25:28	1
3154839	99	47	31,11	cyclictest	3185010	-21	apt-get	21:10:10	1
3154839	99	47	31,11	cyclictest	17	1	rcu_preempt	20:05:00	1
3154839	99	46	39,5	cyclictest	3197728	-21	/usr/sbin/munin	21:25:24	1
3154839	99	46	38,6	cyclictest	3255269	-21	kworker/u4:0-rpciod	22:50:30	1
3154839	99	46	36,8	cyclictest	3281238	-21	cron	23:10:00	1
3154839	99	46	35,8	cyclictest	3181252	-21	gltestperf	20:50:24	1
3154839	99	46	32,11	cyclictest	3269365	-21	ssh	22:55:15	1
3154839	99	46	26,15	cyclictest	3221359	-21	ssh	21:55:29	1
3154839	99	45	38,5	cyclictest	3166986	-21	fschecks_time	19:55:19	1
3154839	99	45	31,8	cyclictest	3293497	-21	ssh	23:25:15	1
3154839	99	45	28,11	cyclictest	3156822	-21	ntpq	19:15:28	1
3154839	99	44	38,4	cyclictest	0	-21	swapper/1	19:31:48	1
3154838	99	44	30,10	cyclictest	3154848	-21	latency_hist	19:10:01	0
3154839	99	43	37,4	cyclictest	3175763	-21	aten2__	20:30:15	1
3154839	99	43	34,7	cyclictest	3177437	-21	gltestperf	20:35:19	1
3154839	99	42	34,5	cyclictest	0	-21	swapper/1	19:50:43	1
3154839	99	42	27,11	cyclictest	3171082	-21	ntpq	20:10:28	1
3154839	99	41	33,6	cyclictest	3175398	-21	sed	20:25:41	1
3154839	99	41	28,10	cyclictest	3184095	-21	ntpq	21:00:36	1
3154839	99	41	21,13	cyclictest	3161970	-21	grep	19:35:24	1
3154839	99	39	30,6	cyclictest	3154775	-21	kworker/u4:4-rpciod	19:10:40	1
3154839	99	39	19,13	cyclictest	3184901	-21	latency_hist	21:10:01	1
3154839	99	38	29,6	cyclictest	3154872	-21	cat	19:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17