OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Thu Sep 17, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3616577	99	127	93,31	cyclictest	53	-21	kswapd0	11:35:08	0
3616577	99	127	93,31	cyclictest	53	-21	kswapd0	11:35:07	0
3616579	99	104	83,8	cyclictest	3624277	-21	kworker/u4:0+events_unbound	07:40:22	1
3616579	99	92	83,6	cyclictest	3626852	-21	kworker/u4:1+events_unbound	08:20:46	1
3616579	99	91	83,5	cyclictest	3713544	-21	kworker/u4:10+events_unbound	10:36:08	1
3616579	99	90	80,8	cyclictest	3612866	-21	kworker/u4:3+events_unbound	07:20:17	1
3616579	99	89	81,6	cyclictest	3762164	-21	kworker/u4:6+events_unbound	11:31:14	1
3616579	99	84	63,5	cyclictest	3766711	-21	kworker/u4:0+events_unbound	11:26:14	1
3616579	99	81	72,6	cyclictest	3758316	-21	kworker/u4:4+events_unbound	11:16:13	1
3616579	99	81	70,8	cyclictest	3602387	-21	kworker/u4:7+events_unbound	07:45:25	1
3616579	99	80	73,5	cyclictest	3695198	-21	kworker/u4:11+events_unbound	10:06:07	1
3616579	99	79	70,7	cyclictest	3815613	-21	kworker/u4:0+events_unbound	12:26:22	1
3616577	99	78	71,5	cyclictest	3762165	-21	kworker/u4:7+events_unbound	11:21:13	0
3616579	99	76	60,8	cyclictest	3671158	-21	diskmemload	09:35:29	1
3616579	99	75	66,7	cyclictest	3615302	-21	kworker/u4:0+events_unbound	07:25:20	1
3616577	99	74	2,19	cyclictest	3683915	-21	apt-get	09:50:12	0
3616579	99	71	64,5	cyclictest	3663747	-21	kworker/u4:2+events_unbound	09:31:01	1
3616579	99	70	62,6	cyclictest	3647386	-21	kworker/u4:3+events_unbound	09:20:59	1
3616577	99	70	32,34	cyclictest	3616807	-21	aten_r7power_en	07:10:15	0
3616577	99	70	29,38	cyclictest	0	-21	swapper/0	08:00:35	0
3616579	99	69	57,8	cyclictest	3689168	-21	sh	09:55:29	1
3616577	99	69	34,32	cyclictest	3675943	-21	mailstats	09:40:39	0
3616577	99	69	29,37	cyclictest	256	50	irq/23-42890000.ethernet	12:00:21	0
3616577	99	69	22,6	cyclictest	0	-21	swapper/0	10:15:34	0
3616577	99	68	23,5	cyclictest	3688430	-21	ssh	09:55:12	0
3616577	99	67	56,9	cyclictest	3737717	-21	latency_hist	10:50:02	0
3616577	99	67	56,9	cyclictest	3737717	-21	latency_hist	10:50:01	0
3616577	99	67	35,28	cyclictest	3716590	-21	ssh	10:25:39	0
3616577	99	67	28,36	cyclictest	3621553	-21	timerwakeupswit	07:25:42	0
3616577	99	66	33,30	cyclictest	3831613	-21	fschecks_time	12:35:22	0
3616577	99	66	32,31	cyclictest	3641297	-21	aten_r7power_po	08:45:15	0
3616577	99	66	31,32	cyclictest	3626173	-21	gltestperf	07:45:19	0
3616577	99	66	28,35	cyclictest	0	-21	swapper/0	10:50:45	0
3616577	99	66	28,35	cyclictest	0	-21	swapper/0	10:50:45	0
3616577	99	65	34,27	cyclictest	0	-21	swapper/0	09:30:00	0
3616577	99	65	30,32	cyclictest	3693057	-21	cut	10:00:15	0
3616577	99	65	29,33	cyclictest	3645890	-21	timerandwakeup	09:00:38	0
3616577	99	65	28,34	cyclictest	0	-21	swapper/0	08:15:36	0
3616577	99	65	27,35	cyclictest	3747403	-21	kernelversion	11:00:22	0
3616577	99	65	26,36	cyclictest	0	-21	swapper/0	09:35:20	0
3616579	99	64	48,13	cyclictest	53	-21	kswapd0	12:00:09	1
3616577	99	64	4,16	cyclictest	3728747	-21	apt-get	10:40:11	0
3616577	99	64	4,16	cyclictest	3728747	-21	apt-get	10:40:10	0
3616577	99	64	3,24	cyclictest	3827511	-21	ssh	12:30:28	0
3616577	99	64	32,29	cyclictest	3822559	-21	sed	12:25:18	0
3616577	99	64	30,31	cyclictest	0	-21	swapper/0	09:20:37	0
3616577	99	64	29,32	cyclictest	3665899	-21	basename	09:30:14	0
3616577	99	64	29,32	cyclictest	0	-21	swapper/0	09:15:34	0
3616577	99	64	26,7	cyclictest	3629141	-21	systemd	07:55:36	0
3616577	99	64	2,27	cyclictest	3752138	-21	ntp_states	11:05:34	0
3616577	99	64	19,12	cyclictest	3697486	-21	apt-get	10:05:14	0
3616579	99	63	56,5	cyclictest	3815616	-21	kworker/u4:3+events_unbound	12:21:21	1
3616577	99	63	31,29	cyclictest	0	-21	swapper/0	11:20:00	0
3616577	99	63	30,30	cyclictest	3743060	-21	ntp_kernel_pll_	10:55:26	0
3616577	99	63	30,30	cyclictest	3743060	-21	ntp_kernel_pll_	10:55:25	0
3616577	99	63	28,31	cyclictest	0	-21	swapper/0	11:50:33	0
3616577	99	63	26,34	cyclictest	0	-21	swapper/0	10:10:27	0
3616577	99	63	26,33	cyclictest	0	-21	swapper/0	12:20:02	0
3616577	99	63	26,33	cyclictest	0	-21	swapper/0	12:20:01	0
3616577	99	63	25,5	cyclictest	3646575	-21	fschecks_count	09:05:21	0
3616577	99	63	20,7	cyclictest	3782395	-21	ssh	11:40:11	0
3616577	99	63	1,12	cyclictest	3787123	-21	/usr/sbin/munin	11:45:19	0
3616579	99	62	54,6	cyclictest	3758315	-21	kworker/u4:1+events_unbound	12:11:21	1
3616579	99	62	54,6	cyclictest	3667673	-21	kworker/u4:3+events_unbound	10:01:06	1
3616577	99	62	5,22	cyclictest	3648688	-21	ssh	09:10:37	0
3616577	99	62	31,20	cyclictest	3638382	-21	apt-get	08:35:09	0
3616577	99	62	27,32	cyclictest	0	-21	swapper/0	10:20:16	0
3616577	99	62	25,34	cyclictest	0	-21	swapper/0	08:25:19	0
3616577	99	62	20,39	cyclictest	3690582	-21	kworker/u4:5+rpciod	10:35:44	0
3616577	99	62	1,26	cyclictest	3680506	-21	/usr/sbin/munin	09:45:38	0
3616579	99	61	53,6	cyclictest	3811090	-21	kworker/u4:7+events_unbound	12:16:20	1
3616579	99	61	53,6	cyclictest	3811090	-21	kworker/u4:7+events_unbound	12:16:20	1
3616577	99	61	26,32	cyclictest	0	-21	swapper/0	12:20:31	0
3616577	99	61	26,32	cyclictest	0	-21	swapper/0	08:20:34	0
3616577	99	61	2,16	cyclictest	3796326	-21	ntpq	11:55:23	0
3616577	99	60	26,3	cyclictest	0	-21	swapper/0	10:30:34	0
3616577	99	60	26,31	cyclictest	0	-21	swapper/0	08:50:21	0
3616579	99	59	50,5	cyclictest	3682120	-21	kworker/u4:11+events_unbound	09:51:04	1
3616577	99	59	3,16	cyclictest	3624304	-21	modprobe	07:40:00	0
3616577	99	59	24,5	cyclictest	3625288	-21	cat	07:40:33	0
3616577	99	57	24,6	cyclictest	0	-21	swapper/0	11:10:37	0
3616577	99	57	23,6	cyclictest	3630985	-21	aten_r7power_po	08:05:15	0
3616577	99	57	2,12	cyclictest	3771758	-21	ssh	11:27:44	0
3616579	99	56	47,6	cyclictest	3787841	-21	mailstats	11:45:37	1
3616579	99	56	4,44	cyclictest	3827568	-21	ssh	12:30:31	1
3616577	99	56	34,19	cyclictest	3777764	-21	latency_hist	11:35:01	0
3616577	99	56	23,4	cyclictest	0	-21	swapper/0	08:35:00	0
3616577	99	56	21,6	cyclictest	0	-21	swapper/0	07:55:00	0
3616579	99	55	40,12	cyclictest	0	-21	swapper/1	10:25:11	1
3616579	99	55	39,13	cyclictest	53	-21	kswapd0	11:35:11	1
3616579	99	55	39,13	cyclictest	53	-21	kswapd0	11:35:10	1
3616577	99	55	49,4	cyclictest	0	-21	swapper/0	12:05:15	0
3616577	99	55	24,4	cyclictest	3758315	-21	kworker/u4:1-rpciod	12:10:40	0
3616579	99	54	44,4	cyclictest	0	-21	swapper/1	10:20:37	1
3616579	99	54	41,7	cyclictest	0	-21	swapper/1	10:40:21	1
3616579	99	54	41,7	cyclictest	0	-21	swapper/1	10:40:20	1
3616579	99	54	41,4	cyclictest	3744705	-21	kworker/u4:2+events_unbound	11:11:13	1
3616579	99	53	46,5	cyclictest	3659144	-21	kworker/u4:12+events_unbound	09:26:01	1
3616577	99	53	44,7	cyclictest	400	-21	systemd-logind	07:15:17	0
3616579	99	52	42,8	cyclictest	3690583	-21	kworker/u4:6+events_unbound	10:15:01	1
3616579	99	52	32,11	cyclictest	3683626	-21	modprobe	09:50:00	1
3616579	99	51	42,5	cyclictest	3746514	-21	cron	11:00:01	1
3616579	99	51	42,5	cyclictest	3746514	-21	cron	11:00:00	1
3616579	99	51	41,8	cyclictest	3786529	-21	latency_hist	11:45:01	1
3616579	99	50	38,9	cyclictest	3623006	-21	kworker/u4:4-rpciod	07:35:19	1
3616579	99	48	42,4	cyclictest	3805610	-21	switchtime	12:05:42	1
3616579	99	48	41,5	cyclictest	3706784	-21	df_abs	10:15:17	1
3616579	99	48	33,11	cyclictest	0	-21	swapper/1	11:05:38	1
3616579	99	48	12,25	cyclictest	3792042	-21	ssh	11:50:32	1
3616577	99	48	39,7	cyclictest	3622152	-21	sd-accept	07:30:18	0
3616579	99	47	40,5	cyclictest	3831176	-21	acpi	12:35:11	1
3616579	99	47	40,5	cyclictest	3799898	-21	ssh	12:00:01	1
3616579	99	47	40,5	cyclictest	3617469	-21	sendmail_mailqu	07:10:35	1
3616579	99	47	39,6	cyclictest	3656561	-21	latency_hist	09:20:00	1
3616579	99	47	37,7	cyclictest	3636033	-21	aten2__	08:25:14	1
3616579	99	47	37,6	cyclictest	0	-21	swapper/1	11:22:18	1
3616579	99	47	36,8	cyclictest	3679116	-21	modprobe	09:45:01	1
3616579	99	47	32,12	cyclictest	3739108	-21	timerandwakeup	10:50:46	1
3616579	99	47	32,12	cyclictest	3739108	-21	timerandwakeup	10:50:45	1
3616579	99	46	40,4	cyclictest	3647896	-21	aten_r7power_vo	09:10:17	1
3616579	99	46	39,5	cyclictest	3704365	-21	kworker/u4:1+events_unbound	10:31:09	1
3616579	99	46	31,11	cyclictest	3641023	-21	modprobe	08:45:01	1
3616579	99	45	38,5	cyclictest	3647518	-21	latency_hist	09:10:01	1
3616579	99	45	38,5	cyclictest	3622276	-21	fschecks_time	07:30:20	1
3616579	99	45	38,5	cyclictest	3616574	-21	cyclictest	10:46:10	1
3616579	99	45	38,5	cyclictest	3616574	-21	cyclictest	10:46:10	1
3616579	99	45	37,6	cyclictest	3744704	-21	kworker/u4:1+events_unbound	11:02:07	1
3616579	99	45	37,6	cyclictest	3619125	-21	munin-plugin-st	07:20:00	1
3616579	99	45	36,6	cyclictest	3628142	-21	cron	07:55:00	1
3616579	99	45	35,7	cyclictest	3644544	-21	switchtime	08:55:36	1
3616577	99	44	37,5	cyclictest	3633141	-21	unixbench_multi	08:10:39	0
3616579	99	43	37,4	cyclictest	3631397	-21	memory	08:05:21	1
3616579	99	43	35,5	cyclictest	3637303	-21	aten2__	08:30:14	1
3616579	99	43	33,7	cyclictest	3632511	-21	gltestperf	08:10:20	1
3616579	99	42	33,6	cyclictest	3642660	-21	sed	08:50:17	1
3616577	99	42	33,7	cyclictest	3643804	-21	aten_r7power_en	08:55:14	0
3616579	99	41	32,7	cyclictest	3629502	-21	latency_hist	08:00:01	1
3616579	99	41	32,6	cyclictest	0	-21	swapper/1	08:45:24	1
3616579	99	41	31,7	cyclictest	0	-21	swapper/1	09:00:19	1
3616577	99	41	32,6	cyclictest	0	-21	swapper/0	07:20:19	0
3616579	99	40	32,6	cyclictest	3639708	-21	kworker/u4:13+events_unbound	08:39:45	1
3616579	99	40	31,6	cyclictest	0	-21	swapper/1	08:00:13	1
3616577	99	40	31,6	cyclictest	3616574	-21	cyclictest	08:40:16	0
3616579	99	38	29,6	cyclictest	3634669	-21	latency_hist	08:20:02	1
3616579	99	37	27,6	cyclictest	3602386	-21	kworker/u4:2-rpciod	07:10:02	1
3616577	99	30	22,6	cyclictest	0	-21	swapper/0	07:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17