OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Tue Sep 08, 2026 00:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3742987	99	93	86,5	cyclictest	3889357	-21	kworker/u4:4+events_unbound	23:18:25	1
3742987	99	90	84,5	cyclictest	3766103	-21	kworker/u4:16+events_unbound	20:53:04	1
3742987	99	90	83,5	cyclictest	3758443	-21	kworker/u4:3+events_unbound	20:33:00	1
3742987	99	90	83,5	cyclictest	3755872	-21	kworker/u4:11+events_unbound	20:48:03	1
3742987	99	88	82,4	cyclictest	3740480	-21	kworker/u4:4+events_unbound	19:57:53	1
3742987	99	88	82,4	cyclictest	3731850	-21	kworker/u4:2+events_unbound	19:37:51	1
3742987	99	88	81,5	cyclictest	3758443	-21	kworker/u4:3+events_unbound	21:03:04	1
3742987	99	88	81,5	cyclictest	3757171	-21	kworker/u4:14+events_unbound	20:02:54	1
3742987	99	85	79,5	cyclictest	3773858	-21	kworker/u4:2+events_unbound	21:08:06	1
3742986	99	81	76,3	cyclictest	3808212	-21	kworker/u4:2+events_unbound	22:03:15	0
3742986	99	76	2,65	cyclictest	3742982	-21	cyclictest	19:10:00	0
3742986	99	74	55,8	cyclictest	3921222	-21	ssh	23:53:22	0
3742986	99	72	41,28	cyclictest	3895661	-21	sh	23:25:00	0
3742986	99	71	4,9	cyclictest	3852075	-21	ssh	22:35:41	0
3742986	99	71	4,62	cyclictest	3842783	-21	ssh	22:25:27	0
3742986	99	71	32,30	cyclictest	3828581	-21	aten_r7power_cu	22:10:18	0
3742987	99	70	3,53	cyclictest	3815664	-21	ssh	21:55:31	1
3742986	99	70	57,10	cyclictest	3810729	-21	fschecks_count	21:50:19	0
3742986	99	70	4,14	cyclictest	3815859	-21	ps	21:55:38	0
3742986	99	70	38,30	cyclictest	3771773	-21	cut	21:00:21	0
3742986	99	68	4,3	cyclictest	0	-21	swapper/0	23:55:37	0
3742986	99	67	2,4	cyclictest	3927003	-21	apt-get	00:00:15	0
3742986	99	67	1,18	cyclictest	3949213	-21	/usr/sbin/munin	00:25:16	0
3742986	99	66	54,9	cyclictest	0	-21	swapper/0	23:30:11	0
3742986	99	66	31,32	cyclictest	0	-21	swapper/0	19:20:15	0
3742986	99	65	4,53	cyclictest	3797736	-21	ntpq	21:35:38	0
3742986	99	65	34,27	cyclictest	0	-21	swapper/0	00:35:18	0
3742986	99	65	22,40	cyclictest	0	-21	swapper/0	20:45:35	0
3742987	99	64	59,3	cyclictest	0	-21	swapper/1	22:45:34	1
3742986	99	64	33,28	cyclictest	3954955	-21	unixbench-2d	00:30:46	0
3742986	99	64	32,30	cyclictest	3910169	-21	ntp_states	23:40:38	0
3742986	99	64	23,38	cyclictest	3755912	-21	sendmail	20:00:00	0
3742986	99	64	1,11	cyclictest	3846580	-21	apt-get	22:30:12	0
3742986	99	63	44,17	cyclictest	3742982	-21	cyclictest	23:28:26	0
3742986	99	63	31,30	cyclictest	3788080	-21	fschecks_count	21:25:18	0
3742986	99	63	2,11	cyclictest	3837521	-21	apt-get	22:20:12	0
3742986	99	63	19,38	cyclictest	3749546	-21	sort	19:35:01	0
3742986	99	63	1,13	cyclictest	3887273	-21	df_abs	23:15:18	0
3742986	99	62	35,24	cyclictest	3803623	-21	kworker/u4:5-rpciod	21:49:42	0
3742986	99	62	3,11	cyclictest	3860969	-21	ntpq	22:45:31	0
3742986	99	62	28,31	cyclictest	3878480	-21	fschecks_count	23:05:21	0
3742986	99	62	27,32	cyclictest	0	-21	swapper/0	20:20:24	0
3742986	99	62	2,6	cyclictest	3802154	-21	ntpq	21:40:31	0
3742986	99	62	24,34	cyclictest	0	-21	swapper/0	00:20:36	0
3742986	99	62	1,58	cyclictest	3747546	-21	ntpq	19:25:26	0
3742986	99	62	1,3	cyclictest	3873655	-21	apt-get	23:00:11	0
3742986	99	62	10,49	cyclictest	0	-21	swapper/0	00:15:22	0
3742986	99	61	8,49	cyclictest	3770038	-21	cron	20:55:00	0
3742986	99	61	6,38	cyclictest	3869222	-21	apt-get	22:55:19	0
3742986	99	61	37,21	cyclictest	3744730	-21	fschecks_time	19:15:19	0
3742986	99	61	34,22	cyclictest	0	-21	swapper/0	22:54:56	0
3742986	99	61	29,28	cyclictest	3770658	-21	tail	20:55:19	0
3742986	99	61	27,32	cyclictest	3779175	-21	gltestperf	21:15:21	0
3742986	99	61	26,32	cyclictest	0	-21	swapper/0	22:40:17	0
3742986	99	61	2,15	cyclictest	3750903	-21	apt-get	19:40:10	0
3742986	99	61	1,56	cyclictest	3784052	-21	ntpq	21:20:32	0
3742986	99	60	4,51	cyclictest	0	-21	swapper/0	19:45:42	0
3742986	99	60	4,49	cyclictest	3765580	-21	ntpq	20:35:25	0
3742986	99	60	4,49	cyclictest	3764969	-21	latency_hist	20:35:02	0
3742986	99	60	22,35	cyclictest	3760207	-21	fschecks_time	20:15:21	0
3742986	99	60	21,35	cyclictest	0	-21	swapper/0	23:10:37	0
3742986	99	60	21,35	cyclictest	0	-21	swapper/0	23:10:37	0
3742986	99	60	2,10	cyclictest	3823946	-21	apt-get	22:05:16	0
3742987	99	59	47,9	cyclictest	3773896	-21	diskmemload	22:22:11	1
3742986	99	59	2,7	cyclictest	3913697	-21	apt-get	23:45:13	0
3742986	99	59	25,28	cyclictest	0	-21	swapper/0	22:18:21	0
3742986	99	59	1,6	cyclictest	3905606	-21	ntpq	23:35:32	0
3742987	99	58	46,9	cyclictest	0	-21	swapper/1	22:10:33	1
3742987	99	58	3,43	cyclictest	3949925	-21	ssh	00:25:25	1
3742986	99	58	4,47	cyclictest	3931441	-21	ssh	00:05:10	0
3742986	99	58	3,7	cyclictest	3762489	-21	apt-get	20:25:11	0
3742986	99	58	3,6	cyclictest	3756736	-21	ntpq	20:00:31	0
3742986	99	58	3,50	cyclictest	3774926	-21	ntpq	21:10:27	0
3742986	99	58	3,16	cyclictest	3743838	-21	ps	19:10:37	0
3742986	99	58	19,35	cyclictest	3936215	-21	sh	00:10:22	0
3742987	99	57	50,6	cyclictest	3731850	-21	kworker/u4:2+events_unbound	19:40:03	1
3742986	99	57	30,23	cyclictest	0	-21	swapper/0	21:30:21	0
3742986	99	57	26,27	cyclictest	0	-21	swapper/0	20:05:39	0
3742986	99	57	12,42	cyclictest	3759381	-21	sendmail_mailqu	20:10:35	0
3742986	99	57	1,12	cyclictest	3753627	-21	aten_r7power_po	19:50:17	0
3742987	99	56	42,11	cyclictest	0	-21	swapper/1	21:15:31	1
3742986	99	56	3,46	cyclictest	3750163	-21	ntpq	19:35:25	0
3742987	99	55	48,4	cyclictest	0	-21	swapper/1	00:00:26	1
3742987	99	55	43,9	cyclictest	53	-21	kswapd0	00:10:22	1
3742987	99	55	23,8	cyclictest	53	-21	kswapd0	23:20:12	1
3742986	99	55	2,9	cyclictest	3766900	-21	ntpq	20:40:27	0
3742986	99	55	26,26	cyclictest	0	-21	swapper/0	21:05:23	0
3742987	99	54	48,4	cyclictest	3757168	-21	kworker/u4:9+events_unbound	20:05:04	1
3742987	99	54	43,6	cyclictest	0	-21	swapper/1	21:40:31	1
3742987	99	53	48,4	cyclictest	3731850	-21	kworker/u4:2+events_unbound	19:15:04	1
3742987	99	53	21,19	cyclictest	0	-21	swapper/1	22:25:27	1
3742987	99	52	41,9	cyclictest	3901582	-21	xargs	23:30:48	1
3742987	99	51	44,5	cyclictest	3789832	-21	kworker/u4:29+events_unbound	21:26:47	1
3742987	99	51	43,5	cyclictest	3792360	-21	apt-get	21:30:16	1
3742987	99	51	40,9	cyclictest	3746563	-21	timerandwakeup	19:20:36	1
3742987	99	50	44,5	cyclictest	3740480	-21	kworker/u4:4+events_unbound	19:25:02	1
3742987	99	50	43,5	cyclictest	3847475	-21	ld	22:30:35	1
3742987	99	50	41,6	cyclictest	3796875	-21	aten2__	21:35:17	1
3742987	99	49	43,4	cyclictest	3742982	-21	cyclictest	21:23:08	1
3742987	99	49	41,6	cyclictest	3929327	-21	kworker/u4:6+events_unbound	00:10:02	1
3742987	99	48	40,5	cyclictest	3833538	-21	/usr/sbin/munin	22:15:21	1
3742987	99	48	39,7	cyclictest	3918283	-21	aten_r7power_cu	23:50:21	1
3742987	99	48	39,6	cyclictest	3770961	-21	sendmail_mailqu	20:55:36	1
3742987	99	48	38,7	cyclictest	3765855	-21	switchtime	20:35:38	1
3742987	99	47	40,5	cyclictest	3856279	-21	/usr/sbin/munin	22:40:25	1
3742987	99	47	39,6	cyclictest	3958665	-21	if_eth0	00:35:22	1
3742987	99	47	39,5	cyclictest	3865145	-21	fschecks_time	22:50:24	1
3742987	99	47	39,5	cyclictest	0	-21	swapper/1	00:30:15	1
3742987	99	46	40,4	cyclictest	3854238	-21	sshd	22:38:24	1
3742987	99	46	39,5	cyclictest	3945286	-21	grep	00:20:21	1
3742987	99	46	39,5	cyclictest	3808215	-21	kworker/u4:4+events_unbound	21:53:12	1
3742987	99	46	38,5	cyclictest	3763404	-21	timerwakeupswit	20:25:37	1
3742987	99	46	35,8	cyclictest	3926797	-21	latency_hist	00:00:00	1
3742987	99	46	35,8	cyclictest	3875790	-21	ssh	23:01:53	1
3742987	99	46	32,6	cyclictest	3907409	-21	kworker/u4:3+events_unbound	23:48:31	1
3742987	99	46	14,5	cyclictest	27	1	ktimers/1	23:25:12	1
3742987	99	45	39,4	cyclictest	3940807	-21	gltestperf	00:15:20	1
3742987	99	45	37,5	cyclictest	3882258	-21	cron	23:10:00	1
3742987	99	45	35,7	cyclictest	3775048	-21	diskmemload	21:10:34	1
3742987	99	44	38,5	cyclictest	3748054	-21	kworker/u4:10+events_unbound	19:30:57	1
3742987	99	44	37,5	cyclictest	3883193	-21	/usr/sbin/munin	23:10:27	1
3742987	99	44	37,5	cyclictest	3883193	-21	/usr/sbin/munin	23:10:26	1
3742987	99	44	37,5	cyclictest	3767151	-21	switchtime	20:40:40	1
3742987	99	44	37,5	cyclictest	3733129	-21	kworker/u4:13+events_unbound	19:11:16	1
3742987	99	43	37,4	cyclictest	3904916	-21	aten_r7power_cu	23:35:19	1
3742987	99	43	37,4	cyclictest	3741712	-21	kworker/u4:6+events_unbound	19:48:25	1
3742987	99	43	36,5	cyclictest	3819788	-21	fschecks_time	22:00:17	1
3742987	99	42	35,5	cyclictest	3824264	-21	fschecks_count	22:05:20	1
3742987	99	42	34,6	cyclictest	3869420	-21	aten_r7power_vo	22:55:22	1
3742987	99	42	33,7	cyclictest	3806289	-21	fschecks_time	21:45:20	1
3742987	99	41	33,5	cyclictest	3909933	-21	ldconfig	23:40:25	1
3742987	99	40	34,5	cyclictest	3757169	-21	kworker/u4:12+events_unbound	20:13:17	1
3742987	99	40	32,5	cyclictest	3743068	-21	latency_hist	19:10:02	1
3742987	99	39	34,4	cyclictest	3753330	-21	kworker/u4:0+events_unbound	19:50:43	1
3742987	99	37	31,5	cyclictest	3760980	-21	kworker/u4:6+events_unbound	20:23:55	1
3742987	99	37	29,6	cyclictest	3759966	-21	aten_r7power_cu	20:15:16	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17