OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #d, slot #3

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackdslot3.osadl.org (updated Mon Jul 13, 2026 00:45:49)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1394	91	239	170,23	phc2sys	0	-21	swapper/3	19:09:49	3
5196	2	206	171,24	sleep0	0	-21	swapper/0	19:09:24	0
5193	2	206	173,22	sleep2	0	-21	swapper/2	19:09:22	2
3118	2	203	170,22	sleep1	0	-21	swapper/1	19:05:10	1
1394	91	89	69,10	phc2sys	0	-21	swapper/3	19:10:00	3
5536	99	57	7,7	cyclictest	4444	-21	tr	22:30:14	1
5535	99	57	27,8	cyclictest	9	-21	ksoftirqd/0	23:25:32	0
8220	2	56	0,1	sleep2	0	-21	swapper/2	19:15:14	2
5536	99	56	7,6	cyclictest	13132	-21	cpuspeed_turbos	23:55:13	1
5536	99	55	1,15	cyclictest	20156	-21	cat	00:10:00	1
5536	99	55	0,11	cyclictest	534	-21	sed	00:35:18	1
1393	91	55	0,1	ptp4l	40	1	ktimersoftd/3	00:05:59	3
5536	99	54	4,10	cyclictest	5844	-21	apt-key	23:40:01	1
5536	99	54	4,10	cyclictest	5844	-21	apt-key	23:40:01	1
5536	99	54	0,11	cyclictest	25493	-21	sed	23:10:29	1
5536	99	53	5,7	cyclictest	25216	-21	cpuspeed_turbos	00:20:14	1
5536	99	53	3,6	cyclictest	0	-21	swapper/1	20:30:19	1
5536	99	53	0,10	cyclictest	17568	-21	phc2sys	22:55:23	1
1393	91	53	0,1	ptp4l	40	1	ktimersoftd/3	22:05:50	3
5536	99	52	5,9	cyclictest	28427	-21	cat	00:25:20	1
5536	99	52	2,10	cyclictest	2518	-21	gnome-shell	22:15:22	1
5536	99	52	2,10	cyclictest	21757	-21	hwlatdetect	20:50:16	1
5536	99	52	1,10	cyclictest	13014	-21	cpuspeed_turbos	21:40:13	1
1393	91	52	0,1	ptp4l	40	1	ktimersoftd/3	19:56:04	3
5536	99	51	6,5	cyclictest	0	-21	swapper/1	21:00:10	1
5536	99	51	5,6	cyclictest	13788	-21	latency_hist	22:50:01	1
5536	99	51	2,10	cyclictest	18171	-21	awk	21:50:17	1
5536	99	51	1,10	cyclictest	19868	-21	ls	23:00:21	1
1393	91	51	0,1	ptp4l	40	1	ktimersoftd/3	23:50:34	3
5536	99	50	3,9	cyclictest	8692	-21	sed	19:15:19	1
5536	99	50	1,10	cyclictest	16178	-21	cut	22:55:00	1
5536	99	50	0,11	cyclictest	6932	-21	phc2sys-jitter	21:25:23	1
5536	99	49	2,9	cyclictest	31151	-21	ptp4l-jitter	00:30:25	1
5536	99	49	2,9	cyclictest	25038	-21	latency_hist	00:20:01	1
5536	99	48	41,4	cyclictest	26716	-21	cron	19:54:59	1
5536	99	48	2,18	cyclictest	837	-21	mailstats	22:20:25	1
5536	99	48	1,10	cyclictest	15285	-21	cat	19:30:14	1
5536	99	48	0,9	cyclictest	0	-21	swapper/1	20:57:58	1
5536	99	48	0,16	cyclictest	1648	-21	sed	20:10:01	1
5536	99	47	2,9	cyclictest	2518	-21	gnome-shell	21:47:58	1
5536	99	47	2,10	cyclictest	22764	-21	sed	22:00:13	1
5536	99	47	1,11	cyclictest	4621	-21	fschecks_time	20:15:17	1
5536	99	47	1,10	cyclictest	24537	-21	grep	19:50:00	1
5536	99	47	0,18	cyclictest	27001	-21	sed	23:15:19	1
5536	99	47	0,16	cyclictest	9136	-21	cut	23:45:19	1
5536	99	47	0,11	cyclictest	791	-21	sed	23:30:00	1
5537	99	46	11,4	cyclictest	33	-21	ksoftirqd/2	00:40:00	2
5536	99	46	6,11	cyclictest	19434	-21	cat	20:45:19	1
5536	99	46	2,9	cyclictest	21988	-21	idleruntime-cro	19:45:00	1
5536	99	46	1,9	cyclictest	0	-21	swapper/1	21:59:58	1
5536	99	46	1,5	cyclictest	0	-21	swapper/1	20:00:15	1
5537	99	45	1,3	cyclictest	12	1	rcu_preempt	20:25:24	2
5536	99	45	1,16	cyclictest	2038	-21	df_abs	20:10:16	1
5536	99	45	1,11	cyclictest	22622	-21	cat	00:15:01	1
5536	99	45	1,11	cyclictest	22622	-21	cat	00:15:01	1
5536	99	45	0,12	cyclictest	18224	-21	sed	19:35:18	1
578	98	44	0,9	rtkit-daemon	0	-21	swapper/2	21:58:41	2
5536	99	44	7,6	cyclictest	27538	-21	if_enp1s0	19:55:18	1
5536	99	44	1,8	cyclictest	27601	-21	fschecks_time	22:10:17	1
5536	99	44	0,17	cyclictest	2790	-21	irqrtprio	22:25:17	1
5535	99	44	10,4	cyclictest	9	-21	ksoftirqd/0	22:50:21	0
1393	91	44	0,1	ptp4l	40	1	ktimersoftd/3	21:55:37	3
5537	99	43	31,10	cyclictest	33	-21	ksoftirqd/2	21:10:17	2
5536	99	43	5,6	cyclictest	30949	2	sleep1	21:10:14	1
5536	99	43	1,12	cyclictest	15671	-21	expr	00:00:15	1
5536	99	43	1,12	cyclictest	10857	-21	cstates	23:50:13	1
5535	99	43	37,3	cyclictest	9	-21	ksoftirqd/0	20:05:00	0
5537	99	42	6,8	cyclictest	33	-21	ksoftirqd/2	23:05:27	2
5537	99	42	10,7	cyclictest	33	-21	ksoftirqd/2	00:20:01	2
5536	99	42	3,8	cyclictest	5857	-21	df	19:10:14	1
5536	99	42	1,16	cyclictest	1062	-21	ls	23:30:14	1
1393	91	42	0,1	ptp4l	40	1	ktimersoftd/3	00:30:15	3
1393	91	42	0,0	ptp4l	40	1	ktimersoftd/3	23:15:15	3
5538	99	41	34,4	cyclictest	14421	-21	grep	22:50:15	3
5537	99	41	7,4	cyclictest	33	-21	ksoftirqd/2	22:40:00	2
5536	99	41	1,8	cyclictest	9767	-21	sed	22:40:18	1
5536	99	41	1,8	cyclictest	9767	-21	sed	22:40:18	1
5536	99	41	1,8	cyclictest	10131	-21	meminfo	20:25:21	1
5536	99	41	1,7	cyclictest	9009	-21	irqstats	21:30:20	1
5536	99	41	1,7	cyclictest	25265	-21	hddtemp_smartct	22:05:16	1
5537	99	40	35,3	cyclictest	33	-21	ksoftirqd/2	21:50:00	2
5537	99	40	35,3	cyclictest	33	-21	ksoftirqd/2	19:55:00	2
5537	99	40	20,12	cyclictest	33	-21	ksoftirqd/2	21:45:00	2
5536	99	40	2,6	cyclictest	7305	-21	ps	22:35:19	1
5536	99	40	2,6	cyclictest	11353	-21	memory	19:20:22	1
5535	99	40	34,3	cyclictest	9	-21	ksoftirqd/0	00:15:00	0
5535	99	40	34,3	cyclictest	9	-21	ksoftirqd/0	00:14:59	0
5537	99	39	35,2	cyclictest	33	-21	ksoftirqd/2	21:55:01	2
5537	99	39	35,2	cyclictest	33	-21	ksoftirqd/2	21:00:00	2
5537	99	39	33,3	cyclictest	33	-21	ksoftirqd/2	19:25:18	2
5537	99	39	31,6	cyclictest	33	-21	ksoftirqd/2	20:05:51	2
5537	99	39	10,6	cyclictest	33	-21	ksoftirqd/2	19:24:59	2
5537	99	39	0,2	cyclictest	12	1	rcu_preempt	23:25:18	2
5535	99	39	9,4	cyclictest	9	-21	ksoftirqd/0	20:50:27	0
5535	99	39	6,10	cyclictest	9	-21	ksoftirqd/0	00:00:00	0
5535	99	39	34,3	cyclictest	9	-21	ksoftirqd/0	22:50:01	0
5535	99	39	33,3	cyclictest	9	-21	ksoftirqd/0	22:00:02	0
5537	99	38	4,3	cyclictest	33	-21	ksoftirqd/2	22:00:14	2
5537	99	38	34,2	cyclictest	33	-21	ksoftirqd/2	00:25:01	2
5537	99	38	33,3	cyclictest	33	-21	ksoftirqd/2	20:15:28	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-06-15 - 15:03