OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #e, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot6.osadl.org (updated Mon Feb 02, 2026 00:44:52)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2334612	99	96	89,6	cyclictest	2402259	-21	kworker/u8:0+flush-179:0	23:00:01	1
2334612	99	93	81,10	cyclictest	266	-21	systemd-journal	20:55:01	1
2334611	99	93	84,6	cyclictest	2399366	-21	latency_hist	22:40:01	0
2334611	99	88	79,6	cyclictest	2402259	-21	kworker/u8:0+flush-179:0	22:55:00	0
2334612	99	87	78,7	cyclictest	2371521	-21	latency_hist	21:05:01	1
2334612	99	86	78,5	cyclictest	2349970	-21	kworker/u8:1+flush-179:0	20:00:01	1
2334612	99	85	75,8	cyclictest	2363543	-21	kworker/u8:1+events_unbound	20:40:00	1
2334612	99	85	74,8	cyclictest	2399888	-21	kworker/u8:3+flush-179:0	23:00:20	1
2334612	99	84	78,4	cyclictest	2345842	-21	kworker/u8:2+events_unbound	19:45:00	1
2334612	99	83	77,5	cyclictest	2377862	-21	kworker/u8:1+events_unbound	22:15:23	1
2334611	99	82	76,4	cyclictest	266	-21	systemd-journal	20:35:20	0
2334612	99	81	75,4	cyclictest	2391123	-21	kworker/u8:3+flush-179:0	22:30:21	1
2334612	99	81	74,5	cyclictest	2387967	-21	latency_hist	22:05:01	1
2334612	99	81	74,5	cyclictest	2349970	-21	kworker/u8:1+events_unbound	20:05:24	1
2334612	99	79	74,4	cyclictest	2425914	-21	kworker/u8:3+events_unbound	00:25:26	1
2334612	99	79	72,6	cyclictest	2368373	-21	kworker/u8:3+flush-179:0	21:25:24	1
2334612	99	76	71,4	cyclictest	2345842	-21	kworker/u8:2+events_unbound	19:45:24	1
2334612	99	76	71,3	cyclictest	2377921	-21	kworker/u8:2+flush-179:0	21:45:01	1
2334612	99	75	69,4	cyclictest	2409147	-21	kworker/u8:0+flush-179:0	23:25:00	1
2334612	99	75	69,4	cyclictest	2340478	-21	kworker/u8:0+flush-179:0	19:30:00	1
2334612	99	75	68,5	cyclictest	2422400	-21	kworker/u8:1+events_unbound	23:50:03	1
2334612	99	75	67,6	cyclictest	2377921	-21	kworker/u8:2+flush-179:0	21:40:00	1
2334612	99	75	61,11	cyclictest	2425854	-40	logrotate	00:00:00	1
2334611	99	74	65,7	cyclictest	2352171	-21	latency_hist	20:05:02	0
2334612	99	73	67,4	cyclictest	2425832	-21	kworker/u8:1+flush-179:0	00:10:24	1
2334612	99	72	67,3	cyclictest	2321279	-21	kworker/u8:3+flush-179:0	19:15:20	1
2334612	99	71	65,4	cyclictest	2345842	-21	kworker/u8:2+events_unbound	20:20:01	1
2334612	99	70	65,4	cyclictest	2425914	-21	kworker/u8:3+flush-179:0	00:35:00	1
2334612	99	70	64,4	cyclictest	2341062	-21	kworker/u8:1+flush-179:0	19:35:00	1
2334612	99	70	63,5	cyclictest	2334437	-21	kworker/u8:2+flush-179:0	19:25:00	1
2334612	99	69	63,5	cyclictest	2368306	-21	kworker/u8:1+flush-179:0	21:15:01	1
2334612	99	69	63,4	cyclictest	2425914	-21	kworker/u8:3+events_unbound	00:20:01	1
2334612	99	68	60,6	cyclictest	2361964	-21	latency_hist	20:35:01	1
2334612	99	68	59,6	cyclictest	2376253	-21	kworker/u8:0+flush-179:0	21:20:20	1
2334612	99	67	60,4	cyclictest	2340478	-21	kworker/u8:0+events_unbound	19:35:20	1
2334612	99	67	60,4	cyclictest	2340478	-21	kworker/u8:0+events_unbound	19:35:20	1
2334612	99	67	58,7	cyclictest	2392984	-21	kworker/u8:0+flush-179:0	22:20:16	1
2334611	99	67	1,63	cyclictest	714	-21	Xorg	21:01:58	0
2334612	99	66	59,5	cyclictest	2349970	-21	kworker/u8:1+flush-179:0	20:00:20	1
2334612	99	65	62,2	cyclictest	0	-21	swapper/1	20:14:00	1
2334612	99	65	57,5	cyclictest	2345842	-21	kworker/u8:2+flush-179:0	20:40:20	1
2334612	99	64	58,5	cyclictest	2345842	-21	kworker/u8:2+flush-179:0	20:20:28	1
2334617	99	63	61,1	cyclictest	0	-21	swapper/3	23:35:59	3
2334612	99	63	57,4	cyclictest	2368373	-21	kworker/u8:3+events_unbound	21:35:00	1
2334611	99	63	52,9	cyclictest	2435719	-21	apt-get	00:30:13	0
2334617	99	62	0,60	cyclictest	0	-21	swapper/3	20:16:00	3
2334612	99	61	55,3	cyclictest	2409147	-21	kworker/u8:0+flush-179:0	23:20:00	1
2334612	99	61	53,6	cyclictest	2382963	-21	kworker/u8:3+flush-179:0	21:50:20	1
2334612	99	60	55,4	cyclictest	2377862	-21	kworker/u8:1+flush-179:0	22:09:55	1
2334612	99	60	52,6	cyclictest	2409147	-21	kworker/u8:0+flush-179:0	23:30:00	1
2334612	99	60	52,6	cyclictest	2334437	-21	kworker/u8:2+events_unbound	19:15:00	1
2334611	99	60	50,7	cyclictest	2410737	-21	kworker/u8:2+events_unbound	23:45:00	0
2334612	99	59	53,5	cyclictest	2425832	-21	kworker/u8:1+flush-179:0	00:20:21	1
2334612	99	59	51,6	cyclictest	2409147	-21	kworker/u8:0+flush-179:0	23:40:01	1
2334611	99	59	50,7	cyclictest	2410737	-21	kworker/u8:2+flush-179:0	23:35:17	0
2334612	99	58	53,4	cyclictest	2425832	-21	kworker/u8:1+flush-179:0	00:00:25	1
2334612	99	58	52,5	cyclictest	2409147	-21	kworker/u8:0+flush-179:0	23:45:20	1
2334612	99	58	50,5	cyclictest	2425914	-21	kworker/u8:3+flush-179:0	00:35:20	1
2334611	99	58	52,4	cyclictest	2407559	-21	kworker/u8:1+flush-179:0	23:05:21	0
2334611	99	58	50,6	cyclictest	2340478	-21	kworker/u8:0+flush-179:0	19:54:59	0
2334612	99	56	49,5	cyclictest	2345842	-21	kworker/u8:2+events_unbound	20:45:17	1
2334612	99	56	44,9	cyclictest	266	-21	systemd-journal	21:20:00	1
2334611	99	56	46,8	cyclictest	2416050	-21	apt-get	23:30:12	0
2334611	99	56	46,8	cyclictest	2416050	-21	apt-get	23:30:12	0
2334611	99	56	45,8	cyclictest	2389806	-21	apt-get	22:10:11	0
2334611	99	55	48,5	cyclictest	2384512	-21	latency_hist	21:50:02	0
2334611	99	55	48,5	cyclictest	2342614	-21	latency_hist	19:35:01	0
2334611	99	55	45,7	cyclictest	2345842	-21	kworker/u8:2+flush-179:0	20:45:20	0
2334612	99	54	49,4	cyclictest	2377862	-21	kworker/u8:1+flush-179:0	22:00:00	1
2334612	99	54	47,5	cyclictest	2377862	-21	kworker/u8:1+events_unbound	22:40:13	1
2334611	99	54	46,6	cyclictest	2345842	-21	kworker/u8:2+events_unbound	20:25:02	0
2334611	99	53	45,6	cyclictest	2334917	-21	apt-get	19:10:12	0
2334612	99	52	44,6	cyclictest	266	-21	systemd-journal	19:51:20	1
45770	91	51	0,14	ptp4l	614	90	irq/134-eno1-TxRx-0	19:10:00	3
2334611	99	51	44,5	cyclictest	2334437	-21	kworker/u8:2+flush-179:0	19:25:24	0
2334611	99	51	42,7	cyclictest	266	-21	systemd-journal	22:22:20	0
2334611	99	51	39,9	cyclictest	510	-21	rs:main		0
2334617	99	49	46,2	cyclictest	0	-21	swapper/3	22:14:58	3
2334612	99	49	38,8	cyclictest	266	-21	systemd-journal	22:30:00	1
2334612	99	48	40,5	cyclictest	2417385	-21	latency_hist	23:35:00	1
2334612	99	48	40,5	cyclictest	2417385	-21	latency_hist	23:35:00	1
2334611	99	48	41,5	cyclictest	2334437	-21	kworker/u8:2+events_unbound	19:20:24	0
2334611	99	48	40,5	cyclictest	2425914	-21	kworker/u8:3+events_unbound	00:15:01	0
2334616	99	47	44,2	cyclictest	0	-21	swapper/2	20:14:00	2
2334612	99	47	42,3	cyclictest	2377862	-21	kworker/u8:1+events_unbound	22:10:11	1
2334611	99	47	39,6	cyclictest	2401219	-21	latency_hist	22:45:01	0
2334612	99	46	41,4	cyclictest	2407559	-21	kworker/u8:1+events_unbound	23:05:25	1
2334612	99	46	1,44	cyclictest	714	-21	Xorg	22:38:59	1
2334611	99	46	39,5	cyclictest	2425832	-21	kworker/u8:1+flush-179:0	00:09:59	0
2334611	99	46	38,6	cyclictest	2426026	-21	cat	00:00:01	0
2334611	99	46	36,7	cyclictest	2345842	-21	kworker/u8:2+events_unbound	20:34:59	0
2334611	99	46	33,10	cyclictest	2430941	-21	apt-get	00:15:12	0
2334611	99	45	40,3	cyclictest	2438660	-21	awk	00:40:00	0
2334611	99	45	40,3	cyclictest	2374687	-21	cron	21:15:01	0
2334611	99	45	33,10	cyclictest	2384766	-21	apt-get	21:50:12	0
2334611	99	44	38,4	cyclictest	2409147	-21	kworker/u8:0+flush-179:0	23:25:21	0
2334611	99	44	37,5	cyclictest	2345842	-21	kworker/u8:2+flush-179:0	20:10:22	0
2334611	99	43	39,2	cyclictest	0	-21	swapper/0	22:57:58	0
2334612	99	42	33,4	cyclictest	2407559	-21	kworker/u8:1+events_unbound	23:10:22	1
2334612	99	42	33,4	cyclictest	2407559	-21	kworker/u8:1+events_unbound	23:10:22	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2020-10-04 - 12:21