OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #f, slot #7

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7.osadl.org (updated Tue Dec 09, 2025 00:46:14)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3084918	99	87	29,39	cyclictest	3250897	-21	mii-tool	00:00:16	4
3084918	99	80	79,1	cyclictest	1	-21	systemd	21:10:01	4
3084918	99	74	16,39	cyclictest	3264116	-21	munin-run	00:25:00	4
3084918	99	74	13,59	cyclictest	3190246	-21	kworker/u32:2+events_unbound	23:09:39	4
3084918	99	74	12,41	cyclictest	3189481	-21	taskset	22:10:41	4
3084918	99	73	15,39	cyclictest	3130708	-21	kworker/u32:3+events_unbound	21:58:13	4
3084918	99	72	33,19	cyclictest	0	-21	swapper/4	19:50:51	4
3084918	99	72	14,39	cyclictest	3084668	-21	kworker/u32:0+events_unbound	20:09:01	4
3084918	99	72	12,59	cyclictest	3172725	-21	kworker/u32:0+events_unbound	21:54:01	4
3084918	99	72	12,59	cyclictest	3084668	-21	kworker/u32:0+events_unbound	19:18:39	4
3084918	99	71	33,38	cyclictest	61	-21	ksoftirqd/4	23:40:35	4
3084918	99	71	32,39	cyclictest	0	-21	swapper/4	00:05:46	4
3084918	99	71	32,21	cyclictest	0	-21	swapper/4	23:46:47	4
3084918	99	71	32,19	cyclictest	60	1	ktimers/4	22:24:15	4
3084918	99	71	31,22	cyclictest	0	-21	swapper/4	21:44:31	4
3084918	99	71	13,38	cyclictest	873	-21	mta-sts-daemon	19:21:01	4
3084918	99	71	12,59	cyclictest	3084668	-21	kworker/u32:0+events_unbound	19:39:39	4
3084918	99	70	31,19	cyclictest	0	-21	swapper/4	22:05:33	4
3084918	99	70	31,19	cyclictest	0	-21	swapper/4	20:21:36	4
3084918	99	70	31,19	cyclictest	0	-21	swapper/4	20:21:35	4
3084918	99	70	31,19	cyclictest	0	-21	swapper/4	20:01:25	4
3084918	99	70	30,21	cyclictest	0	-21	swapper/4	19:32:03	4
3084918	99	66	8,39	cyclictest	3211504	-21	ntpq	22:50:23	4
3084918	99	66	8,39	cyclictest	3204309	-21	kworker/u32:5+events_unbound	22:40:13	4
3084918	99	66	45,20	cyclictest	3231643	-21	ntpq	23:25:21	4
3084918	99	65	6,59	cyclictest	3193074	-21	kworker/u32:3	23:00:07	4
3084918	99	65	6,39	cyclictest	3104326	-21	grep	19:40:25	4
3084918	99	62	61,1	cyclictest	3154276	-21	if_eno2	21:10:19	4
3084918	99	62	23,19	cyclictest	1447	98	rtkit-daemon	23:22:33	4
3084918	99	60	0,39	cyclictest	3266696	-21	chrt	00:29:50	4
3084918	99	59	40,19	cyclictest	0	-21	swapper/4	23:10:13	4
3084918	99	59	18,19	cyclictest	3130392	-21	munin-run	20:30:01	4
3084918	99	59	0,40	cyclictest	3130708	-21	kworker/u32:3+events_unbound	21:16:13	4
3084918	99	55	14,19	cyclictest	0	-21	swapper/4	21:27:15	4
3084918	99	55	0,54	cyclictest	3216069	-21	kworker/u32:4+events_unbound	00:33:36	4
3084918	99	55	0,54	cyclictest	3216069	-21	kworker/u32:4+events_unbound	00:33:36	4
3084918	99	54	36,18	cyclictest	61	-21	ksoftirqd/4	20:37:27	4
3084918	99	54	33,19	cyclictest	0	-21	swapper/4	20:58:35	4
3084918	99	54	19,35	cyclictest	0	-21	swapper/4	22:59:11	4
3084918	99	54	19,35	cyclictest	0	-21	swapper/4	20:53:48	4
3084918	99	54	19,35	cyclictest	0	-21	swapper/4	20:43:15	4
3084918	99	54	19,15	cyclictest	0	-21	swapper/4	22:48:39	4
3084918	99	54	19,15	cyclictest	0	-21	swapper/4	20:30:59	4
3084918	99	54	19,15	cyclictest	0	-21	swapper/4	20:30:59	4
3084918	99	54	19,15	cyclictest	0	-21	swapper/4	20:18:41	4
3084918	99	54	19,15	cyclictest	0	-21	swapper/4	00:38:10	4
3084918	99	54	15,39	cyclictest	0	-21	swapper/4	22:31:57	4
3084918	99	54	14,39	cyclictest	0	-21	swapper/4	23:55:07	4
3084914	99	54	15,38	cyclictest	0	-21	swapper/0	19:55:17	0
3084918	99	53	33,19	cyclictest	0	-21	swapper/4	22:26:11	4
3084918	99	53	19,15	cyclictest	0	-21	swapper/4	23:53:19	4
3084918	99	53	19,15	cyclictest	0	-21	swapper/4	22:02:05	4
3084918	99	53	19,15	cyclictest	0	-21	swapper/4	19:28:01	4
3084918	99	53	19,15	cyclictest	0	-21	swapper/4	00:12:52	4
3084918	99	53	18,15	cyclictest	0	-21	swapper/4	21:47:13	4
3084918	99	53	14,39	cyclictest	3190246	-21	kworker/u32:2+events_unbound	22:19:13	4
3084918	99	53	14,39	cyclictest	3085245	-21	kworker/u32:3+events_unbound	19:10:13	4
3084918	99	53	14,39	cyclictest	0	-21	swapper/4	23:35:31	4
3084918	99	53	14,39	cyclictest	0	-21	swapper/4	23:31:39	4
3084918	99	53	14,39	cyclictest	0	-21	swapper/4	23:15:45	4
3084918	99	53	14,39	cyclictest	0	-21	swapper/4	19:55:49	4
3084918	99	53	14,39	cyclictest	0	-21	swapper/4	00:15:18	4
3084918	99	53	14,38	cyclictest	3130708	-21	kworker/u32:3+events_unbound	21:03:37	4
3084915	99	53	15,19	cyclictest	0	-21	swapper/1	19:45:16	1
3084920	99	52	33,19	cyclictest	0	-21	swapper/6	22:55:19	6
3084918	99	52	33,19	cyclictest	0	-21	swapper/4	21:37:03	4
3084918	99	52	33,19	cyclictest	0	-21	swapper/4	21:21:49	4
3084918	99	52	33,19	cyclictest	0	-21	swapper/4	20:46:57	4
3084918	99	52	33,19	cyclictest	0	-21	swapper/4	20:10:05	4
3084918	99	52	33,19	cyclictest	0	-21	swapper/4	19:45:07	4
3084918	99	52	33,0	cyclictest	0	-21	swapper/4	22:36:51	4
3084918	99	52	13,39	cyclictest	0	-21	swapper/4	21:31:51	4
3084914	99	52	14,19	cyclictest	0	-21	swapper/0	20:40:16	0
3084914	99	51	13,19	cyclictest	0	-21	swapper/0	20:50:16	0
3084919	99	50	11,39	cyclictest	0	-21	swapper/5	00:35:17	5
3084914	99	50	12,19	cyclictest	0	-21	swapper/0	23:15:18	0
3084920	99	49	31,18	cyclictest	0	-21	swapper/6	20:00:18	6
3084919	99	49	10,19	cyclictest	0	-21	swapper/5	21:25:17	5
3084916	99	49	29,19	cyclictest	0	-21	swapper/2	20:20:16	2
3084916	99	49	29,19	cyclictest	0	-21	swapper/2	20:20:16	2
3084914	99	48	9,38	cyclictest	0	-21	swapper/0	19:20:16	0
3084920	99	47	8,39	cyclictest	0	-21	swapper/6	20:05:18	6
3084916	99	46	27,19	cyclictest	0	-21	swapper/2	19:25:16	2
3084914	99	46	6,39	cyclictest	0	-21	swapper/0	22:40:16	0
3084919	99	42	4,19	cyclictest	0	-21	swapper/5	20:40:16	5
3084915	99	42	3,39	cyclictest	0	-21	swapper/1	19:20:16	1
3084920	99	41	3,19	cyclictest	0	-21	swapper/6	21:45:17	6
3084920	99	41	22,19	cyclictest	77	1	rcuc/6	00:05:17	6
3084919	99	41	4,18	cyclictest	877	-21	mta-sts-daemon	22:10:17	5
3084919	99	41	3,19	cyclictest	0	-21	swapper/5	22:20:16	5
3084919	99	41	2,39	cyclictest	0	-21	swapper/5	22:15:17	5
3084919	99	41	2,39	cyclictest	0	-21	swapper/5	19:20:16	5
3084920	99	40	2,19	cyclictest	0	-21	swapper/6	19:45:16	6
3084919	99	40	2,19	cyclictest	0	-21	swapper/5	20:25:18	5
3084914	99	40	22,18	cyclictest	0	-21	swapper/0	19:35:16	0
3084920	99	39	0,20	cyclictest	0	-21	swapper/6	22:40:16	6
3084914	99	39	21,18	cyclictest	0	-21	swapper/0	22:25:17	0
3084914	99	39	1,19	cyclictest	0	-21	swapper/0	20:45:18	0
3084919	99	38	13,19	cyclictest	0	-21	swapper/5	21:35:18	5
3084919	99	38	0,19	cyclictest	0	-21	swapper/5	20:55:20	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00