OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #f, slot #7

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7.osadl.org (updated Thu Apr 23, 2026 12:46:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2267003	99	86	48,38	cyclictest	0	-21	swapper/0	11:50:15	0
2267010	99	62	0,19	cyclictest	0	-21	swapper/7	07:10:14	7
2267005	99	62	23,39	cyclictest	42	1	ktimers/2	11:05:16	2
2267004	99	57	38,1	cyclictest	873	-21	mta-sts-daemon	08:15:40	1
2267009	99	53	15,19	cyclictest	0	-21	swapper/6	11:45:17	6
2267006	99	53	14,19	cyclictest	0	-21	swapper/3	10:10:15	3
2267004	99	52	13,2	cyclictest	0	-21	swapper/1	10:37:00	1
2267007	99	51	13,19	cyclictest	0	-21	swapper/4	07:50:15	4
2267006	99	51	32,19	cyclictest	0	-21	swapper/3	07:50:16	3
2267003	99	51	13,19	cyclictest	0	-21	swapper/0	11:55:15	0
2267009	99	50	12,19	cyclictest	0	-21	swapper/6	09:40:16	6
2267007	99	50	12,19	cyclictest	0	-21	swapper/4	07:15:17	4
2267006	99	50	11,39	cyclictest	0	-21	swapper/3	07:35:15	3
2267004	99	50	13,1	cyclictest	0	-21	swapper/1	08:58:49	1
2267008	99	48	9,39	cyclictest	0	-21	swapper/5	08:45:17	5
2267005	99	48	9,19	cyclictest	0	-21	swapper/2	12:35:16	2
2267005	99	48	28,20	cyclictest	0	-21	swapper/2	10:20:15	2
2267005	99	48	10,38	cyclictest	0	-21	swapper/2	11:55:15	2
2267009	99	47	9,19	cyclictest	0	-21	swapper/6	07:40:16	6
2267008	99	47	7,39	cyclictest	0	-21	swapper/5	08:10:16	5
2267005	99	47	9,19	cyclictest	0	-21	swapper/2	11:20:16	2
2267004	99	47	8,2	cyclictest	1	-21	systemd	09:47:25	1
2267003	99	46	8,19	cyclictest	0	-21	swapper/0	09:10:13	0
2267007	99	45	26,19	cyclictest	0	-21	swapper/4	07:40:16	4
2267004	99	45	45,0	cyclictest	0	-21	swapper/1	08:39:23	1
2267004	99	45	4,39	cyclictest	0	-21	swapper/1	10:49:25	1
2267010	99	44	6,19	cyclictest	0	-21	swapper/7	12:15:17	7
2267007	99	44	5,39	cyclictest	0	-21	swapper/4	08:25:16	4
2267005	99	44	5,39	cyclictest	0	-21	swapper/2	10:25:16	2
2267004	99	44	4,39	cyclictest	0	-21	swapper/1	12:16:55	1
2267004	99	44	4,39	cyclictest	0	-21	swapper/1	11:44:55	1
2267004	99	44	4,39	cyclictest	0	-21	swapper/1	11:36:03	1
2267004	99	44	4,39	cyclictest	0	-21	swapper/1	11:05:54	1
2267004	99	44	4,39	cyclictest	0	-21	swapper/1	09:55:13	1
2267009	99	43	5,19	cyclictest	0	-21	swapper/6	08:30:15	6
2267007	99	43	5,19	cyclictest	0	-21	swapper/4	11:15:16	4
2267004	99	43	4,39	cyclictest	0	-21	swapper/1	11:33:43	1
2267004	99	43	4,39	cyclictest	0	-21	swapper/1	11:29:59	1
2267004	99	43	4,39	cyclictest	0	-21	swapper/1	08:04:27	1
2267004	99	43	3,39	cyclictest	0	-21	swapper/1	10:26:03	1
2267004	99	43	3,39	cyclictest	0	-21	swapper/1	10:21:39	1
2267004	99	43	3,20	cyclictest	2346794	-21	systemd-run	09:35:01	1
2267004	99	43	23,19	cyclictest	2430094	-21	apt	12:05:11	1
2267004	99	43	23,19	cyclictest	2329106	-21	ntp_kernel_pll_	09:00:19	1
2267007	99	42	23,19	cyclictest	0	-21	swapper/4	11:50:14	4
2267006	99	42	4,19	cyclictest	0	-21	swapper/3	08:15:18	3
2267004	99	42	3,39	cyclictest	0	-21	swapper/1	08:12:15	1
2267004	99	42	23,19	cyclictest	2317932	-21	ntpq	08:40:19	1
2267004	99	42	23,0	cyclictest	2434109	-21	awk	12:10:18	1
2267004	99	42	22,19	cyclictest	2362321	-21	awk	10:00:18	1
2267006	99	41	2,39	cyclictest	50	1	rcuc/3	07:55:16	3
2267004	99	41	3,19	cyclictest	0	-21	swapper/1	12:23:15	1
2267004	99	41	22,19	cyclictest	0	-21	swapper/1	08:25:15	1
2267004	99	41	22,18	cyclictest	2276778	-21	ntpq	07:25:19	1
2267004	99	41	1,39	cyclictest	0	-21	swapper/1	07:45:39	1
2267004	99	41	0,40	cyclictest	0	-21	swapper/1	08:06:32	1
2267010	99	40	1,39	cyclictest	0	-21	swapper/7	09:45:17	7
2267010	99	40	0,39	cyclictest	0	-21	swapper/7	11:35:15	7
2267004	99	40	19,18	cyclictest	0	-21	swapper/1	07:44:45	1
2267004	99	40	18,18	cyclictest	2405598	-21	cpuspeed_turbos	11:20:13	1
2267004	99	40	0,39	cyclictest	0	-21	swapper/1	07:35:11	1
2267010	99	39	0,20	cyclictest	0	-21	swapper/7	10:55:15	7
2267007	99	39	1,19	cyclictest	0	-21	swapper/4	10:45:17	4
2267007	99	39	0,20	cyclictest	0	-21	swapper/4	12:00:14	4
2267006	99	39	0,20	cyclictest	0	-21	swapper/3	10:00:16	3
2267004	99	39	19,19	cyclictest	33	1	ktimers/1	09:13:55	1
2267004	99	39	17,21	cyclictest	1086	-21	runrttasks	09:07:56	1
2267004	99	39	1,19	cyclictest	2399839	-21	cut	11:10:11	1
2267004	99	39	0,38	cyclictest	0	-21	swapper/1	09:15:02	1
2267008	99	38	38,0	cyclictest	2418615	-21	kworker/5:1+events	11:57:41	5
2267008	99	38	38,0	cyclictest	2410124	-21	kworker/5:2+events	11:36:36	5
2267008	99	38	38,0	cyclictest	2404635	-21	kworker/5:1+events	11:23:09	5
2267008	99	38	38,0	cyclictest	2393404	-21	kworker/5:0+events	11:29:53	5
2267008	99	38	38,0	cyclictest	2371482	-21	kworker/5:0+events	10:18:13	5
2267008	99	38	38,0	cyclictest	2338188	-21	kworker/5:2+events	10:41:57	5
2267008	99	38	38,0	cyclictest	2338188	-21	kworker/5:2+events	10:41:57	5
2267008	99	38	38,0	cyclictest	2296577	-21	kworker/5:0+events	08:41:01	5
2267008	99	38	38,0	cyclictest	2289168	-21	kworker/5:1+events	08:39:09	5
2267006	99	38	38,0	cyclictest	0	-21	swapper/3	11:35:00	3
2267004	99	38	37,1	cyclictest	0	-21	swapper/1	09:35:17	1
2267004	99	38	19,19	cyclictest	792	-21	rs:main		1
2267004	99	38	0,38	cyclictest	1	-21	systemd	12:35:01	1
2267004	99	38	0,38	cyclictest	0	-21	swapper/1	09:29:54	1
2267010	99	37	0,18	cyclictest	0	-21	swapper/7	08:35:15	7
2267008	99	37	37,0	cyclictest	2442979	-21	kworker/5:1+events	12:37:13	5
2267008	99	37	37,0	cyclictest	2434747	-21	kworker/5:0+events	12:30:41	5
2267008	99	37	37,0	cyclictest	2434747	-21	kworker/5:0+events	12:21:32	5
2267008	99	37	37,0	cyclictest	2424606	-21	kworker/5:2+events	12:29:25	5
2267008	99	37	37,0	cyclictest	2424606	-21	kworker/5:2+events	12:15:45	5
2267008	99	37	37,0	cyclictest	2424606	-21	kworker/5:2+events	12:06:29	5
2267008	99	37	37,0	cyclictest	2418615	-21	kworker/5:1+events	12:03:17	5
2267008	99	37	37,0	cyclictest	2418615	-21	kworker/5:1+events	11:46:53	5
2267008	99	37	37,0	cyclictest	2410124	-21	kworker/5:2+events	11:41:33	5
2267008	99	37	37,0	cyclictest	2393404	-21	kworker/5:0+events	11:50:09	5
2267008	99	37	37,0	cyclictest	2393404	-21	kworker/5:0+events	11:18:53	5
2267008	99	37	37,0	cyclictest	2393404	-21	kworker/5:0+events	11:07:01	5
2267008	99	37	37,0	cyclictest	2393404	-21	kworker/5:0+events	11:00:49	5
2267008	99	37	37,0	cyclictest	2371482	-21	kworker/5:0+events	10:31:13	5
2267008	99	37	37,0	cyclictest	2352169	-21	kworker/5:1+events	09:55:41	5
2267008	99	37	37,0	cyclictest	2352169	-21	kworker/5:1+events	09:48:13	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00