OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Jul 12, 2025 00:43:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1094323	2	55	45,7	sleep5	0	-21	swapper/5	03:29:28	5
1094238	2	55	22,29	sleep7	0	-21	swapper/7	03:28:18	7
1094437	2	50	40,7	sleep6	0	-21	swapper/6	03:31:06	6
1094435	2	48	39,6	sleep4	0	-21	swapper/4	03:31:04	4
1094837	99	42	0,40	cyclictest	1191425	-21	latency_hist	04:17:27	7
1094837	99	42	0,40	cyclictest	1191425	-21	latency_hist	04:17:27	7
1094826	99	32	30,2	cyclictest	1200396	-21	kworker/u16:5+events_unbound	05:27:22	4
1094826	99	30	28,2	cyclictest	1121318	-21	kworker/u16:2+events_unbound	03:54:38	4
1094826	99	30	28,2	cyclictest	1092227	-21	kworker/u16:5+events_unbound	04:02:49	4
1332655	2	29	0,0	chrt	0	-21	swapper/5	05:22:49	5
1094826	99	29	26,2	cyclictest	1479146	-21	kworker/u16:3+events_unbound	07:07:29	4
1094830	99	28	26,2	cyclictest	1346808	-21	kworker/u16:3+flush-8:0	05:57:46	5
1094826	99	28	26,2	cyclictest	1686254	-21	kworker/u16:2+events_unbound	08:22:26	4
1094826	99	27	24,2	cyclictest	1727785	-21	kworker/u16:1+events_unbound	08:52:28	4
1094837	99	26	0,25	cyclictest	1243020	-21	latency_hist	04:42:28	7
1094837	99	26	0,24	cyclictest	1593572	-21	latency_hist	07:32:27	7
1094826	99	26	24,2	cyclictest	1121318	-21	kworker/u16:2+events_unbound	03:47:44	4
1094826	99	26	23,2	cyclictest	1479146	-21	kworker/u16:3+flush-8:0	09:02:26	4
1094826	99	26	23,2	cyclictest	1479146	-21	kworker/u16:3+flush-8:0	09:02:26	4
1094830	99	25	23,2	cyclictest	1479146	-21	kworker/u16:3+flush-8:0	08:12:45	5
1094837	99	24	0,22	cyclictest	1335773	-21	latency_hist	05:27:27	7
1094837	99	24	0,22	cyclictest	1294539	-21	latency_hist	05:07:27	7
1094837	99	24	0,22	cyclictest	1294539	-21	latency_hist	05:07:27	7
1094826	99	24	22,2	cyclictest	1407823	-21	kworker/u16:1+events_unbound	06:22:50	4
1094826	99	24	21,2	cyclictest	1200396	-21	kworker/u16:5+flush-8:0	06:07:46	4
1094830	99	23	21,2	cyclictest	1479146	-21	kworker/u16:3+events_unbound	07:14:41	5
1094830	99	23	21,2	cyclictest	1064491	-21	kworker/u16:3+flush-8:0	03:37:58	5
1094826	99	22	20,2	cyclictest	820377	-21	kworker/u16:1+flush-8:0	04:17:37	4
1094826	99	22	20,2	cyclictest	1614312	-21	kworker/u16:4+events_unbound	07:47:55	4
1094826	99	22	19,2	cyclictest	1567576	-21	kworker/u16:4+events_unbound	07:22:40	4
1094826	99	22	19,2	cyclictest	1567576	-21	kworker/u16:4+events_unbound	07:22:40	4
1571319	2	21	0,1	chrt	1571320	-21	kthreadcore	07:17:49	7
1094837	99	21	0,20	cyclictest	1562648	-21	sed	07:17:26	7
1094837	99	21	0,19	cyclictest	1706795	-21	latency_hist	08:27:27	7
1094830	99	21	17,3	cyclictest	1121318	-21	kworker/u16:2+flush-8:0	05:02:58	5
1094830	99	21	17,3	cyclictest	1121318	-21	kworker/u16:2+flush-8:0	05:02:58	5
1094826	99	21	19,2	cyclictest	1541611	-21	kworker/u16:0+flush-8:0	07:37:22	4
1094826	99	21	18,2	cyclictest	1440858	-21	kworker/u16:2+events_unbound	06:32:44	4
1094837	99	20	19,0	cyclictest	0	-21	swapper/7	04:07:46	7
1094832	99	20	18,2	cyclictest	1192159	-21	kworker/u16:4+events_unbound	04:17:46	6
1094830	99	20	18,2	cyclictest	1200396	-21	kworker/u16:5+flush-8:0	06:12:27	5
1094826	99	20	18,2	cyclictest	1407823	-21	kworker/u16:1+events_unbound	06:43:27	4
1094826	99	20	18,2	cyclictest	1200396	-21	kworker/u16:5+flush-8:0	04:54:50	4
1094826	99	20	18,2	cyclictest	1192159	-21	kworker/u16:4+flush-8:0	05:17:56	4
1094826	99	20	17,2	cyclictest	1614312	-21	kworker/u16:4+events_unbound	08:32:40	4
1094826	99	20	17,2	cyclictest	1092227	-21	kworker/u16:5+events_unbound	03:32:39	4
1094826	99	19	17,2	cyclictest	1200396	-21	kworker/u16:5+flush-8:0	05:43:01	4
1094826	99	19	16,3	cyclictest	1614312	-21	kworker/u16:4+events_unbound	08:08:26	4
1094837	99	18	15,2	cyclictest	1284288	-21	latency_hist	05:02:27	7
1094837	99	18	15,2	cyclictest	1129816	-21	latency_hist	03:47:28	7
1094830	99	18	16,2	cyclictest	1121318	-21	kworker/u16:2+flush-8:0	04:12:57	5
1094830	99	18	16,2	cyclictest	1121318	-21	kworker/u16:2+flush-8:0	04:12:57	5
1094826	99	18	16,2	cyclictest	339226	-21	kworker/u16:0+events_unbound	04:25:37	4
1094837	99	17	0,1	cyclictest	0	-21	swapper/7	06:12:53	7
1094837	99	17	0,15	cyclictest	1387411	-21	latency_hist	05:52:27	7
1094837	99	17	0,15	cyclictest	1387411	-21	latency_hist	05:52:27	7
1094830	99	17	0,16	cyclictest	1757243	-21	latency	08:47:49	5
1094826	99	17	15,2	cyclictest	1604104	-21	kworker/u16:2+flush-8:0	07:37:47	4
1094826	99	17	15,2	cyclictest	1121318	-21	kworker/u16:2+flush-8:0	04:07:47	4
1094826	99	17	14,2	cyclictest	1346808	-21	kworker/u16:3+flush-8:0	06:02:37	4
1094826	99	17	0,1	cyclictest	0	-21	swapper/4	08:32:05	4
1094826	99	17	0,1	cyclictest	0	-21	swapper/4	05:55:25	4
1094826	99	16	14,2	cyclictest	1479146	-21	kworker/u16:3+flush-8:0	08:04:36	4
1094826	99	16	14,2	cyclictest	1479146	-21	kworker/u16:3+events_unbound	08:37:51	4
1094826	99	16	14,2	cyclictest	1479146	-21	kworker/u16:3+events_unbound	08:37:51	4
1094826	99	16	14,2	cyclictest	1407823	-21	kworker/u16:1+events_unbound	06:52:56	4
1094826	99	16	14,2	cyclictest	1346808	-21	kworker/u16:3+events_unbound	05:57:55	4
1094826	99	16	14,2	cyclictest	1192159	-21	kworker/u16:4+events_unbound	05:33:49	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	08:47:26	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	08:22:52	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	08:14:40	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	07:58:17	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	07:18:21	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	07:17:20	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	06:19:59	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	05:39:02	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	05:14:27	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	05:05:14	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	05:05:14	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	04:58:04	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	04:48:51	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	04:40:40	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	04:34:31	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	04:17:07	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	04:17:07	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	03:59:42	4
1094826	99	16	0,1	cyclictest	0	-21	swapper/4	03:43:19	4
1094837	99	15	9,5	cyclictest	27763	-21	gvfs-afc-volume	08:37:52	7
1094837	99	15	9,5	cyclictest	27763	-21	gvfs-afc-volume	08:37:52	7
1094837	99	15	13,1	cyclictest	0	-21	swapper/7	08:17:52	7
1094837	99	15	0,13	cyclictest	1313	-21	snmpd	08:36:37	7
1094832	99	15	12,2	cyclictest	1455243	-21	tr	06:22:49	6
1094832	99	15	12,2	cyclictest	1407823	-21	kworker/u16:1+flush-8:0	06:07:42	6
1094830	99	15	13,2	cyclictest	1407823	-21	kworker/u16:1+events_unbound	06:52:42	5
1094826	99	15	13,2	cyclictest	1200396	-21	kworker/u16:5+events_unbound	04:27:51	4
1094826	99	15	0,1	cyclictest	0	-21	swapper/4	05:47:48	4
1094826	99	15	0,1	cyclictest	0	-21	swapper/4	05:47:48	4
1094837	99	14	7,6	cyclictest	27763	-21	gvfs-afc-volume	03:37:53	7
1094837	99	14	7,6	cyclictest	27430	-21	gmain	07:32:49	7
1094837	99	14	0,1	cyclictest	0	-21	swapper/7	08:12:54	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17