OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #7

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot7.osadl.org (updated Fri Sep 20, 2024 00:45:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1749364	99	421	24,396	cyclictest	0	-21	swapper/8	19:31:54	14
1749364	99	418	25,393	cyclictest	0	-21	swapper/8	19:11:36	14
1749362	99	417	415,1	cyclictest	1834102	-21	kworker/6:1+events@ output_poll_execute	19:29:52	12
1749371	99	414	0,14	cyclictest	0	-21	swapper/15	19:22:12	7
1749365	99	413	17,396	cyclictest	0	-21	swapper/9	19:23:51	15
1749363	99	413	413,0	cyclictest	0	-21	swapper/7	19:14:55	13
1749371	99	411	0,12	cyclictest	0	-21	swapper/15	19:16:52	7
1749371	99	411	0,12	cyclictest	0	-21	swapper/15	19:16:52	7
1749371	99	403	0,2	cyclictest	0	-21	swapper/15	19:28:54	7
1749367	99	395	393,1	cyclictest	1345758	-21	kworker/11:2+events@ output_poll_execute	19:18:59	3
1749367	99	395	393,1	cyclictest	1345758	-21	kworker/11:2+events@ output_poll_execute	19:18:58	3
1749363	99	394	392,2	cyclictest	712112	-21	Renderer	19:22:12	13
1749360	99	392	391,1	cyclictest	712112	-21	Renderer	19:16:12	10
1749360	99	392	391,1	cyclictest	712112	-21	Renderer	19:16:11	10
1749363	99	389	388,0	cyclictest	1690391	-21	kworker/7:0+events@ output_poll_execute	19:16:52	13
1749363	99	389	388,0	cyclictest	1690391	-21	kworker/7:0+events@ output_poll_execute	19:16:52	13
1749361	99	387	384,3	cyclictest	712241	-21	WRRende~ckend#2	19:23:13	11
1749358	99	387	386,1	cyclictest	0	-21	swapper/2	19:22:29	8
1749363	99	383	381,1	cyclictest	1748886	-21	kworker/7:2+events@ output_poll_execute	19:28:54	13
1749359	99	378	378,0	cyclictest	0	-21	swapper/3	19:29:51	9
1749368	99	372	372,0	cyclictest	0	-21	swapper/12	19:26:30	4
1749361	99	370	370,0	cyclictest	0	-21	swapper/5	19:30:52	11
1749361	99	370	368,1	cyclictest	1538254	-21	kworker/5:0+events@ output_poll_execute	19:26:53	11
1749359	99	365	365,0	cyclictest	0	-21	swapper/3	19:10:56	9
1749361	99	364	364,0	cyclictest	0	-21	swapper/5	19:12:12	11
1749359	99	364	362,1	cyclictest	1795488	-21	kworker/3:2+events@ output_poll_execute	19:31:32	9
1749370	99	363	363,0	cyclictest	0	-21	swapper/14	19:31:33	6
1749369	99	363	360,3	cyclictest	712112	-21	Renderer	19:23:12	5
1749359	99	363	362,0	cyclictest	1689531	-21	kworker/3:0+events@ output_poll_execute	19:22:52	9
1749360	99	362	360,1	cyclictest	0	-21	swapper/4	19:29:52	10
1749367	99	360	359,1	cyclictest	273	50	irq/129-xhci_hcd	19:28:54	3
1749370	99	357	0,357	cyclictest	0	-21	swapper/14	19:16:29	6
1749370	99	357	0,357	cyclictest	0	-21	swapper/14	19:16:29	6
1749357	99	354	352,2	cyclictest	8991	-21	Xorg	19:24:43	1
1749356	99	353	349,3	cyclictest	1768141	-21	kworker/0:0+events@ output_poll_execute	19:31:55	0
1749356	99	353	348,4	cyclictest	1555547	-21	kworker/0:1+events@ output_poll_execute	19:11:35	0
1749360	99	352	351,0	cyclictest	0	-21	swapper/4	19:14:34	10
1749362	99	350	349,1	cyclictest	8991	-21	Xorg	19:16:29	12
1749362	99	350	349,1	cyclictest	8991	-21	Xorg	19:16:29	12
1749369	99	348	346,1	cyclictest	1851900	-21	kworker/13:0+events@ output_poll_execute	19:30:52	5
1749361	99	348	348,0	cyclictest	0	-21	swapper/5	19:15:59	11
1749361	99	348	348,0	cyclictest	0	-21	swapper/5	19:15:59	11
1749356	99	346	343,3	cyclictest	0	-21	swapper/0	19:20:49	0
1749369	99	345	345,0	cyclictest	0	-21	swapper/13	19:26:53	5
1749368	99	344	343,1	cyclictest	3354436	-21	firefox	19:16:12	4
1749368	99	344	343,1	cyclictest	3354436	-21	firefox	19:16:11	4
1749369	99	341	340,1	cyclictest	712112	-21	Renderer	19:12:12	5
1749366	99	334	331,3	cyclictest	8991	-21	Xorg	19:22:29	2
1749359	99	331	331,0	cyclictest	0	-21	swapper/3	19:18:59	9
1749359	99	331	331,0	cyclictest	0	-21	swapper/3	19:18:58	9
1749369	99	325	324,1	cyclictest	9562	20	pipewire	19:15:59	5
1749369	99	325	324,1	cyclictest	9562	20	pipewire	19:15:58	5
1749357	99	313	14,299	cyclictest	0	-21	swapper/1	19:15:46	1
1749357	99	313	14,299	cyclictest	0	-21	swapper/1	19:15:46	1
1749357	99	309	307,1	cyclictest	1671609	-21	kworker/1:2+events@ output_poll_execute	19:12:58	1
1749368	99	305	303,1	cyclictest	1555542	-21	kworker/12:1+events@ output_poll_execute	19:14:35	4
1749367	99	300	0,299	cyclictest	0	-21	swapper/11	19:22:51	3
1749365	99	291	7,283	cyclictest	4104532	-21	Isolated	10:48:07	15
1749370	99	290	0,289	cyclictest	0	-21	swapper/14	19:27:51	6
1749356	99	290	285,4	cyclictest	1768141	-21	kworker/0:0+kacpi_notify@ acpi_os_execute_deferred	19:17:33	0
1749356	99	290	285,4	cyclictest	1768141	-21	kworker/0:0+kacpi_notify@ acpi_os_execute_deferred	19:17:33	0
1749371	99	289	289,0	cyclictest	0	-21	swapper/15	19:31:55	7
1749370	99	289	0,288	cyclictest	0	-21	swapper/14	19:22:11	6
1749371	99	288	288,0	cyclictest	0	-21	swapper/15	19:11:36	7
1749365	99	288	287,0	cyclictest	1729577	-21	kworker/9:2+events@ output_poll_execute	19:15:46	15
1749365	99	288	287,0	cyclictest	1729577	-21	kworker/9:2+events@ output_poll_execute	19:15:45	15
1749370	99	284	0,283	cyclictest	0	-21	swapper/14	19:13:52	6
1749358	99	284	282,1	cyclictest	1748783	-21	kworker/2:1+pm@ pm_runtime_work	19:16:11	8
1749358	99	284	282,1	cyclictest	1748783	-21	kworker/2:1+pm@ pm_runtime_work	19:16:11	8
1749368	99	283	279,4	cyclictest	712112	-21	Renderer	19:30:06	4
1749366	99	283	0,282	cyclictest	0	-21	swapper/10	19:18:00	2
1749366	99	283	0,282	cyclictest	0	-21	swapper/10	19:18:00	2
1749362	99	281	280,0	cyclictest	1767997	-21	kworker/6:2+pm@ pm_runtime_work	19:22:11	12
1749362	99	279	276,2	cyclictest	1767997	-21	kworker/6:2+events@ output_poll_execute	19:13:52	12
1749364	99	277	0,276	cyclictest	712241	-21	WRRende~ckend#2	19:18:13	14
1749364	99	277	0,276	cyclictest	712241	-21	WRRende~ckend#2	19:18:12	14
1749367	99	276	276,0	cyclictest	0	-21	swapper/11	19:12:12	3
1749362	99	274	270,3	cyclictest	9356	-21	gnome-shell	19:30:52	12
1749356	99	268	265,2	cyclictest	0	-21	swapper/0	19:28:54	0
1748616	2	268	261,4	sleep3	0	-21	swapper/3	19:07:37	9
1749363	99	264	263,0	cyclictest	1690391	-21	kworker/7:0+events@ output_poll_execute	19:32:30	13
1749360	99	264	262,1	cyclictest	0	-21	swapper/4	19:24:11	10
1749364	99	253	252,0	cyclictest	1729620	-21	kworker/8:2+pm@ pm_runtime_work	19:20:38	14
1749357	99	253	246,4	cyclictest	1671609	-21	kworker/1:2+pm@ pm_runtime_work	19:32:42	1
1749366	99	250	248,1	cyclictest	1306002	-21	kworker/10:1+events@ drm_mode_rmfb_work_fn	19:11:01	2
1749367	99	249	249,0	cyclictest	0	-21	swapper/11	19:31:21	3
1749366	99	232	228,1	cyclictest	9356	-21	gnome-shell	22:55:01	2
1749365	99	223	223,0	cyclictest	0	-21	swapper/9	19:32:54	15
1749364	99	220	3,121	cyclictest	0	-21	swapper/8	23:05:01	14
1749356	99	219	212,6	cyclictest	0	-21	swapper/0	22:55:01	0
1749364	99	218	3,119	cyclictest	0	-21	swapper/8	22:25:00	14
1749368	99	216	214,2	cyclictest	712112	-21	Renderer	19:24:10	4
1749358	99	210	209,1	cyclictest	0	-21	swapper/2	19:10:56	8
1748763	2	200	158,32	sleep12	0	-21	swapper/12	19:08:33	4
1748517	2	198	166,23	sleep0	0	-21	swapper/0	19:06:46	0
1749358	99	197	193,4	cyclictest	9356	-21	gnome-shell	19:27:58	8
1749364	99	193	192,1	cyclictest	0	-21	swapper/8	19:26:53	14
1748406	2	187	162,15	sleep8	0	-21	swapper/8	19:06:04	14
1748471	2	178	155,14	sleep7	0	-21	swapper/7	19:06:36	13
1749364	99	175	3,72	cyclictest	2351817	-21	Isolated	10:48:07	14
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17