OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #7

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot7.osadl.org (updated Tue Jan 21, 2025 00:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1466406	99	425	0,30	cyclictest	0	-21	swapper/9	00:09:15	15
1466406	99	408	8,400	cyclictest	117	-21	ksoftirqd/9	00:36:49	15
1466399	99	403	9,394	cyclictest	2577720	-21	python3	23:59:56	13
1466380	99	403	6,397	cyclictest	1957446	-21	build-lib	23:50:55	8
1466391	99	399	397,2	cyclictest	0	-21	swapper/5	00:33:23	11
1466377	99	399	7,392	cyclictest	0	-21	swapper/1	23:51:56	1
1466428	99	398	0,397	cyclictest	1214279	-21	turbostat	23:44:55	7
1466425	99	397	0,396	cyclictest	0	-21	swapper/14	00:09:46	6
1466377	99	397	4,393	cyclictest	0	-21	swapper/1	00:03:24	1
1466420	99	395	392,2	cyclictest	1561890	-21	kworker/13:0+events@ output_poll_execute	00:33:23	5
1466377	99	392	390,2	cyclictest	0	-21	swapper/1	00:10:45	1
1466425	99	384	0,383	cyclictest	0	-21	swapper/14	23:58:21	6
1466375	99	383	380,2	cyclictest	1878124	-21	kworker/0:1+events@ output_poll_execute	23:53:36	0
1466375	99	381	377,4	cyclictest	0	-21	swapper/0	23:57:11	0
1466425	99	380	378,1	cyclictest	0	-21	swapper/14	23:53:59	6
1466380	99	380	379,1	cyclictest	74546	-21	Renderer	00:31:22	8
1466428	99	379	0,378	cyclictest	0	-21	swapper/15	00:11:17	7
1466410	99	375	373,1	cyclictest	1052691	-21	kworker/10:2+events@ output_poll_execute	00:36:22	2
1466404	99	375	372,2	cyclictest	2514284	-21	kworker/8:1+events@ output_poll_execute	00:06:25	14
1466410	99	374	372,1	cyclictest	3657621	-21	kworker/10:1+events@ output_poll_execute	23:45:49	2
1466389	99	374	372,2	cyclictest	0	-21	swapper/4	00:06:47	10
1466377	99	371	370,1	cyclictest	74546	-21	Renderer	00:09:15	1
1466410	99	370	367,2	cyclictest	1052691	-21	kworker/10:2+events@ output_poll_execute	00:32:20	2
1466377	99	370	369,1	cyclictest	9777	-21	gnome-shell	23:46:59	1
1466391	99	369	369,0	cyclictest	0	-21	swapper/5	23:52:12	11
1466385	99	367	366,1	cyclictest	74546	-21	Renderer	23:55:18	9
1466375	99	366	359,6	cyclictest	592030	-21	kworker/0:0+events@ delayed_vfree_work	00:06:24	0
1466420	99	365	364,1	cyclictest	74546	-21	Renderer	23:52:13	5
1466389	99	363	363,0	cyclictest	0	-21	swapper/4	00:04:26	10
1466414	99	360	360,0	cyclictest	0	-21	swapper/11	23:55:19	3
1466377	99	359	357,1	cyclictest	1944101	-21	kworker/1:0+events@ output_poll_execute	00:36:49	1
1466425	99	357	0,357	cyclictest	0	-21	swapper/14	00:01:21	6
1466406	99	354	352,2	cyclictest	0	-21	swapper/9	23:56:59	15
1466418	99	353	352,1	cyclictest	0	-21	swapper/12	00:34:11	4
1466410	99	348	347,1	cyclictest	74546	-21	Renderer	23:57:20	2
1466399	99	348	348,0	cyclictest	941840	-21	python3	23:44:54	13
1466380	99	347	346,1	cyclictest	0	-21	swapper/2	00:36:21	8
1466418	99	346	278,1	cyclictest	1287424	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	23:53:59	4
1466404	99	346	343,2	cyclictest	1489506	-21	kworker/8:2+pm@ pm_runtime_work	00:04:16	14
1466380	99	346	344,2	cyclictest	0	-21	swapper/2	23:45:48	8
1466396	99	343	342,0	cyclictest	2276377	-21	kworker/6:1+events@ output_poll_execute	23:58:21	12
1466425	99	342	0,341	cyclictest	0	-21	swapper/14	00:32:47	6
1466375	99	337	330,6	cyclictest	0	-21	swapper/0	00:04:17	0
1466391	99	333	332,1	cyclictest	3665111	-21	Renderer	00:05:53	11
1466399	99	330	329,1	cyclictest	74546	-21	Renderer	00:11:17	13
1466404	99	329	329,0	cyclictest	0	-21	swapper/8	00:33:44	14
1466404	99	329	328,1	cyclictest	74546	-21	Renderer	23:53:14	14
1466420	99	328	327,1	cyclictest	3406759	-21	build-bin	00:05:54	5
1466396	99	327	325,1	cyclictest	3587128	-21	kworker/6:0+events@ output_poll_execute	00:09:46	12
1466404	99	325	325,0	cyclictest	0	-21	swapper/8	23:55:48	14
1466425	99	322	321,1	cyclictest	0	-21	swapper/14	00:37:22	6
1466385	99	322	319,2	cyclictest	3789689	-21	kworker/3:0+events@ output_poll_execute	00:35:49	9
1466428	99	321	319,1	cyclictest	0	-21	swapper/15	23:56:39	7
1466380	99	320	320,0	cyclictest	0	-21	swapper/2	23:57:19	8
1466375	99	320	316,3	cyclictest	3653199	-21	kworker/0:1+events@ output_poll_execute	00:33:45	0
1466385	99	317	315,1	cyclictest	1511618	-21	kworker/3:0+events@ output_poll_execute	23:52:36	9
1466414	99	316	314,2	cyclictest	3954485	-21	Isolated	11:44:24	3
1466389	99	316	314,1	cyclictest	965733	-21	kworker/4:2+pm@ pm_runtime_work	00:34:11	10
1466414	99	313	310,3	cyclictest	1626406	-21	build-lib	23:52:35	3
1466391	99	313	312,1	cyclictest	1750091	-21	sed	23:47:58	11
1466428	99	312	0,311	cyclictest	0	-21	swapper/15	00:02:53	7
1466385	99	312	310,1	cyclictest	3789689	-21	kworker/3:0+events@ output_poll_execute	00:31:44	9
1466406	99	311	309,1	cyclictest	1108428	-21	kworker/9:1+events@ output_poll_execute	23:51:57	15
1466428	99	309	307,1	cyclictest	0	-21	swapper/15	23:53:59	7
1466420	99	308	306,1	cyclictest	407096	-21	kworker/13:1+events@ output_poll_execute	23:47:57	5
1466406	99	308	307,0	cyclictest	1955890	-21	kworker/9:2+events@ output_poll_execute	00:03:23	15
1466414	99	306	304,2	cyclictest	0	-21	swapper/11	00:31:43	3
1466425	99	304	0,303	cyclictest	0	-21	swapper/14	23:47:34	6
1466410	99	298	298,0	cyclictest	0	-21	swapper/10	00:00:47	2
1466396	99	297	291,2	cyclictest	1896395	-21	kworker/6:2+events@ output_poll_execute	23:54:38	12
1466404	99	292	5,0	cyclictest	0	-21	swapper/8	00:10:45	14
1466396	99	292	290,1	cyclictest	632018	-21	kworker/6:2+pm@ pm_runtime_work	00:32:36	12
1466396	99	290	287,2	cyclictest	2276377	-21	kworker/6:1+events@ output_poll_execute	00:01:21	12
1466389	99	289	289,0	cyclictest	0	-21	swapper/4	23:54:11	10
1466418	99	288	286,2	cyclictest	74546	-21	Renderer	00:01:53	4
1466414	99	287	286,1	cyclictest	74546	-21	Renderer	23:49:32	3
1466375	99	287	0,0	cyclictest	0	-21	swapper/0	23:48:36	0
1466418	99	286	284,1	cyclictest	3127184	-21	kworker/12:1+events@ output_poll_execute	00:06:48	4
1466375	99	286	279,6	cyclictest	3653199	-21	kworker/0:1+kacpi_notify@ acpi_os_execute_deferred	00:10:45	0
1466404	99	285	282,2	cyclictest	1489506	-21	kworker/8:2+events@ output_poll_execute	23:48:47	14
1466428	99	283	282,0	cyclictest	0	-21	swapper/15	23:48:46	7
1466399	99	282	278,3	cyclictest	1851094	-21	kworker/7:0+pm@ pm_runtime_work	00:02:42	13
1466428	99	280	278,1	cyclictest	0	-21	swapper/15	00:09:46	7
1466377	99	279	278,1	cyclictest	9777	-21	gnome-shell	23:56:59	1
1466414	99	278	276,2	cyclictest	9777	-21	gnome-shell	00:00:58	3
1466380	99	278	277,1	cyclictest	192065	-21	kworker/2:1+pm@ pm_runtime_work	00:00:38	8
1466385	99	277	273,3	cyclictest	3560264	-21	kworker/3:2+events@ output_poll_execute	23:44:39	9
1466396	99	276	272,3	cyclictest	9777	-21	gnome-shell	23:49:59	12
1466385	99	276	273,2	cyclictest	3738826	-21	grep	00:08:20	9
1466391	99	275	272,2	cyclictest	9777	-21	gnome-shell	00:02:59	11
1466385	99	275	274,1	cyclictest	74546	-21	Renderer	23:46:14	9
1466406	99	274	270,3	cyclictest	1955890	-21	kworker/9:2+events@ output_poll_execute	00:10:44	15
1466391	99	273	273,0	cyclictest	0	-21	swapper/5	23:56:13	11
1466428	99	271	271,0	cyclictest	0	-21	swapper/15	00:33:45	7
1466399	99	271	269,1	cyclictest	1394580	-21	kworker/7:2+events@ output_poll_execute	23:46:37	13
1466414	99	270	267,3	cyclictest	74546	-21	Renderer	00:08:21	3
1466420	99	269	268,0	cyclictest	1561890	-21	kworker/13:0+pm@ pm_runtime_work	23:56:13	5
1466420	99	269	267,1	cyclictest	0	-21	swapper/13	00:02:58	5
1466414	99	269	267,2	cyclictest	0	-21	swapper/11	23:44:40	3
1466418	99	264	262,2	cyclictest	1626406	-21	build-lib	23:48:47	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17