OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Fri Jun 20, 2025 12:44:37)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4009761	2	216	187,19	sleep2	0	-21	swapper/2	07:08:55	2
4009707	2	216	187,19	sleep3	0	-21	swapper/3	07:08:11	3
4009660	2	201	173,18	sleep0	0	-21	swapper/0	07:07:36	0
4009796	2	198	170,18	sleep1	0	-21	swapper/1	07:09:21	1
4010050	99	90	0,55	cyclictest	34501	-21	/usr/share/muni	10:45:02	0
4010050	99	64	61,2	cyclictest	131418	-21	kworker/u8:1+flush-179:0	12:30:01	0
4010050	99	63	61,2	cyclictest	4151994	-21	kworker/u8:1+flush-179:0	09:30:35	0
4010050	99	59	56,2	cyclictest	4162561	-21	kworker/u8:0+flush-179:0	09:45:33	0
4010056	99	58	55,2	cyclictest	4023008	-21	kworker/u8:1+events_unbound	09:17:03	2
4010056	99	57	7,50	cyclictest	4009929	-21	kworker/u8:4+efi_rts_wq	07:13:30	2
4010050	99	57	54,2	cyclictest	3968800	-21	kworker/u8:0+events_unbound	07:25:11	0
4010056	99	56	52,3	cyclictest	19396	-21	kworker/u8:1+events_unbound	11:50:20	2
4010061	99	55	50,3	cyclictest	23714	-21	/usr/share/muni	10:35:11	3
4010056	99	55	52,2	cyclictest	99514	-21	kworker/u8:3+flush-179:0	12:25:35	2
4010056	99	55	51,3	cyclictest	4151994	-21	kworker/u8:1+flush-179:0	09:35:18	2
4010050	99	55	52,2	cyclictest	4109160	-21	kworker/u8:2+flush-179:0	09:40:20	0
4010050	99	55	52,2	cyclictest	4109160	-21	kworker/u8:2+flush-179:0	09:40:20	0
4010056	99	54	51,2	cyclictest	4162561	-21	kworker/u8:0+flush-179:0	10:15:11	2
4010056	99	54	50,3	cyclictest	4061294	-21	kworker/u8:0+flush-179:0	08:15:30	2
4010056	99	54	39,13	cyclictest	4167309	-21	chrome	09:45:01	2
4010056	99	54	39,13	cyclictest	4167309	-21	chrome	09:45:01	2
4010056	99	53	50,2	cyclictest	4023008	-21	kworker/u8:1+events_unbound	08:40:20	2
4010050	99	53	50,2	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	09:15:19	0
4010056	99	52	48,3	cyclictest	4073454	-21	kworker/u8:4+flush-179:0	08:20:18	2
4010050	99	52	48,3	cyclictest	4081293	-21	kworker/u8:2+flush-179:0	08:30:15	0
4010050	99	51	48,2	cyclictest	99514	-21	kworker/u8:3+flush-179:0	11:50:34	0
4010050	99	51	47,4	cyclictest	4156920	-21	kworker/u8:4+flush-179:0	09:55:31	0
4010050	99	51	47,3	cyclictest	4061294	-21	kworker/u8:0+flush-179:0	08:20:18	0
4010050	99	51	47,3	cyclictest	4030427	-21	kworker/u8:2+flush-179:0	07:40:34	0
4010050	99	51	46,4	cyclictest	4096173	-21	kworker/u8:0+events_unbound	08:40:01	0
4010056	99	50	44,5	cyclictest	4109160	-21	kworker/u8:2+flush-179:0	10:05:33	2
4010050	99	50	46,2	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	08:50:19	0
4010061	99	49	41,6	cyclictest	1515559	-21	ThreadPoolForeg	10:30:33	3
4010056	99	49	45,3	cyclictest	4162561	-21	kworker/u8:0+flush-179:0	10:45:28	2
4010056	99	49	45,3	cyclictest	4101774	-21	kworker/u8:3+flush-179:0	09:00:15	2
4010056	99	49	45,3	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	09:13:31	2
4010050	99	49	46,2	cyclictest	64575	-21	kworker/u8:2+flush-179:0	11:20:20	0
4010056	99	48	45,2	cyclictest	91938	-21	kworker/u8:2+events_unbound	11:45:05	2
4010056	99	48	45,2	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	07:55:12	2
4010056	99	48	45,2	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	07:20:33	2
4010051	99	48	44,3	cyclictest	4152332	-21	/usr/share/muni	09:30:01	1
4010051	99	48	42,4	cyclictest	4091593	-21	/usr/share/muni	08:30:00	1
4010050	99	48	45,2	cyclictest	4009929	-21	kworker/u8:4+flush-179:0	07:15:05	0
4010050	99	48	45,2	cyclictest	3994277	-21	kworker/u8:3+flush-179:0	07:35:20	0
4010050	99	48	45,2	cyclictest	19396	-21	kworker/u8:1+events_unbound	11:45:12	0
4010050	99	48	44,3	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	08:55:19	0
4010050	99	47	44,2	cyclictest	44224	-21	kworker/u8:3+flush-179:0	10:55:32	0
4010056	99	46	44,2	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	08:05:11	2
4010056	99	46	43,2	cyclictest	4162561	-21	kworker/u8:0+flush-179:0	10:30:31	2
4010056	99	46	43,2	cyclictest	4009929	-21	kworker/u8:4+events_unbound	07:15:33	2
4010056	99	46	42,3	cyclictest	4023008	-21	kworker/u8:1+events_unbound	08:45:19	2
4010056	99	46	42,2	cyclictest	4046361	-21	/usr/share/muni	07:45:02	2
4010051	99	46	41,3	cyclictest	4086347	-21	latency_hist	08:25:01	1
4010050	99	46	43,2	cyclictest	4162561	-21	kworker/u8:0+flush-179:0	10:05:10	0
4010050	99	46	42,3	cyclictest	99514	-21	kworker/u8:3+flush-179:0	12:00:11	0
4010050	99	46	42,3	cyclictest	4162561	-21	kworker/u8:0+events_unbound	11:35:19	0
4010050	99	46	42,3	cyclictest	4156920	-21	kworker/u8:4+events_unbound	09:35:33	0
4010050	99	46	0,44	cyclictest	1515603	-21	chrome	08:40:21	0
4010061	99	45	40,3	cyclictest	4106666	-21	chrome	08:45:01	3
4010061	99	45	39,4	cyclictest	64769	-21	/usr/share/muni	11:15:05	3
4010061	99	45	38,5	cyclictest	4051473	-21	/usr/share/muni	07:50:10	3
4010056	99	45	44,1	cyclictest	4023008	-21	kworker/u8:1+events_unbound	07:35:33	2
4010056	99	45	42,2	cyclictest	99514	-21	kworker/u8:3+flush-179:0	12:00:11	2
4010056	99	45	42,2	cyclictest	4051578	-21	/usr/share/muni	07:50:04	2
4010050	99	45	41,3	cyclictest	4106722	-21	/usr/share/muni	08:45:18	0
4010050	99	45	41,3	cyclictest	4045776	-21	kworker/u8:3+flush-179:0	08:00:23	0
4010050	99	45	39,4	cyclictest	4109160	-21	kworker/u8:2+flush-179:0	10:00:10	0
4010061	99	44	1,43	cyclictest	4009929	-21	kworker/u8:4+efi_rts_wq	07:13:28	3
4010056	99	44	41,2	cyclictest	4101774	-21	kworker/u8:3+flush-179:0	09:25:06	2
4010056	99	44	41,2	cyclictest	4101774	-21	kworker/u8:3+flush-179:0	09:25:05	2
4010056	99	44	41,2	cyclictest	3968800	-21	kworker/u8:0+events_unbound	07:40:10	2
4010051	99	44	39,4	cyclictest	1515610	-21	ThreadPoolForeg	10:35:32	1
4010051	99	44	38,5	cyclictest	79917	-21	/usr/share/muni	11:30:04	1
4010051	99	44	31,2	cyclictest	1515606	-21	ThreadPoolForeg	09:45:01	1
4010051	99	44	31,2	cyclictest	1515606	-21	ThreadPoolForeg	09:45:01	1
4010050	99	44	41,2	cyclictest	4023008	-21	kworker/u8:1+flush-179:0	08:15:09	0
4010061	99	43	34,8	cyclictest	823100	-1	kworker/3:2H+kblockd	11:47:28	3
4010056	99	43	40,3	cyclictest	44224	-21	kworker/u8:3+flush-179:0	11:00:17	2
4010056	99	43	39,3	cyclictest	126019	-21	kworker/u8:0+events_unbound	12:20:02	2
4010051	99	43	40,2	cyclictest	12813	-21	kworker/u8:3+flush-179:0	10:25:01	1
4010051	99	43	39,3	cyclictest	19396	-21	kworker/u8:1+flush-179:0	11:10:20	1
4010051	99	43	37,4	cyclictest	56113	-21	apt-get	11:05:13	1
4010050	99	43	39,3	cyclictest	4109160	-21	kworker/u8:2+flush-179:0	10:35:19	0
4010050	99	43	39,2	cyclictest	4109160	-21	kworker/u8:2+flush-179:0	09:50:21	0
4010050	99	43	37,4	cyclictest	4046331	-21	chrome	07:45:01	0
4010061	99	42	32,9	cyclictest	823100	-1	kworker/3:2H+kblockd	07:29:03	3
4010056	99	42	39,2	cyclictest	64575	-21	kworker/u8:2+flush-179:0	11:25:28	2
4010056	99	42	39,2	cyclictest	4023008	-21	kworker/u8:1+events_unbound	07:30:09	2
4010056	99	42	38,3	cyclictest	4101774	-21	kworker/u8:3+events_unbound	09:05:28	2
4010056	99	42	30,11	cyclictest	4040237	-21	kworker/2:2+pm	11:08:41	2
4010050	99	42	39,2	cyclictest	4162561	-21	kworker/u8:0+flush-179:0	10:30:10	0
4010050	99	42	38,3	cyclictest	4162561	-21	kworker/u8:0+events_unbound	10:15:56	0
4010050	99	42	38,3	cyclictest	4101774	-21	kworker/u8:3+flush-179:0	09:10:04	0
4010061	99	41	37,3	cyclictest	4162561	-21	kworker/u8:0+events_unbound	10:45:02	3
4010061	99	41	37,3	cyclictest	4022553	-21	apt-get	07:20:13	3
4010061	99	41	36,4	cyclictest	4151382	-31	munin-html	09:25:34	3
4010061	99	41	36,4	cyclictest	4151382	-31	munin-html	09:25:34	3
4010056	99	41	35,5	cyclictest	4111828	-21	/usr/share/muni	08:50:10	2
4010050	99	41	38,2	cyclictest	19396	-21	kworker/u8:1+events_unbound	11:10:13	0
4010050	99	41	38,2	cyclictest	126019	-21	kworker/u8:0+events_unbound	12:20:20	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17