OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Sun Dec 14, 2025 12:44:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3794143	2	223	181,32	sleep3	0	-21	swapper/3	07:07:24	3
3794093	2	186	146,30	sleep2	0	-21	swapper/2	07:06:47	2
3794262	2	185	162,13	sleep0	0	-21	swapper/0	07:08:55	0
3794141	2	177	156,12	sleep1	0	-21	swapper/1	07:07:23	1
3794534	99	65	60,3	cyclictest	3982113	-21	latency_hist	10:10:00	1
3794537	99	63	43,3	cyclictest	4096019	-21	kworker/u8:4+flush-179:0	12:11:41	2
3794531	99	63	57,4	cyclictest	3936979	-21	diskstats	09:25:18	0
3794534	99	61	57,3	cyclictest	4043941	-21	kworker/u8:0+flush-179:0	11:10:34	1
3794534	99	60	54,4	cyclictest	3968160	-21	kworker/u8:0+events_unbound	10:35:29	1
3794531	99	60	54,4	cyclictest	4061010	-21	ntpq	11:25:15	0
3794534	99	59	54,3	cyclictest	3995637	-21	kworker/u8:4+events_unbound	10:50:35	1
3794531	99	59	55,3	cyclictest	4131223	-21	munin-update	12:35:35	0
3794539	99	57	54,2	cyclictest	3976744	-21	gpgv	10:05:01	3
3794537	99	55	51,3	cyclictest	3893192	-21	latency_hist	08:45:01	2
3794534	99	55	52,2	cyclictest	3986976	-21	kworker/u8:1+flush-179:0	10:25:21	1
3794534	99	55	50,3	cyclictest	4043397	-21	munin-limits	11:05:35	1
3794531	99	55	51,3	cyclictest	3914491	-21	/usr/share/muni	09:05:16	0
3794531	99	55	48,5	cyclictest	3982368	-21	/usr/share/muni	10:10:11	0
3794537	99	54	51,2	cyclictest	4069635	-21	kworker/u8:1+flush-179:0	11:35:28	2
3794534	99	54	50,3	cyclictest	3830851	-21	kworker/u8:0+flush-179:0	08:05:32	1
3794534	99	54	49,3	cyclictest	3955696	-21	kworker/u8:1+events_unbound	09:45:30	1
3794534	99	54	49,3	cyclictest	3947040	-21	kworker/u8:3+events_unbound	10:04:12	1
3794539	99	53	47,5	cyclictest	3830851	-21	kworker/u8:0+flush-179:0	09:05:11	3
3794537	99	53	39,2	cyclictest	3893492	-21	chrome	08:45:01	2
3794537	99	53	32,20	cyclictest	3913914	-21	kworker/2:2+pm	09:48:59	2
3794534	99	53	49,3	cyclictest	4026587	-21	kworker/u8:2+flush-179:0	11:00:27	1
3794539	99	52	43,6	cyclictest	3940475	-21	/usr/share/muni	09:30:11	3
3794534	99	52	47,3	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	08:03:27	1
3794531	99	52	47,4	cyclictest	3125725	-21	ThreadPoolForeg	10:25:30	0
3794534	99	51	48,2	cyclictest	4033332	-21	kworker/u8:3+events_unbound	11:43:50	1
3794539	99	50	45,3	cyclictest	3757668	-21	kworker/u8:4+events_unbound	08:20:14	3
3794537	99	50	46,3	cyclictest	3987474	-21	/usr/share/muni	10:15:19	2
3794537	99	50	23,11	cyclictest	3971293	-21	kworker/2:1+pm	11:55:30	2
3794537	99	50	1,43	cyclictest	4069309	-31	munin-graph	11:31:11	2
3794534	99	50	46,3	cyclictest	3976346	-21	kworker/u8:2+events_unbound	10:15:40	1
3794531	99	50	45,4	cyclictest	3947040	-21	kworker/u8:3+flush-179:0	09:39:31	0
3794531	99	50	42,7	cyclictest	3125687	-21	ThreadPoolForeg	07:51:55	0
3794537	99	49	44,4	cyclictest	3125688	-21	Chrome_ChildIOT	12:25:00	2
3794537	99	49	28,20	cyclictest	1260	-21	snmpd	07:58:38	2
3794534	99	49	45,3	cyclictest	4033332	-21	kworker/u8:3+flush-179:0	11:50:28	1
3794534	99	49	45,3	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	09:30:22	1
3794531	99	49	46,2	cyclictest	4026587	-21	kworker/u8:2+flush-179:0	11:05:31	0
3794539	99	48	43,4	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	07:30:22	3
3794537	99	48	43,4	cyclictest	247561	-21	ThreadPoolForeg	10:40:04	2
3794537	99	48	10,37	cyclictest	247557	-21	chrome	08:01:04	2
3794534	99	48	44,3	cyclictest	3924468	-21	kworker/u8:0+events_unbound	09:15:30	1
3794534	99	48	44,3	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	07:20:30	1
3794531	99	48	44,3	cyclictest	3956236	-21	/usr/share/muni	09:45:03	0
3961806	2	47	0,1	sleep2	0	-21	swapper/2	09:50:06	2
3794539	99	47	42,4	cyclictest	3995637	-21	kworker/u8:4+flush-179:0	10:40:36	3
3794537	99	47	44,1	cyclictest	3831815	-21	chrome	07:45:03	2
3794537	99	47	34,12	cyclictest	3125627	-21	ChromeDriver	00:55:19	2
3794537	99	47	1,16	cyclictest	247545	-13	VizCompositorTh	11:51:39	2
3794534	99	47	44,2	cyclictest	3857013	-21	kworker/u8:3+flush-179:0	08:10:19	1
3794534	99	47	43,3	cyclictest	4069635	-21	kworker/u8:1+flush-179:0	11:35:23	1
3794534	99	47	43,3	cyclictest	3986976	-21	kworker/u8:1+events_unbound	10:40:30	1
3794534	99	47	42,3	cyclictest	4079823	-21	kworker/u8:2+flush-179:0	11:55:20	1
3794534	99	47	38,5	cyclictest	3945570	-21	/usr/share/muni	09:35:10	1
3794539	99	46	41,4	cyclictest	3815575	-21	kworker/u8:2+flush-179:0	08:00:14	3
3794539	99	46	41,4	cyclictest	3773243	-21	kworker/u8:1+flush-179:0	07:50:11	3
3794537	99	46	36,9	cyclictest	3971293	-21	kworker/2:1+pm	11:16:05	2
3794537	99	46	36,7	cyclictest	3971293	-21	kworker/2:1+pm	10:07:45	2
3794537	99	46	31,14	cyclictest	4100789	-21	/usr/share/muni	12:05:17	2
3794537	99	46	26,16	cyclictest	3125726	-13	Chrome_ChildIOT	11:44:52	2
3794534	99	46	43,2	cyclictest	3995637	-21	kworker/u8:4+flush-179:0	11:30:17	1
3794534	99	46	43,2	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	09:50:22	1
3794534	99	46	42,3	cyclictest	4115664	-21	kworker/u8:1+flush-179:0	12:20:25	1
3794534	99	46	42,3	cyclictest	4115664	-21	kworker/u8:1+events_unbound	12:35:29	1
3794534	99	46	42,3	cyclictest	3887727	-21	kworker/u8:2+flush-179:0	08:50:29	1
3794534	99	46	42,3	cyclictest	3773243	-21	kworker/u8:1+flush-179:0	07:50:12	1
3794534	99	46	42,3	cyclictest	3757668	-21	kworker/u8:4+events_unbound	10:10:09	1
3794534	99	46	41,4	cyclictest	4043941	-21	kworker/u8:0+events_unbound	11:15:35	1
3794534	99	46	41,4	cyclictest	3773243	-21	kworker/u8:1+events_unbound	07:45:34	1
3794534	99	46	40,4	cyclictest	3703508	-21	kworker/u8:0+flush-179:0	07:25:26	1
3794534	99	46	32,3	cyclictest	3995637	-21	kworker/u8:4+flush-179:0	11:20:22	1
3794531	99	46	43,3	cyclictest	3887727	-21	kworker/u8:2+flush-179:0	09:40:12	0
3794531	99	46	42,3	cyclictest	3830851	-21	kworker/u8:0+flush-179:0	08:25:16	0
3794531	99	46	42,2	cyclictest	3894895	-21	kworker/u8:1+flush-179:0	08:45:31	0
3794531	99	46	34,3	cyclictest	3816144	-21	/usr/share/muni	07:30:04	0
3794531	99	46	30,14	cyclictest	4006815	-21	ntpq	10:30:36	0
3794537	99	45	39,5	cyclictest	4121261	-21	/usr/share/muni	12:25:09	2
3794537	99	45	0,1	cyclictest	3125684	-21	Chrome_DevTools	10:11:10	2
3794534	99	45	41,3	cyclictest	4089924	-21	kworker/u8:0+flush-179:0	12:25:21	1
3794534	99	45	41,3	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	09:20:07	1
3794534	99	45	41,3	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	07:15:28	1
3794534	99	45	41,3	cyclictest	3757668	-21	kworker/u8:4+flush-179:0	07:15:27	1
3794534	99	45	39,4	cyclictest	3935256	-21	/usr/share/muni	09:25:03	1
3794531	99	45	39,5	cyclictest	247516	-21	Chrome_ChildIOT	10:00:39	0
3794537	99	44	36,6	cyclictest	3125687	-21	ThreadPoolForeg	12:04:59	2
3794537	99	44	35,8	cyclictest	3913914	-21	kworker/2:2+pm	09:08:42	2
3794537	99	44	34,9	cyclictest	3971293	-21	kworker/2:1+pm	10:20:04	2
3794534	99	44	41,2	cyclictest	4115664	-21	kworker/u8:1+events_unbound	12:30:28	1
3794534	99	44	41,2	cyclictest	3830851	-21	kworker/u8:0+flush-179:0	08:25:20	1
3794534	99	44	40,3	cyclictest	3986976	-21	kworker/u8:1+flush-179:0	10:55:29	1
3794534	99	44	40,3	cyclictest	3955696	-21	kworker/u8:1+events_unbound	09:42:08	1
3794534	99	44	40,3	cyclictest	3773243	-21	kworker/u8:1+events_unbound	07:30:05	1
3794534	99	44	39,2	cyclictest	2863913	-1	kworker/1:0H+kblockd	12:00:33	1
3794539	99	43	39,3	cyclictest	3968160	-21	kworker/u8:0+flush-179:0	10:28:17	3
3794539	99	43	39,3	cyclictest	3858919	-21	apt-get	08:10:14	3
3794539	99	43	37,4	cyclictest	4115664	-21	kworker/u8:1+flush-179:0	12:30:36	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17