OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Tue Dec 09, 2025 12:44:42)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
625575	2	209	186,13	sleep1	0	-21	swapper/1	07:07:37	1
625577	2	205	182,13	sleep3	0	-21	swapper/3	07:07:38	3
621404	2	194	159,25	sleep2	0	-21	swapper/2	07:05:08	2
625604	2	189	165,14	sleep0	0	-21	swapper/0	07:07:55	0
625987	99	67	61,4	cyclictest	886743	-21	/usr/share/muni	11:20:03	0
625996	99	66	61,3	cyclictest	598866	-21	kworker/u8:2+flush-179:0	07:15:39	3
625993	99	66	62,3	cyclictest	604641	-21	kworker/u8:5+events_unbound	07:15:03	2
625996	99	62	49,10	cyclictest	751190	-21	kworker/u8:4+events_unbound	10:10:22	3
625993	99	62	58,3	cyclictest	865323	-21	kworker/u8:1+events_unbound	11:15:15	2
625993	99	62	21,10	cyclictest	912499	-26	chrome	11:45:01	2
625993	99	59	54,4	cyclictest	782564	-21	/usr/share/muni	09:40:01	2
625989	99	59	56,2	cyclictest	834071	-21	kworker/u8:2+events_unbound	11:20:18	1
625989	99	59	54,4	cyclictest	3125724	-21	ThreadPoolForeg	07:10:37	1
625989	99	59	18,38	cyclictest	912456	-21	snmp_ryswitch.c	11:45:01	1
625989	99	58	54,3	cyclictest	891342	-21	kworker/u8:5+flush-179:0	11:25:09	1
625989	99	57	52,2	cyclictest	839385	-21	kworker/u8:3+flush-179:0	10:45:26	1
625987	99	57	4,53	cyclictest	751190	-21	kworker/u8:4+efi_rts_wq	09:11:58	0
625996	99	56	52,3	cyclictest	647392	-21	kworker/u8:1+flush-179:0	07:30:30	3
625993	99	56	53,2	cyclictest	647379	-21	kworker/u8:0+flush-179:0	07:40:35	2
625989	99	56	52,3	cyclictest	679882	-21	kworker/u8:5+events_unbound	08:14:00	1
625993	99	55	51,3	cyclictest	668823	-21	kworker/u8:4+flush-179:0	08:55:42	2
625989	99	55	52,2	cyclictest	897273	-21	kworker/u8:0+flush-179:0	11:50:31	1
625989	99	55	51,3	cyclictest	679882	-21	kworker/u8:5+events_unbound	08:20:14	1
625989	99	55	51,2	cyclictest	668823	-21	kworker/u8:4+flush-179:0	08:05:13	1
625993	99	53	49,3	cyclictest	679882	-21	kworker/u8:5+events_unbound	09:25:15	2
625989	99	53	50,2	cyclictest	834071	-21	kworker/u8:2+flush-179:0	12:10:10	1
625989	99	53	50,2	cyclictest	771826	-21	kworker/u8:0+flush-179:0	10:20:14	1
625989	99	53	50,2	cyclictest	771826	-21	kworker/u8:0+flush-179:0	09:50:14	1
625989	99	53	50,2	cyclictest	668814	-21	kworker/u8:3+flush-179:0	07:50:31	1
625996	99	52	48,3	cyclictest	771826	-21	kworker/u8:0+flush-179:0	10:25:13	3
625996	99	52	47,4	cyclictest	679882	-21	kworker/u8:5+flush-179:0	08:10:34	3
625993	99	52	49,2	cyclictest	647392	-21	kworker/u8:1+flush-179:0	07:30:37	2
625989	99	52	49,2	cyclictest	668823	-21	kworker/u8:4+flush-179:0	08:55:30	1
625989	99	52	48,3	cyclictest	922324	-21	kworker/u8:3+events_unbound	12:00:00	1
625987	99	52	47,4	cyclictest	964010	-21	/usr/share/muni	12:35:11	0
625993	99	51	48,2	cyclictest	839385	-21	kworker/u8:3+events_unbound	11:35:00	2
625993	99	51	48,2	cyclictest	679882	-21	kworker/u8:5+events_unbound	09:20:32	2
625989	99	51	48,2	cyclictest	865323	-21	kworker/u8:1+events_unbound	11:15:18	1
625989	99	51	48,2	cyclictest	647392	-21	kworker/u8:1+flush-179:0	07:40:07	1
625989	99	51	46,4	cyclictest	813221	-21	munin-limits	10:05:37	1
625987	99	51	45,5	cyclictest	679882	-21	kworker/u8:5+flush-179:0	09:35:24	0
625996	99	50	45,4	cyclictest	771826	-21	kworker/u8:0+flush-179:0	10:05:21	3
625993	99	50	48,2	cyclictest	647379	-21	kworker/u8:0+flush-179:0	07:36:11	2
625993	99	50	47,2	cyclictest	647379	-21	kworker/u8:0+events_unbound	07:45:17	2
625993	99	50	46,3	cyclictest	844700	-21	kworker/u8:0+events_unbound	11:10:30	2
625993	99	50	46,3	cyclictest	668823	-21	kworker/u8:4+flush-179:0	08:15:18	2
625989	99	50	47,2	cyclictest	771826	-21	kworker/u8:0+flush-179:0	09:45:09	1
625989	99	50	47,2	cyclictest	756473	-21	kworker/u8:0+events_unbound	09:15:01	1
625989	99	50	46,3	cyclictest	844700	-21	kworker/u8:0+flush-179:0	11:10:31	1
625996	99	49	41,3	cyclictest	891342	-21	kworker/u8:5+flush-179:0	12:20:07	3
625993	99	49	46,3	cyclictest	834071	-21	kworker/u8:2+events_unbound	11:00:41	2
625993	99	49	46,2	cyclictest	865323	-21	kworker/u8:1+events_unbound	11:06:34	2
625993	99	49	46,2	cyclictest	834071	-21	kworker/u8:2+events_unbound	12:10:12	2
625993	99	49	46,2	cyclictest	695187	-21	kworker/u8:1+flush-179:0	08:30:15	2
625993	99	49	45,3	cyclictest	751190	-21	kworker/u8:4+events_unbound	10:16:09	2
625993	99	49	29,19	cyclictest	679882	-21	kworker/u8:5+flush-179:0	08:45:02	2
625989	99	49	46,2	cyclictest	834071	-21	kworker/u8:2+flush-179:0	10:35:21	1
625989	99	49	46,2	cyclictest	598866	-21	kworker/u8:2+flush-179:0	07:20:27	1
625989	99	49	44,3	cyclictest	913957	-21	kworker/u8:1+flush-179:0	12:29:12	1
625989	99	49	44,3	cyclictest	741216	-21	kworker/u8:2+events_unbound	09:03:37	1
625987	99	49	42,5	cyclictest	912127	-21	agora-tariff2.s	11:45:23	0
625987	99	49	42,5	cyclictest	803452	-21	/usr/share/muni	10:00:04	0
625996	99	48	44,3	cyclictest	771826	-21	kworker/u8:0+events_unbound	09:35:11	3
625996	99	48	41,5	cyclictest	720411	-21	/usr/share/muni	08:40:03	3
625993	99	48	45,3	cyclictest	834071	-21	kworker/u8:2+flush-179:0	11:20:07	2
625993	99	48	45,2	cyclictest	891342	-21	kworker/u8:5+flush-179:0	12:05:13	2
625993	99	48	44,3	cyclictest	834071	-21	kworker/u8:2+events_unbound	11:55:50	2
625993	99	48	44,3	cyclictest	707324	-21	kworker/u8:2+events_unbound	08:35:01	2
625993	99	48	42,3	cyclictest	726104	-21	snmp_wanpowerct	08:45:03	2
625989	99	48	46,2	cyclictest	834071	-21	kworker/u8:2+flush-179:0	12:30:21	1
625989	99	48	46,2	cyclictest	834071	-21	kworker/u8:2+flush-179:0	12:30:21	1
625987	99	48	41,5	cyclictest	725067	-21	kworker/u8:3+events_unbound	08:50:20	0
625987	99	48	40,6	cyclictest	653474	-21	/usr/share/muni	07:35:15	0
625987	99	48	0,46	cyclictest	921914	-21	chrt	11:50:36	0
625996	99	47	41,4	cyclictest	3125725	-21	ThreadPoolForeg	10:15:40	3
625996	99	47	30,15	cyclictest	658941	-21	/usr/share/muni	07:40:19	3
625993	99	47	44,2	cyclictest	891342	-21	kworker/u8:5+events_unbound	12:15:14	2
625993	99	47	44,2	cyclictest	771826	-21	kworker/u8:0+flush-179:0	10:20:58	2
625993	99	47	44,2	cyclictest	751190	-21	kworker/u8:4+events_unbound	10:05:17	2
625993	99	47	44,2	cyclictest	679882	-21	kworker/u8:5+events_unbound	08:50:31	2
625993	99	47	42,4	cyclictest	3125725	-21	ThreadPoolForeg	07:29:15	2
625989	99	47	44,2	cyclictest	756623	-21	kworker/u8:1+events_unbound	09:30:23	1
625987	99	47	41,4	cyclictest	684515	-21	latency_hist	08:05:00	0
625987	99	47	33,13	cyclictest	70454	-1	kworker/0:1H+kblockd	10:45:37	0
625996	99	46	43,2	cyclictest	679882	-21	kworker/u8:5+events_unbound	08:00:14	3
625996	99	46	40,4	cyclictest	927922	-21	/usr/share/muni	12:00:02	3
625993	99	46	44,2	cyclictest	771826	-21	kworker/u8:0+flush-179:0	09:45:23	2
625993	99	46	43,2	cyclictest	834071	-21	kworker/u8:2+events_unbound	12:35:29	2
625993	99	46	42,3	cyclictest	679882	-21	kworker/u8:5+events_unbound	09:17:51	2
625993	99	46	41,4	cyclictest	771826	-21	kworker/u8:0+events_unbound	09:50:20	2
625993	99	46	33,12	cyclictest	715255	-21	kworker/2:4+pm	09:33:43	2
625989	99	46	43,2	cyclictest	834071	-21	kworker/u8:2+events_unbound	10:55:13	1
625989	99	46	43,2	cyclictest	679882	-21	kworker/u8:5+flush-179:0	08:35:19	1
625989	99	46	42,3	cyclictest	897065	-21	/usr/share/muni	11:30:16	1
625989	99	46	42,3	cyclictest	891342	-21	kworker/u8:5+flush-179:0	12:06:15	1
625989	99	46	42,3	cyclictest	741216	-21	kworker/u8:2+flush-179:0	09:15:31	1
625987	99	46	42,2	cyclictest	70454	-1	kworker/0:1H+kblockd	11:01:31	0
625993	99	45	43,2	cyclictest	771826	-21	kworker/u8:0+flush-179:0	10:00:39	2
625993	99	45	43,2	cyclictest	668823	-21	kworker/u8:4+events_unbound	08:10:21	2
625993	99	45	42,2	cyclictest	803174	-21	kworker/u8:3+events_unbound	10:11:19	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17