OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Fri Nov 21, 2025 12:44:42)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3280919	2	207	183,14	sleep2	0	-21	swapper/2	07:08:22	2
3280748	2	199	169,20	sleep3	0	-21	swapper/3	07:06:14	3
3280881	2	197	173,14	sleep1	0	-21	swapper/1	07:07:51	1
3280857	2	182	158,14	sleep0	0	-21	swapper/0	07:07:35	0
3281233	99	77	73,2	cyclictest	3504360	-21	/usr/share/muni	10:45:01	1
3281237	99	74	70,3	cyclictest	3529271	-21	kworker/u8:5+flush-179:0	11:30:10	2
3281231	99	67	62,3	cyclictest	3493425	-21	kworker/u8:1+flush-179:0	10:40:36	0
3281233	99	63	57,4	cyclictest	3318255	-21	ThreadPoolSingl	07:45:02	1
3281237	99	61	57,3	cyclictest	3520364	-21	kworker/u8:2+flush-179:0	11:10:20	2
3281233	99	61	54,5	cyclictest	3566198	-21	chrome	11:45:04	1
3281231	99	61	56,4	cyclictest	3570888	-21	kworker/u8:0+flush-179:0	11:50:16	0
3281237	99	59	54,4	cyclictest	3334006	-21	/usr/share/muni	08:00:02	2
3281233	99	59	47,3	cyclictest	3503877	-21	gpgv	10:45:00	1
3281237	99	57	53,3	cyclictest	3601515	-21	kworker/u8:3+flush-179:0	12:30:30	2
3281233	99	57	50,5	cyclictest	3125724	-21	ThreadPoolForeg	10:50:10	1
3281231	99	57	55,1	cyclictest	0	-21	swapper/0	09:40:35	0
3281231	99	56	51,4	cyclictest	3509861	-21	/usr/share/muni	10:50:15	0
3281237	99	55	51,3	cyclictest	3555245	-21	kworker/u8:4+flush-179:0	11:45:29	2
3281237	99	55	51,3	cyclictest	3313674	-21	kworker/u8:2+events_unbound	10:35:31	2
3281233	99	55	48,5	cyclictest	3441766	-21	/usr/share/muni	09:45:11	1
3281231	99	55	40,14	cyclictest	3339998	-21	apt-get	08:05:11	0
3281237	99	54	51,2	cyclictest	3313674	-21	kworker/u8:2+events_unbound	09:15:30	2
3281237	99	54	50,3	cyclictest	3545253	-21	kworker/u8:2+events_unbound	12:00:30	2
3281237	99	54	4,48	cyclictest	3380234	-21	snmp_wlanswitch	08:45:01	2
3281239	99	53	48,4	cyclictest	3239207	-21	kworker/u8:1+flush-179:0	08:45:31	3
3281239	99	53	46,4	cyclictest	3313097	-21	/usr/share/muni	07:40:15	3
3281237	99	53	49,3	cyclictest	3426669	-21	kworker/u8:3+events_unbound	10:17:00	2
3281237	99	53	49,3	cyclictest	3317862	-21	kworker/u8:3+events_unbound	07:55:16	2
3281237	99	52	49,2	cyclictest	3384842	-21	kworker/u8:5+events_unbound	09:38:10	2
3281231	99	52	47,4	cyclictest	3125688	-21	Chrome_ChildIOT	11:30:36	0
3281237	99	51	48,2	cyclictest	3410664	-21	kworker/u8:1+flush-179:0	09:30:26	2
3281237	99	51	47,3	cyclictest	3545253	-21	kworker/u8:2+events_unbound	12:15:01	2
3281237	99	51	47,3	cyclictest	3265010	-21	kworker/u8:2+flush-179:0	07:20:01	2
3281237	99	51	36,14	cyclictest	3541834	-21	ntpq	11:20:16	2
3281237	99	51	36,14	cyclictest	3535034	-21	kworker/u8:1+events_unbound	11:55:15	2
3281239	99	50	45,4	cyclictest	3467328	-21	kworker/u8:4+flush-179:0	10:23:11	3
3281237	99	50	47,2	cyclictest	3565466	-21	kworker/u8:5+events_unbound	12:20:29	2
3281237	99	50	47,2	cyclictest	3565466	-21	kworker/u8:5+events_unbound	12:20:29	2
3281237	99	50	46,3	cyclictest	3280811	-21	kworker/u8:3+flush-179:0	07:10:07	2
3281237	99	50	24,25	cyclictest	3493425	-21	kworker/u8:1+flush-179:0	10:45:02	2
3281233	99	50	42,6	cyclictest	3125724	-21	ThreadPoolForeg	11:15:11	1
3281231	99	50	47,2	cyclictest	3313674	-21	kworker/u8:2+flush-179:0	09:25:22	0
3281231	99	50	46,3	cyclictest	3313674	-21	kworker/u8:2+flush-179:0	10:05:20	0
3281231	99	50	45,4	cyclictest	3125687	-21	ThreadPoolForeg	12:00:35	0
3281237	99	49	46,2	cyclictest	3565466	-21	kworker/u8:5+flush-179:0	12:17:01	2
3281237	99	49	46,2	cyclictest	3313674	-21	kworker/u8:2+flush-179:0	08:10:11	2
3281237	99	49	45,3	cyclictest	3301741	-21	kworker/u8:3+events_unbound	07:33:03	2
3281237	99	49	45,2	cyclictest	3239207	-21	kworker/u8:1+events_unbound	08:22:44	2
3281237	99	49	45,2	cyclictest	3239207	-21	kworker/u8:1+events_unbound	08:22:44	2
3281233	99	49	45,3	cyclictest	3301745	-31	munin-graph	07:25:49	1
3281239	99	48	44,3	cyclictest	3493425	-21	kworker/u8:1+flush-179:0	10:55:06	3
3281239	99	48	44,3	cyclictest	3462265	-21	kworker/u8:0+flush-179:0	10:31:29	3
3281239	99	48	43,3	cyclictest	3239207	-21	kworker/u8:1+flush-179:0	08:25:11	3
3281231	99	48	45,2	cyclictest	3313674	-21	kworker/u8:2+flush-179:0	10:00:25	0
3281239	99	47	43,3	cyclictest	3451917	-21	gpgv	09:54:59	3
3281237	99	47	45,2	cyclictest	3313674	-21	kworker/u8:2+events_unbound	09:25:12	2
3281237	99	47	44,2	cyclictest	3565466	-21	kworker/u8:5+flush-179:0	12:35:27	2
3281237	99	47	43,3	cyclictest	76405	-21	systemd-journal	09:25:01	2
3281237	99	47	43,2	cyclictest	3313674	-21	kworker/u8:2+events_unbound	09:55:00	2
3281237	99	47	37,3	cyclictest	3467328	-21	kworker/u8:4+events_unbound	11:05:02	2
3281231	99	47	44,2	cyclictest	3354010	-21	kworker/u8:3+flush-179:0	08:30:10	0
3281239	99	46	39,5	cyclictest	3426122	-21	latency_hist	09:30:01	3
3281237	99	46	42,3	cyclictest	3555245	-21	kworker/u8:4+events_unbound	11:50:07	2
3281237	99	46	42,3	cyclictest	3514394	-21	kworker/u8:0+flush-179:0	10:52:56	2
3281237	99	46	42,3	cyclictest	3364201	-21	kworker/u8:0+flush-179:0	08:52:05	2
3281237	99	46	33,13	cyclictest	3529271	-21	kworker/u8:5+flush-179:0	11:15:16	2
3281233	99	46	38,5	cyclictest	3359596	-21	/usr/share/muni	08:25:02	1
3281233	99	46	38,5	cyclictest	3359596	-21	/usr/share/muni	08:25:02	1
3281233	99	46	36,9	cyclictest	3529271	-21	kworker/u8:5+flush-179:0	11:25:16	1
3281237	99	45	42,3	cyclictest	3239207	-21	kworker/u8:1+flush-179:0	08:26:52	2
3281237	99	45	40,4	cyclictest	3125724	-21	ThreadPoolForeg	10:04:16	2
3281237	99	45	40,3	cyclictest	3520364	-21	kworker/u8:2+events_unbound	11:00:15	2
3281237	99	45	39,4	cyclictest	3441745	-21	chrome	09:45:02	2
3281237	99	45	11,33	cyclictest	3125728	-13	Compositor	08:30:45	2
3281231	99	45	42,2	cyclictest	3239207	-21	kworker/u8:1+events_unbound	08:04:26	0
3281231	99	45	40,4	cyclictest	3565466	-21	kworker/u8:5+flush-179:0	11:45:01	0
3281231	99	45	39,4	cyclictest	3498697	-21	latency_hist	10:40:01	0
3387466	2	44	0,1	sleep0	3387463	-21	if_enp3s0	08:50:19	0
3281239	99	44	40,3	cyclictest	3384842	-21	kworker/u8:5+flush-179:0	10:00:15	3
3281237	99	44	40,3	cyclictest	3545253	-21	kworker/u8:2+events_unbound	11:40:15	2
3281237	99	44	40,3	cyclictest	3384842	-21	kworker/u8:5+flush-179:0	09:05:20	2
3281233	99	44	31,2	cyclictest	3446490	-1	kworker/1:1H+kblockd	11:04:36	1
3281231	99	44	40,3	cyclictest	3384842	-21	kworker/u8:5+flush-179:0	09:00:12	0
3281231	99	44	40,3	cyclictest	3307661	-21	kworker/u8:0+flush-179:0	07:40:35	0
3281231	99	44	1,42	cyclictest	247557	-21	chrome	07:50:15	0
3281239	99	43	38,3	cyclictest	3529271	-21	kworker/u8:5+flush-179:0	11:15:20	3
3281239	99	43	25,16	cyclictest	3281389	-21	/usr/share/muni	07:10:14	3
3281237	99	43	40,2	cyclictest	3503545	-21	kworker/u8:3+events_unbound	10:44:56	2
3281237	99	43	40,2	cyclictest	3467328	-21	kworker/u8:4+flush-179:0	10:30:23	2
3281237	99	43	40,2	cyclictest	3313674	-21	kworker/u8:2+events_unbound	08:41:45	2
3281237	99	43	40,2	cyclictest	3239207	-21	kworker/u8:1+flush-179:0	07:20:28	2
3281237	99	43	39,3	cyclictest	3313674	-21	kworker/u8:2+events_unbound	10:26:54	2
3281237	99	43	36,2	cyclictest	3317862	-21	kworker/u8:3+events_unbound	07:45:34	2
3281233	99	43	38,4	cyclictest	3483519	-21	/usr/share/muni	10:25:03	1
3281233	99	43	36,5	cyclictest	3125687	-21	ThreadPoolForeg	09:35:36	1
3281233	99	43	36,4	cyclictest	3477876	-21	latency_hist	10:20:01	1
3281233	99	43	35,5	cyclictest	3313090	-21	/usr/share/muni	07:40:09	1
3281231	99	43	39,3	cyclictest	3313674	-21	kworker/u8:2+flush-179:0	10:25:27	0
3281239	99	42	38,3	cyclictest	3505303	-21	ThreadPoolForeg	10:45:14	3
3281239	99	42	38,3	cyclictest	3239207	-21	kworker/u8:1+flush-179:0	08:02:00	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17