OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Mon Dec 08, 2025 12:45:20)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3328329	2	212	169,33	sleep2	0	-21	swapper/2	07:08:34	2
3328262	2	202	179,13	sleep1	0	-21	swapper/1	07:07:41	1
3328104	2	196	173,13	sleep0	0	-21	swapper/0	07:06:12	0
3328383	2	193	166,17	sleep3	0	-21	swapper/3	07:09:16	3
3328854	99	93	38,52	cyclictest	3489926	-21	chrome	09:45:01	3
3328844	99	85	34,12	cyclictest	3489951	-21	snmp_areswitch.	09:45:01	1
3328844	99	73	1,71	cyclictest	3478066	-21	kworker/u8:1+efi_rts_wq	09:38:53	1
3328844	99	71	66,3	cyclictest	3525411	-21	kworker/u8:0+events_unbound	10:30:38	1
3328844	99	67	64,2	cyclictest	3333395	-21	kworker/u8:4+flush-179:0	08:20:27	1
3328854	99	64	50,10	cyclictest	3402600	-21	kworker/u8:5+flush-179:0	09:20:29	3
3328848	99	63	57,4	cyclictest	3531149	-21	kworker/u8:2+flush-179:0	10:45:41	2
3328854	99	62	57,3	cyclictest	3354687	-21	kworker/u8:1+events_unbound	08:30:35	3
3328844	99	62	59,2	cyclictest	3640377	-21	kworker/u8:2+events_unbound	12:15:36	1
3328854	99	61	57,3	cyclictest	3645956	-21	kworker/u8:0+flush-179:0	12:30:39	3
3328854	99	61	57,3	cyclictest	3525411	-21	kworker/u8:0+flush-179:0	11:00:40	3
3328854	99	60	55,3	cyclictest	3458449	-21	kworker/u8:1+events_unbound	09:15:01	3
3328844	99	60	56,3	cyclictest	3478066	-21	kworker/u8:1+flush-179:0	09:55:27	1
3328844	99	60	54,5	cyclictest	3125689	-21	ThreadPoolForeg	07:40:25	1
3328848	99	58	4,11	cyclictest	3489932	-21	snmp_wanswitch.	09:45:01	2
3328844	99	58	55,2	cyclictest	3417086	-21	kworker/u8:0+flush-179:0	08:35:28	1
3328844	99	58	54,3	cyclictest	3312405	-21	kworker/u8:0+flush-179:0	08:15:17	1
3328848	99	57	53,3	cyclictest	3531149	-21	kworker/u8:2+flush-179:0	10:25:15	2
3328844	99	57	54,2	cyclictest	3593876	-21	kworker/u8:3+events_unbound	11:35:09	1
3328844	99	57	53,3	cyclictest	3417086	-21	kworker/u8:0+flush-179:0	08:40:13	1
3328854	99	56	52,3	cyclictest	3333395	-21	kworker/u8:4+events_unbound	07:40:20	3
3328848	99	56	52,3	cyclictest	3402600	-21	kworker/u8:5+events_unbound	08:40:10	2
3328844	99	56	53,2	cyclictest	3478066	-21	kworker/u8:1+events_unbound	10:13:40	1
3328854	99	55	53,2	cyclictest	3380897	-21	kworker/u8:2+flush-179:0	08:05:33	3
3328854	99	55	51,3	cyclictest	3531149	-21	kworker/u8:2+flush-179:0	10:26:55	3
3328854	99	55	51,3	cyclictest	3478066	-21	kworker/u8:1+events_unbound	09:40:41	3
3328844	99	55	52,2	cyclictest	3401121	-21	kworker/u8:3+events_unbound	08:30:25	1
3328844	99	55	52,2	cyclictest	3401121	-21	kworker/u8:3+events_unbound	08:25:35	1
3328844	99	55	51,3	cyclictest	3660907	-21	kworker/u8:3+flush-179:0	12:36:25	1
3328854	99	54	51,2	cyclictest	3333395	-21	kworker/u8:4+flush-179:0	08:10:26	3
3328844	99	54	51,2	cyclictest	3531149	-21	kworker/u8:2+flush-179:0	10:40:00	1
3328844	99	54	51,2	cyclictest	3531149	-21	kworker/u8:2+flush-179:0	10:39:59	1
3328854	99	53	49,3	cyclictest	3345280	-21	latency_hist	07:25:01	3
3328854	99	52	50,2	cyclictest	3589229	-21	kworker/u8:1+flush-179:0	11:20:38	3
3328854	99	52	49,2	cyclictest	3417086	-21	kworker/u8:0+events_unbound	08:35:30	3
3328854	99	52	49,2	cyclictest	3281213	-21	kworker/u8:2+flush-179:0	07:15:08	3
3328844	99	52	49,3	cyclictest	3578162	-21	kworker/u8:0+flush-179:0	11:10:39	1
3328844	99	52	44,3	cyclictest	3593876	-21	kworker/u8:3+events_unbound	11:40:07	1
3328840	99	52	45,5	cyclictest	3500966	-21	/usr/share/muni	09:55:02	0
3328854	99	51	48,2	cyclictest	3599004	-21	kworker/u8:1+flush-179:0	11:55:36	3
3328854	99	51	48,2	cyclictest	3556028	-21	kworker/u8:1+flush-179:0	10:45:33	3
3328848	99	51	47,3	cyclictest	3402600	-21	kworker/u8:5+events_unbound	08:25:18	2
3328844	99	51	48,2	cyclictest	3609979	-21	kworker/u8:2+flush-179:0	11:50:31	1
3328844	99	51	48,2	cyclictest	3417086	-21	kworker/u8:0+flush-179:0	08:50:08	1
3328844	99	51	48,2	cyclictest	3402600	-21	kworker/u8:5+events_unbound	09:00:44	1
3328840	99	51	46,3	cyclictest	3402600	-21	kworker/u8:5+flush-179:0	09:15:24	0
3328840	99	51	37,2	cyclictest	3578162	-21	kworker/u8:0+flush-179:0	11:25:03	0
3328854	99	50	46,3	cyclictest	3402600	-21	kworker/u8:5+events_unbound	10:43:39	3
3328854	99	50	44,2	cyclictest	3593876	-21	kworker/u8:3+flush-179:0	11:45:12	3
3328844	99	50	46,3	cyclictest	3402600	-21	kworker/u8:5+flush-179:0	09:20:19	1
3328844	99	50	46,2	cyclictest	3354687	-21	kworker/u8:1+flush-179:0	08:00:39	1
3328854	99	49	46,2	cyclictest	3645956	-21	kworker/u8:0+flush-179:0	12:20:18	3
3328854	99	49	46,2	cyclictest	3447673	-21	kworker/u8:2+events_unbound	09:35:14	3
3328854	99	49	46,2	cyclictest	3354687	-21	kworker/u8:1+events_unbound	08:25:29	3
3328854	99	49	45,3	cyclictest	3333395	-21	kworker/u8:4+events_unbound	07:35:28	3
3328854	99	49	42,2	cyclictest	3531149	-21	kworker/u8:2+events_unbound	10:37:00	3
3328854	99	49	42,2	cyclictest	3531149	-21	kworker/u8:2+events_unbound	10:37:00	3
3328848	99	49	46,2	cyclictest	3354687	-21	kworker/u8:1+flush-179:0	08:00:33	2
3328848	99	49	45,3	cyclictest	3640377	-21	kworker/u8:2+flush-179:0	12:20:15	2
3328848	99	49	45,3	cyclictest	3474110	-21	/usr/share/muni	09:30:09	2
3328844	99	49	45,3	cyclictest	3489460	-21	kworker/u8:2+flush-179:0	10:00:13	1
3328854	99	48	46,2	cyclictest	3578162	-21	kworker/u8:0+flush-179:0	11:25:16	3
3328854	99	48	46,2	cyclictest	3333395	-21	kworker/u8:4+events_unbound	07:55:23	3
3328854	99	48	45,2	cyclictest	3599004	-21	kworker/u8:1+flush-179:0	11:50:31	3
3328854	99	48	45,2	cyclictest	3489460	-21	kworker/u8:2+events_unbound	09:50:16	3
3328854	99	48	35,12	cyclictest	3632694	-21	kworker/u8:4+flush-179:0	12:15:25	3
3328848	99	48	44,3	cyclictest	3402600	-21	kworker/u8:5+flush-179:0	09:35:38	2
3328844	99	48	45,2	cyclictest	3478066	-21	kworker/u8:1+flush-179:0	09:35:01	1
3328844	99	48	45,2	cyclictest	3402600	-21	kworker/u8:5+flush-179:0	11:30:36	1
3328844	99	48	45,2	cyclictest	3312405	-21	kworker/u8:0+events_unbound	08:05:38	1
3328844	99	48	44,3	cyclictest	3521491	-21	/usr/share/muni	10:15:10	1
3328844	99	48	44,3	cyclictest	3402600	-21	kworker/u8:5+flush-179:0	09:05:25	1
3328844	99	48	31,11	cyclictest	3599004	-21	kworker/u8:1+flush-179:0	12:05:13	1
3328840	99	48	42,5	cyclictest	3515813	-31	munin-html	10:06:26	0
3328854	99	47	44,2	cyclictest	3417086	-21	kworker/u8:0+events_unbound	08:50:09	3
3328854	99	47	44,2	cyclictest	3402600	-21	kworker/u8:5+events_unbound	09:55:10	3
3328854	99	47	43,3	cyclictest	3489460	-21	kworker/u8:2+flush-179:0	10:05:20	3
3328854	99	47	43,3	cyclictest	3371051	-21	latency_hist	07:50:00	3
3328848	99	47	44,2	cyclictest	3281199	-21	kworker/2:2+pm	07:16:08	2
3328848	99	47	39,6	cyclictest	3125725	-21	ThreadPoolForeg	10:40:50	2
3328844	99	47	45,2	cyclictest	3333395	-21	kworker/u8:4+flush-179:0	07:20:37	1
3328844	99	47	44,2	cyclictest	3291110	-21	kworker/u8:3+flush-179:0	07:30:24	1
3328844	99	47	43,3	cyclictest	3632694	-21	kworker/u8:4+flush-179:0	12:28:49	1
3328844	99	47	43,3	cyclictest	3531149	-21	kworker/u8:2+flush-179:0	10:55:05	1
3328844	99	47	31,15	cyclictest	2431947	-1	kworker/1:2H+kblockd	11:25:01	1
3328840	99	47	43,3	cyclictest	3355710	-21	/usr/share/muni	07:35:05	0
3328854	99	46	43,2	cyclictest	3599004	-21	kworker/u8:1+flush-179:0	12:05:07	3
3328854	99	46	43,2	cyclictest	3333395	-21	kworker/u8:4+flush-179:0	07:30:32	3
3328854	99	46	42,3	cyclictest	3333683	-21	munin-limits	07:11:16	3
3328848	99	46	44,1	cyclictest	3579973	-21	kworker/2:1+pm	11:18:44	2
3328848	99	46	42,2	cyclictest	3619981	-21	kworker/2:2+pm	12:39:13	2
3328844	99	46	42,3	cyclictest	3609979	-21	kworker/u8:2+events_unbound	11:45:30	1
3328844	99	46	42,3	cyclictest	3417086	-21	kworker/u8:0+events_unbound	08:58:27	1
3328840	99	46	40,4	cyclictest	3537284	-21	/usr/share/muni	10:30:13	0
3328840	99	46	40,3	cyclictest	3564731	-21	apt-get	10:55:14	0
3328854	99	45	42,2	cyclictest	3401121	-21	kworker/u8:3+events_unbound	08:40:46	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17