OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Tue Nov 18, 2025 12:44:44)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3025259	2	207	163,34	sleep3	0	-21	swapper/3	07:06:29	3
3025278	2	201	170,23	sleep2	0	-21	swapper/2	07:06:45	2
3025417	2	195	171,14	sleep1	0	-21	swapper/1	07:08:24	1
3025505	2	188	163,15	sleep0	0	-21	swapper/0	07:09:31	0
3025719	99	69	66,2	cyclictest	3202180	-21	kworker/u8:0+events_unbound	10:15:19	2
3025713	99	67	64,2	cyclictest	3340975	-21	kworker/u8:2+flush-179:0	12:15:36	0
3025713	99	67	63,2	cyclictest	3125627	-21	ChromeDriver	00:55:19	0
3025719	99	62	56,4	cyclictest	3063146	-21	chrome	07:45:01	2
3025719	99	60	51,3	cyclictest	3103583	-21	kworker/u8:5+events_unbound	10:45:10	2
3025719	99	60	3,56	cyclictest	3222658	-21	kworker/u8:4+efi_rts_wq	10:39:17	2
3025713	99	60	9,51	cyclictest	3222658	-21	kworker/u8:4+efi_rts_wq	10:39:17	0
3025718	99	59	52,5	cyclictest	3320896	-21	latency_hist	11:55:00	1
3025719	99	58	55,2	cyclictest	3222658	-21	kworker/u8:4+flush-179:0	10:55:13	2
3025719	99	58	54,3	cyclictest	3032190	-21	kworker/u8:4+flush-179:0	07:25:11	2
3025719	99	58	33,24	cyclictest	3025575	-21	munin-update	07:10:05	2
3025719	99	58	33,23	cyclictest	3192205	-21	munin-update	09:50:06	2
3025720	99	57	51,5	cyclictest	247560	-21	ThreadPoolForeg	12:00:35	3
3025719	99	57	51,5	cyclictest	247560	-21	ThreadPoolForeg	09:10:00	2
3025713	99	57	53,3	cyclictest	3202180	-21	kworker/u8:0+events_unbound	10:15:14	0
3025719	99	56	52,3	cyclictest	3340975	-21	kworker/u8:2+events_unbound	12:20:30	2
3025719	99	56	52,3	cyclictest	3176539	-21	kworker/u8:3+events_unbound	09:35:31	2
3025713	99	56	53,2	cyclictest	3284078	-21	kworker/u8:4+flush-179:0	11:20:21	0
3025713	99	56	53,2	cyclictest	3103583	-21	kworker/u8:5+events_unbound	11:00:13	0
3025713	99	56	40,14	cyclictest	3124689	-21	ThreadPoolForeg	08:45:02	0
3025719	99	55	51,3	cyclictest	3052296	-21	kworker/u8:4+flush-179:0	08:40:22	2
3025713	99	55	51,2	cyclictest	3320674	-21	kworker/u8:3+events_unbound	12:00:20	0
3025720	99	54	43,10	cyclictest	3103583	-21	kworker/u8:5+events_unbound	09:20:09	3
3025719	99	54	50,3	cyclictest	3067901	-21	kworker/u8:3+events_unbound	07:55:01	2
3025713	99	54	50,3	cyclictest	3052296	-21	kworker/u8:4+flush-179:0	08:10:04	0
3025713	99	54	50,3	cyclictest	3052296	-21	kworker/u8:4+flush-179:0	08:10:04	0
3025719	99	53	49,3	cyclictest	3315484	-21	kworker/u8:1+events_unbound	12:10:13	2
3025719	99	53	49,3	cyclictest	3273967	-21	kworker/u8:1+flush-179:0	11:36:38	2
3025719	99	53	49,3	cyclictest	3125725	-21	ThreadPoolForeg	08:50:00	2
3025719	99	53	48,4	cyclictest	3099121	-21	/usr/share/muni	08:20:14	2
3025713	99	53	50,2	cyclictest	3032190	-21	kworker/u8:4+events_unbound	07:25:00	0
3025713	99	53	49,3	cyclictest	3051845	-21	munin-limits	07:30:34	0
3025713	99	53	47,4	cyclictest	3062844	-21	latency_hist	07:45:02	0
3025719	99	52	46,2	cyclictest	3284078	-21	kworker/u8:4+flush-179:0	11:20:18	2
3025713	99	52	2,49	cyclictest	3125630	-13	chrome	10:05:15	0
3025719	99	51	47,3	cyclictest	3134932	-21	kworker/u8:1+events_unbound	09:00:35	2
3025718	99	51	44,5	cyclictest	3361416	-31	munin-graph	12:31:28	1
3025713	99	51	48,2	cyclictest	3222658	-21	kworker/u8:4+events_unbound	10:31:07	0
3025713	99	51	48,2	cyclictest	3052296	-21	kworker/u8:4+events_unbound	08:55:18	0
3025713	99	51	47,3	cyclictest	3340975	-21	kworker/u8:2+events_unbound	12:35:39	0
3025713	99	51	46,4	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	10:00:23	0
3025713	99	51	46,4	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	10:00:23	0
3025720	99	50	47,2	cyclictest	3134932	-21	kworker/u8:1+flush-179:0	09:25:04	3
3025720	99	50	44,5	cyclictest	3300494	-21	/usr/share/muni	11:35:14	3
3025719	99	50	47,2	cyclictest	3103580	-21	kworker/u8:0+flush-179:0	08:51:33	2
3025719	99	50	45,4	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	10:00:17	2
3025719	99	50	45,4	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	10:00:16	2
3025713	99	50	47,2	cyclictest	3134932	-21	kworker/u8:1+flush-179:0	09:15:21	0
3025720	99	49	45,3	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	09:12:59	3
3025719	99	49	46,2	cyclictest	3320674	-21	kworker/u8:3+flush-179:0	11:55:27	2
3025719	99	49	45,3	cyclictest	3361041	-21	kworker/u8:0+flush-179:0	12:35:20	2
3025719	99	49	45,3	cyclictest	3057405	-21	kworker/u8:1+flush-179:0	08:15:01	2
3025719	99	49	45,3	cyclictest	3057405	-21	kworker/u8:1+flush-179:0	08:15:01	2
3025718	99	49	44,4	cyclictest	3171256	-21	kworker/u8:2+flush-179:0	09:55:11	1
3025713	99	49	46,2	cyclictest	3222658	-21	kworker/u8:4+events_unbound	10:55:08	0
3025713	99	49	46,2	cyclictest	3103583	-21	kworker/u8:5+events_unbound	09:55:21	0
3025713	99	49	46,1	cyclictest	3361839	-21	munin-run	12:35:00	0
3025713	99	49	45,3	cyclictest	3294805	-21	kworker/u8:0+flush-179:0	12:05:39	0
3025713	99	49	45,3	cyclictest	3134932	-21	kworker/u8:1+flush-179:0	09:20:57	0
3025713	99	49	45,3	cyclictest	3103580	-21	kworker/u8:0+flush-179:0	08:24:24	0
3025713	99	49	45,3	cyclictest	2896793	-21	kworker/u8:2+events_unbound	07:15:34	0
3025720	99	48	44,3	cyclictest	76405	-21	systemd-journal	11:55:21	3
3025720	99	48	43,3	cyclictest	3197696	-21	/usr/share/muni	09:55:05	3
3025720	99	48	42,5	cyclictest	3078630	-21	/usr/share/muni	08:00:06	3
3025719	99	48	46,2	cyclictest	3229735	-21	kworker/u8:2+flush-179:0	11:10:17	2
3025719	99	48	44,3	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	09:30:18	2
3025719	99	48	44,3	cyclictest	2988461	-21	kworker/u8:0+events_unbound	07:20:14	2
3025719	99	48	34,13	cyclictest	3297007	-21	kworker/u8:3+flush-179:0	11:30:22	2
3025719	99	48	33,13	cyclictest	3067901	-21	kworker/u8:3+flush-179:0	07:58:05	2
3025718	99	48	42,4	cyclictest	247560	-21	ThreadPoolForeg	09:30:29	1
3025713	99	48	44,3	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	08:32:10	0
3025720	99	47	45,2	cyclictest	2896793	-21	kworker/u8:2+flush-179:0	07:40:27	3
3025720	99	47	44,2	cyclictest	3213047	-21	kworker/u8:1+flush-179:0	10:10:11	3
3025720	99	47	43,3	cyclictest	3202180	-21	kworker/u8:0+flush-179:0	10:15:28	3
3025719	99	47	44,2	cyclictest	3222658	-21	kworker/u8:4+flush-179:0	10:25:07	2
3025719	99	47	44,2	cyclictest	3052296	-21	kworker/u8:4+events_unbound	08:05:30	2
3025713	99	47	44,3	cyclictest	3340975	-21	kworker/u8:2+flush-179:0	12:20:30	0
3025713	99	47	44,2	cyclictest	3047089	-21	kworker/u8:3+flush-179:0	07:26:22	0
3025720	99	46	43,2	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	09:15:06	3
3025720	99	46	43,2	cyclictest	3052296	-21	kworker/u8:4+flush-179:0	07:45:15	3
3025720	99	46	42,3	cyclictest	3229735	-21	kworker/u8:2+flush-179:0	10:50:28	3
3025720	99	46	39,5	cyclictest	76405	-21	systemd-journal	12:40:00	3
3025719	99	46	44,2	cyclictest	2896793	-21	kworker/u8:2+flush-179:0	07:40:25	2
3025719	99	46	43,2	cyclictest	3057405	-21	kworker/u8:1+flush-179:0	08:25:01	2
3025719	99	46	42,3	cyclictest	3297007	-21	kworker/u8:3+flush-179:0	11:40:07	2
3025719	99	46	42,3	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	09:55:26	2
3025719	99	46	42,3	cyclictest	3057405	-21	kworker/u8:1+events_unbound	08:00:30	2
3025718	99	46	42,3	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	10:00:31	1
3025718	99	46	42,3	cyclictest	3103583	-21	kworker/u8:5+flush-179:0	10:00:31	1
3025718	99	46	42,3	cyclictest	2896793	-21	kworker/u8:2+flush-179:0	07:10:19	1
3025713	99	46	43,2	cyclictest	3222658	-21	kworker/u8:4+flush-179:0	10:25:01	0
3025713	99	46	43,2	cyclictest	3222658	-21	kworker/u8:4+flush-179:0	10:25:01	0
3025713	99	46	42,3	cyclictest	3294805	-21	kworker/u8:0+events_unbound	11:35:36	0
3025713	99	46	41,4	cyclictest	3229735	-21	kworker/u8:2+flush-179:0	10:40:40	0
3025713	99	46	41,4	cyclictest	3140702	-21	/usr/share/muni	09:00:02	0
3025713	99	46	33,12	cyclictest	2989125	-1	kworker/0:2H+kblockd	08:36:18	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17