OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #b, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rackbslot1.osadl.org (updated Sat Nov 15, 2025 12:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2759756	2	225	176,39	sleep1	0	-21	swapper/1	07:09:50	1
2759639	2	212	187,14	sleep2	0	-21	swapper/2	07:08:19	2
2759723	2	211	183,18	sleep3	0	-21	swapper/3	07:09:23	3
2759559	2	206	163,33	sleep0	0	-21	swapper/0	07:07:16	0
2935022	2	100	0,1	sleep0	0	-21	swapper/0	09:55:36	0
2760120	99	68	62,3	cyclictest	2748870	-21	kworker/u8:0+events_unbound	07:20:15	2
2760124	99	63	7,55	cyclictest	2959436	-21	kworker/u8:2+efi_rts_wq	10:39:56	3
2760124	99	63	58,4	cyclictest	3043246	-21	kworker/u8:1+flush-179:0	12:00:00	3
2760124	99	57	53,3	cyclictest	2817456	-21	kworker/u8:1+flush-179:0	08:05:15	3
2760124	99	55	51,3	cyclictest	2940654	-21	kworker/u8:4+events_unbound	11:10:10	3
2760116	99	55	51,3	cyclictest	2689849	-21	kworker/u8:3+events_unbound	10:33:06	1
2760124	99	54	51,2	cyclictest	3063529	-21	kworker/u8:0+flush-179:0	12:15:15	3
2760124	99	54	50,3	cyclictest	2939933	-31	munin-html	10:00:37	3
2760120	99	54	49,3	cyclictest	2807319	-21	kworker/u8:0+events_unbound	08:06:29	2
2760116	99	54	52,2	cyclictest	3074830	-21	kworker/u8:4+flush-179:0	12:17:01	1
2760116	99	54	49,2	cyclictest	3007822	-21	kworker/u8:3+events_unbound	11:40:20	1
2760114	99	54	50,3	cyclictest	2786366	-21	kworker/u8:2+flush-179:0	08:05:29	0
2760124	99	53	49,3	cyclictest	2940654	-21	kworker/u8:4+events_unbound	10:50:34	3
2760124	99	53	49,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	07:50:14	3
2760124	99	53	46,3	cyclictest	3094788	-21	kworker/u8:0+flush-179:0	12:35:32	3
2760124	99	53	46,3	cyclictest	3094788	-21	kworker/u8:0+flush-179:0	12:35:32	3
2760120	99	53	47,3	cyclictest	3094788	-21	kworker/u8:0+events_unbound	12:35:35	2
2760120	99	53	47,3	cyclictest	3094788	-21	kworker/u8:0+events_unbound	12:35:34	2
2760124	99	52	47,4	cyclictest	2689849	-21	kworker/u8:3+events_unbound	09:50:14	3
2760120	99	52	49,2	cyclictest	3017678	-21	kworker/u8:2+events_unbound	11:25:19	2
2760120	99	52	48,3	cyclictest	3054927	-21	kworker/u8:2+events_unbound	12:10:01	2
2760114	99	52	4,47	cyclictest	2959436	-21	kworker/u8:2+efi_rts_wq	10:39:58	0
2760124	99	51	48,2	cyclictest	3043246	-21	kworker/u8:1+flush-179:0	12:20:21	3
2760124	99	51	47,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	09:40:25	3
2760124	99	51	43,3	cyclictest	3007822	-21	kworker/u8:3+events_unbound	11:19:00	3
2760124	99	51	43,3	cyclictest	3007822	-21	kworker/u8:3+events_unbound	11:19:00	3
2760116	99	51	47,3	cyclictest	2925255	-21	kworker/u8:1+events_unbound	10:09:01	1
2760114	99	51	47,3	cyclictest	2848052	-21	kworker/u8:1+flush-179:0	09:00:42	0
2760124	99	50	46,3	cyclictest	2689849	-21	kworker/u8:3+events_unbound	08:00:28	3
2760116	99	50	46,3	cyclictest	2689849	-21	kworker/u8:3+events_unbound	08:34:39	1
2760116	99	50	43,6	cyclictest	2909575	-21	kworker/u8:4+events_unbound	09:50:24	1
2760124	99	49	45,3	cyclictest	3074830	-21	kworker/u8:4+flush-179:0	12:25:15	3
2760124	99	49	41,3	cyclictest	2950038	-21	kworker/u8:0+flush-179:0	10:15:30	3
2760120	99	49	47,1	cyclictest	2894249	-21	kworker/2:2+pm	09:23:14	2
2760120	99	49	44,4	cyclictest	2848052	-21	kworker/u8:1+events_unbound	08:55:14	2
2760120	99	49	43,4	cyclictest	2941005	-21	/usr/share/muni	10:05:16	2
2760124	99	48	45,3	cyclictest	2925255	-21	kworker/u8:1+flush-179:0	10:07:42	3
2760124	99	48	44,3	cyclictest	3023078	-21	kworker/u8:4+flush-179:0	11:41:52	3
2760124	99	48	41,3	cyclictest	2786366	-21	kworker/u8:2+flush-179:0	07:35:17	3
2760120	99	48	44,3	cyclictest	3060595	-21	apt-get	12:00:15	2
2760120	99	48	43,2	cyclictest	2817456	-21	kworker/u8:1+events_unbound	08:10:31	2
2760116	99	48	43,4	cyclictest	2940654	-21	kworker/u8:4+events_unbound	10:17:03	1
2760114	99	48	40,5	cyclictest	3089444	-31	munin-html	12:25:39	0
2760124	99	47	44,2	cyclictest	3007822	-21	kworker/u8:3+events_unbound	11:35:34	3
2760124	99	47	44,2	cyclictest	2955817	-21	kworker/u8:1+flush-179:0	10:20:16	3
2760124	99	47	44,2	cyclictest	2950038	-21	kworker/u8:0+events_unbound	10:12:04	3
2760124	99	47	42,4	cyclictest	2873009	-21	kworker/u8:0+flush-179:0	09:00:07	3
2760124	99	47	33,13	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	07:12:13	3
2760120	99	47	44,2	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	10:12:56	2
2760120	99	47	41,4	cyclictest	2998036	-21	/usr/share/muni	11:00:08	2
2760116	99	47	44,2	cyclictest	2873009	-21	kworker/u8:0+events_unbound	09:45:13	1
2760114	99	47	43,3	cyclictest	2807319	-21	kworker/u8:0+flush-179:0	07:53:44	0
3058266	2	46	0,1	chrt	3058267	-21	nmap	11:55:34	0
2760124	99	46	43,2	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	10:25:16	3
2760124	99	46	42,3	cyclictest	2873009	-21	kworker/u8:0+flush-179:0	09:10:34	3
2760124	99	46	42,3	cyclictest	2786366	-21	kworker/u8:2+flush-179:0	08:10:28	3
2760120	99	46	43,2	cyclictest	2959436	-21	kworker/u8:2+events_unbound	11:05:01	2
2760120	99	46	42,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	10:45:32	2
2760120	99	46	42,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	08:47:05	2
2760120	99	46	42,3	cyclictest	2689849	-21	kworker/u8:3+events_unbound	09:44:31	2
2760120	99	46	41,3	cyclictest	3007822	-21	kworker/u8:3+events_unbound	11:18:06	2
2760120	99	46	41,3	cyclictest	3007822	-21	kworker/u8:3+events_unbound	11:18:06	2
2760116	99	46	42,3	cyclictest	2873009	-21	kworker/u8:0+flush-179:0	09:31:46	1
2760114	99	46	38,6	cyclictest	2781858	-21	/usr/share/muni	07:30:15	0
2760114	99	46	37,7	cyclictest	247560	-21	ThreadPoolForeg	12:16:19	0
2760124	99	45	42,2	cyclictest	3017678	-21	kworker/u8:2+flush-179:0	11:32:16	3
2760124	99	45	42,2	cyclictest	2992300	-21	kworker/u8:1+flush-179:0	11:05:25	3
2760124	99	45	41,3	cyclictest	2940654	-21	kworker/u8:4+events_unbound	11:00:23	3
2760124	99	45	41,3	cyclictest	2848052	-21	kworker/u8:1+events_unbound	08:55:30	3
2760124	99	45	40,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	08:40:01	3
2760124	99	45	34,10	cyclictest	2383302	-1	kworker/3:0H+kblockd	10:49:45	3
2760120	99	45	42,2	cyclictest	2848052	-21	kworker/u8:1+events_unbound	08:50:19	2
2760120	99	45	42,2	cyclictest	2807319	-21	kworker/u8:0+events_unbound	08:17:58	2
2760120	99	45	42,2	cyclictest	2807319	-21	kworker/u8:0+events_unbound	08:17:58	2
2760120	99	45	42,2	cyclictest	2689849	-21	kworker/u8:3+events_unbound	07:44:26	2
2760120	99	45	41,3	cyclictest	3007822	-21	kworker/u8:3+flush-179:0	11:13:27	2
2760120	99	45	33,11	cyclictest	3002760	-21	kworker/2:1+pm	12:12:57	2
2760120	99	45	0,43	cyclictest	3043890	-21	/usr/share/muni	11:45:01	2
2760116	99	45	42,2	cyclictest	2848052	-21	kworker/u8:1+flush-179:0	09:25:30	1
2760116	99	45	41,3	cyclictest	2689849	-21	kworker/u8:3+events_unbound	07:25:12	1
2760116	99	45	40,3	cyclictest	2909649	-21	munin-update	09:35:34	1
2760114	99	45	38,5	cyclictest	3125725	-21	ThreadPoolForeg	09:50:30	0
2760114	99	45	32,12	cyclictest	2739333	-1	kworker/0:2H+kblockd	09:16:22	0
2760124	99	44	40,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	07:25:15	3
2760124	99	44	39,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	09:05:14	3
2760124	99	44	38,5	cyclictest	2904812	-21	/usr/share/muni	09:30:06	3
2760120	99	44	42,2	cyclictest	2748870	-21	kworker/u8:0+flush-179:0	07:28:29	2
2760120	99	44	42,2	cyclictest	2689849	-21	kworker/u8:3+events_unbound	09:04:28	2
2760120	99	44	41,2	cyclictest	2959436	-21	kworker/u8:2+events_unbound	10:30:35	2
2760120	99	44	40,3	cyclictest	3074830	-21	kworker/u8:4+flush-179:0	12:25:00	2
2760120	99	44	39,3	cyclictest	2908893	-31	munin-html	09:30:34	2
2760120	99	44	38,5	cyclictest	3125725	-21	ThreadPoolForeg	08:00:11	2
2760120	99	44	38,3	cyclictest	2873009	-21	kworker/u8:0+events_unbound	09:17:36	2
2760120	99	44	31,12	cyclictest	3002760	-21	kworker/2:1+pm	12:25:26	2
2760114	99	44	40,3	cyclictest	2689849	-21	kworker/u8:3+flush-179:0	08:55:21	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17