OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Fri Dec 05, 2025 00:43:32)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
458077	2	60	48,8	sleep6	0	-21	swapper/6	03:17:48	6
467481	2	59	48,7	sleep4	0	-21	swapper/4	03:19:15	4
467619	2	56	44,8	sleep5	0	-21	swapper/5	03:21:08	5
468083	99	54	51,2	cyclictest	562510	-21	kworker/u16:2+flush-8:0	04:28:08	4
468090	99	53	51,2	cyclictest	976387	-21	kworker/u16:1+flush-8:0	07:52:41	6
468084	99	52	50,2	cyclictest	643721	-21	kworker/u16:4+flush-8:0	05:18:08	5
468083	99	48	46,2	cyclictest	417162	-21	kworker/u16:3+events_unbound	04:04:09	4
468083	99	47	45,2	cyclictest	845815	-21	kworker/u16:4+events_unbound	07:10:37	4
468083	99	46	44,2	cyclictest	602295	-21	kworker/u16:1+events_unbound	04:44:09	4
468084	99	45	43,2	cyclictest	512260	-21	kworker/u16:0+events_unbound	03:51:09	5
468084	99	45	43,2	cyclictest	512260	-21	kworker/u16:0+events_unbound	03:51:09	5
468084	99	44	41,2	cyclictest	744393	-21	kworker/u16:2+flush-8:0	05:57:41	5
467484	2	43	9,30	sleep7	0	-21	swapper/7	03:19:18	7
468083	99	42	40,2	cyclictest	714623	-21	kworker/u16:5+events_unbound	05:51:09	4
468083	99	42	40,2	cyclictest	522417	-21	kworker/u16:2+events_unbound	03:49:08	4
468083	99	42	40,2	cyclictest	522417	-21	kworker/u16:2+events_unbound	03:49:08	4
468093	99	41	36,4	cyclictest	589235	-21	systemd-journal	06:01:52	7
468083	99	41	38,2	cyclictest	744393	-21	kworker/u16:2+events_unbound	06:32:44	4
468084	99	40	38,2	cyclictest	804662	-21	kworker/u16:3+events_unbound	06:51:10	5
468083	99	40	38,2	cyclictest	744393	-21	kworker/u16:2+events_unbound	06:05:09	4
468083	99	40	38,2	cyclictest	542583	-21	kworker/u16:0+events_unbound	04:01:09	4
468084	99	39	37,2	cyclictest	704533	-21	kworker/u16:1+events_unbound	05:34:09	5
468084	99	39	36,2	cyclictest	562510	-21	kworker/u16:2+flush-8:0	04:12:58	5
468083	99	39	37,2	cyclictest	895798	-21	kworker/u16:0+flush-8:0	06:51:56	4
468083	99	39	37,2	cyclictest	845815	-21	kworker/u16:4+events_unbound	07:13:41	4
468084	99	38	36,2	cyclictest	917220	-21	kworker/u16:2+events_unbound	07:29:44	5
468083	99	38	36,2	cyclictest	643721	-21	kworker/u16:4+events_unbound	05:04:09	4
468083	99	38	36,2	cyclictest	417162	-21	kworker/u16:3+events_unbound	03:44:09	4
468084	99	37	35,2	cyclictest	562510	-21	kworker/u16:2+events_unbound	04:22:08	5
468083	99	37	35,2	cyclictest	1017159	-21	kworker/u16:4+events_unbound	08:09:09	4
468084	99	36	34,2	cyclictest	976387	-21	kworker/u16:1+events_unbound	07:39:09	5
468084	99	36	34,2	cyclictest	594180	-21	kworker/u16:0+events_unbound	04:30:53	5
468084	99	36	34,2	cyclictest	3937713	-21	kworker/u16:4+flush-8:0	03:40:09	5
468084	99	36	34,2	cyclictest	1006800	-21	kworker/u16:2+events_unbound	08:02:09	5
468083	99	36	34,2	cyclictest	673790	-21	kworker/u16:0+events_unbound	05:32:29	4
468084	99	35	33,2	cyclictest	845815	-21	kworker/u16:4+events_unbound	06:41:10	5
468084	99	35	33,2	cyclictest	804662	-21	kworker/u16:3+events_unbound	06:46:11	5
468084	99	35	33,2	cyclictest	602295	-21	kworker/u16:1+events_unbound	05:05:13	5
468084	99	35	33,2	cyclictest	417162	-21	kworker/u16:3+events_unbound	03:55:41	5
468084	99	35	32,2	cyclictest	996675	-21	kworker/u16:3+flush-8:0	07:43:08	5
468084	99	35	32,2	cyclictest	895798	-21	kworker/u16:0+flush-8:0	07:12:52	5
468083	99	35	33,2	cyclictest	602295	-21	kworker/u16:1+events_unbound	05:09:37	4
468083	99	35	33,2	cyclictest	3937713	-21	kworker/u16:4+events_unbound	03:25:00	4
468093	99	34	33,0	cyclictest	0	-21	swapper/7	06:14:09	7
468093	99	34	0,32	cyclictest	673897	-21	latency_hist	05:02:42	7
468090	99	34	32,2	cyclictest	714623	-21	kworker/u16:5+events_unbound	05:23:08	6
468084	99	34	32,2	cyclictest	895798	-21	kworker/u16:0+events_unbound	07:35:52	5
468084	99	34	32,2	cyclictest	804662	-21	kworker/u16:3+flush-8:0	07:00:36	5
468084	99	34	32,2	cyclictest	673790	-21	kworker/u16:0+events_unbound	05:16:51	5
468084	99	34	32,2	cyclictest	1006800	-21	kworker/u16:2+events_unbound	08:15:09	5
468084	99	34	31,2	cyclictest	804662	-21	kworker/u16:3+events_unbound	06:27:45	5
468083	99	34	32,2	cyclictest	714623	-21	kworker/u16:5+events_unbound	05:24:52	4
468083	99	34	31,2	cyclictest	804662	-21	kworker/u16:3+flush-8:0	06:18:08	4
468083	99	34	31,2	cyclictest	1106907	-21	kworker/u16:3+flush-8:0	08:38:13	4
468093	99	33	28,4	cyclictest	492142	-21	latency_hist	03:32:42	7
468090	99	33	31,2	cyclictest	1017159	-21	kworker/u16:4+flush-8:0	08:13:00	6
468090	99	33	29,3	cyclictest	1057382	-21	kworker/u16:0+flush-8:0	08:33:00	6
468084	99	33	31,2	cyclictest	643721	-21	kworker/u16:4+events_unbound	05:11:13	5
468084	99	33	31,2	cyclictest	602295	-21	kworker/u16:1+events_unbound	04:55:52	5
468084	99	33	31,2	cyclictest	542583	-21	kworker/u16:0+events_unbound	04:10:03	5
468084	99	33	31,2	cyclictest	1017159	-21	kworker/u16:4+events_unbound	08:22:42	5
468084	99	33	31,2	cyclictest	1006800	-21	kworker/u16:2+events_unbound	08:07:10	5
468083	99	33	31,2	cyclictest	895798	-21	kworker/u16:0+flush-8:0	06:53:12	4
468083	99	33	31,2	cyclictest	845815	-21	kworker/u16:4+flush-8:0	06:40:32	4
468084	99	32	30,2	cyclictest	917220	-21	kworker/u16:2+events_unbound	07:06:52	5
468084	99	32	30,2	cyclictest	895798	-21	kworker/u16:0+flush-8:0	06:55:51	5
468084	99	32	30,2	cyclictest	895798	-21	kworker/u16:0+events_unbound	07:21:10	5
468084	99	32	30,2	cyclictest	744393	-21	kworker/u16:2+events_unbound	06:07:10	5
468084	99	32	30,2	cyclictest	744393	-21	kworker/u16:2+events_unbound	05:41:44	5
468084	99	32	30,2	cyclictest	714623	-21	kworker/u16:5+events_unbound	05:25:13	5
468084	99	32	30,2	cyclictest	1017159	-21	kworker/u16:4+events_unbound	07:56:52	5
468083	99	32	30,2	cyclictest	845815	-21	kworker/u16:4+events_unbound	07:18:16	4
468083	99	32	30,2	cyclictest	804662	-21	kworker/u16:3+flush-8:0	06:09:51	4
468083	99	32	30,2	cyclictest	417162	-21	kworker/u16:3+events_unbound	03:40:52	4
468083	99	32	30,2	cyclictest	1017159	-21	kworker/u16:4+events_unbound	08:47:10	4
468083	99	32	29,2	cyclictest	1017159	-21	kworker/u16:4+events_unbound	07:57:43	4
468090	99	31	28,2	cyclictest	917220	-21	kworker/u16:2+flush-8:0	07:17:57	6
468084	99	31	29,2	cyclictest	996675	-21	kworker/u16:3+events_unbound	08:11:53	5
468084	99	31	29,2	cyclictest	845408	-21	kworker/u16:1+flush-8:0	06:37:10	5
468084	99	31	29,2	cyclictest	804662	-21	kworker/u16:3+events_unbound	06:09:11	5
468084	99	31	29,2	cyclictest	1073989	-21	kworker/u16:1+events_unbound	08:19:52	5
468084	99	31	29,2	cyclictest	1057382	-21	kworker/u16:0+events_unbound	08:48:32	5
468084	99	31	29,2	cyclictest	1017159	-21	kworker/u16:4+events_unbound	08:46:52	5
468084	99	31	28,2	cyclictest	845815	-21	kworker/u16:4+events_unbound	07:07:43	5
468084	99	31	28,2	cyclictest	744393	-21	kworker/u16:2+flush-8:0	05:48:09	5
468083	99	31	29,2	cyclictest	1057382	-21	kworker/u16:0+events_unbound	08:30:33	4
468093	99	30	28,1	cyclictest	0	-21	swapper/7	07:03:04	7
468093	99	30	26,3	cyclictest	576600	-21	grep	04:13:02	7
468084	99	30	28,2	cyclictest	673790	-21	kworker/u16:0+events_unbound	06:20:08	5
468084	99	30	28,2	cyclictest	412076	-21	kworker/u16:1+events_unbound	03:31:01	5
468083	99	30	28,2	cyclictest	643721	-21	kworker/u16:4+events_unbound	05:21:13	4
468083	99	30	27,2	cyclictest	744835	-21	kworker/u16:3+flush-8:0	05:37:52	4
468083	99	30	27,2	cyclictest	744393	-21	kworker/u16:2+flush-8:0	05:57:44	4
468083	99	29	27,2	cyclictest	804662	-21	kworker/u16:3+events_unbound	06:31:09	4
468083	99	29	27,2	cyclictest	1006800	-21	kworker/u16:2+events_unbound	08:15:52	4
468083	99	29	26,2	cyclictest	417162	-21	kworker/u16:3+flush-8:0	03:52:49	4
468090	99	28	26,2	cyclictest	412076	-21	kworker/u16:1+events_unbound	03:48:05	6
468090	99	28	26,2	cyclictest	412076	-21	kworker/u16:1+events_unbound	03:48:05	6
468090	99	28	25,2	cyclictest	845815	-21	kworker/u16:4+flush-8:0	06:48:09	6
468084	99	28	26,2	cyclictest	845815	-21	kworker/u16:4+events_unbound	07:26:13	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17