OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #e, slot #3

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot3.osadl.org (updated Tue Apr 07, 2026 12:43:48)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
135029	99	72	43,24	cyclictest	240965	-21	kworker/1:0	10:35:15	1
135029	99	70	37,32	cyclictest	220000	-21	kworker/1:0	10:10:14	1
135029	99	67	37,29	cyclictest	3116789	-1	kworker/1:1H	09:18:55	1
135029	99	67	1,64	cyclictest	0	-21	swapper/1	12:35:00	1
135029	99	66	62,2	cyclictest	0	-21	swapper/1	10:15:48	1
135029	99	66	44,21	cyclictest	292244	-21	kworker/1:1	11:35:01	1
135029	99	65	30,34	cyclictest	153958	-21	kworker/1:0	08:10:01	1
135029	99	64	0,2	cyclictest	602	-21	in:imuxsock	08:23:51	1
135029	99	63	60,1	cyclictest	261733	-21	ssh	10:56:14	1
135029	99	63	38,24	cyclictest	3116789	-1	kworker/1:1H	07:40:20	1
135029	99	63	38,24	cyclictest	3116789	-1	kworker/1:1H	07:40:20	1
135029	99	63	0,60	cyclictest	292999	-21	fschecks_count	11:35:12	1
135029	99	62	43,18	cyclictest	267066	-21	kworker/1:0	11:05:13	1
135029	99	62	42,19	cyclictest	306596	-21	kworker/1:1	11:55:14	1
135029	99	62	31,30	cyclictest	162830	-21	kworker/1:1	08:50:13	1
135029	99	61	43,17	cyclictest	280301	-21	kworker/1:0	11:20:15	1
135029	99	61	42,18	cyclictest	230914	-21	kworker/1:0	10:20:14	1
135029	99	61	41,18	cyclictest	310874	-21	kworker/1:2	12:00:16	1
135029	99	61	41,18	cyclictest	142594	-21	kworker/1:1	07:35:12	1
135029	99	61	37,20	cyclictest	310874	-21	kworker/1:2	12:10:14	1
135029	99	61	31,29	cyclictest	224526	-21	kworker/1:2	10:30:13	1
135029	99	61	31,29	cyclictest	146238	-21	kworker/1:2	08:30:13	1
135029	99	61	30,30	cyclictest	146238	-21	kworker/1:2	08:25:13	1
135029	99	61	29,31	cyclictest	297420	-21	kworker/1:0	11:45:17	1
135029	99	61	27,32	cyclictest	146238	-21	kworker/1:2	07:45:14	1
135029	99	60	43,16	cyclictest	210643	-21	kworker/1:2	09:55:14	1
135029	99	60	43,16	cyclictest	197699	-21	kworker/1:3	09:50:14	1
135029	99	60	43,16	cyclictest	179150	-21	kworker/1:1	09:30:14	1
135029	99	60	42,17	cyclictest	292244	-21	kworker/1:1	11:45:01	1
135029	99	60	42,17	cyclictest	140715	-21	kworker/1:3	07:30:15	1
135029	99	60	41,17	cyclictest	162830	-21	kworker/1:1	08:45:15	1
135029	99	60	38,20	cyclictest	3116789	-1	kworker/1:1H	11:55:01	1
135029	99	60	28,30	cyclictest	210643	-21	kworker/1:2	10:00:14	1
135029	99	60	1,4	cyclictest	604	-21	rs:main		1
135029	99	59	44,14	cyclictest	267066	-21	kworker/1:0	11:04:08	1
135029	99	59	43,15	cyclictest	3116789	-1	kworker/1:1H	07:25:15	1
135029	99	59	43,15	cyclictest	197699	-21	kworker/1:3	09:40:14	1
135029	99	59	43,15	cyclictest	146238	-21	kworker/1:2	07:55:11	1
135029	99	59	42,16	cyclictest	170538	-21	kworker/1:2	09:10:16	1
135029	99	59	41,17	cyclictest	220000	-21	kworker/1:0	10:09:01	1
135029	99	59	41,17	cyclictest	161039	-21	kworker/1:3	08:35:15	1
135029	99	59	40,17	cyclictest	3116789	-1	kworker/1:1H	09:25:15	1
135029	99	59	40,17	cyclictest	3116789	-1	kworker/1:1H	09:25:14	1
135029	99	59	39,19	cyclictest	245273	-21	kworker/1:1	10:45:34	1
135029	99	59	36,22	cyclictest	328164	-21	kworker/1:0	12:20:15	1
135029	99	59	27,31	cyclictest	133473	-21	kworker/1:2	07:10:13	1
135029	99	58	42,15	cyclictest	162830	-21	kworker/1:1	08:55:14	1
135029	99	58	41,16	cyclictest	179150	-21	kworker/1:1	09:20:00	1
135029	99	58	41,16	cyclictest	138479	-21	kworker/1:1	07:20:13	1
135029	99	58	40,17	cyclictest	150523	-21	kworker/1:0	08:00:15	1
135029	99	58	40,17	cyclictest	146238	-21	kworker/1:2	08:13:46	1
135029	99	58	38,19	cyclictest	271416	-21	kworker/1:2	11:18:18	1
135029	99	57	40,16	cyclictest	332493	-21	kworker/1:2	12:25:48	1
135029	99	57	40,16	cyclictest	3116789	-1	kworker/1:1H	10:44:05	1
135029	99	57	40,16	cyclictest	280301	-21	kworker/1:0	11:25:14	1
135029	99	57	38,17	cyclictest	230914	-21	kworker/1:0	10:25:12	1
135029	99	57	38,17	cyclictest	146238	-21	kworker/1:2	08:15:01	1
135029	99	57	1,54	cyclictest	275975	-21	systemd-run	11:14:59	1
135029	99	56	39,16	cyclictest	341866	-21	kworker/1:0	12:36:48	1
135029	99	56	39,16	cyclictest	192061	-21	kworker/1:0	09:35:15	1
135029	99	56	38,17	cyclictest	170538	-21	kworker/1:2	09:05:00	1
135029	99	56	37,17	cyclictest	146238	-21	kworker/1:2	07:50:01	1
135029	99	56	37,17	cyclictest	133473	-21	kworker/1:2	07:20:00	1
135029	99	56	35,19	cyclictest	310874	-21	kworker/1:2	12:15:15	1
135027	99	56	51,3	cyclictest	144651	-21	kworker/0:2	08:04:13	0
135029	99	55	37,17	cyclictest	162830	-21	kworker/1:1	08:40:12	1
135029	99	55	37,16	cyclictest	254129	-21	kworker/1:2	10:50:06	1
135029	99	55	34,20	cyclictest	3116789	-1	kworker/1:1H	12:09:12	1
135029	99	55	0,53	cyclictest	0	-21	swapper/1	09:47:44	1
135027	99	55	50,3	cyclictest	259594	-21	kworker/0:0	11:33:48	0
135033	99	54	49,3	cyclictest	2540909	-1	kworker/3:0H	09:05:03	3
135027	99	54	49,3	cyclictest	4110129	-1	kworker/0:2H	11:14:15	0
135033	99	53	49,3	cyclictest	2540909	-1	kworker/3:0H	10:24:56	3
135033	99	53	48,3	cyclictest	138552	-21	kworker/3:1	07:51:43	3
135033	99	53	47,3	cyclictest	2540909	-1	kworker/3:0H	08:50:13	3
135027	99	53	48,3	cyclictest	4110129	-1	kworker/0:2H	08:38:44	0
135033	99	52	49,2	cyclictest	271859	-21	kworker/3:0	11:14:47	3
135033	99	52	48,3	cyclictest	271859	-21	kworker/3:0	11:25:39	3
135033	99	52	47,4	cyclictest	2540909	-1	kworker/3:0H	10:48:47	3
135032	99	52	47,3	cyclictest	3168092	-1	kworker/2:2H	12:16:21	2
135032	99	52	47,3	cyclictest	3168092	-1	kworker/2:2H	09:19:02	2
135032	99	52	47,3	cyclictest	180870	-21	kworker/2:2	09:29:14	2
135032	99	52	47,3	cyclictest	180870	-21	kworker/2:2	09:29:13	2
135027	99	52	48,3	cyclictest	216796	-21	kworker/0:2	10:10:13	0
135027	99	52	47,3	cyclictest	4110129	-1	kworker/0:2H	09:35:30	0
135032	99	51	46,3	cyclictest	149321	-21	kworker/2:1	07:51:00	2
135027	99	51	46,3	cyclictest	4110129	-1	kworker/0:2H	07:35:12	0
135032	99	50	44,4	cyclictest	3168092	-1	kworker/2:2H	09:33:44	2
135027	99	50	47,2	cyclictest	242067	-21	kworker/0:2	10:54:12	0
135027	99	50	46,2	cyclictest	132078	-21	kworker/0:2	07:17:14	0
135032	99	49	44,3	cyclictest	3168092	-1	kworker/2:2H	10:49:18	2
135032	99	49	44,3	cyclictest	3168092	-1	kworker/2:2H	09:11:44	2
135032	99	49	43,4	cyclictest	3168092	-1	kworker/2:2H	07:48:09	2
135027	99	49	46,2	cyclictest	203675	-21	kworker/0:0	10:06:43	0
135027	99	49	44,3	cyclictest	4110129	-1	kworker/0:2H	11:20:01	0
135027	99	49	43,3	cyclictest	4110129	-1	kworker/0:2H	07:53:45	0
135033	99	48	45,2	cyclictest	189283	-21	kworker/3:2	10:38:12	3
135033	99	48	44,2	cyclictest	287736	-21	kworker/3:2	12:10:45	3
135033	99	48	43,3	cyclictest	2540909	-1	kworker/3:0H	11:55:06	3
135032	99	48	43,3	cyclictest	294391	-21	kworker/2:1	11:40:48	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:33