OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat May 16, 2026 12:46:41)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3917847	2	2611	2571,26	sleep0	3898038	-21	kworker/0:1+events@ dbs_work_handler	07:05:28	0
3918753	2	868	857,6	sleep5	0	-21	swapper/5	07:08:48	5
3919010	99	140	72,49	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:55:24	0
3919010	99	135	112,15	cyclictest	10577	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:31:09	0
3919019	99	123	111,6	cyclictest	3995681	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:45:46	2
3919010	99	122	78,28	cyclictest	4188255	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:10:55	0
3919010	99	122	78,28	cyclictest	4188255	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:10:55	0
3919010	99	120	60,52	cyclictest	4016363	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:50:19	0
3919015	99	119	104,8	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:00:48	1
3919015	99	119	104,8	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:00:48	1
3919010	99	119	85,27	cyclictest	4188255	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:36:12	0
3919010	99	119	30,45	cyclictest	0	-21	swapper/0	10:30:39	0
3919024	99	117	87,10	cyclictest	3978874	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:25:31	3
3919024	99	117	87,10	cyclictest	3978874	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:25:31	3
3969054	2	116	0,8	sleep3	36	-21	rcuc/3	09:10:41	3
3919015	99	112	98,7	cyclictest	4009729	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:55:46	1
3919019	99	110	98,6	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:27:34	2
3919019	99	110	98,6	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:27:34	2
3919015	99	110	86,9	cyclictest	4055475	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:24:04	1
3919015	99	110	71,8	cyclictest	4158478	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:53:34	1
3919019	99	109	95,7	cyclictest	3916533	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:10:04	2
3919010	99	109	69,8	cyclictest	3978874	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:37:22	0
3919010	99	108	81,18	cyclictest	3939027	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:15:27	0
3919010	99	108	74,26	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:46:16	0
3919010	99	108	74,26	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:46:16	0
3919024	99	107	92,7	cyclictest	4061900	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:40:52	3
3919019	99	106	62,14	cyclictest	4055475	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:27:30	2
3919010	99	106	59,39	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:40:37	0
3919024	99	105	90,8	cyclictest	4151064	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:41:05	3
3919019	99	105	63,8	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:07:28	2
3919019	99	105	63,8	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:07:28	2
3919010	99	105	49,48	cyclictest	4016363	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:10:28	0
3919019	99	104	92,6	cyclictest	4055475	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:30:51	2
3919019	99	104	59,14	cyclictest	3918565	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:17:08	2
3919019	99	104	59,14	cyclictest	3918565	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:17:07	2
3919010	99	103	77,18	cyclictest	3948985	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:30:35	0
3919019	99	102	72,7	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:39:44	2
3919015	99	102	86,8	cyclictest	4111278	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:31:05	1
3919015	99	102	86,8	cyclictest	4111278	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:31:04	1
3919024	99	101	86,8	cyclictest	4170601	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:34	3
3919024	99	101	86,8	cyclictest	4170601	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:33	3
3919024	99	101	82,7	cyclictest	4074160	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:37:35	3
3919010	99	101	77,17	cyclictest	3959846	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:50:37	0
3919019	99	100	88,6	cyclictest	4111278	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:11:00	2
3919010	99	100	75,17	cyclictest	3926842	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:40:13	0
3919010	99	99	57,33	cyclictest	3995681	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:44:56	0
3919010	99	98	74,17	cyclictest	4151064	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:40:14	0
3919024	99	97	83,7	cyclictest	3972395	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:45:02	3
3919019	99	97	85,6	cyclictest	4170601	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:05	2
3919010	99	96	62,16	cyclictest	3932736	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	07:46:17	0
3919024	99	95	81,7	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:55:59	3
3919010	99	95	67,7	cyclictest	3924710	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:25:36	0
3919024	99	94	72,9	cyclictest	3987470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:53:27	3
3919015	99	94	68,8	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:40:02	1
3919019	99	93	81,6	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:56:56	2
3919019	99	93	81,6	cyclictest	3967372	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:19:35	2
3919019	99	93	80,7	cyclictest	3965285	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:20:10	2
3919019	99	93	78,8	cyclictest	4158478	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:46:05	2
3919019	99	93	63,18	cyclictest	3967372	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:13:25	2
3919015	99	93	78,7	cyclictest	10577	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:31:12	1
3919024	99	92	78,7	cyclictest	3192	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:16:09	3
3919024	99	92	78,7	cyclictest	3192	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:16:09	3
3919024	99	92	77,8	cyclictest	4136257	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:38:38	3
3919024	99	92	77,8	cyclictest	4136257	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:38:37	3
3919015	99	92	80,6	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:35:52	1
3919010	99	92	66,8	cyclictest	4048520	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:20:18	0
3919010	99	92	56,15	cyclictest	3978874	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:30:18	0
3919010	99	91	68,7	cyclictest	3965285	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:14:50	0
3919010	99	91	67,8	cyclictest	4158478	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:45:35	0
3919010	99	91	44,31	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:50:13	0
3919010	99	91	44,31	cyclictest	4030554	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:50:13	0
3919010	99	90	67,7	cyclictest	4074160	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:38:13	0
3919024	99	89	75,7	cyclictest	3965285	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:15:43	3
3919024	99	89	73,8	cyclictest	4074160	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:51:02	3
3919024	99	89	73,8	cyclictest	4074160	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:51:01	3
3919019	99	89	77,6	cyclictest	3929449	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:47:34	2
3919019	99	89	62,7	cyclictest	3924710	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:27:49	2
18419	2	89	0,8	sleep2	29	-21	rcuc/2	12:29:11	2
3919024	99	88	74,7	cyclictest	10577	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:26:32	3
3919015	99	88	74,7	cyclictest	4170601	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:58	1
3919015	99	88	74,7	cyclictest	4170601	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:58	1
3919010	99	88	64,7	cyclictest	4158478	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:50:41	0
3919010	99	88	63,8	cyclictest	4188255	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:25:34	0
3919033	99	87	80,3	cyclictest	0	-21	swapper/5	10:10:15	5
3919019	99	87	75,6	cyclictest	4089490	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:49:48	2
3919019	99	87	75,6	cyclictest	4089490	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:49:48	2
3919015	99	87	74,6	cyclictest	4144117	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:40:24	1
3919010	99	87	53,7	cyclictest	4097980	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:00:27	0
3919019	99	86	73,7	cyclictest	4111278	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:19:32	2
3919033	99	85	80,2	cyclictest	0	-21	swapper/5	08:20:13	5
3919024	99	85	72,6	cyclictest	3916533	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:30:09	3
3919024	99	85	72,6	cyclictest	3916533	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:30:08	3
3919019	99	85	72,6	cyclictest	4151064	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:53:43	2
3919019	99	85	71,7	cyclictest	4136257	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:38:57	2
3919019	99	85	71,7	cyclictest	4136257	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:38:57	2
3919015	99	85	71,7	cyclictest	3948985	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:30:28	1
3919015	99	85	70,7	cyclictest	3934769	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:10:57	1
3919015	99	85	55,7	cyclictest	4119381	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:25:24	1
3919015	99	85	55,7	cyclictest	4119381	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:25:23	1
3919033	99	84	78,2	cyclictest	0	-21	swapper/5	11:50:21	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17