OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat May 09, 2026 12:46:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3914906	99	175	93,58	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:35:13	0
3914906	99	166	129,28	cyclictest	4074628	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:40:59	0
3972829	2	163	0,3	sleep1	0	-21	swapper/1	09:18:54	1
3914906	99	154	68,19	cyclictest	3975720	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:46:31	0
3914906	99	153	83,48	cyclictest	4145958	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:43:15	0
3914906	99	144	55,46	cyclictest	3963570	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:17:16	0
3914906	99	142	106,28	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:00:32	0
3914906	99	142	106,28	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:00:32	0
3914906	99	136	99,29	cyclictest	4046280	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:35:58	0
3914906	99	136	99,29	cyclictest	4046280	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:35:57	0
3914906	99	125	90,27	cyclictest	4145958	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:31:21	0
3914906	99	125	60,56	cyclictest	4139491	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:03:11	0
3914920	99	124	110,7	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:16:04	3
3914920	99	124	110,7	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:16:03	3
3914906	99	124	1,65	cyclictest	4024010	-21	/usr/sbin/munin	10:00:16	0
3914931	99	122	116,3	cyclictest	0	-21	swapper/5	10:40:59	5
3914906	99	121	48,36	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:56:29	0
3914906	99	120	83,29	cyclictest	4002785	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:55:35	0
3914906	99	120	83,29	cyclictest	4002785	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:55:35	0
3914920	99	119	105,7	cyclictest	4091316	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:01:01	3
3914906	99	119	30,63	cyclictest	0	-21	swapper/0	09:43:42	0
3914906	99	119	2,66	cyclictest	0	-21	swapper/0	12:15:13	0
3914906	99	118	84,27	cyclictest	4010783	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:50:52	0
3914906	99	118	84,27	cyclictest	4010783	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:50:51	0
3914906	99	118	65,45	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:05:23	0
3914906	99	117	82,28	cyclictest	3967080	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:25:05	0
3914911	99	116	103,6	cyclictest	3967080	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:25:47	1
3914906	99	116	81,27	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:25:29	0
3914906	99	116	81,27	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:25:29	0
3914906	99	116	54,41	cyclictest	4057079	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:28:34	0
3914906	99	115	49,20	cyclictest	3959012	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:20:07	0
3914920	99	114	98,8	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:40:16	3
3914906	99	114	78,28	cyclictest	4186885	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:35:34	0
3914906	99	114	65,41	cyclictest	4129083	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:30:04	0
3914906	99	110	50,36	cyclictest	4046280	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:45:19	0
3914906	99	109	72,28	cyclictest	4027701	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:33:54	0
3914906	99	109	72,28	cyclictest	4027701	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:33:53	0
3914906	99	108	69,18	cyclictest	4036431	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:15:54	0
3914906	99	108	60,41	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:11:57	0
3914906	99	108	60,41	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:11:56	0
3914911	99	107	93,7	cyclictest	3945522	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:30:35	1
3914911	99	107	93,7	cyclictest	3940845	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:15:34	1
3914906	99	107	70,28	cyclictest	4091316	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:26:48	0
3914920	99	106	85,8	cyclictest	4036431	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:26:03	3
3914906	99	105	71,26	cyclictest	4121373	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:19:30	0
3914906	99	105	71,26	cyclictest	4121373	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:19:29	0
3914906	99	105	69,17	cyclictest	3956909	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:55:44	0
3914906	99	105	65,19	cyclictest	3930171	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:46:35	0
3914906	99	104	68,28	cyclictest	4046280	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:23:00	0
3914906	99	104	67,20	cyclictest	4139491	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:57:53	0
3914906	99	104	67,20	cyclictest	4139491	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:57:53	0
3914906	99	103	68,27	cyclictest	3934879	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:05:32	0
3914906	99	103	65,18	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:33:51	0
3914920	99	102	51,14	cyclictest	3950907	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:36:49	3
3914920	99	102	51,14	cyclictest	3950907	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:36:48	3
3914906	99	102	68,13	cyclictest	4163147	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:53:33	0
3914906	99	102	67,19	cyclictest	3961148	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:05:40	0
3914906	99	102	63,19	cyclictest	3943012	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:36:28	0
3914906	99	102	63,19	cyclictest	3943012	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:36:28	0
3914906	99	102	63,19	cyclictest	3940845	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:19:13	0
3914906	99	102	63,19	cyclictest	3911842	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:14:34	0
3914906	99	102	47,36	cyclictest	3945522	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:01:25	0
3914906	99	101	66,20	cyclictest	4139491	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:48:13	0
3914906	99	101	65,19	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:40:35	0
3914906	99	101	61,20	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:00:24	0
3914906	99	101	61,20	cyclictest	3967080	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:38:15	0
3914906	99	100	62,18	cyclictest	4145958	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:06:28	0
3914906	99	100	61,19	cyclictest	4027701	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:07:48	0
3914906	99	100	59,20	cyclictest	3934879	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:10:13	0
3914931	99	99	93,3	cyclictest	0	-21	swapper/5	08:00:32	5
3914931	99	99	93,3	cyclictest	0	-21	swapper/5	08:00:32	5
3914906	99	99	57,23	cyclictest	3963570	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:31:51	0
3914906	99	98	58,20	cyclictest	3945522	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:40:37	0
3914906	99	97	75,16	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:55:29	0
3914906	99	97	62,27	cyclictest	4176173	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:17	0
3914906	99	97	62,19	cyclictest	3943012	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:33:17	0
3914906	99	97	60,17	cyclictest	3961148	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:10:07	0
3914906	99	97	57,20	cyclictest	3916644	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:15:59	0
3914920	99	96	64,7	cyclictest	4121373	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:38:24	3
3914906	99	96	66,21	cyclictest	4010783	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:10:37	0
3914906	99	96	56,18	cyclictest	4145958	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:22:41	0
3914924	99	95	83,6	cyclictest	11733	-21	ssh	12:26:19	4
3914911	99	95	80,8	cyclictest	4046280	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:40:12	1
3914911	99	95	79,7	cyclictest	4084599	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:00:17	1
3914906	99	95	53,26	cyclictest	4074628	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:51:00	0
3914906	99	94	67,19	cyclictest	3953107	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:45:04	0
3914906	99	94	65,21	cyclictest	4186885	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:25:19	0
3914931	99	93	86,3	cyclictest	0	-21	swapper/5	10:35:58	5
3914931	99	93	86,3	cyclictest	0	-21	swapper/5	10:35:57	5
3914920	99	93	79,7	cyclictest	3940845	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:20:33	3
3914920	99	93	79,7	cyclictest	3940845	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:20:33	3
3914920	99	92	80,6	cyclictest	4129083	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:28:07	3
3914906	99	92	64,20	cyclictest	3918830	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:20:30	0
3914920	99	91	76,8	cyclictest	4139491	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:01:11	3
3914920	99	90	59,7	cyclictest	4010783	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:17:30	3
3914920	99	89	75,7	cyclictest	3975720	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:40:50	3
3914920	99	89	73,8	cyclictest	4176173	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:34	3
3914920	99	89	58,7	cyclictest	3975720	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:49:24	3
3914920	99	88	74,7	cyclictest	4145958	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:40:33	3
3914920	99	88	64,7	cyclictest	4046280	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:31:41	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17