OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Jan 04, 2026 12:46:56)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4106382	99	135	121,7	cyclictest	85669	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:00:36	2
4106376	99	135	121,7	cyclictest	85669	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:20:39	1
4106387	99	120	107,7	cyclictest	57218	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:45:31	3
4106376	99	116	102,7	cyclictest	116477	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:35:43	1
4106391	99	113	102,6	cyclictest	4157873	-21	diskmemload-4	09:35:19	4
4106396	99	110	103,3	cyclictest	0	-21	swapper/5	09:35:20	5
4106382	99	107	97,6	cyclictest	210	-21	kswapd0	09:55:26	2
4106376	99	106	92,7	cyclictest	29799	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:15:27	1
4106376	99	106	91,8	cyclictest	4116801	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:20:34	1
4106371	99	105	84,4	cyclictest	689	50	irq/527-eth0-Tx	12:30:00	0
4106371	99	104	79,18	cyclictest	57218	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:45:33	0
4106382	99	103	88,8	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:25:30	2
4106371	99	103	53,26	cyclictest	160286	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:15:17	0
4106382	99	102	87,8	cyclictest	145670	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:50	2
4106382	99	102	87,8	cyclictest	145670	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:49	2
4106376	99	100	85,8	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:40:33	1
4106382	99	99	85,7	cyclictest	4116801	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:05:02	2
4106376	99	98	88,6	cyclictest	210	-21	kswapd0	11:50:26	1
4106376	99	98	88,4	cyclictest	73603	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:50:35	1
4106376	99	98	88,4	cyclictest	73603	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:50:35	1
4106382	99	97	82,8	cyclictest	145670	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:20:35	2
4106371	99	97	67,14	cyclictest	690	50	irq/528-eth0-Tx	09:35:12	0
4106376	99	96	82,7	cyclictest	57218	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:35:30	1
4106371	99	96	70,9	cyclictest	0	-21	swapper/0	12:10:36	0
4106371	99	95	65,18	cyclictest	4154714	-21	diskmemload	10:35:22	0
4106382	99	94	80,7	cyclictest	116477	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:30:23	2
4106382	99	92	78,6	cyclictest	37724	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:32:35	2
4106376	99	92	59,18	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:23:35	1
4106376	99	91	80,4	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:10:26	1
4106371	99	91	81,7	cyclictest	210	-21	kswapd0	12:25:01	0
4106396	99	90	84,3	cyclictest	0	-21	swapper/5	11:03:30	5
4106371	99	90	67,13	cyclictest	0	-21	swapper/0	11:15:42	0
4106371	99	90	59,15	cyclictest	0	-21	swapper/0	10:05:31	0
4106391	99	89	83,2	cyclictest	0	-21	swapper/4	11:03:31	4
4106382	99	88	74,7	cyclictest	137567	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:45:02	2
4106371	99	88	65,15	cyclictest	0	-21	swapper/0	09:19:18	0
4106371	99	88	65,15	cyclictest	0	-21	swapper/0	09:19:18	0
4106371	99	88	62,16	cyclictest	689	50	irq/527-eth0-Tx	11:45:31	0
4106382	99	87	74,6	cyclictest	4116801	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:15:04	2
4106382	99	87	73,7	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:55:36	2
4106382	99	87	73,7	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:55:36	2
4106371	99	87	66,7	cyclictest	97822	-21	ssh	11:10:05	0
4106387	99	86	76,7	cyclictest	210	-21	kswapd0	09:50:22	3
4106376	99	86	71,8	cyclictest	145670	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:00:29	1
4106382	99	85	71,7	cyclictest	4169776	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:15:30	2
4106371	99	85	66,4	cyclictest	0	-21	swapper/0	10:25:37	0
4106396	99	84	79,2	cyclictest	0	-21	swapper/5	12:15:16	5
4106387	99	84	69,8	cyclictest	4163155	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:25:17	3
4106382	99	84	71,6	cyclictest	4135677	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:40:07	2
4106382	99	84	70,7	cyclictest	79839	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:10:22	2
4106382	99	84	70,7	cyclictest	4135677	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:20:44	2
4106382	99	84	70,7	cyclictest	4135677	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:20:44	2
4106371	99	84	51,18	cyclictest	0	-21	swapper/0	08:10:13	0
4106391	99	83	78,2	cyclictest	0	-21	swapper/4	12:15:15	4
4106376	99	83	69,7	cyclictest	137567	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:45:07	1
4106371	99	83	2,4	cyclictest	162131	-21	ssh	12:05:31	0
4106371	99	83	2,4	cyclictest	162131	-21	ssh	12:05:30	0
4106382	99	82	70,6	cyclictest	4116801	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:26:34	2
4106376	99	82	67,8	cyclictest	57218	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:30:34	1
4106382	99	81	71,6	cyclictest	210	-21	kswapd0	10:35:26	2
4106396	99	80	74,3	cyclictest	0	-21	swapper/5	11:45:44	5
4106387	99	80	56,8	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:30:34	3
4106382	99	80	69,5	cyclictest	131646	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:00:48	2
4106371	99	80	57,11	cyclictest	691	50	irq/529-eth0-Tx	12:00:41	0
4106371	99	80	54,17	cyclictest	689	50	irq/527-eth0-Tx	08:15:31	0
4106371	99	80	50,18	cyclictest	0	-21	swapper/0	08:30:27	0
4106396	99	79	74,2	cyclictest	0	-21	swapper/5	12:00:26	5
4106391	99	79	73,3	cyclictest	0	-21	swapper/4	11:45:44	4
4106387	99	79	65,7	cyclictest	57218	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:25:40	3
4106376	99	79	66,6	cyclictest	4169776	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:52:34	1
4106376	99	79	55,8	cyclictest	95191	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:09:34	1
4106376	99	79	54,9	cyclictest	4102082	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:09:39	1
4106371	99	79	71,5	cyclictest	210	-21	kswapd0	09:49:46	0
4106371	99	79	37,19	cyclictest	0	-21	swapper/0	10:00:26	0
4106371	99	79	37,19	cyclictest	0	-21	swapper/0	10:00:26	0
4106391	99	78	73,2	cyclictest	0	-21	swapper/4	12:00:27	4
4106387	99	78	70,5	cyclictest	210	-21	kswapd0	09:15:01	3
4106387	99	78	70,5	cyclictest	210	-21	kswapd0	09:15:01	3
4106382	99	78	64,7	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:04:11	2
4106382	99	78	64,7	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:04:11	2
4106382	99	78	55,9	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:12:59	2
4106376	99	78	68,4	cyclictest	4135677	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:45:08	1
4106376	99	78	56,8	cyclictest	4135677	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:20:16	1
4106376	99	78	56,8	cyclictest	4135677	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:20:16	1
4106371	99	78	56,16	cyclictest	689	50	irq/527-eth0-Tx	11:05:23	0
4106371	99	78	49,16	cyclictest	0	-21	swapper/0	07:31:31	0
4106371	99	78	45,19	cyclictest	0	-21	swapper/0	11:26:05	0
4106396	99	77	71,3	cyclictest	0	-21	swapper/5	09:10:37	5
4106396	99	77	71,3	cyclictest	0	-21	swapper/5	09:10:37	5
4106376	99	77	64,6	cyclictest	85669	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:04:25	1
4106376	99	77	63,7	cyclictest	79839	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:11:24	1
4106376	99	77	63,7	cyclictest	4102082	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:25:04	1
4106376	99	77	47,8	cyclictest	4152554	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:10:40	1
4106376	99	77	47,8	cyclictest	4152554	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:10:39	1
4106371	99	77	25,27	cyclictest	4165912	-21	ssh	09:20:28	0
4106371	99	77	25,27	cyclictest	4165912	-21	ssh	09:20:28	0
4106387	99	76	65,5	cyclictest	124531	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:40:44	3
4106376	99	76	62,7	cyclictest	19554	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:30:15	1
4106376	99	76	61,8	cyclictest	192012	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	12:32:35	1
4106371	99	76	49,14	cyclictest	0	-21	swapper/0	09:11:24	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17