OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Jan 11, 2026 00:46:54)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2848303	99	158	46,36	cyclictest	2995923	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:10:31	0
2848303	99	158	46,36	cyclictest	2995923	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:10:31	0
2848314	99	153	113,18	cyclictest	3101469	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:28:29	1
2848303	99	145	65,57	cyclictest	3011828	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:45:18	0
2848303	99	141	38,40	cyclictest	3073731	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:45:32	0
2848303	99	141	38,40	cyclictest	3073731	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:45:31	0
2848303	99	135	42,34	cyclictest	3109595	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:13:44	0
2848322	99	134	120,7	cyclictest	2988751	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:28:15	2
2848303	99	130	92,30	cyclictest	2880191	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:32:54	0
2848303	99	130	90,19	cyclictest	3016041	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	22:58:18	0
2848303	99	130	90,19	cyclictest	3016041	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	22:58:17	0
2848303	99	128	90,17	cyclictest	3004950	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:40:20	0
2848303	99	128	71,49	cyclictest	2957445	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:25:28	0
2848303	99	123	62,42	cyclictest	2897958	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:10:40	0
2848303	99	118	77,20	cyclictest	2854189	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:25:15	0
2848303	99	117	54,44	cyclictest	2858514	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:55:38	0
2848303	99	117	54,44	cyclictest	2858514	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:55:37	0
2848303	99	116	97,15	cyclictest	210	-21	kswapd0	21:30:27	0
2848303	99	116	80,15	cyclictest	3061469	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:03:26	0
2848303	99	116	80,15	cyclictest	3061469	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:03:25	0
2848322	99	112	100,6	cyclictest	3016041	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	22:53:17	2
2848303	99	111	35,58	cyclictest	690	50	irq/528-eth0-Tx	23:05:36	0
2848303	99	111	35,58	cyclictest	690	50	irq/528-eth0-Tx	23:05:36	0
2848351	99	110	104,3	cyclictest	0	-21	swapper/5	23:30:26	5
2848314	99	108	94,7	cyclictest	3101469	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:20:18	1
2848314	99	105	92,7	cyclictest	3022962	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:38:22	1
2848303	99	104	86,14	cyclictest	210	-21	kswapd0	22:50:27	0
2848314	99	103	91,6	cyclictest	2897958	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:33:06	1
2848314	99	103	90,7	cyclictest	3022962	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:53:25	1
2848314	99	103	90,7	cyclictest	3022962	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:53:24	1
2848303	99	103	84,15	cyclictest	210	-21	kswapd0	23:40:27	0
2848303	99	103	25,40	cyclictest	3063170	-21	grep	23:25:45	0
2848303	99	102	83,14	cyclictest	3130056	-21	ssh	00:20:26	0
2848303	99	102	76,19	cyclictest	2880191	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:03:00	0
2848303	99	102	76,19	cyclictest	2880191	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:02:59	0
2848303	99	101	75,18	cyclictest	3101469	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:58:45	0
2848303	99	101	75,18	cyclictest	3101469	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:58:45	0
2848303	99	101	2,58	cyclictest	13	-21	ksoftirqd/0	23:35:40	0
2848314	99	100	86,7	cyclictest	3109595	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:13:26	1
3107345	2	99	0,6	sleep1	0	-21	swapper/1	00:01:57	1
3107345	2	99	0,6	sleep1	0	-21	swapper/1	00:01:57	1
2848314	99	99	87,6	cyclictest	2934256	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:43:13	1
2848314	99	99	87,6	cyclictest	2934256	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:43:12	1
2848303	99	99	77,19	cyclictest	2924822	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:53:08	0
2848303	99	99	1,87	cyclictest	0	-21	swapper/0	20:25:42	0
2848303	99	98	42,13	cyclictest	15	-21	rcuc/0	23:51:31	0
2848303	99	98	42,13	cyclictest	15	-21	rcuc/0	23:51:31	0
2848314	99	97	83,7	cyclictest	2841009	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:12:39	1
2848332	99	96	84,8	cyclictest	3068333	-21	bingrep	23:30:26	3
2848314	99	96	82,7	cyclictest	2924822	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:50:03	1
2848332	99	95	87,5	cyclictest	210	-21	kswapd0	22:30:07	3
2848303	99	95	70,18	cyclictest	2861353	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:05:14	0
2848314	99	94	84,6	cyclictest	210	-21	kswapd0	22:50:26	1
2848314	99	94	71,10	cyclictest	3022962	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:43:23	1
2848303	99	94	73,17	cyclictest	210	-21	kswapd0	23:30:27	0
2848303	99	94	66,19	cyclictest	2897958	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:23:54	0
2848303	99	94	1,81	cyclictest	0	-21	swapper/0	22:15:43	0
2848303	99	94	1,81	cyclictest	0	-21	swapper/0	22:15:42	0
2848340	99	93	88,2	cyclictest	0	-21	swapper/4	21:30:26	4
2848303	99	93	66,19	cyclictest	2924822	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:45:32	0
2848351	99	92	85,3	cyclictest	0	-21	swapper/5	23:18:21	5
2848351	99	92	85,3	cyclictest	0	-21	swapper/5	23:18:20	5
2848322	99	92	78,7	cyclictest	3109595	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:38:28	2
2848303	99	92	66,19	cyclictest	2934256	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:10:14	0
2848303	99	92	66,19	cyclictest	2934256	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:10:14	0
2848303	99	92	65,19	cyclictest	2861353	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:23:14	0
2848303	99	92	55,30	cyclictest	2897958	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:56:19	0
2848351	99	91	86,2	cyclictest	0	-21	swapper/5	00:20:16	5
2848340	99	91	84,3	cyclictest	0	-21	swapper/4	20:32:53	4
2848332	99	91	71,7	cyclictest	3022962	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:25:09	3
2848322	99	91	78,6	cyclictest	3135952	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:26:44	2
2848314	99	91	65,9	cyclictest	2903963	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:28:04	1
2848303	99	91	65,19	cyclictest	2957445	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:35:56	0
2848303	99	91	65,19	cyclictest	2856314	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:30:22	0
2848303	99	91	55,29	cyclictest	2924822	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:05:26	0
2848303	99	91	36,16	cyclictest	13	-21	ksoftirqd/0	21:15:38	0
2848340	99	90	78,7	cyclictest	3018987	-21	ssh	22:50:26	4
2848314	99	90	76,7	cyclictest	2903963	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:38:07	1
2848314	99	90	76,7	cyclictest	2903963	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:38:06	1
2848303	99	90	71,14	cyclictest	210	-21	kswapd0	00:05:06	0
2848303	99	90	64,19	cyclictest	2895157	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:08:24	0
2848303	99	90	58,23	cyclictest	689	50	irq/527-eth0-Tx	00:15:13	0
2848351	99	89	82,3	cyclictest	0	-21	swapper/5	20:20:28	5
2848322	99	89	71,6	cyclictest	3101469	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:01:14	2
2848322	99	89	71,6	cyclictest	3101469	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:01:14	2
2848303	99	89	66,18	cyclictest	2957431	-21	bingrep	22:00:27	0
2848303	99	89	65,20	cyclictest	2897958	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:44:36	0
2848303	99	89	65,20	cyclictest	2897958	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:44:35	0
2848303	99	89	62,20	cyclictest	2995923	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:19:38	0
2848303	99	89	62,20	cyclictest	2995923	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:19:37	0
2848340	99	88	68,10	cyclictest	2948205	-21	ssh	21:53:08	4
2848322	99	88	75,6	cyclictest	2861353	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:09:34	2
2848314	99	88	75,7	cyclictest	2995923	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:43:14	1
2848303	99	88	60,20	cyclictest	2858514	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:50:13	0
2848303	99	88	1,83	cyclictest	0	-21	swapper/0	19:40:31	0
2848340	99	87	82,2	cyclictest	0	-21	swapper/4	22:58:18	4
2848340	99	87	82,2	cyclictest	0	-21	swapper/4	22:58:17	4
2848340	99	87	75,7	cyclictest	3130055	-21	ssh	00:20:26	4
2848332	99	87	72,8	cyclictest	3022962	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:50:16	3
2848332	99	87	72,8	cyclictest	3022962	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:50:16	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17