OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Mon Aug 10, 2026 12:46:28)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3164521	2	288	0,5	sleep0	13	-21	ksoftirqd/0	07:05:36	0
3165440	99	137	113,16	cyclictest	3201660	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:45:14	0
3165440	99	134	85,16	cyclictest	3147725	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:19:51	0
3165440	99	127	91,27	cyclictest	674	50	irq/528-eth0-Tx	08:15:01	0
3165440	99	127	91,27	cyclictest	674	50	irq/528-eth0-Tx	08:15:00	0
3165440	99	119	97,14	cyclictest	3147725	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:34:53	0
3165440	99	118	69,42	cyclictest	3195427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:35:13	0
3165449	99	109	96,6	cyclictest	3171361	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:24:52	2
3165449	99	109	96,6	cyclictest	3171361	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:24:51	2
3165444	99	109	95,7	cyclictest	3276232	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:45:37	1
3165449	99	105	91,7	cyclictest	3318446	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:20:52	2
3165440	99	105	53,21	cyclictest	3493769	-21	sshd	12:39:42	0
3165440	99	103	65,5	cyclictest	675	50	irq/529-eth0-Tx	09:55:35	0
3165440	99	103	65,5	cyclictest	675	50	irq/529-eth0-Tx	09:55:34	0
3165459	99	101	94,4	cyclictest	0	-21	swapper/4	09:45:01	4
3165449	99	101	87,7	cyclictest	3318446	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:35:46	2
3165459	99	100	95,3	cyclictest	0	-21	swapper/4	08:40:15	4
3165459	99	100	95,2	cyclictest	0	-21	swapper/4	09:45:29	4
3165440	99	100	78,15	cyclictest	3171361	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:29:52	0
3165449	99	99	86,6	cyclictest	3412273	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:10:51	2
3165440	99	99	50,17	cyclictest	3480824	-21	latency_hist	12:30:01	0
3165440	99	98	66,13	cyclictest	673	50	irq/527-eth0-Tx	11:04:53	0
3165459	99	95	84,6	cyclictest	3217328	-21	diskmemload-4	10:20:35	4
3165444	99	95	82,6	cyclictest	3276232	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:25:35	1
3165444	99	95	79,8	cyclictest	3209536	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:55:30	1
3165444	99	95	79,8	cyclictest	3209536	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:55:29	1
3165449	99	93	79,7	cyclictest	3276232	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:05:41	2
3165449	99	93	79,7	cyclictest	3276232	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:05:41	2
3165440	99	91	60,6	cyclictest	673	50	irq/527-eth0-Tx	09:45:01	0
3165440	99	90	61,22	cyclictest	3243798	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:45:28	0
3165459	99	89	82,4	cyclictest	0	-21	swapper/4	08:30:43	4
3165444	99	89	75,7	cyclictest	3147725	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:44:57	1
3165440	99	89	69,6	cyclictest	3276232	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:16:01	0
3165440	99	89	61,9	cyclictest	3201660	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:40:16	0
3165449	99	87	73,7	cyclictest	3318446	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:15:43	2
3165449	99	87	73,7	cyclictest	3276232	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:50:39	2
3165444	99	87	62,9	cyclictest	3318446	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:52	1
3165444	99	87	62,9	cyclictest	3318446	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:51	1
3165440	99	87	28,38	cyclictest	3195427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:24:37	0
3165440	99	87	28,38	cyclictest	3195427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:24:37	0
3165440	99	86	50,7	cyclictest	3303553	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:20:35	0
3165444	99	85	72,6	cyclictest	3423806	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:55:19	1
3165463	99	84	77,3	cyclictest	0	-21	swapper/5	09:25:25	5
3165449	99	84	69,7	cyclictest	3209536	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:05:20	2
3165440	99	84	60,13	cyclictest	673	50	irq/527-eth0-Tx	10:15:33	0
3165440	99	84	57,17	cyclictest	674	50	irq/528-eth0-Tx	11:56:37	0
3165463	99	83	76,3	cyclictest	0	-21	swapper/5	12:30:53	5
3165440	99	83	57,7	cyclictest	3292580	-21	cat	10:10:00	0
3165449	99	81	68,6	cyclictest	3423806	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:55:47	2
3165440	99	81	49,15	cyclictest	3192134	-21	aten2.4-expect	08:15:17	0
3165070	2	81	54,19	sleep4	0	-21	swapper/4	07:07:19	4
3165459	99	80	73,3	cyclictest	0	-21	swapper/4	07:25:40	4
3165459	99	80	67,7	cyclictest	3327789	-21	ssh	10:35:33	4
3165459	99	80	67,7	cyclictest	3327789	-21	ssh	10:35:32	4
3165459	99	80	62,12	cyclictest	3421845	-21	ssh	11:45:27	4
3165459	99	80	62,12	cyclictest	3421845	-21	ssh	11:45:27	4
3165459	99	79	73,3	cyclictest	0	-21	swapper/4	09:30:31	4
3165444	99	79	65,7	cyclictest	3326788	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:35:36	1
3165444	99	79	65,7	cyclictest	3326788	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:35:36	1
3389752	2	78	0,3	sleep3	37	-21	ksoftirqd/3	11:21:26	3
3165463	99	78	72,3	cyclictest	0	-21	swapper/5	08:50:16	5
3165440	99	78	58,6	cyclictest	3456504	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:24:46	0
3165440	99	78	42,14	cyclictest	0	-21	swapper/0	11:20:27	0
3165440	99	78	39,17	cyclictest	3348167	-21	ssh	10:50:41	0
3165440	99	78	1,62	cyclictest	0	-21	swapper/0	09:03:14	0
3165459	99	77	71,3	cyclictest	0	-21	swapper/4	08:55:34	4
3165459	99	76	62,8	cyclictest	3313238	-21	ssh	10:25:15	4
3165440	99	76	1,61	cyclictest	0	-21	swapper/0	10:37:17	0
3165440	99	76	1,61	cyclictest	0	-21	swapper/0	10:37:17	0
3165459	99	75	70,2	cyclictest	0	-21	swapper/4	10:45:35	4
3165459	99	75	64,6	cyclictest	3354695	-21	ssh	10:55:33	4
3165459	99	74	65,5	cyclictest	3420468	-21	ssh	11:45:01	4
3165453	99	74	63,5	cyclictest	3183999	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:56:46	3
3165459	99	73	68,2	cyclictest	0	-21	swapper/4	09:00:39	4
3165459	99	73	63,6	cyclictest	3219769	-21	ssh	09:15:27	4
3165459	99	73	63,5	cyclictest	0	-21	swapper/4	12:10:39	4
3165459	99	73	62,6	cyclictest	3217328	-21	diskmemload-4	09:50:16	4
3165459	99	73	58,9	cyclictest	3295094	-21	ssh	10:11:02	4
3165449	99	73	61,6	cyclictest	3318446	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:49	2
3165449	99	73	61,6	cyclictest	3318446	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:05:49	2
3165449	99	73	61,6	cyclictest	3276232	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:22:45	2
3165440	99	73	56,4	cyclictest	676	50	irq/530-eth0-Tx	09:20:13	0
3165440	99	73	56,4	cyclictest	676	50	irq/530-eth0-Tx	09:20:12	0
3165440	99	73	39,19	cyclictest	0	-21	swapper/0	09:10:59	0
3165459	99	72	67,2	cyclictest	0	-21	swapper/4	09:29:05	4
3165459	99	72	63,5	cyclictest	3323625	-21	ssh	10:32:35	4
3165453	99	72	60,6	cyclictest	3412273	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:45:17	3
3165453	99	72	60,6	cyclictest	3412273	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:45:17	3
3165453	99	72	59,6	cyclictest	3147725	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:48:47	3
3165444	99	72	59,6	cyclictest	3412273	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:15:51	1
3165449	99	71	59,6	cyclictest	3195427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:25:11	2
3165440	99	71	47,8	cyclictest	3199308	-21	grep	08:30:42	0
3165459	99	70	65,2	cyclictest	0	-21	swapper/4	08:45:33	4
3165459	99	70	65,2	cyclictest	0	-21	swapper/4	08:25:41	4
3165459	99	70	64,2	cyclictest	0	-21	swapper/4	07:20:31	4
3165459	99	70	64,2	cyclictest	0	-21	swapper/4	07:20:31	4
3165459	99	70	54,10	cyclictest	3462282	-21	ssh	12:15:31	4
3165453	99	70	58,6	cyclictest	3179375	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:10:09	3
3165453	99	70	58,6	cyclictest	3179375	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:10:08	3
3165440	99	70	46,13	cyclictest	674	50	irq/528-eth0-Tx	10:15:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17