OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Thu Feb 05, 2026 00:46:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4084426	2	3161	3133,9	sleep3	4079088	-21	kworker/3:3+events@ dbs_work_handler	19:05:25	3
4085400	2	382	357,15	sleep4	0	-21	swapper/4	19:09:30	4
4085601	99	154	129,6	cyclictest	44357	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:35:58	0
4085601	99	124	111,6	cyclictest	4113708	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:20:32	0
4085601	99	118	69,42	cyclictest	107130	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:44:41	0
4085606	99	109	95,7	cyclictest	36618	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:45:58	1
4085601	99	108	59,29	cyclictest	25535	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:33:32	0
4085601	99	107	73,27	cyclictest	60041	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:54:39	0
4085601	99	105	55,31	cyclictest	4134233	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:11:35	0
4085618	99	104	90,7	cyclictest	4099604	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:29:34	3
4085618	99	104	90,7	cyclictest	4099604	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:29:34	3
4084254	2	104	86,7	sleep1	4064307	-21	kworker/1:0+events@ dbs_work_handler	19:05:23	1
4085601	99	103	63,16	cyclictest	25535	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:24:38	0
4085601	99	103	3,60	cyclictest	36618	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:40:40	0
4085601	99	101	49,29	cyclictest	97116	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:29:34	0
4085601	99	101	27,57	cyclictest	4088637	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:19:03	0
4085601	99	101	27,57	cyclictest	4088637	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:19:02	0
4085606	99	100	86,7	cyclictest	44357	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:00:56	1
4085606	99	100	86,7	cyclictest	44357	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:00:55	1
4085601	99	100	64,13	cyclictest	4192311	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:02:44	0
4085601	99	100	64,13	cyclictest	4192311	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:02:43	0
4085618	99	99	85,7	cyclictest	4097541	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:40:22	3
4085601	99	99	85,7	cyclictest	4137644	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:30:58	0
4085601	99	99	59,33	cyclictest	87512	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:52:17	0
4085622	99	98	86,7	cyclictest	4174201	-21	ssh	21:42:38	4
4085622	99	97	84,7	cyclictest	4137554	-21	diskmemload-4	00:06:24	4
4085622	99	97	84,7	cyclictest	4137554	-21	diskmemload-4	00:06:24	4
4085606	99	97	83,7	cyclictest	4117887	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:35:35	1
4085622	99	96	90,3	cyclictest	0	-21	swapper/4	00:17:03	4
4085601	99	96	84,6	cyclictest	154652	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:37:55	0
4085601	99	96	84,6	cyclictest	154652	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:37:54	0
4085601	99	96	82,7	cyclictest	44357	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:46:32	0
4085601	99	96	69,14	cyclictest	689	50	irq/527-eth0-Tx	23:35:00	0
4085601	99	95	67,7	cyclictest	76114	-21	cat	23:00:01	0
4085622	99	94	88,3	cyclictest	0	-21	swapper/4	21:01:34	4
4085601	99	94	81,6	cyclictest	4091319	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:33:35	0
4085601	99	94	68,14	cyclictest	691	50	irq/529-eth0-Tx	22:15:01	0
4085627	99	93	88,2	cyclictest	0	-21	swapper/5	21:50:50	5
4085606	99	93	80,6	cyclictest	4166303	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:10:52	1
4085627	99	92	87,2	cyclictest	0	-21	swapper/5	21:29:35	5
4085627	99	92	87,2	cyclictest	0	-21	swapper/5	21:29:34	5
4085622	99	92	86,3	cyclictest	0	-21	swapper/4	23:26:01	4
4085601	99	92	1,81	cyclictest	174118	-21	idleruntime-cro	00:20:00	0
4085627	99	91	86,2	cyclictest	0	-21	swapper/5	23:38:01	5
4085627	99	91	86,2	cyclictest	0	-21	swapper/5	23:38:00	5
4085627	99	91	85,3	cyclictest	0	-21	swapper/5	21:15:41	5
4085601	99	91	2,70	cyclictest	0	-21	swapper/0	00:07:13	0
4085601	99	91	2,70	cyclictest	0	-21	swapper/0	00:07:12	0
4085627	99	90	83,3	cyclictest	0	-21	swapper/5	23:07:06	5
4085622	99	90	76,8	cyclictest	140882	-21	ssh	23:51:54	4
4085601	99	90	76,7	cyclictest	107130	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:45:07	0
4085601	99	90	61,20	cyclictest	689	50	irq/527-eth0-Tx	20:50:00	0
4085601	99	90	57,26	cyclictest	4132045	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:05:13	0
4085622	99	89	83,3	cyclictest	0	-21	swapper/4	23:14:34	4
4085606	99	89	76,7	cyclictest	4083273	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:20:14	1
4085601	99	89	79,7	cyclictest	4126453	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:36:44	0
4085601	99	89	60,7	cyclictest	97116	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:37:06	0
4085601	99	89	60,7	cyclictest	97116	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:37:05	0
4085601	99	89	37,44	cyclictest	4134233	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:24:28	0
4085601	99	89	37,44	cyclictest	4134233	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:24:27	0
74400	2	88	0,5	sleep4	4137554	-21	diskmemload-4	22:58:14	4
4085622	99	88	75,6	cyclictest	0	-21	swapper/4	21:34:26	4
4085611	99	88	74,7	cyclictest	4134233	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:20:42	2
4085611	99	88	74,7	cyclictest	4134233	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:20:42	2
4085601	99	88	74,7	cyclictest	44357	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:01:02	0
4085601	99	88	74,7	cyclictest	44357	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:01:01	0
4085601	99	88	68,4	cyclictest	691	50	irq/529-eth0-Tx	21:25:36	0
4085601	99	88	68,4	cyclictest	691	50	irq/529-eth0-Tx	21:25:36	0
4085627	99	87	82,2	cyclictest	0	-21	swapper/5	21:45:52	5
4085627	99	87	80,4	cyclictest	0	-21	swapper/5	20:50:00	5
4085606	99	87	73,7	cyclictest	4126453	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:05:39	1
4085601	99	87	75,6	cyclictest	4174716	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:49:00	0
4085606	99	86	63,8	cyclictest	25535	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:30:00	1
4085601	99	86	60,18	cyclictest	179009	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:30:53	0
4085601	99	86	60,18	cyclictest	179009	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:30:53	0
4085601	99	85	73,6	cyclictest	4108217	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:10:07	0
4085601	99	85	73,6	cyclictest	4108217	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:10:07	0
4085627	99	84	79,2	cyclictest	0	-21	swapper/5	00:30:53	5
4085627	99	84	79,2	cyclictest	0	-21	swapper/5	00:30:53	5
4085606	99	84	68,8	cyclictest	4166303	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:50:37	1
4085601	99	84	76,6	cyclictest	4174716	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:44:52	0
4085601	99	84	73,5	cyclictest	4081152	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:13:32	0
4085627	99	83	78,2	cyclictest	0	-21	swapper/5	23:40:58	5
4085622	99	83	77,3	cyclictest	0	-21	swapper/4	19:11:35	4
4085622	99	83	71,7	cyclictest	4150723	-21	ssh	21:24:27	4
4085622	99	83	71,7	cyclictest	4150723	-21	ssh	21:24:27	4
4085627	99	82	77,2	cyclictest	0	-21	swapper/5	23:52:40	5
4085627	99	82	75,3	cyclictest	0	-21	swapper/5	20:35:40	5
4085601	99	82	48,17	cyclictest	0	-21	swapper/0	22:25:39	0
4085627	99	81	76,2	cyclictest	0	-21	swapper/5	23:18:38	5
4085627	99	81	75,3	cyclictest	0	-21	swapper/5	23:46:14	5
4085622	99	81	75,3	cyclictest	0	-21	swapper/4	21:45:35	4
4085618	99	81	67,7	cyclictest	107130	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:38:25	3
4085618	99	81	67,7	cyclictest	107130	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:38:24	3
4085606	99	81	67,7	cyclictest	87512	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:31:34	1
4085606	99	81	45,8	cyclictest	4137644	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:28:23	1
4085606	99	81	45,8	cyclictest	4137644	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:28:23	1
4085601	99	81	73,6	cyclictest	4126453	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:03:35	0
4085601	99	81	67,7	cyclictest	4126453	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:15:41	0
4085622	99	80	67,7	cyclictest	4151587	-21	ssh	21:25:04	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17