OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Mon Jul 20, 2026 00:46:28)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1062599	2	1044	1019,15	sleep5	0	-21	swapper/5	19:05:23	5
1064019	99	123	88,25	cyclictest	1074090	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:37:04	0
1064019	99	121	75,33	cyclictest	1109408	-21	ethtool	21:00:25	0
1064019	99	120	78,35	cyclictest	1104221	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:22:18	0
1064019	99	120	53,51	cyclictest	1127862	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:26:21	0
1064042	99	116	103,6	cyclictest	1339265	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:38:45	3
1064019	99	113	55,42	cyclictest	1217653	-21	ssh	22:30:21	0
1064019	99	113	55,42	cyclictest	1217653	-21	ssh	22:30:20	0
1064019	99	109	5,48	cyclictest	13	-21	ksoftirqd/0	22:53:54	0
1064019	99	109	53,41	cyclictest	0	-21	swapper/0	23:00:41	0
1064019	99	109	1,52	cyclictest	48	-21	rcuop/4	00:20:22	0
1064019	99	107	39,55	cyclictest	676	50	irq/530-eth0-Tx	23:25:22	0
1064019	99	106	12,67	cyclictest	673	50	irq/527-eth0-Tx	22:15:23	0
1064019	99	105	1,70	cyclictest	0	-21	swapper/0	19:15:21	0
1064019	99	105	1,57	cyclictest	13	-21	ksoftirqd/0	21:15:27	0
1064019	99	102	70,24	cyclictest	1199628	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:22:27	0
1064019	99	102	70,24	cyclictest	1199628	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:22:26	0
1064019	99	102	45,25	cyclictest	14	-21	rcu_preempt	20:10:41	0
1064019	99	102	45,25	cyclictest	14	-21	rcu_preempt	20:10:41	0
1064019	99	100	2,60	cyclictest	0	-21	swapper/0	22:39:21	0
1064019	99	100	12,64	cyclictest	674	50	irq/528-eth0-Tx	23:13:03	0
1064019	99	100	12,64	cyclictest	674	50	irq/528-eth0-Tx	23:13:03	0
1064019	99	99	50,24	cyclictest	0	-21	swapper/0	20:05:45	0
1064019	99	99	1,6	cyclictest	1356123	-21	ssh	00:15:08	0
1064019	99	98	53,21	cyclictest	674	50	irq/528-eth0-Tx	00:10:43	0
1064019	99	98	53,21	cyclictest	674	50	irq/528-eth0-Tx	00:10:43	0
1064019	99	98	43,47	cyclictest	1314773	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:48:06	0
1064019	99	98	32,12	cyclictest	0	-21	swapper/0	23:35:15	0
1064019	99	97	63,31	cyclictest	1252095	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:59:46	0
1064019	99	97	42,24	cyclictest	674	50	irq/528-eth0-Tx	23:50:20	0
1064019	99	97	33,38	cyclictest	142	50	irq/98-imx_mu_c	21:56:40	0
1064019	99	97	27,37	cyclictest	0	-21	swapper/0	21:40:21	0
1064019	99	97	27,37	cyclictest	0	-21	swapper/0	21:40:21	0
1064019	99	96	48,25	cyclictest	1102808	-21	/usr/sbin/munin	20:45:25	0
1064019	99	96	47,22	cyclictest	1112747	-21	diskmemload	21:32:26	0
1064019	99	96	21,28	cyclictest	13	-21	ksoftirqd/0	22:00:34	0
1064019	99	95	2,48	cyclictest	1376536	-21	ssh	00:30:22	0
1064019	99	94	44,18	cyclictest	13	-21	ksoftirqd/0	22:13:40	0
1064019	99	94	1,4	cyclictest	1311134	-21	ssh	23:40:38	0
1064019	99	93	65,25	cyclictest	1112646	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:47:22	0
1064019	99	93	2,4	cyclictest	0	-21	swapper/0	20:15:43	0
1064019	99	93	1,5	cyclictest	1073306	-21	ntpq	19:30:41	0
1064019	99	92	47,31	cyclictest	1112646	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:08:55	0
1064019	99	92	32,22	cyclictest	675	50	irq/529-eth0-Tx	22:25:12	0
1064019	99	92	32,22	cyclictest	675	50	irq/529-eth0-Tx	22:25:11	0
1064019	99	92	1,59	cyclictest	0	-21	swapper/0	23:20:34	0
1064019	99	91	4,42	cyclictest	13	-21	ksoftirqd/0	21:37:46	0
1064019	99	91	1,49	cyclictest	13	-21	ksoftirqd/0	00:29:19	0
1064019	99	90	23,15	cyclictest	1330356	-21	irqstats	23:55:23	0
1064019	99	89	1,47	cyclictest	0	-21	swapper/0	23:31:35	0
1064019	99	88	16,30	cyclictest	676	50	irq/530-eth0-Tx	22:47:01	0
1064019	99	87	43,14	cyclictest	1100535	-21	date	20:40:01	0
1064019	99	87	1,25	cyclictest	1281187	-21	ssh	23:18:20	0
1064019	99	87	1,25	cyclictest	1281187	-21	ssh	23:18:19	0
1064019	99	87	11,32	cyclictest	675	50	irq/529-eth0-Tx	22:40:28	0
1064019	99	86	56,23	cyclictest	1076670	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:57:08	0
1064019	99	86	47,35	cyclictest	1104221	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:14:46	0
1064042	99	85	70,7	cyclictest	1339265	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:13:36	3
1064042	99	85	70,7	cyclictest	1339265	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:13:36	3
1064059	99	84	77,3	cyclictest	0	-21	swapper/5	20:37:15	5
1064050	99	81	75,2	cyclictest	0	-21	swapper/4	22:30:35	4
1064050	99	81	75,2	cyclictest	0	-21	swapper/4	22:30:34	4
1064025	99	81	69,6	cyclictest	1339265	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:23:39	1
1064042	99	79	66,6	cyclictest	1190090	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:13:44	3
1064019	99	78	46,15	cyclictest	1076670	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:47:22	0
1064042	99	77	63,6	cyclictest	1059548	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:13:47	3
1381291	2	75	0,4	sleep5	0	-21	swapper/5	00:34:09	5
1064050	99	75	69,3	cyclictest	0	-21	swapper/4	00:35:59	4
1064050	99	75	62,7	cyclictest	1116222	-21	diskmemload-4	00:28:31	4
1064019	99	75	42,15	cyclictest	1096278	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:28:57	0
1064019	99	75	33,13	cyclictest	1265914	-21	ssh	23:06:17	0
1064019	99	75	2,59	cyclictest	0	-21	swapper/0	00:06:06	0
1064019	99	75	2,59	cyclictest	0	-21	swapper/0	00:06:06	0
1064019	99	75	1,26	cyclictest	13	-21	ksoftirqd/0	00:35:10	0
1064050	99	74	67,3	cyclictest	0	-21	swapper/4	21:50:40	4
1064050	99	74	62,7	cyclictest	1196552	-21	ssh	22:14:46	4
1064019	99	74	40,16	cyclictest	1088629	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:21:04	0
1064019	99	74	2,4	cyclictest	0	-21	swapper/0	20:55:00	0
1064019	99	74	11,34	cyclictest	676	50	irq/530-eth0-Tx	00:00:17	0
1064019	99	74	11,34	cyclictest	676	50	irq/530-eth0-Tx	00:00:16	0
1153884	2	73	0,5	sleep1	23	-21	ksoftirqd/1	21:41:49	1
1153884	2	73	0,5	sleep1	23	-21	ksoftirqd/1	21:41:48	1
1064050	99	73	66,3	cyclictest	0	-21	swapper/4	23:29:54	4
1064050	99	73	66,3	cyclictest	0	-21	swapper/4	22:53:37	4
1064050	99	73	66,3	cyclictest	0	-21	swapper/4	19:20:43	4
1064050	99	73	66,3	cyclictest	0	-21	swapper/4	19:20:43	4
1064050	99	73	60,7	cyclictest	1116222	-21	diskmemload-4	23:45:37	4
1064019	99	73	41,20	cyclictest	674	50	irq/528-eth0-Tx	19:50:17	0
1064019	99	73	39,22	cyclictest	673	50	irq/527-eth0-Tx	21:05:29	0
1064019	99	73	21,19	cyclictest	675	50	irq/529-eth0-Tx	21:50:30	0
1064050	99	72	67,2	cyclictest	0	-21	swapper/4	23:17:35	4
1064050	99	72	67,2	cyclictest	0	-21	swapper/4	23:17:34	4
1064050	99	72	66,3	cyclictest	0	-21	swapper/4	21:13:56	4
1064025	99	72	58,7	cyclictest	1339265	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:18:39	1
1064031	99	71	58,7	cyclictest	1063741	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:22:02	2
1064031	99	71	58,7	cyclictest	1063741	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:22:02	2
1064050	99	70	65,2	cyclictest	0	-21	swapper/4	22:45:16	4
1064050	99	70	64,2	cyclictest	0	-21	swapper/4	19:45:13	4
1064050	99	69	58,6	cyclictest	1123173	-21	ssh	21:19:19	4
1064050	99	69	56,8	cyclictest	1141060	-21	ssh	21:32:19	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17