OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Fri Jul 17, 2026 00:46:28)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2081371	99	122	19,57	cyclictest	2095236	-1	kworker/0:0H+kblockd@ blk_mq_run_work_fn	19:57:35	0
2081388	99	104	91,7	cyclictest	2221268	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:57:54	3
2081371	99	103	26,59	cyclictest	2123181	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:55:47	0
2081371	99	101	77,16	cyclictest	2160463	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:37:39	0
2081388	99	99	85,7	cyclictest	2221268	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:42:52	3
2081371	99	99	5,79	cyclictest	0	-21	swapper/0	22:50:33	0
2081371	99	98	16,65	cyclictest	0	-21	swapper/0	23:05:38	0
2081371	99	95	22,63	cyclictest	0	-21	swapper/0	23:57:04	0
2081371	99	94	16,31	cyclictest	2359759	-21	tail	00:05:22	0
2081371	99	92	56,26	cyclictest	0	-21	swapper/0	23:10:21	0
2081371	99	92	56,26	cyclictest	0	-21	swapper/0	23:10:20	0
2081382	99	91	75,8	cyclictest	2358419	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:28:10	2
2081371	99	91	48,24	cyclictest	0	-21	swapper/0	22:39:53	0
2081371	99	91	48,24	cyclictest	0	-21	swapper/0	22:39:52	0
2081376	99	90	76,7	cyclictest	2194497	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:02:46	1
2081371	99	90	62,15	cyclictest	675	50	irq/529-eth0-Tx	23:30:44	0
2081388	99	89	75,7	cyclictest	2297350	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:17:57	3
2081371	99	89	1,49	cyclictest	0	-21	swapper/0	22:00:20	0
2081392	99	88	83,2	cyclictest	0	-21	swapper/4	21:37:39	4
2081371	99	88	2,20	cyclictest	2334875	-21	users	23:45:46	0
2081371	99	88	2,20	cyclictest	2334875	-21	users	23:45:45	0
2081371	99	87	35,36	cyclictest	2353624	-1	kworker/0:2H-events_highpri	00:16:44	0
2081371	99	87	35,36	cyclictest	2353624	-1	kworker/0:2H-events_highpri	00:16:44	0
2081376	99	86	72,6	cyclictest	2151019	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:27:40	1
2081371	99	86	48,26	cyclictest	673	50	irq/527-eth0-Tx	23:00:40	0
2081371	99	86	2,6	cyclictest	2127890	-21	latency_hist	21:05:01	0
2081388	99	85	71,7	cyclictest	2382443	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:25:17	3
2081371	99	85	8,6	cyclictest	675	50	irq/529-eth0-Tx	00:10:29	0
2081371	99	85	6,22	cyclictest	0	-21	swapper/0	00:30:24	0
2081371	99	85	39,27	cyclictest	0	-21	swapper/0	19:17:17	0
2081371	99	84	32,8	cyclictest	2188864	-21	ntpq	21:55:29	0
2081371	99	84	32,8	cyclictest	2188864	-21	ntpq	21:55:28	0
2081397	99	83	77,3	cyclictest	0	-21	swapper/5	23:55:01	5
2081371	99	83	7,40	cyclictest	0	-21	swapper/0	21:33:28	0
2081062	2	83	54,20	sleep4	0	-21	swapper/4	19:08:00	4
2081392	99	82	70,7	cyclictest	2175563	-21	ssh	21:45:27	4
2081371	99	82	38,31	cyclictest	0	-21	swapper/0	21:12:03	0
2081371	99	82	32,5	cyclictest	2295369	-21	head	23:15:47	0
2081371	99	82	25,16	cyclictest	674	50	irq/528-eth0-Tx	22:25:12	0
2081371	99	82	2,42	cyclictest	0	-21	swapper/0	21:49:41	0
2081382	99	81	68,6	cyclictest	2123181	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:32:38	2
2081376	99	81	65,8	cyclictest	2306137	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:40:12	1
2081371	99	81	52,15	cyclictest	673	50	irq/527-eth0-Tx	22:20:40	0
2081371	99	81	46,4	cyclictest	674	50	irq/528-eth0-Tx	22:13:44	0
2081371	99	81	29,21	cyclictest	0	-21	swapper/0	19:35:01	0
2081392	99	80	68,6	cyclictest	2280411	-21	ssh	23:05:12	4
2258692	2	79	0,6	sleep0	15	-21	rcuc/0	22:48:25	0
2081397	99	79	73,3	cyclictest	0	-21	swapper/5	22:55:09	5
2081397	99	79	72,3	cyclictest	0	-21	swapper/5	00:34:20	5
2081388	99	79	65,7	cyclictest	2230588	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:52:56	3
2081376	99	79	63,7	cyclictest	2221268	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:49:51	1
2081371	99	79	7,38	cyclictest	2321092	-21	processes	23:35:40	0
2081371	99	79	59,16	cyclictest	210	-21	kswapd0	21:40:06	0
2081371	99	79	15,26	cyclictest	0	-21	swapper/0	22:44:25	0
2188368	2	78	0,4	sleep1	0	-21	swapper/1	21:55:20	1
2188368	2	78	0,4	sleep1	0	-21	swapper/1	21:55:20	1
2081397	99	78	73,2	cyclictest	0	-21	swapper/5	20:12:26	5
2081397	99	78	72,3	cyclictest	0	-21	swapper/5	22:46:44	5
2388556	2	77	0,4	sleep1	0	-21	swapper/1	00:26:47	1
2081371	99	77	4,3	cyclictest	0	-21	swapper/0	19:10:43	0
2081371	99	77	27,6	cyclictest	674	50	irq/528-eth0-Tx	00:00:20	0
2081371	99	77	18,28	cyclictest	673	50	irq/527-eth0-Tx	23:23:17	0
2081371	99	77	13,29	cyclictest	2140994	-21	latency_hist	21:20:02	0
2081371	99	77	13,29	cyclictest	2140994	-21	latency_hist	21:20:01	0
2081397	99	76	71,2	cyclictest	0	-21	swapper/5	21:15:32	5
2081397	99	76	71,2	cyclictest	0	-21	swapper/5	21:15:31	5
2081371	99	76	6,38	cyclictest	0	-21	swapper/0	22:55:18	0
2081371	99	76	29,6	cyclictest	674	50	irq/528-eth0-Tx	21:22:46	0
2343655	2	75	0,6	chrt	0	-21	swapper/1	23:52:59	1
2081397	99	75	69,3	cyclictest	0	-21	swapper/5	23:28:29	5
2081371	99	75	5,41	cyclictest	673	50	irq/527-eth0-Tx	00:20:15	0
2081371	99	75	46,25	cyclictest	210	-21	kswapd0	00:25:26	0
2081371	99	75	35,18	cyclictest	0	-21	swapper/0	20:50:43	0
2081371	99	75	35,18	cyclictest	0	-21	swapper/0	20:50:43	0
2081371	99	75	33,5	cyclictest	674	50	irq/528-eth0-Tx	22:15:14	0
2081397	99	74	68,3	cyclictest	0	-21	swapper/5	20:50:26	5
2081397	99	74	68,3	cyclictest	0	-21	swapper/5	20:50:25	5
2081397	99	74	67,4	cyclictest	0	-21	swapper/5	00:13:41	5
2081392	99	74	62,7	cyclictest	2248439	-21	ssh	22:40:26	4
2081388	99	74	60,7	cyclictest	2230588	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:27:50	3
2081388	99	74	51,10	cyclictest	2332415	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:03:05	3
2081382	99	74	66,5	cyclictest	210	-21	kswapd0	22:14:37	2
2081376	99	74	60,7	cyclictest	2221268	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:53:19	1
2081371	99	74	7,41	cyclictest	0	-21	swapper/0	20:10:21	0
2081371	99	74	31,6	cyclictest	675	50	irq/529-eth0-Tx	22:33:01	0
2154624	2	73	0,5	chrt	0	-21	swapper/1	21:30:05	1
2081397	99	73	65,4	cyclictest	0	-21	swapper/5	22:15:33	5
2081382	99	73	60,6	cyclictest	2289137	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:33:00	2
2081371	99	73	6,38	cyclictest	2326864	-21	/usr/sbin/munin	23:40:23	0
2081392	99	72	65,3	cyclictest	0	-21	swapper/4	21:40:06	4
2081371	99	72	9,30	cyclictest	0	-21	swapper/0	23:25:33	0
2081371	99	72	3,32	cyclictest	0	-21	swapper/0	21:28:44	0
2080946	2	72	49,13	sleep5	0	-21	swapper/5	19:06:29	5
2081397	99	71	66,2	cyclictest	0	-21	swapper/5	23:15:16	5
2081397	99	71	65,3	cyclictest	0	-21	swapper/5	23:50:01	5
2081397	99	71	65,3	cyclictest	0	-21	swapper/5	23:50:00	5
2081397	99	71	65,3	cyclictest	0	-21	swapper/5	19:40:19	5
2081397	99	71	65,3	cyclictest	0	-21	swapper/5	19:30:35	5
2081371	99	71	10,5	cyclictest	675	50	irq/529-eth0-Tx	23:50:32	0
2081397	99	70	64,3	cyclictest	0	-21	swapper/5	19:50:23	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17