OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat Jun 20, 2026 00:46:32)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3905106	2	2626	2616,5	sleep5	0	-21	swapper/5	19:06:00	5
3905564	99	127	112,8	cyclictest	3907189	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:15:34	3
3905551	99	119	85,22	cyclictest	0	-21	swapper/0	20:40:11	0
3905551	99	118	22,60	cyclictest	3973636	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:41:04	0
3905551	99	114	74,26	cyclictest	673	50	irq/527-eth0-Tx	23:26:29	0
3905551	99	114	74,26	cyclictest	673	50	irq/527-eth0-Tx	23:26:29	0
3905551	99	113	2,68	cyclictest	4047994	-21	find	22:25:42	0
4159861	2	111	0,6	sleep0	15	-21	rcuc/0	23:55:43	0
3905551	99	110	68,32	cyclictest	674	50	irq/528-eth0-Tx	23:10:29	0
3905551	99	110	2,68	cyclictest	3954070	-21	cat	21:10:00	0
3905551	99	109	74,22	cyclictest	674	50	irq/528-eth0-Tx	22:55:34	0
3905551	99	109	58,17	cyclictest	0	-21	swapper/0	20:25:35	0
3905551	99	109	1,73	cyclictest	0	-21	swapper/0	20:00:30	0
3905551	99	109	1,73	cyclictest	0	-21	swapper/0	20:00:29	0
3905551	99	106	1,78	cyclictest	0	-21	swapper/0	19:25:29	0
3905551	99	106	1,78	cyclictest	0	-21	swapper/0	19:25:29	0
3905551	99	105	2,76	cyclictest	0	-21	swapper/0	20:50:39	0
3905564	99	104	91,7	cyclictest	4073132	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:01:24	3
3905551	99	104	65,16	cyclictest	674	50	irq/528-eth0-Tx	23:03:01	0
3905551	99	103	68,10	cyclictest	674	50	irq/528-eth0-Tx	23:05:26	0
3905551	99	103	54,18	cyclictest	4028836	-21	sed	22:10:24	0
4071960	2	102	0,5	sleep4	4071957	-21	ssh	22:45:23	4
3905551	99	102	44,18	cyclictest	0	-21	swapper/0	00:15:07	0
3905551	99	102	2,73	cyclictest	0	-21	swapper/0	23:30:20	0
3905551	99	102	1,79	cyclictest	0	-21	swapper/0	21:53:01	0
3905551	99	102	1,74	cyclictest	0	-21	swapper/0	20:05:33	0
3905551	99	101	1,74	cyclictest	0	-21	swapper/0	21:25:29	0
3905551	99	101	1,74	cyclictest	0	-21	swapper/0	21:25:28	0
3905551	99	101	1,74	cyclictest	0	-21	swapper/0	20:30:33	0
3905551	99	101	1,44	cyclictest	0	-21	swapper/0	22:46:21	0
3905551	99	100	69,24	cyclictest	674	50	irq/528-eth0-Tx	21:15:28	0
3905551	99	100	66,12	cyclictest	675	50	irq/529-eth0-Tx	19:10:29	0
3905551	99	100	1,73	cyclictest	0	-21	swapper/0	19:55:33	0
3905556	99	99	86,7	cyclictest	3920089	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:45:40	1
3905556	99	99	86,7	cyclictest	3920089	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:45:40	1
3905551	99	99	64,12	cyclictest	675	50	irq/529-eth0-Tx	21:30:20	0
3905551	99	99	55,7	cyclictest	10927	-21	ssh	00:31:51	0
3905551	99	99	55,7	cyclictest	10927	-21	ssh	00:31:51	0
3905551	99	99	1,60	cyclictest	0	-21	swapper/0	19:15:29	0
3905551	99	98	52,17	cyclictest	0	-21	swapper/0	22:05:19	0
3905551	99	98	1,76	cyclictest	0	-21	swapper/0	22:34:25	0
3905551	99	98	1,75	cyclictest	0	-21	swapper/0	22:39:43	0
3905551	99	98	1,75	cyclictest	0	-21	swapper/0	22:39:42	0
3905569	99	97	91,3	cyclictest	0	-21	swapper/4	22:51:24	4
3905564	99	97	83,7	cyclictest	4180558	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:32:25	3
3905564	99	97	83,7	cyclictest	4180558	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:32:24	3
3905564	99	96	82,7	cyclictest	4098461	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:11:27	3
3905551	99	96	2,76	cyclictest	0	-21	swapper/0	19:50:01	0
3905551	99	96	2,76	cyclictest	0	-21	swapper/0	19:50:01	0
3905551	99	96	1,72	cyclictest	0	-21	swapper/0	20:16:13	0
3905551	99	96	1,70	cyclictest	68	-21	kcompactd0	22:41:16	0
3905556	99	95	81,8	cyclictest	4073132	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:00:11	1
3905551	99	95	2,72	cyclictest	0	-21	swapper/0	22:54:13	0
3905560	99	94	80,7	cyclictest	4160251	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:13:35	2
3905551	99	94	67,8	cyclictest	0	-21	swapper/0	00:23:09	0
3905551	99	94	1,58	cyclictest	0	-21	swapper/0	20:23:56	0
3905551	99	94	1,58	cyclictest	0	-21	swapper/0	20:23:55	0
3905551	99	93	66,4	cyclictest	0	-21	swapper/0	20:45:35	0
3905551	99	93	57,16	cyclictest	674	50	irq/528-eth0-Tx	23:21:27	0
3905551	99	93	57,16	cyclictest	674	50	irq/528-eth0-Tx	23:21:27	0
3905551	99	93	51,14	cyclictest	0	-21	swapper/0	19:40:17	0
3905551	99	93	2,5	cyclictest	4142451	-21	ssh	23:41:37	0
4065517	2	90	0,4	sleep3	0	-21	swapper/3	22:40:19	3
3905573	99	85	80,2	cyclictest	0	-21	swapper/5	20:40:52	5
3905560	99	85	71,7	cyclictest	3907189	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:20:35	2
3905564	99	84	70,7	cyclictest	4142827	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:01:39	3
3904556	2	84	55,20	sleep4	0	-21	swapper/4	19:05:35	4
3905573	99	83	77,3	cyclictest	0	-21	swapper/5	23:31:29	5
4153544	2	82	0,13	sleep0	13	-21	ksoftirqd/0	23:50:40	0
3905564	99	82	70,6	cyclictest	4142827	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:08:30	3
3905556	99	82	67,8	cyclictest	3902236	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:10:34	1
3905556	99	82	65,8	cyclictest	3931659	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:20:48	1
3905556	99	82	65,8	cyclictest	3931659	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:20:47	1
3905560	99	81	68,6	cyclictest	4142827	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:46:55	2
3905551	99	81	2,6	cyclictest	3931798	-21	munin-run	20:15:01	0
3905551	99	81	2,44	cyclictest	0	-21	swapper/0	22:16:53	0
3905551	99	81	1,3	cyclictest	0	-21	swapper/0	00:04:31	0
3905551	99	80	49,14	cyclictest	0	-21	swapper/0	19:30:29	0
3905551	99	80	43,3	cyclictest	0	-21	swapper/0	22:20:34	0
3905551	99	80	1,48	cyclictest	0	-21	swapper/0	21:55:25	0
3905551	99	80	1,48	cyclictest	0	-21	swapper/0	21:55:24	0
3905564	99	79	69,7	cyclictest	210	-21	kswapd0	00:15:07	3
3905560	99	79	65,7	cyclictest	4142827	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:35:45	2
3905556	99	79	65,7	cyclictest	4125275	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:31:46	1
3905551	99	79	53,7	cyclictest	4134621	-21	ntpq	23:35:33	0
3905551	99	79	51,14	cyclictest	0	-21	swapper/0	19:50:30	0
3905551	99	79	43,5	cyclictest	3940995	-21	ntpq	20:35:29	0
3905551	99	79	41,4	cyclictest	0	-21	swapper/0	21:10:27	0
3905551	99	79	39,25	cyclictest	13	-21	ksoftirqd/0	23:15:10	0
3905551	99	79	1,75	cyclictest	0	-21	swapper/0	21:24:39	0
3905551	99	79	1,51	cyclictest	0	-21	swapper/0	21:40:01	0
3905564	99	78	64,7	cyclictest	3937611	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:20:20	3
3905560	99	78	64,7	cyclictest	4194290	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:28:41	2
3905551	99	78	43,15	cyclictest	0	-21	swapper/0	22:04:44	0
3905551	99	78	1,74	cyclictest	0	-21	swapper/0	00:37:27	0
3905564	99	77	65,6	cyclictest	4106778	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:16:28	3
3905551	99	77	54,14	cyclictest	673	50	irq/527-eth0-Tx	19:35:33	0
3905551	99	77	49,3	cyclictest	0	-21	swapper/0	23:45:35	0
3905551	99	77	42,21	cyclictest	14	-21	rcu_preempt	00:14:19	0
3905551	99	77	2,47	cyclictest	15	-21	rcuc/0	00:25:41	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17