OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Fri Mar 06, 2026 00:46:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2879037	2	781	767,6	sleep2	2864337	-21	kworker/2:2+events@ dbs_work_handler	19:05:21	2
2880533	99	126	1,87	cyclictest	3048530	-21	rm	22:42:37	0
2936463	2	125	0,4	sleep4	2932430	-21	diskmemload-4	21:16:25	4
2880538	99	122	108,7	cyclictest	2916733	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:42:35	1
2880544	99	120	106,7	cyclictest	3055196	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:02:56	2
2880544	99	120	106,7	cyclictest	3055196	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:02:56	2
2880538	99	117	104,7	cyclictest	3099645	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:38:02	1
2880533	99	117	2,83	cyclictest	0	-21	swapper/0	22:50:16	0
2880533	99	117	2,83	cyclictest	0	-21	swapper/0	22:50:16	0
2880533	99	117	1,48	cyclictest	0	-21	swapper/0	20:40:12	0
2880544	99	115	100,8	cyclictest	2923999	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:12:41	2
2880544	99	115	100,8	cyclictest	2923999	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:12:41	2
2880533	99	115	3,81	cyclictest	2980040	-21	aten2_r3power_f	21:50:19	0
2880533	99	112	2,94	cyclictest	2891040	-21	aten2_r3power_f	19:35:17	0
2880533	99	112	2,86	cyclictest	2928978	-21	diskmemload	21:25:01	0
2880533	99	112	2,86	cyclictest	2928978	-21	diskmemload	21:25:00	0
2880533	99	112	1,98	cyclictest	0	-21	swapper/0	23:30:31	0
2880533	99	112	1,98	cyclictest	0	-21	swapper/0	22:49:41	0
2880533	99	112	1,97	cyclictest	0	-21	swapper/0	21:55:37	0
2880533	99	112	1,89	cyclictest	0	-21	swapper/0	22:59:07	0
2880533	99	112	1,89	cyclictest	0	-21	swapper/0	22:59:06	0
2880538	99	111	97,8	cyclictest	3113868	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:53:35	1
2880533	99	111	78,14	cyclictest	13300	-21	snmpd	21:10:24	0
2880533	99	111	78,14	cyclictest	13300	-21	snmpd	21:10:24	0
2880533	99	111	63,22	cyclictest	3176007	-21	ntpq	00:20:37	0
2880533	99	111	1,95	cyclictest	0	-21	swapper/0	19:20:29	0
2880533	99	110	78,23	cyclictest	0	-21	swapper/0	19:40:35	0
2880533	99	109	2,94	cyclictest	0	-21	swapper/0	20:50:32	0
2880533	99	109	1,95	cyclictest	0	-21	swapper/0	19:15:01	0
2880533	99	109	1,3	cyclictest	0	-21	swapper/0	23:15:11	0
2880533	99	108	1,93	cyclictest	0	-21	swapper/0	22:27:07	0
2880533	99	108	1,90	cyclictest	0	-21	swapper/0	21:00:31	0
2880533	99	108	1,71	cyclictest	0	-21	swapper/0	00:35:12	0
2880538	99	106	93,6	cyclictest	3073940	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:22:57	1
2880538	99	106	92,7	cyclictest	2931779	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:37:47	1
2880533	99	106	1,92	cyclictest	0	-21	swapper/0	23:14:32	0
2880533	99	106	1,92	cyclictest	0	-21	swapper/0	22:38:37	0
2880533	99	106	1,90	cyclictest	2928978	-21	diskmemload	22:00:42	0
2880533	99	105	71,20	cyclictest	689	50	irq/527-eth0-Tx	00:18:39	0
2880533	99	105	2,5	cyclictest	2966498	-21	cat	21:40:01	0
2880533	99	105	2,40	cyclictest	0	-21	swapper/0	00:30:17	0
2880533	99	105	1,54	cyclictest	3019746	-21	awk	22:20:28	0
2880533	99	104	59,27	cyclictest	2958807	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:07:17	0
2880533	99	104	59,27	cyclictest	2958807	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:07:16	0
2880533	99	104	2,84	cyclictest	0	-21	swapper/0	20:24:40	0
2880533	99	104	2,84	cyclictest	0	-21	swapper/0	20:24:39	0
2880533	99	104	2,55	cyclictest	2951271	-21	ssh	21:28:09	0
2880533	99	104	2,55	cyclictest	2951271	-21	ssh	21:28:08	0
2880538	99	103	90,6	cyclictest	3024515	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:27:49	1
2880533	99	103	71,19	cyclictest	0	-21	swapper/0	19:15:37	0
2880533	99	103	2,74	cyclictest	2911246	-21	aten2_r3power_p	20:25:19	0
2880533	99	103	2,5	cyclictest	3117390	-21	ntpq	23:35:32	0
2880533	99	102	1,78	cyclictest	0	-21	swapper/0	20:10:01	0
2880533	99	101	27,47	cyclictest	3077808	-21	/usr/sbin/munin	23:05:20	0
2880533	99	101	27,47	cyclictest	3077808	-21	/usr/sbin/munin	23:05:20	0
2880533	99	101	27,27	cyclictest	0	-21	swapper/0	22:10:35	0
2880533	99	101	1,88	cyclictest	0	-21	swapper/0	22:31:52	0
2880533	99	101	1,48	cyclictest	0	-21	swapper/0	00:29:09	0
2880544	99	100	87,6	cyclictest	3113868	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:56:35	2
2880533	99	100	1,54	cyclictest	0	-21	swapper/0	19:54:41	0
2880533	99	100	1,3	cyclictest	0	-21	swapper/0	21:15:44	0
2880533	99	99	65,20	cyclictest	0	-21	swapper/0	20:30:44	0
2880533	99	99	58,31	cyclictest	691	50	irq/529-eth0-Tx	23:45:04	0
2880533	99	99	2,87	cyclictest	0	-21	swapper/0	20:55:02	0
2880533	99	99	2,52	cyclictest	3097349	-21	df_abs	23:20:23	0
2880533	99	99	1,88	cyclictest	0	-21	swapper/0	20:45:20	0
2880533	99	99	1,86	cyclictest	0	-21	swapper/0	19:25:35	0
2880533	99	99	1,85	cyclictest	0	-21	swapper/0	20:10:15	0
2880533	99	99	1,84	cyclictest	0	-21	swapper/0	20:15:33	0
2880544	99	98	83,7	cyclictest	2978746	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:55:42	2
2880533	99	98	54,28	cyclictest	3145283	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:10:32	0
2880533	99	98	2,79	cyclictest	3128822	-21	sed	23:45:01	0
2880533	99	98	1,4	cyclictest	3143524	-21	ssh	23:55:41	0
2880533	99	98	1,48	cyclictest	0	-21	swapper/0	20:00:37	0
2880533	99	98	1,48	cyclictest	0	-21	swapper/0	20:00:37	0
2880538	99	97	84,6	cyclictest	2931779	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:32:45	1
2880533	99	97	2,88	cyclictest	143	50	irq/98-imx_mu_c	21:30:34	0
2880548	99	96	83,6	cyclictest	2923999	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:02:39	3
2880538	99	96	82,7	cyclictest	2888348	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:32:28	1
2880538	99	96	82,7	cyclictest	2888348	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:32:28	1
2880533	99	96	2,84	cyclictest	0	-21	swapper/0	00:08:19	0
2880533	99	96	1,47	cyclictest	0	-21	swapper/0	21:40:22	0
2880538	99	95	80,7	cyclictest	3164004	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:30:26	1
2880533	99	95	6,33	cyclictest	3072378	-21	cat	23:00:47	0
2880533	99	95	6,33	cyclictest	3072378	-21	cat	23:00:46	0
2880533	99	94	63,19	cyclictest	0	-21	swapper/0	19:31:49	0
2880533	99	94	63,19	cyclictest	0	-21	swapper/0	19:31:49	0
2880533	99	94	54,7	cyclictest	2895524	-21	sed	19:45:23	0
2880533	99	94	54,7	cyclictest	2895524	-21	sed	19:45:23	0
2880533	99	94	45,31	cyclictest	0	-21	swapper/0	21:05:38	0
2880533	99	94	25,27	cyclictest	3103848	-21	df_abs	23:25:22	0
2880533	99	94	1,49	cyclictest	0	-21	swapper/0	21:49:23	0
2880533	99	93	54,20	cyclictest	2928978	-21	diskmemload	00:00:35	0
2880533	99	93	44,29	cyclictest	0	-21	swapper/0	20:38:36	0
2880533	99	93	44,29	cyclictest	0	-21	swapper/0	20:38:36	0
2880533	99	93	1,83	cyclictest	48	-21	rcuop/4	23:55:01	0
2880538	99	91	76,8	cyclictest	3048081	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:50:12	1
2880538	99	91	76,8	cyclictest	3048081	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:50:11	1
2880548	99	90	76,7	cyclictest	2926658	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:06:33	3
2880538	99	90	68,8	cyclictest	2931779	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:09:44	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17