OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Jan 18, 2026 00:46:31)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2869781	2	3432	3414,10	sleep5	0	-21	swapper/5	19:05:38	5
2869546	2	1179	1162,8	sleep1	2869220	-21	kworker/1:2+events@ dbs_work_handler	19:05:28	1
2870693	99	177	34,97	cyclictest	2874475	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	19:40:32	0
2870706	99	134	120,7	cyclictest	3110384	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:53:06	2
2969200	2	126	0,11	sleep0	13	-21	ksoftirqd/0	21:51:40	0
2870725	99	114	109,2	cyclictest	0	-21	swapper/4	23:58:08	4
2870693	99	113	81,4	cyclictest	2995601	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:27:51	0
2870725	99	111	105,3	cyclictest	0	-21	swapper/4	22:52:57	4
2870725	99	111	105,3	cyclictest	0	-21	swapper/4	22:52:57	4
2870693	99	111	85,6	cyclictest	689	50	irq/527-eth0-Tx	22:05:01	0
2870693	99	111	69,18	cyclictest	56	-21	rcuop/5	00:25:28	0
2870693	99	110	70,19	cyclictest	689	50	irq/527-eth0-Tx	00:10:20	0
2870693	99	108	62,33	cyclictest	689	50	irq/527-eth0-Tx	22:45:23	0
2870725	99	104	97,3	cyclictest	0	-21	swapper/4	19:42:14	4
2870706	99	104	89,7	cyclictest	3094312	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:34:33	2
2870693	99	104	71,9	cyclictest	2913016	-1	kworker/0:0H-kblockd	22:50:28	0
2870693	99	104	71,9	cyclictest	2913016	-1	kworker/0:0H-kblockd	22:50:28	0
2870725	99	99	94,2	cyclictest	0	-21	swapper/4	00:33:16	4
3161609	2	97	0,4	sleep1	0	-21	swapper/1	00:27:14	1
2870706	99	97	84,6	cyclictest	3087921	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:23:11	2
2870706	99	97	83,7	cyclictest	2902742	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:46:35	2
2870706	99	96	83,6	cyclictest	2876567	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:26:34	2
2870706	99	96	65,7	cyclictest	2961492	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	21:53:12	2
2870693	99	95	72,5	cyclictest	689	50	irq/527-eth0-Tx	00:05:12	0
2870693	99	94	69,6	cyclictest	2902742	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:42:25	0
2870693	99	94	69,4	cyclictest	0	-21	swapper/0	23:25:22	0
2870706	99	93	62,7	cyclictest	2920222	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:38:45	2
2870693	99	93	72,4	cyclictest	0	-21	swapper/0	22:05:39	0
2870693	99	93	72,4	cyclictest	0	-21	swapper/0	22:05:39	0
2870706	99	92	80,6	cyclictest	2948834	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:41:35	2
2870693	99	92	60,12	cyclictest	0	-21	swapper/0	21:30:19	0
2870706	99	91	79,6	cyclictest	3139017	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:30:36	2
2870706	99	91	60,8	cyclictest	2874475	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	19:19:25	2
2870706	99	90	76,7	cyclictest	2920222	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:29:58	2
2870706	99	90	58,7	cyclictest	2933174	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:46:03	2
2870693	99	90	74,4	cyclictest	691	50	irq/529-eth0-Tx	21:56:09	0
2870693	99	90	62,7	cyclictest	3097848	-21	sh	23:35:37	0
2870693	99	90	62,11	cyclictest	0	-21	swapper/0	22:30:25	0
2870693	99	90	51,3	cyclictest	0	-21	swapper/0	22:23:49	0
2870706	99	89	76,6	cyclictest	2878659	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:33:42	2
2870693	99	89	61,16	cyclictest	0	-21	swapper/0	19:20:12	0
2870693	99	89	60,16	cyclictest	0	-21	swapper/0	22:55:31	0
2870693	99	89	60,16	cyclictest	0	-21	swapper/0	22:55:30	0
3106006	2	88	0,4	sleep3	0	-21	swapper/3	23:42:11	3
3106006	2	88	0,4	sleep3	0	-21	swapper/3	23:42:11	3
3092287	2	88	0,5	sleep3	3092291	-21	unixbench_singl	23:30:46	3
2870706	99	88	74,7	cyclictest	2988827	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:12:43	2
2870693	99	88	64,15	cyclictest	689	50	irq/527-eth0-Tx	23:15:34	0
2870706	99	87	73,7	cyclictest	3041075	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:19:08	2
2870706	99	87	60,7	cyclictest	2917546	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:11:44	2
2870693	99	87	59,9	cyclictest	0	-21	swapper/0	00:35:01	0
2870693	99	87	41,10	cyclictest	0	-21	swapper/0	23:20:30	0
2870706	99	86	74,6	cyclictest	3011814	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:42:14	2
2870706	99	86	74,6	cyclictest	3011814	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:42:14	2
2870706	99	86	73,6	cyclictest	3081566	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:36:00	2
2870706	99	86	73,6	cyclictest	2866273	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:14:34	2
2870706	99	86	73,6	cyclictest	2866273	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:14:33	2
2870706	99	85	72,6	cyclictest	3087921	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:40:52	2
2870706	99	85	72,6	cyclictest	3087921	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:40:52	2
2870706	99	85	71,7	cyclictest	3101636	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:55:23	2
2870698	99	85	44,15	cyclictest	2890756	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:01:24	1
2870693	99	85	66,12	cyclictest	0	-21	swapper/0	23:48:50	0
2870693	99	85	55,13	cyclictest	0	-21	swapper/0	20:30:16	0
2870735	99	84	79,2	cyclictest	0	-21	swapper/5	22:42:55	5
2870735	99	84	79,2	cyclictest	0	-21	swapper/5	22:42:55	5
2870725	99	84	76,3	cyclictest	0	-21	swapper/4	22:27:51	4
2870706	99	84	70,7	cyclictest	3041075	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:27:59	2
2870706	99	84	70,7	cyclictest	2902742	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:31:34	2
2870693	99	84	65,9	cyclictest	0	-21	swapper/0	19:35:35	0
2870693	99	84	61,7	cyclictest	2910106	-21	ntp_kernel_err	20:45:29	0
2870693	99	84	56,15	cyclictest	690	50	irq/528-eth0-Tx	23:05:18	0
2870693	99	84	54,9	cyclictest	0	-21	swapper/0	20:10:35	0
2870693	99	84	54,9	cyclictest	0	-21	swapper/0	20:10:34	0
2870725	99	83	64,14	cyclictest	3152043	-21	ssh	00:20:02	4
2870706	99	83	70,6	cyclictest	2940957	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:32:39	2
2870693	99	83	53,4	cyclictest	0	-21	swapper/0	23:55:48	0
2978217	2	82	0,5	sleep5	0	-21	swapper/5	21:59:44	5
2870706	99	82	69,6	cyclictest	2926795	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:19:33	2
2870693	99	82	58,8	cyclictest	0	-21	swapper/0	20:35:33	0
2870693	99	82	46,21	cyclictest	0	-21	swapper/0	19:25:31	0
2870735	99	81	70,8	cyclictest	0	-21	swapper/5	19:25:12	5
2870725	99	81	67,8	cyclictest	3110127	-21	ssh	23:45:33	4
2870706	99	81	68,6	cyclictest	2892808	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:11:50	2
2870706	99	81	68,6	cyclictest	2892808	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:11:49	2
2870706	99	81	67,7	cyclictest	3101636	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:12:35	2
2870706	99	81	67,7	cyclictest	3068622	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:20:20	2
2870706	99	81	67,7	cyclictest	3068622	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:14:15	2
2870706	99	81	67,7	cyclictest	2908787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:02:30	2
2870706	99	81	67,7	cyclictest	2902742	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:44:34	2
2870693	99	81	59,13	cyclictest	690	50	irq/528-eth0-Tx	23:12:56	0
2870693	99	81	45,17	cyclictest	0	-21	swapper/0	19:55:13	0
2870706	99	80	67,6	cyclictest	2926795	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:22:35	2
2870706	99	80	66,7	cyclictest	2917546	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:09:09	2
2870706	99	80	65,8	cyclictest	3081566	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:48:07	2
2870706	99	80	65,7	cyclictest	3166536	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:35:54	2
2870693	99	80	63,6	cyclictest	689	50	irq/527-eth0-Tx	19:50:38	0
2870693	99	80	63,4	cyclictest	689	50	irq/527-eth0-Tx	20:00:15	0
2870693	99	80	54,16	cyclictest	690	50	irq/528-eth0-Tx	23:03:40	0
2870693	99	80	54,16	cyclictest	690	50	irq/528-eth0-Tx	23:03:40	0
2870693	99	80	49,6	cyclictest	15	-21	rcuc/0	21:25:17	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17