OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Fri Jul 24, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
14932	99	104	102	cyclictest	20068	-21	tune2fs	04:06:06	1
14951	99	103	102	cyclictest	0	-21	swapper/3	08:55:56	3
14951	99	103	102	cyclictest	0	-21	swapper/3	04:06:06	3
14932	99	103	102	cyclictest	15874	-21	tune2fs	08:55:56	1
14932	99	94	92	cyclictest	0	-21	swapper/1	04:41:07	1
14951	99	87	86	cyclictest	0	-21	swapper/3	09:20:53	3
14951	99	83	82	cyclictest	0	-21	swapper/3	09:15:58	3
14951	99	83	82	cyclictest	0	-21	swapper/3	09:00:59	3
14951	99	83	82	cyclictest	0	-21	swapper/3	08:45:55	3
14951	99	83	82	cyclictest	0	-21	swapper/3	08:41:01	3
14951	99	83	82	cyclictest	0	-21	swapper/3	08:31:02	3
14951	99	83	82	cyclictest	0	-21	swapper/3	08:15:55	3
14951	99	83	82	cyclictest	0	-21	swapper/3	07:55:58	3
14951	99	83	82	cyclictest	0	-21	swapper/3	07:50:45	3
14951	99	83	82	cyclictest	0	-21	swapper/3	07:40:58	3
14951	99	83	82	cyclictest	0	-21	swapper/3	07:31:02	3
14951	99	83	82	cyclictest	0	-21	swapper/3	07:31:02	3
14951	99	83	82	cyclictest	0	-21	swapper/3	07:13:55	3
14951	99	83	82	cyclictest	0	-21	swapper/3	06:50:48	3
14951	99	83	82	cyclictest	0	-21	swapper/3	06:36:06	3
14951	99	83	82	cyclictest	0	-21	swapper/3	06:25:46	3
14951	99	83	82	cyclictest	0	-21	swapper/3	05:21:09	3
14951	99	83	82	cyclictest	0	-21	swapper/3	05:16:10	3
14951	99	83	82	cyclictest	0	-21	swapper/3	05:11:07	3
14951	99	83	82	cyclictest	0	-21	swapper/3	04:56:10	3
14951	99	83	82	cyclictest	0	-21	swapper/3	04:36:06	3
14951	99	83	82	cyclictest	0	-21	swapper/3	04:31:05	3
14951	99	83	82	cyclictest	0	-21	swapper/3	04:21:15	3
14951	99	83	82	cyclictest	0	-21	swapper/3	04:16:02	3
14951	99	83	82	cyclictest	0	-21	swapper/3	04:01:49	3
14951	99	83	81	cyclictest	478	-21	kjournald	06:05:47	3
14951	99	83	71	cyclictest	0	-21	swapper/3	05:50:49	3
14951	99	83	71	cyclictest	0	-21	swapper/3	04:41:07	3
14932	99	83	82	cyclictest	5041	-21	tune2fs	07:15:58	1
14932	99	83	81	cyclictest	7404	-21	tune2fs	07:20:57	1
14932	99	83	81	cyclictest	7273	-21	tune2fs	08:35:55	1
14932	99	83	81	cyclictest	7116	-21	tune2fs	06:06:01	1
14932	99	83	81	cyclictest	4974	-21	tune2fs	04:46:04	1
14932	99	83	81	cyclictest	31100	-21	tune2fs	08:15:55	1
14932	99	83	81	cyclictest	30773	-21	tune2fs	07:00:58	1
14932	99	83	81	cyclictest	2840	-21	tune2fs	05:56:01	1
14932	99	83	81	cyclictest	26868	-21	tune2fs	08:05:57	1
14932	99	83	81	cyclictest	26836	-21	tune2fs	09:20:53	1
14932	99	83	81	cyclictest	26412	-21	tune2fs	04:21:07	1
14932	99	83	81	cyclictest	24550	-21	tune2fs	08:00:57	1
14932	99	83	81	cyclictest	24121	-21	tune2fs	04:16:04	1
14932	99	83	81	cyclictest	22586	-21	tune2fs	07:55:57	1
14932	99	83	81	cyclictest	20392	-21	tune2fs	07:50:56	1
14932	99	83	81	cyclictest	20102	-21	tune2fs	06:36:00	1
14932	99	83	81	cyclictest	19584	-21	aten2.4-expect	05:20:59	1
14932	99	83	81	cyclictest	18045	-21	tune2fs	09:00:53	1
14932	99	83	81	cyclictest	15835	-21	tune2fs	07:40:59	1
14932	99	83	81	cyclictest	15424	-21	tune2fs	03:56:06	1
14951	99	82	81	cyclictest	478	-21	kjournald	07:50:41	3
14951	99	82	81	cyclictest	0	-21	swapper/3	08:35:55	3
14951	99	82	81	cyclictest	0	-21	swapper/3	08:05:57	3
14951	99	82	81	cyclictest	0	-21	swapper/3	08:00:57	3
14951	99	82	81	cyclictest	0	-21	swapper/3	07:20:57	3
14951	99	82	81	cyclictest	0	-21	swapper/3	07:15:58	3
14951	99	82	81	cyclictest	0	-21	swapper/3	07:00:58	3
14951	99	82	81	cyclictest	0	-21	swapper/3	06:50:45	3
14951	99	82	81	cyclictest	0	-21	swapper/3	06:06:01	3
14951	99	82	81	cyclictest	0	-21	swapper/3	05:56:01	3
14951	99	82	81	cyclictest	0	-21	swapper/3	05:36:02	3
14951	99	82	81	cyclictest	0	-21	swapper/3	05:31:08	3
14951	99	82	81	cyclictest	0	-21	swapper/3	05:06:02	3
14951	99	82	81	cyclictest	0	-21	swapper/3	04:46:04	3
14951	99	82	81	cyclictest	0	-21	swapper/3	04:15:51	3
14951	99	82	81	cyclictest	0	-21	swapper/3	03:56:06	3
14932	99	82	81	cyclictest	5271	-21	tune2fs	08:30:56	1
14951	99	74	72	cyclictest	0	-21	swapper/3	08:26:05	3
14932	99	74	72	cyclictest	0	-21	swapper/1	08:50:55	1
14932	99	74	72	cyclictest	0	-21	swapper/1	06:05:47	1
14951	99	73	72	cyclictest	0	-21	swapper/3	06:26:01	3
14932	99	73	72	cyclictest	0	-21	swapper/1	07:29:22	1
14932	99	73	72	cyclictest	0	-21	swapper/1	07:10:58	1
14932	99	73	72	cyclictest	0	-21	swapper/1	06:31:01	1
14932	99	73	72	cyclictest	0	-21	swapper/1	06:25:46	1
14932	99	73	72	cyclictest	0	-21	swapper/1	04:51:08	1
14932	99	73	72	cyclictest	0	-21	swapper/1	04:11:12	1
14932	99	73	71	cyclictest	2504	-21	aten2.4-expect	08:25:52	1
14932	99	73	71	cyclictest	1109	-21	kauditd	05:35:48	1
14951	99	72	71	cyclictest	1383	-17	auditd	06:45:46	3
14951	99	72	71	cyclictest	0	-21	swapper/3	09:13:06	3
14951	99	72	71	cyclictest	0	-21	swapper/3	09:09:10	3
14951	99	72	71	cyclictest	0	-21	swapper/3	05:45:47	3
14932	99	72	71	cyclictest	0	-21	swapper/1	08:50:41	1
14932	99	72	71	cyclictest	0	-21	swapper/1	06:45:46	1
14932	99	72	71	cyclictest	0	-21	swapper/1	06:11:07	1
14932	99	72	71	cyclictest	0	-21	swapper/1	05:51:08	1
14932	99	72	71	cyclictest	0	-21	swapper/1	05:41:10	1
14932	99	72	71	cyclictest	0	-21	swapper/1	05:31:10	1
14932	99	72	71	cyclictest	0	-21	swapper/1	04:56:05	1
14932	99	72	71	cyclictest	0	-21	swapper/1	04:36:13	1
14932	99	71	70	cyclictest	0	-21	swapper/1	09:05:53	1
14951	99	70	69	cyclictest	0	-21	swapper/3	04:27:12	3
14932	99	69	68	cyclictest	0	-21	swapper/1	06:45:57	1
14932	99	65	53	cyclictest	1384	-13	audispd	05:30:48	1
14951	99	63	62	cyclictest	0	-21	swapper/3	08:20:55	3
14951	99	63	62	cyclictest	0	-21	swapper/3	08:11:04	3
14951	99	63	62	cyclictest	0	-21	swapper/3	07:25:57	3
14951	99	63	62	cyclictest	0	-21	swapper/3	07:10:44	3
14951	99	63	62	cyclictest	0	-21	swapper/3	06:56:02	3
14951	99	63	62	cyclictest	0	-21	swapper/3	06:31:00	3
14951	99	63	62	cyclictest	0	-21	swapper/3	06:11:01	3
14951	99	63	62	cyclictest	0	-21	swapper/3	05:01:04	3
14951	99	63	62	cyclictest	0	-21	swapper/3	04:51:10	3
14951	99	63	62	cyclictest	0	-21	swapper/3	03:55:52	3
14951	99	63	61	cyclictest	30421	-21	aten2.4-expect	05:45:59	3
14951	99	63	61	cyclictest	14715	-21	sed	07:36:07	3
14951	99	63	51	cyclictest	0	-21	swapper/3	08:50:55	3
14951	99	63	51	cyclictest	0	-21	swapper/3	06:16:03	3
14951	99	63	51	cyclictest	0	-21	swapper/3	05:30:48	3
14932	99	63	62	cyclictest	0	-21	swapper/1	08:41:01	1
14932	99	63	62	cyclictest	0	-21	swapper/1	06:50:48	1
14932	99	63	62	cyclictest	0	-21	swapper/1	05:16:10	1
14932	99	63	62	cyclictest	0	-21	swapper/1	05:11:07	1
14932	99	63	62	cyclictest	0	-21	swapper/1	04:31:05	1
14932	99	63	61	cyclictest	32765	-21	aten2.4-expect	08:20:53	1
14932	99	63	61	cyclictest	30810	-21	tune2fs	05:46:01	1
14932	99	63	61	cyclictest	28658	-21	tune2fs	04:26:05	1
14932	99	63	61	cyclictest	24488	-21	tune2fs	09:15:53	1
14932	99	63	61	cyclictest	17801	-21	tune2fs	04:01:08	1
14932	99	63	61	cyclictest	15765	-21	tune2fs	06:26:01	1
14932	99	63	61	cyclictest	13060	-21	aten2.4-expect	05:06:00	1
14932	99	63	61	cyclictest	11625	-21	tune2fs	07:30:57	1
14932	99	63	61	cyclictest	11625	-21	tune2fs	07:30:57	1
14932	99	63	61	cyclictest	11516	-21	tune2fs	06:15:59	1
14932	99	63	61	cyclictest	11432	-21	tune2fs	05:01:03	1
14932	99	63	41	cyclictest	0	-21	swapper/1	09:10:53	1
14932	99	63	41	cyclictest	0	-21	swapper/1	08:10:54	1
14941	99	62	61	cyclictest	0	-21	swapper/2	04:46:02	2
14941	99	62	60	cyclictest	8680	-21	telnet	04:56:02	2
14932	99	62	61	cyclictest	625	-21	tune2fs	07:05:59	1
14932	99	62	61	cyclictest	13629	-21	tune2fs	07:35:58	1
14932	99	62	61	cyclictest	0	-21	swapper/1	07:50:41	1
14932	99	62	61	cyclictest	0	-21	swapper/1	06:55:57	1
14921	99	61	60	cyclictest	0	-21	swapper/0	04:46:02	0
14941	99	60	58	cyclictest	9038	-21	telnet	07:25:55	2
14921	99	60	59	cyclictest	0	-21	swapper/0	04:56:02	0
14921	99	58	57	cyclictest	0	-21	swapper/0	07:25:55	0
14921	99	58	38	cyclictest	0	-21	swapper/0	09:00:59	0
14941	99	54	52	cyclictest	19527	-21	telnet	05:20:59	2
14941	99	54	52	cyclictest	0	-21	swapper/2	07:10:56	2
14941	99	54	52	cyclictest	0	-21	swapper/2	05:06:00	2
14921	99	54	53	cyclictest	760	50	irq/18-parport0	08:34:16	0
14921	99	54	51	cyclictest	0	-21	swapper/0	05:55:58	0
14941	99	53	52	cyclictest	1876	-21	hald-addon-stor	05:16:08	2
14941	99	53	52	cyclictest	0	-21	swapper/2	07:40:57	2
14941	99	53	52	cyclictest	0	-21	swapper/2	06:35:57	2
14941	99	53	52	cyclictest	0	-21	swapper/2	05:11:01	2
14941	99	53	52	cyclictest	0	-21	swapper/2	04:36:03	2
14941	99	53	52	cyclictest	0	-21	swapper/2	04:26:02	2
14941	99	53	51	cyclictest	4751	-21	telnet	08:30:54	2
14941	99	53	51	cyclictest	32738	-21	telnet	08:20:53	2
14941	99	53	51	cyclictest	30546	-21	telnet	07:00:56	2
14941	99	53	51	cyclictest	28205	-21	telnet	05:41:01	2
14941	99	53	51	cyclictest	26245	-21	telnet	08:05:54	2
14941	99	53	51	cyclictest	2508	-21	telnet	08:25:52	2
14941	99	53	51	cyclictest	24033	-21	telnet	06:45:58	2
14941	99	53	51	cyclictest	2337	-21	telnet	05:55:58	2
14941	99	53	51	cyclictest	2150	-21	telnet	04:41:04	2
14941	99	53	51	cyclictest	17629	-21	telnet	07:45:55	2
14941	99	53	51	cyclictest	13363	-21	telnet	08:50:53	2
14941	99	53	51	cyclictest	13305	-21	telnet	07:35:56	2
14941	99	53	51	cyclictest	11141	-21	telnet	07:30:54	2
14941	99	53	51	cyclictest	11141	-21	telnet	07:30:54	2
14941	99	53	41	cyclictest	0	-21	swapper/2	09:10:52	2
14941	99	53	41	cyclictest	0	-21	swapper/2	09:07:29	2
14941	99	53	41	cyclictest	0	-21	swapper/2	08:55:54	2
14941	99	53	41	cyclictest	0	-21	swapper/2	07:59:24	2
14941	99	53	41	cyclictest	0	-21	swapper/2	06:15:57	2
14941	99	53	41	cyclictest	0	-21	swapper/2	06:00:58	2
14941	99	53	41	cyclictest	0	-21	swapper/2	04:16:02	2
14941	99	53	41	cyclictest	0	-21	swapper/2	03:56:03	2
14921	99	53	52	cyclictest	760	50	irq/18-parport0	09:08:21	0
14921	99	53	52	cyclictest	760	50	irq/18-parport0	08:47:14	0
14921	99	53	52	cyclictest	760	50	irq/18-parport0	08:27:59	0
14921	99	53	52	cyclictest	760	50	irq/18-parport0	08:15:49	0
14921	99	53	52	cyclictest	760	50	irq/18-parport0	07:43:00	0
14921	99	53	52	cyclictest	760	50	irq/18-parport0	05:26:47	0
14921	99	53	52	cyclictest	0	-21	swapper/0	08:40:52	0
14921	99	53	52	cyclictest	0	-21	swapper/0	08:23:23	0
14921	99	53	52	cyclictest	0	-21	swapper/0	08:15:25	0
14921	99	53	52	cyclictest	0	-21	swapper/0	08:01:50	0
14921	99	53	52	cyclictest	0	-21	swapper/0	07:58:04	0
14921	99	53	52	cyclictest	0	-21	swapper/0	07:52:10	0
14921	99	53	52	cyclictest	0	-21	swapper/0	07:49:28	0
14921	99	53	52	cyclictest	0	-21	swapper/0	07:22:23	0
14921	99	53	52	cyclictest	0	-21	swapper/0	06:56:28	0
14921	99	53	52	cyclictest	0	-21	swapper/0	06:35:21	0
14921	99	53	52	cyclictest	0	-21	swapper/0	05:54:30	0
14921	99	53	52	cyclictest	0	-21	swapper/0	05:31:25	0
14921	99	53	52	cyclictest	0	-21	swapper/0	04:53:29	0
14921	99	53	52	cyclictest	0	-21	swapper/0	04:00:51	0
14921	99	53	51	cyclictest	50	50	irq/44-ahci	05:16:08	0
14921	99	53	51	cyclictest	0	-21	swapper/0	08:05:54	0
14921	99	53	51	cyclictest	0	-21	swapper/0	07:35:56	0
14921	99	53	51	cyclictest	0	-21	swapper/0	06:45:58	0
14921	99	53	51	cyclictest	0	-21	swapper/0	05:06:00	0
14921	99	53	51	cyclictest	0	-21	swapper/0	04:41:04	0
14921	99	53	51	cyclictest	0	-21	swapper/0	04:26:32	0
14921	99	53	41	cyclictest	0	-21	swapper/0	09:10:52	0
14921	99	53	41	cyclictest	0	-21	swapper/0	08:55:54	0
14921	99	53	41	cyclictest	0	-21	swapper/0	06:50:56	0
14921	99	53	41	cyclictest	0	-21	swapper/0	05:36:00	0
14921	99	53	41	cyclictest	0	-21	swapper/0	04:36:03	0
14941	99	52	51	cyclictest	8919	-21	telnet	06:10:58	2
14941	99	52	51	cyclictest	4625	-21	telnet	07:15:56	2
14941	99	52	51	cyclictest	278	-21	usb-storage	08:46:18	2
14941	99	52	51	cyclictest	17685	-21	telnet	09:00:51	2
14941	99	52	51	cyclictest	17450	-21	telnet	06:30:56	2
14941	99	52	51	cyclictest	15279	-21	telnet	06:25:58	2
14941	99	52	51	cyclictest	0	-21	swapper/2	09:20:43	2
14941	99	52	51	cyclictest	0	-21	swapper/2	08:20:35	2
14941	99	52	51	cyclictest	0	-21	swapper/2	08:13:37	2
14941	99	52	51	cyclictest	0	-21	swapper/2	08:03:20	2
14941	99	52	51	cyclictest	0	-21	swapper/2	07:52:40	2
14941	99	52	51	cyclictest	0	-21	swapper/2	07:21:31	2
14941	99	52	51	cyclictest	0	-21	swapper/2	06:56:56	2
14941	99	52	51	cyclictest	0	-21	swapper/2	06:53:02	2
14941	99	52	51	cyclictest	0	-21	swapper/2	06:42:37	2
14941	99	52	51	cyclictest	0	-21	swapper/2	06:06:58	2
14941	99	52	51	cyclictest	0	-21	swapper/2	05:31:25	2
14941	99	52	51	cyclictest	0	-21	swapper/2	04:23:10	2
14941	99	52	50	cyclictest	6597	-21	telnet	04:51:00	2
14941	99	52	41	cyclictest	0	-21	swapper/2	04:02:03	2
14932	99	52	51	cyclictest	0	-21	swapper/1	03:55:52	1
14921	99	52	51	cyclictest	760	50	irq/18-parport0	09:15:47	0
14921	99	52	51	cyclictest	760	50	irq/18-parport0	08:39:44	0
14921	99	52	51	cyclictest	760	50	irq/18-parport0	06:06:58	0
14921	99	52	51	cyclictest	760	50	irq/18-parport0	05:47:03	0
14921	99	52	51	cyclictest	1876	-21	hald-addon-stor	06:18:52	0
14921	99	52	51	cyclictest	1286	50	irq/46-eth0	09:20:51	0
14921	99	52	51	cyclictest	0	-21	swapper/0	08:50:53	0
14921	99	52	51	cyclictest	0	-21	swapper/0	07:30:54	0
14921	99	52	51	cyclictest	0	-21	swapper/0	07:30:54	0
14921	99	52	51	cyclictest	0	-21	swapper/0	07:15:56	0
14921	99	52	51	cyclictest	0	-21	swapper/0	07:10:56	0
14921	99	52	51	cyclictest	0	-21	swapper/0	07:00:56	0
14921	99	52	51	cyclictest	0	-21	swapper/0	06:40:53	0
14921	99	52	51	cyclictest	0	-21	swapper/0	06:35:57	0
14921	99	52	51	cyclictest	0	-21	swapper/0	06:25:58	0
14921	99	52	51	cyclictest	0	-21	swapper/0	06:10:58	0
14921	99	52	51	cyclictest	0	-21	swapper/0	05:41:01	0
14921	99	52	51	cyclictest	0	-21	swapper/0	05:20:59	0
14921	99	52	51	cyclictest	0	-21	swapper/0	05:11:01	0
14921	99	52	51	cyclictest	0	-21	swapper/0	05:04:20	0
14921	99	52	51	cyclictest	0	-21	swapper/0	04:21:16	0
14921	99	52	51	cyclictest	0	-21	swapper/0	04:05:45	0
14921	99	48	47	cyclictest	0	-21	swapper/0	04:16:02	0
14941	99	46	45	cyclictest	0	-21	swapper/2	08:41:06	2
14921	99	45	31	cyclictest	0	-21	swapper/0	04:10:56	0
14941	99	44	43	cyclictest	0	-21	swapper/2	09:16:26	2
14941	99	44	43	cyclictest	0	-21	swapper/2	04:10:52	2
14941	99	44	42	cyclictest	278	-21	usb-storage	05:27:51	2
14941	99	44	42	cyclictest	13142	-21	aten2.4_r3power	06:20:57	2
14941	99	44	42	cyclictest	0	-21	swapper/2	07:05:57	2
14921	99	44	42	cyclictest	760	50	irq/18-parport0	06:21:45	0
14921	99	44	41	cyclictest	0	-21	swapper/0	06:01:20	0
14921	99	44	41	cyclictest	0	-21	swapper/0	04:32:02	0
14921	99	44	41	cyclictest	0	-21	swapper/0	04:06:08	0
14941	99	43	41	cyclictest	278	-21	usb-storage	04:06:01	2
14941	99	43	41	cyclictest	0	-21	swapper/2	08:35:53	2
14941	99	43	41	cyclictest	0	-21	swapper/2	05:50:58	2
14941	99	43	41	cyclictest	0	-21	swapper/2	05:45:54	2
14941	99	43	41	cyclictest	0	-21	swapper/2	05:35:53	2
14941	99	43	41	cyclictest	0	-21	swapper/2	05:00:56	2
14941	99	43	41	cyclictest	0	-21	swapper/2	04:31:02	2
14921	99	43	41	cyclictest	0	-21	swapper/0	07:05:46	0
14941	99	32	31	cyclictest	15016	-21	latency_hist	03:55:52	2
14921	99	32	31	cyclictest	0	-21	swapper/0	03:55:52	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17