OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon May 25, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
26826	99	124	122	cyclictest	6324	-21	tune2fs	10:15:14	1
26848	99	108	92	cyclictest	0	-21	swapper/3	10:15:14	3
26848	99	108	92	cyclictest	0	-21	swapper/3	10:05:15	3
26848	99	108	92	cyclictest	0	-21	swapper/3	08:50:17	3
26848	99	108	92	cyclictest	0	-21	swapper/3	08:40:17	3
26848	99	108	92	cyclictest	0	-21	swapper/3	08:00:05	3
26848	99	108	92	cyclictest	0	-21	swapper/3	07:35:17	3
26848	99	108	92	cyclictest	0	-21	swapper/3	06:50:29	3
26848	99	108	92	cyclictest	0	-21	swapper/3	05:55:26	3
26848	99	108	92	cyclictest	0	-21	swapper/3	05:45:32	3
26848	99	108	92	cyclictest	0	-21	swapper/3	05:00:26	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:35:15	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:30:23	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:20:23	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:16:15	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:10:14	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:10:14	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:05:15	3
26848	99	107	92	cyclictest	0	-21	swapper/3	09:00:16	3
26848	99	107	92	cyclictest	0	-21	swapper/3	08:55:18	3
26848	99	107	92	cyclictest	0	-21	swapper/3	08:45:25	3
26848	99	107	92	cyclictest	0	-21	swapper/3	08:35:19	3
26848	99	107	92	cyclictest	0	-21	swapper/3	07:45:27	3
26848	99	107	92	cyclictest	0	-21	swapper/3	07:20:18	3
26848	99	107	92	cyclictest	0	-21	swapper/3	07:15:22	3
26848	99	107	92	cyclictest	0	-21	swapper/3	07:10:21	3
26848	99	107	92	cyclictest	0	-21	swapper/3	07:00:22	3
26848	99	107	92	cyclictest	0	-21	swapper/3	06:55:22	3
26848	99	107	92	cyclictest	0	-21	swapper/3	06:45:21	3
26848	99	107	92	cyclictest	0	-21	swapper/3	06:40:25	3
26848	99	107	92	cyclictest	0	-21	swapper/3	06:10:24	3
26848	99	107	92	cyclictest	0	-21	swapper/3	05:25:24	3
26848	99	107	92	cyclictest	0	-21	swapper/3	05:09:41	3
26848	99	107	92	cyclictest	0	-21	swapper/3	04:55:29	3
26848	99	106	92	cyclictest	0	-21	swapper/3	08:15:22	3
26848	99	106	92	cyclictest	0	-21	swapper/3	07:30:25	3
26826	99	104	102	cyclictest	1941	-21	tune2fs	08:50:17	1
26848	99	98	92	cyclictest	0	-21	swapper/3	09:25:18	3
26848	99	97	92	cyclictest	0	-21	swapper/3	06:35:21	3
26848	99	97	92	cyclictest	0	-21	swapper/3	05:20:24	3
26848	99	96	92	cyclictest	0	-21	swapper/3	08:05:24	3
26848	99	96	92	cyclictest	0	-21	swapper/3	07:50:19	3
26848	99	96	92	cyclictest	0	-21	swapper/3	05:40:25	3
26848	99	96	92	cyclictest	0	-21	swapper/3	05:17:49	3
26848	99	87	82	cyclictest	0	-21	swapper/3	10:10:13	3
26848	99	87	82	cyclictest	0	-21	swapper/3	09:40:24	3
26848	99	87	82	cyclictest	0	-21	swapper/3	08:20:18	3
26848	99	87	82	cyclictest	0	-21	swapper/3	07:25:21	3
26848	99	87	82	cyclictest	0	-21	swapper/3	06:00:21	3
26848	99	87	82	cyclictest	0	-21	swapper/3	04:50:26	3
26848	99	87	72	cyclictest	0	-21	swapper/3	09:45:15	3
26848	99	86	82	cyclictest	0	-21	swapper/3	09:50:14	3
26848	99	86	82	cyclictest	0	-21	swapper/3	07:05:21	3
26848	99	86	82	cyclictest	0	-21	swapper/3	06:05:26	3
26848	99	86	82	cyclictest	0	-21	swapper/3	05:30:25	3
26848	99	85	82	cyclictest	0	-21	swapper/3	08:30:19	3
26848	99	85	82	cyclictest	0	-21	swapper/3	05:35:29	3
26848	99	85	81	cyclictest	0	-21	swapper/3	10:00:14	3
26848	99	85	81	cyclictest	0	-21	swapper/3	08:10:25	3
26848	99	85	71	cyclictest	0	-21	swapper/3	06:15:32	3
26848	99	84	81	cyclictest	0	-21	swapper/3	07:40:25	3
26826	99	84	82	cyclictest	0	-21	swapper/1	07:30:21	1
26848	99	83	82	cyclictest	0	-21	swapper/3	08:03:12	3
26848	99	83	82	cyclictest	0	-21	swapper/3	06:33:00	3
26848	99	83	82	cyclictest	0	-21	swapper/3	06:25:22	3
26848	99	83	82	cyclictest	0	-21	swapper/3	06:22:58	3
26826	99	83	82	cyclictest	0	-21	swapper/1	09:45:21	1
26826	99	83	82	cyclictest	0	-21	swapper/1	08:45:18	1
26826	99	83	82	cyclictest	0	-21	swapper/1	08:40:18	1
26826	99	83	82	cyclictest	0	-21	swapper/1	08:25:17	1
26826	99	83	82	cyclictest	0	-21	swapper/1	08:25:03	1
26826	99	83	82	cyclictest	0	-21	swapper/1	08:15:22	1
26826	99	83	82	cyclictest	0	-21	swapper/1	08:00:19	1
26826	99	83	82	cyclictest	0	-21	swapper/1	07:50:26	1
26826	99	83	82	cyclictest	0	-21	swapper/1	07:35:21	1
26826	99	83	82	cyclictest	0	-21	swapper/1	06:55:23	1
26826	99	83	82	cyclictest	0	-21	swapper/1	06:50:20	1
26826	99	83	82	cyclictest	0	-21	swapper/1	06:50:07	1
26826	99	83	82	cyclictest	0	-21	swapper/1	06:42:42	1
26826	99	83	82	cyclictest	0	-21	swapper/1	05:50:10	1
26826	99	83	82	cyclictest	0	-21	swapper/1	05:42:44	1
26826	99	83	82	cyclictest	0	-21	swapper/1	05:20:16	1
26826	99	83	82	cyclictest	0	-21	swapper/1	04:50:32	1
26826	99	83	81	cyclictest	6368	-21	tune2fs	07:45:20	1
26826	99	83	81	cyclictest	4354	-21	tune2fs	10:10:14	1
26826	99	83	81	cyclictest	4239	-21	tune2fs	08:55:16	1
26826	99	83	81	cyclictest	3875	-21	tune2fs	06:25:22	1
26826	99	83	81	cyclictest	3718	-21	tune2fs	05:10:25	1
26826	99	83	81	cyclictest	25547	-21	tune2fs	07:15:20	1
26826	99	83	81	cyclictest	19343	-21	tune2fs	09:30:15	1
26826	99	83	81	cyclictest	15059	-21	tune2fs	09:20:16	1
26826	99	83	81	cyclictest	14682	-21	tune2fs	05:35:22	1
26848	99	82	81	cyclictest	0	-21	swapper/3	05:10:25	3
26826	99	82	81	cyclictest	0	-21	swapper/1	07:10:22	1
26826	99	79	78	cyclictest	0	-21	swapper/1	07:22:21	1
26848	99	75	71	cyclictest	0	-21	swapper/3	08:27:14	3
26848	99	75	71	cyclictest	0	-21	swapper/3	05:50:24	3
26826	99	73	72	cyclictest	0	-21	swapper/1	10:05:15	1
26826	99	73	72	cyclictest	0	-21	swapper/1	10:00:15	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:55:23	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:52:13	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:35:13	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:25:15	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:15:53	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:10:14	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:10:14	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:05:15	1
26826	99	73	72	cyclictest	0	-21	swapper/1	09:00:15	1
26826	99	73	72	cyclictest	0	-21	swapper/1	08:35:19	1
26826	99	73	72	cyclictest	0	-21	swapper/1	08:30:17	1
26826	99	73	72	cyclictest	0	-21	swapper/1	08:10:20	1
26826	99	73	72	cyclictest	0	-21	swapper/1	08:06:13	1
26826	99	73	72	cyclictest	0	-21	swapper/1	07:55:16	1
26826	99	73	72	cyclictest	0	-21	swapper/1	07:40:21	1
26826	99	73	72	cyclictest	0	-21	swapper/1	07:25:26	1
26826	99	73	72	cyclictest	0	-21	swapper/1	07:05:20	1
26826	99	73	72	cyclictest	0	-21	swapper/1	07:00:22	1
26826	99	73	72	cyclictest	0	-21	swapper/1	06:35:20	1
26826	99	73	72	cyclictest	0	-21	swapper/1	06:30:22	1
26826	99	73	72	cyclictest	0	-21	swapper/1	06:22:21	1
26826	99	73	72	cyclictest	0	-21	swapper/1	06:15:28	1
26826	99	73	72	cyclictest	0	-21	swapper/1	06:10:24	1
26826	99	73	72	cyclictest	0	-21	swapper/1	06:05:23	1
26826	99	73	72	cyclictest	0	-21	swapper/1	05:55:24	1
26826	99	73	72	cyclictest	0	-21	swapper/1	05:50:13	1
26826	99	73	72	cyclictest	0	-21	swapper/1	05:32:51	1
26826	99	73	72	cyclictest	0	-21	swapper/1	05:25:24	1
26826	99	73	72	cyclictest	0	-21	swapper/1	05:15:23	1
26826	99	73	72	cyclictest	0	-21	swapper/1	05:00:24	1
26826	99	73	72	cyclictest	0	-21	swapper/1	04:55:23	1
26848	99	71	51	cyclictest	0	-21	swapper/3	09:59:23	3
26848	99	67	51	cyclictest	0	-21	swapper/3	04:50:12	3
26836	99	63	62	cyclictest	0	-21	swapper/2	09:43:00	2
26826	99	63	62	cyclictest	0	-21	swapper/1	09:40:08	1
26826	99	63	62	cyclictest	0	-21	swapper/1	06:00:10	1
26826	99	63	62	cyclictest	0	-21	swapper/1	05:05:24	1
26818	99	62	61	cyclictest	0	-21	swapper/0	07:10:16	0
26836	99	60	59	cyclictest	0	-21	swapper/2	09:53:44	2
26836	99	60	59	cyclictest	0	-21	swapper/2	07:44:45	2
26836	99	60	59	cyclictest	0	-21	swapper/2	07:04:20	2
26836	99	60	59	cyclictest	0	-21	swapper/2	06:56:53	2
26836	99	60	59	cyclictest	0	-21	swapper/2	05:40:49	2
26818	99	60	59	cyclictest	0	-21	swapper/0	09:20:14	0
26818	99	60	59	cyclictest	0	-21	swapper/0	08:15:15	0
26836	99	59	58	cyclictest	0	-21	swapper/2	09:10:13	2
26836	99	59	58	cyclictest	0	-21	swapper/2	09:10:13	2
26818	99	59	58	cyclictest	0	-21	swapper/0	09:30:12	0
26836	99	57	51	cyclictest	0	-21	swapper/2	07:37:31	2
26836	99	56	55	cyclictest	0	-21	swapper/2	06:50:07	2
26836	99	56	55	cyclictest	0	-21	swapper/2	06:00:31	2
26836	99	55	54	cyclictest	0	-21	swapper/2	05:52:01	2
26836	99	55	54	cyclictest	0	-21	swapper/2	05:19:32	2
26836	99	55	43	cyclictest	18	1	ksoftirqd/2	10:10:31	2
26818	99	55	54	cyclictest	0	-21	swapper/0	07:30:19	0
26836	99	54	53	cyclictest	278	-21	usb-storage	05:28:12	2
26836	99	54	52	cyclictest	50	50	irq/44-ahci	08:35:53	2
26836	99	54	52	cyclictest	0	-21	swapper/2	07:45:18	2
26836	99	54	52	cyclictest	0	-21	swapper/2	06:35:18	2
26836	99	54	51	cyclictest	0	-21	swapper/2	08:09:28	2
26818	99	54	53	cyclictest	760	50	irq/18-parport0	10:16:35	0
26818	99	54	53	cyclictest	0	-21	swapper/0	10:08:15	0
26818	99	54	53	cyclictest	0	-21	swapper/0	09:52:50	0
26818	99	54	53	cyclictest	0	-21	swapper/0	09:00:15	0
26818	99	54	53	cyclictest	0	-21	swapper/0	08:56:02	0
26818	99	54	53	cyclictest	0	-21	swapper/0	08:40:01	0
26818	99	54	53	cyclictest	0	-21	swapper/0	08:10:18	0
26818	99	54	53	cyclictest	0	-21	swapper/0	08:06:32	0
26818	99	54	53	cyclictest	0	-21	swapper/0	07:59:44	0
26818	99	54	53	cyclictest	0	-21	swapper/0	07:45:35	0
26818	99	54	53	cyclictest	0	-21	swapper/0	07:29:39	0
26818	99	54	53	cyclictest	0	-21	swapper/0	07:07:33	0
26818	99	54	53	cyclictest	0	-21	swapper/0	06:47:29	0
26818	99	54	53	cyclictest	0	-21	swapper/0	06:35:47	0
26818	99	54	53	cyclictest	0	-21	swapper/0	06:29:46	0
26818	99	54	53	cyclictest	0	-21	swapper/0	06:01:55	0
26818	99	54	53	cyclictest	0	-21	swapper/0	05:47:49	0
26818	99	54	53	cyclictest	0	-21	swapper/0	05:42:17	0
26818	99	54	53	cyclictest	0	-21	swapper/0	05:26:30	0
26818	99	54	53	cyclictest	0	-21	swapper/0	05:10:22	0
26818	99	54	53	cyclictest	0	-21	swapper/0	05:08:07	0
26818	99	54	53	cyclictest	0	-21	swapper/0	05:00:05	0
26818	99	54	53	cyclictest	0	-21	swapper/0	04:54:45	0
26818	99	54	52	cyclictest	760	50	irq/18-parport0	07:41:01	0
26818	99	54	52	cyclictest	1286	50	irq/46-eth0	06:23:38	0
26818	99	54	41	cyclictest	50	50	irq/44-ahci	07:00:48	0
26836	99	53	52	cyclictest	50	50	irq/44-ahci	06:20:04	2
26836	99	53	52	cyclictest	278	-21	usb-storage	06:14:46	2
26836	99	53	52	cyclictest	18	1	ksoftirqd/2	09:03:04	2
26836	99	53	52	cyclictest	0	-21	swapper/2	09:37:47	2
26836	99	53	52	cyclictest	0	-21	swapper/2	09:05:12	2
26836	99	53	52	cyclictest	0	-21	swapper/2	08:30:15	2
26836	99	53	52	cyclictest	0	-21	swapper/2	07:55:15	2
26836	99	53	52	cyclictest	0	-21	swapper/2	07:30:19	2
26836	99	53	52	cyclictest	0	-21	swapper/2	07:25:19	2
26836	99	53	52	cyclictest	0	-21	swapper/2	07:20:17	2
26836	99	53	52	cyclictest	0	-21	swapper/2	07:05:18	2
26836	99	53	52	cyclictest	0	-21	swapper/2	06:25:19	2
26836	99	53	52	cyclictest	0	-21	swapper/2	06:21:02	2
26836	99	53	52	cyclictest	0	-21	swapper/2	06:06:27	2
26836	99	53	52	cyclictest	0	-21	swapper/2	05:45:21	2
26836	99	53	51	cyclictest	50	50	irq/44-ahci	09:16:55	2
26836	99	53	51	cyclictest	3361	-21	telnet	05:10:23	2
26836	99	53	51	cyclictest	29634	-21	telnet	09:55:12	2
26836	99	53	41	cyclictest	0	-21	swapper/2	09:20:13	2
26836	99	53	41	cyclictest	0	-21	swapper/2	06:30:24	2
26836	99	53	41	cyclictest	0	-21	swapper/2	04:55:32	2
26826	99	53	52	cyclictest	0	-21	swapper/1	04:50:12	1
26818	99	53	52	cyclictest	760	50	irq/18-parport0	10:00:24	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	09:43:38	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	09:05:50	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	08:50:40	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	08:27:59	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	08:21:29	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	07:20:02	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	06:56:57	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	06:11:18	0
26818	99	53	52	cyclictest	760	50	irq/18-parport0	05:51:09	0
26818	99	53	52	cyclictest	0	-21	swapper/0	09:38:17	0
26818	99	53	52	cyclictest	0	-21	swapper/0	07:22:52	0
26818	99	53	52	cyclictest	0	-21	swapper/0	06:40:09	0
26818	99	53	52	cyclictest	0	-21	swapper/0	06:34:39	0
26818	99	53	51	cyclictest	50	50	irq/44-ahci	09:10:47	0
26818	99	53	51	cyclictest	50	50	irq/44-ahci	09:10:47	0
26818	99	53	41	cyclictest	0	-21	swapper/0	09:18:03	0
26818	99	53	41	cyclictest	0	-21	swapper/0	08:01:14	0
26818	99	53	41	cyclictest	0	-21	swapper/0	06:54:27	0
26818	99	53	41	cyclictest	0	-21	swapper/0	06:08:11	0
26836	99	52	51	cyclictest	50	50	irq/44-ahci	10:05:06	2
26836	99	52	51	cyclictest	50	50	irq/44-ahci	08:23:27	2
26836	99	52	51	cyclictest	278	-21	usb-storage	08:54:06	2
26836	99	52	51	cyclictest	1876	-21	hald-addon-stor	10:15:07	2
26836	99	52	51	cyclictest	1876	-21	hald-addon-stor	05:32:44	2
26836	99	52	51	cyclictest	14228	-21	telnet	05:35:20	2
26836	99	52	51	cyclictest	1083	-21	telnet	05:05:24	2
26836	99	52	51	cyclictest	0	-21	swapper/2	10:01:00	2
26836	99	52	51	cyclictest	0	-21	swapper/2	09:45:36	2
26836	99	52	51	cyclictest	0	-21	swapper/2	09:30:03	2
26836	99	52	51	cyclictest	0	-21	swapper/2	09:25:14	2
26836	99	52	51	cyclictest	0	-21	swapper/2	08:55:22	2
26836	99	52	51	cyclictest	0	-21	swapper/2	08:47:48	2
26836	99	52	51	cyclictest	0	-21	swapper/2	08:40:27	2
26836	99	52	51	cyclictest	0	-21	swapper/2	08:25:41	2
26836	99	52	51	cyclictest	0	-21	swapper/2	08:15:34	2
26836	99	52	51	cyclictest	0	-21	swapper/2	08:10:15	2
26836	99	52	51	cyclictest	0	-21	swapper/2	08:01:14	2
26836	99	52	51	cyclictest	0	-21	swapper/2	07:51:03	2
26836	99	52	51	cyclictest	0	-21	swapper/2	07:16:20	2
26836	99	52	51	cyclictest	0	-21	swapper/2	07:10:30	2
26836	99	52	51	cyclictest	0	-21	swapper/2	06:53:53	2
26836	99	52	51	cyclictest	0	-21	swapper/2	06:41:25	2
26836	99	52	51	cyclictest	0	-21	swapper/2	05:57:21	2
26836	99	52	51	cyclictest	0	-21	swapper/2	05:21:54	2
26836	99	52	51	cyclictest	0	-21	swapper/2	05:03:09	2
26836	99	52	51	cyclictest	0	-21	swapper/2	04:50:37	2
26818	99	52	51	cyclictest	760	50	irq/18-parport0	10:12:59	0
26818	99	52	51	cyclictest	760	50	irq/18-parport0	08:41:43	0
26818	99	52	51	cyclictest	760	50	irq/18-parport0	05:21:50	0
26818	99	52	51	cyclictest	0	-21	swapper/0	09:57:28	0
26818	99	52	51	cyclictest	0	-21	swapper/0	09:45:40	0
26818	99	52	51	cyclictest	0	-21	swapper/0	08:47:32	0
26818	99	52	51	cyclictest	0	-21	swapper/0	07:50:29	0
26818	99	52	51	cyclictest	0	-21	swapper/0	06:16:24	0
26818	99	52	51	cyclictest	0	-21	swapper/0	05:55:15	0
26818	99	52	51	cyclictest	0	-21	swapper/0	05:01:03	0
26818	99	52	48	cyclictest	0	-21	swapper/0	05:30:45	0
26818	99	50	49	cyclictest	0	-21	swapper/0	08:31:38	0
26818	99	48	47	cyclictest	0	-21	swapper/0	07:35:53	0
26818	99	48	41	cyclictest	0	-21	swapper/0	05:38:36	0
26818	99	45	44	cyclictest	0	-21	swapper/0	09:26:32	0
26818	99	43	42	cyclictest	0	-21	swapper/0	05:15:27	0
26836	99	42	41	cyclictest	0	-21	swapper/2	04:50:12	2
26818	99	32	31	cyclictest	0	-21	swapper/0	04:50:12	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17