OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Sep 07, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
22117	99	117	112	cyclictest	0	-21	swapper/3	07:30:10	3
22115	99	104	102	cyclictest	5816	-21	tune2fs	06:20:13	1
22115	99	104	102	cyclictest	29490	-21	tune2fs	06:00:12	1
22117	99	103	102	cyclictest	0	-21	swapper/3	06:30:20	3
22115	99	103	102	cyclictest	0	-21	swapper/1	08:25:14	1
22115	99	103	102	cyclictest	0	-21	swapper/1	06:30:20	1
22115	99	94	92	cyclictest	22707	-21	tune2fs	05:45:14	1
22115	99	94	71	cyclictest	29210	-21	tune2fs	03:30:20	1
22117	99	93	92	cyclictest	0	-21	swapper/3	08:25:14	3
22117	99	93	92	cyclictest	0	-21	swapper/3	05:45:14	3
22115	99	93	92	cyclictest	0	-21	swapper/1	05:00:21	1
22117	99	89	72	cyclictest	0	-21	swapper/3	03:55:19	3
22117	99	88	72	cyclictest	0	-21	swapper/3	03:45:19	3
22117	99	87	82	cyclictest	0	-21	swapper/3	07:35:10	3
22117	99	87	82	cyclictest	0	-21	swapper/3	05:40:15	3
22117	99	87	82	cyclictest	0	-21	swapper/3	04:35:16	3
22117	99	87	82	cyclictest	0	-21	swapper/3	04:10:18	3
22117	99	87	82	cyclictest	0	-21	swapper/3	03:35:19	3
22117	99	86	82	cyclictest	0	-21	swapper/3	08:30:15	3
22117	99	86	82	cyclictest	0	-21	swapper/3	07:43:31	3
22117	99	86	82	cyclictest	0	-21	swapper/3	06:55:23	3
22117	99	86	82	cyclictest	0	-21	swapper/3	06:44:58	3
22117	99	86	82	cyclictest	0	-21	swapper/3	06:18:16	3
22115	99	84	82	cyclictest	20884	-21	tune2fs	05:40:15	1
22115	99	84	82	cyclictest	0	-21	swapper/1	07:34:56	1
22117	99	83	82	cyclictest	0	-21	swapper/3	08:10:20	3
22117	99	83	82	cyclictest	0	-21	swapper/3	08:05:16	3
22117	99	83	82	cyclictest	0	-21	swapper/3	07:50:18	3
22117	99	83	82	cyclictest	0	-21	swapper/3	07:50:18	3
22117	99	83	82	cyclictest	0	-21	swapper/3	07:25:16	3
22117	99	83	82	cyclictest	0	-21	swapper/3	07:20:18	3
22117	99	83	82	cyclictest	0	-21	swapper/3	07:10:12	3
22117	99	83	82	cyclictest	0	-21	swapper/3	07:05:18	3
22117	99	83	82	cyclictest	0	-21	swapper/3	07:04:58	3
22117	99	83	82	cyclictest	0	-21	swapper/3	06:50:15	3
22117	99	83	82	cyclictest	0	-21	swapper/3	06:20:13	3
22117	99	83	82	cyclictest	0	-21	swapper/3	06:13:16	3
22117	99	83	82	cyclictest	0	-21	swapper/3	06:05:00	3
22117	99	83	82	cyclictest	0	-21	swapper/3	05:55:22	3
22117	99	83	82	cyclictest	0	-21	swapper/3	05:15:22	3
22117	99	83	82	cyclictest	0	-21	swapper/3	04:40:20	3
22117	99	83	82	cyclictest	0	-21	swapper/3	04:20:21	3
22117	99	83	82	cyclictest	0	-21	swapper/3	04:05:04	3
22117	99	83	82	cyclictest	0	-21	swapper/3	03:52:55	3
22117	99	83	82	cyclictest	0	-21	swapper/3	03:52:55	3
22117	99	83	82	cyclictest	0	-21	swapper/3	03:42:54	3
22117	99	83	82	cyclictest	0	-21	swapper/3	03:30:22	3
22117	99	83	82	cyclictest	0	-21	swapper/3	03:25:28	3
22117	99	83	82	cyclictest	0	-21	swapper/3	03:20:29	3
22115	99	83	82	cyclictest	0	-21	swapper/1	08:34:54	1
22115	99	83	82	cyclictest	0	-21	swapper/1	08:10:20	1
22115	99	83	82	cyclictest	0	-21	swapper/1	07:35:11	1
22115	99	83	82	cyclictest	0	-21	swapper/1	07:04:58	1
22115	99	83	82	cyclictest	0	-21	swapper/1	06:50:15	1
22115	99	83	82	cyclictest	0	-21	swapper/1	04:45:17	1
22115	99	83	82	cyclictest	0	-21	swapper/1	04:11:49	1
22115	99	83	82	cyclictest	0	-21	swapper/1	04:05:04	1
22115	99	83	81	cyclictest	31772	-21	tune2fs	07:20:11	1
22115	99	83	81	cyclictest	27197	-21	tune2fs	04:40:17	1
22115	99	83	81	cyclictest	27119	-21	tune2fs	03:25:21	1
22115	99	83	81	cyclictest	24983	-21	tune2fs	05:50:14	1
22115	99	83	81	cyclictest	18379	-21	tune2fs	04:20:17	1
22115	99	83	81	cyclictest	14367	-21	tune2fs	07:55:09	1
22115	99	83	81	cyclictest	12372	-21	tune2fs	07:50:12	1
22115	99	83	81	cyclictest	12372	-21	tune2fs	07:50:12	1
22117	99	82	81	cyclictest	0	-21	swapper/3	07:55:09	3
22115	99	82	81	cyclictest	1384	-13	audispd	04:05:04	1
22115	99	82	81	cyclictest	1001	-21	tune2fs	04:55:17	1
22117	99	79	72	cyclictest	0	-21	swapper/3	06:05:15	3
22117	99	77	72	cyclictest	0	-21	swapper/3	04:50:16	3
22117	99	77	61	cyclictest	11805	-21	df_abs	05:20:13	3
22117	99	76	72	cyclictest	0	-21	swapper/3	05:00:22	3
22117	99	73	72	cyclictest	0	-21	swapper/3	04:30:26	3
22115	99	73	72	cyclictest	0	-21	swapper/1	08:35:05	1
22115	99	73	72	cyclictest	0	-21	swapper/1	08:15:09	1
22115	99	73	72	cyclictest	0	-21	swapper/1	08:05:07	1
22115	99	73	72	cyclictest	0	-21	swapper/1	08:00:11	1
22115	99	73	72	cyclictest	0	-21	swapper/1	07:25:07	1
22115	99	73	72	cyclictest	0	-21	swapper/1	07:15:11	1
22115	99	73	72	cyclictest	0	-21	swapper/1	07:05:09	1
22115	99	73	72	cyclictest	0	-21	swapper/1	06:45:22	1
22115	99	73	72	cyclictest	0	-21	swapper/1	06:40:10	1
22115	99	73	72	cyclictest	0	-21	swapper/1	06:35:09	1
22115	99	73	72	cyclictest	0	-21	swapper/1	06:25:18	1
22115	99	73	72	cyclictest	0	-21	swapper/1	06:19:59	1
22115	99	73	72	cyclictest	0	-21	swapper/1	06:14:59	1
22115	99	73	72	cyclictest	0	-21	swapper/1	06:05:12	1
22115	99	73	72	cyclictest	0	-21	swapper/1	05:55:13	1
22115	99	73	72	cyclictest	0	-21	swapper/1	05:35:12	1
22115	99	73	72	cyclictest	0	-21	swapper/1	05:35:00	1
22115	99	73	72	cyclictest	0	-21	swapper/1	05:25:01	1
22115	99	73	72	cyclictest	0	-21	swapper/1	05:10:17	1
22115	99	73	72	cyclictest	0	-21	swapper/1	04:50:13	1
22115	99	73	72	cyclictest	0	-21	swapper/1	04:35:14	1
22115	99	73	72	cyclictest	0	-21	swapper/1	04:30:03	1
22115	99	73	72	cyclictest	0	-21	swapper/1	04:30:03	1
22115	99	73	72	cyclictest	0	-21	swapper/1	03:50:16	1
22115	99	73	72	cyclictest	0	-21	swapper/1	03:50:16	1
22115	99	73	72	cyclictest	0	-21	swapper/1	03:45:17	1
22115	99	73	72	cyclictest	0	-21	swapper/1	03:40:18	1
22117	99	72	71	cyclictest	0	-21	swapper/3	06:28:17	3
22117	99	72	71	cyclictest	0	-21	swapper/3	04:45:17	3
22117	99	72	71	cyclictest	0	-21	swapper/3	03:15:21	3
22115	99	72	71	cyclictest	24742	-21	aten2.4-expect	08:20:05	1
22115	99	72	71	cyclictest	0	-21	swapper/1	07:45:17	1
22115	99	72	71	cyclictest	0	-21	swapper/1	07:13:26	1
22115	99	72	71	cyclictest	0	-21	swapper/1	06:55:14	1
22115	99	72	71	cyclictest	0	-21	swapper/1	05:28:10	1
22115	99	72	71	cyclictest	0	-21	swapper/1	03:20:27	1
22115	99	72	70	cyclictest	7751	-21	tune2fs	03:55:19	1
22115	99	72	60	cyclictest	0	-21	swapper/1	03:35:19	1
22115	99	71	70	cyclictest	0	-21	swapper/1	05:08:53	1
22115	99	71	70	cyclictest	0	-21	swapper/1	05:08:53	1
22117	99	68	62	cyclictest	0	-21	swapper/3	08:00:09	3
22117	99	68	62	cyclictest	0	-21	swapper/3	07:15:10	3
22117	99	68	62	cyclictest	0	-21	swapper/3	06:45:13	3
22117	99	68	62	cyclictest	0	-21	swapper/3	06:35:11	3
22117	99	68	62	cyclictest	0	-21	swapper/3	04:55:17	3
22117	99	68	61	cyclictest	26053	-21	sed	05:50:23	3
22117	99	68	52	cyclictest	0	-21	swapper/3	08:15:06	3
22117	99	68	52	cyclictest	0	-21	swapper/3	07:45:11	3
22117	99	67	62	cyclictest	0	-21	swapper/3	08:39:54	3
22117	99	67	62	cyclictest	0	-21	swapper/3	08:35:08	3
22117	99	67	62	cyclictest	0	-21	swapper/3	05:35:01	3
22117	99	67	62	cyclictest	0	-21	swapper/3	05:10:14	3
22117	99	67	62	cyclictest	0	-21	swapper/3	04:25:23	3
22117	99	67	62	cyclictest	0	-21	swapper/3	04:00:18	3
22117	99	66	62	cyclictest	0	-21	swapper/3	08:20:15	3
22117	99	66	62	cyclictest	0	-21	swapper/3	05:30:22	3
22117	99	66	62	cyclictest	0	-21	swapper/3	04:15:22	3
22117	99	66	61	cyclictest	0	-21	swapper/3	05:25:16	3
22117	99	66	51	cyclictest	0	-21	swapper/3	05:05:22	3
22117	99	66	51	cyclictest	0	-21	swapper/3	05:05:22	3
22115	99	63	62	cyclictest	0	-21	swapper/1	08:40:05	1
22115	99	63	62	cyclictest	0	-21	swapper/1	07:40:08	1
22115	99	63	62	cyclictest	0	-21	swapper/1	05:15:15	1
22115	99	63	62	cyclictest	0	-21	swapper/1	04:15:15	1
22115	99	63	61	cyclictest	22597	-21	tune2fs	03:15:21	1
22116	99	59	58	cyclictest	0	-21	swapper/2	06:22:01	2
22114	99	57	41	cyclictest	0	-21	swapper/0	06:08:19	0
22114	99	57	41	cyclictest	0	-21	swapper/0	04:15:07	0
22116	99	56	55	cyclictest	0	-21	swapper/2	07:40:06	2
22116	99	56	55	cyclictest	0	-21	swapper/2	05:22:03	2
22116	99	56	55	cyclictest	0	-21	swapper/2	04:31:03	2
22116	99	56	55	cyclictest	0	-21	swapper/2	04:05:43	2
22116	99	56	55	cyclictest	0	-21	swapper/2	03:55:44	2
22116	99	56	51	cyclictest	0	-21	swapper/2	04:40:48	2
22116	99	55	54	cyclictest	17006	-21	latency	06:45:16	2
22116	99	55	53	cyclictest	0	-21	swapper/2	07:15:18	2
22116	99	55	51	cyclictest	0	-21	swapper/2	04:23:21	2
22116	99	55	43	cyclictest	5317	-21	telnet	07:35:07	2
22116	99	54	53	cyclictest	9208	-21	kworker/2:2	06:44:23	2
22116	99	54	53	cyclictest	14632	-21	latency	04:10:21	2
22116	99	54	53	cyclictest	0	-21	swapper/2	06:25:31	2
22116	99	54	52	cyclictest	0	-21	swapper/2	03:35:16	2
22116	99	54	51	cyclictest	478	-21	kjournald	04:03:33	2
22116	99	54	51	cyclictest	0	-21	swapper/2	06:59:21	2
22116	99	54	51	cyclictest	0	-21	swapper/2	04:15:21	2
22114	99	54	51	cyclictest	0	-21	swapper/0	07:39:47	0
22114	99	54	51	cyclictest	0	-21	swapper/0	07:11:24	0
22116	99	53	52	cyclictest	50	50	irq/44-ahci	08:20:12	2
22116	99	53	52	cyclictest	278	-21	usb-storage	08:14:30	2
22116	99	53	52	cyclictest	278	-21	usb-storage	06:36:32	2
22116	99	53	52	cyclictest	278	-21	usb-storage	06:08:43	2
22116	99	53	52	cyclictest	26344	-21	kworker/2:1	04:46:38	2
22116	99	53	52	cyclictest	1876	-21	hald-addon-stor	03:25:19	2
22116	99	53	52	cyclictest	18	1	ksoftirqd/2	07:25:12	2
22116	99	53	52	cyclictest	18	1	ksoftirqd/2	04:50:34	2
22116	99	53	52	cyclictest	0	-21	swapper/2	08:03:24	2
22116	99	53	52	cyclictest	0	-21	swapper/2	07:53:45	2
22116	99	53	52	cyclictest	0	-21	swapper/2	07:53:45	2
22116	99	53	52	cyclictest	0	-21	swapper/2	07:09:57	2
22116	99	53	52	cyclictest	0	-21	swapper/2	06:50:11	2
22116	99	53	52	cyclictest	0	-21	swapper/2	06:30:48	2
22116	99	53	52	cyclictest	0	-21	swapper/2	06:10:11	2
22116	99	53	52	cyclictest	0	-21	swapper/2	05:50:11	2
22116	99	53	52	cyclictest	0	-21	swapper/2	05:40:12	2
22116	99	53	52	cyclictest	0	-21	swapper/2	05:10:13	2
22116	99	53	52	cyclictest	0	-21	swapper/2	05:09:07	2
22116	99	53	52	cyclictest	0	-21	swapper/2	05:09:07	2
22116	99	53	52	cyclictest	0	-21	swapper/2	05:02:59	2
22116	99	53	52	cyclictest	0	-21	swapper/2	04:26:47	2
22116	99	53	52	cyclictest	0	-21	swapper/2	03:47:50	2
22116	99	53	51	cyclictest	730	-21	telnet	04:55:15	2
22116	99	53	51	cyclictest	50	50	irq/44-ahci	07:31:08	2
22116	99	53	51	cyclictest	50	50	irq/44-ahci	05:34:24	2
22116	99	53	51	cyclictest	1876	-21	hald-addon-stor	08:32:23	2
22116	99	53	41	cyclictest	0	-21	swapper/2	08:15:13	2
22116	99	53	41	cyclictest	0	-21	swapper/2	05:25:25	2
22116	99	53	41	cyclictest	0	-21	swapper/2	04:38:40	2
22116	99	53	41	cyclictest	0	-21	swapper/2	03:50:20	2
22116	99	53	41	cyclictest	0	-21	swapper/2	03:50:20	2
22114	99	53	52	cyclictest	760	50	irq/18-parport0	08:10:06	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	08:08:06	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	07:44:05	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	07:26:36	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	07:06:21	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	06:29:26	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	06:16:53	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	05:56:01	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	05:00:17	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	04:56:48	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	04:25:35	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	04:10:31	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	04:03:46	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	03:45:42	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	03:41:26	0
22114	99	53	52	cyclictest	760	50	irq/18-parport0	03:30:47	0
22114	99	53	52	cyclictest	4033	-21	kworker/0:0	03:56:27	0
22114	99	53	52	cyclictest	3	1	ksoftirqd/0	07:32:57	0
22114	99	53	52	cyclictest	3	1	ksoftirqd/0	04:47:17	0
22114	99	53	52	cyclictest	24112	-21	kworker/0:0	08:26:47	0
22114	99	53	52	cyclictest	21403	-21	kworker/0:1	07:04:00	0
22114	99	53	52	cyclictest	0	-21	swapper/0	08:35:04	0
22114	99	53	52	cyclictest	0	-21	swapper/0	08:30:06	0
22114	99	53	52	cyclictest	0	-21	swapper/0	08:15:06	0
22114	99	53	52	cyclictest	0	-21	swapper/0	07:17:56	0
22114	99	53	52	cyclictest	0	-21	swapper/0	05:54:53	0
22114	99	53	52	cyclictest	0	-21	swapper/0	05:45:11	0
22114	99	53	52	cyclictest	0	-21	swapper/0	05:24:07	0
22114	99	53	52	cyclictest	0	-21	swapper/0	04:31:30	0
22114	99	53	52	cyclictest	0	-21	swapper/0	04:10:03	0
22114	99	53	52	cyclictest	0	-21	swapper/0	03:21:07	0
22114	99	53	52	cyclictest	0	-21	swapper/0	03:15:18	0
22114	99	53	51	cyclictest	50	50	irq/44-ahci	06:22:31	0
22114	99	53	51	cyclictest	50	50	irq/44-ahci	05:19:47	0
22114	99	53	51	cyclictest	50	50	irq/44-ahci	05:10:40	0
22114	99	53	51	cyclictest	478	-21	kjournald	05:25:39	0
22114	99	53	51	cyclictest	1286	50	irq/46-eth0	03:25:12	0
22114	99	53	51	cyclictest	0	-21	swapper/0	06:55:14	0
22114	99	53	51	cyclictest	0	-21	swapper/0	03:35:11	0
22116	99	52	51	cyclictest	501	-21	telnet	03:40:15	2
22116	99	52	51	cyclictest	3039	-21	telnet	06:15:12	2
22116	99	52	51	cyclictest	278	-21	usb-storage	06:01:35	2
22116	99	52	51	cyclictest	278	-21	usb-storage	03:20:53	2
22116	99	52	51	cyclictest	278	-21	usb-storage	03:16:43	2
22116	99	52	51	cyclictest	1876	-21	hald-addon-stor	07:00:29	2
22116	99	52	51	cyclictest	0	-21	swapper/2	08:40:27	2
22116	99	52	51	cyclictest	0	-21	swapper/2	08:36:39	2
22116	99	52	51	cyclictest	0	-21	swapper/2	08:05:28	2
22116	99	52	51	cyclictest	0	-21	swapper/2	07:56:15	2
22116	99	52	51	cyclictest	0	-21	swapper/2	07:46:03	2
22116	99	52	51	cyclictest	0	-21	swapper/2	07:10:40	2
22116	99	52	51	cyclictest	0	-21	swapper/2	05:56:07	2
22116	99	52	51	cyclictest	0	-21	swapper/2	05:47:04	2
22116	99	52	51	cyclictest	0	-21	swapper/2	05:35:22	2
22116	99	52	51	cyclictest	0	-21	swapper/2	05:15:59	2
22116	99	52	51	cyclictest	0	-21	swapper/2	03:31:15	2
22116	99	52	41	cyclictest	31507	-21	fschecks_count	07:20:11	2
22114	99	52	51	cyclictest	760	50	irq/18-parport0	08:40:03	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	07:45:13	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	07:21:36	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	06:40:08	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	06:35:30	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	06:00:27	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	05:30:34	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	04:50:46	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	04:40:50	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	04:36:44	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	03:52:28	0
22114	99	52	51	cyclictest	760	50	irq/18-parport0	03:52:28	0
22114	99	52	51	cyclictest	50	50	irq/44-ahci	07:55:27	0
22114	99	52	51	cyclictest	1286	50	irq/46-eth0	05:05:13	0
22114	99	52	51	cyclictest	1286	50	irq/46-eth0	05:05:13	0
22114	99	52	51	cyclictest	0	-21	swapper/0	08:20:32	0
22114	99	52	51	cyclictest	0	-21	swapper/0	07:59:57	0
22114	99	52	51	cyclictest	0	-21	swapper/0	07:50:10	0
22114	99	52	51	cyclictest	0	-21	swapper/0	07:50:10	0
22114	99	52	51	cyclictest	0	-21	swapper/0	06:50:03	0
22114	99	52	51	cyclictest	0	-21	swapper/0	06:45:17	0
22114	99	52	51	cyclictest	0	-21	swapper/0	06:30:02	0
22114	99	52	51	cyclictest	0	-21	swapper/0	06:10:11	0
22114	99	52	51	cyclictest	0	-21	swapper/0	05:40:58	0
22114	99	52	51	cyclictest	0	-21	swapper/0	05:36:22	0
22114	99	52	51	cyclictest	0	-21	swapper/0	04:20:35	0
22116	99	48	47	cyclictest	0	-21	swapper/2	08:26:22	2
3	1	12	0	ksoftirqd/0	1876	-21	hald-addon-stor	03:13:05	0
50	50	10	0	irq/44-ahci	0	-21	swapper/2	03:10:52	2
21	99	10	0	migration/3	20000	-21	munin-node	03:10:18	3
12	1	8	0	ksoftirqd/1	1461	-21	irqbalance	03:12:49	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17