OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sat Mar 14, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
8262	99	106	102	cyclictest	0	-21	swapper/1	09:35:13	1
8262	99	105	102	cyclictest	0	-21	swapper/1	06:25:20	1
8283	99	104	102	cyclictest	0	-21	swapper/3	07:35:39	3
8283	99	103	102	cyclictest	0	-21	swapper/3	10:15:12	3
8283	99	103	102	cyclictest	0	-21	swapper/3	09:20:28	3
8262	99	103	102	cyclictest	0	-21	swapper/1	10:15:12	1
8262	99	97	92	cyclictest	25943	-21	aten2.4-expect	09:05:26	1
8262	99	97	82	cyclictest	0	-21	swapper/1	09:35:30	1
8262	99	97	82	cyclictest	0	-21	swapper/1	09:20:26	1
8262	99	97	82	cyclictest	0	-21	swapper/1	08:55:25	1
8262	99	97	82	cyclictest	0	-21	swapper/1	07:45:28	1
8262	99	97	82	cyclictest	0	-21	swapper/1	06:30:32	1
8262	99	96	92	cyclictest	0	-21	swapper/1	10:40:21	1
8262	99	96	92	cyclictest	0	-21	swapper/1	10:10:12	1
8262	99	96	92	cyclictest	0	-21	swapper/1	09:45:14	1
8262	99	96	92	cyclictest	0	-21	swapper/1	08:50:26	1
8262	99	96	92	cyclictest	0	-21	swapper/1	08:15:27	1
8262	99	96	82	cyclictest	0	-21	swapper/1	10:45:30	1
8262	99	96	82	cyclictest	0	-21	swapper/1	10:15:30	1
8262	99	96	82	cyclictest	0	-21	swapper/1	09:55:13	1
8262	99	96	82	cyclictest	0	-21	swapper/1	07:50:30	1
8262	99	96	82	cyclictest	0	-21	swapper/1	06:00:33	1
8262	99	95	92	cyclictest	0	-21	swapper/1	11:20:09	1
8262	99	95	92	cyclictest	0	-21	swapper/1	10:25:11	1
8262	99	95	92	cyclictest	0	-21	swapper/1	09:10:26	1
8262	99	95	92	cyclictest	0	-21	swapper/1	08:35:35	1
8262	99	95	92	cyclictest	0	-21	swapper/1	07:10:33	1
8262	99	95	92	cyclictest	0	-21	swapper/1	06:25:40	1
8262	99	95	92	cyclictest	0	-21	swapper/1	06:15:39	1
8262	99	93	92	cyclictest	0	-21	swapper/1	09:45:31	1
8262	99	93	92	cyclictest	0	-21	swapper/1	08:40:28	1
8262	99	89	81	cyclictest	26109	-21	tune2fs	06:35:34	1
8262	99	88	81	cyclictest	9903	-21	sed	05:55:44	1
8262	99	88	72	cyclictest	0	-21	swapper/1	11:20:28	1
8262	99	88	72	cyclictest	0	-21	swapper/1	10:35:24	1
8262	99	88	72	cyclictest	0	-21	swapper/1	06:45:36	1
8262	99	88	72	cyclictest	0	-21	swapper/1	06:10:35	1
8262	99	87	72	cyclictest	0	-21	swapper/1	11:10:26	1
8262	99	87	72	cyclictest	0	-21	swapper/1	10:30:27	1
8262	99	87	72	cyclictest	0	-21	swapper/1	09:15:14	1
8262	99	87	72	cyclictest	0	-21	swapper/1	06:50:32	1
8262	99	87	72	cyclictest	0	-21	swapper/1	06:40:34	1
8262	99	87	71	cyclictest	0	-21	swapper/1	11:05:24	1
8262	99	87	71	cyclictest	0	-21	swapper/1	10:55:24	1
8262	99	87	71	cyclictest	0	-21	swapper/1	10:50:24	1
8262	99	87	71	cyclictest	0	-21	swapper/1	10:50:24	1
8262	99	87	71	cyclictest	0	-21	swapper/1	09:55:25	1
8262	99	87	71	cyclictest	0	-21	swapper/1	09:55:25	1
8262	99	87	71	cyclictest	0	-21	swapper/1	08:30:26	1
8262	99	87	71	cyclictest	0	-21	swapper/1	08:00:31	1
8262	99	87	71	cyclictest	0	-21	swapper/1	08:00:31	1
8262	99	87	71	cyclictest	0	-21	swapper/1	07:30:35	1
8262	99	87	71	cyclictest	0	-21	swapper/1	07:05:33	1
8262	99	86	72	cyclictest	0	-21	swapper/1	06:05:42	1
8262	99	86	71	cyclictest	0	-21	swapper/1	11:00:21	1
8262	99	86	71	cyclictest	0	-21	swapper/1	09:25:31	1
8262	99	86	71	cyclictest	0	-21	swapper/1	08:45:17	1
8262	99	86	71	cyclictest	0	-21	swapper/1	08:25:29	1
8262	99	86	71	cyclictest	0	-21	swapper/1	08:20:29	1
8262	99	86	71	cyclictest	0	-21	swapper/1	08:05:38	1
8262	99	86	71	cyclictest	0	-21	swapper/1	07:55:30	1
8262	99	86	71	cyclictest	0	-21	swapper/1	07:35:30	1
8262	99	86	71	cyclictest	0	-21	swapper/1	07:25:31	1
8262	99	86	71	cyclictest	0	-21	swapper/1	07:00:38	1
8262	99	86	71	cyclictest	0	-21	swapper/1	06:55:36	1
8262	99	85	71	cyclictest	0	-21	swapper/1	10:28:32	1
8262	99	85	71	cyclictest	0	-21	swapper/1	10:00:30	1
8262	99	85	71	cyclictest	0	-21	swapper/1	09:00:31	1
8262	99	85	71	cyclictest	0	-21	swapper/1	08:10:31	1
8262	99	85	71	cyclictest	0	-21	swapper/1	07:43:10	1
8262	99	85	71	cyclictest	0	-21	swapper/1	07:20:35	1
8262	99	85	71	cyclictest	0	-21	swapper/1	07:15:40	1
8283	99	83	82	cyclictest	0	-21	swapper/3	11:20:25	3
8283	99	83	82	cyclictest	0	-21	swapper/3	11:13:40	3
8283	99	83	82	cyclictest	0	-21	swapper/3	11:00:29	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:55:28	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:50:24	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:50:24	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:40:30	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:35:31	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:30:30	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:23:32	3
8283	99	83	82	cyclictest	0	-21	swapper/3	10:00:32	3
8283	99	83	82	cyclictest	0	-21	swapper/3	09:46:13	3
8283	99	83	82	cyclictest	0	-21	swapper/3	09:40:34	3
8283	99	83	82	cyclictest	0	-21	swapper/3	09:35:13	3
8283	99	83	82	cyclictest	0	-21	swapper/3	09:15:35	3
8283	99	83	82	cyclictest	0	-21	swapper/3	09:10:35	3
8283	99	83	82	cyclictest	0	-21	swapper/3	09:00:34	3
8283	99	83	82	cyclictest	0	-21	swapper/3	08:35:35	3
8283	99	83	82	cyclictest	0	-21	swapper/3	08:33:17	3
8283	99	83	82	cyclictest	0	-21	swapper/3	07:50:39	3
8283	99	83	82	cyclictest	0	-21	swapper/3	07:48:10	3
8283	99	83	82	cyclictest	0	-21	swapper/3	07:28:38	3
8283	99	83	82	cyclictest	0	-21	swapper/3	07:15:33	3
8283	99	83	82	cyclictest	0	-21	swapper/3	07:10:39	3
8283	99	83	82	cyclictest	0	-21	swapper/3	06:53:03	3
8283	99	83	82	cyclictest	0	-21	swapper/3	06:40:42	3
8283	99	83	82	cyclictest	0	-21	swapper/3	06:20:36	3
8283	99	83	82	cyclictest	0	-21	swapper/3	06:10:42	3
8283	99	83	82	cyclictest	0	-21	swapper/3	06:00:42	3
8283	99	83	82	cyclictest	0	-21	swapper/3	05:55:44	3
8283	99	82	81	cyclictest	0	-21	swapper/3	10:45:26	3
8283	99	82	81	cyclictest	0	-21	swapper/3	09:05:28	3
8283	99	82	81	cyclictest	0	-21	swapper/3	08:45:29	3
8283	99	82	81	cyclictest	0	-21	swapper/3	08:20:33	3
8283	99	82	81	cyclictest	0	-21	swapper/3	08:05:31	3
8283	99	82	81	cyclictest	0	-21	swapper/3	07:40:31	3
8283	99	82	81	cyclictest	0	-21	swapper/3	06:35:34	3
8283	99	82	81	cyclictest	0	-21	swapper/3	06:15:34	3
8283	99	73	72	cyclictest	14817	-21	latency_hist	07:25:18	3
8283	99	73	72	cyclictest	0	-21	swapper/3	11:15:29	3
8283	99	73	72	cyclictest	0	-21	swapper/3	08:50:34	3
8283	99	73	72	cyclictest	0	-21	swapper/3	08:30:15	3
8283	99	73	72	cyclictest	0	-21	swapper/3	07:00:35	3
8283	99	73	72	cyclictest	0	-21	swapper/3	06:55:37	3
8283	99	72	71	cyclictest	0	-21	swapper/3	10:08:30	3
8283	99	72	71	cyclictest	0	-21	swapper/3	10:00:13	3
8283	99	72	71	cyclictest	0	-21	swapper/3	10:00:13	3
8283	99	72	71	cyclictest	0	-21	swapper/3	07:05:40	3
8283	99	67	66	cyclictest	0	-21	swapper/3	08:20:16	3
8283	99	67	62	cyclictest	0	-21	swapper/3	10:25:25	3
8283	99	66	61	cyclictest	0	-21	swapper/3	06:25:33	3
8283	99	64	62	cyclictest	0	-21	swapper/3	08:40:28	3
8283	99	63	62	cyclictest	0	-21	swapper/3	11:05:10	3
8283	99	63	62	cyclictest	0	-21	swapper/3	10:15:22	3
8283	99	63	62	cyclictest	0	-21	swapper/3	09:50:26	3
8283	99	63	62	cyclictest	0	-21	swapper/3	09:25:14	3
8283	99	63	62	cyclictest	0	-21	swapper/3	08:55:24	3
8283	99	63	62	cyclictest	0	-21	swapper/3	08:10:27	3
8283	99	63	62	cyclictest	0	-21	swapper/3	08:00:28	3
8283	99	63	62	cyclictest	0	-21	swapper/3	08:00:28	3
8283	99	63	62	cyclictest	0	-21	swapper/3	07:55:28	3
8283	99	63	62	cyclictest	0	-21	swapper/3	07:30:29	3
8283	99	63	62	cyclictest	0	-21	swapper/3	06:30:20	3
8283	99	63	62	cyclictest	0	-21	swapper/3	06:05:28	3
8283	99	63	51	cyclictest	0	-21	swapper/3	09:35:25	3
8283	99	63	51	cyclictest	0	-21	swapper/3	06:45:30	3
8274	99	61	60	cyclictest	0	-21	swapper/2	09:55:23	2
8274	99	61	60	cyclictest	0	-21	swapper/2	09:55:23	2
8274	99	59	58	cyclictest	0	-21	swapper/2	09:18:05	2
8274	99	59	58	cyclictest	0	-21	swapper/2	08:40:30	2
8253	99	59	58	cyclictest	0	-21	swapper/0	10:10:23	0
8274	99	58	57	cyclictest	0	-21	swapper/2	11:20:25	2
8274	99	58	57	cyclictest	0	-21	swapper/2	11:12:16	2
8274	99	58	57	cyclictest	0	-21	swapper/2	11:06:11	2
8274	99	58	57	cyclictest	0	-21	swapper/2	10:39:07	2
8274	99	58	57	cyclictest	0	-21	swapper/2	10:25:23	2
8274	99	58	57	cyclictest	0	-21	swapper/2	09:31:16	2
8274	99	58	57	cyclictest	0	-21	swapper/2	09:07:52	2
8274	99	58	57	cyclictest	0	-21	swapper/2	08:55:31	2
8274	99	58	57	cyclictest	0	-21	swapper/2	08:35:29	2
8274	99	58	57	cyclictest	0	-21	swapper/2	08:30:21	2
8274	99	58	57	cyclictest	0	-21	swapper/2	08:10:02	2
8274	99	58	57	cyclictest	0	-21	swapper/2	07:39:45	2
8274	99	58	57	cyclictest	0	-21	swapper/2	07:30:40	2
8274	99	58	57	cyclictest	0	-21	swapper/2	07:22:10	2
8274	99	58	57	cyclictest	0	-21	swapper/2	06:51:41	2
8274	99	58	57	cyclictest	0	-21	swapper/2	06:39:07	2
8274	99	58	57	cyclictest	0	-21	swapper/2	06:25:43	2
8274	99	58	57	cyclictest	0	-21	swapper/2	06:16:31	2
8274	99	58	57	cyclictest	0	-21	swapper/2	06:04:29	2
8274	99	57	56	cyclictest	0	-21	swapper/2	10:16:43	2
8274	99	57	56	cyclictest	0	-21	swapper/2	10:06:05	2
8274	99	57	56	cyclictest	0	-21	swapper/2	10:04:37	2
8274	99	57	56	cyclictest	0	-21	swapper/2	09:53:19	2
8274	99	57	56	cyclictest	0	-21	swapper/2	09:00:24	2
8274	99	57	56	cyclictest	0	-21	swapper/2	08:29:05	2
8274	99	57	56	cyclictest	0	-21	swapper/2	08:15:11	2
8274	99	57	56	cyclictest	0	-21	swapper/2	07:28:19	2
8274	99	57	56	cyclictest	0	-21	swapper/2	07:10:31	2
8274	99	57	56	cyclictest	0	-21	swapper/2	06:24:05	2
8274	99	57	56	cyclictest	0	-21	swapper/2	05:55:42	2
8274	99	57	45	cyclictest	0	-21	swapper/2	10:45:23	2
8253	99	57	56	cyclictest	0	-21	swapper/0	06:50:31	0
8253	99	57	51	cyclictest	0	-21	swapper/0	07:03:04	0
8253	99	57	50	cyclictest	0	-21	swapper/0	06:18:42	0
8274	99	56	55	cyclictest	0	-21	swapper/2	10:30:20	2
8274	99	56	55	cyclictest	0	-21	swapper/2	09:46:26	2
8274	99	56	55	cyclictest	0	-21	swapper/2	09:39:53	2
8274	99	56	55	cyclictest	0	-21	swapper/2	08:24:33	2
8274	99	56	55	cyclictest	0	-21	swapper/2	07:50:30	2
8274	99	56	55	cyclictest	0	-21	swapper/2	07:45:40	2
8274	99	56	55	cyclictest	0	-21	swapper/2	06:45:58	2
8274	99	56	55	cyclictest	0	-21	swapper/2	06:10:22	2
8274	99	56	42	cyclictest	278	-21	usb-storage	09:42:08	2
8253	99	56	45	cyclictest	0	-21	swapper/0	09:25:24	0
8274	99	55	54	cyclictest	0	-21	swapper/2	10:59:39	2
8274	99	55	54	cyclictest	0	-21	swapper/2	10:50:32	2
8274	99	55	54	cyclictest	0	-21	swapper/2	10:50:32	2
8274	99	55	54	cyclictest	0	-21	swapper/2	08:45:30	2
8274	99	55	54	cyclictest	0	-21	swapper/2	07:03:32	2
8274	99	55	48	cyclictest	0	-21	swapper/2	06:34:22	2
8274	99	55	41	cyclictest	50	50	irq/44-ahci	06:05:56	2
8262	99	55	51	cyclictest	0	-21	swapper/1	05:55:22	1
8253	99	55	53	cyclictest	50	50	irq/44-ahci	09:00:15	0
8274	99	54	53	cyclictest	278	1	usb-storage	08:00:06	2
8274	99	54	53	cyclictest	18	1	ksoftirqd/2	08:16:18	2
8274	99	54	53	cyclictest	17497	-21	telnet	11:15:21	2
8274	99	54	53	cyclictest	0	-21	swapper/2	07:41:15	2
8274	99	54	51	cyclictest	18	1	ksoftirqd/2	06:40:59	2
8274	99	54	42	cyclictest	50	50	irq/44-ahci	08:52:28	2
8274	99	54	42	cyclictest	0	-21	swapper/2	10:14:41	2
8253	99	54	53	cyclictest	0	-21	swapper/0	06:45:30	0
8253	99	54	53	cyclictest	0	-21	swapper/0	05:56:19	0
8274	99	53	52	cyclictest	31932	-21	kworker/2:0	09:20:23	2
8274	99	53	52	cyclictest	10566	-21	munin-node	07:15:41	2
8274	99	53	52	cyclictest	0	-21	swapper/2	09:10:15	2
8274	99	53	52	cyclictest	0	-21	swapper/2	08:00:24	2
8274	99	53	52	cyclictest	0	-21	swapper/2	08:00:24	2
8274	99	53	51	cyclictest	278	-21	usb-storage	06:57:37	2
8274	99	53	51	cyclictest	26059	-21	telnet	10:20:23	2
8274	99	53	51	cyclictest	2352	-21	telnet	10:40:21	2
8274	99	53	41	cyclictest	6601	-21	fschecks_count	07:05:33	2
8274	99	53	41	cyclictest	0	-21	swapper/2	11:00:20	2
8274	99	53	41	cyclictest	0	-21	swapper/2	09:25:23	2
8253	99	53	52	cyclictest	760	50	irq/18-parport0	11:01:41	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	10:57:48	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	10:47:20	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	10:33:21	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	09:57:52	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	09:57:52	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	09:40:19	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	09:21:27	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	08:12:56	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	08:06:52	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	07:50:25	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	06:57:09	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	06:44:45	0
8253	99	53	52	cyclictest	760	50	irq/18-parport0	06:05:25	0
8253	99	53	52	cyclictest	50	50	irq/44-ahci	11:20:46	0
8253	99	53	52	cyclictest	1864	-21	hald-addon-stor	07:44:11	0
8253	99	53	52	cyclictest	0	-21	swapper/0	11:16:05	0
8253	99	53	52	cyclictest	0	-21	swapper/0	11:10:17	0
8253	99	53	52	cyclictest	0	-21	swapper/0	10:20:23	0
8253	99	53	52	cyclictest	0	-21	swapper/0	10:15:53	0
8253	99	53	52	cyclictest	0	-21	swapper/0	09:35:48	0
8253	99	53	52	cyclictest	0	-21	swapper/0	09:31:19	0
8253	99	53	52	cyclictest	0	-21	swapper/0	08:52:25	0
8253	99	53	52	cyclictest	0	-21	swapper/0	08:35:16	0
8253	99	53	52	cyclictest	0	-21	swapper/0	07:17:02	0
8253	99	53	52	cyclictest	0	-21	swapper/0	07:08:49	0
8253	99	53	52	cyclictest	0	-21	swapper/0	06:20:34	0
8253	99	53	51	cyclictest	50	50	irq/44-ahci	08:21:40	0
8253	99	53	41	cyclictest	50	50	irq/44-ahci	07:31:04	0
8253	99	53	41	cyclictest	0	-21	swapper/0	10:50:24	0
8253	99	53	41	cyclictest	0	-21	swapper/0	10:50:24	0
8253	99	53	41	cyclictest	0	-21	swapper/0	10:39:10	0
8253	99	53	41	cyclictest	0	-21	swapper/0	10:25:33	0
8253	99	53	41	cyclictest	0	-21	swapper/0	10:05:24	0
8253	99	53	41	cyclictest	0	-21	swapper/0	09:45:37	0
8253	99	53	41	cyclictest	0	-21	swapper/0	09:07:18	0
8253	99	53	41	cyclictest	0	-21	swapper/0	08:40:33	0
8253	99	53	41	cyclictest	0	-21	swapper/0	08:34:41	0
8253	99	53	41	cyclictest	0	-21	swapper/0	08:00:30	0
8253	99	53	41	cyclictest	0	-21	swapper/0	08:00:30	0
8253	99	53	41	cyclictest	0	-21	swapper/0	07:55:28	0
8253	99	53	41	cyclictest	0	-21	swapper/0	07:35:29	0
8253	99	53	41	cyclictest	0	-21	swapper/0	07:25:30	0
8253	99	53	41	cyclictest	0	-21	swapper/0	07:20:35	0
8253	99	53	41	cyclictest	0	-21	swapper/0	06:32:39	0
8253	99	53	41	cyclictest	0	-21	swapper/0	06:25:35	0
8253	99	53	41	cyclictest	0	-21	swapper/0	06:10:34	0
8253	99	52	51	cyclictest	50	50	irq/44-ahci	11:05:45	0
8253	99	52	51	cyclictest	0	-21	swapper/0	10:42:36	0
8253	99	52	51	cyclictest	0	-21	swapper/0	10:00:16	0
8253	99	52	51	cyclictest	0	-21	swapper/0	09:15:47	0
8253	99	52	51	cyclictest	0	-21	swapper/0	09:13:12	0
8253	99	52	51	cyclictest	0	-21	swapper/0	08:56:48	0
8253	99	52	51	cyclictest	0	-21	swapper/0	08:45:46	0
8253	99	52	51	cyclictest	0	-21	swapper/0	08:25:25	0
8253	99	52	51	cyclictest	0	-21	swapper/0	08:15:27	0
8253	99	52	51	cyclictest	0	-21	swapper/0	07:45:33	0
8253	99	52	51	cyclictest	0	-21	swapper/0	07:10:20	0
8253	99	52	51	cyclictest	0	-21	swapper/0	06:35:52	0
8253	99	52	51	cyclictest	0	-21	swapper/0	06:00:41	0
8253	99	52	41	cyclictest	0	-21	swapper/0	09:50:25	0
8283	99	45	41	cyclictest	0	-21	swapper/3	05:55:22	3
8274	99	42	41	cyclictest	0	-21	swapper/2	05:55:22	2
8253	99	42	41	cyclictest	0	-21	swapper/0	05:55:22	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17