OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Sat May 09, 2026 00:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
937	99	104	102	cyclictest	10603	-21	tune2fs	18:40:18	1
939	99	103	102	cyclictest	0	-21	swapper/3	18:40:18	3
937	99	103	102	cyclictest	0	-21	swapper/1	17:45:07	1
937	99	97	92	cyclictest	1381	-21	aten2.4-expect	20:50:10	1
937	99	96	92	cyclictest	0	-21	swapper/1	22:15:12	1
937	99	96	92	cyclictest	0	-21	swapper/1	18:55:26	1
937	99	96	82	cyclictest	0	-21	swapper/1	21:05:52	1
937	99	95	92	cyclictest	0	-21	swapper/1	22:14:57	1
937	99	95	92	cyclictest	0	-21	swapper/1	22:08:13	1
937	99	95	92	cyclictest	0	-21	swapper/1	21:55:09	1
937	99	95	92	cyclictest	0	-21	swapper/1	21:35:09	1
937	99	95	92	cyclictest	0	-21	swapper/1	20:23:36	1
937	99	95	92	cyclictest	0	-21	swapper/1	19:45:17	1
937	99	95	92	cyclictest	0	-21	swapper/1	18:50:22	1
937	99	95	92	cyclictest	0	-21	swapper/1	17:13:35	1
937	99	94	90	cyclictest	0	-21	swapper/1	21:23:59	1
939	99	93	92	cyclictest	0	-21	swapper/3	17:45:07	3
937	99	93	92	cyclictest	0	-21	swapper/1	18:04:28	1
939	99	88	82	cyclictest	0	-21	swapper/3	19:40:15	3
937	99	88	82	cyclictest	22864	-21	aten2.4-expect	17:55:18	1
937	99	88	72	cyclictest	0	-21	swapper/1	20:45:21	1
937	99	88	72	cyclictest	0	-21	swapper/1	19:40:16	1
939	99	87	82	cyclictest	0	-21	swapper/3	21:05:00	3
939	99	87	82	cyclictest	0	-21	swapper/3	20:30:15	3
939	99	87	72	cyclictest	0	-21	swapper/3	22:06:06	3
937	99	87	82	cyclictest	23701	-21	tune2fs	20:25:16	1
937	99	87	82	cyclictest	0	-21	swapper/1	22:30:14	1
937	99	87	82	cyclictest	0	-21	swapper/1	21:25:22	1
937	99	87	82	cyclictest	0	-21	swapper/1	19:50:12	1
937	99	87	82	cyclictest	0	-21	swapper/1	19:25:17	1
937	99	87	82	cyclictest	0	-21	swapper/1	19:25:17	1
937	99	87	82	cyclictest	0	-21	swapper/1	19:15:04	1
937	99	87	82	cyclictest	0	-21	swapper/1	19:05:16	1
937	99	87	82	cyclictest	0	-21	swapper/1	17:30:21	1
937	99	87	81	cyclictest	8265	-21	tune2fs	18:35:18	1
937	99	87	81	cyclictest	25669	-21	tune2fs	20:30:15	1
937	99	87	81	cyclictest	23728	-21	tune2fs	21:40:12	1
937	99	87	81	cyclictest	1471	-21	tune2fs	17:05:21	1
937	99	87	71	cyclictest	0	-21	swapper/1	20:00:24	1
937	99	87	71	cyclictest	0	-21	swapper/1	19:30:25	1
939	99	86	82	cyclictest	0	-21	swapper/3	22:21:09	3
939	99	86	82	cyclictest	0	-21	swapper/3	22:16:08	3
939	99	86	82	cyclictest	0	-21	swapper/3	21:46:03	3
939	99	86	82	cyclictest	0	-21	swapper/3	20:46:01	3
939	99	86	82	cyclictest	0	-21	swapper/3	20:36:00	3
939	99	86	82	cyclictest	0	-21	swapper/3	20:25:58	3
939	99	86	82	cyclictest	0	-21	swapper/3	17:15:29	3
939	99	86	81	cyclictest	0	-21	swapper/3	17:55:20	3
937	99	86	82	cyclictest	0	-21	swapper/1	22:27:44	1
937	99	86	82	cyclictest	0	-21	swapper/1	22:20:08	1
937	99	86	82	cyclictest	0	-21	swapper/1	22:01:37	1
937	99	86	82	cyclictest	0	-21	swapper/1	21:50:03	1
937	99	86	82	cyclictest	0	-21	swapper/1	21:45:15	1
937	99	86	82	cyclictest	0	-21	swapper/1	21:30:10	1
937	99	86	82	cyclictest	0	-21	swapper/1	21:16:20	1
937	99	86	82	cyclictest	0	-21	swapper/1	21:16:20	1
937	99	86	82	cyclictest	0	-21	swapper/1	21:10:31	1
937	99	86	82	cyclictest	0	-21	swapper/1	21:00:18	1
937	99	86	82	cyclictest	0	-21	swapper/1	20:55:20	1
937	99	86	82	cyclictest	0	-21	swapper/1	20:40:50	1
937	99	86	82	cyclictest	0	-21	swapper/1	20:37:55	1
937	99	86	82	cyclictest	0	-21	swapper/1	20:15:15	1
937	99	86	82	cyclictest	0	-21	swapper/1	20:10:24	1
937	99	86	82	cyclictest	0	-21	swapper/1	20:05:15	1
937	99	86	82	cyclictest	0	-21	swapper/1	19:55:26	1
937	99	86	82	cyclictest	0	-21	swapper/1	19:35:12	1
937	99	86	82	cyclictest	0	-21	swapper/1	19:20:18	1
937	99	86	82	cyclictest	0	-21	swapper/1	19:16:10	1
937	99	86	82	cyclictest	0	-21	swapper/1	19:00:15	1
937	99	86	82	cyclictest	0	-21	swapper/1	18:26:50	1
937	99	86	82	cyclictest	0	-21	swapper/1	18:20:16	1
937	99	86	82	cyclictest	0	-21	swapper/1	18:15:08	1
937	99	86	82	cyclictest	0	-21	swapper/1	18:05:28	1
937	99	86	82	cyclictest	0	-21	swapper/1	17:50:22	1
937	99	86	82	cyclictest	0	-21	swapper/1	17:45:21	1
937	99	86	82	cyclictest	0	-21	swapper/1	17:35:19	1
937	99	86	82	cyclictest	0	-21	swapper/1	17:25:08	1
937	99	86	82	cyclictest	0	-21	swapper/1	17:16:34	1
937	99	86	71	cyclictest	0	-21	swapper/1	18:30:18	1
937	99	86	71	cyclictest	0	-21	swapper/1	18:10:28	1
937	99	85	82	cyclictest	0	-21	swapper/1	18:45:16	1
937	99	85	82	cyclictest	0	-21	swapper/1	17:20:22	1
939	99	84	83	cyclictest	16517	-21	sadc	21:24:58	3
939	99	83	82	cyclictest	0	-21	swapper/3	22:30:17	3
939	99	83	82	cyclictest	0	-21	swapper/3	22:14:57	3
939	99	83	82	cyclictest	0	-21	swapper/3	22:04:57	3
939	99	83	82	cyclictest	0	-21	swapper/3	21:55:18	3
939	99	83	82	cyclictest	0	-21	swapper/3	21:25:13	3
939	99	83	82	cyclictest	0	-21	swapper/3	21:15:14	3
939	99	83	82	cyclictest	0	-21	swapper/3	21:15:14	3
939	99	83	82	cyclictest	0	-21	swapper/3	21:10:17	3
939	99	83	82	cyclictest	0	-21	swapper/3	21:05:19	3
939	99	83	82	cyclictest	0	-21	swapper/3	20:51:02	3
939	99	83	82	cyclictest	0	-21	swapper/3	20:45:01	3
939	99	83	82	cyclictest	0	-21	swapper/3	20:20:20	3
939	99	83	82	cyclictest	0	-21	swapper/3	20:10:22	3
939	99	83	82	cyclictest	0	-21	swapper/3	20:05:17	3
939	99	83	82	cyclictest	0	-21	swapper/3	19:55:23	3
939	99	83	82	cyclictest	0	-21	swapper/3	19:35:22	3
939	99	83	82	cyclictest	0	-21	swapper/3	19:30:22	3
939	99	83	82	cyclictest	0	-21	swapper/3	19:00:23	3
939	99	83	82	cyclictest	0	-21	swapper/3	18:55:25	3
939	99	83	82	cyclictest	0	-21	swapper/3	18:35:25	3
939	99	83	82	cyclictest	0	-21	swapper/3	18:30:25	3
939	99	83	82	cyclictest	0	-21	swapper/3	18:25:40	3
939	99	83	82	cyclictest	0	-21	swapper/3	18:20:19	3
939	99	83	82	cyclictest	0	-21	swapper/3	18:15:07	3
939	99	83	82	cyclictest	0	-21	swapper/3	18:10:26	3
939	99	83	82	cyclictest	0	-21	swapper/3	17:50:27	3
939	99	83	82	cyclictest	0	-21	swapper/3	17:45:28	3
939	99	83	82	cyclictest	0	-21	swapper/3	17:35:07	3
939	99	83	82	cyclictest	0	-21	swapper/3	17:35:07	3
939	99	82	81	cyclictest	0	-21	swapper/3	21:44:57	3
939	99	82	81	cyclictest	0	-21	swapper/3	17:25:22	3
937	99	75	71	cyclictest	0	-21	swapper/1	17:05:08	1
939	99	73	72	cyclictest	0	-21	swapper/3	19:15:12	3
939	99	73	68	cyclictest	0	-21	swapper/3	17:20:19	3
939	99	72	71	cyclictest	0	-21	swapper/3	22:25:08	3
939	99	72	71	cyclictest	0	-21	swapper/3	21:35:12	3
939	99	72	71	cyclictest	0	-21	swapper/3	21:34:58	3
939	99	72	71	cyclictest	0	-21	swapper/3	19:45:23	3
939	99	72	71	cyclictest	0	-21	swapper/3	19:05:14	3
939	99	72	71	cyclictest	0	-21	swapper/3	18:05:24	3
939	99	71	70	cyclictest	0	-21	swapper/3	18:00:18	3
938	99	67	62	cyclictest	0	-21	swapper/2	22:00:08	2
938	99	67	51	cyclictest	0	-21	swapper/2	19:05:14	2
938	99	67	51	cyclictest	0	-21	swapper/2	17:45:19	2
939	99	66	65	cyclictest	0	-21	swapper/3	19:50:12	3
938	99	65	64	cyclictest	0	-21	swapper/2	22:19:41	2
938	99	65	64	cyclictest	0	-21	swapper/2	20:09:50	2
938	99	65	64	cyclictest	0	-21	swapper/2	18:39:22	2
938	99	65	64	cyclictest	0	-21	swapper/2	18:08:25	2
938	99	64	49	cyclictest	0	-21	swapper/2	18:20:17	2
939	99	63	62	cyclictest	0	-21	swapper/3	21:50:07	3
939	99	63	62	cyclictest	0	-21	swapper/3	20:55:11	3
939	99	63	62	cyclictest	0	-21	swapper/3	20:15:13	3
939	99	63	62	cyclictest	0	-21	swapper/3	20:00:13	3
939	99	63	62	cyclictest	0	-21	swapper/3	19:25:15	3
939	99	63	62	cyclictest	0	-21	swapper/3	19:25:15	3
939	99	63	62	cyclictest	0	-21	swapper/3	19:20:03	3
939	99	63	62	cyclictest	0	-21	swapper/3	19:10:04	3
939	99	63	62	cyclictest	0	-21	swapper/3	18:50:05	3
939	99	63	62	cyclictest	0	-21	swapper/3	18:45:05	3
939	99	63	62	cyclictest	0	-21	swapper/3	17:05:20	3
939	99	63	51	cyclictest	0	-21	swapper/3	17:10:17	3
938	99	63	62	cyclictest	0	-21	swapper/2	22:20:07	2
938	99	62	61	cyclictest	0	-21	swapper/2	21:40:10	2
938	99	62	61	cyclictest	0	-21	swapper/2	19:40:14	2
938	99	62	61	cyclictest	0	-21	swapper/2	19:25:14	2
938	99	62	61	cyclictest	0	-21	swapper/2	19:25:14	2
938	99	62	61	cyclictest	0	-21	swapper/2	18:55:16	2
938	99	62	61	cyclictest	0	-21	swapper/2	18:15:18	2
938	99	62	61	cyclictest	0	-21	swapper/2	17:30:18	2
938	99	62	50	cyclictest	0	-21	swapper/2	18:25:17	2
936	99	62	45	cyclictest	0	-21	swapper/0	19:15:13	0
938	99	61	60	cyclictest	0	-21	swapper/2	17:15:20	2
936	99	61	60	cyclictest	0	-21	swapper/0	21:00:11	0
938	99	60	59	cyclictest	0	-21	swapper/2	18:10:16	2
936	99	60	59	cyclictest	0	-21	swapper/0	20:20:11	0
938	99	59	58	cyclictest	0	-21	swapper/2	19:20:14	2
936	99	58	41	cyclictest	0	-21	swapper/0	19:51:32	0
938	99	57	52	cyclictest	0	-21	swapper/2	22:29:12	2
938	99	57	52	cyclictest	0	-21	swapper/2	20:20:51	2
938	99	56	52	cyclictest	0	-21	swapper/2	17:20:55	2
938	99	56	51	cyclictest	0	-21	swapper/2	21:34:58	2
938	99	56	51	cyclictest	0	-21	swapper/2	21:09:25	2
938	99	55	52	cyclictest	0	-21	swapper/2	17:59:51	2
938	99	55	51	cyclictest	18	1	ksoftirqd/2	19:15:39	2
938	99	55	51	cyclictest	0	-21	swapper/2	21:00:01	2
938	99	55	51	cyclictest	0	-21	swapper/2	20:55:03	2
938	99	55	51	cyclictest	0	-21	swapper/2	20:50:03	2
938	99	55	51	cyclictest	0	-21	swapper/2	19:52:48	2
938	99	55	51	cyclictest	0	-21	swapper/2	19:33:04	2
938	99	55	51	cyclictest	0	-21	swapper/2	18:49:02	2
938	99	55	51	cyclictest	0	-21	swapper/2	18:40:48	2
938	99	55	51	cyclictest	0	-21	swapper/2	17:10:37	2
938	99	55	41	cyclictest	0	-21	swapper/2	20:18:05	2
936	99	55	54	cyclictest	0	-21	swapper/0	21:15:34	0
936	99	55	54	cyclictest	0	-21	swapper/0	21:15:34	0
938	99	54	50	cyclictest	0	-21	swapper/2	17:40:19	2
938	99	54	41	cyclictest	18	1	ksoftirqd/2	20:48:26	2
936	99	54	53	cyclictest	478	-21	kjournald	21:06:53	0
939	99	53	52	cyclictest	0	-21	swapper/3	17:05:08	3
938	99	53	52	cyclictest	0	-21	swapper/2	22:30:07	2
938	99	53	52	cyclictest	0	-21	swapper/2	22:10:57	2
938	99	53	52	cyclictest	0	-21	swapper/2	22:05:02	2
938	99	53	52	cyclictest	0	-21	swapper/2	21:56:29	2
938	99	53	52	cyclictest	0	-21	swapper/2	21:50:01	2
938	99	53	52	cyclictest	0	-21	swapper/2	21:45:09	2
938	99	53	52	cyclictest	0	-21	swapper/2	21:34:59	2
938	99	53	52	cyclictest	0	-21	swapper/2	21:26:09	2
938	99	53	52	cyclictest	0	-21	swapper/2	21:20:36	2
938	99	53	52	cyclictest	0	-21	swapper/2	20:40:33	2
938	99	53	52	cyclictest	0	-21	swapper/2	20:36:37	2
938	99	53	52	cyclictest	0	-21	swapper/2	20:30:52	2
938	99	53	52	cyclictest	0	-21	swapper/2	20:28:42	2
938	99	53	52	cyclictest	0	-21	swapper/2	20:10:41	2
938	99	53	52	cyclictest	0	-21	swapper/2	20:02:22	2
938	99	53	52	cyclictest	0	-21	swapper/2	19:55:28	2
938	99	53	52	cyclictest	0	-21	swapper/2	19:45:11	2
938	99	53	52	cyclictest	0	-21	swapper/2	19:36:28	2
938	99	53	52	cyclictest	0	-21	swapper/2	19:10:16	2
938	99	53	52	cyclictest	0	-21	swapper/2	19:00:14	2
938	99	53	52	cyclictest	0	-21	swapper/2	18:50:54	2
938	99	53	52	cyclictest	0	-21	swapper/2	18:30:15	2
938	99	53	52	cyclictest	0	-21	swapper/2	17:53:02	2
938	99	53	52	cyclictest	0	-21	swapper/2	17:35:52	2
938	99	53	52	cyclictest	0	-21	swapper/2	17:06:53	2
938	99	53	51	cyclictest	25041	-21	telnet	18:00:18	2
938	99	53	41	cyclictest	0	-21	swapper/2	21:10:10	2
938	99	53	41	cyclictest	0	-21	swapper/2	17:26:23	2
936	99	53	52	cyclictest	760	50	irq/18-parport0	22:08:37	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	21:41:16	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	21:33:14	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	21:12:25	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	20:15:43	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	19:46:24	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	18:06:38	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	17:23:17	0
936	99	53	52	cyclictest	760	50	irq/18-parport0	17:08:52	0
936	99	53	52	cyclictest	0	-21	swapper/0	22:15:34	0
936	99	53	52	cyclictest	0	-21	swapper/0	21:55:09	0
936	99	53	52	cyclictest	0	-21	swapper/0	21:50:49	0
936	99	53	52	cyclictest	0	-21	swapper/0	20:55:12	0
936	99	53	52	cyclictest	0	-21	swapper/0	19:30:44	0
936	99	53	52	cyclictest	0	-21	swapper/0	19:00:14	0
936	99	53	52	cyclictest	0	-21	swapper/0	18:36:11	0
936	99	53	52	cyclictest	0	-21	swapper/0	18:10:17	0
936	99	53	52	cyclictest	0	-21	swapper/0	17:25:20	0
936	99	53	51	cyclictest	1286	50	irq/46-eth0	22:20:18	0
936	99	53	51	cyclictest	1286	50	irq/46-eth0	20:30:18	0
936	99	53	41	cyclictest	760	50	irq/18-parport0	22:14:44	0
936	99	53	41	cyclictest	0	-21	swapper/0	22:28:02	0
936	99	53	41	cyclictest	0	-21	swapper/0	21:37:02	0
936	99	53	41	cyclictest	0	-21	swapper/0	20:52:59	0
936	99	53	41	cyclictest	0	-21	swapper/0	20:47:26	0
936	99	53	41	cyclictest	0	-21	swapper/0	20:41:36	0
936	99	53	41	cyclictest	0	-21	swapper/0	20:12:23	0
936	99	53	41	cyclictest	0	-21	swapper/0	19:41:00	0
936	99	53	41	cyclictest	0	-21	swapper/0	19:20:23	0
936	99	53	41	cyclictest	0	-21	swapper/0	19:11:49	0
936	99	53	41	cyclictest	0	-21	swapper/0	18:45:56	0
936	99	53	41	cyclictest	0	-21	swapper/0	18:32:27	0
936	99	53	41	cyclictest	0	-21	swapper/0	17:56:28	0
936	99	53	41	cyclictest	0	-21	swapper/0	17:47:26	0
936	99	53	41	cyclictest	0	-21	swapper/0	17:35:41	0
936	99	53	41	cyclictest	0	-21	swapper/0	17:17:46	0
936	99	53	31	cyclictest	0	-21	swapper/0	18:25:21	0
936	99	53	21	cyclictest	0	-21	swapper/0	20:25:02	0
938	99	52	51	cyclictest	0	-21	swapper/2	21:15:10	2
938	99	52	51	cyclictest	0	-21	swapper/2	21:15:10	2
936	99	52	51	cyclictest	760	50	irq/18-parport0	21:20:00	0
936	99	52	51	cyclictest	760	50	irq/18-parport0	17:10:14	0
936	99	52	51	cyclictest	20342	-21	kworker/0:1	19:05:31	0
936	99	52	51	cyclictest	13746	-21	kworker/0:0	18:50:56	0
936	99	52	51	cyclictest	0	-21	swapper/0	22:30:47	0
936	99	52	51	cyclictest	0	-21	swapper/0	21:26:56	0
936	99	52	51	cyclictest	0	-21	swapper/0	20:07:41	0
936	99	52	51	cyclictest	0	-21	swapper/0	20:01:33	0
936	99	52	51	cyclictest	0	-21	swapper/0	19:57:07	0
936	99	52	51	cyclictest	0	-21	swapper/0	19:25:05	0
936	99	52	51	cyclictest	0	-21	swapper/0	19:25:05	0
936	99	52	51	cyclictest	0	-21	swapper/0	18:55:32	0
936	99	52	51	cyclictest	0	-21	swapper/0	18:20:11	0
936	99	52	51	cyclictest	0	-21	swapper/0	18:02:02	0
936	99	52	51	cyclictest	0	-21	swapper/0	17:50:18	0
936	99	52	51	cyclictest	0	-21	swapper/0	17:42:03	0
936	99	52	51	cyclictest	0	-21	swapper/0	17:31:55	0
936	99	52	45	cyclictest	0	-21	swapper/0	22:00:31	0
936	99	52	45	cyclictest	0	-21	swapper/0	18:15:19	0
936	99	52	41	cyclictest	0	-21	swapper/0	21:45:45	0
936	99	52	41	cyclictest	0	-21	swapper/0	20:35:10	0
936	99	52	41	cyclictest	0	-21	swapper/0	19:39:06	0
936	99	52	41	cyclictest	0	-21	swapper/0	18:40:10	0
938	99	43	42	cyclictest	0	-21	swapper/2	17:05:09	2
936	99	42	41	cyclictest	0	-21	swapper/0	17:05:09	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17