OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Tue Jun 16, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
21365	99	126	112	cyclictest	0	-21	swapper/3	06:50:25	3
21365	99	103	102	cyclictest	0	-21	swapper/3	09:40:27	3
21365	99	103	102	cyclictest	0	-21	swapper/3	09:35:23	3
21365	99	103	102	cyclictest	0	-21	swapper/3	06:05:26	3
21345	99	103	102	cyclictest	0	-21	swapper/1	09:40:27	1
21345	99	103	102	cyclictest	0	-21	swapper/1	09:35:23	1
21345	99	94	93	cyclictest	12	1	ksoftirqd/1	06:48:12	1
21345	99	94	92	cyclictest	31067	-21	tune2fs	06:05:26	1
21345	99	94	92	cyclictest	0	-21	swapper/1	06:50:25	1
21365	99	93	92	cyclictest	0	-21	swapper/3	09:50:18	3
21365	99	93	92	cyclictest	0	-21	swapper/3	08:15:22	3
21365	99	93	92	cyclictest	0	-21	swapper/3	07:05:23	3
21345	99	93	92	cyclictest	0	-21	swapper/1	06:30:22	1
21365	99	90	82	cyclictest	0	-21	swapper/3	05:25:29	3
21365	99	89	82	cyclictest	0	-21	swapper/3	09:26:31	3
21365	99	89	82	cyclictest	0	-21	swapper/3	08:55:30	3
21365	99	89	81	cyclictest	0	-21	swapper/3	08:35:21	3
21365	99	88	82	cyclictest	0	-21	swapper/3	09:33:08	3
21365	99	88	82	cyclictest	0	-21	swapper/3	09:20:20	3
21365	99	88	82	cyclictest	0	-21	swapper/3	09:20:20	3
21365	99	88	82	cyclictest	0	-21	swapper/3	09:10:02	3
21365	99	88	82	cyclictest	0	-21	swapper/3	08:45:23	3
21365	99	88	82	cyclictest	0	-21	swapper/3	08:20:24	3
21365	99	88	82	cyclictest	0	-21	swapper/3	07:50:29	3
21365	99	88	82	cyclictest	0	-21	swapper/3	07:33:03	3
21365	99	88	82	cyclictest	0	-21	swapper/3	06:45:12	3
21365	99	88	82	cyclictest	0	-21	swapper/3	05:35:51	3
21365	99	88	82	cyclictest	0	-21	swapper/3	05:20:32	3
21365	99	88	81	cyclictest	0	-21	swapper/3	09:55:20	3
21365	99	88	81	cyclictest	0	-21	swapper/3	08:25:30	3
21365	99	88	81	cyclictest	0	-21	swapper/3	07:00:26	3
21365	99	88	81	cyclictest	0	-21	swapper/3	06:15:26	3
21365	99	87	82	cyclictest	0	-21	swapper/3	07:25:30	3
21365	99	87	82	cyclictest	0	-21	swapper/3	04:52:38	3
21365	99	87	82	cyclictest	0	-21	swapper/3	04:30:34	3
21365	99	87	81	cyclictest	0	-21	swapper/3	07:35:22	3
21365	99	87	81	cyclictest	0	-21	swapper/3	06:20:27	3
21365	99	86	82	cyclictest	0	-21	swapper/3	04:47:38	3
21345	99	84	83	cyclictest	24482	-21	tune2fs	05:50:28	1
21345	99	84	82	cyclictest	8419	-21	tune2fs	08:55:21	1
21345	99	84	82	cyclictest	3241	-21	tune2fs	06:15:26	1
21345	99	84	82	cyclictest	29958	-21	tune2fs	09:45:20	1
21345	99	84	82	cyclictest	20616	-21	tune2fs	06:55:26	1
21345	99	84	82	cyclictest	17639	-21	aten2.4-expect	05:35:26	1
21365	99	83	82	cyclictest	21600	-21	needreboot	08:10:27	3
21365	99	83	82	cyclictest	21600	-21	needreboot	08:10:27	3
21365	99	83	82	cyclictest	0	-21	swapper/3	09:45:18	3
21365	99	83	82	cyclictest	0	-21	swapper/3	08:50:19	3
21365	99	83	82	cyclictest	0	-21	swapper/3	08:30:23	3
21365	99	83	82	cyclictest	0	-21	swapper/3	08:07:10	3
21365	99	83	82	cyclictest	0	-21	swapper/3	07:20:02	3
21365	99	83	82	cyclictest	0	-21	swapper/3	06:25:34	3
21365	99	83	82	cyclictest	0	-21	swapper/3	06:10:32	3
21365	99	83	82	cyclictest	0	-21	swapper/3	06:00:26	3
21365	99	83	82	cyclictest	0	-21	swapper/3	05:55:27	3
21365	99	83	82	cyclictest	0	-21	swapper/3	05:49:47	3
21365	99	83	82	cyclictest	0	-21	swapper/3	05:19:19	3
21365	99	83	82	cyclictest	0	-21	swapper/3	04:39:17	3
21345	99	83	82	cyclictest	28371	-21	tune2fs	04:45:31	1
21345	99	83	82	cyclictest	0	-21	swapper/1	09:20:20	1
21345	99	83	82	cyclictest	0	-21	swapper/1	09:20:20	1
21345	99	83	82	cyclictest	0	-21	swapper/1	09:15:27	1
21345	99	83	82	cyclictest	0	-21	swapper/1	09:05:23	1
21345	99	83	82	cyclictest	0	-21	swapper/1	08:50:19	1
21345	99	83	82	cyclictest	0	-21	swapper/1	08:45:18	1
21345	99	83	82	cyclictest	0	-21	swapper/1	08:35:25	1
21345	99	83	82	cyclictest	0	-21	swapper/1	08:28:12	1
21345	99	83	82	cyclictest	0	-21	swapper/1	08:15:29	1
21345	99	83	82	cyclictest	0	-21	swapper/1	08:10:30	1
21345	99	83	82	cyclictest	0	-21	swapper/1	08:10:30	1
21345	99	83	82	cyclictest	0	-21	swapper/1	07:50:29	1
21345	99	83	82	cyclictest	0	-21	swapper/1	07:40:24	1
21345	99	83	82	cyclictest	0	-21	swapper/1	07:25:30	1
21345	99	83	82	cyclictest	0	-21	swapper/1	07:20:31	1
21345	99	83	82	cyclictest	0	-21	swapper/1	07:18:01	1
21345	99	83	82	cyclictest	0	-21	swapper/1	07:07:59	1
21345	99	83	82	cyclictest	0	-21	swapper/1	06:20:27	1
21345	99	83	82	cyclictest	0	-21	swapper/1	06:10:35	1
21345	99	83	82	cyclictest	0	-21	swapper/1	05:40:31	1
21345	99	83	82	cyclictest	0	-21	swapper/1	05:25:37	1
21345	99	83	82	cyclictest	0	-21	swapper/1	05:20:32	1
21345	99	83	82	cyclictest	0	-21	swapper/1	05:10:37	1
21345	99	83	82	cyclictest	0	-21	swapper/1	04:39:17	1
21345	99	83	81	cyclictest	9977	-21	aten2.4-expect	09:00:19	1
21345	99	83	81	cyclictest	8907	-21	aten2.4-expect	05:15:26	1
21345	99	83	81	cyclictest	7571	-21	tune2fs	06:25:27	1
21345	99	83	81	cyclictest	5777	-21	tune2fs	07:35:22	1
21345	99	83	81	cyclictest	32155	-21	tune2fs	09:50:17	1
21345	99	83	81	cyclictest	3136	-21	aten2.4-expect	07:30:23	1
21345	99	83	81	cyclictest	30327	-21	aten2.4-expect	04:50:27	1
21345	99	83	81	cyclictest	29755	-21	tune2fs	08:30:20	1
21345	99	83	81	cyclictest	28955	-21	tune2fs	06:00:27	1
21345	99	83	81	cyclictest	26735	-21	tune2fs	05:55:27	1
21345	99	83	81	cyclictest	1954	-21	tune2fs	09:55:20	1
21345	99	83	81	cyclictest	16737	-21	tune2fs	08:00:24	1
21345	99	83	81	cyclictest	14465	-21	tune2fs	07:55:22	1
21345	99	83	72	cyclictest	0	-21	swapper/1	08:20:24	1
21365	99	82	81	cyclictest	0	-21	swapper/3	09:00:19	3
21365	99	82	81	cyclictest	0	-21	swapper/3	07:55:22	3
21365	99	82	81	cyclictest	0	-21	swapper/3	07:40:24	3
21365	99	82	81	cyclictest	0	-21	swapper/3	06:55:26	3
21365	99	82	81	cyclictest	0	-21	swapper/3	05:50:28	3
21345	99	82	81	cyclictest	408	-21	md1_raid1	05:45:27	1
21345	99	82	81	cyclictest	408	-21	md1_raid1	04:30:37	1
21345	99	82	81	cyclictest	22645	-21	tune2fs	07:00:26	1
21345	99	82	71	cyclictest	0	-21	swapper/1	08:40:22	1
21365	99	79	78	cyclictest	0	-21	swapper/3	05:06:49	3
21365	99	78	72	cyclictest	0	-21	swapper/3	04:44:21	3
21365	99	78	71	cyclictest	0	-21	swapper/3	06:45:25	3
21365	99	74	73	cyclictest	6993	-21	fschecks_count	05:10:29	3
21365	99	74	73	cyclictest	17191	-21	runrttasks	05:33:40	3
21365	99	74	73	cyclictest	1306	-21	cpuspeed	08:40:21	3
21365	99	73	72	cyclictest	0	-21	swapper/3	09:15:27	3
21365	99	73	72	cyclictest	0	-21	swapper/3	09:10:18	3
21365	99	73	72	cyclictest	0	-21	swapper/3	08:00:22	3
21365	99	73	72	cyclictest	0	-21	swapper/3	07:46:34	3
21365	99	73	72	cyclictest	0	-21	swapper/3	07:20:24	3
21365	99	73	72	cyclictest	0	-21	swapper/3	07:10:21	3
21365	99	73	72	cyclictest	0	-21	swapper/3	06:35:23	3
21365	99	73	72	cyclictest	0	-21	swapper/3	06:30:22	3
21365	99	73	72	cyclictest	0	-21	swapper/3	05:40:25	3
21365	99	73	72	cyclictest	0	-21	swapper/3	05:00:33	3
21365	99	73	72	cyclictest	0	-21	swapper/3	04:55:23	3
21345	99	73	72	cyclictest	12	1	ksoftirqd/1	06:35:26	1
21345	99	73	72	cyclictest	0	-21	swapper/1	09:32:50	1
21345	99	73	72	cyclictest	0	-21	swapper/1	09:25:27	1
21345	99	73	72	cyclictest	0	-21	swapper/1	09:10:30	1
21345	99	73	72	cyclictest	0	-21	swapper/1	08:05:22	1
21345	99	73	72	cyclictest	0	-21	swapper/1	07:10:24	1
21345	99	73	72	cyclictest	0	-21	swapper/1	05:30:29	1
21345	99	73	72	cyclictest	0	-21	swapper/1	05:05:34	1
21345	99	73	72	cyclictest	0	-21	swapper/1	05:00:31	1
21345	99	73	72	cyclictest	0	-21	swapper/1	04:59:59	1
21345	99	73	72	cyclictest	0	-21	swapper/1	04:40:35	1
21345	99	72	71	cyclictest	408	-21	md1_raid1	06:40:51	1
21355	99	66	62	cyclictest	0	-21	swapper/2	09:22:59	2
21355	99	66	62	cyclictest	0	-21	swapper/2	09:22:59	2
21334	99	65	52	cyclictest	0	-21	swapper/0	08:55:36	0
21334	99	65	52	cyclictest	0	-21	swapper/0	08:54:03	0
21334	99	65	41	cyclictest	0	-21	swapper/0	08:28:57	0
21334	99	65	41	cyclictest	0	-21	swapper/0	08:19:33	0
21355	99	64	61	cyclictest	0	-21	swapper/2	08:46:28	2
21345	99	64	63	cyclictest	12	1	ksoftirqd/1	07:45:53	1
21334	99	64	51	cyclictest	0	-21	swapper/0	09:14:08	0
21334	99	64	41	cyclictest	0	-21	swapper/0	08:44:35	0
21365	99	63	62	cyclictest	0	-21	swapper/3	04:30:17	3
21355	99	63	62	cyclictest	0	-21	swapper/2	09:11:58	2
21355	99	63	62	cyclictest	0	-21	swapper/2	09:01:27	2
21355	99	63	62	cyclictest	0	-21	swapper/2	08:51:37	2
21355	99	63	62	cyclictest	0	-21	swapper/2	08:40:39	2
21355	99	63	62	cyclictest	0	-21	swapper/2	08:35:01	2
21355	99	63	62	cyclictest	0	-21	swapper/2	08:27:16	2
21355	99	63	62	cyclictest	0	-21	swapper/2	08:22:15	2
21355	99	63	62	cyclictest	0	-21	swapper/2	08:15:52	2
21355	99	63	62	cyclictest	0	-21	swapper/2	06:14:50	2
21345	99	63	62	cyclictest	0	-21	swapper/1	04:30:17	1
21334	99	63	62	cyclictest	0	-21	swapper/0	07:24:06	0
21334	99	63	41	cyclictest	0	-21	swapper/0	06:06:52	0
21355	99	62	61	cyclictest	0	-21	swapper/2	09:15:37	2
21355	99	62	61	cyclictest	0	-21	swapper/2	08:55:49	2
21355	99	62	61	cyclictest	0	-21	swapper/2	08:35:51	2
21355	99	62	61	cyclictest	0	-21	swapper/2	08:06:13	2
21355	99	62	61	cyclictest	0	-21	swapper/2	08:01:26	2
21355	99	62	61	cyclictest	0	-21	swapper/2	07:56:35	2
21355	99	62	61	cyclictest	0	-21	swapper/2	06:42:20	2
21355	99	62	51	cyclictest	0	-21	swapper/2	09:07:10	2
21334	99	62	61	cyclictest	0	-21	swapper/0	09:20:41	0
21334	99	62	61	cyclictest	0	-21	swapper/0	09:20:41	0
21334	99	62	61	cyclictest	0	-21	swapper/0	08:00:21	0
21334	99	62	61	cyclictest	0	-21	swapper/0	05:51:34	0
21334	99	62	52	cyclictest	0	-21	swapper/0	09:25:28	0
21334	99	62	51	cyclictest	0	-21	swapper/0	08:35:41	0
21334	99	62	41	cyclictest	0	-21	swapper/0	09:02:42	0
21334	99	62	41	cyclictest	0	-21	swapper/0	08:45:25	0
21334	99	62	41	cyclictest	0	-21	swapper/0	08:31:58	0
21334	99	62	41	cyclictest	0	-21	swapper/0	08:23:27	0
21334	99	62	41	cyclictest	0	-21	swapper/0	06:00:12	0
21334	99	62	41	cyclictest	0	-21	swapper/0	05:26:00	0
21355	99	61	60	cyclictest	0	-21	swapper/2	08:10:39	2
21355	99	61	60	cyclictest	0	-21	swapper/2	08:10:39	2
21355	99	61	60	cyclictest	0	-21	swapper/2	06:31:54	2
21355	99	61	60	cyclictest	0	-21	swapper/2	04:52:53	2
21355	99	61	60	cyclictest	0	-21	swapper/2	04:37:33	2
21355	99	61	60	cyclictest	0	-21	swapper/2	04:33:31	2
21355	99	61	51	cyclictest	0	-21	swapper/2	05:33:34	2
21334	99	61	60	cyclictest	0	-21	swapper/0	05:20:26	0
21334	99	61	60	cyclictest	0	-21	swapper/0	05:10:27	0
21334	99	61	41	cyclictest	0	-21	swapper/0	09:16:24	0
21334	99	61	41	cyclictest	0	-21	swapper/0	09:07:51	0
21355	99	60	59	cyclictest	0	-21	swapper/2	09:25:22	2
21355	99	60	59	cyclictest	0	-21	swapper/2	07:20:57	2
21355	99	60	59	cyclictest	0	-21	swapper/2	07:05:18	2
21355	99	60	59	cyclictest	0	-21	swapper/2	06:03:28	2
21355	99	60	59	cyclictest	0	-21	swapper/2	05:18:34	2
21355	99	60	59	cyclictest	0	-21	swapper/2	04:57:28	2
21355	99	60	59	cyclictest	0	-21	swapper/2	04:48:02	2
21355	99	60	59	cyclictest	0	-21	swapper/2	04:41:30	2
21334	99	60	59	cyclictest	0	-21	swapper/0	06:24:06	0
21334	99	60	59	cyclictest	0	-21	swapper/0	05:19:28	0
21355	99	59	58	cyclictest	0	-21	swapper/2	07:32:59	2
21355	99	59	58	cyclictest	0	-21	swapper/2	06:35:17	2
21355	99	59	58	cyclictest	0	-21	swapper/2	05:22:50	2
21334	99	59	58	cyclictest	0	-21	swapper/0	04:37:31	0
21334	99	59	52	cyclictest	0	-21	swapper/0	05:42:45	0
21355	99	58	57	cyclictest	0	-21	swapper/2	06:06:52	2
21355	99	58	57	cyclictest	0	-21	swapper/2	05:25:35	2
21355	99	58	47	cyclictest	0	-21	swapper/2	05:06:33	2
21334	99	58	57	cyclictest	0	-21	swapper/0	07:13:15	0
21334	99	58	31	cyclictest	0	-21	swapper/0	06:46:05	0
21355	99	57	56	cyclictest	0	-21	swapper/2	07:53:09	2
21355	99	57	56	cyclictest	0	-21	swapper/2	07:29:03	2
21355	99	57	56	cyclictest	0	-21	swapper/2	07:01:35	2
21355	99	57	56	cyclictest	0	-21	swapper/2	05:44:40	2
21334	99	57	56	cyclictest	0	-21	swapper/0	06:31:21	0
21334	99	57	56	cyclictest	0	-21	swapper/0	06:14:11	0
21334	99	57	56	cyclictest	0	-21	swapper/0	05:04:00	0
21334	99	57	41	cyclictest	0	-21	swapper/0	04:48:54	0
21355	99	56	55	cyclictest	0	-21	swapper/2	07:46:33	2
21355	99	56	55	cyclictest	0	-21	swapper/2	07:42:09	2
21355	99	56	55	cyclictest	0	-21	swapper/2	07:36:13	2
21355	99	56	55	cyclictest	0	-21	swapper/2	07:15:28	2
21355	99	56	55	cyclictest	0	-21	swapper/2	06:58:18	2
21355	99	56	55	cyclictest	0	-21	swapper/2	06:51:37	2
21355	99	56	55	cyclictest	0	-21	swapper/2	06:27:34	2
21355	99	56	55	cyclictest	0	-21	swapper/2	06:24:41	2
21355	99	56	55	cyclictest	0	-21	swapper/2	06:18:47	2
21355	99	56	55	cyclictest	0	-21	swapper/2	06:00:12	2
21355	99	56	55	cyclictest	0	-21	swapper/2	05:54:05	2
21355	99	56	55	cyclictest	0	-21	swapper/2	05:46:39	2
21355	99	56	55	cyclictest	0	-21	swapper/2	05:38:13	2
21355	99	56	55	cyclictest	0	-21	swapper/2	05:12:14	2
21355	99	56	55	cyclictest	0	-21	swapper/2	05:03:42	2
21334	99	56	55	cyclictest	0	-21	swapper/0	07:48:01	0
21334	99	56	55	cyclictest	0	-21	swapper/0	07:35:31	0
21334	99	56	55	cyclictest	0	-21	swapper/0	06:52:41	0
21334	99	56	55	cyclictest	0	-21	swapper/0	06:17:41	0
21334	99	56	52	cyclictest	0	-21	swapper/0	07:30:21	0
21334	99	56	52	cyclictest	0	-21	swapper/0	05:49:49	0
21334	99	56	52	cyclictest	0	-21	swapper/0	05:36:11	0
21334	99	56	52	cyclictest	0	-21	swapper/0	05:05:24	0
21334	99	56	41	cyclictest	0	-21	swapper/0	04:51:26	0
21334	99	55	54	cyclictest	0	-21	swapper/0	06:42:50	0
21334	99	55	54	cyclictest	0	-21	swapper/0	06:03:53	0
21334	99	55	52	cyclictest	0	-21	swapper/0	07:52:13	0
21334	99	55	52	cyclictest	0	-21	swapper/0	05:32:44	0
21334	99	55	52	cyclictest	0	-21	swapper/0	04:42:05	0
21334	99	55	43	cyclictest	0	-21	swapper/0	04:32:06	0
21355	99	54	51	cyclictest	0	-21	swapper/2	07:14:24	2
21355	99	54	51	cyclictest	0	-21	swapper/2	06:45:13	2
21334	99	54	53	cyclictest	0	-21	swapper/0	07:15:59	0
21334	99	54	53	cyclictest	0	-21	swapper/0	06:36:31	0
21334	99	54	53	cyclictest	0	-21	swapper/0	06:26:58	0
21334	99	54	52	cyclictest	0	-21	swapper/0	04:55:43	0
21334	99	54	42	cyclictest	0	-21	swapper/0	07:55:19	0
21334	99	54	42	cyclictest	0	-21	swapper/0	07:04:18	0
21334	99	54	41	cyclictest	0	-21	swapper/0	08:08:28	0
21355	99	53	52	cyclictest	50	50	irq/44-ahci	09:35:38	2
21355	99	53	51	cyclictest	27419	-21	telnet	09:40:15	2
21334	99	53	52	cyclictest	760	50	irq/18-parport0	09:56:14	0
21334	99	53	52	cyclictest	0	-21	swapper/0	09:35:30	0
21334	99	53	52	cyclictest	0	-21	swapper/0	09:31:01	0
21334	99	53	52	cyclictest	0	-21	swapper/0	08:10:11	0
21334	99	53	52	cyclictest	0	-21	swapper/0	08:10:11	0
21334	99	53	52	cyclictest	0	-21	swapper/0	07:41:01	0
21334	99	53	52	cyclictest	0	-21	swapper/0	07:25:12	0
21334	99	53	52	cyclictest	0	-21	swapper/0	07:05:37	0
21334	99	53	52	cyclictest	0	-21	swapper/0	06:55:20	0
21355	99	52	51	cyclictest	366	-21	missed_timers	09:50:21	2
21355	99	52	51	cyclictest	23091	-21	telnet	09:30:17	2
21355	99	52	51	cyclictest	0	-21	swapper/2	09:56:14	2
21355	99	52	51	cyclictest	0	-21	swapper/2	09:45:17	2
21334	99	52	51	cyclictest	760	50	irq/18-parport0	09:50:52	0
21334	99	52	51	cyclictest	0	-21	swapper/0	09:45:48	0
21334	99	52	51	cyclictest	0	-21	swapper/0	09:40:15	0
21355	99	36	20	cyclictest	21392	-21	latency_hist	04:30:17	2
21334	99	32	31	cyclictest	0	-21	swapper/0	04:30:17	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17