OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Tue Sep 08, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
22790	99	109	102	cyclictest	13384	-21	tune2fs	05:19:22	1
22790	99	106	102	cyclictest	19599	-21	fschecks_time	04:19:22	1
22790	99	104	102	cyclictest	3513	-21	tune2fs	08:39:13	1
22790	99	98	82	cyclictest	0	-21	swapper/1	04:39:20	1
22790	99	93	92	cyclictest	0	-21	swapper/1	03:43:50	1
22790	99	92	91	cyclictest	392	-21	md2_raid1	07:04:03	1
22790	99	89	82	cyclictest	25563	-21	aten2.4-expect	04:34:19	1
22790	99	89	82	cyclictest	25563	-21	aten2.4-expect	04:34:19	1
22790	99	89	82	cyclictest	18416	-21	tune2fs	07:59:15	1
22790	99	88	82	cyclictest	0	-21	swapper/1	05:34:21	1
22790	99	88	82	cyclictest	0	-21	swapper/1	04:44:25	1
22790	99	88	81	cyclictest	8402	-21	tune2fs	03:54:22	1
22790	99	88	72	cyclictest	0	-21	swapper/1	05:44:24	1
22790	99	88	72	cyclictest	0	-21	swapper/1	03:19:27	1
22790	99	88	72	cyclictest	0	-21	swapper/1	03:19:27	1
22790	99	87	82	cyclictest	408	-21	md1_raid1	07:44:20	1
22790	99	87	82	cyclictest	408	-21	md1_raid1	05:10:57	1
22790	99	87	82	cyclictest	408	-21	md1_raid1	04:59:26	1
22790	99	87	82	cyclictest	408	-21	md1_raid1	04:59:07	1
22790	99	87	82	cyclictest	0	-21	swapper/1	08:29:14	1
22790	99	87	82	cyclictest	0	-21	swapper/1	08:14:14	1
22790	99	87	82	cyclictest	0	-21	swapper/1	07:54:01	1
22790	99	87	82	cyclictest	0	-21	swapper/1	07:19:15	1
22790	99	87	82	cyclictest	0	-21	swapper/1	04:24:25	1
22790	99	87	82	cyclictest	0	-21	swapper/1	04:17:53	1
22790	99	87	82	cyclictest	0	-21	swapper/1	03:52:24	1
22790	99	87	82	cyclictest	0	-21	swapper/1	03:36:34	1
22790	99	87	72	cyclictest	0	-21	swapper/1	08:04:22	1
22790	99	87	72	cyclictest	0	-21	swapper/1	06:19:27	1
22790	99	86	82	cyclictest	0	-21	swapper/1	07:39:23	1
22790	99	86	82	cyclictest	0	-21	swapper/1	07:02:14	1
22790	99	86	82	cyclictest	0	-21	swapper/1	06:42:11	1
22790	99	86	82	cyclictest	0	-21	swapper/1	06:07:04	1
22790	99	86	82	cyclictest	0	-21	swapper/1	05:39:30	1
22790	99	86	82	cyclictest	0	-21	swapper/1	05:04:24	1
22790	99	86	82	cyclictest	0	-21	swapper/1	04:07:53	1
22790	99	86	82	cyclictest	0	-21	swapper/1	03:29:32	1
22790	99	86	82	cyclictest	0	-21	swapper/1	03:24:30	1
22790	99	86	74	cyclictest	0	-21	swapper/1	05:49:25	1
22811	99	84	82	cyclictest	29147	-21	fschecks_time	07:09:17	3
22811	99	84	72	cyclictest	0	-21	swapper/3	07:24:13	3
22811	99	84	72	cyclictest	0	-21	swapper/3	07:04:19	3
22811	99	83	82	cyclictest	0	-21	swapper/3	08:39:20	3
22811	99	83	82	cyclictest	0	-21	swapper/3	08:37:16	3
22811	99	83	82	cyclictest	0	-21	swapper/3	08:27:27	3
22811	99	83	82	cyclictest	0	-21	swapper/3	08:19:18	3
22811	99	83	82	cyclictest	0	-21	swapper/3	08:11:50	3
22811	99	83	82	cyclictest	0	-21	swapper/3	08:04:22	3
22811	99	83	82	cyclictest	0	-21	swapper/3	07:59:22	3
22811	99	83	82	cyclictest	0	-21	swapper/3	07:49:20	3
22811	99	83	82	cyclictest	0	-21	swapper/3	07:43:19	3
22811	99	83	82	cyclictest	0	-21	swapper/3	07:34:16	3
22811	99	83	82	cyclictest	0	-21	swapper/3	07:29:18	3
22811	99	83	82	cyclictest	0	-21	swapper/3	07:14:26	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:59:16	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:54:24	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:44:17	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:39:17	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:34:28	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:29:24	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:24:23	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:15:06	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:08:10	3
22811	99	83	82	cyclictest	0	-21	swapper/3	06:02:03	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:54:20	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:52:07	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:38:26	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:29:25	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:26:58	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:19:23	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:16:57	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:09:29	3
22811	99	83	82	cyclictest	0	-21	swapper/3	05:04:25	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:54:19	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:54:08	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:44:22	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:39:09	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:34:27	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:34:27	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:24:28	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:19:32	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:09:29	3
22811	99	83	82	cyclictest	0	-21	swapper/3	04:01:44	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:55:03	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:49:27	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:46:42	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:39:31	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:34:32	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:32:12	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:24:30	3
22811	99	83	82	cyclictest	0	-21	swapper/3	03:14:32	3
22811	99	83	72	cyclictest	0	-21	swapper/3	04:15:35	3
22811	99	83	71	cyclictest	0	-21	swapper/3	07:44:16	3
22790	99	83	82	cyclictest	0	-21	swapper/1	08:34:20	1
22790	99	83	82	cyclictest	0	-21	swapper/1	07:34:04	1
22790	99	83	82	cyclictest	0	-21	swapper/1	07:29:18	1
22790	99	83	82	cyclictest	0	-21	swapper/1	07:24:16	1
22790	99	83	82	cyclictest	0	-21	swapper/1	07:14:25	1
22790	99	83	82	cyclictest	0	-21	swapper/1	07:09:23	1
22790	99	83	82	cyclictest	0	-21	swapper/1	06:54:24	1
22790	99	83	82	cyclictest	0	-21	swapper/1	06:44:17	1
22790	99	83	82	cyclictest	0	-21	swapper/1	06:34:20	1
22790	99	83	82	cyclictest	0	-21	swapper/1	06:15:06	1
22790	99	83	82	cyclictest	0	-21	swapper/1	06:02:07	1
22790	99	83	82	cyclictest	0	-21	swapper/1	05:31:59	1
22790	99	83	82	cyclictest	0	-21	swapper/1	05:14:24	1
22790	99	83	82	cyclictest	0	-21	swapper/1	04:49:20	1
22790	99	83	82	cyclictest	0	-21	swapper/1	04:09:27	1
22790	99	83	82	cyclictest	0	-21	swapper/1	04:02:51	1
22790	99	83	82	cyclictest	0	-21	swapper/1	03:44:31	1
22790	99	83	82	cyclictest	0	-21	swapper/1	03:19:11	1
22790	99	83	81	cyclictest	15609	-21	tune2fs	05:24:22	1
22811	99	82	81	cyclictest	0	-21	swapper/3	07:54:14	3
22811	99	81	79	cyclictest	0	-21	swapper/3	08:29:14	3
22811	99	80	79	cyclictest	0	-21	swapper/3	06:09:19	3
22811	99	80	79	cyclictest	0	-21	swapper/3	04:59:12	3
22811	99	80	79	cyclictest	0	-21	swapper/3	04:30:22	3
22811	99	80	79	cyclictest	0	-21	swapper/3	04:05:31	3
22811	99	80	79	cyclictest	0	-21	swapper/3	03:23:58	3
22811	99	80	79	cyclictest	0	-21	swapper/3	03:23:58	3
22790	99	79	71	cyclictest	408	-21	md1_raid1	05:56:29	1
22790	99	77	72	cyclictest	408	-21	md1_raid1	08:10:53	1
22790	99	77	72	cyclictest	0	-21	swapper/1	08:27:18	1
22790	99	77	72	cyclictest	0	-21	swapper/1	06:30:55	1
22790	99	77	72	cyclictest	0	-21	swapper/1	06:27:08	1
22790	99	77	72	cyclictest	0	-21	swapper/1	04:33:48	1
22790	99	77	71	cyclictest	408	-21	md1_raid1	06:10:55	1
22790	99	74	72	cyclictest	0	-21	swapper/1	08:19:12	1
22811	99	73	72	cyclictest	0	-21	swapper/3	08:17:42	3
22811	99	73	72	cyclictest	0	-21	swapper/3	07:19:36	3
22811	99	73	72	cyclictest	0	-21	swapper/3	06:49:17	3
22811	99	73	72	cyclictest	0	-21	swapper/3	05:45:55	3
22811	99	73	72	cyclictest	0	-21	swapper/3	05:39:30	3
22790	99	73	72	cyclictest	0	-21	swapper/1	06:53:25	1
22811	99	72	71	cyclictest	0	-21	swapper/3	06:19:29	3
22790	99	72	71	cyclictest	408	-21	md1_raid1	07:54:14	1
22779	99	70	69	cyclictest	0	-21	swapper/0	06:44:50	0
22779	99	69	68	cyclictest	0	-21	swapper/0	07:51:39	0
22779	99	67	50	cyclictest	0	-21	swapper/0	03:19:33	0
22779	99	67	50	cyclictest	0	-21	swapper/0	03:19:33	0
22779	99	65	62	cyclictest	0	-21	swapper/0	06:38:12	0
22779	99	65	59	cyclictest	0	-21	swapper/0	05:34:46	0
22779	99	65	52	cyclictest	0	-21	swapper/0	07:45:37	0
22779	99	65	51	cyclictest	0	-21	swapper/0	07:26:42	0
22779	99	65	51	cyclictest	0	-21	swapper/0	07:21:57	0
22779	99	65	51	cyclictest	0	-21	swapper/0	05:11:07	0
22779	99	65	51	cyclictest	0	-21	swapper/0	04:44:50	0
22779	99	65	51	cyclictest	0	-21	swapper/0	04:39:39	0
22799	99	64	51	cyclictest	0	-21	swapper/2	05:50:54	2
22779	99	64	63	cyclictest	0	-21	swapper/0	06:49:49	0
22779	99	64	63	cyclictest	0	-21	swapper/0	06:03:39	0
22779	99	64	51	cyclictest	0	-21	swapper/0	05:03:24	0
22811	99	63	62	cyclictest	0	-21	swapper/3	03:14:12	3
22799	99	63	41	cyclictest	0	-21	swapper/2	05:08:37	2
22790	99	63	62	cyclictest	0	-21	swapper/1	03:14:12	1
22779	99	63	62	cyclictest	0	-21	swapper/0	08:43:06	0
22779	99	63	62	cyclictest	0	-21	swapper/0	08:15:26	0
22779	99	63	62	cyclictest	0	-21	swapper/0	08:06:19	0
22779	99	63	62	cyclictest	0	-21	swapper/0	08:01:46	0
22779	99	63	62	cyclictest	0	-21	swapper/0	07:54:08	0
22779	99	63	62	cyclictest	0	-21	swapper/0	07:17:51	0
22779	99	63	62	cyclictest	0	-21	swapper/0	07:07:03	0
22779	99	63	62	cyclictest	0	-21	swapper/0	06:59:37	0
22779	99	63	62	cyclictest	0	-21	swapper/0	06:18:43	0
22779	99	63	62	cyclictest	0	-21	swapper/0	06:10:22	0
22779	99	63	62	cyclictest	0	-21	swapper/0	06:07:01	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:56:13	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:50:48	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:48:05	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:40:04	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:29:56	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:25:17	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:16:00	0
22779	99	63	62	cyclictest	0	-21	swapper/0	05:06:14	0
22779	99	63	62	cyclictest	0	-21	swapper/0	04:49:16	0
22779	99	63	62	cyclictest	0	-21	swapper/0	03:45:07	0
22779	99	63	62	cyclictest	0	-21	swapper/0	03:31:45	0
22779	99	63	62	cyclictest	0	-21	swapper/0	03:16:22	0
22799	99	62	61	cyclictest	0	-21	swapper/2	06:54:35	2
22799	99	62	61	cyclictest	0	-21	swapper/2	03:29:40	2
22799	99	62	41	cyclictest	0	-21	swapper/2	08:04:07	2
22779	99	62	61	cyclictest	0	-21	swapper/0	08:37:34	0
22779	99	62	61	cyclictest	0	-21	swapper/0	08:29:34	0
22779	99	62	61	cyclictest	0	-21	swapper/0	08:26:43	0
22779	99	62	61	cyclictest	0	-21	swapper/0	08:20:35	0
22779	99	62	61	cyclictest	0	-21	swapper/0	07:35:29	0
22779	99	62	61	cyclictest	0	-21	swapper/0	07:09:50	0
22779	99	62	61	cyclictest	0	-21	swapper/0	06:43:19	0
22779	99	62	61	cyclictest	0	-21	swapper/0	06:27:35	0
22779	99	62	61	cyclictest	0	-21	swapper/0	06:20:59	0
22779	99	62	61	cyclictest	0	-21	swapper/0	05:22:49	0
22779	99	62	61	cyclictest	0	-21	swapper/0	04:54:59	0
22779	99	62	51	cyclictest	0	-21	swapper/0	03:27:22	0
22799	99	61	60	cyclictest	0	-21	swapper/2	06:53:25	2
22799	99	61	51	cyclictest	0	-21	swapper/2	07:00:01	2
22799	99	61	51	cyclictest	0	-21	swapper/2	06:00:33	2
22779	99	61	60	cyclictest	0	-21	swapper/0	08:11:32	0
22779	99	61	60	cyclictest	0	-21	swapper/0	07:31:37	0
22779	99	61	60	cyclictest	0	-21	swapper/0	06:56:20	0
22779	99	60	59	cyclictest	0	-21	swapper/0	06:31:35	0
22799	99	59	58	cyclictest	0	-21	swapper/2	07:33:28	2
22799	99	59	58	cyclictest	0	-21	swapper/2	06:26:11	2
22779	99	59	58	cyclictest	0	-21	swapper/0	07:42:15	0
22799	99	58	57	cyclictest	0	-21	swapper/2	07:10:29	2
22799	99	58	47	cyclictest	0	-21	swapper/2	06:06:27	2
22779	99	58	41	cyclictest	0	-21	swapper/0	03:39:24	0
22799	99	57	52	cyclictest	0	-21	swapper/2	07:44:41	2
22799	99	57	52	cyclictest	0	-21	swapper/2	05:37:39	2
22799	99	57	41	cyclictest	0	-21	swapper/2	07:05:49	2
22799	99	56	55	cyclictest	0	-21	swapper/2	07:34:15	2
22799	99	56	55	cyclictest	0	-21	swapper/2	07:16:11	2
22799	99	56	55	cyclictest	0	-21	swapper/2	06:39:36	2
22799	99	56	55	cyclictest	0	-21	swapper/2	05:48:39	2
22799	99	56	55	cyclictest	0	-21	swapper/2	05:20:30	2
22799	99	56	55	cyclictest	0	-21	swapper/2	05:15:46	2
22799	99	56	55	cyclictest	0	-21	swapper/2	04:59:29	2
22799	99	56	52	cyclictest	0	-21	swapper/2	08:18:52	2
22799	99	56	52	cyclictest	0	-21	swapper/2	08:10:34	2
22799	99	56	52	cyclictest	0	-21	swapper/2	07:51:13	2
22799	99	56	52	cyclictest	0	-21	swapper/2	06:44:39	2
22799	99	56	52	cyclictest	0	-21	swapper/2	06:20:59	2
22799	99	56	52	cyclictest	0	-21	swapper/2	05:57:38	2
22799	99	56	51	cyclictest	0	-21	swapper/2	04:16:13	2
22799	99	56	41	cyclictest	0	-21	swapper/2	07:56:45	2
22799	99	56	41	cyclictest	0	-21	swapper/2	07:21:31	2
22799	99	56	41	cyclictest	0	-21	swapper/2	06:35:24	2
22799	99	56	41	cyclictest	0	-21	swapper/2	06:15:39	2
22799	99	56	41	cyclictest	0	-21	swapper/2	05:41:05	2
22799	99	56	41	cyclictest	0	-21	swapper/2	05:31:13	2
22799	99	56	41	cyclictest	0	-21	swapper/2	04:46:08	2
22799	99	56	41	cyclictest	0	-21	swapper/2	04:28:36	2
22799	99	56	41	cyclictest	0	-21	swapper/2	03:26:31	2
22799	99	56	41	cyclictest	0	-21	swapper/2	03:16:16	2
22799	99	55	54	cyclictest	0	-21	swapper/2	06:29:40	2
22799	99	55	54	cyclictest	0	-21	swapper/2	06:09:33	2
22799	99	55	54	cyclictest	0	-21	swapper/2	04:42:49	2
22799	99	55	52	cyclictest	0	-21	swapper/2	08:20:37	2
22799	99	55	52	cyclictest	0	-21	swapper/2	03:43:20	2
22799	99	55	51	cyclictest	0	-21	swapper/2	08:39:15	2
22799	99	55	51	cyclictest	0	-21	swapper/2	08:34:09	2
22799	99	55	51	cyclictest	0	-21	swapper/2	08:25:29	2
22799	99	55	51	cyclictest	0	-21	swapper/2	07:59:56	2
22799	99	55	51	cyclictest	0	-21	swapper/2	07:40:57	2
22799	99	55	51	cyclictest	0	-21	swapper/2	07:25:38	2
22799	99	55	41	cyclictest	0	-21	swapper/2	08:29:29	2
22799	99	55	41	cyclictest	0	-21	swapper/2	05:24:21	2
22799	99	55	41	cyclictest	0	-21	swapper/2	03:47:44	2
22799	99	55	41	cyclictest	0	-21	swapper/2	03:37:22	2
22799	99	54	53	cyclictest	0	-21	swapper/2	05:10:29	2
22799	99	54	52	cyclictest	50	50	irq/44-ahci	04:03:16	2
22799	99	54	52	cyclictest	0	-21	swapper/2	03:55:25	2
22779	99	54	53	cyclictest	760	50	irq/18-parport0	04:34:14	0
22779	99	54	53	cyclictest	760	50	irq/18-parport0	04:34:14	0
22779	99	54	53	cyclictest	760	50	irq/18-parport0	04:21:22	0
22779	99	54	53	cyclictest	760	50	irq/18-parport0	04:16:47	0
22779	99	54	53	cyclictest	3	1	ksoftirqd/0	04:33:09	0
22779	99	54	52	cyclictest	0	-21	swapper/0	04:25:26	0
22799	99	53	52	cyclictest	0	-21	swapper/2	04:54:11	2
22799	99	53	52	cyclictest	0	-21	swapper/2	04:49:23	2
22799	99	53	52	cyclictest	0	-21	swapper/2	04:34:19	2
22799	99	53	52	cyclictest	0	-21	swapper/2	04:34:19	2
22799	99	53	52	cyclictest	0	-21	swapper/2	04:29:50	2
22799	99	53	52	cyclictest	0	-21	swapper/2	04:19:20	2
22799	99	53	52	cyclictest	0	-21	swapper/2	04:09:21	2
22799	99	53	52	cyclictest	0	-21	swapper/2	04:07:01	2
22799	99	53	52	cyclictest	0	-21	swapper/2	03:19:21	2
22799	99	53	52	cyclictest	0	-21	swapper/2	03:19:21	2
22799	99	53	41	cyclictest	0	-21	swapper/2	03:49:25	2
22779	99	53	52	cyclictest	0	-21	swapper/0	04:04:12	0
22779	99	53	52	cyclictest	0	-21	swapper/0	03:54:34	0
22779	99	53	51	cyclictest	10267	-21	telnet	03:59:22	0
22779	99	53	41	cyclictest	50	50	irq/44-ahci	03:50:32	0
22779	99	53	41	cyclictest	50	50	irq/44-ahci	03:34:37	0
22779	99	53	41	cyclictest	0	-21	swapper/0	04:11:27	0
22799	99	42	41	cyclictest	0	-21	swapper/2	03:14:11	2
22779	99	42	41	cyclictest	0	-21	swapper/0	03:14:11	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17