OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Tue Aug 11, 2026 12:43:28)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
15075	99	107	102	cyclictest	0	-21	swapper/1	03:44:45	1
15077	99	94	92	cyclictest	0	-21	swapper/3	07:54:42	3
15077	99	93	92	cyclictest	0	-21	swapper/3	07:17:09	3
15077	99	93	92	cyclictest	0	-21	swapper/3	07:17:09	3
15077	99	93	92	cyclictest	0	-21	swapper/3	07:04:33	3
15077	99	93	92	cyclictest	0	-21	swapper/3	06:59:43	3
15077	99	93	92	cyclictest	0	-21	swapper/3	06:19:28	3
15077	99	93	92	cyclictest	0	-21	swapper/3	05:19:52	3
15077	99	93	92	cyclictest	0	-21	swapper/3	04:49:48	3
15077	99	93	92	cyclictest	0	-21	swapper/3	04:28:03	3
15077	99	93	92	cyclictest	0	-21	swapper/3	04:04:53	3
15075	99	93	92	cyclictest	0	-21	swapper/1	08:55:55	1
15075	99	93	92	cyclictest	0	-21	swapper/1	07:29:40	1
15075	99	93	92	cyclictest	0	-21	swapper/1	07:29:40	1
15075	99	91	90	cyclictest	0	-21	swapper/1	08:48:43	1
15075	99	90	89	cyclictest	0	-21	swapper/1	09:05:38	1
15077	99	89	72	cyclictest	0	-21	swapper/3	08:34:40	3
15077	99	89	72	cyclictest	0	-21	swapper/3	05:29:29	3
15077	99	88	72	cyclictest	0	-21	swapper/3	08:44:37	3
15077	99	88	72	cyclictest	0	-21	swapper/3	08:14:48	3
15077	99	88	72	cyclictest	0	-21	swapper/3	08:09:25	3
15077	99	88	72	cyclictest	0	-21	swapper/3	07:10:16	3
15077	99	88	72	cyclictest	0	-21	swapper/3	06:28:28	3
15077	99	88	72	cyclictest	0	-21	swapper/3	05:13:31	3
15077	99	88	72	cyclictest	0	-21	swapper/3	04:14:56	3
15077	99	87	82	cyclictest	0	-21	swapper/3	06:49:39	3
15077	99	87	72	cyclictest	0	-21	swapper/3	08:59:37	3
15077	99	87	72	cyclictest	0	-21	swapper/3	05:49:42	3
15077	99	87	72	cyclictest	0	-21	swapper/3	05:14:50	3
15077	99	87	72	cyclictest	0	-21	swapper/3	04:20:12	3
15077	99	87	72	cyclictest	0	-21	swapper/3	03:50:17	3
15077	99	86	82	cyclictest	0	-21	swapper/3	06:34:42	3
15077	99	86	82	cyclictest	0	-21	swapper/3	04:35:11	3
15077	99	86	81	cyclictest	0	-21	swapper/3	08:49:35	3
15077	99	86	81	cyclictest	0	-21	swapper/3	07:24:40	3
15077	99	86	81	cyclictest	0	-21	swapper/3	06:09:40	3
15077	99	86	81	cyclictest	0	-21	swapper/3	04:29:46	3
15077	99	86	74	cyclictest	19086	-21	fschecks_time	07:29:40	3
15077	99	86	74	cyclictest	19086	-21	fschecks_time	07:29:40	3
15077	99	86	71	cyclictest	0	-21	swapper/3	03:39:53	3
15075	99	86	81	cyclictest	12923	-21	tune2fs	08:29:38	1
15077	99	85	82	cyclictest	0	-21	swapper/3	03:59:40	3
15077	99	84	83	cyclictest	3763	-21	md1_resync	05:59:45	3
15077	99	84	83	cyclictest	3763	-21	md1_resync	05:41:38	3
15077	99	84	82	cyclictest	0	-21	swapper/3	05:55:25	3
15077	99	84	72	cyclictest	4184	-21	latency	06:54:44	3
15075	99	84	82	cyclictest	19969	-21	tune2fs	03:49:47	1
15075	99	84	82	cyclictest	16786	-21	tune2fs	07:24:40	1
15075	99	84	82	cyclictest	0	-21	swapper/1	07:39:44	1
15075	99	84	82	cyclictest	0	-21	swapper/1	04:54:57	1
15075	99	84	81	cyclictest	9693	-21	gltestperf	04:39:46	1
15075	99	84	72	cyclictest	0	-21	swapper/1	05:49:40	1
15077	99	83	82	cyclictest	0	-21	swapper/3	08:58:01	3
15077	99	83	82	cyclictest	0	-21	swapper/3	08:39:34	3
15077	99	83	82	cyclictest	0	-21	swapper/3	08:29:38	3
15077	99	83	82	cyclictest	0	-21	swapper/3	08:26:56	3
15077	99	83	82	cyclictest	0	-21	swapper/3	08:21:50	3
15077	99	83	82	cyclictest	0	-21	swapper/3	08:04:40	3
15077	99	83	82	cyclictest	0	-21	swapper/3	08:04:40	3
15077	99	83	82	cyclictest	0	-21	swapper/3	07:59:35	3
15077	99	83	82	cyclictest	0	-21	swapper/3	07:49:36	3
15077	99	83	82	cyclictest	0	-21	swapper/3	07:44:38	3
15077	99	83	82	cyclictest	0	-21	swapper/3	07:39:44	3
15077	99	83	82	cyclictest	0	-21	swapper/3	07:34:39	3
15077	99	83	82	cyclictest	0	-21	swapper/3	07:19:38	3
15077	99	83	82	cyclictest	0	-21	swapper/3	06:44:43	3
15077	99	83	82	cyclictest	0	-21	swapper/3	06:39:42	3
15077	99	83	82	cyclictest	0	-21	swapper/3	06:29:45	3
15077	99	83	82	cyclictest	0	-21	swapper/3	06:14:40	3
15077	99	83	82	cyclictest	0	-21	swapper/3	06:04:42	3
15077	99	83	82	cyclictest	0	-21	swapper/3	05:44:42	3
15077	99	83	82	cyclictest	0	-21	swapper/3	05:34:48	3
15077	99	83	82	cyclictest	0	-21	swapper/3	05:29:44	3
15077	99	83	82	cyclictest	0	-21	swapper/3	05:04:41	3
15077	99	83	82	cyclictest	0	-21	swapper/3	04:59:43	3
15077	99	83	82	cyclictest	0	-21	swapper/3	04:54:45	3
15077	99	83	82	cyclictest	0	-21	swapper/3	04:39:31	3
15077	99	83	82	cyclictest	0	-21	swapper/3	04:09:50	3
15077	99	83	82	cyclictest	0	-21	swapper/3	03:44:46	3
15075	99	83	82	cyclictest	408	-21	md1_raid1	06:59:47	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:59:37	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:49:44	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:39:34	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:34:38	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:24:42	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:19:35	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:14:48	1
15075	99	83	82	cyclictest	0	-21	swapper/1	08:09:25	1
15075	99	83	82	cyclictest	0	-21	swapper/1	07:59:35	1
15075	99	83	82	cyclictest	0	-21	swapper/1	07:49:38	1
15075	99	83	82	cyclictest	0	-21	swapper/1	07:19:47	1
15075	99	83	82	cyclictest	0	-21	swapper/1	07:14:44	1
15075	99	83	82	cyclictest	0	-21	swapper/1	07:14:44	1
15075	99	83	82	cyclictest	0	-21	swapper/1	07:09:39	1
15075	99	83	82	cyclictest	0	-21	swapper/1	07:04:47	1
15075	99	83	82	cyclictest	0	-21	swapper/1	06:59:05	1
15075	99	83	82	cyclictest	0	-21	swapper/1	06:49:38	1
15075	99	83	82	cyclictest	0	-21	swapper/1	06:39:40	1
15075	99	83	82	cyclictest	0	-21	swapper/1	06:35:09	1
15075	99	83	82	cyclictest	0	-21	swapper/1	06:28:28	1
15075	99	83	82	cyclictest	0	-21	swapper/1	06:19:28	1
15075	99	83	82	cyclictest	0	-21	swapper/1	06:14:48	1
15075	99	83	82	cyclictest	0	-21	swapper/1	05:34:46	1
15075	99	83	82	cyclictest	0	-21	swapper/1	05:24:44	1
15075	99	83	82	cyclictest	0	-21	swapper/1	05:19:55	1
15075	99	83	82	cyclictest	0	-21	swapper/1	05:09:46	1
15075	99	83	82	cyclictest	0	-21	swapper/1	05:04:44	1
15075	99	83	82	cyclictest	0	-21	swapper/1	04:49:44	1
15075	99	83	82	cyclictest	0	-21	swapper/1	04:24:48	1
15075	99	83	82	cyclictest	0	-21	swapper/1	04:19:47	1
15075	99	83	82	cyclictest	0	-21	swapper/1	03:59:48	1
15075	99	83	82	cyclictest	0	-21	swapper/1	03:39:53	1
15075	99	83	81	cyclictest	5238	-21	tune2fs	04:29:46	1
15075	99	83	81	cyclictest	24851	-21	tune2fs	05:14:43	1
15075	99	83	81	cyclictest	18335	-21	tune2fs	04:59:45	1
15075	99	83	81	cyclictest	16468	-21	tune2fs	06:09:40	1
15075	99	83	81	cyclictest	14229	-21	tune2fs	06:04:45	1
15075	99	82	81	cyclictest	408	-21	md1_raid1	07:44:47	1
15075	99	82	81	cyclictest	408	-21	md1_raid1	05:54:42	1
15075	99	82	81	cyclictest	408	-21	md1_raid1	04:35:17	1
15075	99	82	81	cyclictest	408	-21	md1_raid1	04:14:46	1
15075	99	82	81	cyclictest	31224	-21	tune2fs	05:29:44	1
15077	99	80	79	cyclictest	11937	-21	hddtemp_smartct	04:44:46	3
15077	99	78	73	cyclictest	0	-21	swapper/3	09:04:52	3
15077	99	77	72	cyclictest	0	-21	swapper/3	03:54:54	3
15077	99	77	72	cyclictest	0	-21	swapper/3	03:54:54	3
15075	99	74	73	cyclictest	408	-21	md1_raid1	04:04:52	1
15075	99	74	73	cyclictest	12	1	ksoftirqd/1	04:12:56	1
15076	99	73	72	cyclictest	0	-21	swapper/2	07:13:05	2
15075	99	73	72	cyclictest	12	1	ksoftirqd/1	03:57:17	1
15075	99	73	72	cyclictest	12	1	ksoftirqd/1	03:57:17	1
15075	99	73	72	cyclictest	0	-21	swapper/1	08:04:40	1
15075	99	73	72	cyclictest	0	-21	swapper/1	08:04:40	1
15075	99	73	72	cyclictest	0	-21	swapper/1	07:54:36	1
15075	99	73	72	cyclictest	0	-21	swapper/1	07:34:47	1
15075	99	73	72	cyclictest	0	-21	swapper/1	06:48:26	1
15075	99	73	72	cyclictest	0	-21	swapper/1	06:31:47	1
15075	99	73	72	cyclictest	0	-21	swapper/1	05:59:45	1
15075	99	73	72	cyclictest	0	-21	swapper/1	05:44:43	1
15075	99	73	72	cyclictest	0	-21	swapper/1	05:39:43	1
15075	99	73	72	cyclictest	0	-21	swapper/1	04:44:45	1
15076	99	66	65	cyclictest	0	-21	swapper/2	03:55:09	2
15076	99	66	65	cyclictest	0	-21	swapper/2	03:55:09	2
15076	99	65	51	cyclictest	0	-21	swapper/2	04:31:42	2
15076	99	65	41	cyclictest	0	-21	swapper/2	07:45:56	2
15076	99	64	63	cyclictest	0	-21	swapper/2	07:30:23	2
15076	99	64	63	cyclictest	0	-21	swapper/2	07:30:23	2
15076	99	64	63	cyclictest	0	-21	swapper/2	05:17:52	2
15076	99	64	51	cyclictest	0	-21	swapper/2	08:10:25	2
15076	99	64	51	cyclictest	0	-21	swapper/2	08:09:00	2
15076	99	64	51	cyclictest	0	-21	swapper/2	08:09:00	2
15076	99	64	51	cyclictest	0	-21	swapper/2	07:54:17	2
15076	99	64	51	cyclictest	0	-21	swapper/2	04:23:52	2
15076	99	63	62	cyclictest	0	-21	swapper/2	08:15:41	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:59:26	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:54:52	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:40:16	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:36:33	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:24:59	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:19:59	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:17:21	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:17:21	2
15076	99	63	62	cyclictest	0	-21	swapper/2	07:06:08	2
15076	99	63	62	cyclictest	0	-21	swapper/2	06:51:28	2
15076	99	63	62	cyclictest	0	-21	swapper/2	06:47:11	2
15076	99	63	62	cyclictest	0	-21	swapper/2	06:43:49	2
15076	99	63	62	cyclictest	0	-21	swapper/2	06:35:26	2
15076	99	63	62	cyclictest	0	-21	swapper/2	05:30:33	2
15076	99	63	62	cyclictest	0	-21	swapper/2	05:19:37	2
15076	99	63	62	cyclictest	0	-21	swapper/2	05:00:56	2
15076	99	63	62	cyclictest	0	-21	swapper/2	04:47:50	2
15076	99	63	62	cyclictest	0	-21	swapper/2	04:27:09	2
15076	99	63	62	cyclictest	0	-21	swapper/2	04:15:38	2
15076	99	63	62	cyclictest	0	-21	swapper/2	04:11:21	2
15076	99	63	62	cyclictest	0	-21	swapper/2	04:08:22	2
15076	99	63	62	cyclictest	0	-21	swapper/2	04:00:58	2
15076	99	63	62	cyclictest	0	-21	swapper/2	03:46:00	2
15076	99	63	62	cyclictest	0	-21	swapper/2	03:43:02	2
15076	99	63	51	cyclictest	0	-21	swapper/2	04:52:22	2
15076	99	63	51	cyclictest	0	-21	swapper/2	04:37:07	2
15076	99	62	61	cyclictest	0	-21	swapper/2	07:03:23	2
15076	99	62	61	cyclictest	0	-21	swapper/2	06:58:52	2
15076	99	62	61	cyclictest	0	-21	swapper/2	06:29:22	2
15076	99	62	61	cyclictest	0	-21	swapper/2	06:21:45	2
15076	99	62	61	cyclictest	0	-21	swapper/2	06:17:00	2
15076	99	62	61	cyclictest	0	-21	swapper/2	04:40:32	2
15076	99	62	61	cyclictest	0	-21	swapper/2	03:49:41	2
15070	99	62	61	cyclictest	0	-21	swapper/0	07:46:23	0
15070	99	62	61	cyclictest	0	-21	swapper/0	07:04:00	0
15076	99	61	60	cyclictest	0	-21	swapper/2	06:09:35	2
15076	99	61	60	cyclictest	0	-21	swapper/2	05:56:12	2
15076	99	61	60	cyclictest	0	-21	swapper/2	05:26:45	2
15070	99	61	60	cyclictest	0	-21	swapper/0	07:58:58	0
15076	99	60	59	cyclictest	0	-21	swapper/2	06:33:06	2
15076	99	60	59	cyclictest	0	-21	swapper/2	05:37:13	2
15076	99	60	59	cyclictest	0	-21	swapper/2	05:05:54	2
15070	99	60	42	cyclictest	0	-21	swapper/0	04:00:10	0
15076	99	59	58	cyclictest	0	-21	swapper/2	05:11:39	2
15070	99	59	58	cyclictest	0	-21	swapper/0	08:01:46	0
15070	99	59	55	cyclictest	760	50	irq/18-parport0	08:09:25	0
15070	99	59	53	cyclictest	0	-21	swapper/0	07:42:54	0
15070	99	59	41	cyclictest	0	-21	swapper/0	05:47:52	0
15076	99	58	57	cyclictest	0	-21	swapper/2	05:51:21	2
15070	99	58	57	cyclictest	0	-21	swapper/0	08:14:35	0
15070	99	58	57	cyclictest	0	-21	swapper/0	07:50:21	0
15070	99	58	57	cyclictest	0	-21	swapper/0	07:32:48	0
15070	99	58	57	cyclictest	0	-21	swapper/0	07:32:48	0
15070	99	58	50	cyclictest	0	-21	swapper/0	07:18:30	0
15070	99	58	50	cyclictest	0	-21	swapper/0	07:18:30	0
15070	99	58	46	cyclictest	0	-21	swapper/0	08:04:27	0
15070	99	58	46	cyclictest	0	-21	swapper/0	08:04:27	0
15076	99	57	56	cyclictest	0	-21	swapper/2	06:02:25	2
15070	99	57	52	cyclictest	0	-21	swapper/0	04:10:57	0
15070	99	57	52	cyclictest	0	-21	swapper/0	03:56:10	0
15070	99	57	52	cyclictest	0	-21	swapper/0	03:56:10	0
15070	99	57	50	cyclictest	0	-21	swapper/0	04:18:09	0
15070	99	57	49	cyclictest	0	-21	swapper/0	08:54:27	0
15070	99	57	41	cyclictest	0	-21	swapper/0	04:07:32	0
15070	99	56	55	cyclictest	0	-21	swapper/0	07:35:44	0
15070	99	56	55	cyclictest	0	-21	swapper/0	06:52:18	0
15070	99	56	55	cyclictest	0	-21	swapper/0	05:59:45	0
15070	99	56	55	cyclictest	0	-21	swapper/0	05:20:10	0
15070	99	56	55	cyclictest	0	-21	swapper/0	05:09:24	0
15070	99	56	55	cyclictest	0	-21	swapper/0	04:41:36	0
15070	99	56	52	cyclictest	0	-21	swapper/0	04:29:33	0
15070	99	56	52	cyclictest	0	-21	swapper/0	03:45:00	0
15070	99	56	51	cyclictest	0	-21	swapper/0	05:52:24	0
15070	99	56	51	cyclictest	0	-21	swapper/0	05:00:35	0
15070	99	56	51	cyclictest	0	-21	swapper/0	04:47:32	0
15070	99	56	51	cyclictest	0	-21	swapper/0	04:25:58	0
15070	99	56	44	cyclictest	0	-21	swapper/0	03:51:48	0
15070	99	56	41	cyclictest	0	-21	swapper/0	05:31:22	0
15070	99	56	41	cyclictest	0	-21	swapper/0	05:17:42	0
15070	99	56	41	cyclictest	0	-21	swapper/0	04:56:28	0
15076	99	55	54	cyclictest	21921	-21	munin-node	08:49:38	2
15076	99	55	54	cyclictest	14585	-21	munin-node	06:04:47	2
15076	99	55	54	cyclictest	0	-21	swapper/2	08:41:25	2
15076	99	55	51	cyclictest	0	-21	swapper/2	08:31:45	2
15076	99	55	51	cyclictest	0	-21	swapper/2	05:48:19	2
15076	99	55	51	cyclictest	0	-21	swapper/2	05:39:38	2
15070	99	55	54	cyclictest	0	-21	swapper/0	07:27:04	0
15070	99	55	54	cyclictest	0	-21	swapper/0	06:21:39	0
15070	99	55	51	cyclictest	0	-21	swapper/0	05:38:54	0
15070	99	55	50	cyclictest	0	-21	swapper/0	07:20:34	0
15076	99	54	53	cyclictest	18	1	ksoftirqd/2	09:01:57	2
15076	99	54	53	cyclictest	16449	-21	sshd	08:39:08	2
15076	99	54	52	cyclictest	0	-21	swapper/2	04:55:44	2
15076	99	54	51	cyclictest	50	50	irq/44-ahci	09:05:12	2
15070	99	54	53	cyclictest	0	-21	swapper/0	06:38:23	0
15070	99	54	53	cyclictest	0	-21	swapper/0	05:43:00	0
15070	99	54	53	cyclictest	0	-21	swapper/0	04:51:20	0
15070	99	54	53	cyclictest	0	-21	swapper/0	04:21:38	0
15070	99	54	52	cyclictest	0	-21	swapper/0	05:11:26	0
15070	99	54	52	cyclictest	0	-21	swapper/0	04:36:22	0
15070	99	54	52	cyclictest	0	-21	swapper/0	03:40:46	0
15070	99	54	51	cyclictest	0	-21	swapper/0	07:08:34	0
15070	99	54	41	cyclictest	0	-21	swapper/0	06:24:47	0
15070	99	54	41	cyclictest	0	-21	swapper/0	05:27:37	0
15076	99	53	41	cyclictest	0	-21	swapper/2	08:54:43	2
15076	99	53	41	cyclictest	0	-21	swapper/2	08:44:52	2
15076	99	53	41	cyclictest	0	-21	swapper/2	08:19:33	2
15070	99	53	52	cyclictest	0	-21	swapper/0	08:49:38	0
15070	99	53	52	cyclictest	0	-21	swapper/0	07:09:33	0
15070	99	53	52	cyclictest	0	-21	swapper/0	06:54:36	0
15070	99	53	52	cyclictest	0	-21	swapper/0	06:44:51	0
15070	99	53	52	cyclictest	0	-21	swapper/0	06:39:43	0
15070	99	53	52	cyclictest	0	-21	swapper/0	06:29:44	0
15070	99	53	52	cyclictest	0	-21	swapper/0	06:14:46	0
15070	99	53	52	cyclictest	0	-21	swapper/0	06:09:37	0
15070	99	53	52	cyclictest	0	-21	swapper/0	06:05:35	0
15070	99	53	52	cyclictest	0	-21	swapper/0	05:54:37	0
15070	99	53	51	cyclictest	1876	-21	hald-addon-stor	08:30:02	0
15076	99	52	51	cyclictest	10088	-21	telnet	08:24:36	2
15070	99	52	51	cyclictest	0	-21	swapper/0	09:05:17	0
15070	99	52	51	cyclictest	0	-21	swapper/0	08:42:33	0
15070	99	52	51	cyclictest	0	-21	swapper/0	08:34:37	0
15070	99	52	51	cyclictest	0	-21	swapper/0	08:27:18	0
15070	99	52	51	cyclictest	0	-21	swapper/0	08:22:49	0
15070	99	51	50	cyclictest	0	-21	swapper/0	09:02:28	0
15070	99	48	47	cyclictest	0	-21	swapper/0	08:49:07	0
8	99	16	0	watchdog/0	14522	-40	yum-updatesd-he	03:35:20	0
50	50	12	0	irq/44-ahci	12893	-21	munin-node	03:34:52	2
23	1	12	0	ksoftirqd/3	3763	-21	md1_resync	03:35:38	3
10	99	12	0	migration/1	14645	-21	taskset	03:36:31	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17