OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Tue May 26, 2026 12:43:28)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3183	99	108	92	cyclictest	0	-21	swapper/3	05:59:15	3
3183	99	108	92	cyclictest	0	-21	swapper/3	05:59:15	3
3183	99	108	102	cyclictest	0	-21	swapper/3	10:04:17	3
3183	99	108	102	cyclictest	0	-21	swapper/3	07:24:25	3
3181	99	105	93	cyclictest	7506	-21	tune2fs	09:54:20	1
3181	99	104	102	cyclictest	15694	-21	tune2fs	08:59:22	1
3183	99	103	102	cyclictest	0	-21	swapper/3	09:14:25	3
3183	99	103	102	cyclictest	0	-21	swapper/3	08:39:28	3
3183	99	103	102	cyclictest	0	-21	swapper/3	06:41:48	3
3181	99	103	102	cyclictest	22395	-21	tune2fs	09:14:21	1
3181	99	94	93	cyclictest	0	-21	swapper/1	07:39:24	1
3181	99	94	92	cyclictest	17908	-21	tune2fs	09:04:21	1
3183	99	93	92	cyclictest	0	-21	swapper/3	09:54:29	3
3183	99	93	92	cyclictest	0	-21	swapper/3	07:04:27	3
3181	99	93	92	cyclictest	0	-21	swapper/1	06:09:35	1
3181	99	93	92	cyclictest	0	-21	swapper/1	05:54:15	1
3181	99	93	92	cyclictest	0	-21	swapper/1	05:43:39	1
3183	99	90	72	cyclictest	0	-21	swapper/3	06:14:33	3
3181	99	90	88	cyclictest	11081	-21	tune2fs	07:34:25	1
3183	99	89	82	cyclictest	3870	-21	runrttasks	08:30:31	3
3181	99	89	83	cyclictest	0	-21	swapper/1	07:04:14	1
3183	99	88	83	cyclictest	0	-21	swapper/3	09:24:39	3
3183	99	88	82	cyclictest	0	-21	swapper/3	08:54:32	3
3183	99	88	82	cyclictest	0	-21	swapper/3	07:29:24	3
3183	99	88	82	cyclictest	0	-21	swapper/3	07:19:25	3
3183	99	88	82	cyclictest	0	-21	swapper/3	07:14:13	3
3183	99	88	82	cyclictest	0	-21	swapper/3	06:14:15	3
3183	99	88	82	cyclictest	0	-21	swapper/3	05:44:16	3
3183	99	88	71	cyclictest	0	-21	swapper/3	06:49:36	3
3183	99	88	71	cyclictest	0	-21	swapper/3	05:59:33	3
3183	99	87	82	cyclictest	0	-21	swapper/3	10:14:26	3
3183	99	87	82	cyclictest	0	-21	swapper/3	10:09:17	3
3183	99	87	82	cyclictest	0	-21	swapper/3	09:04:21	3
3183	99	87	82	cyclictest	0	-21	swapper/3	08:49:29	3
3183	99	87	82	cyclictest	0	-21	swapper/3	08:24:10	3
3183	99	87	82	cyclictest	0	-21	swapper/3	07:54:33	3
3183	99	87	82	cyclictest	0	-21	swapper/3	07:49:24	3
3183	99	87	82	cyclictest	0	-21	swapper/3	07:49:24	3
3183	99	87	82	cyclictest	0	-21	swapper/3	06:44:27	3
3183	99	87	82	cyclictest	0	-21	swapper/3	05:24:38	3
3183	99	86	82	cyclictest	0	-21	swapper/3	05:49:38	3
3183	99	86	81	cyclictest	0	-21	swapper/3	08:59:22	3
3181	99	85	83	cyclictest	14102	-21	taskset	06:26:55	1
3181	99	85	83	cyclictest	0	-21	swapper/1	05:24:29	1
3181	99	85	72	cyclictest	0	-21	swapper/1	05:45:37	1
3181	99	84	83	cyclictest	12	1	ksoftirqd/1	04:49:30	1
3181	99	84	83	cyclictest	0	-21	swapper/1	10:09:20	1
3181	99	84	83	cyclictest	0	-21	swapper/1	09:44:30	1
3181	99	84	83	cyclictest	0	-21	swapper/1	09:34:18	1
3181	99	84	83	cyclictest	0	-21	swapper/1	08:52:12	1
3181	99	84	83	cyclictest	0	-21	swapper/1	08:44:22	1
3181	99	84	83	cyclictest	0	-21	swapper/1	08:39:23	1
3181	99	84	83	cyclictest	0	-21	swapper/1	08:37:10	1
3181	99	84	83	cyclictest	0	-21	swapper/1	08:24:28	1
3181	99	84	83	cyclictest	0	-21	swapper/1	08:21:53	1
3181	99	84	83	cyclictest	0	-21	swapper/1	08:14:29	1
3181	99	84	83	cyclictest	0	-21	swapper/1	07:59:22	1
3181	99	84	83	cyclictest	0	-21	swapper/1	07:52:54	1
3181	99	84	83	cyclictest	0	-21	swapper/1	07:52:54	1
3181	99	84	83	cyclictest	0	-21	swapper/1	07:09:31	1
3181	99	84	83	cyclictest	0	-21	swapper/1	06:59:28	1
3181	99	84	83	cyclictest	0	-21	swapper/1	06:49:32	1
3181	99	84	83	cyclictest	0	-21	swapper/1	06:48:39	1
3181	99	84	83	cyclictest	0	-21	swapper/1	06:41:48	1
3181	99	84	83	cyclictest	0	-21	swapper/1	06:29:27	1
3181	99	84	83	cyclictest	0	-21	swapper/1	06:14:38	1
3181	99	84	83	cyclictest	0	-21	swapper/1	05:59:25	1
3181	99	84	83	cyclictest	0	-21	swapper/1	05:54:28	1
3181	99	84	83	cyclictest	0	-21	swapper/1	05:54:28	1
3181	99	84	83	cyclictest	0	-21	swapper/1	05:36:40	1
3181	99	84	83	cyclictest	0	-21	swapper/1	05:09:30	1
3181	99	84	83	cyclictest	0	-21	swapper/1	05:04:32	1
3181	99	84	83	cyclictest	0	-21	swapper/1	04:59:34	1
3181	99	84	83	cyclictest	0	-21	swapper/1	04:54:34	1
3181	99	84	82	cyclictest	8817	-21	tune2fs	07:29:24	1
3183	99	83	82	cyclictest	0	-21	swapper/3	09:54:06	3
3183	99	83	82	cyclictest	0	-21	swapper/3	09:44:22	3
3183	99	83	82	cyclictest	0	-21	swapper/3	09:39:22	3
3183	99	83	82	cyclictest	0	-21	swapper/3	09:19:23	3
3183	99	83	82	cyclictest	0	-21	swapper/3	09:09:28	3
3183	99	83	82	cyclictest	0	-21	swapper/3	08:44:23	3
3183	99	83	82	cyclictest	0	-21	swapper/3	08:24:24	3
3183	99	83	82	cyclictest	0	-21	swapper/3	08:14:32	3
3183	99	83	82	cyclictest	0	-21	swapper/3	08:09:30	3
3183	99	83	82	cyclictest	0	-21	swapper/3	07:39:22	3
3183	99	83	82	cyclictest	0	-21	swapper/3	06:54:14	3
3183	99	83	82	cyclictest	0	-21	swapper/3	06:34:33	3
3183	99	83	82	cyclictest	0	-21	swapper/3	06:29:36	3
3183	99	83	82	cyclictest	0	-21	swapper/3	06:24:28	3
3183	99	83	82	cyclictest	0	-21	swapper/3	06:19:31	3
3183	99	83	82	cyclictest	0	-21	swapper/3	05:44:41	3
3183	99	83	82	cyclictest	0	-21	swapper/3	05:32:17	3
3183	99	83	82	cyclictest	0	-21	swapper/3	05:24:17	3
3183	99	83	82	cyclictest	0	-21	swapper/3	05:14:39	3
3183	99	83	82	cyclictest	0	-21	swapper/3	05:04:39	3
3183	99	83	82	cyclictest	0	-21	swapper/3	04:59:39	3
3183	99	83	82	cyclictest	0	-21	swapper/3	04:54:40	3
3183	99	83	82	cyclictest	0	-21	swapper/3	04:49:31	3
3183	99	83	81	cyclictest	16140	-21	md1_resync	07:44:58	3
3181	99	83	82	cyclictest	0	-21	swapper/1	09:59:27	1
3181	99	83	82	cyclictest	0	-21	swapper/1	09:59:27	1
3181	99	83	82	cyclictest	0	-21	swapper/1	09:49:28	1
3181	99	83	82	cyclictest	0	-21	swapper/1	09:39:22	1
3181	99	83	82	cyclictest	0	-21	swapper/1	09:24:27	1
3181	99	83	82	cyclictest	0	-21	swapper/1	09:19:26	1
3181	99	83	82	cyclictest	0	-21	swapper/1	08:54:15	1
3181	99	83	82	cyclictest	0	-21	swapper/1	07:24:25	1
3181	99	83	82	cyclictest	0	-21	swapper/1	06:36:47	1
3181	99	83	82	cyclictest	0	-21	swapper/1	06:19:28	1
3181	99	83	82	cyclictest	0	-21	swapper/1	05:18:17	1
3181	99	83	81	cyclictest	20724	-21	aten2.4-expect	05:29:27	1
3181	99	83	81	cyclictest	19758	-21	tune2fs	07:54:23	1
3183	99	82	81	cyclictest	0	-21	swapper/3	09:59:20	3
3183	99	82	81	cyclictest	0	-21	swapper/3	09:59:20	3
3183	99	82	81	cyclictest	0	-21	swapper/3	07:59:24	3
3183	99	82	81	cyclictest	0	-21	swapper/3	05:09:39	3
3183	99	82	71	cyclictest	28925	-21	munin-node	06:59:33	3
3181	99	79	77	cyclictest	0	-21	swapper/1	09:09:19	1
3181	99	76	75	cyclictest	0	-21	swapper/1	08:05:41	1
3181	99	76	75	cyclictest	0	-21	swapper/1	07:19:28	1
3181	99	76	75	cyclictest	0	-21	swapper/1	06:05:45	1
3181	99	75	74	cyclictest	0	-21	swapper/1	07:44:27	1
3181	99	75	73	cyclictest	408	-21	md1_raid1	06:54:26	1
3181	99	75	73	cyclictest	408	-21	md1_raid1	05:19:27	1
3181	99	75	73	cyclictest	0	-21	swapper/1	09:29:30	1
3181	99	75	73	cyclictest	0	-21	swapper/1	08:29:22	1
3181	99	75	73	cyclictest	0	-21	swapper/1	08:13:43	1
3181	99	75	73	cyclictest	0	-21	swapper/1	07:14:24	1
3183	99	74	73	cyclictest	5495	-21	in.tftpd	06:07:59	3
3181	99	74	73	cyclictest	0	-21	swapper/1	10:04:21	1
3181	99	74	72	cyclictest	0	-21	swapper/1	10:14:28	1
3183	99	73	72	cyclictest	0	-21	swapper/3	09:34:26	3
3183	99	73	72	cyclictest	0	-21	swapper/3	08:37:03	3
3183	99	73	72	cyclictest	0	-21	swapper/3	08:09:07	3
3183	99	73	72	cyclictest	0	-21	swapper/3	07:34:31	3
3183	99	73	61	cyclictest	0	-21	swapper/3	05:34:26	3
3183	99	72	61	cyclictest	0	-21	swapper/3	07:15:11	3
3183	99	68	67	cyclictest	0	-21	swapper/3	09:32:40	3
3182	99	68	48	cyclictest	0	-21	swapper/2	06:33:49	2
3182	99	67	61	cyclictest	0	-21	swapper/2	08:01:12	2
3182	99	67	51	cyclictest	0	-21	swapper/2	08:53:54	2
3182	99	67	41	cyclictest	0	-21	swapper/2	08:31:01	2
3182	99	66	62	cyclictest	0	-21	swapper/2	07:30:07	2
3182	99	66	41	cyclictest	0	-21	swapper/2	09:06:16	2
3182	99	66	41	cyclictest	0	-21	swapper/2	08:59:42	2
3182	99	66	41	cyclictest	0	-21	swapper/2	08:54:14	2
3182	99	66	41	cyclictest	0	-21	swapper/2	08:44:46	2
3182	99	66	41	cyclictest	0	-21	swapper/2	08:39:38	2
3182	99	66	41	cyclictest	0	-21	swapper/2	08:25:37	2
3182	99	66	41	cyclictest	0	-21	swapper/2	08:21:43	2
3182	99	66	41	cyclictest	0	-21	swapper/2	08:08:40	2
3182	99	66	41	cyclictest	0	-21	swapper/2	07:56:01	2
3182	99	66	41	cyclictest	0	-21	swapper/2	07:22:38	2
3182	99	65	61	cyclictest	0	-21	swapper/2	08:35:27	2
3182	99	65	61	cyclictest	0	-21	swapper/2	08:09:58	2
3182	99	65	61	cyclictest	0	-21	swapper/2	07:50:09	2
3182	99	65	61	cyclictest	0	-21	swapper/2	07:50:09	2
3182	99	65	61	cyclictest	0	-21	swapper/2	06:08:26	2
3182	99	65	60	cyclictest	278	-21	usb-storage	09:53:38	2
3182	99	65	51	cyclictest	0	-21	swapper/2	05:21:42	2
3182	99	65	51	cyclictest	0	-21	swapper/2	05:04:39	2
3182	99	65	41	cyclictest	0	-21	swapper/2	09:12:00	2
3182	99	64	61	cyclictest	0	-21	swapper/2	06:26:25	2
3182	99	64	60	cyclictest	0	-21	swapper/2	09:55:04	2
3182	99	64	60	cyclictest	0	-21	swapper/2	08:14:36	2
3182	99	64	60	cyclictest	0	-21	swapper/2	07:35:29	2
3182	99	64	60	cyclictest	0	-21	swapper/2	06:11:29	2
3182	99	64	51	cyclictest	0	-21	swapper/2	09:14:14	2
3182	99	64	51	cyclictest	0	-21	swapper/2	06:40:42	2
3182	99	64	49	cyclictest	392	-21	md2_raid1	10:08:22	2
3182	99	63	62	cyclictest	0	-21	swapper/2	06:20:43	2
3182	99	63	62	cyclictest	0	-21	swapper/2	05:31:51	2
3182	99	63	60	cyclictest	0	-21	swapper/2	07:28:01	2
3182	99	63	48	cyclictest	0	-21	swapper/2	07:46:46	2
3182	99	63	48	cyclictest	0	-21	swapper/2	06:00:17	2
3180	99	63	62	cyclictest	0	-21	swapper/0	08:54:20	0
3180	99	63	62	cyclictest	0	-21	swapper/0	08:45:20	0
3180	99	63	62	cyclictest	0	-21	swapper/0	08:39:54	0
3180	99	63	62	cyclictest	0	-21	swapper/0	08:24:32	0
3180	99	63	60	cyclictest	0	-21	swapper/0	08:34:47	0
3182	99	62	61	cyclictest	0	-21	swapper/2	10:11:45	2
3182	99	62	61	cyclictest	0	-21	swapper/2	07:40:00	2
3182	99	62	61	cyclictest	0	-21	swapper/2	07:15:41	2
3182	99	62	61	cyclictest	0	-21	swapper/2	06:36:37	2
3182	99	62	61	cyclictest	0	-21	swapper/2	06:18:18	2
3182	99	62	61	cyclictest	0	-21	swapper/2	05:59:04	2
3182	99	62	61	cyclictest	0	-21	swapper/2	05:59:04	2
3182	99	62	61	cyclictest	0	-21	swapper/2	05:13:06	2
3182	99	62	61	cyclictest	0	-21	swapper/2	04:59:56	2
3182	99	62	61	cyclictest	0	-21	swapper/2	04:55:23	2
3182	99	62	58	cyclictest	0	-21	swapper/2	07:05:02	2
3182	99	62	58	cyclictest	0	-21	swapper/2	05:51:02	2
3182	99	62	48	cyclictest	0	-21	swapper/2	07:13:43	2
3182	99	62	47	cyclictest	0	-21	swapper/2	07:01:34	2
3182	99	62	47	cyclictest	0	-21	swapper/2	05:27:07	2
3182	99	62	41	cyclictest	0	-21	swapper/2	06:53:52	2
3182	99	62	41	cyclictest	0	-21	swapper/2	05:42:20	2
3180	99	62	61	cyclictest	0	-21	swapper/0	09:42:25	0
3180	99	62	61	cyclictest	0	-21	swapper/0	08:51:44	0
3180	99	62	61	cyclictest	0	-21	swapper/0	08:29:42	0
3180	99	62	61	cyclictest	0	-21	swapper/0	08:21:38	0
3180	99	62	61	cyclictest	0	-21	swapper/0	05:49:56	0
3180	99	62	61	cyclictest	0	-21	swapper/0	05:03:33	0
3180	99	61	60	cyclictest	0	-21	swapper/0	09:10:55	0
3180	99	61	60	cyclictest	0	-21	swapper/0	09:07:42	0
3180	99	61	60	cyclictest	0	-21	swapper/0	08:59:29	0
3180	99	61	60	cyclictest	0	-21	swapper/0	08:14:13	0
3180	99	61	60	cyclictest	0	-21	swapper/0	08:10:52	0
3180	99	61	60	cyclictest	0	-21	swapper/0	07:47:10	0
3182	99	60	57	cyclictest	0	-21	swapper/2	05:18:17	2
3182	99	60	41	cyclictest	0	-21	swapper/2	05:45:42	2
3182	99	60	40	cyclictest	0	-21	swapper/2	09:24:02	2
3180	99	60	59	cyclictest	0	-21	swapper/0	07:35:56	0
3180	99	60	59	cyclictest	0	-21	swapper/0	06:37:03	0
3182	99	59	55	cyclictest	0	-21	swapper/2	06:45:17	2
3182	99	59	52	cyclictest	0	-21	swapper/2	04:51:49	2
3182	99	59	41	cyclictest	0	-21	swapper/2	09:39:46	2
3180	99	59	58	cyclictest	0	-21	swapper/0	08:08:04	0
3180	99	59	58	cyclictest	0	-21	swapper/0	06:34:03	0
3180	99	59	58	cyclictest	0	-21	swapper/0	04:53:43	0
3182	99	58	51	cyclictest	278	-21	usb-storage	06:55:58	2
3180	99	58	57	cyclictest	0	-21	swapper/0	07:57:01	0
3180	99	58	57	cyclictest	0	-21	swapper/0	07:06:01	0
3180	99	58	57	cyclictest	0	-21	swapper/0	06:27:44	0
3180	99	58	57	cyclictest	0	-21	swapper/0	05:38:46	0
3180	99	58	57	cyclictest	0	-21	swapper/0	04:56:40	0
3180	99	58	52	cyclictest	0	-21	swapper/0	07:32:03	0
3180	99	58	41	cyclictest	0	-21	swapper/0	05:09:34	0
3182	99	57	41	cyclictest	0	-21	swapper/2	10:14:08	2
3182	99	57	41	cyclictest	0	-21	swapper/2	09:59:55	2
3182	99	57	41	cyclictest	0	-21	swapper/2	09:59:55	2
3182	99	57	41	cyclictest	0	-21	swapper/2	09:44:58	2
3182	99	57	41	cyclictest	0	-21	swapper/2	09:34:41	2
3182	99	57	41	cyclictest	0	-21	swapper/2	09:33:40	2
3182	99	57	41	cyclictest	0	-21	swapper/2	09:26:09	2
3182	99	57	41	cyclictest	0	-21	swapper/2	05:34:27	2
3180	99	57	56	cyclictest	0	-21	swapper/0	05:58:04	0
3180	99	57	56	cyclictest	0	-21	swapper/0	05:58:04	0
3180	99	57	56	cyclictest	0	-21	swapper/0	05:29:27	0
3180	99	57	50	cyclictest	0	-21	swapper/0	06:09:40	0
3180	99	56	55	cyclictest	0	-21	swapper/0	07:19:22	0
3180	99	56	51	cyclictest	0	-21	swapper/0	07:50:20	0
3180	99	56	51	cyclictest	0	-21	swapper/0	07:50:20	0
3180	99	56	49	cyclictest	0	-21	swapper/0	06:56:52	0
3180	99	56	49	cyclictest	0	-21	swapper/0	06:45:51	0
3180	99	55	54	cyclictest	0	-21	swapper/0	07:14:23	0
3180	99	55	54	cyclictest	0	-21	swapper/0	05:20:14	0
3180	99	55	51	cyclictest	0	-21	swapper/0	05:26:08	0
3180	99	55	41	cyclictest	0	-21	swapper/0	10:11:06	0
3180	99	54	53	cyclictest	760	50	irq/18-parport0	06:19:50	0
3180	99	54	53	cyclictest	50	50	irq/44-ahci	05:18:34	0
3180	99	54	53	cyclictest	0	-21	swapper/0	10:17:57	0
3180	99	54	53	cyclictest	0	-21	swapper/0	07:40:51	0
3180	99	54	52	cyclictest	0	-21	swapper/0	05:45:16	0
3180	99	54	51	cyclictest	0	-21	swapper/0	05:05:26	0
3180	99	53	52	cyclictest	760	50	irq/18-parport0	09:58:03	0
3180	99	53	52	cyclictest	50	50	irq/44-ahci	07:00:52	0
3180	99	53	52	cyclictest	0	-21	swapper/0	10:02:39	0
3180	99	53	52	cyclictest	0	-21	swapper/0	10:02:39	0
3180	99	53	52	cyclictest	0	-21	swapper/0	09:45:56	0
3180	99	53	52	cyclictest	0	-21	swapper/0	09:37:46	0
3180	99	53	52	cyclictest	0	-21	swapper/0	09:14:18	0
3180	99	53	52	cyclictest	0	-21	swapper/0	08:01:14	0
3180	99	53	52	cyclictest	0	-21	swapper/0	07:24:20	0
3180	99	53	52	cyclictest	0	-21	swapper/0	07:09:43	0
3180	99	53	52	cyclictest	0	-21	swapper/0	06:50:09	0
3180	99	53	52	cyclictest	0	-21	swapper/0	06:39:15	0
3180	99	53	52	cyclictest	0	-21	swapper/0	06:14:17	0
3180	99	53	52	cyclictest	0	-21	swapper/0	06:06:32	0
3180	99	53	52	cyclictest	0	-21	swapper/0	05:59:49	0
3180	99	53	52	cyclictest	0	-21	swapper/0	05:39:35	0
3180	99	53	41	cyclictest	0	-21	swapper/0	10:04:17	0
3180	99	53	41	cyclictest	0	-21	swapper/0	09:24:32	0
3180	99	52	51	cyclictest	0	-21	swapper/0	09:49:25	0
3180	99	52	51	cyclictest	0	-21	swapper/0	09:29:30	0
3180	99	52	41	cyclictest	0	-21	swapper/0	09:20:01	0
8	99	14	0	watchdog/0	0	-21	swapper/0	04:49:09	0
50	50	11	0	irq/44-ahci	0	-21	swapper/2	04:45:08	2
21	99	10	0	migration/3	2452	-21	unixbench-2d	04:44:42	3
12	1	8	0	ksoftirqd/1	862	-21	runrttasks	04:44:22	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17