OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Wed Aug 05, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
14175	99	133	132	cyclictest	0	-21	swapper/1	06:40:16	1
14178	99	123	122	cyclictest	26010	-21	munin-node	08:40:11	3
14178	99	110	104	cyclictest	31566	-21	sed	07:35:13	3
14178	99	103	92	cyclictest	0	-21	swapper/3	06:40:16	3
14175	99	103	102	cyclictest	0	-21	swapper/1	05:21:38	1
14175	99	98	71	cyclictest	13274	-21	tune2fs	06:55:06	1
14175	99	94	92	cyclictest	6718	-21	aten2.4-expect	09:10:00	1
14175	99	94	92	cyclictest	30092	-21	aten2.4-expect	07:35:01	1
14178	99	93	92	cyclictest	1385	-17	sedispatch	08:35:00	3
14175	99	93	92	cyclictest	0	-21	swapper/1	08:42:10	1
14175	99	93	92	cyclictest	0	-21	swapper/1	08:25:08	1
14175	99	90	72	cyclictest	0	-21	swapper/1	07:05:07	1
14175	99	88	82	cyclictest	30981	-21	tune2fs	08:50:03	1
14175	99	87	81	cyclictest	15576	-21	tune2fs	08:15:03	1
14175	99	86	82	cyclictest	0	-21	swapper/1	03:56:25	1
14178	99	84	82	cyclictest	0	-21	swapper/3	06:25:02	3
14178	99	83	82	cyclictest	0	-21	swapper/3	09:00:08	3
14178	99	83	82	cyclictest	0	-21	swapper/3	08:55:08	3
14178	99	83	82	cyclictest	0	-21	swapper/3	08:45:09	3
14178	99	83	82	cyclictest	0	-21	swapper/3	08:30:08	3
14178	99	83	82	cyclictest	0	-21	swapper/3	08:29:48	3
14178	99	83	82	cyclictest	0	-21	swapper/3	08:05:07	3
14178	99	83	82	cyclictest	0	-21	swapper/3	08:00:15	3
14178	99	83	82	cyclictest	0	-21	swapper/3	07:50:14	3
14178	99	83	82	cyclictest	0	-21	swapper/3	07:29:51	3
14178	99	83	82	cyclictest	0	-21	swapper/3	06:50:13	3
14178	99	83	82	cyclictest	0	-21	swapper/3	06:21:47	3
14178	99	83	82	cyclictest	0	-21	swapper/3	06:11:45	3
14178	99	83	82	cyclictest	0	-21	swapper/3	05:36:40	3
14178	99	83	82	cyclictest	0	-21	swapper/3	05:34:56	3
14178	99	83	82	cyclictest	0	-21	swapper/3	05:06:36	3
14178	99	83	82	cyclictest	0	-21	swapper/3	04:55:04	3
14178	99	83	82	cyclictest	0	-21	swapper/3	04:40:33	3
14178	99	83	82	cyclictest	0	-21	swapper/3	04:14:58	3
14175	99	83	82	cyclictest	0	-21	swapper/1	09:00:08	1
14175	99	83	82	cyclictest	0	-21	swapper/1	08:55:08	1
14175	99	83	82	cyclictest	0	-21	swapper/1	08:45:09	1
14175	99	83	82	cyclictest	0	-21	swapper/1	08:39:48	1
14175	99	83	82	cyclictest	0	-21	swapper/1	08:30:07	1
14175	99	83	82	cyclictest	0	-21	swapper/1	08:10:06	1
14175	99	83	82	cyclictest	0	-21	swapper/1	08:05:07	1
14175	99	83	82	cyclictest	0	-21	swapper/1	08:00:02	1
14175	99	83	82	cyclictest	0	-21	swapper/1	07:55:11	1
14175	99	83	82	cyclictest	0	-21	swapper/1	07:50:14	1
14175	99	83	82	cyclictest	0	-21	swapper/1	07:26:58	1
14175	99	83	82	cyclictest	0	-21	swapper/1	07:10:15	1
14175	99	83	82	cyclictest	0	-21	swapper/1	07:00:12	1
14175	99	83	82	cyclictest	0	-21	swapper/1	06:45:07	1
14175	99	83	82	cyclictest	0	-21	swapper/1	06:35:15	1
14175	99	83	82	cyclictest	0	-21	swapper/1	06:25:02	1
14175	99	83	82	cyclictest	0	-21	swapper/1	06:11:45	1
14175	99	83	82	cyclictest	0	-21	swapper/1	05:39:55	1
14175	99	83	82	cyclictest	0	-21	swapper/1	05:35:56	1
14175	99	83	82	cyclictest	0	-21	swapper/1	05:34:56	1
14175	99	83	82	cyclictest	0	-21	swapper/1	05:26:39	1
14175	99	83	82	cyclictest	0	-21	swapper/1	05:14:56	1
14175	99	83	82	cyclictest	0	-21	swapper/1	05:06:36	1
14175	99	83	82	cyclictest	0	-21	swapper/1	05:01:35	1
14175	99	83	82	cyclictest	0	-21	swapper/1	04:51:58	1
14175	99	83	82	cyclictest	0	-21	swapper/1	04:40:27	1
14175	99	83	81	cyclictest	2520	-21	tune2fs	07:45:04	1
14175	99	83	81	cyclictest	24130	-21	tune2fs	07:20:05	1
14175	99	83	81	cyclictest	21955	-21	tune2fs	07:15:06	1
14178	99	82	81	cyclictest	0	-21	swapper/3	09:10:03	3
14178	99	82	81	cyclictest	0	-21	swapper/3	08:50:03	3
14178	99	82	81	cyclictest	0	-21	swapper/3	08:15:03	3
14178	99	82	81	cyclictest	0	-21	swapper/3	07:45:04	3
14178	99	82	81	cyclictest	0	-21	swapper/3	07:20:05	3
14178	99	82	81	cyclictest	0	-21	swapper/3	07:15:06	3
14178	99	82	71	cyclictest	0	-21	swapper/3	07:31:59	3
14175	99	82	81	cyclictest	0	-21	swapper/1	04:56:34	1
14175	99	82	71	cyclictest	0	-21	swapper/1	07:40:33	1
14175	99	82	71	cyclictest	0	-21	swapper/1	07:40:33	1
14175	99	77	76	cyclictest	0	-21	swapper/1	04:45:24	1
14175	99	76	72	cyclictest	0	-21	swapper/1	08:20:26	1
14175	99	76	72	cyclictest	0	-21	swapper/1	06:04:54	1
14175	99	76	72	cyclictest	0	-21	swapper/1	04:14:58	1
14175	99	76	72	cyclictest	0	-21	swapper/1	04:04:59	1
14175	99	75	71	cyclictest	0	-21	swapper/1	06:18:09	1
14178	99	74	72	cyclictest	14315	-21	sed	06:55:15	3
14178	99	74	71	cyclictest	0	-21	swapper/3	03:45:50	3
14178	99	73	72	cyclictest	0	-21	swapper/3	08:20:25	3
14178	99	73	72	cyclictest	0	-21	swapper/3	07:04:52	3
14178	99	73	72	cyclictest	0	-21	swapper/3	06:30:16	3
14178	99	73	72	cyclictest	0	-21	swapper/3	05:10:42	3
14178	99	73	72	cyclictest	0	-21	swapper/3	03:51:24	3
14178	99	73	51	cyclictest	0	-21	swapper/3	07:00:03	3
14175	99	73	72	cyclictest	0	-21	swapper/1	09:04:59	1
14175	99	73	72	cyclictest	0	-21	swapper/1	07:29:57	1
14175	99	73	72	cyclictest	0	-21	swapper/1	06:50:07	1
14175	99	73	72	cyclictest	0	-21	swapper/1	06:30:05	1
14175	99	73	72	cyclictest	0	-21	swapper/1	06:19:54	1
14175	99	73	72	cyclictest	0	-21	swapper/1	06:04:58	1
14175	99	73	72	cyclictest	0	-21	swapper/1	05:55:38	1
14175	99	73	72	cyclictest	0	-21	swapper/1	05:50:55	1
14175	99	73	72	cyclictest	0	-21	swapper/1	05:45:38	1
14175	99	73	72	cyclictest	0	-21	swapper/1	05:10:38	1
14175	99	73	72	cyclictest	0	-21	swapper/1	04:35:32	1
14175	99	73	72	cyclictest	0	-21	swapper/1	04:30:12	1
14175	99	73	72	cyclictest	0	-21	swapper/1	04:25:40	1
14175	99	73	72	cyclictest	0	-21	swapper/1	04:20:04	1
14175	99	73	72	cyclictest	0	-21	swapper/1	04:15:59	1
14175	99	73	72	cyclictest	0	-21	swapper/1	04:15:59	1
14175	99	73	72	cyclictest	0	-21	swapper/1	04:05:19	1
14175	99	73	72	cyclictest	0	-21	swapper/1	03:50:34	1
14175	99	73	72	cyclictest	0	-21	swapper/1	03:45:24	1
14178	99	72	71	cyclictest	0	-21	swapper/3	07:10:05	3
14178	99	72	71	cyclictest	0	-21	swapper/3	05:26:39	3
14178	99	72	71	cyclictest	0	-21	swapper/3	04:20:05	3
14178	99	72	61	cyclictest	0	-21	swapper/3	05:02:52	3
14177	99	72	41	cyclictest	278	1	usb-storage	07:24:34	2
14177	99	69	49	cyclictest	0	-21	swapper/2	05:41:52	2
14177	99	68	52	cyclictest	278	1	usb-storage	05:33:09	2
14177	99	68	52	cyclictest	278	1	usb-storage	04:24:45	2
14177	99	67	62	cyclictest	18	1	ksoftirqd/2	06:04:16	2
14177	99	67	52	cyclictest	0	-21	swapper/2	04:00:40	2
14177	99	67	51	cyclictest	278	1	usb-storage	06:45:30	2
14177	99	67	51	cyclictest	278	1	usb-storage	05:47:14	2
14177	99	67	51	cyclictest	278	1	usb-storage	05:23:01	2
14177	99	67	51	cyclictest	18	1	ksoftirqd/2	04:10:38	2
14177	99	67	50	cyclictest	0	-21	swapper/2	08:23:04	2
14177	99	67	41	cyclictest	0	-21	swapper/2	06:38:16	2
14178	99	66	65	cyclictest	0	-21	swapper/3	07:55:02	3
14177	99	66	51	cyclictest	0	-21	swapper/2	07:30:58	2
14177	99	66	51	cyclictest	0	-21	swapper/2	07:04:57	2
14177	99	66	51	cyclictest	0	-21	swapper/2	06:50:36	2
14177	99	66	51	cyclictest	0	-21	swapper/2	05:10:44	2
14177	99	66	51	cyclictest	0	-21	swapper/2	04:41:35	2
14177	99	66	50	cyclictest	0	-21	swapper/2	08:00:07	2
14177	99	66	50	cyclictest	0	-21	swapper/2	06:25:13	2
14177	99	66	41	cyclictest	0	-21	swapper/2	05:58:58	2
14177	99	65	50	cyclictest	0	-21	swapper/2	08:41:14	2
14177	99	65	50	cyclictest	0	-21	swapper/2	08:12:55	2
14177	99	65	50	cyclictest	0	-21	swapper/2	08:05:49	2
14177	99	65	50	cyclictest	0	-21	swapper/2	07:51:07	2
14177	99	65	50	cyclictest	0	-21	swapper/2	07:48:12	2
14177	99	65	50	cyclictest	0	-21	swapper/2	07:41:38	2
14177	99	65	50	cyclictest	0	-21	swapper/2	07:41:38	2
14177	99	65	50	cyclictest	0	-21	swapper/2	07:26:48	2
14177	99	65	50	cyclictest	0	-21	swapper/2	06:59:16	2
14177	99	65	50	cyclictest	0	-21	swapper/2	06:33:50	2
14177	99	65	50	cyclictest	0	-21	swapper/2	06:21:03	2
14177	99	65	50	cyclictest	0	-21	swapper/2	06:12:15	2
14177	99	65	50	cyclictest	0	-21	swapper/2	06:06:21	2
14177	99	65	50	cyclictest	0	-21	swapper/2	05:51:22	2
14177	99	65	50	cyclictest	0	-21	swapper/2	05:17:21	2
14177	99	65	50	cyclictest	0	-21	swapper/2	05:02:52	2
14177	99	65	50	cyclictest	0	-21	swapper/2	04:59:24	2
14177	99	65	50	cyclictest	0	-21	swapper/2	04:51:22	2
14177	99	65	50	cyclictest	0	-21	swapper/2	04:37:37	2
14177	99	65	50	cyclictest	0	-21	swapper/2	04:28:39	2
14177	99	65	50	cyclictest	0	-21	swapper/2	04:18:44	2
14177	99	65	50	cyclictest	0	-21	swapper/2	04:18:44	2
14177	99	65	50	cyclictest	0	-21	swapper/2	04:08:10	2
14177	99	65	50	cyclictest	0	-21	swapper/2	03:54:48	2
14178	99	64	62	cyclictest	0	-21	swapper/3	06:35:53	3
14178	99	63	62	cyclictest	0	-21	swapper/3	09:04:59	3
14178	99	63	62	cyclictest	0	-21	swapper/3	08:09:49	3
14178	99	63	62	cyclictest	0	-21	swapper/3	06:45:03	3
14178	99	63	62	cyclictest	0	-21	swapper/3	06:14:56	3
14178	99	63	62	cyclictest	0	-21	swapper/3	06:06:40	3
14178	99	63	62	cyclictest	0	-21	swapper/3	06:03:40	3
14178	99	63	62	cyclictest	0	-21	swapper/3	05:55:09	3
14178	99	63	62	cyclictest	0	-21	swapper/3	05:51:42	3
14178	99	63	62	cyclictest	0	-21	swapper/3	05:44:55	3
14178	99	63	62	cyclictest	0	-21	swapper/3	05:40:04	3
14178	99	63	62	cyclictest	0	-21	swapper/3	05:21:38	3
14178	99	63	62	cyclictest	0	-21	swapper/3	05:14:56	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:54:52	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:46:32	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:36:31	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:31:30	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:26:29	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:16:28	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:16:28	3
14178	99	63	62	cyclictest	0	-21	swapper/3	04:06:26	3
14178	99	63	62	cyclictest	0	-21	swapper/3	03:59:59	3
14178	99	63	62	cyclictest	0	-21	swapper/3	03:56:57	3
14178	99	63	61	cyclictest	32580	-21	fschecks_count	07:40:05	3
14178	99	63	61	cyclictest	32580	-21	fschecks_count	07:40:05	3
14177	99	62	61	cyclictest	0	-21	swapper/2	03:56:40	2
14177	99	60	51	cyclictest	0	-21	swapper/2	08:59:29	2
14177	99	60	41	cyclictest	0	-21	swapper/2	08:34:54	2
14177	99	59	33	cyclictest	20440	-21	irqstats	08:25:04	2
14177	99	57	51	cyclictest	0	-21	swapper/2	07:57:03	2
14177	99	57	46	cyclictest	0	-21	swapper/2	07:35:02	2
14177	99	57	41	cyclictest	278	1	usb-storage	09:14:22	2
14177	99	57	41	cyclictest	278	1	usb-storage	07:10:01	2
14177	99	57	41	cyclictest	278	1	usb-storage	05:28:05	2
14177	99	57	41	cyclictest	278	1	usb-storage	04:33:57	2
14177	99	57	41	cyclictest	18	1	ksoftirqd/2	08:50:29	2
14177	99	57	41	cyclictest	0	-21	swapper/2	09:07:45	2
14177	99	57	41	cyclictest	0	-21	swapper/2	08:44:59	2
14177	99	57	41	cyclictest	0	-21	swapper/2	08:32:44	2
14177	99	57	41	cyclictest	0	-21	swapper/2	08:15:59	2
14177	99	57	41	cyclictest	0	-21	swapper/2	07:00:13	2
14177	99	57	41	cyclictest	0	-21	swapper/2	06:18:45	2
14177	99	57	41	cyclictest	0	-21	swapper/2	05:07:36	2
14177	99	56	51	cyclictest	278	-21	usb-storage	09:01:23	2
14177	99	56	51	cyclictest	0	-21	swapper/2	05:39:16	2
14177	99	56	41	cyclictest	0	-21	swapper/2	04:47:45	2
14177	99	56	41	cyclictest	0	-21	swapper/2	03:47:29	2
14177	99	56	34	cyclictest	21480	-21	aten2.4-expect	07:15:04	2
14167	99	56	55	cyclictest	0	-21	swapper/0	09:05:00	0
14177	99	55	51	cyclictest	0	-21	swapper/2	06:43:12	2
14167	99	53	52	cyclictest	0	-21	swapper/0	09:09:57	0
14167	99	53	52	cyclictest	0	-21	swapper/0	09:00:24	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:54:57	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:50:12	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:44:53	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:40:00	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:34:50	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:29:59	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:25:05	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:19:58	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:14:59	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:10:34	0
14167	99	53	52	cyclictest	0	-21	swapper/0	08:04:54	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:59:52	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:54:56	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:49:52	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:44:58	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:39:51	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:39:51	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:35:15	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:30:02	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:25:56	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:20:02	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:15:26	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:10:18	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:05:05	0
14167	99	53	52	cyclictest	0	-21	swapper/0	07:00:18	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:55:02	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:50:18	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:45:04	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:40:17	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:34:56	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:29:55	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:25:00	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:19:56	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:15:46	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:10:08	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:04:55	0
14167	99	53	52	cyclictest	0	-21	swapper/0	06:00:00	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:54:55	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:50:00	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:45:04	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:40:11	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:35:10	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:30:05	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:25:47	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:20:05	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:14:58	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:09:59	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:05:02	0
14167	99	53	52	cyclictest	0	-21	swapper/0	05:00:16	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:54:59	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:50:21	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:45:11	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:42:21	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:35:03	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:30:15	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:25:16	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:20:01	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:15:02	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:15:02	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:10:01	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:05:41	0
14167	99	53	52	cyclictest	0	-21	swapper/0	04:00:11	0
14167	99	53	52	cyclictest	0	-21	swapper/0	03:55:18	0
14167	99	53	52	cyclictest	0	-21	swapper/0	03:50:06	0
14167	99	53	52	cyclictest	0	-21	swapper/0	03:45:37	0
14167	99	22	21	cyclictest	0	-21	swapper/0	03:45:00	0
18	1	11	0	ksoftirqd/2	0	-21	swapper/2	03:41:41	2
12	1	11	0	ksoftirqd/1	14171	-21	latency_hist	03:45:00	1
23	1	10	0	ksoftirqd/3	0	-21	swapper/3	03:41:41	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17