OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Sat Jul 25, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
21172	99	122	121	cyclictest	0	-21	swapper/3	07:00:08	3
21172	99	113	112	cyclictest	0	-21	swapper/3	07:20:05	3
21170	99	103	102	cyclictest	0	-21	swapper/1	07:20:05	1
21172	99	93	92	cyclictest	0	-21	swapper/3	07:55:05	3
21172	99	93	81	cyclictest	0	-21	swapper/3	07:10:09	3
21170	99	93	92	cyclictest	0	-21	swapper/1	07:50:05	1
21170	99	93	92	cyclictest	0	-21	swapper/1	07:38:04	1
21170	99	93	92	cyclictest	0	-21	swapper/1	07:25:08	1
21170	99	93	92	cyclictest	0	-21	swapper/1	07:15:12	1
21170	99	93	92	cyclictest	0	-21	swapper/1	06:20:13	1
21170	99	93	92	cyclictest	0	-21	swapper/1	06:11:15	1
21170	99	93	92	cyclictest	0	-21	swapper/1	05:50:12	1
21170	99	93	92	cyclictest	0	-21	swapper/1	04:35:19	1
21170	99	93	92	cyclictest	0	-21	swapper/1	04:04:57	1
21172	99	92	91	cyclictest	0	-21	swapper/3	08:35:13	3
21172	99	92	91	cyclictest	0	-21	swapper/3	08:20:10	3
21172	99	92	91	cyclictest	0	-21	swapper/3	08:10:02	3
21172	99	92	91	cyclictest	0	-21	swapper/3	05:05:09	3
21172	99	92	91	cyclictest	0	-21	swapper/3	05:00:13	3
21172	99	92	91	cyclictest	0	-21	swapper/3	04:45:10	3
21172	99	92	91	cyclictest	0	-21	swapper/3	04:35:19	3
21172	99	84	72	cyclictest	0	-21	swapper/3	05:34:54	3
21172	99	84	71	cyclictest	0	-21	swapper/3	09:10:05	3
21172	99	84	71	cyclictest	0	-21	swapper/3	07:05:05	3
21170	99	84	82	cyclictest	30563	-21	tune2fs	08:00:03	1
21170	99	84	82	cyclictest	0	-21	swapper/1	09:10:07	1
21172	99	83	82	cyclictest	0	-21	swapper/3	09:05:11	3
21172	99	83	82	cyclictest	0	-21	swapper/3	08:05:02	3
21172	99	83	82	cyclictest	0	-21	swapper/3	07:49:59	3
21172	99	83	82	cyclictest	0	-21	swapper/3	07:45:10	3
21172	99	83	82	cyclictest	0	-21	swapper/3	07:43:04	3
21172	99	83	82	cyclictest	0	-21	swapper/3	07:38:04	3
21172	99	83	82	cyclictest	0	-21	swapper/3	07:30:07	3
21172	99	83	82	cyclictest	0	-21	swapper/3	07:15:12	3
21172	99	83	82	cyclictest	0	-21	swapper/3	06:57:57	3
21172	99	83	82	cyclictest	0	-21	swapper/3	06:20:13	3
21172	99	83	82	cyclictest	0	-21	swapper/3	06:10:06	3
21172	99	83	82	cyclictest	0	-21	swapper/3	04:20:18	3
21172	99	83	82	cyclictest	0	-21	swapper/3	04:00:10	3
21172	99	83	81	cyclictest	0	-21	swapper/3	09:20:02	3
21172	99	83	81	cyclictest	0	-21	swapper/3	09:00:00	3
21172	99	83	71	cyclictest	0	-21	swapper/3	07:25:02	3
21172	99	83	71	cyclictest	0	-21	swapper/3	05:40:07	3
21172	99	83	71	cyclictest	0	-21	swapper/3	04:55:11	3
21172	99	83	71	cyclictest	0	-21	swapper/3	03:59:57	3
21170	99	83	82	cyclictest	24318	-21	tune2fs	07:45:04	1
21170	99	83	82	cyclictest	0	-21	swapper/1	09:20:02	1
21170	99	83	82	cyclictest	0	-21	swapper/1	09:08:17	1
21170	99	83	82	cyclictest	0	-21	swapper/1	08:45:07	1
21170	99	83	82	cyclictest	0	-21	swapper/1	08:43:13	1
21170	99	83	82	cyclictest	0	-21	swapper/1	08:34:47	1
21170	99	83	82	cyclictest	0	-21	swapper/1	08:24:47	1
21170	99	83	82	cyclictest	0	-21	swapper/1	08:19:35	1
21170	99	83	82	cyclictest	0	-21	swapper/1	07:55:05	1
21170	99	83	82	cyclictest	0	-21	swapper/1	07:13:00	1
21170	99	83	82	cyclictest	0	-21	swapper/1	06:27:52	1
21170	99	83	82	cyclictest	0	-21	swapper/1	06:15:16	1
21170	99	83	82	cyclictest	0	-21	swapper/1	05:45:12	1
21170	99	83	82	cyclictest	0	-21	swapper/1	05:05:10	1
21170	99	83	81	cyclictest	9276	-21	tune2fs	08:25:04	1
21170	99	83	81	cyclictest	4685	-21	tune2fs	07:00:05	1
21170	99	83	81	cyclictest	32599	-21	tune2fs	04:20:11	1
21170	99	83	81	cyclictest	311	-21	tune2fs	08:05:02	1
21170	99	83	81	cyclictest	28377	-21	tune2fs	04:10:12	1
21170	99	83	81	cyclictest	26026	-21	tune2fs	05:20:09	1
21170	99	83	81	cyclictest	2535	-21	tune2fs	04:25:12	1
21170	99	83	81	cyclictest	2336	-21	tune2fs	05:40:07	1
21170	99	83	81	cyclictest	22183	-21	tune2fs	07:40:03	1
21170	99	83	81	cyclictest	22132	-21	tune2fs	08:55:02	1
21170	99	83	81	cyclictest	21818	-21	tune2fs	03:55:12	1
21170	99	83	81	cyclictest	15439	-21	tune2fs	04:55:11	1
21170	99	83	81	cyclictest	11091	-21	tune2fs	04:45:09	1
21172	99	82	81	cyclictest	0	-21	swapper/3	08:55:02	3
21172	99	82	81	cyclictest	0	-21	swapper/3	08:25:04	3
21172	99	82	81	cyclictest	0	-21	swapper/3	08:00:03	3
21172	99	82	81	cyclictest	0	-21	swapper/3	05:25:06	3
21172	99	82	81	cyclictest	0	-21	swapper/3	04:25:12	3
21172	99	82	81	cyclictest	0	-21	swapper/3	04:10:12	3
21172	99	82	81	cyclictest	0	-21	swapper/3	04:05:09	3
21172	99	82	80	cyclictest	0	-21	swapper/3	06:35:08	3
21172	99	82	80	cyclictest	0	-21	swapper/3	04:32:21	3
21172	99	82	80	cyclictest	0	-21	swapper/3	04:15:11	3
21172	99	82	71	cyclictest	0	-21	swapper/3	05:20:09	3
21172	99	82	70	cyclictest	0	-21	swapper/3	08:50:06	3
21172	99	82	70	cyclictest	0	-21	swapper/3	08:34:47	3
21170	99	82	81	cyclictest	8997	-21	tune2fs	05:55:09	1
21172	99	81	80	cyclictest	0	-21	swapper/3	04:52:38	3
21172	99	81	70	cyclictest	0	-21	swapper/3	06:47:56	3
21172	99	79	77	cyclictest	14445	-21	runrttasks	06:06:13	3
21172	99	75	70	cyclictest	0	-21	swapper/3	05:45:12	3
21172	99	74	73	cyclictest	0	-21	swapper/3	09:18:19	3
21170	99	74	73	cyclictest	0	-21	swapper/1	06:07:49	1
21172	99	73	72	cyclictest	0	-21	swapper/3	06:44:50	3
21172	99	73	71	cyclictest	0	-21	swapper/3	08:15:03	3
21172	99	73	71	cyclictest	0	-21	swapper/3	06:00:10	3
21172	99	73	51	cyclictest	0	-21	swapper/3	05:50:06	3
21170	99	73	72	cyclictest	0	-21	swapper/1	09:15:06	1
21170	99	73	72	cyclictest	0	-21	swapper/1	08:59:46	1
21170	99	73	72	cyclictest	0	-21	swapper/1	08:35:03	1
21170	99	73	72	cyclictest	0	-21	swapper/1	08:10:03	1
21170	99	73	72	cyclictest	0	-21	swapper/1	07:30:11	1
21170	99	73	72	cyclictest	0	-21	swapper/1	07:05:09	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:55:10	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:50:04	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:50:04	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:45:05	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:40:13	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:35:07	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:30:13	1
21170	99	73	72	cyclictest	0	-21	swapper/1	06:00:05	1
21170	99	73	72	cyclictest	0	-21	swapper/1	05:34:54	1
21170	99	73	72	cyclictest	0	-21	swapper/1	05:30:14	1
21170	99	73	72	cyclictest	0	-21	swapper/1	05:25:07	1
21170	99	73	72	cyclictest	0	-21	swapper/1	05:15:07	1
21170	99	73	72	cyclictest	0	-21	swapper/1	05:10:08	1
21170	99	73	72	cyclictest	0	-21	swapper/1	04:50:19	1
21170	99	73	72	cyclictest	0	-21	swapper/1	04:40:08	1
21170	99	73	72	cyclictest	0	-21	swapper/1	04:29:59	1
21170	99	73	72	cyclictest	0	-21	swapper/1	04:15:09	1
21170	99	73	72	cyclictest	0	-21	swapper/1	04:05:18	1
21170	99	73	71	cyclictest	17423	-21	tune2fs	05:00:09	1
21170	99	73	61	cyclictest	0	-21	swapper/1	08:50:06	1
21172	99	72	71	cyclictest	17514	-21	fschecks_count	06:15:07	3
21172	99	72	70	cyclictest	0	-21	swapper/3	08:44:58	3
21172	99	72	70	cyclictest	0	-21	swapper/3	06:30:06	3
21172	99	72	70	cyclictest	0	-21	swapper/3	06:25:07	3
21172	99	72	70	cyclictest	0	-21	swapper/3	05:30:10	3
21172	99	72	70	cyclictest	0	-21	swapper/3	05:15:09	3
21172	99	72	70	cyclictest	0	-21	swapper/3	05:10:08	3
21172	99	72	70	cyclictest	0	-21	swapper/3	04:40:11	3
21172	99	72	60	cyclictest	0	-21	swapper/3	08:40:00	3
21172	99	72	60	cyclictest	0	-21	swapper/3	06:50:04	3
21172	99	72	60	cyclictest	0	-21	swapper/3	06:50:04	3
21172	99	72	60	cyclictest	0	-21	swapper/3	05:55:08	3
21171	99	72	71	cyclictest	0	-21	swapper/2	09:16:04	2
21169	99	60	59	cyclictest	0	-21	swapper/0	08:50:00	0
21169	99	59	33	cyclictest	0	-21	swapper/0	07:54:50	0
21169	99	58	52	cyclictest	0	-21	swapper/0	09:23:20	0
21169	99	58	52	cyclictest	0	-21	swapper/0	06:32:55	0
21169	99	58	41	cyclictest	0	-21	swapper/0	05:49:44	0
21171	99	57	51	cyclictest	0	-21	swapper/2	05:38:03	2
21169	99	57	51	cyclictest	0	-21	swapper/0	08:35:00	0
21169	99	57	50	cyclictest	0	-21	swapper/0	05:59:54	0
21169	99	57	41	cyclictest	0	-21	swapper/0	09:03:27	0
21169	99	57	41	cyclictest	0	-21	swapper/0	06:15:05	0
21169	99	57	41	cyclictest	0	-21	swapper/0	04:30:09	0
21169	99	57	31	cyclictest	0	-21	swapper/0	09:08:35	0
21169	99	57	31	cyclictest	0	-21	swapper/0	06:20:37	0
21169	99	56	51	cyclictest	0	-21	swapper/0	09:13:39	0
21169	99	56	51	cyclictest	0	-21	swapper/0	08:25:02	0
21169	99	56	51	cyclictest	0	-21	swapper/0	08:04:59	0
21169	99	56	51	cyclictest	0	-21	swapper/0	07:41:30	0
21169	99	56	51	cyclictest	0	-21	swapper/0	07:15:03	0
21169	99	56	51	cyclictest	0	-21	swapper/0	06:25:03	0
21169	99	56	51	cyclictest	0	-21	swapper/0	05:40:05	0
21169	99	56	51	cyclictest	0	-21	swapper/0	05:37:51	0
21169	99	56	51	cyclictest	0	-21	swapper/0	04:50:10	0
21169	99	56	51	cyclictest	0	-21	swapper/0	04:25:59	0
21169	99	56	51	cyclictest	0	-21	swapper/0	04:11:26	0
21171	99	55	53	cyclictest	27624	-21	sshd	07:52:13	2
21171	99	55	41	cyclictest	0	-21	swapper/2	09:23:02	2
21171	99	55	41	cyclictest	0	-21	swapper/2	08:59:19	2
21171	99	55	41	cyclictest	0	-21	swapper/2	06:12:51	2
21169	99	55	41	cyclictest	0	-21	swapper/0	06:51:24	0
21169	99	55	41	cyclictest	0	-21	swapper/0	06:51:24	0
21171	99	54	42	cyclictest	278	-21	usb-storage	06:01:18	2
21171	99	54	41	cyclictest	0	-21	swapper/2	08:34:42	2
21169	99	54	51	cyclictest	0	-21	swapper/0	07:25:39	0
21169	99	54	41	cyclictest	0	-21	swapper/0	07:52:34	0
21169	99	54	41	cyclictest	0	-21	swapper/0	06:41:44	0
21169	99	54	41	cyclictest	0	-21	swapper/0	04:38:29	0
21169	99	54	41	cyclictest	0	-21	swapper/0	03:55:19	0
21171	99	53	52	cyclictest	0	-21	swapper/2	09:05:15	2
21171	99	53	52	cyclictest	0	-21	swapper/2	08:35:22	2
21171	99	53	52	cyclictest	0	-21	swapper/2	08:10:29	2
21171	99	53	52	cyclictest	0	-21	swapper/2	07:57:55	2
21171	99	53	52	cyclictest	0	-21	swapper/2	07:38:30	2
21171	99	53	52	cyclictest	0	-21	swapper/2	06:20:04	2
21171	99	53	52	cyclictest	0	-21	swapper/2	06:18:41	2
21171	99	53	52	cyclictest	0	-21	swapper/2	06:05:05	2
21171	99	53	52	cyclictest	0	-21	swapper/2	05:56:14	2
21171	99	53	52	cyclictest	0	-21	swapper/2	05:47:28	2
21171	99	53	52	cyclictest	0	-21	swapper/2	05:31:25	2
21171	99	53	52	cyclictest	0	-21	swapper/2	05:29:25	2
21171	99	53	52	cyclictest	0	-21	swapper/2	05:00:34	2
21171	99	53	52	cyclictest	0	-21	swapper/2	04:27:27	2
21171	99	53	52	cyclictest	0	-21	swapper/2	04:22:48	2
21171	99	53	52	cyclictest	0	-21	swapper/2	04:17:54	2
21171	99	53	52	cyclictest	0	-21	swapper/2	04:14:52	2
21171	99	53	51	cyclictest	50	50	irq/44-ahci	06:54:08	2
21171	99	53	51	cyclictest	50	50	irq/44-ahci	06:54:08	2
21171	99	53	41	cyclictest	278	-21	usb-storage	06:40:32	2
21171	99	53	41	cyclictest	278	-21	usb-storage	04:37:37	2
21171	99	53	41	cyclictest	0	-21	swapper/2	08:54:08	2
21171	99	53	41	cyclictest	0	-21	swapper/2	07:21:00	2
21171	99	53	41	cyclictest	0	-21	swapper/2	07:05:13	2
21171	99	53	41	cyclictest	0	-21	swapper/2	06:39:06	2
21171	99	53	41	cyclictest	0	-21	swapper/2	04:04:40	2
21169	99	53	52	cyclictest	760	50	irq/18-parport0	08:30:50	0
21169	99	53	52	cyclictest	760	50	irq/18-parport0	08:03:41	0
21169	99	53	52	cyclictest	760	50	irq/18-parport0	06:55:48	0
21169	99	53	52	cyclictest	0	-21	swapper/0	08:22:38	0
21169	99	53	52	cyclictest	0	-21	swapper/0	06:45:04	0
21169	99	53	52	cyclictest	0	-21	swapper/0	06:07:34	0
21169	99	53	51	cyclictest	0	-21	swapper/0	07:35:05	0
21171	99	52	51	cyclictest	0	-21	swapper/2	08:45:46	2
21171	99	52	51	cyclictest	0	-21	swapper/2	08:42:50	2
21171	99	52	51	cyclictest	0	-21	swapper/2	08:15:01	2
21171	99	52	51	cyclictest	0	-21	swapper/2	08:04:01	2
21171	99	52	51	cyclictest	0	-21	swapper/2	07:33:04	2
21171	99	52	51	cyclictest	0	-21	swapper/2	07:29:02	2
21171	99	52	51	cyclictest	0	-21	swapper/2	07:18:29	2
21171	99	52	51	cyclictest	0	-21	swapper/2	06:24:51	2
21171	99	52	51	cyclictest	0	-21	swapper/2	05:41:43	2
21171	99	52	51	cyclictest	0	-21	swapper/2	05:07:20	2
21171	99	52	51	cyclictest	0	-21	swapper/2	04:53:32	2
21171	99	52	51	cyclictest	0	-21	swapper/2	04:48:06	2
21171	99	52	51	cyclictest	0	-21	swapper/2	04:30:13	2
21171	99	52	50	cyclictest	30399	-21	forks	06:45:06	2
21171	99	52	41	cyclictest	0	-21	swapper/2	07:48:14	2
21171	99	52	41	cyclictest	0	-21	swapper/2	06:33:45	2
21169	99	52	51	cyclictest	760	50	irq/18-parport0	07:10:21	0
21169	99	52	51	cyclictest	278	-21	usb-storage	05:53:32	0
21169	99	52	51	cyclictest	10644	-21	telnet	04:45:07	0
21169	99	52	51	cyclictest	0	-21	swapper/0	08:45:36	0
21169	99	52	51	cyclictest	0	-21	swapper/0	08:15:01	0
21169	99	52	51	cyclictest	0	-21	swapper/0	08:09:58	0
21169	99	52	51	cyclictest	0	-21	swapper/0	07:45:00	0
21169	99	52	51	cyclictest	0	-21	swapper/0	07:23:55	0
21169	99	52	51	cyclictest	0	-21	swapper/0	07:06:45	0
21169	99	52	51	cyclictest	0	-21	swapper/0	07:00:54	0
21169	99	52	51	cyclictest	0	-21	swapper/0	06:35:49	0
21169	99	52	51	cyclictest	0	-21	swapper/0	06:13:53	0
21169	99	52	51	cyclictest	0	-21	swapper/0	05:55:14	0
21169	99	52	51	cyclictest	0	-21	swapper/0	05:21:21	0
21169	99	52	51	cyclictest	0	-21	swapper/0	05:19:09	0
21169	99	52	51	cyclictest	0	-21	swapper/0	05:06:22	0
21169	99	52	51	cyclictest	0	-21	swapper/0	05:00:07	0
21169	99	52	51	cyclictest	0	-21	swapper/0	04:55:40	0
21169	99	52	51	cyclictest	0	-21	swapper/0	04:43:07	0
21169	99	52	51	cyclictest	0	-21	swapper/0	04:16:58	0
21169	99	52	51	cyclictest	0	-21	swapper/0	04:05:09	0
21169	99	52	51	cyclictest	0	-21	swapper/0	04:04:50	0
21169	99	52	41	cyclictest	0	-21	swapper/0	05:10:54	0
21171	99	51	50	cyclictest	0	-21	swapper/2	07:11:01	2
21171	99	51	41	cyclictest	0	-21	swapper/2	08:08:19	2
21171	99	51	41	cyclictest	0	-21	swapper/2	04:57:34	2
21169	99	51	41	cyclictest	0	-21	swapper/0	09:15:10	0
21171	99	50	49	cyclictest	0	-21	swapper/2	08:25:00	2
21171	99	50	49	cyclictest	0	-21	swapper/2	07:00:34	2
21171	99	50	49	cyclictest	0	-21	swapper/2	06:57:24	2
21171	99	50	49	cyclictest	0	-21	swapper/2	05:22:05	2
21171	99	50	49	cyclictest	0	-21	swapper/2	05:10:28	2
21171	99	50	49	cyclictest	0	-21	swapper/2	04:42:55	2
21171	99	50	49	cyclictest	0	-21	swapper/2	04:08:45	2
21171	99	50	49	cyclictest	0	-21	swapper/2	03:59:34	2
21171	99	50	48	cyclictest	23822	-21	aten2.4_r3power	08:59:57	2
21171	99	50	41	cyclictest	278	-21	usb-storage	09:10:35	2
21169	99	50	41	cyclictest	0	-21	swapper/0	07:31:48	0
21169	99	50	41	cyclictest	0	-21	swapper/0	05:31:39	0
21169	99	50	41	cyclictest	0	-21	swapper/0	04:20:20	0
21171	99	49	48	cyclictest	0	-21	swapper/2	07:42:16	2
21171	99	49	48	cyclictest	0	-21	swapper/2	05:15:08	2
21171	99	49	47	cyclictest	0	-21	swapper/2	08:20:35	2
21169	99	49	42	cyclictest	50	50	irq/44-ahci	05:25:17	0
21171	99	48	47	cyclictest	0	-21	swapper/2	05:52:22	2
21169	99	48	44	cyclictest	0	-21	swapper/0	08:42:50	0
21169	99	48	41	cyclictest	50	50	irq/44-ahci	08:55:15	0
8	99	11	0	watchdog/0	19595	-21	grep	03:50:12	0
23	1	11	0	ksoftirqd/3	0	-21	swapper/3	03:51:16	3
16	99	10	0	migration/2	20385	-21	sendmail_mailtr	03:50:19	2
12	1	7	0	ksoftirqd/1	18867	-40	yum-updatesd-he	03:49:59	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17