OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Wed May 13, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
17357	99	94	92	cyclictest	6806	-21	aten2.4-expect	05:51:14	3
17338	99	94	92	cyclictest	29055	-21	tune2fs	07:56:11	1
17338	99	91	90	cyclictest	613	-21	tune2fs	06:51:13	1
17338	99	88	87	cyclictest	0	-21	swapper/1	07:36:09	1
17338	99	85	82	cyclictest	0	-21	swapper/1	07:51:18	1
17338	99	84	82	cyclictest	3327	-21	tune2fs	08:11:11	1
17357	99	83	82	cyclictest	0	-21	swapper/3	10:21:08	3
17357	99	83	82	cyclictest	0	-21	swapper/3	10:16:10	3
17357	99	83	82	cyclictest	0	-21	swapper/3	10:01:14	3
17357	99	83	82	cyclictest	0	-21	swapper/3	09:56:13	3
17357	99	83	82	cyclictest	0	-21	swapper/3	09:51:53	3
17357	99	83	82	cyclictest	0	-21	swapper/3	09:16:08	3
17357	99	83	82	cyclictest	0	-21	swapper/3	09:11:15	3
17357	99	83	82	cyclictest	0	-21	swapper/3	08:46:15	3
17357	99	83	82	cyclictest	0	-21	swapper/3	08:41:08	3
17357	99	83	82	cyclictest	0	-21	swapper/3	08:31:16	3
17357	99	83	82	cyclictest	0	-21	swapper/3	08:06:16	3
17357	99	83	82	cyclictest	0	-21	swapper/3	08:01:18	3
17357	99	83	82	cyclictest	0	-21	swapper/3	07:46:21	3
17357	99	83	82	cyclictest	0	-21	swapper/3	07:38:07	3
17357	99	83	82	cyclictest	0	-21	swapper/3	07:23:05	3
17357	99	83	82	cyclictest	0	-21	swapper/3	07:20:59	3
17357	99	83	82	cyclictest	0	-21	swapper/3	07:11:20	3
17357	99	83	82	cyclictest	0	-21	swapper/3	07:01:20	3
17357	99	83	82	cyclictest	0	-21	swapper/3	06:46:21	3
17357	99	83	82	cyclictest	0	-21	swapper/3	06:36:22	3
17357	99	83	82	cyclictest	0	-21	swapper/3	06:26:20	3
17357	99	83	82	cyclictest	0	-21	swapper/3	06:16:12	3
17357	99	83	82	cyclictest	0	-21	swapper/3	06:12:52	3
17357	99	83	82	cyclictest	0	-21	swapper/3	05:56:20	3
17357	99	83	82	cyclictest	0	-21	swapper/3	05:46:22	3
17357	99	83	82	cyclictest	0	-21	swapper/3	05:41:24	3
17357	99	83	82	cyclictest	0	-21	swapper/3	05:27:44	3
17357	99	83	82	cyclictest	0	-21	swapper/3	05:21:18	3
17357	99	83	82	cyclictest	0	-21	swapper/3	05:17:43	3
17357	99	83	82	cyclictest	0	-21	swapper/3	05:12:42	3
17357	99	83	81	cyclictest	392	-21	md2_raid1	05:01:04	3
17357	99	83	81	cyclictest	22151	-21	aten2.4_r3power	07:41:08	3
17338	99	83	82	cyclictest	0	-21	swapper/1	10:21:12	1
17338	99	83	82	cyclictest	0	-21	swapper/1	10:20:52	1
17338	99	83	82	cyclictest	0	-21	swapper/1	10:13:33	1
17338	99	83	82	cyclictest	0	-21	swapper/1	10:06:13	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:51:53	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:46:13	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:36:13	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:31:14	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:31:14	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:26:16	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:18:24	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:15:55	1
17338	99	83	82	cyclictest	0	-21	swapper/1	09:06:15	1
17338	99	83	82	cyclictest	0	-21	swapper/1	08:56:15	1
17338	99	83	82	cyclictest	0	-21	swapper/1	08:41:08	1
17338	99	83	82	cyclictest	0	-21	swapper/1	08:21:17	1
17338	99	83	82	cyclictest	0	-21	swapper/1	08:01:19	1
17338	99	83	82	cyclictest	0	-21	swapper/1	07:46:13	1
17338	99	83	82	cyclictest	0	-21	swapper/1	07:41:17	1
17338	99	83	82	cyclictest	0	-21	swapper/1	07:21:19	1
17338	99	83	82	cyclictest	0	-21	swapper/1	07:16:18	1
17338	99	83	82	cyclictest	0	-21	swapper/1	06:58:00	1
17338	99	83	82	cyclictest	0	-21	swapper/1	06:41:21	1
17338	99	83	82	cyclictest	0	-21	swapper/1	06:32:56	1
17338	99	83	82	cyclictest	0	-21	swapper/1	06:27:54	1
17338	99	83	82	cyclictest	0	-21	swapper/1	05:57:49	1
17338	99	83	82	cyclictest	0	-21	swapper/1	05:52:48	1
17338	99	83	82	cyclictest	0	-21	swapper/1	05:36:22	1
17338	99	83	82	cyclictest	0	-21	swapper/1	05:31:24	1
17338	99	83	82	cyclictest	0	-21	swapper/1	05:16:25	1
17338	99	83	82	cyclictest	0	-21	swapper/1	05:06:25	1
17338	99	83	81	cyclictest	9899	-21	tune2fs	09:41:06	1
17338	99	83	81	cyclictest	3134	-21	tune2fs	05:41:17	1
17338	99	83	81	cyclictest	16188	-21	tune2fs	09:56:06	1
17338	99	83	81	cyclictest	13746	-21	tune2fs	06:06:15	1
17357	99	82	81	cyclictest	0	-21	swapper/3	09:46:06	3
17357	99	82	81	cyclictest	0	-21	swapper/3	08:51:10	3
17357	99	82	81	cyclictest	0	-21	swapper/3	07:26:14	3
17357	99	82	81	cyclictest	0	-21	swapper/3	06:51:13	3
17357	99	82	81	cyclictest	0	-21	swapper/3	06:01:16	3
17338	99	82	80	cyclictest	18095	-21	tune2fs	06:16:15	1
17357	99	75	72	cyclictest	0	-21	swapper/3	10:06:05	3
17357	99	73	72	cyclictest	0	-21	swapper/3	10:26:08	3
17357	99	73	72	cyclictest	0	-21	swapper/3	09:42:54	3
17357	99	73	72	cyclictest	0	-21	swapper/3	09:31:44	3
17357	99	73	72	cyclictest	0	-21	swapper/3	09:31:44	3
17357	99	73	72	cyclictest	0	-21	swapper/3	09:26:07	3
17357	99	73	72	cyclictest	0	-21	swapper/3	09:06:11	3
17357	99	73	72	cyclictest	0	-21	swapper/3	09:01:17	3
17357	99	73	72	cyclictest	0	-21	swapper/3	08:36:20	3
17357	99	73	72	cyclictest	0	-21	swapper/3	08:26:10	3
17357	99	73	72	cyclictest	0	-21	swapper/3	08:21:08	3
17357	99	73	72	cyclictest	0	-21	swapper/3	07:55:10	3
17357	99	73	72	cyclictest	0	-21	swapper/3	07:31:15	3
17357	99	73	72	cyclictest	0	-21	swapper/3	06:56:12	3
17357	99	73	72	cyclictest	0	-21	swapper/3	06:31:22	3
17357	99	73	72	cyclictest	0	-21	swapper/3	06:21:12	3
17357	99	73	72	cyclictest	0	-21	swapper/3	06:06:22	3
17357	99	73	72	cyclictest	0	-21	swapper/3	05:36:21	3
17357	99	73	72	cyclictest	0	-21	swapper/3	05:31:14	3
17357	99	73	71	cyclictest	23922	-21	runrttasks	10:11:40	3
17338	99	73	72	cyclictest	0	-21	swapper/1	10:26:03	1
17338	99	73	72	cyclictest	0	-21	swapper/1	10:01:14	1
17338	99	73	72	cyclictest	0	-21	swapper/1	09:23:12	1
17338	99	73	72	cyclictest	0	-21	swapper/1	08:52:03	1
17338	99	73	72	cyclictest	0	-21	swapper/1	08:46:06	1
17338	99	73	72	cyclictest	0	-21	swapper/1	08:36:17	1
17338	99	73	72	cyclictest	0	-21	swapper/1	08:27:58	1
17338	99	73	72	cyclictest	0	-21	swapper/1	08:16:46	1
17338	99	73	72	cyclictest	0	-21	swapper/1	07:14:20	1
17338	99	73	72	cyclictest	0	-21	swapper/1	05:01:19	1
17338	99	73	71	cyclictest	16096	-21	tune2fs	07:26:14	1
17338	99	73	61	cyclictest	0	-21	swapper/1	08:08:56	1
17357	99	72	61	cyclictest	2982	-21	df_abs	08:11:10	3
17357	99	72	61	cyclictest	2139	-21	unixbench_singl	09:21:17	3
17338	99	72	71	cyclictest	0	-21	swapper/1	07:31:19	1
17338	99	72	60	cyclictest	0	-21	swapper/1	06:02:50	1
17357	99	71	70	cyclictest	0	-21	swapper/3	07:56:11	3
17338	99	69	68	cyclictest	0	-21	swapper/1	05:29:16	1
17326	99	68	60	cyclictest	0	-21	swapper/0	07:04:27	0
17357	99	66	62	cyclictest	0	-21	swapper/3	09:00:55	3
17357	99	66	52	cyclictest	0	-21	swapper/3	06:42:48	3
17338	99	66	62	cyclictest	0	-21	swapper/1	05:16:03	1
17357	99	65	52	cyclictest	0	-21	swapper/3	08:16:46	3
17338	99	65	63	cyclictest	11868	-21	tune2fs	08:31:09	1
17338	99	65	62	cyclictest	0	-21	swapper/1	06:11:23	1
17338	99	64	63	cyclictest	0	-21	swapper/1	09:01:17	1
17338	99	64	62	cyclictest	5324	-21	tune2fs	07:01:13	1
17357	99	63	62	cyclictest	0	-21	swapper/3	09:35:54	3
17357	99	63	62	cyclictest	0	-21	swapper/3	07:06:00	3
17357	99	63	62	cyclictest	0	-21	swapper/3	05:06:15	3
17357	99	63	62	cyclictest	0	-21	swapper/3	05:01:04	3
17349	99	63	62	cyclictest	0	-21	swapper/2	06:51:12	2
17338	99	63	62	cyclictest	1386	-13	audispd	05:21:03	1
17338	99	63	62	cyclictest	0	-21	swapper/1	07:06:00	1
17338	99	63	62	cyclictest	0	-21	swapper/1	06:46:11	1
17338	99	63	62	cyclictest	0	-21	swapper/1	06:36:12	1
17338	99	63	62	cyclictest	0	-21	swapper/1	06:21:12	1
17338	99	63	62	cyclictest	0	-21	swapper/1	05:46:14	1
17338	99	63	62	cyclictest	0	-21	swapper/1	05:01:04	1
17349	99	62	52	cyclictest	0	-21	swapper/2	09:01:50	2
17326	99	62	61	cyclictest	0	-21	swapper/0	07:55:05	0
17326	99	62	61	cyclictest	0	-21	swapper/0	05:34:42	0
17349	99	61	52	cyclictest	0	-21	swapper/2	08:13:52	2
17349	99	60	51	cyclictest	0	-21	swapper/2	10:10:12	2
17349	99	60	51	cyclictest	0	-21	swapper/2	08:04:29	2
17349	99	59	54	cyclictest	0	-21	swapper/2	06:10:19	2
17349	99	59	42	cyclictest	50	50	irq/44-ahci	08:56:01	2
17326	99	59	51	cyclictest	0	-21	swapper/0	08:48:53	0
17349	99	58	52	cyclictest	50	50	irq/44-ahci	10:26:57	2
17349	99	58	51	cyclictest	28324	-21	telnet	05:26:15	2
17349	99	58	41	cyclictest	278	-21	usb-storage	08:06:40	2
17349	99	58	41	cyclictest	0	-21	swapper/2	05:16:23	2
17326	99	58	51	cyclictest	0	-21	swapper/0	08:03:39	0
17326	99	58	50	cyclictest	0	-21	swapper/0	08:07:42	0
17326	99	58	41	cyclictest	0	-21	swapper/0	09:38:45	0
17349	99	57	52	cyclictest	278	-21	usb-storage	09:20:48	2
17349	99	57	52	cyclictest	18	1	ksoftirqd/2	09:46:13	2
17349	99	57	52	cyclictest	18	1	ksoftirqd/2	05:31:24	2
17349	99	57	52	cyclictest	0	-21	swapper/2	09:41:47	2
17349	99	57	52	cyclictest	0	-21	swapper/2	09:32:53	2
17349	99	57	52	cyclictest	0	-21	swapper/2	09:32:53	2
17349	99	57	52	cyclictest	0	-21	swapper/2	08:28:46	2
17349	99	57	52	cyclictest	0	-21	swapper/2	08:22:40	2
17349	99	57	52	cyclictest	0	-21	swapper/2	07:21:10	2
17349	99	57	52	cyclictest	0	-21	swapper/2	07:02:23	2
17349	99	57	52	cyclictest	0	-21	swapper/2	06:37:56	2
17349	99	57	52	cyclictest	0	-21	swapper/2	06:33:50	2
17349	99	57	52	cyclictest	0	-21	swapper/2	05:23:05	2
17349	99	57	51	cyclictest	50	50	irq/44-ahci	09:37:45	2
17349	99	57	51	cyclictest	50	50	irq/44-ahci	09:10:40	2
17349	99	57	51	cyclictest	278	-21	usb-storage	10:18:41	2
17349	99	57	51	cyclictest	278	-21	usb-storage	09:14:26	2
17349	99	57	51	cyclictest	278	-21	usb-storage	08:55:05	2
17349	99	57	51	cyclictest	278	-21	usb-storage	06:00:47	2
17349	99	57	51	cyclictest	278	-21	usb-storage	05:52:06	2
17349	99	57	51	cyclictest	2217	-21	snmpd	07:08:02	2
17349	99	57	51	cyclictest	20812	-21	iostat	07:36:14	2
17349	99	57	51	cyclictest	0	-21	swapper/2	10:21:02	2
17349	99	57	41	cyclictest	9202	-21	telnet	07:11:11	2
17349	99	57	41	cyclictest	0	-21	swapper/2	08:20:16	2
17349	99	57	41	cyclictest	0	-21	swapper/2	07:52:27	2
17349	99	57	41	cyclictest	0	-21	swapper/2	07:26:44	2
17349	99	57	41	cyclictest	0	-21	swapper/2	06:46:51	2
17349	99	57	41	cyclictest	0	-21	swapper/2	06:45:48	2
17349	99	57	41	cyclictest	0	-21	swapper/2	06:01:34	2
17349	99	57	41	cyclictest	0	-21	swapper/2	05:36:17	2
17349	99	57	41	cyclictest	0	-21	swapper/2	05:08:39	2
17326	99	57	50	cyclictest	0	-21	swapper/0	10:10:44	0
17326	99	57	50	cyclictest	0	-21	swapper/0	06:40:18	0
17326	99	57	41	cyclictest	0	-21	swapper/0	05:43:24	0
17349	99	56	51	cyclictest	278	-21	usb-storage	09:52:46	2
17349	99	56	51	cyclictest	278	-21	usb-storage	09:27:37	2
17349	99	56	51	cyclictest	0	-21	swapper/2	10:12:50	2
17349	99	56	51	cyclictest	0	-21	swapper/2	10:01:28	2
17349	99	56	51	cyclictest	0	-21	swapper/2	09:55:54	2
17349	99	56	51	cyclictest	0	-21	swapper/2	09:21:00	2
17349	99	56	51	cyclictest	0	-21	swapper/2	08:47:51	2
17349	99	56	51	cyclictest	0	-21	swapper/2	08:42:29	2
17349	99	56	51	cyclictest	0	-21	swapper/2	08:40:17	2
17349	99	56	51	cyclictest	0	-21	swapper/2	08:31:07	2
17349	99	56	51	cyclictest	0	-21	swapper/2	07:58:47	2
17349	99	56	51	cyclictest	0	-21	swapper/2	07:43:43	2
17349	99	56	51	cyclictest	0	-21	swapper/2	07:34:28	2
17349	99	56	51	cyclictest	0	-21	swapper/2	07:16:09	2
17349	99	56	51	cyclictest	0	-21	swapper/2	06:26:22	2
17349	99	56	51	cyclictest	0	-21	swapper/2	06:23:34	2
17349	99	56	51	cyclictest	0	-21	swapper/2	06:16:12	2
17349	99	56	51	cyclictest	0	-21	swapper/2	06:14:07	2
17349	99	56	51	cyclictest	0	-21	swapper/2	05:46:14	2
17349	99	56	51	cyclictest	0	-21	swapper/2	05:41:14	2
17349	99	56	51	cyclictest	0	-21	swapper/2	05:15:19	2
17349	99	56	51	cyclictest	0	-21	swapper/2	05:01:15	2
17349	99	56	41	cyclictest	0	-21	swapper/2	07:47:37	2
17326	99	56	49	cyclictest	0	-21	swapper/0	09:43:19	0
17326	99	56	49	cyclictest	0	-21	swapper/0	09:22:46	0
17326	99	56	49	cyclictest	0	-21	swapper/0	09:16:06	0
17326	99	56	49	cyclictest	0	-21	swapper/0	08:25:58	0
17349	99	55	51	cyclictest	0	-21	swapper/2	06:56:29	2
17326	99	55	48	cyclictest	0	-21	swapper/0	07:41:09	0
17326	99	53	51	cyclictest	50	50	irq/44-ahci	05:36:42	0
17326	99	52	51	cyclictest	0	-21	swapper/0	10:29:13	0
17326	99	52	51	cyclictest	0	-21	swapper/0	10:16:32	0
17326	99	52	51	cyclictest	0	-21	swapper/0	10:11:44	0
17326	99	52	51	cyclictest	0	-21	swapper/0	09:57:42	0
17326	99	52	51	cyclictest	0	-21	swapper/0	09:48:59	0
17326	99	52	51	cyclictest	0	-21	swapper/0	09:31:59	0
17326	99	52	51	cyclictest	0	-21	swapper/0	09:31:59	0
17326	99	52	51	cyclictest	0	-21	swapper/0	09:26:17	0
17326	99	52	51	cyclictest	0	-21	swapper/0	09:12:16	0
17326	99	52	51	cyclictest	0	-21	swapper/0	08:57:53	0
17326	99	52	51	cyclictest	0	-21	swapper/0	08:54:29	0
17326	99	52	51	cyclictest	0	-21	swapper/0	08:16:34	0
17326	99	52	51	cyclictest	0	-21	swapper/0	07:48:43	0
17326	99	52	51	cyclictest	0	-21	swapper/0	07:22:14	0
17326	99	52	51	cyclictest	0	-21	swapper/0	07:18:00	0
17326	99	52	51	cyclictest	0	-21	swapper/0	06:59:05	0
17326	99	52	51	cyclictest	0	-21	swapper/0	06:47:07	0
17326	99	52	51	cyclictest	0	-21	swapper/0	06:45:10	0
17326	99	52	51	cyclictest	0	-21	swapper/0	06:24:38	0
17326	99	52	51	cyclictest	0	-21	swapper/0	06:17:27	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:59:09	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:54:33	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:28:12	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:21:13	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:16:23	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:11:39	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:07:41	0
17326	99	52	51	cyclictest	0	-21	swapper/0	05:05:19	0
17326	99	52	45	cyclictest	0	-21	swapper/0	07:57:15	0
17326	99	52	45	cyclictest	0	-21	swapper/0	06:26:22	0
17326	99	51	50	cyclictest	0	-21	swapper/0	10:20:55	0
17326	99	51	50	cyclictest	0	-21	swapper/0	10:01:40	0
17326	99	51	50	cyclictest	0	-21	swapper/0	09:55:06	0
17326	99	51	50	cyclictest	0	-21	swapper/0	09:10:02	0
17326	99	51	50	cyclictest	0	-21	swapper/0	08:36:01	0
17326	99	51	50	cyclictest	0	-21	swapper/0	08:32:11	0
17326	99	51	50	cyclictest	0	-21	swapper/0	08:22:20	0
17326	99	51	50	cyclictest	0	-21	swapper/0	07:40:15	0
17326	99	51	50	cyclictest	0	-21	swapper/0	07:30:56	0
17326	99	51	50	cyclictest	0	-21	swapper/0	07:14:12	0
17326	99	51	50	cyclictest	0	-21	swapper/0	07:06:59	0
17326	99	51	50	cyclictest	0	-21	swapper/0	06:54:15	0
17326	99	51	50	cyclictest	0	-21	swapper/0	06:31:54	0
17326	99	51	50	cyclictest	0	-21	swapper/0	06:11:33	0
17326	99	51	50	cyclictest	0	-21	swapper/0	06:06:21	0
17326	99	51	50	cyclictest	0	-21	swapper/0	06:01:39	0
17326	99	51	50	cyclictest	0	-21	swapper/0	05:47:00	0
17326	99	50	49	cyclictest	0	-21	swapper/0	09:04:38	0
17326	99	50	49	cyclictest	0	-21	swapper/0	08:42:07	0
17326	99	50	49	cyclictest	0	-21	swapper/0	07:31:50	0
17326	99	49	48	cyclictest	0	-21	swapper/0	08:11:52	0
17326	99	43	42	cyclictest	0	-21	swapper/0	05:01:04	0
17349	99	42	41	cyclictest	0	-21	swapper/2	05:01:04	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17