OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Thu Jul 16, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
32405	99	104	103	cyclictest	0	-21	swapper/1	05:03:21	1
32405	99	104	102	cyclictest	28693	-21	tune2fs	05:08:19	1
32405	99	104	102	cyclictest	13615	-21	tune2fs	05:48:16	1
32407	99	103	102	cyclictest	0	-21	swapper/3	07:06:07	3
32407	99	103	102	cyclictest	0	-21	swapper/3	05:48:16	3
32407	99	103	102	cyclictest	0	-21	swapper/3	05:08:19	3
32407	99	103	102	cyclictest	0	-21	swapper/3	05:03:21	3
32407	99	93	92	cyclictest	0	-21	swapper/3	05:23:23	3
32405	99	93	92	cyclictest	0	-21	swapper/1	09:13:09	1
32407	99	85	73	cyclictest	278	-21	usb-storage	07:57:37	3
32405	99	85	83	cyclictest	18155	-21	tune2fs	08:28:09	1
32405	99	85	71	cyclictest	0	-21	swapper/1	05:57:41	1
32407	99	84	82	cyclictest	0	-21	swapper/3	05:28:24	3
32407	99	84	72	cyclictest	0	-21	swapper/3	08:57:55	3
32407	99	83	82	cyclictest	0	-21	swapper/3	09:28:07	3
32407	99	83	82	cyclictest	0	-21	swapper/3	09:23:07	3
32407	99	83	82	cyclictest	0	-21	swapper/3	09:18:06	3
32407	99	83	82	cyclictest	0	-21	swapper/3	09:13:06	3
32407	99	83	82	cyclictest	0	-21	swapper/3	09:08:06	3
32407	99	83	82	cyclictest	0	-21	swapper/3	09:03:10	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:58:09	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:48:07	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:43:08	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:38:07	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:33:09	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:28:08	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:23:08	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:18:09	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:13:10	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:08:10	3
32407	99	83	82	cyclictest	0	-21	swapper/3	08:03:10	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:58:09	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:48:11	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:43:10	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:38:11	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:33:12	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:28:11	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:23:11	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:18:15	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:13:12	3
32407	99	83	82	cyclictest	0	-21	swapper/3	07:08:12	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:58:12	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:58:12	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:53:14	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:48:13	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:43:12	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:38:13	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:33:15	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:28:14	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:23:14	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:18:13	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:13:14	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:08:15	3
32407	99	83	82	cyclictest	0	-21	swapper/3	06:03:13	3
32407	99	83	82	cyclictest	0	-21	swapper/3	05:58:15	3
32407	99	83	82	cyclictest	0	-21	swapper/3	05:53:15	3
32407	99	83	82	cyclictest	0	-21	swapper/3	05:43:14	3
32407	99	83	82	cyclictest	0	-21	swapper/3	05:38:15	3
32407	99	83	82	cyclictest	0	-21	swapper/3	05:33:16	3
32407	99	83	82	cyclictest	0	-21	swapper/3	05:18:19	3
32407	99	83	82	cyclictest	0	-21	swapper/3	05:13:17	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:58:18	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:53:26	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:48:20	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:43:16	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:38:18	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:33:17	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:28:19	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:23:17	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:18:18	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:13:21	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:08:18	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:08:18	3
32407	99	83	82	cyclictest	0	-21	swapper/3	04:05:12	3
32405	99	83	82	cyclictest	0	-21	swapper/1	09:28:12	1
32405	99	83	82	cyclictest	0	-21	swapper/1	09:23:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	09:18:07	1
32405	99	83	82	cyclictest	0	-21	swapper/1	09:08:07	1
32405	99	83	82	cyclictest	0	-21	swapper/1	09:03:15	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:58:12	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:53:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:48:08	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:43:07	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:38:08	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:33:09	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:23:13	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:18:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:13:11	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:08:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	08:03:14	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:58:09	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:53:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:43:15	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:38:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:33:13	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:28:12	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:23:12	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:18:12	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:13:13	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:08:11	1
32405	99	83	82	cyclictest	0	-21	swapper/1	07:03:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:58:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:58:10	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:53:13	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:48:13	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:43:12	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:38:13	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:33:15	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:28:14	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:18:14	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:13:17	1
32405	99	83	82	cyclictest	0	-21	swapper/1	06:03:17	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:58:14	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:43:14	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:38:16	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:33:17	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:28:20	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:23:16	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:18:16	1
32405	99	83	82	cyclictest	0	-21	swapper/1	05:13:17	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:58:19	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:53:17	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:48:21	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:43:16	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:38:17	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:33:21	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:28:19	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:23:17	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:18:23	1
32405	99	83	82	cyclictest	0	-21	swapper/1	04:13:21	1
32405	99	83	81	cyclictest	856	-21	tune2fs	07:48:12	1
32405	99	83	81	cyclictest	28348	-21	aten2.4-expect	06:23:12	1
32405	99	83	81	cyclictest	2747	-21	tune2fs	04:08:19	1
32405	99	83	81	cyclictest	2747	-21	tune2fs	04:08:19	1
32405	99	83	81	cyclictest	22572	-21	tune2fs	06:08:16	1
32405	99	73	72	cyclictest	0	-21	swapper/1	04:04:16	1
32406	99	62	61	cyclictest	0	-21	swapper/2	04:03:17	2
32406	99	58	56	cyclictest	2343	-21	telnet	04:08:17	2
32406	99	58	56	cyclictest	2343	-21	telnet	04:08:17	2
32406	99	56	55	cyclictest	0	-21	swapper/2	08:28:06	2
32406	99	54	52	cyclictest	0	-21	swapper/2	06:23:12	2
32406	99	54	52	cyclictest	0	-21	swapper/2	05:03:20	2
32404	99	54	53	cyclictest	278	-21	usb-storage	09:12:12	0
32404	99	54	52	cyclictest	760	50	irq/18-parport0	09:13:28	0
32406	99	53	52	cyclictest	278	-21	usb-storage	04:14:39	2
32406	99	53	52	cyclictest	0	-21	swapper/2	08:13:09	2
32406	99	53	52	cyclictest	0	-21	swapper/2	07:18:10	2
32406	99	53	52	cyclictest	0	-21	swapper/2	07:03:11	2
32406	99	53	52	cyclictest	0	-21	swapper/2	06:58:11	2
32406	99	53	52	cyclictest	0	-21	swapper/2	06:58:11	2
32406	99	53	52	cyclictest	0	-21	swapper/2	06:33:13	2
32406	99	53	52	cyclictest	0	-21	swapper/2	05:33:15	2
32406	99	53	52	cyclictest	0	-21	swapper/2	05:13:15	2
32406	99	53	52	cyclictest	0	-21	swapper/2	04:58:16	2
32406	99	53	52	cyclictest	0	-21	swapper/2	04:18:16	2
32406	99	53	51	cyclictest	9023	-21	telnet	05:38:15	2
32406	99	53	51	cyclictest	6828	-21	telnet	06:48:11	2
32406	99	53	51	cyclictest	4942	-21	telnet	09:13:04	2
32406	99	53	51	cyclictest	32557	-21	telnet	05:18:14	2
32406	99	53	51	cyclictest	2858	-21	telnet	09:08:06	2
32406	99	53	51	cyclictest	26233	-21	telnet	06:18:12	2
32406	99	53	51	cyclictest	17495	-21	telnet	04:43:14	2
32406	99	53	51	cyclictest	15596	-21	telnet	08:23:07	2
32406	99	53	51	cyclictest	15486	-21	telnet	07:08:09	2
32406	99	53	51	cyclictest	15291	-21	telnet	04:38:16	2
32404	99	53	52	cyclictest	760	50	irq/18-parport0	08:19:14	0
32404	99	53	52	cyclictest	760	50	irq/18-parport0	04:42:40	0
32404	99	53	41	cyclictest	0	-21	swapper/0	05:38:46	0
32406	99	52	51	cyclictest	9143	-21	telnet	06:53:12	2
32406	99	52	51	cyclictest	7181	-21	telnet	09:18:05	2
32406	99	52	51	cyclictest	438	-21	telnet	09:03:08	2
32406	99	52	51	cyclictest	30709	-21	telnet	07:43:09	2
32406	99	52	51	cyclictest	28593	-21	telnet	08:53:07	2
32406	99	52	51	cyclictest	278	-21	usb-storage	09:26:09	2
32406	99	52	51	cyclictest	278	-21	usb-storage	08:44:19	2
32406	99	52	51	cyclictest	278	-21	usb-storage	06:43:38	2
32406	99	52	51	cyclictest	2605	-21	telnet	06:38:12	2
32406	99	52	51	cyclictest	21911	-21	telnet	06:08:13	2
32406	99	52	51	cyclictest	0	-21	swapper/2	08:58:25	2
32406	99	52	51	cyclictest	0	-21	swapper/2	08:37:45	2
32406	99	52	51	cyclictest	0	-21	swapper/2	08:04:55	2
32406	99	52	51	cyclictest	0	-21	swapper/2	07:54:13	2
32406	99	52	51	cyclictest	0	-21	swapper/2	07:40:22	2
32406	99	52	51	cyclictest	0	-21	swapper/2	07:28:30	2
32406	99	52	51	cyclictest	0	-21	swapper/2	07:13:11	2
32406	99	52	51	cyclictest	0	-21	swapper/2	06:06:59	2
32406	99	52	51	cyclictest	0	-21	swapper/2	06:00:17	2
32406	99	52	51	cyclictest	0	-21	swapper/2	05:53:14	2
32406	99	52	51	cyclictest	0	-21	swapper/2	05:25:31	2
32406	99	52	51	cyclictest	0	-21	swapper/2	05:11:01	2
32406	99	52	51	cyclictest	0	-21	swapper/2	04:48:44	2
32404	99	52	51	cyclictest	760	50	irq/18-parport0	08:39:23	0
32404	99	52	51	cyclictest	760	50	irq/18-parport0	04:50:42	0
32404	99	52	51	cyclictest	278	-21	usb-storage	07:09:49	0
32404	99	52	51	cyclictest	0	-21	swapper/0	08:25:34	0
32404	99	52	51	cyclictest	0	-21	swapper/0	07:36:22	0
32404	99	52	51	cyclictest	0	-21	swapper/0	07:25:10	0
32404	99	52	51	cyclictest	0	-21	swapper/0	06:55:15	0
32404	99	52	51	cyclictest	0	-21	swapper/0	06:43:38	0
32404	99	52	51	cyclictest	0	-21	swapper/0	06:39:00	0
32404	99	52	51	cyclictest	0	-21	swapper/0	06:09:59	0
32404	99	52	51	cyclictest	0	-21	swapper/0	05:53:14	0
32404	99	52	51	cyclictest	0	-21	swapper/0	04:33:16	0
32404	99	52	51	cyclictest	0	-21	swapper/0	04:14:39	0
32404	99	51	50	cyclictest	0	-21	swapper/0	06:18:11	0
32404	99	51	33	cyclictest	3	1	ksoftirqd/0	08:32:39	0
32404	99	50	49	cyclictest	0	-21	swapper/0	07:43:09	0
32404	99	50	49	cyclictest	0	-21	swapper/0	06:23:12	0
32404	99	50	49	cyclictest	0	-21	swapper/0	05:08:17	0
32406	99	49	48	cyclictest	11187	-21	cpu	05:43:13	2
32404	99	49	42	cyclictest	4460	-21	kworker/0:0	09:21:12	0
32404	99	49	42	cyclictest	0	-21	swapper/0	08:53:45	0
32404	99	49	41	cyclictest	50	50	irq/44-ahci	08:43:47	0
32404	99	48	41	cyclictest	0	-21	swapper/0	08:14:40	0
32404	99	48	41	cyclictest	0	-21	swapper/0	06:33:16	0
32404	99	48	41	cyclictest	0	-21	swapper/0	04:47:42	0
32404	99	48	41	cyclictest	0	-21	swapper/0	04:28:25	0
32404	99	48	41	cyclictest	0	-21	swapper/0	04:23:27	0
32404	99	48	41	cyclictest	0	-21	swapper/0	04:04:24	0
32404	99	48	31	cyclictest	0	-21	swapper/0	07:21:10	0
32404	99	47	41	cyclictest	0	-21	swapper/0	08:59:18	0
32404	99	47	41	cyclictest	0	-21	swapper/0	07:39:22	0
32404	99	47	41	cyclictest	0	-21	swapper/0	05:18:23	0
32404	99	46	0	cyclictest	0	-21	swapper/0	09:25:04	0
32406	99	45	44	cyclictest	0	-21	swapper/2	06:28:53	2
32404	99	45	43	cyclictest	3	1	ksoftirqd/0	06:16:23	0
32406	99	44	43	cyclictest	0	-21	swapper/2	04:24:17	2
32406	99	44	42	cyclictest	50	50	irq/44-ahci	08:20:52	2
32406	99	44	42	cyclictest	278	-21	usb-storage	05:52:14	2
32406	99	44	42	cyclictest	0	-21	swapper/2	08:11:20	2
32404	99	44	43	cyclictest	0	-21	swapper/0	07:28:52	0
32404	99	44	42	cyclictest	50	50	irq/44-ahci	04:12:39	0
32404	99	44	42	cyclictest	50	50	irq/44-ahci	04:12:39	0
32404	99	44	42	cyclictest	3	1	ksoftirqd/0	07:51:45	0
32404	99	44	42	cyclictest	278	-21	usb-storage	05:50:30	0
32404	99	44	42	cyclictest	23269	-21	kworker/0:0	05:13:31	0
32404	99	44	42	cyclictest	1876	-21	hald-addon-stor	09:31:07	0
32404	99	44	42	cyclictest	1876	-21	hald-addon-stor	05:05:47	0
32406	99	43	42	cyclictest	278	-21	usb-storage	04:29:11	2
32406	99	43	42	cyclictest	0	-21	swapper/2	09:28:27	2
32406	99	43	42	cyclictest	0	-21	swapper/2	07:59:26	2
32406	99	43	42	cyclictest	0	-21	swapper/2	07:48:09	2
32406	99	43	42	cyclictest	0	-21	swapper/2	06:13:13	2
32406	99	43	42	cyclictest	0	-21	swapper/2	05:28:16	2
32406	99	43	41	cyclictest	50	50	irq/44-ahci	07:33:04	2
32406	99	43	41	cyclictest	0	-21	swapper/2	08:38:09	2
32406	99	43	41	cyclictest	0	-21	swapper/2	07:23:10	2
32406	99	43	41	cyclictest	0	-21	swapper/2	04:53:16	2
32404	99	43	42	cyclictest	760	50	irq/18-parport0	07:00:37	0
32404	99	43	42	cyclictest	760	50	irq/18-parport0	07:00:37	0
32404	99	43	42	cyclictest	0	-21	swapper/0	07:58:07	0
32404	99	43	42	cyclictest	0	-21	swapper/0	07:53:17	0
32404	99	43	42	cyclictest	0	-21	swapper/0	07:13:21	0
32404	99	43	42	cyclictest	0	-21	swapper/0	06:28:12	0
32404	99	43	42	cyclictest	0	-21	swapper/0	05:43:25	0
32404	99	43	42	cyclictest	0	-21	swapper/0	05:33:03	0
32404	99	43	42	cyclictest	0	-21	swapper/0	04:58:18	0
32404	99	43	41	cyclictest	760	50	irq/18-parport0	08:50:31	0
32404	99	43	41	cyclictest	50	50	irq/44-ahci	08:05:35	0
32404	99	43	41	cyclictest	50	50	irq/44-ahci	06:03:52	0
32404	99	43	41	cyclictest	50	50	irq/44-ahci	05:30:06	0
32404	99	43	41	cyclictest	278	-21	usb-storage	05:59:19	0
32404	99	43	41	cyclictest	0	-21	swapper/0	04:53:16	0
32404	99	43	31	cyclictest	0	-21	swapper/0	09:03:11	0
32404	99	43	31	cyclictest	0	-21	swapper/0	08:34:29	0
32404	99	43	31	cyclictest	0	-21	swapper/0	08:12:57	0
32404	99	43	31	cyclictest	0	-21	swapper/0	05:24:33	0
32406	99	42	41	cyclictest	0	-21	swapper/2	08:47:57	2
32406	99	42	41	cyclictest	0	-21	swapper/2	04:33:13	2
32404	99	42	41	cyclictest	0	-21	swapper/0	07:03:11	0
32404	99	42	41	cyclictest	0	-21	swapper/0	06:48:11	0
32404	99	42	41	cyclictest	0	-21	swapper/0	04:18:12	0
31943	2	12	1	sleep1	0	-21	swapper/1	03:59:20	1
3	1	11	0	ksoftirqd/0	0	-21	swapper/0	04:00:34	0
16	99	11	0	migration/2	31738	-21	unixbench-2d	03:58:27	2
23	1	10	0	ksoftirqd/3	0	-21	swapper/3	04:00:34	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17