OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Thu Jul 02, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
5749	99	103	102	cyclictest	0	-21	swapper/3	07:36:03	3
5749	99	103	102	cyclictest	0	-21	swapper/3	05:40:58	3
5747	99	103	102	cyclictest	20341	-21	ps	08:30:55	1
5747	99	103	102	cyclictest	0	-21	swapper/1	05:50:57	1
5749	99	93	92	cyclictest	0	-21	swapper/3	09:15:56	3
5749	99	93	92	cyclictest	0	-21	swapper/3	08:30:55	3
5749	99	93	92	cyclictest	0	-21	swapper/3	08:16:02	3
5749	99	93	92	cyclictest	0	-21	swapper/3	07:31:01	3
5749	99	93	92	cyclictest	0	-21	swapper/3	07:16:00	3
5749	99	93	92	cyclictest	0	-21	swapper/3	07:01:02	3
5749	99	93	92	cyclictest	0	-21	swapper/3	07:01:02	3
5749	99	93	92	cyclictest	0	-21	swapper/3	06:06:07	3
5749	99	93	92	cyclictest	0	-21	swapper/3	05:20:44	3
5749	99	93	92	cyclictest	0	-21	swapper/3	04:50:59	3
5749	99	93	92	cyclictest	0	-21	swapper/3	04:42:52	3
5747	99	84	83	cyclictest	10375	-21	aten2.4-expect	06:55:51	1
5749	99	83	82	cyclictest	0	-21	swapper/3	09:44:14	3
5749	99	83	82	cyclictest	0	-21	swapper/3	09:30:56	3
5749	99	83	82	cyclictest	0	-21	swapper/3	09:25:55	3
5749	99	83	82	cyclictest	0	-21	swapper/3	09:05:56	3
5749	99	83	82	cyclictest	0	-21	swapper/3	08:45:52	3
5749	99	83	82	cyclictest	0	-21	swapper/3	08:40:49	3
5749	99	83	82	cyclictest	0	-21	swapper/3	08:35:57	3
5749	99	83	82	cyclictest	0	-21	swapper/3	08:35:57	3
5749	99	83	82	cyclictest	0	-21	swapper/3	08:29:02	3
5749	99	83	82	cyclictest	0	-21	swapper/3	07:55:54	3
5749	99	83	82	cyclictest	0	-21	swapper/3	07:20:53	3
5749	99	83	82	cyclictest	0	-21	swapper/3	07:13:51	3
5749	99	83	82	cyclictest	0	-21	swapper/3	07:09:46	3
5749	99	83	82	cyclictest	0	-21	swapper/3	06:38:45	3
5749	99	83	82	cyclictest	0	-21	swapper/3	06:03:39	3
5749	99	83	82	cyclictest	0	-21	swapper/3	05:50:57	3
5749	99	83	82	cyclictest	0	-21	swapper/3	05:46:05	3
5749	99	83	82	cyclictest	0	-21	swapper/3	05:21:02	3
5749	99	83	82	cyclictest	0	-21	swapper/3	04:36:07	3
5749	99	83	82	cyclictest	0	-21	swapper/3	04:35:47	3
5749	99	83	82	cyclictest	0	-21	swapper/3	04:26:01	3
5749	99	83	82	cyclictest	0	-21	swapper/3	04:20:58	3
5747	99	83	82	cyclictest	6688	-21	tune2fs	08:00:54	1
5747	99	83	82	cyclictest	32353	-21	tune2fs	06:30:57	1
5747	99	83	82	cyclictest	0	-21	swapper/1	09:25:57	1
5747	99	83	82	cyclictest	0	-21	swapper/1	09:10:52	1
5747	99	83	82	cyclictest	0	-21	swapper/1	08:55:36	1
5747	99	83	82	cyclictest	0	-21	swapper/1	08:40:37	1
5747	99	83	82	cyclictest	0	-21	swapper/1	08:40:37	1
5747	99	83	82	cyclictest	0	-21	swapper/1	08:25:58	1
5747	99	83	82	cyclictest	0	-21	swapper/1	08:25:38	1
5747	99	83	82	cyclictest	0	-21	swapper/1	08:05:54	1
5747	99	83	82	cyclictest	0	-21	swapper/1	07:55:39	1
5747	99	83	82	cyclictest	0	-21	swapper/1	07:35:56	1
5747	99	83	82	cyclictest	0	-21	swapper/1	07:11:02	1
5747	99	83	82	cyclictest	0	-21	swapper/1	07:05:59	1
5747	99	83	82	cyclictest	0	-21	swapper/1	07:05:41	1
5747	99	83	82	cyclictest	0	-21	swapper/1	07:05:41	1
5747	99	83	82	cyclictest	0	-21	swapper/1	06:45:59	1
5747	99	83	82	cyclictest	0	-21	swapper/1	06:21:05	1
5747	99	83	82	cyclictest	0	-21	swapper/1	06:16:06	1
5747	99	83	82	cyclictest	0	-21	swapper/1	06:13:41	1
5747	99	83	82	cyclictest	0	-21	swapper/1	06:06:43	1
5747	99	83	82	cyclictest	0	-21	swapper/1	05:46:02	1
5747	99	83	82	cyclictest	0	-21	swapper/1	05:20:44	1
5747	99	83	82	cyclictest	0	-21	swapper/1	05:10:56	1
5747	99	83	82	cyclictest	0	-21	swapper/1	04:36:03	1
5747	99	83	81	cyclictest	6938	-21	tune2fs	09:15:50	1
5747	99	83	81	cyclictest	4194	-21	tune2fs	05:25:58	1
5747	99	83	81	cyclictest	4194	-21	tune2fs	05:25:58	1
5747	99	83	81	cyclictest	32754	-21	tune2fs	09:00:51	1
5747	99	83	81	cyclictest	30167	-21	tune2fs	06:25:55	1
5747	99	83	81	cyclictest	29875	-21	aten2.4-expect	08:55:47	1
5747	99	83	81	cyclictest	27431	-21	aten2.4-expect	05:05:57	1
5747	99	83	81	cyclictest	21505	-21	tune2fs	07:20:53	1
5747	99	83	81	cyclictest	19495	-21	tune2fs	06:00:57	1
5747	99	83	81	cyclictest	17085	-21	aten2.4_r3power	09:40:47	1
5747	99	83	81	cyclictest	13227	-21	tune2fs	09:30:49	1
5747	99	83	81	cyclictest	10574	-21	tune2fs	05:40:58	1
5747	99	83	81	cyclictest	10502	-21	tune2fs	04:26:00	1
5749	99	82	81	cyclictest	392	-21	md2_raid1	06:55:41	3
5749	99	82	81	cyclictest	0	-21	swapper/3	09:00:51	3
5749	99	82	81	cyclictest	0	-21	swapper/3	06:25:55	3
5749	99	82	81	cyclictest	0	-21	swapper/3	05:25:56	3
5749	99	82	81	cyclictest	0	-21	swapper/3	05:25:56	3
5747	99	82	81	cyclictest	8650	-21	tune2fs	06:50:57	1
5747	99	82	81	cyclictest	4432	-21	tune2fs	06:40:56	1
5747	99	82	81	cyclictest	23718	-21	tune2fs	04:55:59	1
5747	99	82	71	cyclictest	0	-21	swapper/1	09:20:54	1
5747	99	82	71	cyclictest	0	-21	swapper/1	07:41:01	1
5749	99	75	74	cyclictest	17016	-21	munin-node	05:55:57	3
5749	99	74	72	cyclictest	0	-21	swapper/3	08:20:58	3
5749	99	73	72	cyclictest	0	-21	swapper/3	09:35:46	3
5749	99	73	72	cyclictest	0	-21	swapper/3	09:10:50	3
5749	99	73	72	cyclictest	0	-21	swapper/3	08:55:47	3
5749	99	73	72	cyclictest	0	-21	swapper/3	08:54:22	3
5749	99	73	72	cyclictest	0	-21	swapper/3	08:05:57	3
5749	99	73	72	cyclictest	0	-21	swapper/3	07:51:00	3
5749	99	73	72	cyclictest	0	-21	swapper/3	07:45:55	3
5749	99	73	72	cyclictest	0	-21	swapper/3	07:40:52	3
5749	99	73	72	cyclictest	0	-21	swapper/3	07:28:24	3
5749	99	73	72	cyclictest	0	-21	swapper/3	06:50:42	3
5749	99	73	72	cyclictest	0	-21	swapper/3	06:41:04	3
5749	99	73	72	cyclictest	0	-21	swapper/3	06:21:04	3
5749	99	73	72	cyclictest	0	-21	swapper/3	06:10:56	3
5749	99	73	72	cyclictest	0	-21	swapper/3	05:31:08	3
5749	99	73	72	cyclictest	0	-21	swapper/3	05:05:58	3
5749	99	73	72	cyclictest	0	-21	swapper/3	04:16:00	3
5747	99	73	72	cyclictest	0	-21	swapper/1	08:40:57	1
5747	99	73	72	cyclictest	0	-21	swapper/1	08:14:00	1
5747	99	73	72	cyclictest	0	-21	swapper/1	07:56:40	1
5747	99	73	72	cyclictest	0	-21	swapper/1	07:50:10	1
5747	99	73	72	cyclictest	0	-21	swapper/1	07:30:53	1
5747	99	73	72	cyclictest	0	-21	swapper/1	07:26:32	1
5747	99	73	72	cyclictest	0	-21	swapper/1	07:17:24	1
5747	99	73	72	cyclictest	0	-21	swapper/1	06:35:56	1
5747	99	73	72	cyclictest	0	-21	swapper/1	05:55:58	1
5747	99	73	72	cyclictest	0	-21	swapper/1	05:36:02	1
5747	99	73	72	cyclictest	0	-21	swapper/1	05:04:09	1
5747	99	73	72	cyclictest	0	-21	swapper/1	04:16:09	1
5749	99	72	71	cyclictest	0	-21	swapper/3	09:20:44	3
5749	99	72	71	cyclictest	0	-21	swapper/3	08:10:48	3
5749	99	72	71	cyclictest	0	-21	swapper/3	08:00:52	3
5749	99	72	71	cyclictest	0	-21	swapper/3	06:55:52	3
5749	99	72	71	cyclictest	0	-21	swapper/3	06:30:55	3
5749	99	72	71	cyclictest	0	-21	swapper/3	06:15:54	3
5749	99	72	71	cyclictest	0	-21	swapper/3	05:35:57	3
5749	99	72	71	cyclictest	0	-21	swapper/3	05:10:55	3
5749	99	72	71	cyclictest	0	-21	swapper/3	05:01:03	3
5749	99	72	71	cyclictest	0	-21	swapper/3	04:55:48	3
5749	99	72	71	cyclictest	0	-21	swapper/3	04:45:58	3
5747	99	72	71	cyclictest	1813	-21	aten2.4-expect	09:05:47	1
5747	99	72	71	cyclictest	14980	-21	aten2.4-expect	09:35:46	1
5747	99	63	62	cyclictest	0	-21	swapper/1	08:45:37	1
5747	99	63	62	cyclictest	0	-21	swapper/1	08:15:50	1
5747	99	63	62	cyclictest	0	-21	swapper/1	05:30:45	1
5747	99	63	62	cyclictest	0	-21	swapper/1	05:20:54	1
5747	99	63	62	cyclictest	0	-21	swapper/1	04:50:49	1
5747	99	63	62	cyclictest	0	-21	swapper/1	04:45:52	1
5747	99	63	62	cyclictest	0	-21	swapper/1	04:40:46	1
5747	99	63	62	cyclictest	0	-21	swapper/1	04:30:58	1
5747	99	63	62	cyclictest	0	-21	swapper/1	04:20:57	1
5746	99	58	50	cyclictest	0	-21	swapper/0	06:51:11	0
5746	99	58	46	cyclictest	0	-21	swapper/0	05:33:10	0
5748	99	57	56	cyclictest	0	-21	swapper/2	09:05:47	2
5748	99	57	56	cyclictest	0	-21	swapper/2	09:01:08	2
5746	99	57	55	cyclictest	0	-21	swapper/0	08:33:37	0
5748	99	56	55	cyclictest	0	-21	swapper/2	06:20:53	2
5746	99	56	55	cyclictest	0	-21	swapper/0	06:08:40	0
5748	99	55	54	cyclictest	0	-21	swapper/2	06:44:37	2
5748	99	55	54	cyclictest	0	-21	swapper/2	06:05:55	2
5748	99	54	53	cyclictest	0	-21	swapper/2	08:20:48	2
5748	99	54	41	cyclictest	1876	-21	hald-addon-stor	08:36:23	2
5748	99	54	41	cyclictest	1876	-21	hald-addon-stor	08:36:23	2
5748	99	54	41	cyclictest	1876	-21	hald-addon-stor	05:13:10	2
5748	99	53	52	cyclictest	0	-21	swapper/2	09:15:47	2
5748	99	53	52	cyclictest	0	-21	swapper/2	08:51:18	2
5748	99	53	52	cyclictest	0	-21	swapper/2	08:06:28	2
5748	99	53	52	cyclictest	0	-21	swapper/2	06:15:36	2
5748	99	53	52	cyclictest	0	-21	swapper/2	06:01:26	2
5748	99	53	52	cyclictest	0	-21	swapper/2	04:54:59	2
5748	99	53	51	cyclictest	50	50	irq/44-ahci	08:57:42	2
5748	99	53	51	cyclictest	50	50	irq/44-ahci	06:34:41	2
5748	99	53	51	cyclictest	50	50	irq/44-ahci	04:23:10	2
5748	99	53	41	cyclictest	278	-21	usb-storage	09:35:42	2
5748	99	53	41	cyclictest	278	-21	usb-storage	08:18:01	2
5748	99	53	41	cyclictest	278	-21	usb-storage	06:26:24	2
5748	99	53	41	cyclictest	278	-21	usb-storage	04:17:12	2
5748	99	53	41	cyclictest	0	-21	swapper/2	09:40:47	2
5748	99	53	41	cyclictest	0	-21	swapper/2	09:33:58	2
5748	99	53	41	cyclictest	0	-21	swapper/2	08:30:57	2
5748	99	53	41	cyclictest	0	-21	swapper/2	08:10:48	2
5748	99	53	41	cyclictest	0	-21	swapper/2	08:00:50	2
5748	99	53	41	cyclictest	0	-21	swapper/2	07:53:04	2
5748	99	53	41	cyclictest	0	-21	swapper/2	07:25:52	2
5748	99	53	41	cyclictest	0	-21	swapper/2	07:20:51	2
5748	99	53	41	cyclictest	0	-21	swapper/2	07:15:50	2
5748	99	53	41	cyclictest	0	-21	swapper/2	07:08:44	2
5748	99	53	41	cyclictest	0	-21	swapper/2	07:00:54	2
5748	99	53	41	cyclictest	0	-21	swapper/2	07:00:54	2
5748	99	53	41	cyclictest	0	-21	swapper/2	06:51:03	2
5748	99	53	41	cyclictest	0	-21	swapper/2	06:45:54	2
5748	99	53	41	cyclictest	0	-21	swapper/2	05:52:07	2
5748	99	53	41	cyclictest	0	-21	swapper/2	05:36:01	2
5748	99	53	41	cyclictest	0	-21	swapper/2	05:28:34	2
5748	99	53	41	cyclictest	0	-21	swapper/2	05:28:34	2
5748	99	53	41	cyclictest	0	-21	swapper/2	05:21:05	2
5748	99	53	41	cyclictest	0	-21	swapper/2	05:15:54	2
5748	99	53	41	cyclictest	0	-21	swapper/2	05:01:03	2
5748	99	53	41	cyclictest	0	-21	swapper/2	04:56:05	2
5748	99	53	41	cyclictest	0	-21	swapper/2	04:30:58	2
5748	99	53	41	cyclictest	0	-21	swapper/2	04:29:58	2
5746	99	53	52	cyclictest	760	50	irq/18-parport0	06:11:18	0
5746	99	53	52	cyclictest	760	50	irq/18-parport0	06:05:08	0
5746	99	53	52	cyclictest	760	50	irq/18-parport0	05:50:39	0
5746	99	53	52	cyclictest	0	-21	swapper/0	08:05:49	0
5746	99	53	52	cyclictest	0	-21	swapper/0	04:45:58	0
5746	99	53	52	cyclictest	0	-21	swapper/0	04:29:16	0
5746	99	53	52	cyclictest	0	-21	swapper/0	04:25:04	0
5746	99	53	41	cyclictest	760	50	irq/18-parport0	08:14:35	0
5746	99	53	41	cyclictest	0	-21	swapper/0	05:36:43	0
5746	99	53	41	cyclictest	0	-21	swapper/0	05:05:57	0
5748	99	52	51	cyclictest	278	-21	usb-storage	08:49:56	2
5748	99	52	51	cyclictest	0	-21	swapper/2	08:41:58	2
5748	99	52	51	cyclictest	0	-21	swapper/2	06:36:25	2
5748	99	52	51	cyclictest	0	-21	swapper/2	05:59:37	2
5748	99	52	51	cyclictest	0	-21	swapper/2	05:50:43	2
5748	99	52	51	cyclictest	0	-21	swapper/2	05:31:44	2
5748	99	52	51	cyclictest	0	-21	swapper/2	04:36:34	2
5748	99	52	41	cyclictest	0	-21	swapper/2	09:25:52	2
5748	99	52	41	cyclictest	0	-21	swapper/2	09:21:19	2
5748	99	52	41	cyclictest	0	-21	swapper/2	09:11:39	2
5748	99	52	41	cyclictest	0	-21	swapper/2	08:27:13	2
5748	99	52	41	cyclictest	0	-21	swapper/2	07:56:52	2
5748	99	52	41	cyclictest	0	-21	swapper/2	07:50:05	2
5748	99	52	41	cyclictest	0	-21	swapper/2	07:44:55	2
5748	99	52	41	cyclictest	0	-21	swapper/2	07:37:56	2
5748	99	52	41	cyclictest	0	-21	swapper/2	06:17:22	2
5748	99	52	41	cyclictest	0	-21	swapper/2	05:40:57	2
5748	99	52	41	cyclictest	0	-21	swapper/2	05:06:08	2
5748	99	52	41	cyclictest	0	-21	swapper/2	04:45:55	2
5748	99	52	41	cyclictest	0	-21	swapper/2	04:44:55	2
5746	99	52	51	cyclictest	760	50	irq/18-parport0	05:17:12	0
5746	99	52	51	cyclictest	0	-21	swapper/0	09:40:49	0
5746	99	52	51	cyclictest	0	-21	swapper/0	09:35:46	0
5746	99	52	51	cyclictest	0	-21	swapper/0	09:30:47	0
5746	99	52	51	cyclictest	0	-21	swapper/0	08:56:32	0
5746	99	52	51	cyclictest	0	-21	swapper/0	08:03:03	0
5746	99	52	51	cyclictest	0	-21	swapper/0	07:51:22	0
5746	99	52	51	cyclictest	0	-21	swapper/0	07:30:51	0
5746	99	52	51	cyclictest	0	-21	swapper/0	07:25:59	0
5746	99	52	51	cyclictest	0	-21	swapper/0	07:10:52	0
5746	99	52	51	cyclictest	0	-21	swapper/0	07:05:52	0
5746	99	52	51	cyclictest	0	-21	swapper/0	06:59:08	0
5746	99	52	51	cyclictest	0	-21	swapper/0	06:45:29	0
5746	99	52	51	cyclictest	0	-21	swapper/0	05:59:07	0
5746	99	52	51	cyclictest	0	-21	swapper/0	05:30:32	0
5746	99	52	51	cyclictest	0	-21	swapper/0	05:30:32	0
5746	99	52	51	cyclictest	0	-21	swapper/0	05:11:14	0
5746	99	52	51	cyclictest	0	-21	swapper/0	04:30:58	0
5746	99	52	50	cyclictest	0	-21	swapper/0	06:35:41	0
5746	99	52	50	cyclictest	0	-21	swapper/0	04:53:23	0
5748	99	51	50	cyclictest	0	-21	swapper/2	07:10:52	2
5746	99	51	50	cyclictest	0	-21	swapper/0	09:25:47	0
5746	99	51	50	cyclictest	0	-21	swapper/0	07:47:28	0
5746	99	51	50	cyclictest	0	-21	swapper/0	07:00:58	0
5746	99	51	50	cyclictest	0	-21	swapper/0	07:00:58	0
5746	99	51	50	cyclictest	0	-21	swapper/0	06:38:51	0
5746	99	51	50	cyclictest	0	-21	swapper/0	06:28:35	0
5746	99	51	50	cyclictest	0	-21	swapper/0	06:18:28	0
5746	99	51	50	cyclictest	0	-21	swapper/0	05:45:44	0
5746	99	51	50	cyclictest	0	-21	swapper/0	04:37:44	0
5746	99	51	49	cyclictest	0	-21	swapper/0	09:11:58	0
5748	99	50	49	cyclictest	0	-21	swapper/2	06:58:31	2
5746	99	50	49	cyclictest	0	-21	swapper/0	09:05:58	0
5746	99	50	49	cyclictest	0	-21	swapper/0	08:41:36	0
5746	99	50	49	cyclictest	0	-21	swapper/0	06:47:31	0
5746	99	50	41	cyclictest	0	-21	swapper/0	07:24:49	0
5748	99	49	47	cyclictest	0	-21	swapper/2	07:33:23	2
5746	99	49	48	cyclictest	0	-21	swapper/0	08:45:55	0
5746	99	49	48	cyclictest	0	-21	swapper/0	08:26:41	0
5746	99	49	48	cyclictest	0	-21	swapper/0	07:19:14	0
5746	99	49	48	cyclictest	0	-21	swapper/0	05:04:54	0
5746	99	49	41	cyclictest	0	-21	swapper/0	07:37:25	0
5746	99	49	31	cyclictest	0	-21	swapper/0	08:23:11	0
5746	99	48	47	cyclictest	0	-21	swapper/0	07:58:22	0
5746	99	48	46	cyclictest	0	-21	swapper/0	05:20:50	0
5746	99	48	41	cyclictest	0	-21	swapper/0	09:17:35	0
5746	99	48	41	cyclictest	0	-21	swapper/0	08:53:12	0
5746	99	48	41	cyclictest	0	-21	swapper/0	05:54:53	0
5746	99	47	46	cyclictest	0	-21	swapper/0	09:01:58	0
5746	99	47	46	cyclictest	0	-21	swapper/0	08:15:55	0
5746	99	47	41	cyclictest	0	-21	swapper/0	04:56:05	0
5746	99	47	41	cyclictest	0	-21	swapper/0	04:16:00	0
5746	99	46	45	cyclictest	0	-21	swapper/0	09:20:50	0
5746	99	45	44	cyclictest	0	-21	swapper/0	08:37:19	0
5746	99	45	44	cyclictest	0	-21	swapper/0	08:37:19	0
5746	99	45	44	cyclictest	0	-21	swapper/0	04:41:24	0
5746	99	43	42	cyclictest	0	-21	swapper/0	07:40:51	0
5746	99	43	42	cyclictest	0	-21	swapper/0	06:20:54	0
23	1	12	0	ksoftirqd/3	0	-21	swapper/3	04:13:28	3
18	1	12	0	ksoftirqd/2	0	-21	swapper/2	04:13:28	2
12	1	11	0	ksoftirqd/1	0	-21	swapper/1	04:13:28	1
8	99	8	0	watchdog/0	0	-21	swapper/0	04:10:58	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17