OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Wed Apr 01, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
13752	99	131	122	cyclictest	0	-21	swapper/3	10:29:26	3
13752	99	123	122	cyclictest	0	-21	swapper/3	07:19:16	3
13752	99	107	102	cyclictest	0	-21	swapper/3	08:59:11	3
13752	99	107	102	cyclictest	0	-21	swapper/3	06:44:18	3
13752	99	107	102	cyclictest	0	-21	swapper/3	05:54:06	3
13752	99	106	102	cyclictest	0	-21	swapper/3	08:19:00	3
13750	99	105	93	cyclictest	25174	-21	tune2fs	08:34:14	1
13750	99	104	102	cyclictest	31946	-21	tune2fs	10:04:11	1
13750	99	104	102	cyclictest	12617	-21	tune2fs	10:34:09	1
13750	99	104	102	cyclictest	12617	-21	tune2fs	10:34:09	1
13752	99	103	102	cyclictest	0	-21	swapper/3	09:14:13	3
13752	99	103	102	cyclictest	0	-21	swapper/3	06:39:23	3
13752	99	97	82	cyclictest	0	-21	swapper/3	08:57:11	3
13752	99	97	82	cyclictest	0	-21	swapper/3	07:14:22	3
13752	99	96	92	cyclictest	0	-21	swapper/3	10:09:13	3
13752	99	93	92	cyclictest	0	-21	swapper/3	07:49:01	3
13752	99	87	82	cyclictest	0	-21	swapper/3	10:19:10	3
13752	99	87	82	cyclictest	0	-21	swapper/3	07:39:16	3
13752	99	86	82	cyclictest	0	-21	swapper/3	08:47:08	3
13752	99	86	82	cyclictest	0	-21	swapper/3	08:34:20	3
13752	99	86	82	cyclictest	0	-21	swapper/3	08:09:21	3
13752	99	86	82	cyclictest	0	-21	swapper/3	06:19:25	3
13752	99	86	81	cyclictest	0	-21	swapper/3	09:59:11	3
13752	99	86	81	cyclictest	0	-21	swapper/3	09:54:11	3
13752	99	86	81	cyclictest	0	-21	swapper/3	07:29:25	3
13752	99	85	82	cyclictest	0	-21	swapper/3	11:04:14	3
13752	99	85	81	cyclictest	0	-21	swapper/3	11:02:30	3
13752	99	85	81	cyclictest	0	-21	swapper/3	10:39:14	3
13752	99	85	81	cyclictest	0	-21	swapper/3	10:17:23	3
13752	99	85	81	cyclictest	0	-21	swapper/3	09:37:16	3
13752	99	85	81	cyclictest	0	-21	swapper/3	06:36:29	3
13752	99	84	82	cyclictest	0	-21	swapper/3	10:54:15	3
13752	99	84	72	cyclictest	0	-21	swapper/3	10:08:55	3
13752	99	84	72	cyclictest	0	-21	swapper/3	06:09:17	3
13750	99	84	82	cyclictest	31467	-21	tune2fs	06:19:18	1
13750	99	84	82	cyclictest	23316	-21	tune2fs	09:44:10	1
13750	99	84	81	cyclictest	16086	-21	sadc	09:28:58	1
13750	99	84	72	cyclictest	0	-21	swapper/1	10:09:13	1
13750	99	84	72	cyclictest	0	-21	swapper/1	06:39:20	1
13750	99	84	72	cyclictest	0	-21	swapper/1	05:54:06	1
13752	99	83	82	cyclictest	0	-21	swapper/3	10:49:08	3
13752	99	83	82	cyclictest	0	-21	swapper/3	10:44:09	3
13752	99	83	82	cyclictest	0	-21	swapper/3	10:34:15	3
13752	99	83	82	cyclictest	0	-21	swapper/3	10:34:15	3
13752	99	83	82	cyclictest	0	-21	swapper/3	10:24:11	3
13752	99	83	82	cyclictest	0	-21	swapper/3	09:44:10	3
13752	99	83	82	cyclictest	0	-21	swapper/3	09:29:11	3
13752	99	83	82	cyclictest	0	-21	swapper/3	09:24:19	3
13752	99	83	82	cyclictest	0	-21	swapper/3	09:19:19	3
13752	99	83	82	cyclictest	0	-21	swapper/3	09:09:19	3
13752	99	83	82	cyclictest	0	-21	swapper/3	09:04:13	3
13752	99	83	82	cyclictest	0	-21	swapper/3	08:49:16	3
13752	99	83	82	cyclictest	0	-21	swapper/3	08:39:20	3
13752	99	83	82	cyclictest	0	-21	swapper/3	08:29:27	3
13752	99	83	82	cyclictest	0	-21	swapper/3	07:59:14	3
13752	99	83	82	cyclictest	0	-21	swapper/3	07:54:20	3
13752	99	83	82	cyclictest	0	-21	swapper/3	07:49:15	3
13752	99	83	82	cyclictest	0	-21	swapper/3	07:34:15	3
13752	99	83	82	cyclictest	0	-21	swapper/3	07:06:37	3
13752	99	83	82	cyclictest	0	-21	swapper/3	06:29:27	3
13752	99	83	82	cyclictest	0	-21	swapper/3	06:24:25	3
13752	99	83	82	cyclictest	0	-21	swapper/3	06:14:21	3
13752	99	83	82	cyclictest	0	-21	swapper/3	05:59:26	3
13752	99	83	82	cyclictest	0	-21	swapper/3	05:54:20	3
13752	99	83	82	cyclictest	0	-21	swapper/3	05:39:21	3
13752	99	83	71	cyclictest	0	-21	swapper/3	07:24:24	3
13750	99	83	82	cyclictest	0	-21	swapper/1	10:49:08	1
13750	99	83	82	cyclictest	0	-21	swapper/1	10:39:14	1
13750	99	83	82	cyclictest	0	-21	swapper/1	10:29:20	1
13750	99	83	82	cyclictest	0	-21	swapper/1	10:24:11	1
13750	99	83	82	cyclictest	0	-21	swapper/1	10:14:11	1
13750	99	83	82	cyclictest	0	-21	swapper/1	09:39:17	1
13750	99	83	82	cyclictest	0	-21	swapper/1	09:29:18	1
13750	99	83	82	cyclictest	0	-21	swapper/1	09:14:17	1
13750	99	83	82	cyclictest	0	-21	swapper/1	09:09:19	1
13750	99	83	82	cyclictest	0	-21	swapper/1	08:54:21	1
13750	99	83	82	cyclictest	0	-21	swapper/1	08:49:16	1
13750	99	83	82	cyclictest	0	-21	swapper/1	08:44:18	1
13750	99	83	82	cyclictest	0	-21	swapper/1	08:29:21	1
13750	99	83	82	cyclictest	0	-21	swapper/1	08:19:21	1
13750	99	83	82	cyclictest	0	-21	swapper/1	08:17:03	1
13750	99	83	82	cyclictest	0	-21	swapper/1	07:49:15	1
13750	99	83	82	cyclictest	0	-21	swapper/1	07:44:21	1
13750	99	83	82	cyclictest	0	-21	swapper/1	07:39:22	1
13750	99	83	82	cyclictest	0	-21	swapper/1	07:34:15	1
13750	99	83	82	cyclictest	0	-21	swapper/1	07:29:23	1
13750	99	83	82	cyclictest	0	-21	swapper/1	07:09:21	1
13750	99	83	82	cyclictest	0	-21	swapper/1	07:04:24	1
13750	99	83	82	cyclictest	0	-21	swapper/1	06:54:22	1
13750	99	83	82	cyclictest	0	-21	swapper/1	06:49:24	1
13750	99	83	82	cyclictest	0	-21	swapper/1	06:44:25	1
13750	99	83	82	cyclictest	0	-21	swapper/1	06:24:25	1
13750	99	83	82	cyclictest	0	-21	swapper/1	06:19:05	1
13750	99	83	82	cyclictest	0	-21	swapper/1	05:54:20	1
13750	99	83	82	cyclictest	0	-21	swapper/1	05:39:27	1
13750	99	83	81	cyclictest	8071	-21	tune2fs	07:54:14	1
13750	99	83	81	cyclictest	3683	-21	tune2fs	08:59:11	1
13750	99	83	81	cyclictest	3114	-21	aten2.4-expect	06:29:16	1
13750	99	83	81	cyclictest	29527	-21	tune2fs	09:59:11	1
13750	99	83	81	cyclictest	25097	-21	tune2fs	06:04:21	1
13750	99	83	81	cyclictest	23526	-21	tune2fs	10:59:08	1
13750	99	83	81	cyclictest	19069	-21	tune2fs	09:34:13	1
13750	99	83	81	cyclictest	16628	-21	tune2fs	06:59:18	1
13750	99	83	81	cyclictest	16382	-21	tune2fs	05:44:20	1
13750	99	82	81	cyclictest	21215	-21	tune2fs	10:54:08	1
13752	99	74	72	cyclictest	25070	-21	fschecks_time	06:04:21	3
13750	99	74	71	cyclictest	5832	-21	tune2fs	06:34:19	1
13752	99	73	72	cyclictest	0	-21	swapper/3	08:24:00	3
13752	99	73	72	cyclictest	0	-21	swapper/3	08:04:12	3
13752	99	73	72	cyclictest	0	-21	swapper/3	06:59:18	3
13752	99	73	72	cyclictest	0	-21	swapper/3	06:54:18	3
13750	99	73	72	cyclictest	0	-21	swapper/1	10:44:09	1
13750	99	73	72	cyclictest	0	-21	swapper/1	08:09:12	1
13750	99	73	72	cyclictest	0	-21	swapper/1	07:59:14	1
13750	99	73	71	cyclictest	5518	-21	aten2.4-expect	10:19:07	1
13750	99	73	71	cyclictest	5409	-21	aten2.4-expect	09:04:10	1
13752	99	72	71	cyclictest	0	-21	swapper/3	06:49:24	3
13750	99	72	71	cyclictest	0	-21	swapper/1	08:24:23	1
13750	99	72	71	cyclictest	0	-21	swapper/1	08:24:23	1
13750	99	72	71	cyclictest	0	-21	swapper/1	07:19:13	1
13750	99	72	71	cyclictest	0	-21	swapper/1	07:14:15	1
13750	99	72	71	cyclictest	0	-21	swapper/1	05:59:26	1
13752	99	68	63	cyclictest	0	-21	swapper/3	07:09:19	3
13752	99	68	52	cyclictest	0	-21	swapper/3	05:44:18	3
13752	99	67	62	cyclictest	0	-21	swapper/3	08:24:18	3
13752	99	67	62	cyclictest	0	-21	swapper/3	08:24:18	3
13752	99	67	51	cyclictest	0	-21	swapper/3	09:39:08	3
13752	99	66	62	cyclictest	0	-21	swapper/3	09:49:12	3
13751	99	65	51	cyclictest	0	-21	swapper/2	10:54:06	2
13749	99	64	46	cyclictest	0	-21	swapper/0	07:27:15	0
13750	99	63	62	cyclictest	0	-21	swapper/1	11:03:53	1
13750	99	63	62	cyclictest	0	-21	swapper/1	09:54:09	1
13750	99	63	62	cyclictest	0	-21	swapper/1	09:49:08	1
13750	99	63	62	cyclictest	0	-21	swapper/1	09:19:09	1
13750	99	63	62	cyclictest	0	-21	swapper/1	08:39:11	1
13750	99	63	62	cyclictest	0	-21	swapper/1	08:04:01	1
13750	99	63	62	cyclictest	0	-21	swapper/1	07:24:02	1
13750	99	63	62	cyclictest	0	-21	swapper/1	06:09:05	1
13749	99	63	62	cyclictest	0	-21	swapper/0	09:24:09	0
13749	99	62	61	cyclictest	0	-21	swapper/0	08:34:12	0
13749	99	62	61	cyclictest	0	-21	swapper/0	06:54:15	0
13751	99	61	59	cyclictest	20490	-21	telnet	07:09:13	2
13749	99	61	60	cyclictest	0	-21	swapper/0	10:09:07	0
13749	99	61	60	cyclictest	0	-21	swapper/0	07:54:11	0
13749	99	61	60	cyclictest	0	-21	swapper/0	06:34:16	0
13749	99	61	60	cyclictest	0	-21	swapper/0	06:14:16	0
13749	99	60	59	cyclictest	0	-21	swapper/0	06:04:18	0
13751	99	59	58	cyclictest	0	-21	swapper/2	11:07:09	2
13749	99	59	41	cyclictest	0	-21	swapper/0	05:40:29	0
13751	99	58	51	cyclictest	0	-21	swapper/2	06:40:23	2
13751	99	58	51	cyclictest	0	-21	swapper/2	06:33:23	2
13749	99	58	52	cyclictest	0	-21	swapper/0	10:16:09	0
13749	99	58	41	cyclictest	0	-21	swapper/0	09:19:33	0
13749	99	58	41	cyclictest	0	-21	swapper/0	08:46:08	0
13749	99	58	41	cyclictest	0	-21	swapper/0	06:50:01	0
13749	99	58	41	cyclictest	0	-21	swapper/0	06:43:01	0
13749	99	57	56	cyclictest	0	-21	swapper/0	07:34:12	0
13751	99	56	51	cyclictest	0	-21	swapper/2	08:44:54	2
13751	99	56	51	cyclictest	0	-21	swapper/2	06:57:56	2
13751	99	55	54	cyclictest	0	-21	swapper/2	10:14:47	2
13751	99	55	51	cyclictest	0	-21	swapper/2	10:49:07	2
13751	99	55	51	cyclictest	0	-21	swapper/2	10:08:45	2
13751	99	55	51	cyclictest	0	-21	swapper/2	09:30:20	2
13749	99	55	41	cyclictest	0	-21	swapper/0	09:56:16	0
13751	99	54	53	cyclictest	5642	-21	telnet	10:19:08	2
13751	99	54	53	cyclictest	1876	-21	hald-addon-stor	06:35:25	2
13751	99	54	53	cyclictest	18	1	ksoftirqd/2	09:19:35	2
13751	99	54	53	cyclictest	0	-21	swapper/2	08:35:03	2
13751	99	54	53	cyclictest	0	-21	swapper/2	08:12:30	2
13751	99	54	53	cyclictest	0	-21	swapper/2	07:59:56	2
13751	99	54	52	cyclictest	50	50	irq/44-ahci	06:14:32	2
13751	99	54	52	cyclictest	0	-21	swapper/2	09:05:48	2
13751	99	54	51	cyclictest	0	-21	swapper/2	07:14:42	2
13751	99	54	51	cyclictest	0	-21	swapper/2	06:59:08	2
13751	99	54	51	cyclictest	0	-21	swapper/2	06:51:45	2
13751	99	54	51	cyclictest	0	-21	swapper/2	06:13:58	2
13751	99	54	41	cyclictest	0	-21	swapper/2	10:27:11	2
13751	99	54	41	cyclictest	0	-21	swapper/2	08:41:45	2
13751	99	54	41	cyclictest	0	-21	swapper/2	06:48:45	2
13749	99	54	53	cyclictest	0	-21	swapper/0	08:42:17	0
13749	99	54	52	cyclictest	0	-21	swapper/0	06:27:34	0
13749	99	54	51	cyclictest	0	-21	swapper/0	06:02:25	0
13751	99	53	52	cyclictest	50	50	irq/44-ahci	10:40:54	2
13751	99	53	52	cyclictest	29922	-21	munin-node	07:29:18	2
13751	99	53	52	cyclictest	278	-21	usb-storage	10:01:12	2
13751	99	53	52	cyclictest	278	-21	usb-storage	07:39:49	2
13751	99	53	52	cyclictest	278	-21	usb-storage	07:06:02	2
13751	99	53	52	cyclictest	18	1	ksoftirqd/2	07:44:09	2
13751	99	53	52	cyclictest	0	-21	swapper/2	09:54:09	2
13751	99	53	52	cyclictest	0	-21	swapper/2	08:25:39	2
13751	99	53	52	cyclictest	0	-21	swapper/2	08:25:39	2
13751	99	53	52	cyclictest	0	-21	swapper/2	07:24:03	2
13751	99	53	52	cyclictest	0	-21	swapper/2	07:20:14	2
13751	99	53	52	cyclictest	0	-21	swapper/2	06:04:14	2
13751	99	53	52	cyclictest	0	-21	swapper/2	05:59:11	2
13751	99	53	52	cyclictest	0	-21	swapper/2	05:41:33	2
13751	99	53	51	cyclictest	801	-21	telnet	06:24:16	2
13751	99	53	51	cyclictest	7534	-21	telnet	07:54:11	2
13751	99	53	51	cyclictest	50	50	irq/44-ahci	10:09:37	2
13751	99	53	51	cyclictest	24959	-21	telnet	09:49:09	2
13751	99	53	51	cyclictest	22833	-21	telnet	10:59:05	2
13751	99	53	51	cyclictest	18427	-21	telnet	09:34:10	2
13751	99	53	51	cyclictest	18402	-21	telnet	08:19:12	2
13751	99	53	51	cyclictest	0	-21	swapper/2	10:45:26	2
13751	99	53	51	cyclictest	0	-21	swapper/2	10:30:26	2
13751	99	53	51	cyclictest	0	-21	swapper/2	09:44:26	2
13751	99	53	51	cyclictest	0	-21	swapper/2	09:28:29	2
13751	99	53	51	cyclictest	0	-21	swapper/2	09:10:19	2
13751	99	53	51	cyclictest	0	-21	swapper/2	09:00:54	2
13751	99	53	51	cyclictest	0	-21	swapper/2	08:16:45	2
13751	99	53	51	cyclictest	0	-21	swapper/2	07:49:12	2
13751	99	53	51	cyclictest	0	-21	swapper/2	05:49:59	2
13751	99	53	51	cyclictest	0	-21	swapper/2	05:44:44	2
13751	99	53	41	cyclictest	0	-21	swapper/2	08:29:59	2
13751	99	53	41	cyclictest	0	-21	swapper/2	06:23:00	2
13751	99	53	41	cyclictest	0	-21	swapper/2	05:56:33	2
13749	99	53	52	cyclictest	760	50	irq/18-parport0	10:44:52	0
13749	99	53	52	cyclictest	760	50	irq/18-parport0	10:26:27	0
13749	99	53	52	cyclictest	760	50	irq/18-parport0	09:49:28	0
13749	99	53	52	cyclictest	760	50	irq/18-parport0	07:42:41	0
13749	99	53	52	cyclictest	1876	-21	hald-addon-stor	07:00:34	0
13749	99	53	52	cyclictest	1286	50	irq/46-eth0	07:49:13	0
13749	99	53	52	cyclictest	1286	50	irq/46-eth0	06:22:10	0
13749	99	53	52	cyclictest	0	-21	swapper/0	11:07:39	0
13749	99	53	52	cyclictest	0	-21	swapper/0	10:53:56	0
13749	99	53	52	cyclictest	0	-21	swapper/0	10:49:07	0
13749	99	53	52	cyclictest	0	-21	swapper/0	10:28:55	0
13749	99	53	52	cyclictest	0	-21	swapper/0	10:04:08	0
13749	99	53	52	cyclictest	0	-21	swapper/0	09:59:09	0
13749	99	53	52	cyclictest	0	-21	swapper/0	09:44:08	0
13749	99	53	52	cyclictest	0	-21	swapper/0	09:13:27	0
13749	99	53	52	cyclictest	0	-21	swapper/0	08:55:18	0
13749	99	53	52	cyclictest	0	-21	swapper/0	08:25:39	0
13749	99	53	52	cyclictest	0	-21	swapper/0	08:25:39	0
13749	99	53	52	cyclictest	0	-21	swapper/0	08:19:12	0
13749	99	53	52	cyclictest	0	-21	swapper/0	08:15:00	0
13749	99	53	52	cyclictest	0	-21	swapper/0	08:09:12	0
13749	99	53	52	cyclictest	0	-21	swapper/0	08:00:36	0
13749	99	53	52	cyclictest	0	-21	swapper/0	07:45:05	0
13749	99	53	52	cyclictest	0	-21	swapper/0	07:19:14	0
13749	99	53	52	cyclictest	0	-21	swapper/0	07:04:14	0
13749	99	53	52	cyclictest	0	-21	swapper/0	06:29:06	0
13749	99	53	52	cyclictest	0	-21	swapper/0	05:55:32	0
13749	99	53	52	cyclictest	0	-21	swapper/0	05:44:18	0
13749	99	53	51	cyclictest	50	50	irq/44-ahci	06:12:11	0
13749	99	53	51	cyclictest	0	-21	swapper/0	10:59:51	0
13749	99	53	47	cyclictest	0	-21	swapper/0	07:18:02	0
13749	99	53	41	cyclictest	0	-21	swapper/0	10:39:07	0
13749	99	53	41	cyclictest	0	-21	swapper/0	09:34:10	0
13749	99	53	41	cyclictest	0	-21	swapper/0	09:14:10	0
13749	99	53	41	cyclictest	0	-21	swapper/0	09:04:37	0
13749	99	53	41	cyclictest	0	-21	swapper/0	08:49:24	0
13749	99	53	41	cyclictest	0	-21	swapper/0	08:29:12	0
13749	99	53	41	cyclictest	0	-21	swapper/0	07:10:02	0
13749	99	53	41	cyclictest	0	-21	swapper/0	06:44:16	0
13749	99	53	41	cyclictest	0	-21	swapper/0	05:52:29	0
13751	99	52	51	cyclictest	0	-21	swapper/2	10:34:06	2
13751	99	52	51	cyclictest	0	-21	swapper/2	10:34:06	2
13751	99	52	51	cyclictest	0	-21	swapper/2	09:39:08	2
13751	99	52	51	cyclictest	0	-21	swapper/2	09:14:10	2
13751	99	52	51	cyclictest	0	-21	swapper/2	08:54:08	2
13751	99	52	51	cyclictest	0	-21	swapper/2	08:49:14	2
13751	99	52	51	cyclictest	0	-21	swapper/2	08:04:11	2
13751	99	52	51	cyclictest	0	-21	swapper/2	07:34:12	2
13749	99	52	51	cyclictest	0	-21	swapper/0	10:34:06	0
13749	99	52	51	cyclictest	0	-21	swapper/0	10:34:06	0
13749	99	52	51	cyclictest	0	-21	swapper/0	10:19:08	0
13749	99	52	51	cyclictest	0	-21	swapper/0	09:40:26	0
13749	99	52	51	cyclictest	0	-21	swapper/0	09:28:59	0
13749	99	52	51	cyclictest	0	-21	swapper/0	08:59:09	0
13749	99	52	51	cyclictest	0	-21	swapper/0	08:04:12	0
13749	99	52	51	cyclictest	0	-21	swapper/0	07:29:14	0
50	50	13	0	irq/44-ahci	13606	-21	latencyplot	05:39:06	2
7	99	11	0	migration/0	12202	-21	fschecks_time	05:34:22	0
21	99	11	0	migration/3	12763	-21	ntp_offset	05:34:26	3
12	1	11	0	ksoftirqd/1	0	-21	swapper/1	05:35:19	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17