OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sat Dec 27, 2025 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
27851	99	123	122	cyclictest	0	-21	swapper/3	11:00:07	3
27849	99	105	104	cyclictest	0	-21	swapper/1	12:30:06	1
27849	99	104	102	cyclictest	24092	-21	tune2fs	08:10:16	1
27851	99	103	102	cyclictest	0	-21	swapper/3	11:45:07	3
27851	99	103	102	cyclictest	0	-21	swapper/3	10:45:10	3
27851	99	103	102	cyclictest	0	-21	swapper/3	09:40:13	3
27851	99	103	102	cyclictest	0	-21	swapper/3	09:35:15	3
27851	99	103	102	cyclictest	0	-21	swapper/3	08:15:16	3
27849	99	103	102	cyclictest	0	-21	swapper/1	07:45:02	1
27849	99	97	92	cyclictest	0	-21	swapper/1	09:00:00	1
27849	99	94	92	cyclictest	26005	-21	tune2fs	12:00:09	1
27851	99	93	92	cyclictest	0	-21	swapper/3	10:14:57	3
27851	99	93	92	cyclictest	0	-21	swapper/3	08:35:15	3
27851	99	93	92	cyclictest	0	-21	swapper/3	07:45:02	3
27849	99	93	92	cyclictest	0	-21	swapper/1	07:55:03	1
27849	99	89	72	cyclictest	0	-21	swapper/1	10:20:08	1
27849	99	88	81	cyclictest	30329	-21	tune2fs	12:10:08	1
27849	99	88	72	cyclictest	0	-21	swapper/1	07:05:18	1
27849	99	87	82	cyclictest	0	-21	swapper/1	10:05:13	1
27849	99	86	84	cyclictest	8831	-21	tune2fs	07:35:17	1
27849	99	86	82	cyclictest	0	-21	swapper/1	10:45:17	1
27849	99	86	82	cyclictest	0	-21	swapper/1	08:43:02	1
27849	99	86	82	cyclictest	0	-21	swapper/1	08:35:21	1
27849	99	86	82	cyclictest	0	-21	swapper/1	07:22:48	1
27849	99	84	82	cyclictest	8749	-21	tune2fs	11:20:10	1
27849	99	84	82	cyclictest	0	-21	swapper/1	09:00:00	1
27851	99	83	82	cyclictest	0	-21	swapper/3	12:25:12	3
27851	99	83	82	cyclictest	0	-21	swapper/3	12:10:12	3
27851	99	83	82	cyclictest	0	-21	swapper/3	11:44:53	3
27851	99	83	82	cyclictest	0	-21	swapper/3	11:20:18	3
27851	99	83	82	cyclictest	0	-21	swapper/3	11:10:10	3
27851	99	83	82	cyclictest	0	-21	swapper/3	10:43:19	3
27851	99	83	82	cyclictest	0	-21	swapper/3	10:30:18	3
27851	99	83	82	cyclictest	0	-21	swapper/3	10:28:17	3
27851	99	83	82	cyclictest	0	-21	swapper/3	10:15:14	3
27851	99	83	82	cyclictest	0	-21	swapper/3	10:00:17	3
27851	99	83	82	cyclictest	0	-21	swapper/3	10:00:17	3
27851	99	83	82	cyclictest	0	-21	swapper/3	09:55:21	3
27851	99	83	82	cyclictest	0	-21	swapper/3	09:50:23	3
27851	99	83	82	cyclictest	0	-21	swapper/3	09:48:10	3
27851	99	83	82	cyclictest	0	-21	swapper/3	09:34:58	3
27851	99	83	82	cyclictest	0	-21	swapper/3	09:20:16	3
27851	99	83	82	cyclictest	0	-21	swapper/3	09:10:20	3
27851	99	83	82	cyclictest	0	-21	swapper/3	09:00:13	3
27851	99	83	82	cyclictest	0	-21	swapper/3	08:56:00	3
27851	99	83	82	cyclictest	0	-21	swapper/3	08:53:03	3
27851	99	83	82	cyclictest	0	-21	swapper/3	08:40:18	3
27851	99	83	82	cyclictest	0	-21	swapper/3	08:33:00	3
27851	99	83	82	cyclictest	0	-21	swapper/3	08:10:23	3
27851	99	83	82	cyclictest	0	-21	swapper/3	07:55:21	3
27851	99	83	82	cyclictest	0	-21	swapper/3	07:52:54	3
27851	99	83	82	cyclictest	0	-21	swapper/3	07:38:10	3
27851	99	83	82	cyclictest	0	-21	swapper/3	07:27:49	3
27851	99	83	81	cyclictest	6663	-21	tune2fs	12:30:06	3
27849	99	83	82	cyclictest	27843	-21	aten2.4-expect	08:20:12	1
27849	99	83	82	cyclictest	0	-21	swapper/1	12:25:12	1
27849	99	83	82	cyclictest	0	-21	swapper/1	12:20:04	1
27849	99	83	82	cyclictest	0	-21	swapper/1	12:15:16	1
27849	99	83	82	cyclictest	0	-21	swapper/1	12:05:10	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:55:14	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:45:14	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:40:17	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:35:09	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:30:16	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:25:12	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:15:16	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:14:55	1
27849	99	83	82	cyclictest	0	-21	swapper/1	11:05:14	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:55:17	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:50:11	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:40:17	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:30:14	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:25:18	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:15:14	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:00:17	1
27849	99	83	82	cyclictest	0	-21	swapper/1	10:00:17	1
27849	99	83	82	cyclictest	0	-21	swapper/1	09:55:19	1
27849	99	83	82	cyclictest	0	-21	swapper/1	09:50:15	1
27849	99	83	82	cyclictest	0	-21	swapper/1	09:40:19	1
27849	99	83	82	cyclictest	0	-21	swapper/1	09:30:19	1
27849	99	83	82	cyclictest	0	-21	swapper/1	09:25:20	1
27849	99	83	82	cyclictest	0	-21	swapper/1	09:20:16	1
27849	99	83	82	cyclictest	0	-21	swapper/1	09:15:21	1
27849	99	83	82	cyclictest	0	-21	swapper/1	08:51:36	1
27849	99	83	82	cyclictest	0	-21	swapper/1	08:25:23	1
27849	99	83	82	cyclictest	0	-21	swapper/1	08:25:23	1
27849	99	83	82	cyclictest	0	-21	swapper/1	08:05:24	1
27849	99	83	82	cyclictest	0	-21	swapper/1	08:00:17	1
27849	99	83	82	cyclictest	0	-21	swapper/1	07:55:16	1
27849	99	83	82	cyclictest	0	-21	swapper/1	07:45:20	1
27849	99	83	82	cyclictest	0	-21	swapper/1	07:25:24	1
27849	99	83	82	cyclictest	0	-21	swapper/1	07:10:27	1
27849	99	83	81	cyclictest	6808	-21	tune2fs	08:45:15	1
27849	99	83	81	cyclictest	32712	-21	tune2fs	07:15:19	1
27849	99	83	81	cyclictest	32465	-21	tune2fs	08:30:13	1
27849	99	83	81	cyclictest	32369	-21	tune2fs	09:45:12	1
27849	99	83	81	cyclictest	28169	-21	tune2fs	09:35:15	1
27849	99	83	81	cyclictest	10885	-21	tune2fs	10:10:12	1
27849	99	83	71	cyclictest	32049	-21	aten2.4-expect	11:00:07	1
27851	99	82	81	cyclictest	0	-21	swapper/3	12:15:09	3
27851	99	82	81	cyclictest	0	-21	swapper/3	12:00:09	3
27851	99	82	81	cyclictest	0	-21	swapper/3	09:25:13	3
27851	99	82	81	cyclictest	0	-21	swapper/3	08:00:18	3
27851	99	82	71	cyclictest	0	-21	swapper/3	11:38:27	3
27851	99	82	71	cyclictest	0	-21	swapper/3	07:05:25	3
27851	99	74	72	cyclictest	0	-21	swapper/3	11:55:07	3
27851	99	74	71	cyclictest	32605	-21	fschecks_count	07:15:19	3
27851	99	73	72	cyclictest	0	-21	swapper/3	11:25:06	3
27851	99	73	72	cyclictest	0	-21	swapper/3	10:55:09	3
27851	99	73	72	cyclictest	0	-21	swapper/3	10:20:09	3
27851	99	73	72	cyclictest	0	-21	swapper/3	10:05:21	3
27851	99	73	72	cyclictest	0	-21	swapper/3	09:05:29	3
27851	99	73	72	cyclictest	0	-21	swapper/3	08:20:27	3
27851	99	73	72	cyclictest	0	-21	swapper/3	07:45:17	3
27849	99	73	72	cyclictest	0	-21	swapper/1	09:05:12	1
27849	99	73	72	cyclictest	0	-21	swapper/1	08:15:15	1
27849	99	73	72	cyclictest	0	-21	swapper/1	07:30:19	1
27851	99	72	71	cyclictest	0	-21	swapper/3	10:50:18	3
27851	99	72	71	cyclictest	0	-21	swapper/3	08:05:24	3
27851	99	72	71	cyclictest	0	-21	swapper/3	07:20:21	3
27849	99	72	71	cyclictest	0	-21	swapper/1	11:50:12	1
27851	99	71	70	cyclictest	0	-21	swapper/3	12:24:39	3
27849	99	71	70	cyclictest	0	-21	swapper/1	10:39:56	1
27849	99	70	69	cyclictest	0	-21	swapper/1	09:10:12	1
27851	99	67	66	cyclictest	0	-21	swapper/3	11:19:02	3
27851	99	66	65	cyclictest	0	-21	swapper/3	11:33:33	3
27851	99	64	62	cyclictest	0	-21	swapper/3	12:05:07	3
27851	99	64	62	cyclictest	0	-21	swapper/3	11:05:16	3
27851	99	64	62	cyclictest	0	-21	swapper/3	09:15:14	3
27851	99	64	62	cyclictest	0	-21	swapper/3	08:45:22	3
27851	99	64	62	cyclictest	0	-21	swapper/3	07:30:17	3
27851	99	63	62	cyclictest	0	-21	swapper/3	11:50:07	3
27851	99	63	62	cyclictest	0	-21	swapper/3	10:35:10	3
27851	99	63	62	cyclictest	0	-21	swapper/3	08:25:15	3
27851	99	63	62	cyclictest	0	-21	swapper/3	08:25:15	3
27851	99	63	62	cyclictest	0	-21	swapper/3	07:10:17	3
27848	99	62	61	cyclictest	0	-21	swapper/0	12:10:05	0
27848	99	62	61	cyclictest	0	-21	swapper/0	09:06:05	0
27848	99	58	41	cyclictest	0	-21	swapper/0	09:02:19	0
27850	99	57	55	cyclictest	0	-21	swapper/2	07:57:16	2
27850	99	57	41	cyclictest	0	-21	swapper/2	10:02:33	2
27850	99	57	41	cyclictest	0	-21	swapper/2	10:02:33	2
27848	99	57	50	cyclictest	0	-21	swapper/0	11:53:55	0
27848	99	57	50	cyclictest	0	-21	swapper/0	11:01:41	0
27848	99	57	50	cyclictest	0	-21	swapper/0	10:11:45	0
27848	99	57	50	cyclictest	0	-21	swapper/0	07:25:55	0
27848	99	57	49	cyclictest	0	-21	swapper/0	08:23:09	0
27850	99	56	41	cyclictest	0	-21	swapper/2	10:05:25	2
27850	99	56	41	cyclictest	0	-21	swapper/2	07:45:24	2
27848	99	56	55	cyclictest	0	-21	swapper/0	09:11:11	0
27848	99	56	49	cyclictest	0	-21	swapper/0	11:21:08	0
27850	99	55	54	cyclictest	5623	-21	munin-node	07:25:26	2
27850	99	55	54	cyclictest	3488	-21	munin-node	07:20:27	2
27850	99	55	54	cyclictest	24554	-21	munin-node	10:40:16	2
27850	99	55	54	cyclictest	24214	-21	munin-node	08:10:17	2
27850	99	55	54	cyclictest	22561	-21	processes	09:20:18	2
27850	99	55	54	cyclictest	1770	-21	latency_hist	08:35:00	2
27850	99	55	54	cyclictest	16104	-21	munin-node	10:20:19	2
27850	99	55	54	cyclictest	11924	-21	processes	07:40:24	2
27850	99	55	54	cyclictest	11558	-21	munin-node	11:25:13	2
27850	99	55	41	cyclictest	0	-21	swapper/2	11:15:20	2
27850	99	54	53	cyclictest	8397	-21	munin-node	08:50:13	2
27850	99	54	53	cyclictest	7670	-21	munin-node	07:30:24	2
27850	99	54	53	cyclictest	7575	-21	munin-node	08:45:21	2
27850	99	54	53	cyclictest	26899	-21	munin-node	12:00:17	2
27850	99	54	53	cyclictest	26608	-21	munin-node	08:15:19	2
27850	99	54	53	cyclictest	24734	-21	munin-node	09:25:19	2
27850	99	54	53	cyclictest	1876	-21	hald-addon-stor	10:13:36	2
27850	99	54	53	cyclictest	18	1	ksoftirqd/2	11:20:29	2
27850	99	54	53	cyclictest	16121	-21	munin-node	11:35:16	2
27850	99	54	53	cyclictest	1059	-21	zcat	07:15:25	2
27850	99	54	52	cyclictest	50	50	irq/44-ahci	12:12:14	2
27850	99	54	52	cyclictest	50	50	irq/44-ahci	11:51:45	2
27850	99	54	52	cyclictest	50	50	irq/44-ahci	09:00:29	2
27850	99	54	51	cyclictest	0	-21	swapper/2	09:17:59	2
27850	99	54	50	cyclictest	0	-21	swapper/2	09:08:11	2
27848	99	54	53	cyclictest	0	-21	swapper/0	09:24:17	0
27848	99	54	50	cyclictest	0	-21	swapper/0	07:54:26	0
27850	99	53	52	cyclictest	3406	-21	sshd	11:05:43	2
27850	99	53	52	cyclictest	31224	-21	munin-node	09:40:21	2
27850	99	53	52	cyclictest	31204	-21	munin-node	07:10:25	2
27850	99	53	52	cyclictest	27925	-21	telnet	07:05:16	2
27850	99	53	52	cyclictest	0	-21	swapper/2	11:44:57	2
27850	99	53	52	cyclictest	0	-21	swapper/2	11:00:06	2
27850	99	53	52	cyclictest	0	-21	swapper/2	10:50:08	2
27850	99	53	52	cyclictest	0	-21	swapper/2	10:45:13	2
27850	99	53	52	cyclictest	0	-21	swapper/2	10:35:08	2
27850	99	53	52	cyclictest	0	-21	swapper/2	10:30:16	2
27850	99	53	52	cyclictest	0	-21	swapper/2	09:50:07	2
27850	99	53	52	cyclictest	0	-21	swapper/2	09:10:12	2
27850	99	53	52	cyclictest	0	-21	swapper/2	08:37:20	2
27850	99	53	52	cyclictest	0	-21	swapper/2	08:25:20	2
27850	99	53	52	cyclictest	0	-21	swapper/2	08:25:20	2
27850	99	53	52	cyclictest	0	-21	swapper/2	07:35:14	2
27850	99	53	51	cyclictest	50	50	irq/44-ahci	11:30:11	2
27850	99	53	51	cyclictest	50	50	irq/44-ahci	09:55:03	2
27850	99	53	51	cyclictest	50	50	irq/44-ahci	08:00:03	2
27850	99	53	51	cyclictest	4044	-21	telnet	11:10:10	2
27850	99	53	51	cyclictest	27911	-21	telnet	08:20:13	2
27850	99	53	51	cyclictest	278	-21	usb-storage	12:20:44	2
27850	99	53	51	cyclictest	278	-21	usb-storage	11:56:31	2
27850	99	53	51	cyclictest	278	-21	usb-storage	10:25:36	2
27850	99	53	51	cyclictest	27646	-21	telnet	12:05:05	2
27850	99	53	41	cyclictest	4792	-21	fschecks_time	08:40:15	2
27850	99	53	41	cyclictest	3933	-21	telnet	12:25:03	2
27850	99	53	41	cyclictest	30049	-21	df_abs	10:55:11	2
27850	99	53	41	cyclictest	278	-21	usb-storage	12:15:38	2
27850	99	53	41	cyclictest	0	-21	swapper/2	12:30:12	2
27850	99	53	41	cyclictest	0	-21	swapper/2	11:39:55	2
27850	99	53	41	cyclictest	0	-21	swapper/2	10:17:34	2
27850	99	53	41	cyclictest	0	-21	swapper/2	09:45:10	2
27850	99	53	41	cyclictest	0	-21	swapper/2	09:35:10	2
27850	99	53	41	cyclictest	0	-21	swapper/2	09:30:52	2
27850	99	53	41	cyclictest	0	-21	swapper/2	08:55:03	2
27850	99	53	41	cyclictest	0	-21	swapper/2	08:05:13	2
27850	99	53	41	cyclictest	0	-21	swapper/2	07:50:14	2
27848	99	53	52	cyclictest	760	50	irq/18-parport0	12:34:05	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	12:16:28	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	11:55:03	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	11:12:50	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	10:27:24	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	10:19:44	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	10:08:21	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	09:51:05	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	09:47:47	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	09:41:10	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	08:57:01	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	08:49:38	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	08:37:38	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	08:25:55	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	08:25:55	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	08:18:25	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	08:09:51	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	07:43:38	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	07:36:24	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	07:23:01	0
27848	99	53	52	cyclictest	760	50	irq/18-parport0	07:13:47	0
27848	99	53	51	cyclictest	760	50	irq/18-parport0	08:50:52	0
27848	99	53	49	cyclictest	0	-21	swapper/0	09:32:42	0
27848	99	53	49	cyclictest	0	-21	swapper/0	07:58:22	0
27848	99	53	49	cyclictest	0	-21	swapper/0	07:17:00	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	12:25:45	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	12:01:22	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	11:47:07	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	11:41:53	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	10:56:45	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	10:46:03	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	10:43:17	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	10:23:50	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	09:39:46	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	09:28:36	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	08:30:46	0
27848	99	52	51	cyclictest	760	50	irq/18-parport0	07:06:04	0
27848	99	52	51	cyclictest	0	-21	swapper/0	12:20:00	0
27848	99	52	51	cyclictest	0	-21	swapper/0	12:07:21	0
27848	99	52	51	cyclictest	0	-21	swapper/0	11:31:37	0
27848	99	52	51	cyclictest	0	-21	swapper/0	11:25:49	0
27848	99	52	51	cyclictest	0	-21	swapper/0	11:06:30	0
27848	99	52	51	cyclictest	0	-21	swapper/0	10:54:07	0
27848	99	52	51	cyclictest	0	-21	swapper/0	10:30:26	0
27848	99	52	51	cyclictest	0	-21	swapper/0	10:00:36	0
27848	99	52	51	cyclictest	0	-21	swapper/0	10:00:36	0
27848	99	52	51	cyclictest	0	-21	swapper/0	08:40:06	0
27848	99	52	51	cyclictest	0	-21	swapper/0	08:11:49	0
27848	99	52	51	cyclictest	0	-21	swapper/0	08:02:09	0
27848	99	52	51	cyclictest	0	-21	swapper/0	07:45:06	0
27848	99	52	51	cyclictest	0	-21	swapper/0	07:30:09	0
27848	99	52	49	cyclictest	0	-21	swapper/0	09:15:04	0
27848	99	51	50	cyclictest	0	-21	swapper/0	11:34:55	0
27848	99	51	50	cyclictest	0	-21	swapper/0	11:15:32	0
27848	99	51	50	cyclictest	0	-21	swapper/0	10:36:20	0
27848	99	51	50	cyclictest	0	-21	swapper/0	09:57:51	0
3	1	11	0	ksoftirqd/0	0	-21	swapper/0	07:01:13	0
23	1	11	0	ksoftirqd/3	0	-21	swapper/3	07:01:13	3
18	1	10	0	ksoftirqd/2	0	-21	swapper/2	07:01:19	2
12	1	10	0	ksoftirqd/1	0	-21	swapper/1	07:01:13	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17