OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sat Aug 29, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
13957	99	129	112	cyclictest	0	-21	swapper/1	04:38:28	1
13957	99	108	103	cyclictest	0	-21	swapper/1	07:47:29	1
13959	99	103	102	cyclictest	0	-21	swapper/3	08:48:18	3
13959	99	103	102	cyclictest	0	-21	swapper/3	08:38:20	3
13959	99	103	102	cyclictest	0	-21	swapper/3	07:15:30	3
13959	99	103	102	cyclictest	0	-21	swapper/3	07:08:21	3
13959	99	103	102	cyclictest	0	-21	swapper/3	04:28:26	3
13957	99	103	102	cyclictest	12	1	ksoftirqd/1	06:43:08	1
13957	99	89	82	cyclictest	3484	-21	tune2fs	05:28:26	1
13957	99	89	82	cyclictest	23347	-21	tune2fs	08:43:18	1
13957	99	88	83	cyclictest	0	-21	swapper/1	07:15:30	1
13957	99	88	83	cyclictest	0	-21	swapper/1	05:23:34	1
13957	99	87	82	cyclictest	0	-21	swapper/1	08:03:25	1
13957	99	87	82	cyclictest	0	-21	swapper/1	07:33:17	1
13957	99	87	82	cyclictest	0	-21	swapper/1	07:33:17	1
13957	99	87	82	cyclictest	0	-21	swapper/1	07:03:28	1
13957	99	87	82	cyclictest	0	-21	swapper/1	06:48:31	1
13957	99	87	82	cyclictest	0	-21	swapper/1	06:18:31	1
13957	99	87	82	cyclictest	0	-21	swapper/1	05:22:28	1
13957	99	87	82	cyclictest	0	-21	swapper/1	03:38:36	1
13957	99	87	82	cyclictest	0	-21	swapper/1	03:38:36	1
13957	99	86	82	cyclictest	0	-21	swapper/1	05:48:31	1
13957	99	86	82	cyclictest	0	-21	swapper/1	05:08:32	1
13957	99	86	82	cyclictest	0	-21	swapper/1	04:05:41	1
13957	99	86	82	cyclictest	0	-21	swapper/1	03:55:40	1
13959	99	84	83	cyclictest	0	-21	swapper/3	04:38:28	3
13959	99	83	82	cyclictest	0	-21	swapper/3	08:33:24	3
13959	99	83	82	cyclictest	0	-21	swapper/3	08:28:27	3
13959	99	83	82	cyclictest	0	-21	swapper/3	08:23:17	3
13959	99	83	82	cyclictest	0	-21	swapper/3	08:16:16	3
13959	99	83	82	cyclictest	0	-21	swapper/3	08:08:26	3
13959	99	83	82	cyclictest	0	-21	swapper/3	08:03:21	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:53:26	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:51:13	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:43:21	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:43:05	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:33:17	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:33:17	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:28:29	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:23:21	3
13959	99	83	82	cyclictest	0	-21	swapper/3	07:03:30	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:58:26	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:53:21	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:43:28	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:38:31	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:33:23	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:28:09	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:26:01	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:08:30	3
13959	99	83	82	cyclictest	0	-21	swapper/3	06:03:31	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:58:23	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:55:56	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:50:56	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:43:30	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:38:30	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:35:54	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:30:53	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:23:31	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:23:10	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:08:25	3
13959	99	83	82	cyclictest	0	-21	swapper/3	05:03:27	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:55:48	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:55:48	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:48:34	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:45:47	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:25:44	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:13:37	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:08:37	3
13959	99	83	82	cyclictest	0	-21	swapper/3	04:03:27	3
13959	99	83	82	cyclictest	0	-21	swapper/3	03:43:25	3
13957	99	83	82	cyclictest	9547	-21	aten2.4-expect	05:43:21	1
13957	99	83	82	cyclictest	0	-21	swapper/1	08:13:24	1
13957	99	83	82	cyclictest	0	-21	swapper/1	08:13:04	1
13957	99	83	82	cyclictest	0	-21	swapper/1	07:58:17	1
13957	99	83	82	cyclictest	0	-21	swapper/1	07:48:26	1
13957	99	83	82	cyclictest	0	-21	swapper/1	07:38:26	1
13957	99	83	82	cyclictest	0	-21	swapper/1	07:26:09	1
13957	99	83	82	cyclictest	0	-21	swapper/1	07:18:27	1
13957	99	83	82	cyclictest	0	-21	swapper/1	06:58:29	1
13957	99	83	82	cyclictest	0	-21	swapper/1	06:56:04	1
13957	99	83	82	cyclictest	0	-21	swapper/1	06:46:04	1
13957	99	83	82	cyclictest	0	-21	swapper/1	06:33:30	1
13957	99	83	82	cyclictest	0	-21	swapper/1	06:23:25	1
13957	99	83	82	cyclictest	0	-21	swapper/1	06:10:58	1
13957	99	83	82	cyclictest	0	-21	swapper/1	05:13:33	1
13957	99	83	82	cyclictest	0	-21	swapper/1	04:50:47	1
13957	99	83	82	cyclictest	0	-21	swapper/1	04:43:33	1
13957	99	83	82	cyclictest	0	-21	swapper/1	04:33:33	1
13957	99	83	82	cyclictest	0	-21	swapper/1	03:58:34	1
13957	99	83	82	cyclictest	0	-21	swapper/1	03:43:28	1
13957	99	83	82	cyclictest	0	-21	swapper/1	03:30:37	1
13957	99	83	81	cyclictest	2957	-21	aten2.4-expect	04:13:26	1
13957	99	83	81	cyclictest	23042	-21	tune2fs	07:28:22	1
13957	99	83	81	cyclictest	16636	-21	tune2fs	05:58:23	1
13957	99	83	81	cyclictest	14426	-21	tune2fs	05:53:22	1
13957	99	83	81	cyclictest	14424	-21	tune2fs	07:08:21	1
13957	99	83	81	cyclictest	1142	-21	tune2fs	04:08:28	1
13959	99	82	81	cyclictest	14788	-21	gltestperf	03:23:30	3
13959	99	82	81	cyclictest	0	-21	swapper/3	07:58:25	3
13957	99	82	81	cyclictest	23098	-21	tune2fs	06:13:24	1
13957	99	82	81	cyclictest	18716	-21	tune2fs	08:33:17	1
13957	99	82	71	cyclictest	0	-21	swapper/1	08:43:03	1
13959	99	74	73	cyclictest	0	-21	swapper/3	07:21:08	3
13957	99	74	72	cyclictest	0	-21	swapper/1	08:48:18	1
13959	99	73	72	cyclictest	0	-21	swapper/3	06:48:21	3
13959	99	73	72	cyclictest	0	-21	swapper/3	04:33:26	3
13959	99	73	72	cyclictest	0	-21	swapper/3	04:23:13	3
13959	99	73	72	cyclictest	0	-21	swapper/3	03:42:14	3
13959	99	73	72	cyclictest	0	-21	swapper/3	03:42:14	3
13959	99	73	72	cyclictest	0	-21	swapper/3	03:28:27	3
13959	99	73	71	cyclictest	28761	-21	aten2.4-expect	03:58:25	3
13957	99	73	72	cyclictest	0	-21	swapper/1	06:28:25	1
13957	99	73	72	cyclictest	0	-21	swapper/1	05:33:32	1
13957	99	73	72	cyclictest	0	-21	swapper/1	05:06:53	1
13957	99	73	72	cyclictest	0	-21	swapper/1	04:58:19	1
13957	99	73	72	cyclictest	0	-21	swapper/1	04:53:34	1
13957	99	73	72	cyclictest	0	-21	swapper/1	04:53:34	1
13957	99	73	72	cyclictest	0	-21	swapper/1	04:28:24	1
13957	99	73	72	cyclictest	0	-21	swapper/1	04:23:34	1
13957	99	73	72	cyclictest	0	-21	swapper/1	04:18:26	1
13957	99	73	71	cyclictest	16249	-21	aten2.4-expect	08:28:16	1
13959	99	72	71	cyclictest	0	-21	swapper/3	08:43:24	3
13959	99	72	71	cyclictest	0	-21	swapper/3	05:13:24	3
13959	99	72	71	cyclictest	0	-21	swapper/3	03:33:37	3
13957	99	72	71	cyclictest	0	-21	swapper/1	06:03:27	1
13957	99	72	71	cyclictest	0	-21	swapper/1	03:23:36	1
13959	99	67	66	cyclictest	0	-21	swapper/3	03:49:46	3
13959	99	66	65	cyclictest	0	-21	swapper/3	06:13:21	3
13959	99	66	53	cyclictest	0	-21	swapper/3	08:18:18	3
13957	99	66	65	cyclictest	0	-21	swapper/1	07:53:16	1
13959	99	65	64	cyclictest	0	-21	swapper/3	06:19:42	3
13959	99	64	63	cyclictest	0	-21	swapper/3	04:58:30	3
13959	99	64	63	cyclictest	0	-21	swapper/3	03:53:36	3
13957	99	63	62	cyclictest	0	-21	swapper/1	08:23:15	1
13957	99	63	62	cyclictest	0	-21	swapper/1	08:18:15	1
13957	99	63	62	cyclictest	0	-21	swapper/1	03:48:26	1
13957	99	63	61	cyclictest	7429	-21	aten2.4-expect	05:38:22	1
13957	99	63	61	cyclictest	17970	-21	aten2.4-expect	03:33:28	1
13958	99	62	61	cyclictest	0	-21	swapper/2	03:46:18	2
13956	99	62	61	cyclictest	0	-21	swapper/0	03:25:58	0
13956	99	58	21	cyclictest	1286	50	irq/46-eth0	07:13:08	0
13958	99	56	51	cyclictest	0	-21	swapper/2	05:49:39	2
13958	99	56	51	cyclictest	0	-21	swapper/2	05:16:48	2
13958	99	56	51	cyclictest	0	-21	swapper/2	04:04:51	2
13958	99	56	51	cyclictest	0	-21	swapper/2	03:41:36	2
13958	99	56	51	cyclictest	0	-21	swapper/2	03:41:36	2
13958	99	55	54	cyclictest	8685	-21	munin-node	08:08:23	2
13958	99	55	54	cyclictest	25959	-21	munin-node	03:48:38	2
13958	99	55	54	cyclictest	18981	-21	fschecks_time	08:33:18	2
13958	99	55	54	cyclictest	15168	-21	munin-node	07:08:27	2
13958	99	55	51	cyclictest	0	-21	swapper/2	06:49:25	2
13958	99	55	51	cyclictest	0	-21	swapper/2	04:00:35	2
13958	99	55	50	cyclictest	0	-21	swapper/2	07:56:40	2
13958	99	54	53	cyclictest	9726	-21	munin-node	08:13:14	2
13958	99	54	53	cyclictest	6045	-21	munin-node	04:18:31	2
13958	99	54	53	cyclictest	3116	-21	munin-node	06:43:18	2
13958	99	54	53	cyclictest	31159	-21	latency_hist	07:48:05	2
13958	99	54	53	cyclictest	29139	-21	munin-node	06:28:22	2
13958	99	54	53	cyclictest	25519	-21	munin-node	05:03:30	2
13958	99	54	53	cyclictest	25418	-21	munin-node	06:18:26	2
13958	99	54	53	cyclictest	23932	-21	munin-node	07:28:29	2
13958	99	54	53	cyclictest	23701	-21	munin-node	04:58:35	2
13958	99	54	53	cyclictest	19050	-21	munin-node	06:03:27	2
13958	99	54	53	cyclictest	1899	-21	munin-node	05:23:30	2
13958	99	54	53	cyclictest	16950	-21	munin-node	07:13:23	2
13958	99	54	53	cyclictest	15180	-21	munin-node	03:23:34	2
13958	99	54	53	cyclictest	14108	-21	munin-node	05:53:21	2
13958	99	54	52	cyclictest	0	-21	swapper/2	06:38:21	2
13956	99	54	42	cyclictest	760	50	irq/18-parport0	04:52:57	0
13958	99	53	52	cyclictest	7251	-21	latency_hist	05:38:11	2
13958	99	53	52	cyclictest	25015	-21	munin-node	07:33:18	2
13958	99	53	52	cyclictest	25015	-21	munin-node	07:33:18	2
13958	99	53	52	cyclictest	13029	-21	munin-node	08:18:22	2
13958	99	53	52	cyclictest	10525	-21	munin-node	04:28:31	2
13958	99	53	52	cyclictest	0	-21	swapper/2	08:03:25	2
13958	99	53	52	cyclictest	0	-21	swapper/2	07:48:18	2
13958	99	53	52	cyclictest	0	-21	swapper/2	07:24:37	2
13958	99	53	52	cyclictest	0	-21	swapper/2	06:56:10	2
13958	99	53	52	cyclictest	0	-21	swapper/2	06:33:20	2
13958	99	53	52	cyclictest	0	-21	swapper/2	05:47:26	2
13958	99	53	52	cyclictest	0	-21	swapper/2	05:38:22	2
13958	99	53	52	cyclictest	0	-21	swapper/2	05:08:22	2
13958	99	53	52	cyclictest	0	-21	swapper/2	04:33:24	2
13958	99	53	52	cyclictest	0	-21	swapper/2	03:53:27	2
13958	99	53	52	cyclictest	0	-21	swapper/2	03:28:27	2
13958	99	53	51	cyclictest	278	-21	usb-storage	08:26:21	2
13958	99	53	51	cyclictest	278	-21	usb-storage	06:00:51	2
13958	99	53	51	cyclictest	22815	-21	telnet	08:43:16	2
13958	99	53	51	cyclictest	15968	-21	telnet	04:43:24	2
13958	99	53	41	cyclictest	3949	-21	kernelversion	05:28:29	2
13958	99	53	41	cyclictest	3490	-21	df_abs	07:58:18	2
13958	99	53	41	cyclictest	32553	-21	vmstat	05:18:35	2
13958	99	53	41	cyclictest	27752	-21	if_eth1	07:38:21	2
13958	99	53	41	cyclictest	18406	-21	cpu	07:18:18	2
13958	99	53	41	cyclictest	18198	-21	entropy	03:33:30	2
13958	99	53	41	cyclictest	17799	-21	sshd	08:28:45	2
13958	99	53	41	cyclictest	0	-21	swapper/2	08:38:17	2
13958	99	53	41	cyclictest	0	-21	swapper/2	04:53:24	2
13958	99	53	41	cyclictest	0	-21	swapper/2	04:53:24	2
13956	99	53	52	cyclictest	0	-21	swapper/0	08:29:15	0
13956	99	53	52	cyclictest	0	-21	swapper/0	08:23:43	0
13956	99	53	52	cyclictest	0	-21	swapper/0	07:59:06	0
13956	99	53	52	cyclictest	0	-21	swapper/0	07:08:46	0
13956	99	53	52	cyclictest	0	-21	swapper/0	06:18:50	0
13956	99	53	52	cyclictest	0	-21	swapper/0	06:17:08	0
13956	99	53	52	cyclictest	0	-21	swapper/0	06:09:24	0
13956	99	53	52	cyclictest	0	-21	swapper/0	05:14:10	0
13956	99	53	52	cyclictest	0	-21	swapper/0	04:57:53	0
13956	99	53	52	cyclictest	0	-21	swapper/0	04:57:53	0
13956	99	53	52	cyclictest	0	-21	swapper/0	04:29:32	0
13956	99	53	52	cyclictest	0	-21	swapper/0	03:47:28	0
13956	99	53	41	cyclictest	0	-21	swapper/0	08:04:43	0
13956	99	53	41	cyclictest	0	-21	swapper/0	07:49:44	0
13956	99	53	41	cyclictest	0	-21	swapper/0	07:43:37	0
13956	99	53	41	cyclictest	0	-21	swapper/0	07:23:19	0
13956	99	53	41	cyclictest	0	-21	swapper/0	06:28:21	0
13956	99	53	41	cyclictest	0	-21	swapper/0	06:00:23	0
13956	99	53	41	cyclictest	0	-21	swapper/0	05:57:13	0
13956	99	53	41	cyclictest	0	-21	swapper/0	05:44:38	0
13956	99	53	41	cyclictest	0	-21	swapper/0	05:32:42	0
13956	99	53	41	cyclictest	0	-21	swapper/0	05:25:54	0
13956	99	53	41	cyclictest	0	-21	swapper/0	05:12:54	0
13956	99	53	41	cyclictest	0	-21	swapper/0	05:03:31	0
13956	99	53	41	cyclictest	0	-21	swapper/0	04:46:27	0
13956	99	53	41	cyclictest	0	-21	swapper/0	04:41:44	0
13956	99	53	41	cyclictest	0	-21	swapper/0	04:24:48	0
13956	99	53	41	cyclictest	0	-21	swapper/0	04:23:06	0
13956	99	53	41	cyclictest	0	-21	swapper/0	04:13:55	0
13956	99	53	41	cyclictest	0	-21	swapper/0	04:04:17	0
13956	99	53	41	cyclictest	0	-21	swapper/0	03:55:05	0
13956	99	53	41	cyclictest	0	-21	swapper/0	03:39:54	0
13956	99	53	41	cyclictest	0	-21	swapper/0	03:39:54	0
13958	99	52	51	cyclictest	278	-21	usb-storage	04:15:11	2
13958	99	52	51	cyclictest	20267	-21	telnet	06:08:21	2
13958	99	52	51	cyclictest	18024	-21	telnet	04:48:25	2
13958	99	52	51	cyclictest	11925	-21	munin-node	07:03:20	2
13958	99	52	51	cyclictest	0	-21	swapper/2	08:48:08	2
13958	99	52	51	cyclictest	0	-21	swapper/2	06:13:21	2
13958	99	52	51	cyclictest	0	-21	swapper/2	04:08:19	2
13958	99	52	50	cyclictest	7734	-21	fschecks_time	04:23:27	2
13958	99	52	41	cyclictest	27055	-21	df_abs	06:23:20	2
13958	99	52	41	cyclictest	10960	-21	swap	06:58:31	2
13958	99	52	41	cyclictest	0	-21	swapper/2	04:38:38	2
13956	99	52	51	cyclictest	0	-21	swapper/0	08:33:15	0
13956	99	52	51	cyclictest	0	-21	swapper/0	07:29:41	0
13956	99	52	51	cyclictest	0	-21	swapper/0	06:58:44	0
13956	99	52	51	cyclictest	0	-21	swapper/0	06:45:59	0
13956	99	52	51	cyclictest	0	-21	swapper/0	06:23:32	0
13956	99	52	51	cyclictest	0	-21	swapper/0	06:03:54	0
13956	99	52	51	cyclictest	0	-21	swapper/0	05:35:30	0
13956	99	52	51	cyclictest	0	-21	swapper/0	04:36:19	0
13956	99	52	51	cyclictest	0	-21	swapper/0	04:10:19	0
13956	99	52	51	cyclictest	0	-21	swapper/0	03:49:14	0
13956	99	52	51	cyclictest	0	-21	swapper/0	03:33:28	0
13956	99	52	51	cyclictest	0	-21	swapper/0	03:33:12	0
13956	99	52	41	cyclictest	0	-21	swapper/0	08:10:24	0
13956	99	52	41	cyclictest	0	-21	swapper/0	07:39:49	0
13956	99	51	50	cyclictest	0	-21	swapper/0	08:53:02	0
13956	99	51	50	cyclictest	0	-21	swapper/0	08:38:19	0
13956	99	51	50	cyclictest	0	-21	swapper/0	08:14:06	0
13956	99	51	50	cyclictest	0	-21	swapper/0	07:34:15	0
13956	99	51	50	cyclictest	0	-21	swapper/0	07:34:15	0
13956	99	51	50	cyclictest	0	-21	swapper/0	07:20:12	0
13956	99	51	50	cyclictest	0	-21	swapper/0	07:03:28	0
13956	99	51	50	cyclictest	0	-21	swapper/0	06:37:15	0
13956	99	51	50	cyclictest	0	-21	swapper/0	04:02:29	0
13956	99	50	49	cyclictest	0	-21	swapper/0	05:51:17	0
13956	99	49	48	cyclictest	0	-21	swapper/0	06:41:11	0
13956	99	49	48	cyclictest	0	-21	swapper/0	05:40:59	0
13956	99	49	42	cyclictest	0	-21	swapper/0	05:22:50	0
13956	99	49	41	cyclictest	0	-21	swapper/0	05:02:53	0
13956	99	48	47	cyclictest	0	-21	swapper/0	08:21:33	0
13956	99	48	47	cyclictest	0	-21	swapper/0	06:49:09	0
13956	99	48	41	cyclictest	0	-21	swapper/0	08:45:54	0
13956	99	47	46	cyclictest	0	-21	swapper/0	06:53:54	0
13956	99	45	44	cyclictest	0	-21	swapper/0	07:55:16	0
8	99	11	0	watchdog/0	13621	2	sleep0	03:21:06	0
16	99	10	0	migration/2	13826	-21	latency_hist	03:23:15	2
12	1	10	0	ksoftirqd/1	0	-21	swapper/1	03:18:30	1
23	1	7	0	ksoftirqd/3	12586	-21	gltestperf	03:18:31	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17