OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Wed Aug 19, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
29055	99	123	122	cyclictest	0	-21	swapper/3	07:22:25	3
29053	99	123	122	cyclictest	23473	-21	tune2fs	07:02:25	1
29055	99	107	102	cyclictest	0	-21	swapper/3	05:22:34	3
29053	99	104	102	cyclictest	16679	-21	tune2fs	04:17:30	1
29053	99	103	102	cyclictest	14661	-21	tune2fs	05:27:29	1
29055	99	95	93	cyclictest	7052	-21	sed	05:07:39	3
29053	99	93	82	cyclictest	0	-21	swapper/1	04:32:16	1
29055	99	89	82	cyclictest	0	-21	swapper/3	04:57:27	3
29055	99	87	82	cyclictest	0	-21	swapper/3	05:57:28	3
29055	99	87	82	cyclictest	0	-21	swapper/3	05:27:28	3
29055	99	87	82	cyclictest	0	-21	swapper/3	04:07:29	3
29055	99	86	81	cyclictest	0	-21	swapper/3	08:07:21	3
29055	99	85	82	cyclictest	0	-21	swapper/3	08:16:01	3
29055	99	85	81	cyclictest	0	-21	swapper/3	06:10:43	3
29055	99	85	71	cyclictest	0	-21	swapper/3	06:57:32	3
29053	99	84	82	cyclictest	6437	-21	tune2fs	07:37:24	1
29055	99	83	82	cyclictest	0	-21	swapper/3	08:42:28	3
29055	99	83	82	cyclictest	0	-21	swapper/3	08:42:28	3
29055	99	83	82	cyclictest	0	-21	swapper/3	08:22:31	3
29055	99	83	82	cyclictest	0	-21	swapper/3	08:06:00	3
29055	99	83	82	cyclictest	0	-21	swapper/3	07:57:23	3
29055	99	83	82	cyclictest	0	-21	swapper/3	07:55:59	3
29055	99	83	82	cyclictest	0	-21	swapper/3	07:12:30	3
29055	99	83	82	cyclictest	0	-21	swapper/3	06:50:50	3
29055	99	83	82	cyclictest	0	-21	swapper/3	06:50:50	3
29055	99	83	82	cyclictest	0	-21	swapper/3	06:42:32	3
29055	99	83	82	cyclictest	0	-21	swapper/3	05:37:36	3
29055	99	83	82	cyclictest	0	-21	swapper/3	05:32:29	3
29055	99	83	82	cyclictest	0	-21	swapper/3	05:17:37	3
29055	99	83	82	cyclictest	0	-21	swapper/3	05:12:32	3
29055	99	83	82	cyclictest	0	-21	swapper/3	05:02:36	3
29055	99	83	82	cyclictest	0	-21	swapper/3	04:55:30	3
29055	99	83	82	cyclictest	0	-21	swapper/3	04:22:39	3
29055	99	83	82	cyclictest	0	-21	swapper/3	04:22:39	3
29055	99	83	82	cyclictest	0	-21	swapper/3	04:17:31	3
29055	99	83	82	cyclictest	0	-21	swapper/3	03:57:40	3
29055	99	83	82	cyclictest	0	-21	swapper/3	03:55:20	3
29055	99	83	82	cyclictest	0	-21	swapper/3	03:47:38	3
29055	99	83	82	cyclictest	0	-21	swapper/3	03:42:39	3
29055	99	83	82	cyclictest	0	-21	swapper/3	03:32:40	3
29055	99	83	71	cyclictest	0	-21	swapper/3	07:37:24	3
29055	99	83	71	cyclictest	0	-21	swapper/3	06:37:25	3
29053	99	83	82	cyclictest	16937	-21	tune2fs	08:02:24	1
29053	99	83	82	cyclictest	0	-21	swapper/1	09:01:08	1
29053	99	83	82	cyclictest	0	-21	swapper/1	07:52:29	1
29053	99	83	82	cyclictest	0	-21	swapper/1	07:30:55	1
29053	99	83	82	cyclictest	0	-21	swapper/1	07:15:53	1
29053	99	83	82	cyclictest	0	-21	swapper/1	07:07:33	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:57:25	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:52:32	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:47:25	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:47:25	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:27:33	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:22:27	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:07:36	1
29053	99	83	82	cyclictest	0	-21	swapper/1	06:02:34	1
29053	99	83	82	cyclictest	0	-21	swapper/1	05:42:35	1
29053	99	83	82	cyclictest	0	-21	swapper/1	05:32:33	1
29053	99	83	82	cyclictest	0	-21	swapper/1	05:15:34	1
29053	99	83	82	cyclictest	0	-21	swapper/1	05:10:33	1
29053	99	83	82	cyclictest	0	-21	swapper/1	04:22:39	1
29053	99	83	82	cyclictest	0	-21	swapper/1	04:22:39	1
29053	99	83	82	cyclictest	0	-21	swapper/1	04:07:31	1
29053	99	83	82	cyclictest	0	-21	swapper/1	03:52:38	1
29053	99	83	81	cyclictest	4147	-21	tune2fs	06:17:28	1
29053	99	83	81	cyclictest	4066	-21	tune2fs	07:32:23	1
29053	99	83	81	cyclictest	3907	-21	tune2fs	05:02:29	1
29053	99	83	81	cyclictest	32130	-21	tune2fs	07:22:25	1
29053	99	83	81	cyclictest	29751	-21	tune2fs	03:32:33	1
29053	99	83	81	cyclictest	29557	-21	tune2fs	04:47:30	1
29053	99	83	81	cyclictest	27532	-21	tune2fs	04:42:30	1
29053	99	83	81	cyclictest	25811	-21	tune2fs	08:22:24	1
29053	99	83	81	cyclictest	25332	-21	tune2fs	05:52:27	1
29053	99	83	81	cyclictest	2243	-21	tune2fs	08:42:22	1
29053	99	83	81	cyclictest	2243	-21	tune2fs	08:42:22	1
29053	99	83	81	cyclictest	1833	-21	tune2fs	06:12:25	1
29053	99	83	81	cyclictest	1534	-21	tune2fs	04:57:30	1
29053	99	83	81	cyclictest	15025	-21	tune2fs	07:57:23	1
29053	99	83	81	cyclictest	15002	-21	tune2fs	06:42:26	1
29053	99	83	81	cyclictest	12210	-21	aten2.4-expect	06:37:25	1
29053	99	83	81	cyclictest	10309	-21	tune2fs	04:02:32	1
29055	99	82	81	cyclictest	0	-21	swapper/3	07:32:23	3
29055	99	82	81	cyclictest	0	-21	swapper/3	06:22:27	3
29055	99	82	81	cyclictest	0	-21	swapper/3	04:42:30	3
29055	99	82	81	cyclictest	0	-21	swapper/3	04:12:31	3
29055	99	77	72	cyclictest	0	-21	swapper/3	04:37:28	3
29055	99	76	72	cyclictest	0	-21	swapper/3	06:32:24	3
29055	99	76	72	cyclictest	0	-21	swapper/3	06:13:47	3
29055	99	76	72	cyclictest	0	-21	swapper/3	04:32:40	3
29055	99	76	62	cyclictest	0	-21	swapper/3	08:51:00	3
29053	99	74	72	cyclictest	31469	-21	aten2.4-expect	04:52:28	1
29055	99	73	72	cyclictest	0	-21	swapper/3	06:28:15	3
29055	99	73	72	cyclictest	0	-21	swapper/3	04:47:40	3
29055	99	73	71	cyclictest	25071	-21	aten2.4-expect	05:52:25	3
29053	99	73	72	cyclictest	0	-21	swapper/1	08:37:20	1
29053	99	73	72	cyclictest	0	-21	swapper/1	08:12:18	1
29053	99	73	72	cyclictest	0	-21	swapper/1	08:07:19	1
29053	99	73	72	cyclictest	0	-21	swapper/1	07:47:20	1
29053	99	73	72	cyclictest	0	-21	swapper/1	07:17:23	1
29053	99	73	72	cyclictest	0	-21	swapper/1	06:32:28	1
29053	99	73	72	cyclictest	0	-21	swapper/1	05:57:25	1
29053	99	73	72	cyclictest	0	-21	swapper/1	05:47:31	1
29053	99	73	72	cyclictest	0	-21	swapper/1	05:37:25	1
29053	99	73	72	cyclictest	0	-21	swapper/1	05:27:14	1
29053	99	73	72	cyclictest	0	-21	swapper/1	05:17:29	1
29053	99	73	72	cyclictest	0	-21	swapper/1	04:37:29	1
29053	99	73	72	cyclictest	0	-21	swapper/1	04:32:27	1
29053	99	73	72	cyclictest	0	-21	swapper/1	04:12:28	1
29053	99	73	72	cyclictest	0	-21	swapper/1	03:57:30	1
29053	99	73	72	cyclictest	0	-21	swapper/1	03:42:30	1
29053	99	73	72	cyclictest	0	-21	swapper/1	03:37:29	1
29053	99	73	62	cyclictest	0	-21	swapper/1	08:32:28	1
29055	99	72	71	cyclictest	0	-21	swapper/3	08:55:32	3
29055	99	72	71	cyclictest	0	-21	swapper/3	08:42:07	3
29055	99	72	71	cyclictest	0	-21	swapper/3	07:02:31	3
29055	99	72	71	cyclictest	0	-21	swapper/3	05:47:35	3
29055	99	72	71	cyclictest	0	-21	swapper/3	05:42:35	3
29055	99	72	71	cyclictest	0	-21	swapper/3	04:02:32	3
29055	99	72	61	cyclictest	0	-21	swapper/3	08:27:18	3
29055	99	71	70	cyclictest	12016	-21	ksmtuned	07:51:13	3
29055	99	69	51	cyclictest	0	-21	swapper/3	08:57:27	3
29055	99	68	62	cyclictest	0	-21	swapper/3	08:17:27	3
29055	99	68	52	cyclictest	0	-21	swapper/3	07:27:27	3
29055	99	68	52	cyclictest	0	-21	swapper/3	07:07:24	3
29055	99	68	52	cyclictest	0	-21	swapper/3	04:27:29	3
29053	99	68	67	cyclictest	0	-21	swapper/1	07:42:25	1
29055	99	67	62	cyclictest	0	-21	swapper/3	08:32:20	3
29055	99	67	62	cyclictest	0	-21	swapper/3	06:02:27	3
29055	99	67	62	cyclictest	0	-21	swapper/3	03:37:32	3
29055	99	67	51	cyclictest	9628	-21	in.tftpd	07:43:32	3
29055	99	67	51	cyclictest	0	-21	swapper/3	07:17:24	3
29055	99	67	51	cyclictest	0	-21	swapper/3	06:52:28	3
29055	99	66	62	cyclictest	0	-21	swapper/3	06:17:34	3
29053	99	63	62	cyclictest	0	-21	swapper/1	08:52:18	1
29053	99	63	62	cyclictest	0	-21	swapper/1	08:47:07	1
29053	99	63	62	cyclictest	0	-21	swapper/1	08:27:19	1
29053	99	63	62	cyclictest	0	-21	swapper/1	08:17:08	1
29053	99	63	61	cyclictest	3385	-21	aten2.4-expect	03:47:30	1
29054	99	62	61	cyclictest	0	-21	swapper/2	07:02:49	2
29054	99	62	61	cyclictest	0	-21	swapper/2	06:10:50	2
29054	99	62	61	cyclictest	0	-21	swapper/2	05:07:53	2
29054	99	62	61	cyclictest	0	-21	swapper/2	04:47:19	2
29054	99	62	61	cyclictest	0	-21	swapper/2	03:56:19	2
29054	99	61	60	cyclictest	0	-21	swapper/2	08:08:31	2
29054	99	61	60	cyclictest	0	-21	swapper/2	05:31:22	2
29052	99	61	51	cyclictest	760	50	irq/18-parport0	08:11:57	0
29054	99	60	59	cyclictest	0	-21	swapper/2	08:33:15	2
29054	99	60	59	cyclictest	0	-21	swapper/2	08:29:45	2
29054	99	60	59	cyclictest	0	-21	swapper/2	08:05:46	2
29054	99	60	59	cyclictest	0	-21	swapper/2	04:44:19	2
29054	99	60	59	cyclictest	0	-21	swapper/2	04:31:14	2
29054	99	59	58	cyclictest	0	-21	swapper/2	07:23:28	2
29054	99	59	58	cyclictest	0	-21	swapper/2	05:12:26	2
29052	99	59	52	cyclictest	760	50	irq/18-parport0	06:00:08	0
29052	99	59	52	cyclictest	760	50	irq/18-parport0	04:41:03	0
29054	99	58	57	cyclictest	0	-21	swapper/2	08:46:00	2
29054	99	58	57	cyclictest	0	-21	swapper/2	08:46:00	2
29054	99	58	57	cyclictest	0	-21	swapper/2	07:42:20	2
29054	99	58	57	cyclictest	0	-21	swapper/2	06:35:50	2
29054	99	58	57	cyclictest	0	-21	swapper/2	05:54:10	2
29054	99	58	57	cyclictest	0	-21	swapper/2	05:02:27	2
29052	99	58	51	cyclictest	1286	50	irq/46-eth0	07:24:08	0
29052	99	58	51	cyclictest	1286	50	irq/46-eth0	03:55:42	0
29052	99	58	46	cyclictest	0	-21	swapper/0	07:28:23	0
29052	99	58	41	cyclictest	0	-21	swapper/0	04:17:29	0
29054	99	57	56	cyclictest	0	-21	swapper/2	04:33:28	2
29054	99	57	56	cyclictest	0	-21	swapper/2	04:10:20	2
29052	99	57	52	cyclictest	0	-21	swapper/0	08:41:08	0
29052	99	57	52	cyclictest	0	-21	swapper/0	08:32:21	0
29052	99	57	52	cyclictest	0	-21	swapper/0	05:25:46	0
29052	99	57	52	cyclictest	0	-21	swapper/0	04:57:27	0
29052	99	57	51	cyclictest	760	50	irq/18-parport0	07:41:33	0
29052	99	57	51	cyclictest	760	50	irq/18-parport0	04:26:46	0
29052	99	57	51	cyclictest	760	50	irq/18-parport0	04:26:46	0
29052	99	57	51	cyclictest	760	50	irq/18-parport0	04:05:11	0
29052	99	57	51	cyclictest	50	50	irq/44-ahci	08:52:46	0
29052	99	57	51	cyclictest	50	50	irq/44-ahci	08:23:11	0
29052	99	57	51	cyclictest	50	50	irq/44-ahci	05:45:33	0
29052	99	57	51	cyclictest	1286	50	irq/46-eth0	06:52:31	0
29052	99	57	51	cyclictest	1286	50	irq/46-eth0	06:03:08	0
29052	99	57	51	cyclictest	1286	50	irq/46-eth0	05:21:52	0
29052	99	57	51	cyclictest	0	-21	swapper/0	06:27:24	0
29052	99	57	51	cyclictest	0	-21	swapper/0	05:53:21	0
29052	99	57	51	cyclictest	0	-21	swapper/0	04:42:33	0
29052	99	57	41	cyclictest	0	-21	swapper/0	07:02:25	0
29054	99	56	55	cyclictest	0	-21	swapper/2	05:51:41	2
29054	99	56	55	cyclictest	0	-21	swapper/2	05:00:45	2
29054	99	56	52	cyclictest	0	-21	swapper/2	06:04:48	2
29052	99	56	51	cyclictest	0	-21	swapper/0	08:42:18	0
29052	99	56	51	cyclictest	0	-21	swapper/0	08:42:18	0
29052	99	56	51	cyclictest	0	-21	swapper/0	08:27:18	0
29052	99	56	51	cyclictest	0	-21	swapper/0	08:02:21	0
29052	99	56	51	cyclictest	0	-21	swapper/0	07:49:38	0
29052	99	56	51	cyclictest	0	-21	swapper/0	07:42:20	0
29052	99	56	51	cyclictest	0	-21	swapper/0	07:07:40	0
29052	99	56	51	cyclictest	0	-21	swapper/0	06:57:22	0
29052	99	56	51	cyclictest	0	-21	swapper/0	06:46:51	0
29052	99	56	51	cyclictest	0	-21	swapper/0	06:15:36	0
29052	99	56	51	cyclictest	0	-21	swapper/0	05:16:06	0
29052	99	56	51	cyclictest	0	-21	swapper/0	04:12:28	0
29052	99	56	51	cyclictest	0	-21	swapper/0	04:01:08	0
29054	99	55	54	cyclictest	24848	-21	sshd	08:19:31	2
29054	99	55	54	cyclictest	0	-21	swapper/2	06:47:19	2
29054	99	55	54	cyclictest	0	-21	swapper/2	06:47:19	2
29054	99	55	53	cyclictest	50	50	irq/44-ahci	07:38:39	2
29054	99	55	53	cyclictest	50	50	irq/44-ahci	03:52:07	2
29054	99	55	51	cyclictest	1876	-21	hald-addon-stor	06:23:42	2
29054	99	55	51	cyclictest	0	-21	swapper/2	08:15:52	2
29054	99	55	51	cyclictest	0	-21	swapper/2	05:42:13	2
29054	99	55	51	cyclictest	0	-21	swapper/2	05:17:58	2
29052	99	55	51	cyclictest	0	-21	swapper/0	05:35:19	0
29052	99	55	51	cyclictest	0	-21	swapper/0	04:47:59	0
29052	99	55	51	cyclictest	0	-21	swapper/0	03:49:18	0
29054	99	54	53	cyclictest	50	50	irq/44-ahci	07:29:49	2
29054	99	54	53	cyclictest	31697	-21	munin-node	08:37:21	2
29054	99	54	53	cyclictest	2302	-21	lldpd	04:22:09	2
29054	99	54	53	cyclictest	18356	-21	munin-node	04:22:34	2
29054	99	54	53	cyclictest	18356	-21	munin-node	04:22:34	2
29054	99	54	53	cyclictest	1653	-21	avahi-daemon	08:23:58	2
29054	99	54	53	cyclictest	14421	-21	telnet	06:42:23	2
29054	99	54	53	cyclictest	0	-21	swapper/2	07:48:17	2
29054	99	54	52	cyclictest	50	50	irq/44-ahci	06:30:07	2
29054	99	54	52	cyclictest	50	50	irq/44-ahci	03:46:49	2
29054	99	54	51	cyclictest	24849	-21	munin-node	04:37:33	2
29054	99	54	51	cyclictest	0	-21	swapper/2	05:43:09	2
29054	99	54	51	cyclictest	0	-21	swapper/2	03:58:47	2
29054	99	54	43	cyclictest	0	-21	swapper/2	04:02:30	2
29052	99	54	52	cyclictest	760	50	irq/18-parport0	04:34:26	0
29054	99	53	52	cyclictest	3485	-21	munin-node	06:17:26	2
29054	99	53	52	cyclictest	18775	-21	telnet	06:52:23	2
29054	99	53	52	cyclictest	1225	-21	telnet	06:12:22	2
29054	99	53	52	cyclictest	0	-21	swapper/2	08:57:18	2
29054	99	53	52	cyclictest	0	-21	swapper/2	08:52:19	2
29054	99	53	52	cyclictest	0	-21	swapper/2	08:47:12	2
29054	99	53	52	cyclictest	0	-21	swapper/2	07:57:15	2
29054	99	53	52	cyclictest	0	-21	swapper/2	07:32:17	2
29054	99	53	52	cyclictest	0	-21	swapper/2	07:17:11	2
29054	99	53	52	cyclictest	0	-21	swapper/2	05:57:39	2
29054	99	53	52	cyclictest	0	-21	swapper/2	05:22:16	2
29054	99	53	52	cyclictest	0	-21	swapper/2	04:52:27	2
29054	99	53	52	cyclictest	0	-21	swapper/2	04:12:50	2
29054	99	53	52	cyclictest	0	-21	swapper/2	03:37:34	2
29054	99	53	52	cyclictest	0	-21	swapper/2	03:32:23	2
29054	99	53	51	cyclictest	50	50	irq/44-ahci	07:12:20	2
29054	99	53	51	cyclictest	50	50	irq/44-ahci	06:37:21	2
29054	99	53	51	cyclictest	50	50	irq/44-ahci	05:32:19	2
29054	99	53	51	cyclictest	20760	-21	munin-node	06:57:22	2
29054	99	53	41	cyclictest	0	-21	swapper/2	07:52:20	2
29054	99	53	41	cyclictest	0	-21	swapper/2	07:07:55	2
29052	99	53	52	cyclictest	760	50	irq/18-parport0	03:37:36	0
29052	99	53	52	cyclictest	0	-21	swapper/0	07:35:49	0
29052	99	53	52	cyclictest	0	-21	swapper/0	06:07:27	0
29052	99	53	52	cyclictest	0	-21	swapper/0	05:48:49	0
29052	99	53	52	cyclictest	0	-21	swapper/0	05:27:26	0
29052	99	53	52	cyclictest	0	-21	swapper/0	04:07:29	0
29052	99	53	52	cyclictest	0	-21	swapper/0	03:37:08	0
29052	99	53	51	cyclictest	760	50	irq/18-parport0	08:13:19	0
29052	99	53	51	cyclictest	50	50	irq/44-ahci	04:27:44	0
29052	99	53	51	cyclictest	1876	-21	hald-addon-stor	07:52:42	0
29052	99	53	41	cyclictest	0	-21	swapper/0	08:58:08	0
29052	99	53	41	cyclictest	0	-21	swapper/0	07:12:25	0
29052	99	53	41	cyclictest	0	-21	swapper/0	06:47:34	0
29052	99	53	41	cyclictest	0	-21	swapper/0	06:47:34	0
29052	99	53	41	cyclictest	0	-21	swapper/0	06:37:28	0
29052	99	53	41	cyclictest	0	-21	swapper/0	06:32:24	0
29052	99	53	41	cyclictest	0	-21	swapper/0	06:22:51	0
29052	99	53	41	cyclictest	0	-21	swapper/0	06:17:26	0
29052	99	53	41	cyclictest	0	-21	swapper/0	05:02:36	0
29052	99	53	41	cyclictest	0	-21	swapper/0	03:42:36	0
29052	99	52	51	cyclictest	760	50	irq/18-parport0	08:19:57	0
29052	99	52	51	cyclictest	0	-21	swapper/0	08:47:36	0
29052	99	52	51	cyclictest	0	-21	swapper/0	07:57:21	0
29052	99	52	51	cyclictest	0	-21	swapper/0	07:17:21	0
29052	99	52	51	cyclictest	0	-21	swapper/0	05:37:25	0
29052	99	52	51	cyclictest	0	-21	swapper/0	05:08:06	0
29052	99	52	51	cyclictest	0	-21	swapper/0	04:54:17	0
8	99	13	0	watchdog/0	28511	-40	yum-updatesd-he	03:28:22	0
50	50	13	0	irq/44-ahci	28900	-21	crond	03:32:19	2
23	1	13	0	ksoftirqd/3	0	-21	swapper/3	03:32:19	3
12	1	12	0	ksoftirqd/1	0	-21	swapper/1	03:32:19	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17