OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Apr 27, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
24887	99	103	102	cyclictest	32178	-21	tune2fs	06:45:45	1
24887	99	94	92	cyclictest	0	-21	swapper/1	10:30:34	1
24890	99	93	92	cyclictest	0	-21	swapper/3	10:35:21	3
24890	99	93	92	cyclictest	0	-21	swapper/3	08:55:25	3
24890	99	93	92	cyclictest	0	-21	swapper/3	06:55:45	3
24890	99	93	92	cyclictest	0	-21	swapper/3	06:45:50	3
24890	99	93	92	cyclictest	0	-21	swapper/3	06:20:30	3
24890	99	93	92	cyclictest	0	-21	swapper/3	06:00:32	3
24890	99	89	83	cyclictest	0	-21	swapper/3	06:35:44	3
24890	99	89	72	cyclictest	1883	-21	fschecks_count	09:20:37	3
24890	99	88	72	cyclictest	0	-21	swapper/3	08:30:42	3
24890	99	87	72	cyclictest	0	-21	swapper/3	09:18:32	3
24890	99	87	72	cyclictest	0	-21	swapper/3	09:05:47	3
24890	99	87	72	cyclictest	0	-21	swapper/3	05:50:32	3
24890	99	86	82	cyclictest	0	-21	swapper/3	09:55:44	3
24890	99	86	82	cyclictest	0	-21	swapper/3	08:25:26	3
24890	99	86	82	cyclictest	0	-21	swapper/3	08:08:22	3
24890	99	86	82	cyclictest	0	-21	swapper/3	06:40:50	3
24890	99	86	82	cyclictest	0	-21	swapper/3	06:05:51	3
24890	99	83	82	cyclictest	0	-21	swapper/3	10:40:34	3
24890	99	83	82	cyclictest	0	-21	swapper/3	10:35:35	3
24890	99	83	82	cyclictest	0	-21	swapper/3	10:20:42	3
24890	99	83	82	cyclictest	0	-21	swapper/3	10:00:44	3
24890	99	83	82	cyclictest	0	-21	swapper/3	09:30:42	3
24890	99	83	82	cyclictest	0	-21	swapper/3	09:10:45	3
24890	99	83	82	cyclictest	0	-21	swapper/3	08:38:26	3
24890	99	83	82	cyclictest	0	-21	swapper/3	07:25:28	3
24890	99	83	82	cyclictest	0	-21	swapper/3	07:18:14	3
24890	99	83	82	cyclictest	0	-21	swapper/3	07:10:51	3
24890	99	83	82	cyclictest	0	-21	swapper/3	06:53:10	3
24890	99	83	82	cyclictest	0	-21	swapper/3	06:30:53	3
24890	99	83	82	cyclictest	0	-21	swapper/3	05:45:32	3
24890	99	83	82	cyclictest	0	-21	swapper/3	05:27:59	3
24890	99	83	82	cyclictest	0	-21	swapper/3	05:22:59	3
24887	99	83	82	cyclictest	0	-21	swapper/1	10:43:46	1
24887	99	83	82	cyclictest	0	-21	swapper/1	10:25:42	1
24887	99	83	82	cyclictest	0	-21	swapper/1	10:23:43	1
24887	99	83	82	cyclictest	0	-21	swapper/1	10:15:42	1
24887	99	83	82	cyclictest	0	-21	swapper/1	09:30:39	1
24887	99	83	82	cyclictest	0	-21	swapper/1	09:25:45	1
24887	99	83	82	cyclictest	0	-21	swapper/1	09:15:44	1
24887	99	83	82	cyclictest	0	-21	swapper/1	09:00:47	1
24887	99	83	82	cyclictest	0	-21	swapper/1	08:53:29	1
24887	99	83	82	cyclictest	0	-21	swapper/1	08:48:28	1
24887	99	83	82	cyclictest	0	-21	swapper/1	08:20:47	1
24887	99	83	82	cyclictest	0	-21	swapper/1	08:18:23	1
24887	99	83	82	cyclictest	0	-21	swapper/1	07:53:20	1
24887	99	83	82	cyclictest	0	-21	swapper/1	07:40:49	1
24887	99	83	82	cyclictest	0	-21	swapper/1	07:35:48	1
24887	99	83	82	cyclictest	0	-21	swapper/1	07:25:50	1
24887	99	83	82	cyclictest	0	-21	swapper/1	07:20:44	1
24887	99	83	82	cyclictest	0	-21	swapper/1	07:10:45	1
24887	99	83	82	cyclictest	0	-21	swapper/1	07:00:52	1
24887	99	83	82	cyclictest	0	-21	swapper/1	06:55:45	1
24887	99	83	82	cyclictest	0	-21	swapper/1	06:50:51	1
24887	99	83	82	cyclictest	0	-21	swapper/1	06:35:51	1
24887	99	83	82	cyclictest	0	-21	swapper/1	06:20:30	1
24887	99	83	82	cyclictest	0	-21	swapper/1	06:05:44	1
24887	99	83	82	cyclictest	0	-21	swapper/1	06:00:54	1
24887	99	83	82	cyclictest	0	-21	swapper/1	05:58:03	1
24887	99	83	82	cyclictest	0	-21	swapper/1	05:45:52	1
24887	99	83	82	cyclictest	0	-21	swapper/1	05:40:53	1
24887	99	83	82	cyclictest	0	-21	swapper/1	05:30:48	1
24887	99	83	82	cyclictest	0	-21	swapper/1	05:20:54	1
24887	99	83	82	cyclictest	0	-21	swapper/1	05:15:34	1
24887	99	83	81	cyclictest	8330	-21	tune2fs	07:05:43	1
24887	99	83	81	cyclictest	8217	-21	tune2fs	05:50:45	1
24887	99	83	81	cyclictest	4109	-21	tune2fs	08:10:42	1
24887	99	83	81	cyclictest	21379	-21	tune2fs	06:20:46	1
24887	99	83	81	cyclictest	17197	-21	tune2fs	09:55:37	1
24887	99	83	81	cyclictest	16839	-21	tune2fs	06:10:44	1
24887	99	83	81	cyclictest	16736	-21	aten2.4-expect	08:40:37	1
24890	99	82	81	cyclictest	0	-21	swapper/3	10:10:37	3
24890	99	82	81	cyclictest	0	-21	swapper/3	10:05:34	3
24890	99	82	81	cyclictest	0	-21	swapper/3	09:25:38	3
24890	99	82	81	cyclictest	0	-21	swapper/3	07:25:43	3
24887	99	82	71	cyclictest	0	-21	swapper/1	07:30:49	1
24890	99	78	62	cyclictest	0	-21	swapper/3	08:25:37	3
24890	99	76	72	cyclictest	0	-21	swapper/3	06:00:45	3
24890	99	76	62	cyclictest	0	-21	swapper/3	07:53:15	3
24890	99	73	72	cyclictest	0	-21	swapper/3	10:25:36	3
24890	99	73	72	cyclictest	0	-21	swapper/3	10:15:43	3
24890	99	73	72	cyclictest	0	-21	swapper/3	09:50:35	3
24890	99	73	72	cyclictest	0	-21	swapper/3	09:45:35	3
24890	99	73	72	cyclictest	0	-21	swapper/3	09:40:24	3
24890	99	73	72	cyclictest	0	-21	swapper/3	09:35:38	3
24890	99	73	72	cyclictest	0	-21	swapper/3	09:00:40	3
24890	99	73	72	cyclictest	0	-21	swapper/3	08:55:37	3
24890	99	73	72	cyclictest	0	-21	swapper/3	08:45:26	3
24890	99	73	72	cyclictest	0	-21	swapper/3	08:40:38	3
24890	99	73	72	cyclictest	0	-21	swapper/3	08:15:42	3
24890	99	73	72	cyclictest	0	-21	swapper/3	08:10:42	3
24890	99	73	72	cyclictest	0	-21	swapper/3	08:00:40	3
24890	99	73	72	cyclictest	0	-21	swapper/3	07:55:31	3
24890	99	73	72	cyclictest	0	-21	swapper/3	07:45:41	3
24890	99	73	72	cyclictest	0	-21	swapper/3	07:40:46	3
24890	99	73	72	cyclictest	0	-21	swapper/3	07:35:44	3
24890	99	73	72	cyclictest	0	-21	swapper/3	07:30:42	3
24890	99	73	72	cyclictest	0	-21	swapper/3	07:05:41	3
24890	99	73	72	cyclictest	0	-21	swapper/3	07:00:29	3
24890	99	73	72	cyclictest	0	-21	swapper/3	06:25:44	3
24890	99	73	72	cyclictest	0	-21	swapper/3	06:20:52	3
24890	99	73	72	cyclictest	0	-21	swapper/3	06:10:50	3
24890	99	73	72	cyclictest	0	-21	swapper/3	05:55:16	3
24890	99	73	72	cyclictest	0	-21	swapper/3	05:35:54	3
24890	99	73	72	cyclictest	0	-21	swapper/3	05:30:52	3
24890	99	73	72	cyclictest	0	-21	swapper/3	05:15:47	3
24887	99	73	72	cyclictest	0	-21	swapper/1	10:10:45	1
24887	99	73	72	cyclictest	0	-21	swapper/1	10:06:30	1
24887	99	73	72	cyclictest	0	-21	swapper/1	09:50:35	1
24887	99	73	72	cyclictest	0	-21	swapper/1	09:40:37	1
24887	99	73	72	cyclictest	0	-21	swapper/1	09:20:37	1
24887	99	73	72	cyclictest	0	-21	swapper/1	09:13:32	1
24887	99	73	72	cyclictest	0	-21	swapper/1	08:35:36	1
24887	99	73	72	cyclictest	0	-21	swapper/1	08:30:39	1
24887	99	73	72	cyclictest	0	-21	swapper/1	08:05:38	1
24887	99	73	72	cyclictest	0	-21	swapper/1	08:04:58	1
24887	99	73	72	cyclictest	0	-21	swapper/1	07:15:53	1
24887	99	73	72	cyclictest	0	-21	swapper/1	06:30:44	1
24887	99	73	72	cyclictest	0	-21	swapper/1	05:35:49	1
24887	99	73	72	cyclictest	0	-21	swapper/1	05:25:44	1
24887	99	73	71	cyclictest	29503	-21	aten2.4-expect	07:55:38	1
24887	99	73	71	cyclictest	1659	-21	aten2.4-expect	10:35:31	1
24887	99	72	71	cyclictest	0	-21	swapper/1	09:05:36	1
24887	99	72	71	cyclictest	0	-21	swapper/1	06:28:52	1
24887	99	65	64	cyclictest	0	-21	swapper/1	08:57:48	1
24887	99	65	62	cyclictest	0	-21	swapper/1	10:00:44	1
24887	99	63	62	cyclictest	0	-21	swapper/1	09:45:34	1
24887	99	63	62	cyclictest	0	-21	swapper/1	09:35:36	1
24887	99	63	62	cyclictest	0	-21	swapper/1	08:25:38	1
24887	99	63	62	cyclictest	0	-21	swapper/1	07:45:31	1
24887	99	63	62	cyclictest	0	-21	swapper/1	06:40:42	1
24889	99	61	60	cyclictest	0	-21	swapper/2	07:54:09	2
24889	99	60	59	cyclictest	0	-21	swapper/2	10:30:31	2
24889	99	59	58	cyclictest	0	-21	swapper/2	06:05:42	2
24879	99	59	52	cyclictest	0	-21	swapper/0	07:28:52	0
24879	99	57	51	cyclictest	0	-21	swapper/0	06:15:45	0
24879	99	56	41	cyclictest	0	-21	swapper/0	05:54:11	0
24889	99	55	54	cyclictest	0	-21	swapper/2	08:34:03	2
24889	99	55	54	cyclictest	0	-21	swapper/2	08:10:48	2
24889	99	55	54	cyclictest	0	-21	swapper/2	08:07:58	2
24889	99	55	54	cyclictest	0	-21	swapper/2	06:57:21	2
24889	99	55	54	cyclictest	0	-21	swapper/2	06:41:10	2
24889	99	55	51	cyclictest	0	-21	swapper/2	06:25:12	2
24879	99	55	53	cyclictest	31494	-21	taskset	09:14:04	0
24889	99	54	52	cyclictest	8094	-21	munin-node	09:35:36	2
24889	99	54	52	cyclictest	0	-21	swapper/2	05:25:44	2
24889	99	54	49	cyclictest	0	-21	swapper/2	07:28:52	2
24889	99	54	42	cyclictest	50	50	irq/44-ahci	08:19:52	2
24889	99	54	42	cyclictest	0	-21	swapper/2	07:30:48	2
24879	99	54	53	cyclictest	0	-21	swapper/0	06:56:19	0
24879	99	54	52	cyclictest	760	50	irq/18-parport0	10:30:19	0
24879	99	54	52	cyclictest	760	50	irq/18-parport0	08:07:38	0
24879	99	54	52	cyclictest	760	50	irq/18-parport0	06:51:21	0
24889	99	53	52	cyclictest	24663	-21	kworker/2:0	07:49:19	2
24889	99	53	52	cyclictest	18	1	ksoftirqd/2	09:33:15	2
24889	99	53	52	cyclictest	18	1	ksoftirqd/2	05:23:05	2
24889	99	53	52	cyclictest	0	-21	swapper/2	10:25:40	2
24889	99	53	52	cyclictest	0	-21	swapper/2	10:18:31	2
24889	99	53	52	cyclictest	0	-21	swapper/2	10:02:42	2
24889	99	53	52	cyclictest	0	-21	swapper/2	09:45:34	2
24889	99	53	52	cyclictest	0	-21	swapper/2	09:41:15	2
24889	99	53	52	cyclictest	0	-21	swapper/2	09:18:10	2
24889	99	53	52	cyclictest	0	-21	swapper/2	08:40:38	2
24889	99	53	52	cyclictest	0	-21	swapper/2	08:35:36	2
24889	99	53	52	cyclictest	0	-21	swapper/2	07:59:33	2
24889	99	53	52	cyclictest	0	-21	swapper/2	07:40:55	2
24889	99	53	52	cyclictest	0	-21	swapper/2	07:35:39	2
24889	99	53	52	cyclictest	0	-21	swapper/2	07:21:40	2
24889	99	53	52	cyclictest	0	-21	swapper/2	07:15:42	2
24889	99	53	52	cyclictest	0	-21	swapper/2	06:30:43	2
24889	99	53	52	cyclictest	0	-21	swapper/2	06:25:42	2
24889	99	53	52	cyclictest	0	-21	swapper/2	05:52:45	2
24889	99	53	52	cyclictest	0	-21	swapper/2	05:19:49	2
24889	99	53	51	cyclictest	50	50	irq/44-ahci	08:53:21	2
24889	99	53	51	cyclictest	50	50	irq/44-ahci	07:05:51	2
24889	99	53	51	cyclictest	31730	-21	telnet	08:00:37	2
24889	99	53	51	cyclictest	27277	-21	telnet	06:35:42	2
24889	99	53	51	cyclictest	1756	-21	telnet	10:35:32	2
24889	99	53	51	cyclictest	12193	-21	telnet	06:00:44	2
24889	99	53	41	cyclictest	0	-21	swapper/2	10:11:59	2
24889	99	53	41	cyclictest	0	-21	swapper/2	09:10:50	2
24889	99	53	41	cyclictest	0	-21	swapper/2	09:05:36	2
24889	99	53	41	cyclictest	0	-21	swapper/2	07:00:45	2
24889	99	53	41	cyclictest	0	-21	swapper/2	05:55:47	2
24889	99	53	41	cyclictest	0	-21	swapper/2	05:40:44	2
24879	99	53	52	cyclictest	760	50	irq/18-parport0	10:41:42	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	10:36:45	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	10:23:17	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	10:16:15	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	10:11:16	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	09:33:57	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	09:28:47	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	09:06:14	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	08:56:32	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	08:50:29	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	08:29:13	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	08:10:36	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	08:01:15	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	07:59:41	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	07:48:55	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	07:30:54	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	07:25:26	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	07:08:49	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	07:04:17	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	06:47:39	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	06:41:40	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	05:59:13	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	05:46:42	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	05:39:12	0
24879	99	53	52	cyclictest	760	50	irq/18-parport0	05:24:12	0
24879	99	53	52	cyclictest	3	1	ksoftirqd/0	06:34:20	0
24879	99	53	52	cyclictest	0	-21	swapper/0	10:00:40	0
24879	99	53	52	cyclictest	0	-21	swapper/0	09:59:06	0
24879	99	53	52	cyclictest	0	-21	swapper/0	09:44:17	0
24879	99	53	52	cyclictest	0	-21	swapper/0	09:37:13	0
24879	99	53	52	cyclictest	0	-21	swapper/0	09:02:46	0
24879	99	53	52	cyclictest	0	-21	swapper/0	08:44:15	0
24879	99	53	52	cyclictest	0	-21	swapper/0	08:30:39	0
24879	99	53	52	cyclictest	0	-21	swapper/0	08:17:50	0
24879	99	53	52	cyclictest	0	-21	swapper/0	06:38:52	0
24879	99	53	52	cyclictest	0	-21	swapper/0	06:06:55	0
24879	99	53	52	cyclictest	0	-21	swapper/0	05:40:44	0
24879	99	53	51	cyclictest	760	50	irq/18-parport0	05:19:27	0
24879	99	53	51	cyclictest	50	50	irq/44-ahci	10:06:03	0
24879	99	53	51	cyclictest	50	50	irq/44-ahci	09:46:10	0
24879	99	53	51	cyclictest	50	50	irq/44-ahci	07:35:43	0
24879	99	53	51	cyclictest	1286	50	irq/46-eth0	06:20:35	0
24879	99	53	51	cyclictest	1286	50	irq/46-eth0	05:28:45	0
24889	99	52	51	cyclictest	50	50	irq/44-ahci	06:11:17	2
24889	99	52	51	cyclictest	50	50	irq/44-ahci	05:46:21	2
24889	99	52	51	cyclictest	278	-21	usb-storage	08:55:50	2
24889	99	52	51	cyclictest	1876	-21	hald-addon-stor	08:25:34	2
24889	99	52	51	cyclictest	0	-21	swapper/2	10:41:17	2
24889	99	52	51	cyclictest	0	-21	swapper/2	10:21:21	2
24889	99	52	51	cyclictest	0	-21	swapper/2	10:07:18	2
24889	99	52	51	cyclictest	0	-21	swapper/2	09:56:58	2
24889	99	52	51	cyclictest	0	-21	swapper/2	09:51:14	2
24889	99	52	51	cyclictest	0	-21	swapper/2	09:25:41	2
24889	99	52	51	cyclictest	0	-21	swapper/2	09:21:00	2
24889	99	52	51	cyclictest	0	-21	swapper/2	09:00:28	2
24889	99	52	51	cyclictest	0	-21	swapper/2	08:47:35	2
24889	99	52	51	cyclictest	0	-21	swapper/2	08:21:12	2
24889	99	52	51	cyclictest	0	-21	swapper/2	07:10:35	2
24889	99	52	51	cyclictest	0	-21	swapper/2	06:51:27	2
24889	99	52	51	cyclictest	0	-21	swapper/2	06:45:35	2
24889	99	52	51	cyclictest	0	-21	swapper/2	06:17:00	2
24889	99	52	51	cyclictest	0	-21	swapper/2	05:36:12	2
24889	99	52	51	cyclictest	0	-21	swapper/2	05:31:02	2
24879	99	52	51	cyclictest	760	50	irq/18-parport0	09:51:08	0
24879	99	52	51	cyclictest	760	50	irq/18-parport0	09:21:18	0
24879	99	52	51	cyclictest	760	50	irq/18-parport0	08:46:43	0
24879	99	52	51	cyclictest	760	50	irq/18-parport0	08:35:57	0
24879	99	52	51	cyclictest	760	50	irq/18-parport0	08:22:10	0
24879	99	52	51	cyclictest	760	50	irq/18-parport0	07:17:34	0
24879	99	52	51	cyclictest	760	50	irq/18-parport0	07:14:56	0
24879	99	52	51	cyclictest	760	50	irq/18-parport0	06:03:03	0
24879	99	52	51	cyclictest	7189	-21	kworker/0:3	06:10:55	0
24879	99	52	51	cyclictest	0	-21	swapper/0	10:33:27	0
24879	99	52	51	cyclictest	0	-21	swapper/0	07:50:30	0
24879	99	52	51	cyclictest	0	-21	swapper/0	07:40:45	0
24879	99	52	51	cyclictest	0	-21	swapper/0	06:27:56	0
24879	99	52	51	cyclictest	0	-21	swapper/0	05:32:14	0
24879	99	50	49	cyclictest	0	-21	swapper/0	09:15:35	0
3	1	12	0	ksoftirqd/0	0	-21	swapper/0	05:11:14	0
18	1	12	0	ksoftirqd/2	0	-21	swapper/2	05:11:14	2
23	1	11	0	ksoftirqd/3	0	-21	swapper/3	05:11:14	3
12	1	11	0	ksoftirqd/1	0	-21	swapper/1	05:11:14	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17