OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sun May 10, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
27730	99	124	122	cyclictest	7362	-21	tune2fs	10:28:48	1
27730	99	104	103	cyclictest	0	-21	swapper/1	05:54:02	1
27730	99	104	102	cyclictest	7857	-21	grep	05:29:10	1
27730	99	104	102	cyclictest	4928	-21	tune2fs	07:53:55	1
27730	99	104	102	cyclictest	11441	-21	tune2fs	09:23:52	1
27732	99	103	102	cyclictest	0	-21	swapper/3	10:28:48	3
27732	99	103	102	cyclictest	0	-21	swapper/3	09:23:52	3
27732	99	103	102	cyclictest	0	-21	swapper/3	07:53:55	3
27732	99	89	83	cyclictest	0	-21	swapper/3	09:28:55	3
27732	99	89	82	cyclictest	0	-21	swapper/3	10:23:58	3
27732	99	89	72	cyclictest	0	-21	swapper/3	06:39:02	3
27732	99	88	83	cyclictest	0	-21	swapper/3	10:08:50	3
27732	99	88	82	cyclictest	0	-21	swapper/3	10:03:47	3
27732	99	88	82	cyclictest	0	-21	swapper/3	09:13:51	3
27732	99	88	82	cyclictest	0	-21	swapper/3	05:59:08	3
27732	99	87	82	cyclictest	0	-21	swapper/3	08:03:54	3
27732	99	87	82	cyclictest	0	-21	swapper/3	07:41:14	3
27732	99	87	82	cyclictest	0	-21	swapper/3	05:48:59	3
27732	99	87	82	cyclictest	0	-21	swapper/3	05:10:50	3
27732	99	86	82	cyclictest	0	-21	swapper/3	10:16:39	3
27732	99	86	81	cyclictest	0	-21	swapper/3	09:48:50	3
27732	99	86	81	cyclictest	0	-21	swapper/3	06:48:59	3
27732	99	86	71	cyclictest	0	-21	swapper/3	09:03:58	3
27732	99	86	71	cyclictest	0	-21	swapper/3	07:14:03	3
27732	99	86	71	cyclictest	0	-21	swapper/3	06:09:06	3
27732	99	86	71	cyclictest	0	-21	swapper/3	06:09:06	3
27732	99	86	71	cyclictest	0	-21	swapper/3	05:34:06	3
27732	99	85	81	cyclictest	0	-21	swapper/3	05:54:02	3
27732	99	84	72	cyclictest	0	-21	swapper/3	09:43:50	3
27732	99	84	72	cyclictest	0	-21	swapper/3	08:43:51	3
27730	99	84	83	cyclictest	0	-21	swapper/1	05:04:04	1
27730	99	84	82	cyclictest	9485	-21	tune2fs	09:18:52	1
27730	99	84	82	cyclictest	26239	-21	tune2fs	06:13:59	1
27732	99	83	82	cyclictest	0	-21	swapper/3	10:18:56	3
27732	99	83	82	cyclictest	0	-21	swapper/3	09:58:50	3
27732	99	83	82	cyclictest	0	-21	swapper/3	09:38:51	3
27732	99	83	82	cyclictest	0	-21	swapper/3	09:18:52	3
27732	99	83	82	cyclictest	0	-21	swapper/3	09:08:58	3
27732	99	83	82	cyclictest	0	-21	swapper/3	08:58:52	3
27732	99	83	82	cyclictest	0	-21	swapper/3	08:53:51	3
27732	99	83	82	cyclictest	0	-21	swapper/3	08:28:54	3
27732	99	83	82	cyclictest	0	-21	swapper/3	08:23:54	3
27732	99	83	82	cyclictest	0	-21	swapper/3	08:19:01	3
27732	99	83	82	cyclictest	0	-21	swapper/3	08:08:53	3
27732	99	83	82	cyclictest	0	-21	swapper/3	07:59:02	3
27732	99	83	82	cyclictest	0	-21	swapper/3	07:48:59	3
27732	99	83	82	cyclictest	0	-21	swapper/3	07:33:55	3
27732	99	83	82	cyclictest	0	-21	swapper/3	07:24:01	3
27732	99	83	82	cyclictest	0	-21	swapper/3	07:18:59	3
27732	99	83	82	cyclictest	0	-21	swapper/3	07:08:54	3
27732	99	83	82	cyclictest	0	-21	swapper/3	07:03:54	3
27732	99	83	82	cyclictest	0	-21	swapper/3	06:58:58	3
27732	99	83	82	cyclictest	0	-21	swapper/3	06:53:59	3
27732	99	83	82	cyclictest	0	-21	swapper/3	06:43:59	3
27732	99	83	82	cyclictest	0	-21	swapper/3	06:29:06	3
27732	99	83	82	cyclictest	0	-21	swapper/3	06:13:56	3
27732	99	83	82	cyclictest	0	-21	swapper/3	05:39:06	3
27732	99	83	82	cyclictest	0	-21	swapper/3	05:29:08	3
27732	99	83	82	cyclictest	0	-21	swapper/3	05:19:07	3
27732	99	83	71	cyclictest	0	-21	swapper/3	06:18:59	3
27730	99	83	82	cyclictest	0	-21	swapper/1	10:23:58	1
27730	99	83	82	cyclictest	0	-21	swapper/1	10:13:48	1
27730	99	83	82	cyclictest	0	-21	swapper/1	09:58:52	1
27730	99	83	82	cyclictest	0	-21	swapper/1	09:53:46	1
27730	99	83	82	cyclictest	0	-21	swapper/1	09:43:51	1
27730	99	83	82	cyclictest	0	-21	swapper/1	09:38:55	1
27730	99	83	82	cyclictest	0	-21	swapper/1	09:08:58	1
27730	99	83	82	cyclictest	0	-21	swapper/1	09:03:49	1
27730	99	83	82	cyclictest	0	-21	swapper/1	08:53:55	1
27730	99	83	82	cyclictest	0	-21	swapper/1	08:43:58	1
27730	99	83	82	cyclictest	0	-21	swapper/1	08:08:53	1
27730	99	83	82	cyclictest	0	-21	swapper/1	07:58:58	1
27730	99	83	82	cyclictest	0	-21	swapper/1	07:48:56	1
27730	99	83	82	cyclictest	0	-21	swapper/1	07:38:57	1
27730	99	83	82	cyclictest	0	-21	swapper/1	07:33:55	1
27730	99	83	82	cyclictest	0	-21	swapper/1	07:23:59	1
27730	99	83	82	cyclictest	0	-21	swapper/1	07:08:54	1
27730	99	83	82	cyclictest	0	-21	swapper/1	06:59:01	1
27730	99	83	82	cyclictest	0	-21	swapper/1	06:39:00	1
27730	99	83	82	cyclictest	0	-21	swapper/1	06:09:03	1
27730	99	83	82	cyclictest	0	-21	swapper/1	06:09:03	1
27730	99	83	82	cyclictest	0	-21	swapper/1	05:59:30	1
27730	99	83	82	cyclictest	0	-21	swapper/1	05:48:45	1
27730	99	83	82	cyclictest	0	-21	swapper/1	05:19:04	1
27730	99	83	81	cyclictest	9120	-21	tune2fs	08:03:54	1
27730	99	83	81	cyclictest	8913	-21	tune2fs	05:33:59	1
27730	99	83	81	cyclictest	7279	-21	tune2fs	09:13:50	1
27730	99	83	81	cyclictest	6771	-21	tune2fs	06:43:56	1
27730	99	83	81	cyclictest	30642	-21	tune2fs	05:09:01	1
27730	99	83	81	cyclictest	30476	-21	aten2.4-expect	10:08:47	1
27730	99	83	81	cyclictest	28618	-21	tune2fs	10:03:47	1
27730	99	83	81	cyclictest	2389	-21	tune2fs	06:33:57	1
27730	99	83	81	cyclictest	22100	-21	tune2fs	09:48:50	1
27730	99	83	81	cyclictest	22012	-21	tune2fs	07:18:55	1
27730	99	83	81	cyclictest	19838	-21	tune2fs	08:28:54	1
27730	99	83	81	cyclictest	15722	-21	tune2fs	08:18:55	1
27730	99	83	81	cyclictest	13180	-21	tune2fs	05:44:02	1
27730	99	83	81	cyclictest	11217	-21	tune2fs	06:53:58	1
27730	99	83	81	cyclictest	11085	-21	tune2fs	05:38:59	1
27730	99	83	71	cyclictest	0	-21	swapper/1	09:28:52	1
27732	99	82	81	cyclictest	0	-21	swapper/3	09:33:51	3
27732	99	82	81	cyclictest	0	-21	swapper/3	06:33:57	3
27732	99	82	81	cyclictest	0	-21	swapper/3	05:44:02	3
27732	99	82	81	cyclictest	0	-21	swapper/3	05:23:57	3
27732	99	82	81	cyclictest	0	-21	swapper/3	05:04:01	3
27732	99	82	71	cyclictest	0	-21	swapper/3	09:53:51	3
27730	99	82	81	cyclictest	9140	-21	tune2fs	06:48:59	1
27730	99	82	81	cyclictest	4121	-21	aten2.4-expect	05:23:57	1
27730	99	82	81	cyclictest	15763	-21	tune2fs	09:33:51	1
27730	99	82	81	cyclictest	15666	-21	tune2fs	07:03:55	1
27732	99	77	72	cyclictest	0	-21	swapper/3	08:48:51	3
27730	99	74	72	cyclictest	19746	-21	tune2fs	07:13:56	1
27732	99	73	72	cyclictest	0	-21	swapper/3	08:41:24	3
27732	99	73	72	cyclictest	0	-21	swapper/3	08:34:02	3
27732	99	73	72	cyclictest	0	-21	swapper/3	08:13:59	3
27732	99	73	72	cyclictest	0	-21	swapper/3	07:47:44	3
27732	99	73	72	cyclictest	0	-21	swapper/3	06:24:04	3
27732	99	73	72	cyclictest	0	-21	swapper/3	06:03:57	3
27732	99	73	72	cyclictest	0	-21	swapper/3	05:14:15	3
27730	99	73	72	cyclictest	0	-21	swapper/1	06:29:02	1
27732	99	72	71	cyclictest	0	-21	swapper/3	07:29:01	3
27730	99	72	71	cyclictest	0	-21	swapper/1	08:23:58	1
27730	99	72	71	cyclictest	0	-21	swapper/1	07:33:05	1
27730	99	66	65	cyclictest	0	-21	swapper/1	05:13:57	1
27730	99	64	62	cyclictest	0	-21	swapper/1	08:51:25	1
27730	99	63	62	cyclictest	0	-21	swapper/1	10:18:40	1
27730	99	63	62	cyclictest	0	-21	swapper/1	08:38:51	1
27730	99	63	62	cyclictest	0	-21	swapper/1	08:33:51	1
27730	99	63	62	cyclictest	0	-21	swapper/1	08:13:53	1
27730	99	63	62	cyclictest	0	-21	swapper/1	07:43:51	1
27730	99	63	62	cyclictest	0	-21	swapper/1	06:18:59	1
27730	99	63	62	cyclictest	0	-21	swapper/1	06:03:58	1
27730	99	63	61	cyclictest	32451	-21	aten2.4-expect	08:58:49	1
27730	99	63	61	cyclictest	30109	-21	aten2.4-expect	06:23:55	1
27729	99	62	61	cyclictest	0	-21	swapper/0	06:38:54	0
27729	99	62	61	cyclictest	0	-21	swapper/0	05:03:59	0
27731	99	61	60	cyclictest	0	-21	swapper/2	07:28:53	2
27729	99	61	60	cyclictest	0	-21	swapper/0	08:58:49	0
27729	99	60	59	cyclictest	0	-21	swapper/0	08:13:51	0
27729	99	60	59	cyclictest	0	-21	swapper/0	07:13:54	0
27729	99	60	59	cyclictest	0	-21	swapper/0	06:58:55	0
27729	99	58	57	cyclictest	0	-21	swapper/0	08:28:51	0
27729	99	58	57	cyclictest	0	-21	swapper/0	07:38:52	0
27729	99	58	41	cyclictest	0	-21	swapper/0	08:47:00	0
27729	99	58	41	cyclictest	0	-21	swapper/0	05:31:03	0
27731	99	57	55	cyclictest	25952	-21	telnet	08:43:49	2
27731	99	56	55	cyclictest	0	-21	swapper/2	09:02:50	2
27729	99	55	54	cyclictest	0	-21	swapper/0	10:08:47	0
27731	99	54	53	cyclictest	0	-21	swapper/2	06:43:54	2
27731	99	54	53	cyclictest	0	-21	swapper/2	06:38:54	2
27731	99	53	52	cyclictest	278	-21	usb-storage	05:24:14	2
27731	99	53	52	cyclictest	0	-21	swapper/2	08:19:07	2
27731	99	53	52	cyclictest	0	-21	swapper/2	07:18:53	2
27731	99	53	52	cyclictest	0	-21	swapper/2	07:06:14	2
27731	99	53	52	cyclictest	0	-21	swapper/2	05:44:00	2
27731	99	53	51	cyclictest	6756	-21	telnet	10:28:45	2
27731	99	53	51	cyclictest	50	50	irq/44-ahci	08:12:35	2
27731	99	53	51	cyclictest	30479	-21	telnet	10:08:47	2
27731	99	53	51	cyclictest	28035	-21	telnet	07:33:53	2
27731	99	53	51	cyclictest	278	-21	usb-storage	08:36:34	2
27731	99	53	51	cyclictest	23965	-21	telnet	09:53:45	2
27731	99	53	51	cyclictest	1995	-21	telnet	06:33:55	2
27731	99	53	51	cyclictest	19673	-21	telnet	09:43:48	2
27731	99	53	51	cyclictest	19482	-21	telnet	07:13:55	2
27731	99	53	51	cyclictest	13107	-21	telnet	09:28:48	2
27731	99	53	51	cyclictest	0	-21	swapper/2	08:31:27	2
27731	99	53	41	cyclictest	0	-21	swapper/2	07:38:52	2
27731	99	53	41	cyclictest	0	-21	swapper/2	05:18:34	2
27729	99	53	52	cyclictest	760	50	irq/18-parport0	10:04:17	0
27729	99	53	52	cyclictest	760	50	irq/18-parport0	09:14:29	0
27729	99	53	52	cyclictest	760	50	irq/18-parport0	08:53:18	0
27729	99	53	52	cyclictest	760	50	irq/18-parport0	08:40:38	0
27729	99	53	52	cyclictest	760	50	irq/18-parport0	07:32:57	0
27729	99	53	52	cyclictest	760	50	irq/18-parport0	06:22:12	0
27729	99	53	52	cyclictest	0	-21	swapper/0	10:28:46	0
27729	99	53	52	cyclictest	0	-21	swapper/0	10:03:27	0
27729	99	53	52	cyclictest	0	-21	swapper/0	09:53:45	0
27729	99	53	52	cyclictest	0	-21	swapper/0	09:38:49	0
27729	99	53	52	cyclictest	0	-21	swapper/0	09:28:49	0
27729	99	53	52	cyclictest	0	-21	swapper/0	08:35:10	0
27729	99	53	52	cyclictest	0	-21	swapper/0	07:51:50	0
27729	99	53	52	cyclictest	0	-21	swapper/0	07:35:01	0
27729	99	53	52	cyclictest	0	-21	swapper/0	07:24:15	0
27729	99	53	52	cyclictest	0	-21	swapper/0	07:19:45	0
27729	99	53	52	cyclictest	0	-21	swapper/0	07:08:54	0
27729	99	53	52	cyclictest	0	-21	swapper/0	07:03:53	0
27729	99	53	52	cyclictest	0	-21	swapper/0	06:53:56	0
27729	99	53	52	cyclictest	0	-21	swapper/0	05:23:57	0
27729	99	53	41	cyclictest	0	-21	swapper/0	09:23:49	0
27731	99	52	51	cyclictest	50	50	irq/44-ahci	10:16:09	2
27731	99	52	51	cyclictest	31674	-21	timerandwakeup	08:54:00	2
27731	99	52	51	cyclictest	2385	-21	telnet	10:18:46	2
27731	99	52	51	cyclictest	21776	-21	telnet	09:48:47	2
27731	99	52	51	cyclictest	17095	-21	telnet	05:53:56	2
27731	99	52	51	cyclictest	0	-21	swapper/2	10:24:22	2
27731	99	52	51	cyclictest	0	-21	swapper/2	10:03:44	2
27731	99	52	51	cyclictest	0	-21	swapper/2	09:58:47	2
27731	99	52	51	cyclictest	0	-21	swapper/2	09:38:49	2
27731	99	52	51	cyclictest	0	-21	swapper/2	09:33:48	2
27731	99	52	51	cyclictest	0	-21	swapper/2	09:23:49	2
27731	99	52	51	cyclictest	0	-21	swapper/2	09:18:50	2
27731	99	52	51	cyclictest	0	-21	swapper/2	09:08:49	2
27731	99	52	51	cyclictest	0	-21	swapper/2	09:03:49	2
27731	99	52	51	cyclictest	0	-21	swapper/2	08:48:53	2
27731	99	52	51	cyclictest	0	-21	swapper/2	08:23:41	2
27731	99	52	51	cyclictest	0	-21	swapper/2	08:13:50	2
27731	99	52	51	cyclictest	0	-21	swapper/2	08:04:56	2
27731	99	52	51	cyclictest	0	-21	swapper/2	07:59:34	2
27731	99	52	51	cyclictest	0	-21	swapper/2	07:53:52	2
27731	99	52	51	cyclictest	0	-21	swapper/2	07:51:04	2
27731	99	52	51	cyclictest	0	-21	swapper/2	07:23:53	2
27731	99	52	51	cyclictest	0	-21	swapper/2	07:08:54	2
27731	99	52	51	cyclictest	0	-21	swapper/2	06:58:55	2
27731	99	52	51	cyclictest	0	-21	swapper/2	06:28:56	2
27731	99	52	51	cyclictest	0	-21	swapper/2	06:23:55	2
27731	99	52	51	cyclictest	0	-21	swapper/2	06:18:56	2
27731	99	52	51	cyclictest	0	-21	swapper/2	06:17:50	2
27731	99	52	51	cyclictest	0	-21	swapper/2	06:08:57	2
27731	99	52	51	cyclictest	0	-21	swapper/2	06:08:57	2
27731	99	52	51	cyclictest	0	-21	swapper/2	05:58:56	2
27731	99	52	51	cyclictest	0	-21	swapper/2	05:38:57	2
27731	99	52	51	cyclictest	0	-21	swapper/2	05:33:56	2
27731	99	52	51	cyclictest	0	-21	swapper/2	05:28:59	2
27731	99	52	51	cyclictest	0	-21	swapper/2	05:18:58	2
27731	99	52	51	cyclictest	0	-21	swapper/2	05:08:58	2
27731	99	52	51	cyclictest	0	-21	swapper/2	05:03:58	2
27729	99	52	51	cyclictest	760	50	irq/18-parport0	10:16:11	0
27729	99	52	51	cyclictest	760	50	irq/18-parport0	08:57:24	0
27729	99	52	51	cyclictest	760	50	irq/18-parport0	08:04:04	0
27729	99	52	51	cyclictest	760	50	irq/18-parport0	07:45:16	0
27729	99	52	51	cyclictest	760	50	irq/18-parport0	06:28:09	0
27729	99	52	51	cyclictest	760	50	irq/18-parport0	06:16:44	0
27729	99	52	51	cyclictest	760	50	irq/18-parport0	05:49:13	0
27729	99	52	51	cyclictest	50	50	irq/44-ahci	05:54:03	0
27729	99	52	51	cyclictest	278	-21	usb-storage	08:09:55	0
27729	99	52	51	cyclictest	0	-21	swapper/0	10:18:47	0
27729	99	52	51	cyclictest	0	-21	swapper/0	09:48:47	0
27729	99	52	51	cyclictest	0	-21	swapper/0	09:43:48	0
27729	99	52	51	cyclictest	0	-21	swapper/0	09:33:48	0
27729	99	52	51	cyclictest	0	-21	swapper/0	09:11:31	0
27729	99	52	51	cyclictest	0	-21	swapper/0	09:04:10	0
27729	99	52	51	cyclictest	0	-21	swapper/0	08:23:51	0
27729	99	52	51	cyclictest	0	-21	swapper/0	08:20:41	0
27729	99	52	51	cyclictest	0	-21	swapper/0	07:59:34	0
27729	99	52	51	cyclictest	0	-21	swapper/0	07:57:58	0
27729	99	52	51	cyclictest	0	-21	swapper/0	06:49:19	0
27729	99	52	51	cyclictest	0	-21	swapper/0	06:43:53	0
27729	99	52	51	cyclictest	0	-21	swapper/0	06:33:55	0
27729	99	52	51	cyclictest	0	-21	swapper/0	06:30:51	0
27729	99	52	51	cyclictest	0	-21	swapper/0	06:12:28	0
27729	99	52	51	cyclictest	0	-21	swapper/0	06:12:28	0
27729	99	52	51	cyclictest	0	-21	swapper/0	06:05:42	0
27729	99	52	51	cyclictest	0	-21	swapper/0	05:46:35	0
27729	99	52	51	cyclictest	0	-21	swapper/0	05:38:57	0
27729	99	52	51	cyclictest	0	-21	swapper/0	05:20:40	0
27729	99	52	51	cyclictest	0	-21	swapper/0	05:15:40	0
27729	99	52	51	cyclictest	0	-21	swapper/0	05:08:58	0
27729	99	52	41	cyclictest	0	-21	swapper/0	05:33:56	0
27731	99	48	47	cyclictest	23820	-21	munin-node	08:38:50	2
27731	99	48	47	cyclictest	0	-21	swapper/2	06:08:45	2
27729	99	48	41	cyclictest	0	-21	swapper/0	09:23:31	0
27729	99	48	41	cyclictest	0	-21	swapper/0	06:01:32	0
27731	99	45	43	cyclictest	278	-21	usb-storage	06:54:04	2
27731	99	44	42	cyclictest	278	-21	usb-storage	05:49:13	2
27731	99	44	41	cyclictest	0	-21	swapper/2	07:48:02	2
27731	99	43	41	cyclictest	8534	-21	ksmtuned	06:48:54	2
27731	99	43	41	cyclictest	0	-21	swapper/2	09:13:48	2
27729	99	43	41	cyclictest	0	-21	swapper/0	10:24:14	0
10	99	12	0	migration/1	25681	-21	aten2.4_r3power	04:58:59	1
50	50	11	0	irq/44-ahci	26555	-21	kernelversion	04:59:04	0
18	1	11	0	ksoftirqd/2	0	-21	swapper/2	04:58:58	2
23	1	10	0	ksoftirqd/3	0	-21	swapper/3	04:59:33	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17