OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sun Sep 06, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
21549	99	128	122	cyclictest	30984	-21	tune2fs	06:06:08	1
21549	99	127	123	cyclictest	0	-21	swapper/1	03:21:23	1
21549	99	108	102	cyclictest	11612	-21	tune2fs	04:06:13	1
21549	99	107	92	cyclictest	0	-21	swapper/1	08:01:04	1
21566	99	104	102	cyclictest	23338	-21	ls	05:46:17	3
21566	99	103	102	cyclictest	0	-21	swapper/3	07:56:04	3
21566	99	103	102	cyclictest	0	-21	swapper/3	07:01:03	3
21566	99	103	102	cyclictest	0	-21	swapper/3	04:21:12	3
21566	99	103	102	cyclictest	0	-21	swapper/3	03:36:11	3
21549	99	103	102	cyclictest	0	-21	swapper/1	04:55:57	1
21549	99	94	92	cyclictest	20027	-21	aten2.4-expect	08:11:00	1
21549	99	93	92	cyclictest	0	-21	swapper/1	08:33:48	1
21549	99	93	92	cyclictest	0	-21	swapper/1	07:35:50	1
21549	99	93	92	cyclictest	0	-21	swapper/1	05:05:56	1
21549	99	89	72	cyclictest	0	-21	swapper/1	08:16:02	1
21549	99	89	72	cyclictest	0	-21	swapper/1	05:26:10	1
21549	99	88	72	cyclictest	0	-21	swapper/1	07:45:50	1
21549	99	87	82	cyclictest	0	-21	swapper/1	06:01:08	1
21549	99	87	82	cyclictest	0	-21	swapper/1	05:36:18	1
21549	99	87	72	cyclictest	0	-21	swapper/1	08:23:46	1
21549	99	87	72	cyclictest	0	-21	swapper/1	07:18:36	1
21549	99	86	82	cyclictest	0	-21	swapper/1	08:36:09	1
21549	99	86	82	cyclictest	0	-21	swapper/1	07:46:12	1
21549	99	86	82	cyclictest	0	-21	swapper/1	07:28:38	1
21549	99	86	82	cyclictest	0	-21	swapper/1	07:11:12	1
21549	99	86	82	cyclictest	0	-21	swapper/1	06:51:12	1
21549	99	86	82	cyclictest	0	-21	swapper/1	06:48:31	1
21549	99	86	82	cyclictest	0	-21	swapper/1	05:51:14	1
21549	99	86	82	cyclictest	0	-21	swapper/1	05:51:14	1
21549	99	86	82	cyclictest	0	-21	swapper/1	05:06:16	1
21549	99	86	82	cyclictest	0	-21	swapper/1	04:46:18	1
21549	99	84	72	cyclictest	0	-21	swapper/1	04:30:57	1
21566	99	83	82	cyclictest	0	-21	swapper/3	08:31:10	3
21566	99	83	82	cyclictest	0	-21	swapper/3	08:21:09	3
21566	99	83	82	cyclictest	0	-21	swapper/3	08:16:09	3
21566	99	83	82	cyclictest	0	-21	swapper/3	08:15:49	3
21566	99	83	82	cyclictest	0	-21	swapper/3	08:01:04	3
21566	99	83	82	cyclictest	0	-21	swapper/3	07:46:06	3
21566	99	83	82	cyclictest	0	-21	swapper/3	07:41:02	3
21566	99	83	82	cyclictest	0	-21	swapper/3	07:38:39	3
21566	99	83	82	cyclictest	0	-21	swapper/3	07:35:50	3
21566	99	83	82	cyclictest	0	-21	swapper/3	07:21:02	3
21566	99	83	82	cyclictest	0	-21	swapper/3	07:16:05	3
21566	99	83	82	cyclictest	0	-21	swapper/3	06:56:05	3
21566	99	83	82	cyclictest	0	-21	swapper/3	06:40:52	3
21566	99	83	82	cyclictest	0	-21	swapper/3	06:36:13	3
21566	99	83	82	cyclictest	0	-21	swapper/3	06:26:13	3
21566	99	83	82	cyclictest	0	-21	swapper/3	06:16:15	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:56:15	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:51:14	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:51:14	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:45:54	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:26:07	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:20:56	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:16:19	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:15:56	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:08:15	3
21566	99	83	82	cyclictest	0	-21	swapper/3	05:01:16	3
21566	99	83	82	cyclictest	0	-21	swapper/3	04:58:13	3
21566	99	83	82	cyclictest	0	-21	swapper/3	04:53:13	3
21566	99	83	82	cyclictest	0	-21	swapper/3	04:41:17	3
21566	99	83	82	cyclictest	0	-21	swapper/3	04:36:17	3
21566	99	83	82	cyclictest	0	-21	swapper/3	04:26:17	3
21566	99	83	82	cyclictest	0	-21	swapper/3	03:51:19	3
21566	99	83	82	cyclictest	0	-21	swapper/3	03:43:02	3
21566	99	83	82	cyclictest	0	-21	swapper/3	03:31:17	3
21566	99	83	82	cyclictest	0	-21	swapper/3	03:26:15	3
21566	99	83	82	cyclictest	0	-21	swapper/3	03:21:23	3
21566	99	83	82	cyclictest	0	-21	swapper/3	03:16:17	3
21549	99	83	82	cyclictest	0	-21	swapper/1	08:41:11	1
21549	99	83	82	cyclictest	0	-21	swapper/1	08:41:11	1
21549	99	83	82	cyclictest	0	-21	swapper/1	08:26:09	1
21549	99	83	82	cyclictest	0	-21	swapper/1	08:06:11	1
21549	99	83	82	cyclictest	0	-21	swapper/1	07:56:03	1
21549	99	83	82	cyclictest	0	-21	swapper/1	07:51:05	1
21549	99	83	82	cyclictest	0	-21	swapper/1	07:36:10	1
21549	99	83	82	cyclictest	0	-21	swapper/1	07:23:37	1
21549	99	83	82	cyclictest	0	-21	swapper/1	07:08:34	1
21549	99	83	82	cyclictest	0	-21	swapper/1	07:08:34	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:56:03	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:41:11	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:36:13	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:31:04	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:26:09	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:21:15	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:16:16	1
21549	99	83	82	cyclictest	0	-21	swapper/1	06:11:14	1
21549	99	83	82	cyclictest	0	-21	swapper/1	05:56:12	1
21549	99	83	82	cyclictest	0	-21	swapper/1	05:41:16	1
21549	99	83	82	cyclictest	0	-21	swapper/1	05:31:14	1
21549	99	83	82	cyclictest	0	-21	swapper/1	05:21:10	1
21549	99	83	82	cyclictest	0	-21	swapper/1	05:16:14	1
21549	99	83	82	cyclictest	0	-21	swapper/1	04:41:11	1
21549	99	83	82	cyclictest	0	-21	swapper/1	04:31:18	1
21549	99	83	82	cyclictest	0	-21	swapper/1	04:21:11	1
21549	99	83	82	cyclictest	0	-21	swapper/1	04:16:15	1
21549	99	83	82	cyclictest	0	-21	swapper/1	04:11:14	1
21549	99	83	82	cyclictest	0	-21	swapper/1	04:01:19	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:56:10	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:51:10	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:46:21	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:41:16	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:36:16	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:31:17	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:26:15	1
21549	99	83	82	cyclictest	0	-21	swapper/1	03:16:15	1
21549	99	83	81	cyclictest	22294	-21	tune2fs	05:46:08	1
21549	99	83	81	cyclictest	22098	-21	aten2.4-expect	07:01:03	1
21549	99	83	71	cyclictest	0	-21	swapper/1	05:11:11	1
21566	99	82	81	cyclictest	0	-21	swapper/3	06:06:09	3
21566	99	82	81	cyclictest	0	-21	swapper/3	05:31:07	3
21566	99	82	71	cyclictest	0	-21	swapper/3	08:06:11	3
21549	99	78	72	cyclictest	0	-21	swapper/1	04:36:11	1
21549	99	74	72	cyclictest	0	-21	swapper/1	04:56:10	1
21566	99	73	72	cyclictest	0	-21	swapper/3	08:26:00	3
21566	99	73	72	cyclictest	0	-21	swapper/3	07:06:04	3
21566	99	73	72	cyclictest	0	-21	swapper/3	07:06:04	3
21566	99	73	72	cyclictest	0	-21	swapper/3	06:01:15	3
21566	99	73	72	cyclictest	0	-21	swapper/3	04:06:13	3
21566	99	73	72	cyclictest	0	-21	swapper/3	03:48:15	3
21566	99	72	71	cyclictest	0	-21	swapper/3	08:41:23	3
21566	99	72	71	cyclictest	0	-21	swapper/3	08:41:23	3
21566	99	72	71	cyclictest	0	-21	swapper/3	07:11:03	3
21566	99	72	71	cyclictest	0	-21	swapper/3	06:46:08	3
21566	99	72	71	cyclictest	0	-21	swapper/3	06:31:04	3
21566	99	72	71	cyclictest	0	-21	swapper/3	04:11:18	3
21566	99	71	70	cyclictest	0	-21	swapper/3	07:28:44	3
21566	99	69	68	cyclictest	0	-21	swapper/3	04:46:09	3
21566	99	68	67	cyclictest	0	-21	swapper/3	07:52:03	3
21549	99	68	67	cyclictest	0	-21	swapper/1	03:16:00	1
21566	99	67	66	cyclictest	0	-21	swapper/3	05:39:48	3
21566	99	67	66	cyclictest	0	-21	swapper/3	04:31:09	3
21539	99	67	66	cyclictest	0	-21	swapper/0	08:43:15	0
21539	99	67	66	cyclictest	0	-21	swapper/0	08:43:15	0
21539	99	67	66	cyclictest	0	-21	swapper/0	05:51:23	0
21539	99	67	66	cyclictest	0	-21	swapper/0	05:51:23	0
21539	99	67	66	cyclictest	0	-21	swapper/0	04:20:09	0
21566	99	66	65	cyclictest	0	-21	swapper/3	06:23:19	3
21566	99	66	65	cyclictest	0	-21	swapper/3	04:05:26	3
21566	99	63	62	cyclictest	0	-21	swapper/3	08:35:59	3
21566	99	63	62	cyclictest	0	-21	swapper/3	06:51:03	3
21566	99	63	62	cyclictest	0	-21	swapper/3	06:10:54	3
21566	99	63	62	cyclictest	0	-21	swapper/3	04:16:09	3
21566	99	63	62	cyclictest	0	-21	swapper/3	03:56:10	3
21539	99	62	61	cyclictest	0	-21	swapper/0	03:37:43	0
21539	99	60	51	cyclictest	0	-21	swapper/0	05:36:36	0
21539	99	59	41	cyclictest	1286	50	irq/46-eth0	07:52:21	0
21539	99	59	41	cyclictest	0	-21	swapper/0	05:43:00	0
21558	99	58	51	cyclictest	0	-21	swapper/2	08:07:05	2
21539	99	58	57	cyclictest	760	50	irq/18-parport0	04:53:20	0
21539	99	58	41	cyclictest	0	-21	swapper/0	08:31:46	0
21539	99	58	41	cyclictest	0	-21	swapper/0	08:07:17	0
21539	99	58	41	cyclictest	0	-21	swapper/0	07:10:45	0
21539	99	58	41	cyclictest	0	-21	swapper/0	07:10:45	0
21539	99	58	41	cyclictest	0	-21	swapper/0	05:07:46	0
21539	99	58	41	cyclictest	0	-21	swapper/0	04:24:53	0
21539	99	57	50	cyclictest	0	-21	swapper/0	03:18:50	0
21558	99	56	41	cyclictest	23711	-21	uptime	08:16:12	2
21558	99	55	53	cyclictest	32535	-21	telnet	03:41:11	2
21558	99	55	51	cyclictest	0	-21	swapper/2	03:23:09	2
21539	99	55	54	cyclictest	0	-21	swapper/0	03:26:38	0
21539	99	55	52	cyclictest	760	50	irq/18-parport0	08:24:42	0
21539	99	55	41	cyclictest	0	-21	swapper/0	08:18:58	0
21539	99	55	21	cyclictest	0	-21	swapper/0	06:29:52	0
21539	99	55	21	cyclictest	0	-21	swapper/0	04:36:55	0
21558	99	54	53	cyclictest	18	1	ksoftirqd/2	07:10:45	2
21558	99	54	53	cyclictest	18	1	ksoftirqd/2	07:10:45	2
21558	99	54	53	cyclictest	0	-21	swapper/2	06:32:36	2
21558	99	54	52	cyclictest	18	1	ksoftirqd/2	04:14:06	2
21558	99	54	52	cyclictest	0	-21	swapper/2	05:41:06	2
21558	99	54	51	cyclictest	0	-21	swapper/2	08:33:14	2
21558	99	54	51	cyclictest	0	-21	swapper/2	06:40:02	2
21558	99	54	51	cyclictest	0	-21	swapper/2	05:38:44	2
21558	99	54	41	cyclictest	50	50	irq/44-ahci	07:00:57	2
21539	99	54	53	cyclictest	0	-21	swapper/0	07:56:37	0
21539	99	54	53	cyclictest	0	-21	swapper/0	03:49:50	0
21539	99	54	51	cyclictest	0	-21	swapper/0	07:30:56	0
21539	99	54	50	cyclictest	0	-21	swapper/0	08:38:40	0
21539	99	54	50	cyclictest	0	-21	swapper/0	06:25:05	0
21558	99	53	52	cyclictest	50	50	irq/44-ahci	05:11:00	2
21558	99	53	52	cyclictest	3954	-21	kworker/2:0	04:40:39	2
21558	99	53	52	cyclictest	278	-21	usb-storage	07:56:15	2
21558	99	53	52	cyclictest	278	-21	usb-storage	07:42:06	2
21558	99	53	52	cyclictest	278	-21	usb-storage	03:51:06	2
21558	99	53	52	cyclictest	25852	-21	kworker/2:1	06:47:38	2
21558	99	53	52	cyclictest	18	1	ksoftirqd/2	07:45:52	2
21558	99	53	52	cyclictest	17420	-21	kworker/2:0	08:00:59	2
21558	99	53	52	cyclictest	0	-21	swapper/2	08:11:55	2
21558	99	53	52	cyclictest	0	-21	swapper/2	07:36:02	2
21558	99	53	52	cyclictest	0	-21	swapper/2	07:23:02	2
21558	99	53	52	cyclictest	0	-21	swapper/2	06:41:05	2
21558	99	53	52	cyclictest	0	-21	swapper/2	06:26:04	2
21558	99	53	52	cyclictest	0	-21	swapper/2	06:16:49	2
21558	99	53	52	cyclictest	0	-21	swapper/2	06:11:13	2
21558	99	53	52	cyclictest	0	-21	swapper/2	06:06:42	2
21558	99	53	52	cyclictest	0	-21	swapper/2	05:48:14	2
21558	99	53	52	cyclictest	0	-21	swapper/2	05:31:05	2
21558	99	53	52	cyclictest	0	-21	swapper/2	05:01:00	2
21558	99	53	52	cyclictest	0	-21	swapper/2	04:42:06	2
21558	99	53	52	cyclictest	0	-21	swapper/2	04:26:08	2
21558	99	53	52	cyclictest	0	-21	swapper/2	04:20:59	2
21558	99	53	52	cyclictest	0	-21	swapper/2	04:06:56	2
21558	99	53	52	cyclictest	0	-21	swapper/2	03:16:11	2
21558	99	53	51	cyclictest	50	50	irq/44-ahci	06:56:20	2
21558	99	53	51	cyclictest	50	50	irq/44-ahci	05:08:09	2
21558	99	53	51	cyclictest	50	50	irq/44-ahci	04:46:22	2
21558	99	53	51	cyclictest	50	50	irq/44-ahci	03:26:25	2
21558	99	53	51	cyclictest	28180	-21	telnet	03:31:11	2
21558	99	53	51	cyclictest	2737	-21	telnet	07:31:01	2
21558	99	53	51	cyclictest	24195	-21	telnet	05:51:07	2
21558	99	53	51	cyclictest	24195	-21	telnet	05:51:07	2
21558	99	53	51	cyclictest	13303	-21	telnet	05:26:07	2
21558	99	53	51	cyclictest	11398	-21	telnet	07:51:00	2
21558	99	53	41	cyclictest	31663	-21	if_eth1	08:36:04	2
21558	99	53	41	cyclictest	31212	-21	interrupts	03:36:13	2
21558	99	53	41	cyclictest	278	-21	usb-storage	07:13:09	2
21558	99	53	41	cyclictest	27471	-21	proc_pri	05:56:14	2
21558	99	53	41	cyclictest	25635	-21	munin-node	08:21:08	2
21558	99	53	41	cyclictest	2423	-21	aten2.4_r3power	03:46:12	2
21558	99	53	41	cyclictest	23001	-21	open_files	04:31:16	2
21558	99	53	41	cyclictest	16032	-21	gltestperf	04:16:12	2
21558	99	53	41	cyclictest	0	-21	swapper/2	08:41:23	2
21558	99	53	41	cyclictest	0	-21	swapper/2	08:41:23	2
21558	99	53	41	cyclictest	0	-21	swapper/2	08:26:05	2
21558	99	53	41	cyclictest	0	-21	swapper/2	07:17:17	2
21558	99	53	41	cyclictest	0	-21	swapper/2	06:52:28	2
21558	99	53	41	cyclictest	0	-21	swapper/2	06:21:16	2
21558	99	53	41	cyclictest	0	-21	swapper/2	05:21:02	2
21558	99	53	41	cyclictest	0	-21	swapper/2	05:18:14	2
21558	99	53	41	cyclictest	0	-21	swapper/2	04:56:08	2
21558	99	53	41	cyclictest	0	-21	swapper/2	04:51:06	2
21558	99	53	41	cyclictest	0	-21	swapper/2	04:03:21	2
21558	99	53	41	cyclictest	0	-21	swapper/2	03:57:27	2
21539	99	53	52	cyclictest	760	50	irq/18-parport0	07:36:50	0
21539	99	53	52	cyclictest	760	50	irq/18-parport0	07:22:38	0
21539	99	53	52	cyclictest	760	50	irq/18-parport0	06:45:24	0
21539	99	53	52	cyclictest	760	50	irq/18-parport0	06:11:33	0
21539	99	53	52	cyclictest	760	50	irq/18-parport0	05:03:00	0
21539	99	53	52	cyclictest	760	50	irq/18-parport0	04:32:03	0
21539	99	53	52	cyclictest	760	50	irq/18-parport0	04:27:31	0
21539	99	53	52	cyclictest	50	50	irq/44-ahci	04:49:20	0
21539	99	53	52	cyclictest	0	-21	swapper/0	07:30:46	0
21539	99	53	52	cyclictest	0	-21	swapper/0	06:51:34	0
21539	99	53	52	cyclictest	0	-21	swapper/0	06:36:05	0
21539	99	53	52	cyclictest	0	-21	swapper/0	06:31:04	0
21539	99	53	52	cyclictest	0	-21	swapper/0	06:06:09	0
21539	99	53	52	cyclictest	0	-21	swapper/0	05:56:06	0
21539	99	53	52	cyclictest	0	-21	swapper/0	05:46:06	0
21539	99	53	52	cyclictest	0	-21	swapper/0	05:16:09	0
21539	99	53	52	cyclictest	0	-21	swapper/0	04:57:24	0
21539	99	53	52	cyclictest	0	-21	swapper/0	04:08:51	0
21539	99	53	52	cyclictest	0	-21	swapper/0	03:56:09	0
21539	99	53	52	cyclictest	0	-21	swapper/0	03:54:46	0
21539	99	53	52	cyclictest	0	-21	swapper/0	03:31:10	0
21539	99	53	51	cyclictest	50	50	irq/44-ahci	07:01:40	0
21539	99	53	46	cyclictest	0	-21	swapper/0	06:58:55	0
21539	99	53	41	cyclictest	760	50	irq/18-parport0	07:16:49	0
21539	99	53	41	cyclictest	760	50	irq/18-parport0	05:34:42	0
21539	99	53	41	cyclictest	0	-21	swapper/0	08:30:22	0
21539	99	53	41	cyclictest	0	-21	swapper/0	08:03:19	0
21539	99	53	41	cyclictest	0	-21	swapper/0	06:49:04	0
21539	99	53	41	cyclictest	0	-21	swapper/0	05:11:22	0
21539	99	53	41	cyclictest	0	-21	swapper/0	04:41:56	0
21539	99	53	21	cyclictest	0	-21	swapper/0	03:42:55	0
21566	99	52	41	cyclictest	21637	-21	latency_hist	03:16:00	3
21558	99	52	51	cyclictest	0	-21	swapper/2	07:25:56	2
21558	99	52	50	cyclictest	28723	-21	forks	06:01:07	2
21539	99	52	51	cyclictest	760	50	irq/18-parport0	07:10:59	0
21539	99	52	51	cyclictest	0	-21	swapper/0	08:11:41	0
21539	99	52	51	cyclictest	0	-21	swapper/0	07:46:40	0
21539	99	52	51	cyclictest	0	-21	swapper/0	07:41:40	0
21539	99	52	51	cyclictest	0	-21	swapper/0	06:16:01	0
21539	99	52	51	cyclictest	0	-21	swapper/0	06:00:59	0
21539	99	52	51	cyclictest	0	-21	swapper/0	05:27:13	0
21539	99	52	51	cyclictest	0	-21	swapper/0	05:21:07	0
21539	99	52	51	cyclictest	0	-21	swapper/0	04:11:04	0
21539	99	52	51	cyclictest	0	-21	swapper/0	04:01:10	0
21539	99	52	51	cyclictest	0	-21	swapper/0	03:23:23	0
21558	99	43	41	cyclictest	21581	-21	latency_hist	03:16:00	2
21539	99	36	31	cyclictest	0	-21	swapper/0	03:16:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17