OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Jun 08, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
23377	99	105	93	cyclictest	2541	-21	tune2fs	05:02:45	1
23377	99	104	102	cyclictest	32559	-21	tune2fs	04:57:44	1
23377	99	104	102	cyclictest	15366	-21	tune2fs	06:47:39	1
23379	99	103	102	cyclictest	0	-21	swapper/3	07:42:37	3
23377	99	90	72	cyclictest	0	-21	swapper/1	04:47:31	1
23377	99	89	82	cyclictest	4792	-21	tune2fs	06:22:42	1
23377	99	89	82	cyclictest	26354	-21	tune2fs	05:57:41	1
23377	99	89	82	cyclictest	22185	-21	tune2fs	09:32:36	1
23377	99	89	82	cyclictest	17867	-21	tune2fs	06:52:40	1
23377	99	89	82	cyclictest	13607	-21	tune2fs	09:12:36	1
23377	99	88	82	cyclictest	15715	-21	tune2fs	08:02:39	1
23377	99	88	82	cyclictest	0	-21	swapper/1	07:32:49	1
23377	99	88	81	cyclictest	2976	-21	tune2fs	10:02:33	1
23377	99	88	81	cyclictest	13612	-21	tune2fs	07:57:38	1
23377	99	88	71	cyclictest	0	-21	swapper/1	08:27:22	1
23377	99	87	82	cyclictest	0	-21	swapper/1	08:42:42	1
23377	99	87	82	cyclictest	0	-21	swapper/1	08:40:43	1
23377	99	86	82	cyclictest	0	-21	swapper/1	10:00:57	1
23377	99	86	82	cyclictest	0	-21	swapper/1	09:10:48	1
23377	99	86	82	cyclictest	0	-21	swapper/1	09:10:48	1
23377	99	86	82	cyclictest	0	-21	swapper/1	08:27:45	1
23377	99	86	82	cyclictest	0	-21	swapper/1	07:27:45	1
23377	99	86	82	cyclictest	0	-21	swapper/1	05:50:14	1
23377	99	86	82	cyclictest	0	-21	swapper/1	05:35:11	1
23377	99	86	82	cyclictest	0	-21	swapper/1	04:55:05	1
23379	99	85	83	cyclictest	0	-21	swapper/3	08:02:49	3
23379	99	83	82	cyclictest	29793	-21	sed	09:47:44	3
23379	99	83	82	cyclictest	0	-21	swapper/3	09:57:40	3
23379	99	83	82	cyclictest	0	-21	swapper/3	09:52:40	3
23379	99	83	82	cyclictest	0	-21	swapper/3	09:37:40	3
23379	99	83	82	cyclictest	0	-21	swapper/3	09:22:42	3
23379	99	83	82	cyclictest	0	-21	swapper/3	09:17:37	3
23379	99	83	82	cyclictest	0	-21	swapper/3	09:15:50	3
23379	99	83	82	cyclictest	0	-21	swapper/3	09:02:36	3
23379	99	83	82	cyclictest	0	-21	swapper/3	08:57:43	3
23379	99	83	82	cyclictest	0	-21	swapper/3	08:30:41	3
23379	99	83	82	cyclictest	0	-21	swapper/3	08:25:41	3
23379	99	83	82	cyclictest	0	-21	swapper/3	08:12:41	3
23379	99	83	82	cyclictest	0	-21	swapper/3	08:09:49	3
23379	99	83	82	cyclictest	0	-21	swapper/3	07:57:45	3
23379	99	83	82	cyclictest	0	-21	swapper/3	07:47:44	3
23379	99	83	82	cyclictest	0	-21	swapper/3	07:22:43	3
23379	99	83	82	cyclictest	0	-21	swapper/3	07:17:38	3
23379	99	83	82	cyclictest	0	-21	swapper/3	07:17:38	3
23379	99	83	82	cyclictest	0	-21	swapper/3	07:12:45	3
23379	99	83	82	cyclictest	0	-21	swapper/3	07:07:44	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:52:39	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:47:47	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:42:47	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:37:48	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:17:46	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:12:47	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:07:46	3
23379	99	83	82	cyclictest	0	-21	swapper/3	06:02:43	3
23379	99	83	82	cyclictest	0	-21	swapper/3	05:27:50	3
23379	99	83	82	cyclictest	0	-21	swapper/3	05:22:51	3
23379	99	83	82	cyclictest	0	-21	swapper/3	05:17:49	3
23379	99	83	82	cyclictest	0	-21	swapper/3	05:10:08	3
23379	99	83	82	cyclictest	0	-21	swapper/3	05:02:45	3
23379	99	83	82	cyclictest	0	-21	swapper/3	04:42:51	3
23379	99	83	81	cyclictest	26972	-21	proc_pri	05:57:47	3
23377	99	83	82	cyclictest	0	-21	swapper/1	09:47:42	1
23377	99	83	82	cyclictest	0	-21	swapper/1	09:30:52	1
23377	99	83	82	cyclictest	0	-21	swapper/1	09:02:21	1
23377	99	83	82	cyclictest	0	-21	swapper/1	08:57:22	1
23377	99	83	82	cyclictest	0	-21	swapper/1	08:47:44	1
23377	99	83	82	cyclictest	0	-21	swapper/1	08:35:42	1
23377	99	83	82	cyclictest	0	-21	swapper/1	08:15:39	1
23377	99	83	82	cyclictest	0	-21	swapper/1	07:47:24	1
23377	99	83	82	cyclictest	0	-21	swapper/1	07:37:45	1
23377	99	83	82	cyclictest	0	-21	swapper/1	07:07:47	1
23377	99	83	82	cyclictest	0	-21	swapper/1	07:02:48	1
23377	99	83	82	cyclictest	0	-21	swapper/1	06:42:49	1
23377	99	83	82	cyclictest	0	-21	swapper/1	06:27:47	1
23377	99	83	82	cyclictest	0	-21	swapper/1	05:55:14	1
23377	99	83	82	cyclictest	0	-21	swapper/1	05:37:49	1
23377	99	83	82	cyclictest	0	-21	swapper/1	05:15:08	1
23377	99	83	81	cyclictest	8841	-21	aten2.4-expect	09:02:34	1
23377	99	83	81	cyclictest	17788	-21	tune2fs	08:07:37	1
23379	99	82	81	cyclictest	0	-21	swapper/3	09:42:34	3
23379	99	82	81	cyclictest	0	-21	swapper/3	07:02:39	3
23379	99	82	81	cyclictest	0	-21	swapper/3	06:22:41	3
23379	99	82	81	cyclictest	0	-21	swapper/3	05:12:42	3
23379	99	82	81	cyclictest	0	-21	swapper/3	04:57:45	3
23379	99	82	81	cyclictest	0	-21	swapper/3	04:52:46	3
23377	99	82	81	cyclictest	26236	-21	tune2fs	07:12:38	1
23377	99	82	81	cyclictest	15688	-21	tune2fs	09:17:34	1
23377	99	79	72	cyclictest	0	-21	swapper/1	09:52:31	1
23377	99	78	77	cyclictest	0	-21	swapper/1	07:02:26	1
23377	99	78	72	cyclictest	0	-21	swapper/1	05:30:32	1
23377	99	77	72	cyclictest	0	-21	swapper/1	09:42:32	1
23377	99	77	71	cyclictest	0	-21	swapper/1	06:02:39	1
23377	99	77	61	cyclictest	0	-21	swapper/1	04:47:43	1
23379	99	76	74	cyclictest	0	-21	swapper/3	05:47:52	3
23379	99	74	73	cyclictest	0	-21	swapper/3	09:32:42	3
23379	99	73	72	cyclictest	0	-21	swapper/3	08:48:37	3
23379	99	73	72	cyclictest	0	-21	swapper/3	08:32:34	3
23379	99	73	72	cyclictest	0	-21	swapper/3	07:37:24	3
23377	99	73	72	cyclictest	0	-21	swapper/1	09:22:42	1
23377	99	73	72	cyclictest	0	-21	swapper/1	07:22:37	1
23377	99	73	72	cyclictest	0	-21	swapper/1	06:42:27	1
23377	99	73	72	cyclictest	0	-21	swapper/1	06:19:49	1
23377	99	73	72	cyclictest	0	-21	swapper/1	06:12:38	1
23377	99	73	72	cyclictest	0	-21	swapper/1	06:07:46	1
23377	99	73	72	cyclictest	0	-21	swapper/1	05:25:10	1
23377	99	73	72	cyclictest	0	-21	swapper/1	04:37:52	1
23377	99	73	71	cyclictest	28573	-21	tune2fs	07:17:38	1
23377	99	73	71	cyclictest	28573	-21	tune2fs	07:17:38	1
23379	99	72	71	cyclictest	0	-21	swapper/3	08:52:41	3
23379	99	72	71	cyclictest	0	-21	swapper/3	07:27:41	3
23379	99	72	71	cyclictest	0	-21	swapper/3	06:35:23	3
23379	99	72	71	cyclictest	0	-21	swapper/3	05:37:49	3
23379	99	72	71	cyclictest	0	-21	swapper/3	04:37:52	3
23377	99	72	71	cyclictest	0	-21	swapper/1	07:52:44	1
23377	99	72	71	cyclictest	0	-21	swapper/1	05:17:49	1
23378	99	67	66	cyclictest	0	-21	swapper/2	10:02:40	2
23378	99	67	66	cyclictest	0	-21	swapper/2	09:01:05	2
23379	99	65	63	cyclictest	0	-21	swapper/3	07:37:38	3
23379	99	65	63	cyclictest	0	-21	swapper/3	07:02:26	3
23379	99	65	63	cyclictest	0	-21	swapper/3	06:27:40	3
23378	99	65	56	cyclictest	0	-21	swapper/2	06:30:14	2
23379	99	64	63	cyclictest	0	-21	swapper/3	10:02:39	3
23379	99	64	63	cyclictest	0	-21	swapper/3	09:27:36	3
23379	99	64	63	cyclictest	0	-21	swapper/3	09:07:47	3
23379	99	64	63	cyclictest	0	-21	swapper/3	09:07:47	3
23379	99	64	63	cyclictest	0	-21	swapper/3	08:42:42	3
23379	99	64	63	cyclictest	0	-21	swapper/3	08:17:35	3
23379	99	64	63	cyclictest	0	-21	swapper/3	07:52:44	3
23379	99	64	63	cyclictest	0	-21	swapper/3	05:52:49	3
23379	99	64	63	cyclictest	0	-21	swapper/3	05:32:42	3
23379	99	64	63	cyclictest	0	-21	swapper/3	04:47:52	3
23379	99	64	62	cyclictest	0	-21	swapper/3	08:37:41	3
23377	99	64	62	cyclictest	21229	-21	sadc	05:47:29	1
23377	99	64	62	cyclictest	21229	-21	sadc	05:47:29	1
23377	99	64	62	cyclictest	0	-21	swapper/1	05:07:51	1
23379	99	63	62	cyclictest	0	-21	swapper/3	05:42:42	3
23379	99	63	62	cyclictest	0	-21	swapper/3	05:42:42	3
23377	99	63	62	cyclictest	0	-21	swapper/1	09:37:31	1
23377	99	63	62	cyclictest	0	-21	swapper/1	08:17:34	1
23377	99	63	62	cyclictest	0	-21	swapper/1	07:42:35	1
23377	99	63	61	cyclictest	8929	-21	tune2fs	06:32:41	1
23378	99	62	57	cyclictest	0	-21	swapper/2	07:18:47	2
23378	99	62	57	cyclictest	0	-21	swapper/2	07:18:47	2
23376	99	62	61	cyclictest	0	-21	swapper/0	09:12:02	0
23376	99	62	61	cyclictest	0	-21	swapper/0	09:12:02	0
23376	99	62	61	cyclictest	0	-21	swapper/0	07:34:20	0
23376	99	62	61	cyclictest	0	-21	swapper/0	07:30:29	0
23376	99	62	61	cyclictest	0	-21	swapper/0	06:32:40	0
23376	99	62	61	cyclictest	0	-21	swapper/0	06:12:44	0
23376	99	62	61	cyclictest	0	-21	swapper/0	05:12:40	0
23376	99	62	61	cyclictest	0	-21	swapper/0	04:56:32	0
23376	99	62	61	cyclictest	0	-21	swapper/0	04:50:32	0
23376	99	62	61	cyclictest	0	-21	swapper/0	04:39:41	0
23378	99	61	56	cyclictest	0	-21	swapper/2	09:31:40	2
23378	99	61	56	cyclictest	0	-21	swapper/2	05:22:43	2
23378	99	61	52	cyclictest	278	-21	usb-storage	09:46:09	2
23378	99	59	42	cyclictest	278	-21	usb-storage	06:46:02	2
23378	99	58	53	cyclictest	0	-21	swapper/2	06:11:37	2
23378	99	58	53	cyclictest	0	-21	swapper/2	05:00:12	2
23378	99	58	52	cyclictest	0	-21	swapper/2	08:07:35	2
23378	99	58	51	cyclictest	0	-21	swapper/2	08:46:43	2
23378	99	58	51	cyclictest	0	-21	swapper/2	06:56:07	2
23378	99	58	42	cyclictest	0	-21	swapper/2	06:25:13	2
23378	99	58	41	cyclictest	3059	-21	iostat	07:32:41	2
23378	99	57	52	cyclictest	50	50	irq/44-ahci	09:39:23	2
23378	99	57	52	cyclictest	278	-21	usb-storage	09:20:58	2
23378	99	57	52	cyclictest	278	-21	usb-storage	08:55:57	2
23378	99	57	52	cyclictest	278	-21	usb-storage	04:39:25	2
23378	99	57	52	cyclictest	0	-21	swapper/2	08:02:36	2
23378	99	57	52	cyclictest	0	-21	swapper/2	07:57:35	2
23378	99	57	52	cyclictest	0	-21	swapper/2	07:52:41	2
23378	99	57	52	cyclictest	0	-21	swapper/2	07:26:02	2
23378	99	57	52	cyclictest	0	-21	swapper/2	06:12:38	2
23378	99	57	52	cyclictest	0	-21	swapper/2	05:59:16	2
23378	99	57	52	cyclictest	0	-21	swapper/2	05:12:40	2
23378	99	57	52	cyclictest	0	-21	swapper/2	04:52:44	2
23378	99	57	51	cyclictest	50	50	irq/44-ahci	07:31:06	2
23378	99	57	51	cyclictest	13099	-21	telnet	09:12:33	2
23378	99	57	41	cyclictest	278	-21	usb-storage	07:13:25	2
23378	99	57	41	cyclictest	26053	-21	aten2.4_r3power	08:27:37	2
23378	99	57	41	cyclictest	22396	-21	iostat	07:02:43	2
23378	99	57	41	cyclictest	0	-21	swapper/2	09:06:30	2
23378	99	57	41	cyclictest	0	-21	swapper/2	08:39:14	2
23378	99	57	41	cyclictest	0	-21	swapper/2	08:34:10	2
23378	99	57	41	cyclictest	0	-21	swapper/2	07:42:36	2
23378	99	57	41	cyclictest	0	-21	swapper/2	07:09:09	2
23378	99	57	41	cyclictest	0	-21	swapper/2	06:18:37	2
23378	99	57	41	cyclictest	0	-21	swapper/2	05:32:53	2
23378	99	57	41	cyclictest	0	-21	swapper/2	05:18:03	2
23378	99	57	41	cyclictest	0	-21	swapper/2	04:48:58	2
23378	99	57	41	cyclictest	0	-21	swapper/2	04:47:09	2
23378	99	56	51	cyclictest	278	-21	usb-storage	09:51:59	2
23378	99	56	51	cyclictest	278	-21	usb-storage	07:47:47	2
23378	99	56	51	cyclictest	278	-21	usb-storage	06:57:53	2
23378	99	56	51	cyclictest	0	-21	swapper/2	09:57:31	2
23378	99	56	51	cyclictest	0	-21	swapper/2	09:54:21	2
23378	99	56	51	cyclictest	0	-21	swapper/2	07:40:22	2
23378	99	56	51	cyclictest	0	-21	swapper/2	06:39:12	2
23378	99	56	51	cyclictest	0	-21	swapper/2	06:35:24	2
23378	99	56	51	cyclictest	0	-21	swapper/2	06:03:09	2
23378	99	56	51	cyclictest	0	-21	swapper/2	05:52:40	2
23378	99	56	51	cyclictest	0	-21	swapper/2	05:27:40	2
23378	99	56	41	cyclictest	0	-21	swapper/2	08:52:11	2
23378	99	56	41	cyclictest	0	-21	swapper/2	08:23:40	2
23378	99	56	41	cyclictest	0	-21	swapper/2	05:48:24	2
23378	99	55	51	cyclictest	0	-21	swapper/2	08:16:50	2
23378	99	55	51	cyclictest	0	-21	swapper/2	06:52:04	2
23378	99	55	51	cyclictest	0	-21	swapper/2	05:42:48	2
23378	99	55	51	cyclictest	0	-21	swapper/2	05:42:48	2
23378	99	55	51	cyclictest	0	-21	swapper/2	05:03:38	2
23376	99	55	50	cyclictest	0	-21	swapper/0	09:12:39	0
23376	99	54	41	cyclictest	0	-21	swapper/0	06:20:55	0
23378	99	53	52	cyclictest	0	-21	swapper/2	09:22:33	2
23378	99	53	52	cyclictest	0	-21	swapper/2	08:17:46	2
23378	99	53	52	cyclictest	0	-21	swapper/2	05:07:42	2
23376	99	53	52	cyclictest	760	50	irq/18-parport0	06:26:55	0
23376	99	53	52	cyclictest	0	-21	swapper/0	09:23:32	0
23376	99	53	52	cyclictest	0	-21	swapper/0	07:07:35	0
23376	99	53	50	cyclictest	0	-21	swapper/0	07:22:40	0
23378	99	52	51	cyclictest	11056	-21	telnet	09:07:33	2
23378	99	52	51	cyclictest	11056	-21	telnet	09:07:33	2
23378	99	52	51	cyclictest	0	-21	swapper/2	09:36:29	2
23378	99	52	51	cyclictest	0	-21	swapper/2	05:39:46	2
23376	99	52	51	cyclictest	0	-21	swapper/0	10:03:14	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:58:39	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:53:17	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:47:47	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:43:47	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:37:23	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:32:31	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:28:18	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:17:24	0
23376	99	52	51	cyclictest	0	-21	swapper/0	09:02:27	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:57:43	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:52:51	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:47:38	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:45:15	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:37:41	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:33:00	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:27:23	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:24:30	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:17:41	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:12:39	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:07:49	0
23376	99	52	51	cyclictest	0	-21	swapper/0	08:02:24	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:58:35	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:52:39	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:47:43	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:42:35	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:38:52	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:17:40	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:17:40	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:13:09	0
23376	99	52	51	cyclictest	0	-21	swapper/0	07:02:49	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:57:36	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:55:55	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:49:24	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:42:30	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:37:50	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:27:37	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:07:40	0
23376	99	52	51	cyclictest	0	-21	swapper/0	06:03:19	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:57:34	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:53:10	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:47:30	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:42:39	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:42:39	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:37:45	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:33:47	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:28:03	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:23:41	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:18:53	0
23376	99	52	51	cyclictest	0	-21	swapper/0	05:08:01	0
23376	99	52	51	cyclictest	0	-21	swapper/0	04:59:46	0
23376	99	52	51	cyclictest	0	-21	swapper/0	04:44:08	0
23376	99	52	41	cyclictest	0	-21	swapper/0	05:04:04	0
23	1	12	0	ksoftirqd/3	0	-21	swapper/3	04:33:29	3
3	1	11	0	ksoftirqd/0	0	-21	swapper/0	04:33:29	0
18	1	11	0	ksoftirqd/2	0	-21	swapper/2	04:33:29	2
12	1	11	0	ksoftirqd/1	0	-21	swapper/1	04:36:21	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17