OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Thu Sep 10, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
28130	99	128	123	cyclictest	0	-21	swapper/3	06:47:37	3
28130	99	128	112	cyclictest	0	-21	swapper/3	06:32:15	3
28124	99	124	122	cyclictest	30826	-21	tune2fs	04:32:32	1
28130	99	107	102	cyclictest	0	-21	swapper/3	03:17:44	3
28124	99	107	102	cyclictest	392	-21	md2_raid1	06:32:15	1
28124	99	104	102	cyclictest	13760	-21	tune2fs	06:22:29	1
28124	99	103	102	cyclictest	5180	-21	tune2fs	06:02:30	1
28124	99	103	102	cyclictest	26734	-21	tune2fs	05:37:29	1
28124	99	103	102	cyclictest	20596	-21	tune2fs	07:52:26	1
28124	99	103	102	cyclictest	0	-21	swapper/1	06:52:14	1
28124	99	103	102	cyclictest	0	-21	swapper/1	04:32:20	1
28130	99	95	94	cyclictest	0	-21	swapper/3	04:02:36	3
28130	99	93	92	cyclictest	0	-21	swapper/3	07:55:43	3
28130	99	93	92	cyclictest	0	-21	swapper/3	06:22:29	3
28130	99	93	92	cyclictest	0	-21	swapper/3	04:32:32	3
28124	99	93	92	cyclictest	0	-21	swapper/1	06:17:36	1
28124	99	93	92	cyclictest	0	-21	swapper/1	05:47:37	1
28124	99	88	82	cyclictest	13722	-21	tune2fs	05:07:32	1
28124	99	88	82	cyclictest	0	-21	swapper/1	04:07:35	1
28124	99	88	72	cyclictest	0	-21	swapper/1	07:22:27	1
28124	99	87	82	cyclictest	0	-21	swapper/1	07:47:12	1
28124	99	87	82	cyclictest	0	-21	swapper/1	05:12:35	1
28124	99	87	82	cyclictest	0	-21	swapper/1	04:44:17	1
28124	99	87	81	cyclictest	29250	-21	tune2fs	08:12:25	1
28130	99	86	82	cyclictest	0	-21	swapper/3	08:07:12	3
28124	99	86	82	cyclictest	0	-21	swapper/1	03:42:35	1
28124	99	86	81	cyclictest	0	-21	swapper/1	08:17:32	1
28124	99	85	82	cyclictest	0	-21	swapper/1	04:22:39	1
28124	99	85	81	cyclictest	0	-21	swapper/1	08:12:12	1
28124	99	85	81	cyclictest	0	-21	swapper/1	07:00:34	1
28124	99	85	81	cyclictest	0	-21	swapper/1	03:22:39	1
28124	99	84	81	cyclictest	0	-21	swapper/1	05:25:20	1
28130	99	83	82	cyclictest	0	-21	swapper/3	08:42:10	3
28130	99	83	82	cyclictest	0	-21	swapper/3	08:17:32	3
28130	99	83	82	cyclictest	0	-21	swapper/3	08:12:12	3
28130	99	83	82	cyclictest	0	-21	swapper/3	07:57:28	3
28130	99	83	82	cyclictest	0	-21	swapper/3	07:47:12	3
28130	99	83	82	cyclictest	0	-21	swapper/3	07:27:33	3
28130	99	83	82	cyclictest	0	-21	swapper/3	07:25:38	3
28130	99	83	82	cyclictest	0	-21	swapper/3	07:02:14	3
28130	99	83	82	cyclictest	0	-21	swapper/3	06:42:15	3
28130	99	83	82	cyclictest	0	-21	swapper/3	06:42:15	3
28130	99	83	82	cyclictest	0	-21	swapper/3	06:02:30	3
28130	99	83	82	cyclictest	0	-21	swapper/3	05:52:37	3
28130	99	83	82	cyclictest	0	-21	swapper/3	05:37:31	3
28130	99	83	82	cyclictest	0	-21	swapper/3	05:27:37	3
28130	99	83	82	cyclictest	0	-21	swapper/3	04:50:14	3
28130	99	83	82	cyclictest	0	-21	swapper/3	04:44:17	3
28130	99	83	82	cyclictest	0	-21	swapper/3	04:22:39	3
28130	99	83	82	cyclictest	0	-21	swapper/3	04:22:20	3
28130	99	83	82	cyclictest	0	-21	swapper/3	03:57:43	3
28130	99	83	82	cyclictest	0	-21	swapper/3	03:42:35	3
28130	99	83	82	cyclictest	0	-21	swapper/3	03:22:39	3
28124	99	83	82	cyclictest	0	-21	swapper/1	08:32:31	1
28124	99	83	82	cyclictest	0	-21	swapper/1	08:27:32	1
28124	99	83	82	cyclictest	0	-21	swapper/1	08:22:31	1
28124	99	83	82	cyclictest	0	-21	swapper/1	07:57:28	1
28124	99	83	82	cyclictest	0	-21	swapper/1	07:47:32	1
28124	99	83	82	cyclictest	0	-21	swapper/1	07:32:34	1
28124	99	83	82	cyclictest	0	-21	swapper/1	07:27:25	1
28124	99	83	82	cyclictest	0	-21	swapper/1	07:12:30	1
28124	99	83	82	cyclictest	0	-21	swapper/1	07:07:24	1
28124	99	83	82	cyclictest	0	-21	swapper/1	07:02:27	1
28124	99	83	82	cyclictest	0	-21	swapper/1	06:52:35	1
28124	99	83	82	cyclictest	0	-21	swapper/1	06:42:28	1
28124	99	83	82	cyclictest	0	-21	swapper/1	06:37:38	1
28124	99	83	82	cyclictest	0	-21	swapper/1	06:37:38	1
28124	99	83	82	cyclictest	0	-21	swapper/1	06:32:29	1
28124	99	83	82	cyclictest	0	-21	swapper/1	06:12:36	1
28124	99	83	82	cyclictest	0	-21	swapper/1	06:07:30	1
28124	99	83	82	cyclictest	0	-21	swapper/1	05:52:34	1
28124	99	83	82	cyclictest	0	-21	swapper/1	05:42:38	1
28124	99	83	82	cyclictest	0	-21	swapper/1	05:32:35	1
28124	99	83	82	cyclictest	0	-21	swapper/1	05:27:37	1
28124	99	83	82	cyclictest	0	-21	swapper/1	05:21:51	1
28124	99	83	82	cyclictest	0	-21	swapper/1	05:02:36	1
28124	99	83	82	cyclictest	0	-21	swapper/1	04:52:41	1
28124	99	83	82	cyclictest	0	-21	swapper/1	04:22:20	1
28124	99	83	82	cyclictest	0	-21	swapper/1	04:15:08	1
28124	99	83	82	cyclictest	0	-21	swapper/1	04:02:43	1
28124	99	83	82	cyclictest	0	-21	swapper/1	03:47:39	1
28124	99	83	82	cyclictest	0	-21	swapper/1	03:37:41	1
28124	99	83	82	cyclictest	0	-21	swapper/1	03:32:39	1
28124	99	83	82	cyclictest	0	-21	swapper/1	03:17:42	1
28124	99	83	82	cyclictest	0	-21	swapper/1	03:15:26	1
28124	99	83	81	cyclictest	4711	-21	aten2.4-expect	04:47:30	1
28124	99	83	81	cyclictest	4546	-21	sadc	06:02:17	1
28124	99	83	81	cyclictest	24905	-21	tune2fs	08:02:26	1
28124	99	83	81	cyclictest	15323	-21	aten2.4-expect	03:57:32	1
28124	99	83	71	cyclictest	0	-21	swapper/1	08:37:22	1
28130	99	82	81	cyclictest	0	-21	swapper/3	08:12:25	3
28130	99	82	81	cyclictest	0	-21	swapper/3	06:17:30	3
28130	99	82	81	cyclictest	0	-21	swapper/3	05:47:30	3
28130	99	82	81	cyclictest	0	-21	swapper/3	05:23:21	3
28124	99	82	81	cyclictest	2753	-21	tune2fs	03:27:35	1
28124	99	82	81	cyclictest	2753	-21	tune2fs	03:27:35	1
28124	99	75	72	cyclictest	0	-21	swapper/1	04:37:51	1
28130	99	74	73	cyclictest	0	-21	swapper/3	07:02:25	3
28130	99	73	72	cyclictest	0	-21	swapper/3	06:17:16	3
28130	99	73	72	cyclictest	0	-21	swapper/3	05:45:22	3
28130	99	73	72	cyclictest	0	-21	swapper/3	05:07:39	3
28130	99	73	72	cyclictest	0	-21	swapper/3	04:55:15	3
28130	99	73	72	cyclictest	0	-21	swapper/3	04:37:40	3
28130	99	73	72	cyclictest	0	-21	swapper/3	03:37:41	3
28124	99	73	72	cyclictest	0	-21	swapper/1	07:37:23	1
28124	99	73	72	cyclictest	0	-21	swapper/1	07:17:25	1
28124	99	73	72	cyclictest	0	-21	swapper/1	04:57:29	1
28124	99	73	72	cyclictest	0	-21	swapper/1	03:52:32	1
28130	99	72	71	cyclictest	0	-21	swapper/3	05:12:43	3
28130	99	72	71	cyclictest	0	-21	swapper/3	05:02:36	3
28130	99	66	65	cyclictest	0	-21	swapper/3	06:55:42	3
28130	99	66	51	cyclictest	0	-21	swapper/3	07:32:37	3
28130	99	64	62	cyclictest	0	-21	swapper/3	04:12:41	3
28130	99	63	62	cyclictest	0	-21	swapper/3	08:32:21	3
28130	99	63	62	cyclictest	0	-21	swapper/3	08:27:25	3
28130	99	63	62	cyclictest	0	-21	swapper/3	08:22:11	3
28130	99	63	62	cyclictest	0	-21	swapper/3	07:47:16	3
28130	99	63	62	cyclictest	0	-21	swapper/3	07:37:24	3
28130	99	63	62	cyclictest	0	-21	swapper/3	07:17:25	3
28130	99	63	62	cyclictest	0	-21	swapper/3	07:12:29	3
28130	99	63	62	cyclictest	0	-21	swapper/3	07:07:24	3
28130	99	63	62	cyclictest	0	-21	swapper/3	06:42:25	3
28130	99	63	62	cyclictest	0	-21	swapper/3	06:32:26	3
28130	99	63	62	cyclictest	0	-21	swapper/3	06:07:27	3
28130	99	63	62	cyclictest	0	-21	swapper/3	05:57:31	3
28130	99	63	62	cyclictest	0	-21	swapper/3	05:32:17	3
28130	99	63	62	cyclictest	0	-21	swapper/3	05:17:30	3
28130	99	63	62	cyclictest	0	-21	swapper/3	04:57:29	3
28130	99	63	62	cyclictest	0	-21	swapper/3	04:27:31	3
28130	99	63	62	cyclictest	0	-21	swapper/3	04:07:21	3
28130	99	63	62	cyclictest	0	-21	swapper/3	03:52:32	3
28130	99	63	62	cyclictest	0	-21	swapper/3	03:47:33	3
28130	99	63	62	cyclictest	0	-21	swapper/3	03:32:23	3
28130	99	63	62	cyclictest	0	-21	swapper/3	03:27:32	3
28130	99	63	62	cyclictest	0	-21	swapper/3	03:27:32	3
28130	99	63	62	cyclictest	0	-21	swapper/3	03:12:34	3
28116	99	63	62	cyclictest	0	-21	swapper/0	08:02:12	0
28129	99	62	61	cyclictest	0	-21	swapper/2	07:06:22	2
28129	99	62	61	cyclictest	0	-21	swapper/2	06:41:15	2
28129	99	62	61	cyclictest	0	-21	swapper/2	06:41:15	2
28129	99	62	61	cyclictest	0	-21	swapper/2	03:31:52	2
28129	99	62	61	cyclictest	0	-21	swapper/2	03:31:52	2
28116	99	62	61	cyclictest	0	-21	swapper/0	04:51:49	0
28116	99	62	61	cyclictest	0	-21	swapper/0	03:39:37	0
28116	99	61	60	cyclictest	0	-21	swapper/0	07:39:10	0
28116	99	61	60	cyclictest	0	-21	swapper/0	06:42:57	0
28116	99	61	60	cyclictest	0	-21	swapper/0	05:14:18	0
28116	99	61	60	cyclictest	0	-21	swapper/0	04:23:02	0
28129	99	60	59	cyclictest	0	-21	swapper/2	08:02:23	2
28129	99	60	59	cyclictest	0	-21	swapper/2	07:59:47	2
28129	99	60	59	cyclictest	0	-21	swapper/2	05:46:17	2
28116	99	60	43	cyclictest	0	-21	swapper/0	07:47:14	0
28129	99	59	58	cyclictest	0	-21	swapper/2	08:32:22	2
28116	99	59	58	cyclictest	0	-21	swapper/0	04:42:32	0
28116	99	58	51	cyclictest	0	-21	swapper/0	07:57:34	0
28116	99	58	51	cyclictest	0	-21	swapper/0	04:12:22	0
28129	99	56	55	cyclictest	7851	-21	missed_timers	04:52:37	2
28129	99	56	44	cyclictest	30289	-21	runrttasks	08:13:40	2
28129	99	55	54	cyclictest	19724	-21	sshd	07:51:34	2
28129	99	55	54	cyclictest	0	-21	swapper/2	06:45:48	2
28129	99	55	52	cyclictest	0	-21	swapper/2	07:52:46	2
28129	99	55	52	cyclictest	0	-21	swapper/2	05:40:29	2
28129	99	55	43	cyclictest	12887	-21	runrttasks	06:18:37	2
28116	99	55	54	cyclictest	0	-21	swapper/0	04:07:33	0
28129	99	54	53	cyclictest	32457	-21	sshd	08:18:34	2
28129	99	54	53	cyclictest	2294	-21	sshd	05:56:39	2
28129	99	54	53	cyclictest	15203	-21	sshd	06:25:38	2
28129	99	54	53	cyclictest	10667	-21	sshd	04:59:41	2
28129	99	54	53	cyclictest	0	-21	swapper/2	07:20:51	2
28129	99	54	53	cyclictest	0	-21	swapper/2	06:47:26	2
28129	99	54	53	cyclictest	0	-21	swapper/2	05:58:54	2
28129	99	54	53	cyclictest	0	-21	swapper/2	05:35:51	2
28129	99	54	53	cyclictest	0	-21	swapper/2	05:22:28	2
28129	99	54	53	cyclictest	0	-21	swapper/2	04:07:32	2
28129	99	54	53	cyclictest	0	-21	swapper/2	03:12:34	2
28129	99	54	52	cyclictest	50	50	irq/44-ahci	06:07:33	2
28129	99	54	42	cyclictest	50	50	irq/44-ahci	03:50:30	2
28129	99	54	42	cyclictest	278	-21	usb-storage	03:54:05	2
28129	99	54	31	cyclictest	2735	-21	aten2.4_r3power	08:27:22	2
28116	99	54	53	cyclictest	0	-21	swapper/0	05:02:24	0
28129	99	53	52	cyclictest	18	1	ksoftirqd/2	04:43:45	2
28129	99	53	52	cyclictest	0	-21	swapper/2	08:08:45	2
28129	99	53	52	cyclictest	0	-21	swapper/2	07:27:24	2
28129	99	53	52	cyclictest	0	-21	swapper/2	07:22:25	2
28129	99	53	52	cyclictest	0	-21	swapper/2	06:57:25	2
28129	99	53	52	cyclictest	0	-21	swapper/2	06:52:26	2
28129	99	53	52	cyclictest	0	-21	swapper/2	06:32:25	2
28129	99	53	52	cyclictest	0	-21	swapper/2	06:12:22	2
28129	99	53	52	cyclictest	0	-21	swapper/2	05:47:36	2
28129	99	53	52	cyclictest	0	-21	swapper/2	05:13:36	2
28129	99	53	52	cyclictest	0	-21	swapper/2	05:07:46	2
28129	99	53	52	cyclictest	0	-21	swapper/2	04:38:33	2
28129	99	53	52	cyclictest	0	-21	swapper/2	04:32:39	2
28129	99	53	52	cyclictest	0	-21	swapper/2	04:30:18	2
28129	99	53	52	cyclictest	0	-21	swapper/2	04:25:00	2
28129	99	53	52	cyclictest	0	-21	swapper/2	04:17:31	2
28129	99	53	52	cyclictest	0	-21	swapper/2	04:06:01	2
28129	99	53	52	cyclictest	0	-21	swapper/2	03:57:37	2
28129	99	53	52	cyclictest	0	-21	swapper/2	03:42:27	2
28129	99	53	52	cyclictest	0	-21	swapper/2	03:37:23	2
28129	99	53	52	cyclictest	0	-21	swapper/2	03:32:33	2
28129	99	53	52	cyclictest	0	-21	swapper/2	03:22:29	2
28129	99	53	42	cyclictest	50	50	irq/44-ahci	04:12:47	2
28129	99	53	41	cyclictest	0	-21	swapper/2	08:22:37	2
28129	99	53	41	cyclictest	0	-21	swapper/2	07:42:38	2
28129	99	53	41	cyclictest	0	-21	swapper/2	07:37:23	2
28129	99	53	41	cyclictest	0	-21	swapper/2	07:32:37	2
28129	99	53	41	cyclictest	0	-21	swapper/2	07:13:19	2
28129	99	53	41	cyclictest	0	-21	swapper/2	07:07:43	2
28129	99	53	41	cyclictest	0	-21	swapper/2	06:03:04	2
28129	99	53	41	cyclictest	0	-21	swapper/2	05:19:32	2
28129	99	53	41	cyclictest	0	-21	swapper/2	05:02:31	2
28129	99	53	41	cyclictest	0	-21	swapper/2	03:17:27	2
28129	99	53	31	cyclictest	0	-21	swapper/2	08:37:28	2
28129	99	53	31	cyclictest	0	-21	swapper/2	06:27:23	2
28129	99	53	31	cyclictest	0	-21	swapper/2	04:47:34	2
28116	99	53	52	cyclictest	1286	50	irq/46-eth0	07:02:26	0
28116	99	53	52	cyclictest	0	-21	swapper/0	08:37:36	0
28116	99	53	52	cyclictest	0	-21	swapper/0	08:27:22	0
28116	99	53	52	cyclictest	0	-21	swapper/0	08:22:22	0
28116	99	53	52	cyclictest	0	-21	swapper/0	08:17:34	0
28116	99	53	52	cyclictest	0	-21	swapper/0	08:12:52	0
28116	99	53	52	cyclictest	0	-21	swapper/0	08:07:12	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:52:17	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:42:21	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:32:44	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:27:14	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:22:31	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:17:26	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:13:22	0
28116	99	53	52	cyclictest	0	-21	swapper/0	07:07:19	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:57:37	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:52:26	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:47:25	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:37:27	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:37:27	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:32:50	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:27:53	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:22:33	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:17:25	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:12:16	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:07:27	0
28116	99	53	52	cyclictest	0	-21	swapper/0	06:02:41	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:57:19	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:52:28	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:48:29	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:42:22	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:37:22	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:32:29	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:27:45	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:22:23	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:17:24	0
28116	99	53	52	cyclictest	0	-21	swapper/0	05:08:13	0
28116	99	53	52	cyclictest	0	-21	swapper/0	04:57:29	0
28116	99	53	52	cyclictest	0	-21	swapper/0	04:52:20	0
28116	99	53	52	cyclictest	0	-21	swapper/0	04:37:31	0
28116	99	53	52	cyclictest	0	-21	swapper/0	04:32:45	0
28116	99	53	52	cyclictest	0	-21	swapper/0	04:27:31	0
28116	99	53	52	cyclictest	0	-21	swapper/0	04:17:24	0
28116	99	53	52	cyclictest	0	-21	swapper/0	04:03:34	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:57:26	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:52:51	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:47:57	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:42:22	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:33:05	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:27:27	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:27:27	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:22:23	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:17:50	0
28116	99	53	52	cyclictest	0	-21	swapper/0	03:12:23	0
28116	99	53	41	cyclictest	0	-21	swapper/0	08:32:14	0
28129	99	52	41	cyclictest	0	-21	swapper/2	05:27:45	2
28124	99	22	21	cyclictest	0	-21	swapper/1	03:12:23	1
28116	99	22	21	cyclictest	0	-21	swapper/0	03:12:23	0
21	99	12	0	migration/3	26851	-21	munin-node	03:07:39	3
50	50	10	0	irq/44-ahci	27976	-21	munin-run	03:12:23	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17