OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sun Aug 02, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
24408	99	128	123	cyclictest	0	-21	swapper/3	06:42:58	3
24405	99	105	92	cyclictest	0	-21	swapper/1	07:42:48	1
24405	99	104	102	cyclictest	24968	-21	tune2fs	03:47:57	1
24405	99	104	102	cyclictest	23022	-21	tune2fs	04:57:56	1
24405	99	104	102	cyclictest	1748	-21	tune2fs	09:07:45	1
24408	99	103	102	cyclictest	22696	-21	munin-node	08:42:49	3
24405	99	103	102	cyclictest	0	-21	swapper/1	05:46:53	1
24405	99	103	102	cyclictest	0	-21	swapper/1	05:46:53	1
24405	99	103	102	cyclictest	0	-21	swapper/1	05:38:38	1
24405	99	103	102	cyclictest	0	-21	swapper/1	04:43:00	1
24405	99	94	92	cyclictest	0	-21	swapper/1	06:42:58	1
24408	99	93	92	cyclictest	0	-21	swapper/3	09:03:06	3
24408	99	93	92	cyclictest	0	-21	swapper/3	05:42:38	3
24405	99	93	92	cyclictest	0	-21	swapper/1	09:03:06	1
24405	99	90	89	cyclictest	0	-21	swapper/1	08:15:34	1
24405	99	90	89	cyclictest	0	-21	swapper/1	07:07:56	1
24405	99	85	83	cyclictest	0	-21	swapper/1	08:52:46	1
24405	99	84	82	cyclictest	16322	-21	aten2.4-expect	08:27:46	1
24405	99	84	82	cyclictest	12	1	ksoftirqd/1	04:07:42	1
24408	99	83	82	cyclictest	0	-21	swapper/3	09:12:49	3
24408	99	83	82	cyclictest	0	-21	swapper/3	09:07:51	3
24408	99	83	82	cyclictest	0	-21	swapper/3	08:52:53	3
24408	99	83	82	cyclictest	0	-21	swapper/3	08:47:50	3
24408	99	83	82	cyclictest	0	-21	swapper/3	08:33:39	3
24408	99	83	82	cyclictest	0	-21	swapper/3	08:33:39	3
24408	99	83	82	cyclictest	0	-21	swapper/3	08:27:55	3
24408	99	83	82	cyclictest	0	-21	swapper/3	08:17:54	3
24408	99	83	82	cyclictest	0	-21	swapper/3	08:02:53	3
24408	99	83	82	cyclictest	0	-21	swapper/3	07:52:55	3
24408	99	83	82	cyclictest	0	-21	swapper/3	07:42:57	3
24408	99	83	82	cyclictest	0	-21	swapper/3	07:17:55	3
24408	99	83	82	cyclictest	0	-21	swapper/3	07:15:24	3
24408	99	83	82	cyclictest	0	-21	swapper/3	06:37:58	3
24408	99	83	82	cyclictest	0	-21	swapper/3	06:37:58	3
24408	99	83	82	cyclictest	0	-21	swapper/3	06:28:01	3
24408	99	83	82	cyclictest	0	-21	swapper/3	06:12:57	3
24408	99	83	82	cyclictest	0	-21	swapper/3	06:07:52	3
24408	99	83	82	cyclictest	0	-21	swapper/3	05:52:56	3
24408	99	83	82	cyclictest	0	-21	swapper/3	05:48:00	3
24408	99	83	82	cyclictest	0	-21	swapper/3	05:43:00	3
24408	99	83	82	cyclictest	0	-21	swapper/3	05:43:00	3
24408	99	83	82	cyclictest	0	-21	swapper/3	05:28:00	3
24408	99	83	82	cyclictest	0	-21	swapper/3	05:13:01	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:52:54	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:42:59	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:28:04	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:27:41	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:17:53	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:13:03	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:07:42	3
24408	99	83	82	cyclictest	0	-21	swapper/3	04:02:42	3
24408	99	83	82	cyclictest	0	-21	swapper/3	03:47:57	3
24405	99	83	82	cyclictest	392	-21	md2_raid1	07:37:34	1
24405	99	83	82	cyclictest	0	-21	swapper/1	08:47:50	1
24405	99	83	82	cyclictest	0	-21	swapper/1	08:42:54	1
24405	99	83	82	cyclictest	0	-21	swapper/1	08:32:53	1
24405	99	83	82	cyclictest	0	-21	swapper/1	08:32:53	1
24405	99	83	82	cyclictest	0	-21	swapper/1	07:37:56	1
24405	99	83	82	cyclictest	0	-21	swapper/1	07:05:23	1
24405	99	83	82	cyclictest	0	-21	swapper/1	07:00:22	1
24405	99	83	82	cyclictest	0	-21	swapper/1	06:15:15	1
24405	99	83	82	cyclictest	0	-21	swapper/1	06:07:52	1
24405	99	83	82	cyclictest	0	-21	swapper/1	06:02:52	1
24405	99	83	82	cyclictest	0	-21	swapper/1	06:00:13	1
24405	99	83	82	cyclictest	0	-21	swapper/1	05:57:37	1
24405	99	83	82	cyclictest	0	-21	swapper/1	05:18:00	1
24405	99	83	82	cyclictest	0	-21	swapper/1	05:15:06	1
24405	99	83	82	cyclictest	0	-21	swapper/1	04:50:02	1
24405	99	83	82	cyclictest	0	-21	swapper/1	04:38:05	1
24405	99	83	82	cyclictest	0	-21	swapper/1	04:33:05	1
24405	99	83	82	cyclictest	0	-21	swapper/1	04:19:57	1
24405	99	83	82	cyclictest	0	-21	swapper/1	04:14:56	1
24405	99	83	81	cyclictest	3766	-21	tune2fs	07:57:47	1
24405	99	83	81	cyclictest	3730	-21	tune2fs	05:27:53	1
24405	99	83	81	cyclictest	27278	-21	tune2fs	05:07:54	1
24405	99	83	81	cyclictest	25267	-21	tune2fs	06:17:52	1
24405	99	83	81	cyclictest	20635	-21	tune2fs	04:52:54	1
24405	99	83	81	cyclictest	1318	-21	tune2fs	05:22:51	1
24408	99	82	81	cyclictest	32144	-21	needreboot	05:17:57	3
24408	99	82	81	cyclictest	0	-21	swapper/3	08:12:47	3
24408	99	82	81	cyclictest	0	-21	swapper/3	07:57:47	3
24408	99	82	81	cyclictest	0	-21	swapper/3	06:22:52	3
24408	99	82	81	cyclictest	0	-21	swapper/3	06:02:52	3
24408	99	82	81	cyclictest	0	-21	swapper/3	04:47:54	3
24408	99	82	81	cyclictest	0	-21	swapper/3	04:32:57	3
24408	99	82	71	cyclictest	0	-21	swapper/3	03:53:04	3
24405	99	82	81	cyclictest	9827	-21	tune2fs	04:27:57	1
24405	99	80	79	cyclictest	0	-21	swapper/1	08:07:53	1
24405	99	74	73	cyclictest	0	-21	swapper/1	08:22:32	1
24408	99	73	72	cyclictest	0	-21	swapper/3	05:58:00	3
24405	99	73	72	cyclictest	0	-21	swapper/1	09:17:31	1
24405	99	73	72	cyclictest	0	-21	swapper/1	07:23:12	1
24405	99	73	72	cyclictest	0	-21	swapper/1	07:22:35	1
24408	99	72	71	cyclictest	0	-21	swapper/3	08:10:34	3
24408	99	72	71	cyclictest	0	-21	swapper/3	07:28:53	3
24408	99	72	71	cyclictest	0	-21	swapper/3	06:17:50	3
24408	99	72	71	cyclictest	0	-21	swapper/3	05:22:49	3
24408	99	72	71	cyclictest	0	-21	swapper/3	04:42:40	3
24408	99	72	71	cyclictest	0	-21	swapper/3	04:07:53	3
24408	99	72	71	cyclictest	0	-21	swapper/3	04:07:53	3
24405	99	71	70	cyclictest	0	-21	swapper/1	08:22:53	1
24405	99	71	70	cyclictest	0	-21	swapper/1	04:02:41	1
24405	99	71	69	cyclictest	0	-21	swapper/1	08:57:49	1
24405	99	71	69	cyclictest	0	-21	swapper/1	07:57:33	1
24405	99	71	69	cyclictest	0	-21	swapper/1	06:37:49	1
24405	99	71	69	cyclictest	0	-21	swapper/1	06:37:49	1
24405	99	71	69	cyclictest	0	-21	swapper/1	06:32:52	1
24405	99	71	69	cyclictest	0	-21	swapper/1	05:32:59	1
24405	99	70	69	cyclictest	0	-21	swapper/1	08:37:53	1
24405	99	70	69	cyclictest	0	-21	swapper/1	08:02:52	1
24405	99	70	69	cyclictest	0	-21	swapper/1	07:27:47	1
24405	99	70	69	cyclictest	0	-21	swapper/1	07:12:48	1
24405	99	70	69	cyclictest	0	-21	swapper/1	06:52:57	1
24405	99	70	69	cyclictest	0	-21	swapper/1	06:47:48	1
24405	99	70	69	cyclictest	0	-21	swapper/1	06:27:51	1
24405	99	70	69	cyclictest	0	-21	swapper/1	06:22:50	1
24405	99	70	69	cyclictest	0	-21	swapper/1	05:47:50	1
24405	99	70	69	cyclictest	0	-21	swapper/1	05:02:52	1
24405	99	70	69	cyclictest	0	-21	swapper/1	04:27:41	1
24405	99	70	69	cyclictest	0	-21	swapper/1	03:52:57	1
24405	99	70	58	cyclictest	0	-21	swapper/1	07:47:54	1
24408	99	65	63	cyclictest	1384	-13	audispd	07:22:35	3
24408	99	64	62	cyclictest	0	-21	swapper/3	07:47:48	3
24408	99	64	62	cyclictest	0	-21	swapper/3	06:57:57	3
24408	99	64	62	cyclictest	0	-21	swapper/3	06:47:50	3
24408	99	63	62	cyclictest	0	-21	swapper/3	08:57:43	3
24408	99	63	62	cyclictest	0	-21	swapper/3	08:22:43	3
24408	99	63	62	cyclictest	0	-21	swapper/3	07:37:49	3
24408	99	63	62	cyclictest	0	-21	swapper/3	07:32:49	3
24408	99	63	62	cyclictest	0	-21	swapper/3	07:07:47	3
24408	99	63	62	cyclictest	0	-21	swapper/3	07:02:48	3
24408	99	63	62	cyclictest	0	-21	swapper/3	06:52:48	3
24408	99	63	62	cyclictest	0	-21	swapper/3	06:32:51	3
24408	99	63	62	cyclictest	0	-21	swapper/3	05:32:39	3
24408	99	63	62	cyclictest	0	-21	swapper/3	05:07:53	3
24408	99	63	62	cyclictest	0	-21	swapper/3	05:02:53	3
24408	99	63	62	cyclictest	0	-21	swapper/3	04:57:53	3
24408	99	63	51	cyclictest	0	-21	swapper/3	08:37:45	3
24405	99	63	61	cyclictest	651	-21	aten2.4-expect	04:07:52	1
24405	99	63	61	cyclictest	651	-21	aten2.4-expect	04:07:52	1
24407	99	61	45	cyclictest	0	-21	swapper/2	06:34:24	2
24407	99	61	41	cyclictest	0	-21	swapper/2	08:26:03	2
24407	99	60	41	cyclictest	0	-21	swapper/2	08:44:25	2
24407	99	60	41	cyclictest	0	-21	swapper/2	08:34:47	2
24407	99	60	41	cyclictest	0	-21	swapper/2	08:34:47	2
24407	99	59	52	cyclictest	0	-21	swapper/2	06:12:33	2
24407	99	59	41	cyclictest	0	-21	swapper/2	07:04:20	2
24407	99	59	41	cyclictest	0	-21	swapper/2	05:14:43	2
24407	99	57	56	cyclictest	0	-21	swapper/2	07:57:33	2
24407	99	57	53	cyclictest	0	-21	swapper/2	04:48:14	2
24407	99	57	52	cyclictest	0	-21	swapper/2	08:52:44	2
24407	99	57	52	cyclictest	0	-21	swapper/2	08:48:15	2
24407	99	57	52	cyclictest	0	-21	swapper/2	08:21:55	2
24407	99	57	52	cyclictest	0	-21	swapper/2	07:27:48	2
24407	99	57	52	cyclictest	0	-21	swapper/2	07:27:22	2
24407	99	57	52	cyclictest	0	-21	swapper/2	07:19:32	2
24407	99	57	52	cyclictest	0	-21	swapper/2	07:12:47	2
24407	99	57	52	cyclictest	0	-21	swapper/2	06:49:45	2
24407	99	57	52	cyclictest	0	-21	swapper/2	05:52:56	2
24407	99	57	52	cyclictest	0	-21	swapper/2	05:47:51	2
24407	99	57	52	cyclictest	0	-21	swapper/2	05:45:46	2
24407	99	57	52	cyclictest	0	-21	swapper/2	05:45:46	2
24407	99	57	52	cyclictest	0	-21	swapper/2	05:31:30	2
24407	99	57	52	cyclictest	0	-21	swapper/2	05:21:04	2
24407	99	57	52	cyclictest	0	-21	swapper/2	04:55:34	2
24407	99	57	52	cyclictest	0	-21	swapper/2	04:27:47	2
24407	99	57	52	cyclictest	0	-21	swapper/2	04:26:42	2
24407	99	57	52	cyclictest	0	-21	swapper/2	04:21:12	2
24407	99	57	52	cyclictest	0	-21	swapper/2	04:16:51	2
24407	99	57	52	cyclictest	0	-21	swapper/2	03:58:35	2
24407	99	57	41	cyclictest	278	-21	usb-storage	04:10:47	2
24407	99	57	41	cyclictest	278	-21	usb-storage	04:10:47	2
24407	99	57	41	cyclictest	0	-21	swapper/2	09:07:51	2
24407	99	57	41	cyclictest	0	-21	swapper/2	07:07:58	2
24407	99	57	41	cyclictest	0	-21	swapper/2	06:15:48	2
24407	99	57	41	cyclictest	0	-21	swapper/2	06:06:25	2
24407	99	57	41	cyclictest	0	-21	swapper/2	05:22:48	2
24407	99	57	41	cyclictest	0	-21	swapper/2	05:00:20	2
24407	99	57	41	cyclictest	0	-21	swapper/2	03:49:36	2
24407	99	56	52	cyclictest	0	-21	swapper/2	09:02:30	2
24407	99	56	52	cyclictest	0	-21	swapper/2	08:40:13	2
24407	99	56	52	cyclictest	0	-21	swapper/2	08:07:49	2
24407	99	56	52	cyclictest	0	-21	swapper/2	07:52:50	2
24407	99	56	52	cyclictest	0	-21	swapper/2	07:49:05	2
24407	99	56	52	cyclictest	0	-21	swapper/2	07:43:01	2
24407	99	56	52	cyclictest	0	-21	swapper/2	07:37:55	2
24407	99	56	52	cyclictest	0	-21	swapper/2	06:54:09	2
24407	99	56	52	cyclictest	0	-21	swapper/2	06:41:38	2
24407	99	56	52	cyclictest	0	-21	swapper/2	06:41:38	2
24407	99	56	52	cyclictest	0	-21	swapper/2	05:57:56	2
24407	99	56	52	cyclictest	0	-21	swapper/2	05:34:41	2
24407	99	56	52	cyclictest	0	-21	swapper/2	05:08:00	2
24407	99	56	52	cyclictest	0	-21	swapper/2	05:04:18	2
24407	99	56	52	cyclictest	0	-21	swapper/2	04:37:54	2
24407	99	56	52	cyclictest	0	-21	swapper/2	04:33:33	2
24407	99	56	52	cyclictest	0	-21	swapper/2	04:02:59	2
24407	99	56	41	cyclictest	0	-21	swapper/2	09:12:40	2
24407	99	56	41	cyclictest	0	-21	swapper/2	09:00:48	2
24407	99	56	41	cyclictest	0	-21	swapper/2	08:30:57	2
24407	99	56	41	cyclictest	0	-21	swapper/2	08:05:48	2
24407	99	56	41	cyclictest	0	-21	swapper/2	06:43:27	2
24407	99	56	41	cyclictest	0	-21	swapper/2	06:18:36	2
24407	99	56	41	cyclictest	0	-21	swapper/2	05:40:40	2
24407	99	56	41	cyclictest	0	-21	swapper/2	04:46:40	2
24407	99	56	41	cyclictest	0	-21	swapper/2	03:52:55	2
24407	99	55	54	cyclictest	0	-21	swapper/2	06:24:24	2
24395	99	55	51	cyclictest	278	-21	usb-storage	05:46:57	0
24395	99	55	51	cyclictest	278	-21	usb-storage	05:46:57	0
24407	99	54	53	cyclictest	18	1	ksoftirqd/2	08:14:38	2
24407	99	54	42	cyclictest	0	-21	swapper/2	06:59:23	2
24395	99	54	53	cyclictest	0	-21	swapper/0	06:22:16	0
24395	99	54	51	cyclictest	0	-21	swapper/0	04:49:21	0
24407	99	53	52	cyclictest	0	-21	swapper/2	06:31:02	2
24407	99	53	41	cyclictest	0	-21	swapper/2	07:37:09	2
24395	99	53	52	cyclictest	0	-21	swapper/0	09:01:38	0
24395	99	53	52	cyclictest	0	-21	swapper/0	08:23:20	0
24395	99	53	52	cyclictest	0	-21	swapper/0	07:12:26	0
24395	99	53	52	cyclictest	0	-21	swapper/0	06:05:41	0
24395	99	53	52	cyclictest	0	-21	swapper/0	05:38:54	0
24395	99	53	52	cyclictest	0	-21	swapper/0	04:30:18	0
24395	99	53	51	cyclictest	31232	-21	telnet	06:32:49	0
24395	99	52	51	cyclictest	278	-21	usb-storage	07:39:39	0
24395	99	52	51	cyclictest	278	-21	usb-storage	06:28:54	0
24395	99	52	51	cyclictest	278	-21	usb-storage	06:13:44	0
24395	99	52	51	cyclictest	278	-21	usb-storage	03:58:11	0
24395	99	52	51	cyclictest	1286	50	irq/46-eth0	06:37:48	0
24395	99	52	51	cyclictest	1286	50	irq/46-eth0	06:37:48	0
24395	99	52	51	cyclictest	0	-21	swapper/0	09:14:45	0
24395	99	52	51	cyclictest	0	-21	swapper/0	08:48:02	0
24395	99	52	51	cyclictest	0	-21	swapper/0	08:46:49	0
24395	99	52	51	cyclictest	0	-21	swapper/0	08:18:04	0
24395	99	52	51	cyclictest	0	-21	swapper/0	08:02:45	0
24395	99	52	51	cyclictest	0	-21	swapper/0	07:47:39	0
24395	99	52	51	cyclictest	0	-21	swapper/0	07:36:49	0
24395	99	52	51	cyclictest	0	-21	swapper/0	07:18:54	0
24395	99	52	51	cyclictest	0	-21	swapper/0	07:03:46	0
24395	99	52	51	cyclictest	0	-21	swapper/0	07:01:52	0
24395	99	52	51	cyclictest	0	-21	swapper/0	06:48:35	0
24395	99	52	51	cyclictest	0	-21	swapper/0	06:44:23	0
24395	99	52	51	cyclictest	0	-21	swapper/0	05:49:59	0
24395	99	52	51	cyclictest	0	-21	swapper/0	05:33:20	0
24395	99	52	51	cyclictest	0	-21	swapper/0	05:28:16	0
24395	99	52	51	cyclictest	0	-21	swapper/0	05:10:47	0
24395	99	52	51	cyclictest	0	-21	swapper/0	05:03:37	0
24395	99	52	51	cyclictest	0	-21	swapper/0	04:24:06	0
24395	99	52	51	cyclictest	0	-21	swapper/0	04:03:47	0
24395	99	52	41	cyclictest	0	-21	swapper/0	04:14:35	0
24395	99	51	50	cyclictest	0	-21	swapper/0	08:08:19	0
24395	99	51	50	cyclictest	0	-21	swapper/0	07:43:08	0
24395	99	51	50	cyclictest	0	-21	swapper/0	03:50:48	0
24395	99	50	49	cyclictest	0	-21	swapper/0	09:08:02	0
24395	99	50	49	cyclictest	0	-21	swapper/0	04:33:58	0
24395	99	49	48	cyclictest	0	-21	swapper/0	06:52:47	0
24395	99	48	47	cyclictest	0	-21	swapper/0	07:54:09	0
24395	99	48	47	cyclictest	0	-21	swapper/0	05:54:23	0
24395	99	48	47	cyclictest	0	-21	swapper/0	04:40:58	0
24395	99	48	47	cyclictest	0	-21	swapper/0	04:08:27	0
24395	99	48	47	cyclictest	0	-21	swapper/0	04:08:27	0
24395	99	48	41	cyclictest	0	-21	swapper/0	08:56:58	0
24395	99	48	41	cyclictest	0	-21	swapper/0	08:38:23	0
24395	99	48	41	cyclictest	0	-21	swapper/0	07:57:52	0
24395	99	46	45	cyclictest	0	-21	swapper/0	07:26:57	0
24395	99	46	45	cyclictest	0	-21	swapper/0	06:24:12	0
24395	99	46	45	cyclictest	0	-21	swapper/0	05:58:28	0
24395	99	46	45	cyclictest	0	-21	swapper/0	05:16:36	0
24395	99	45	44	cyclictest	0	-21	swapper/0	07:28:05	0
24395	99	45	44	cyclictest	0	-21	swapper/0	06:08:03	0
24395	99	45	41	cyclictest	0	-21	swapper/0	09:03:20	0
24395	99	45	41	cyclictest	0	-21	swapper/0	05:17:39	0
24395	99	45	41	cyclictest	0	-21	swapper/0	04:55:31	0
24395	99	44	42	cyclictest	1866	-21	hald-addon-stor	04:19:45	0
24395	99	44	41	cyclictest	0	-21	swapper/0	05:23:12	0
24395	99	44	41	cyclictest	0	-21	swapper/0	05:00:31	0
24395	99	44	30	cyclictest	0	-21	swapper/0	08:32:53	0
24395	99	44	30	cyclictest	0	-21	swapper/0	08:32:53	0
24395	99	43	42	cyclictest	0	-21	swapper/0	08:27:49	0
24395	99	43	42	cyclictest	0	-21	swapper/0	08:12:36	0
24395	99	43	42	cyclictest	0	-21	swapper/0	07:12:47	0
24395	99	43	41	cyclictest	760	50	irq/18-parport0	03:53:02	0
24395	99	43	31	cyclictest	0	-21	swapper/0	04:43:05	0
16	99	14	0	migration/2	24279	-21	latency_hist	03:47:42	2
21	99	12	0	migration/3	23281	-21	munin-node	03:43:03	3
1286	50	11	0	irq/46-eth0	22544	-21	sed	03:42:58	0
10	99	10	0	migration/1	24177	-21	taskset	03:46:50	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17