OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sun Aug 23, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
23388	99	108	102	cyclictest	555	-21	tune2fs	08:48:45	1
23388	99	108	102	cyclictest	2726	-21	tune2fs	07:38:46	1
23388	99	108	102	cyclictest	11112	-21	tune2fs	04:13:55	1
23388	99	104	102	cyclictest	26293	-21	tune2fs	06:03:51	1
23388	99	104	102	cyclictest	17715	-21	tune2fs	06:58:47	1
23388	99	96	92	cyclictest	0	-21	swapper/1	06:18:46	1
23388	99	94	92	cyclictest	28521	-21	tune2fs	06:08:49	1
23390	99	93	92	cyclictest	0	-21	swapper/3	05:53:50	3
23388	99	93	92	cyclictest	0	-21	swapper/1	05:47:06	1
23388	99	89	72	cyclictest	0	-21	swapper/1	05:28:36	1
23388	99	88	86	cyclictest	6813	-21	tune2fs	05:18:51	1
23388	99	88	81	cyclictest	22234	-21	tune2fs	08:23:45	1
23388	99	87	82	cyclictest	9104	-21	tune2fs	04:08:54	1
23388	99	87	82	cyclictest	0	-21	swapper/1	06:38:34	1
23388	99	87	82	cyclictest	0	-21	swapper/1	03:48:41	1
23388	99	87	81	cyclictest	4831	-21	tune2fs	07:43:45	1
23388	99	87	81	cyclictest	24323	-21	tune2fs	08:28:43	1
23388	99	87	81	cyclictest	21608	-21	aten2.4-expect	05:53:48	1
23388	99	87	81	cyclictest	10734	-21	aten2.4-expect	05:28:49	1
23388	99	85	82	cyclictest	0	-21	swapper/1	07:28:54	1
23390	99	84	72	cyclictest	0	-21	swapper/3	06:28:34	3
23388	99	84	81	cyclictest	0	-21	swapper/1	06:32:13	1
23388	99	84	81	cyclictest	0	-21	swapper/1	04:56:58	1
23390	99	83	82	cyclictest	0	-21	swapper/3	08:52:34	3
23390	99	83	82	cyclictest	0	-21	swapper/3	08:38:50	3
23390	99	83	82	cyclictest	0	-21	swapper/3	08:33:47	3
23390	99	83	82	cyclictest	0	-21	swapper/3	08:28:50	3
23390	99	83	82	cyclictest	0	-21	swapper/3	08:08:53	3
23390	99	83	82	cyclictest	0	-21	swapper/3	08:03:54	3
23390	99	83	82	cyclictest	0	-21	swapper/3	07:58:52	3
23390	99	83	82	cyclictest	0	-21	swapper/3	07:52:24	3
23390	99	83	82	cyclictest	0	-21	swapper/3	07:37:23	3
23390	99	83	82	cyclictest	0	-21	swapper/3	07:28:50	3
23390	99	83	82	cyclictest	0	-21	swapper/3	07:18:54	3
23390	99	83	82	cyclictest	0	-21	swapper/3	07:12:19	3
23390	99	83	82	cyclictest	0	-21	swapper/3	07:03:53	3
23390	99	83	82	cyclictest	0	-21	swapper/3	06:57:18	3
23390	99	83	82	cyclictest	0	-21	swapper/3	06:47:16	3
23390	99	83	82	cyclictest	0	-21	swapper/3	06:13:56	3
23390	99	83	82	cyclictest	0	-21	swapper/3	06:07:09	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:48:56	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:43:53	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:38:57	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:37:05	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:27:03	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:18:57	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:13:59	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:12:00	3
23390	99	83	82	cyclictest	0	-21	swapper/3	05:03:59	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:54:00	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:43:57	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:39:00	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:39:00	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:33:54	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:24:01	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:14:02	3
23390	99	83	82	cyclictest	0	-21	swapper/3	04:01:50	3
23390	99	83	82	cyclictest	0	-21	swapper/3	03:56:50	3
23390	99	83	82	cyclictest	0	-21	swapper/3	03:46:48	3
23390	99	83	82	cyclictest	0	-21	swapper/3	03:39:04	3
23390	99	83	82	cyclictest	0	-21	swapper/3	03:34:03	3
23388	99	83	82	cyclictest	0	-21	swapper/1	08:43:50	1
23388	99	83	82	cyclictest	0	-21	swapper/1	08:42:32	1
23388	99	83	82	cyclictest	0	-21	swapper/1	08:33:51	1
23388	99	83	82	cyclictest	0	-21	swapper/1	08:08:51	1
23388	99	83	82	cyclictest	0	-21	swapper/1	07:53:51	1
23388	99	83	82	cyclictest	0	-21	swapper/1	07:48:52	1
23388	99	83	82	cyclictest	0	-21	swapper/1	07:13:53	1
23388	99	83	82	cyclictest	0	-21	swapper/1	07:08:55	1
23388	99	83	82	cyclictest	0	-21	swapper/1	06:53:54	1
23388	99	83	82	cyclictest	0	-21	swapper/1	06:52:17	1
23388	99	83	82	cyclictest	0	-21	swapper/1	06:43:55	1
23388	99	83	82	cyclictest	0	-21	swapper/1	06:38:35	1
23388	99	83	82	cyclictest	0	-21	swapper/1	05:48:52	1
23388	99	83	82	cyclictest	0	-21	swapper/1	04:43:59	1
23388	99	83	82	cyclictest	0	-21	swapper/1	04:33:57	1
23388	99	83	82	cyclictest	0	-21	swapper/1	04:29:02	1
23388	99	83	82	cyclictest	0	-21	swapper/1	03:51:49	1
23388	99	83	82	cyclictest	0	-21	swapper/1	03:28:55	1
23388	99	83	81	cyclictest	6835	-21	tune2fs	04:03:56	1
23388	99	83	81	cyclictest	472	-21	tune2fs	07:33:48	1
23388	99	83	81	cyclictest	4287	-21	aten2.4-expect	05:13:49	1
23388	99	83	81	cyclictest	28574	-21	tune2fs	07:23:47	1
23388	99	83	81	cyclictest	28452	-21	tune2fs	03:38:57	1
23388	99	83	81	cyclictest	2799	-21	tune2fs	06:23:49	1
23388	99	83	81	cyclictest	26124	-21	tune2fs	04:48:53	1
23388	99	83	81	cyclictest	23769	-21	aten2.4-expect	05:58:47	1
23388	99	83	81	cyclictest	21402	-21	aten2.4-expect	04:38:50	1
23388	99	83	81	cyclictest	21402	-21	aten2.4-expect	04:38:50	1
23388	99	83	81	cyclictest	13543	-21	tune2fs	08:03:47	1
23388	99	83	81	cyclictest	12844	-21	aten2.4-expect	04:18:51	1
23390	99	82	81	cyclictest	0	-21	swapper/3	08:53:42	3
23390	99	82	81	cyclictest	0	-21	swapper/3	08:23:45	3
23390	99	82	81	cyclictest	0	-21	swapper/3	07:53:45	3
23390	99	82	81	cyclictest	0	-21	swapper/3	06:28:49	3
23390	99	82	81	cyclictest	0	-21	swapper/3	04:58:52	3
23390	99	82	81	cyclictest	0	-21	swapper/3	04:28:59	3
23390	99	75	72	cyclictest	0	-21	swapper/3	08:17:12	3
23388	99	75	62	cyclictest	0	-21	swapper/1	04:26:02	1
23390	99	73	72	cyclictest	0	-21	swapper/3	08:45:11	3
23390	99	73	72	cyclictest	0	-21	swapper/3	07:43:52	3
23390	99	73	72	cyclictest	0	-21	swapper/3	07:40:53	3
23390	99	73	72	cyclictest	0	-21	swapper/3	07:17:20	3
23390	99	73	72	cyclictest	0	-21	swapper/3	06:08:49	3
23390	99	73	72	cyclictest	0	-21	swapper/3	04:13:39	3
23390	99	73	72	cyclictest	0	-21	swapper/3	04:03:55	3
23388	99	73	72	cyclictest	0	-21	swapper/1	08:21:27	1
23388	99	73	72	cyclictest	0	-21	swapper/1	08:13:40	1
23388	99	73	72	cyclictest	0	-21	swapper/1	07:58:48	1
23388	99	73	72	cyclictest	0	-21	swapper/1	07:03:52	1
23388	99	73	72	cyclictest	0	-21	swapper/1	06:13:48	1
23388	99	73	72	cyclictest	0	-21	swapper/1	05:38:49	1
23388	99	73	72	cyclictest	0	-21	swapper/1	05:33:55	1
23388	99	73	72	cyclictest	0	-21	swapper/1	05:08:49	1
23388	99	73	72	cyclictest	0	-21	swapper/1	05:03:45	1
23388	99	73	72	cyclictest	0	-21	swapper/1	04:58:51	1
23388	99	73	72	cyclictest	0	-21	swapper/1	03:58:53	1
23388	99	73	72	cyclictest	0	-21	swapper/1	03:33:54	1
23388	99	73	71	cyclictest	2375	-21	aten2.4-expect	08:53:39	1
23388	99	73	71	cyclictest	1907	-21	aten2.4-expect	03:53:52	1
23390	99	72	71	cyclictest	0	-21	swapper/3	07:27:21	3
23390	99	72	71	cyclictest	0	-21	swapper/3	04:48:53	3
23390	99	71	70	cyclictest	0	-21	swapper/3	05:33:18	3
23390	99	70	69	cyclictest	0	-21	swapper/3	06:38:57	3
23388	99	67	61	cyclictest	0	-21	swapper/1	07:18:45	1
23390	99	66	65	cyclictest	0	-21	swapper/3	04:20:31	3
23390	99	66	64	cyclictest	1	-21	init	07:03:27	3
23390	99	63	62	cyclictest	0	-21	swapper/3	06:48:45	3
23390	99	63	62	cyclictest	0	-21	swapper/3	06:33:48	3
23390	99	63	62	cyclictest	0	-21	swapper/3	06:18:46	3
23390	99	63	62	cyclictest	0	-21	swapper/3	05:58:46	3
23390	99	63	62	cyclictest	0	-21	swapper/3	03:48:54	3
23390	99	63	62	cyclictest	0	-21	swapper/3	03:28:53	3
23390	99	63	61	cyclictest	19686	-21	aten2.4-expect	08:18:43	3
23387	99	63	62	cyclictest	0	-21	swapper/0	08:38:40	0
23387	99	62	61	cyclictest	0	-21	swapper/0	07:02:45	0
23387	99	62	61	cyclictest	0	-21	swapper/0	06:43:46	0
23387	99	61	41	cyclictest	0	-21	swapper/0	08:22:39	0
23389	99	60	43	cyclictest	0	-21	swapper/2	05:44:35	2
23389	99	60	42	cyclictest	278	-21	usb-storage	07:47:55	2
23389	99	60	41	cyclictest	0	-21	swapper/2	06:37:28	2
23389	99	59	41	cyclictest	0	-21	swapper/2	05:23:28	2
23389	99	59	41	cyclictest	0	-21	swapper/2	05:15:15	2
23387	99	59	58	cyclictest	0	-21	swapper/0	06:27:58	0
23389	99	58	51	cyclictest	0	-21	swapper/2	05:58:47	2
23389	99	58	51	cyclictest	0	-21	swapper/2	04:22:59	2
23389	99	58	41	cyclictest	50	50	irq/44-ahci	04:23:44	2
23389	99	58	41	cyclictest	278	-21	usb-storage	04:10:21	2
23389	99	58	41	cyclictest	278	-21	usb-storage	03:55:24	2
23389	99	58	41	cyclictest	0	-21	swapper/2	08:57:46	2
23389	99	58	41	cyclictest	0	-21	swapper/2	08:38:19	2
23389	99	58	41	cyclictest	0	-21	swapper/2	08:13:50	2
23389	99	58	41	cyclictest	0	-21	swapper/2	06:59:17	2
23389	99	58	41	cyclictest	0	-21	swapper/2	06:39:49	2
23389	99	58	41	cyclictest	0	-21	swapper/2	05:41:48	2
23389	99	58	41	cyclictest	0	-21	swapper/2	05:28:36	2
23389	99	58	41	cyclictest	0	-21	swapper/2	04:58:50	2
23387	99	58	51	cyclictest	0	-21	swapper/0	08:01:42	0
23387	99	58	41	cyclictest	0	-21	swapper/0	08:11:14	0
23387	99	58	41	cyclictest	0	-21	swapper/0	06:13:54	0
23389	99	57	51	cyclictest	0	-21	swapper/2	03:53:36	2
23389	99	57	41	cyclictest	278	-21	usb-storage	05:09:55	2
23389	99	57	41	cyclictest	0	-21	swapper/2	08:53:04	2
23389	99	57	41	cyclictest	0	-21	swapper/2	08:43:43	2
23389	99	57	41	cyclictest	0	-21	swapper/2	08:27:33	2
23389	99	57	41	cyclictest	0	-21	swapper/2	08:20:54	2
23389	99	57	41	cyclictest	0	-21	swapper/2	07:59:48	2
23389	99	57	41	cyclictest	0	-21	swapper/2	07:52:59	2
23389	99	57	41	cyclictest	0	-21	swapper/2	07:23:22	2
23389	99	57	41	cyclictest	0	-21	swapper/2	07:14:10	2
23389	99	57	41	cyclictest	0	-21	swapper/2	07:10:00	2
23389	99	57	41	cyclictest	0	-21	swapper/2	07:07:52	2
23389	99	57	41	cyclictest	0	-21	swapper/2	06:30:42	2
23389	99	57	41	cyclictest	0	-21	swapper/2	06:24:20	2
23389	99	57	41	cyclictest	0	-21	swapper/2	06:05:11	2
23389	99	57	41	cyclictest	0	-21	swapper/2	05:53:45	2
23389	99	57	41	cyclictest	0	-21	swapper/2	05:49:20	2
23389	99	57	41	cyclictest	0	-21	swapper/2	05:36:16	2
23389	99	57	41	cyclictest	0	-21	swapper/2	05:28:50	2
23389	99	57	41	cyclictest	0	-21	swapper/2	05:05:49	2
23389	99	57	41	cyclictest	0	-21	swapper/2	04:45:46	2
23389	99	57	41	cyclictest	0	-21	swapper/2	04:15:57	2
23389	99	57	41	cyclictest	0	-21	swapper/2	04:05:49	2
23389	99	57	41	cyclictest	0	-21	swapper/2	03:35:32	2
23387	99	57	51	cyclictest	0	-21	swapper/0	06:57:15	0
23389	99	56	51	cyclictest	0	-21	swapper/2	07:29:03	2
23389	99	56	50	cyclictest	0	-21	swapper/2	06:47:16	2
23389	99	56	50	cyclictest	0	-21	swapper/2	03:29:23	2
23387	99	56	49	cyclictest	0	-21	swapper/0	04:19:35	0
23387	99	56	41	cyclictest	0	-21	swapper/0	07:29:03	0
23389	99	55	50	cyclictest	0	-21	swapper/2	04:48:50	2
23389	99	55	42	cyclictest	50	50	irq/44-ahci	06:12:16	2
23387	99	55	48	cyclictest	0	-21	swapper/0	05:38:12	0
23389	99	54	53	cyclictest	0	-21	swapper/2	07:54:08	2
23387	99	54	53	cyclictest	0	-21	swapper/0	06:20:02	0
23387	99	54	47	cyclictest	0	-21	swapper/0	03:54:40	0
23389	99	53	47	cyclictest	0	-21	swapper/2	08:07:27	2
23389	99	53	41	cyclictest	0	-21	swapper/2	08:28:51	2
23389	99	53	41	cyclictest	0	-21	swapper/2	06:53:43	2
23389	99	53	41	cyclictest	0	-21	swapper/2	06:48:35	2
23389	99	53	41	cyclictest	0	-21	swapper/2	06:19:16	2
23389	99	53	41	cyclictest	0	-21	swapper/2	06:13:40	2
23389	99	53	41	cyclictest	0	-21	swapper/2	04:41:40	2
23389	99	53	41	cyclictest	0	-21	swapper/2	04:41:40	2
23389	99	53	41	cyclictest	0	-21	swapper/2	04:37:18	2
23389	99	53	41	cyclictest	0	-21	swapper/2	03:48:38	2
23387	99	53	52	cyclictest	760	50	irq/18-parport0	08:43:57	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	07:54:47	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	07:39:03	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	07:18:58	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	07:12:00	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	06:33:48	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	06:09:58	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	06:01:25	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	05:45:53	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	05:30:56	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	05:17:20	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	05:09:57	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	05:07:07	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	05:01:37	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	04:56:35	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	04:40:20	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	04:40:20	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	04:38:18	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	04:28:42	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	04:10:53	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	04:06:01	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	03:59:09	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	03:53:06	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	03:39:36	0
23387	99	53	52	cyclictest	760	50	irq/18-parport0	03:33:44	0
23387	99	53	52	cyclictest	0	-21	swapper/0	08:37:35	0
23387	99	53	52	cyclictest	0	-21	swapper/0	07:48:43	0
23387	99	53	52	cyclictest	0	-21	swapper/0	07:23:45	0
23387	99	53	52	cyclictest	0	-21	swapper/0	06:48:46	0
23387	99	53	52	cyclictest	0	-21	swapper/0	06:41:23	0
23387	99	53	52	cyclictest	0	-21	swapper/0	05:48:48	0
23387	99	53	52	cyclictest	0	-21	swapper/0	05:42:08	0
23387	99	53	52	cyclictest	0	-21	swapper/0	05:18:49	0
23387	99	53	52	cyclictest	0	-21	swapper/0	04:23:51	0
23387	99	53	52	cyclictest	0	-21	swapper/0	03:44:36	0
23387	99	53	51	cyclictest	50	50	irq/44-ahci	03:31:28	0
23387	99	53	51	cyclictest	21580	-21	telnet	05:53:48	0
23387	99	53	48	cyclictest	0	-21	swapper/0	08:53:57	0
23387	99	53	46	cyclictest	0	-21	swapper/0	06:07:37	0
23387	99	53	41	cyclictest	0	-21	swapper/0	08:06:20	0
23389	99	52	51	cyclictest	0	-21	swapper/2	03:59:33	2
23389	99	52	47	cyclictest	0	-21	swapper/2	07:36:19	2
23389	99	52	44	cyclictest	29606	-21	sensors_fan	08:38:50	2
23389	99	52	41	cyclictest	0	-21	swapper/2	04:28:59	2
23387	99	52	51	cyclictest	760	50	irq/18-parport0	05:24:56	0
23387	99	52	51	cyclictest	760	50	irq/18-parport0	04:16:09	0
23387	99	52	51	cyclictest	1876	-21	hald-addon-stor	07:13:58	0
23387	99	52	51	cyclictest	0	-21	swapper/0	08:48:43	0
23387	99	52	51	cyclictest	0	-21	swapper/0	08:29:11	0
23387	99	52	51	cyclictest	0	-21	swapper/0	08:23:39	0
23387	99	52	51	cyclictest	0	-21	swapper/0	08:14:10	0
23387	99	52	51	cyclictest	0	-21	swapper/0	07:43:43	0
23387	99	52	51	cyclictest	0	-21	swapper/0	07:36:31	0
23387	99	52	51	cyclictest	0	-21	swapper/0	07:03:38	0
23387	99	52	51	cyclictest	0	-21	swapper/0	06:28:45	0
23387	99	52	51	cyclictest	0	-21	swapper/0	04:49:10	0
23387	99	52	51	cyclictest	0	-21	swapper/0	04:44:20	0
23389	99	51	50	cyclictest	0	-21	swapper/2	04:57:43	2
23389	99	51	50	cyclictest	0	-21	swapper/2	03:42:52	2
23389	99	51	46	cyclictest	0	-21	swapper/2	08:11:06	2
23389	99	51	46	cyclictest	0	-21	swapper/2	07:25:40	2
23389	99	50	48	cyclictest	0	-21	swapper/2	07:39:42	2
7	99	11	0	migration/0	21942	-21	fschecks_time	03:23:54	0
18	1	11	0	ksoftirqd/2	0	-21	swapper/2	03:28:24	2
10	99	11	0	migration/1	21722	-21	fschecks_count	03:23:54	1
23	1	4	0	ksoftirqd/3	22773	-21	munin-node	03:24:02	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17