OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Thu Jun 18, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
5911	99	104	92	cyclictest	13244	-21	tune2fs	08:28:32	1
5913	99	93	92	cyclictest	0	-21	swapper/3	06:08:24	3
5913	99	93	92	cyclictest	0	-21	swapper/3	05:43:41	3
5911	99	92	90	cyclictest	357	-21	tune2fs	09:13:29	1
5913	99	84	72	cyclictest	0	-21	swapper/3	06:23:43	3
5911	99	84	72	cyclictest	0	-21	swapper/1	06:53:22	1
5911	99	84	71	cyclictest	10400	-21	aten2.4-expect	04:38:38	1
5913	99	83	82	cyclictest	0	-21	swapper/3	09:53:26	3
5913	99	83	82	cyclictest	0	-21	swapper/3	09:23:31	3
5913	99	83	82	cyclictest	0	-21	swapper/3	09:13:29	3
5913	99	83	82	cyclictest	0	-21	swapper/3	09:08:39	3
5913	99	83	82	cyclictest	0	-21	swapper/3	08:48:32	3
5913	99	83	82	cyclictest	0	-21	swapper/3	08:48:32	3
5913	99	83	82	cyclictest	0	-21	swapper/3	08:11:26	3
5913	99	83	82	cyclictest	0	-21	swapper/3	08:03:37	3
5913	99	83	82	cyclictest	0	-21	swapper/3	07:53:40	3
5913	99	83	82	cyclictest	0	-21	swapper/3	07:38:33	3
5913	99	83	82	cyclictest	0	-21	swapper/3	07:38:21	3
5913	99	83	82	cyclictest	0	-21	swapper/3	07:18:39	3
5913	99	83	82	cyclictest	0	-21	swapper/3	07:06:18	3
5913	99	83	82	cyclictest	0	-21	swapper/3	06:58:43	3
5913	99	83	82	cyclictest	0	-21	swapper/3	06:43:23	3
5913	99	83	82	cyclictest	0	-21	swapper/3	06:08:46	3
5913	99	83	82	cyclictest	0	-21	swapper/3	05:33:25	3
5913	99	83	82	cyclictest	0	-21	swapper/3	05:00:58	3
5913	99	83	82	cyclictest	0	-21	swapper/3	04:53:44	3
5913	99	83	71	cyclictest	0	-21	swapper/3	09:41:39	3
5913	99	83	71	cyclictest	0	-21	swapper/3	07:16:19	3
5913	99	83	71	cyclictest	0	-21	swapper/3	04:40:55	3
5911	99	83	82	cyclictest	0	-21	swapper/1	09:53:26	1
5911	99	83	82	cyclictest	0	-21	swapper/1	09:41:39	1
5911	99	83	82	cyclictest	0	-21	swapper/1	09:23:31	1
5911	99	83	82	cyclictest	0	-21	swapper/1	09:08:39	1
5911	99	83	82	cyclictest	0	-21	swapper/1	08:43:40	1
5911	99	83	82	cyclictest	0	-21	swapper/1	08:16:27	1
5911	99	83	82	cyclictest	0	-21	swapper/1	08:11:26	1
5911	99	83	82	cyclictest	0	-21	swapper/1	08:03:37	1
5911	99	83	82	cyclictest	0	-21	swapper/1	07:58:37	1
5911	99	83	82	cyclictest	0	-21	swapper/1	07:53:40	1
5911	99	83	82	cyclictest	0	-21	swapper/1	07:38:33	1
5911	99	83	82	cyclictest	0	-21	swapper/1	07:38:21	1
5911	99	83	82	cyclictest	0	-21	swapper/1	07:28:21	1
5911	99	83	82	cyclictest	0	-21	swapper/1	07:18:39	1
5911	99	83	82	cyclictest	0	-21	swapper/1	07:06:18	1
5911	99	83	82	cyclictest	0	-21	swapper/1	06:58:43	1
5911	99	83	82	cyclictest	0	-21	swapper/1	06:43:23	1
5911	99	83	82	cyclictest	0	-21	swapper/1	06:31:13	1
5911	99	83	82	cyclictest	0	-21	swapper/1	06:23:43	1
5911	99	83	82	cyclictest	0	-21	swapper/1	06:03:44	1
5911	99	83	82	cyclictest	0	-21	swapper/1	05:53:44	1
5911	99	83	82	cyclictest	0	-21	swapper/1	05:46:06	1
5911	99	83	82	cyclictest	0	-21	swapper/1	05:41:05	1
5911	99	83	82	cyclictest	0	-21	swapper/1	05:33:25	1
5911	99	83	82	cyclictest	0	-21	swapper/1	05:20:43	1
5911	99	83	82	cyclictest	0	-21	swapper/1	05:16:01	1
5911	99	83	82	cyclictest	0	-21	swapper/1	05:08:48	1
5911	99	83	82	cyclictest	0	-21	swapper/1	04:53:44	1
5911	99	83	81	cyclictest	6382	-21	tune2fs	04:28:40	1
5911	99	83	81	cyclictest	32670	-21	tune2fs	06:43:36	1
5911	99	83	81	cyclictest	28566	-21	tune2fs	09:03:31	1
5911	99	83	81	cyclictest	21718	-21	tune2fs	06:18:36	1
5911	99	83	81	cyclictest	19850	-21	tune2fs	07:28:35	1
5911	99	83	81	cyclictest	17506	-21	tune2fs	06:08:37	1
5911	99	83	81	cyclictest	15616	-21	tune2fs	09:48:29	1
5911	99	83	81	cyclictest	15392	-21	tune2fs	08:33:31	1
5911	99	83	81	cyclictest	13119	-21	tune2fs	07:13:36	1
5911	99	83	71	cyclictest	22017	-21	tune2fs	08:48:32	1
5911	99	83	71	cyclictest	22017	-21	tune2fs	08:48:32	1
5911	99	83	71	cyclictest	18992	-21	aten2.4-expect	04:58:38	1
5913	99	82	81	cyclictest	4075	-21	aten2.4_r3power	06:53:33	3
5913	99	82	81	cyclictest	0	-21	swapper/3	09:03:31	3
5913	99	82	81	cyclictest	0	-21	swapper/3	06:18:36	3
5913	99	82	81	cyclictest	0	-21	swapper/3	04:33:39	3
5913	99	82	71	cyclictest	0	-21	swapper/3	08:16:27	3
5911	99	82	81	cyclictest	0	-21	swapper/1	04:43:52	1
5911	99	74	72	cyclictest	0	-21	swapper/1	05:03:37	1
5913	99	73	72	cyclictest	0	-21	swapper/3	09:48:29	3
5913	99	73	72	cyclictest	0	-21	swapper/3	08:18:30	3
5913	99	73	72	cyclictest	0	-21	swapper/3	07:58:37	3
5913	99	73	72	cyclictest	0	-21	swapper/3	07:48:20	3
5913	99	73	72	cyclictest	0	-21	swapper/3	06:43:36	3
5913	99	73	72	cyclictest	0	-21	swapper/3	05:20:43	3
5913	99	73	72	cyclictest	0	-21	swapper/3	04:48:47	3
5913	99	73	72	cyclictest	0	-21	swapper/3	04:48:47	3
5913	99	73	72	cyclictest	0	-21	swapper/3	04:43:40	3
5911	99	73	72	cyclictest	0	-21	swapper/1	08:18:30	1
5911	99	73	72	cyclictest	0	-21	swapper/1	07:48:31	1
5911	99	73	72	cyclictest	0	-21	swapper/1	07:43:41	1
5911	99	73	72	cyclictest	0	-21	swapper/1	07:08:33	1
5911	99	73	72	cyclictest	0	-21	swapper/1	06:33:38	1
5911	99	73	72	cyclictest	0	-21	swapper/1	05:58:36	1
5911	99	73	72	cyclictest	0	-21	swapper/1	05:33:41	1
5913	99	72	71	cyclictest	0	-21	swapper/3	08:53:35	3
5913	99	72	71	cyclictest	0	-21	swapper/3	08:43:40	3
5913	99	72	71	cyclictest	0	-21	swapper/3	08:33:31	3
5913	99	72	71	cyclictest	0	-21	swapper/3	07:28:35	3
5913	99	72	71	cyclictest	0	-21	swapper/3	07:28:21	3
5913	99	72	71	cyclictest	0	-21	swapper/3	06:31:13	3
5913	99	72	71	cyclictest	0	-21	swapper/3	05:53:44	3
5913	99	72	71	cyclictest	0	-21	swapper/3	05:16:01	3
5913	99	72	71	cyclictest	0	-21	swapper/3	04:28:40	3
5913	99	72	61	cyclictest	0	-21	swapper/3	05:38:35	3
5911	99	72	71	cyclictest	0	-21	swapper/1	09:36:56	1
5911	99	72	71	cyclictest	0	-21	swapper/1	09:28:59	1
5911	99	72	71	cyclictest	0	-21	swapper/1	04:48:47	1
5911	99	72	71	cyclictest	0	-21	swapper/1	04:48:47	1
5911	99	70	69	cyclictest	2527	-21	crond	05:48:25	1
5913	99	69	68	cyclictest	1384	-13	audispd	06:53:22	3
5913	99	67	65	cyclictest	1	-21	init	06:37:28	3
5911	99	67	62	cyclictest	0	-21	swapper/1	09:18:35	1
5913	99	66	65	cyclictest	0	-21	swapper/3	09:02:05	3
5913	99	66	62	cyclictest	0	-21	swapper/3	05:13:26	3
5911	99	66	62	cyclictest	0	-21	swapper/1	09:43:30	1
5911	99	66	62	cyclictest	0	-21	swapper/1	09:01:33	1
5911	99	66	62	cyclictest	0	-21	swapper/1	08:23:33	1
5911	99	66	61	cyclictest	24124	-21	tune2fs	08:53:32	1
5913	99	65	64	cyclictest	0	-21	swapper/3	05:35:28	3
5913	99	65	62	cyclictest	0	-21	swapper/3	09:21:52	3
5913	99	65	62	cyclictest	0	-21	swapper/3	07:51:23	3
5913	99	65	61	cyclictest	0	-21	swapper/3	07:08:33	3
5913	99	64	63	cyclictest	0	-21	swapper/3	09:33:22	3
5913	99	64	62	cyclictest	0	-21	swapper/3	06:18:23	3
5911	99	64	62	cyclictest	0	-21	swapper/1	06:16:10	1
5913	99	63	62	cyclictest	0	-21	swapper/3	09:43:29	3
5913	99	63	62	cyclictest	0	-21	swapper/3	09:28:28	3
5913	99	63	62	cyclictest	0	-21	swapper/3	08:38:28	3
5913	99	63	62	cyclictest	0	-21	swapper/3	08:28:29	3
5913	99	63	62	cyclictest	0	-21	swapper/3	08:23:28	3
5913	99	63	62	cyclictest	0	-21	swapper/3	05:58:35	3
5913	99	63	62	cyclictest	0	-21	swapper/3	05:48:25	3
5913	99	63	62	cyclictest	0	-21	swapper/3	05:23:37	3
5913	99	63	62	cyclictest	0	-21	swapper/3	05:23:37	3
5913	99	63	62	cyclictest	0	-21	swapper/3	05:03:38	3
5911	99	63	62	cyclictest	0	-21	swapper/1	08:38:27	1
5911	99	63	62	cyclictest	0	-21	swapper/1	06:53:27	1
5911	99	63	62	cyclictest	0	-21	swapper/1	05:23:36	1
5911	99	63	62	cyclictest	0	-21	swapper/1	05:23:36	1
5911	99	63	62	cyclictest	0	-21	swapper/1	04:33:34	1
5912	99	62	61	cyclictest	0	-21	swapper/2	09:53:25	2
5910	99	62	61	cyclictest	0	-21	swapper/0	04:28:28	0
5912	99	61	60	cyclictest	0	-21	swapper/2	07:38:31	2
5912	99	59	58	cyclictest	0	-21	swapper/2	07:18:32	2
5910	99	59	41	cyclictest	0	-21	swapper/0	06:20:45	0
5912	99	57	51	cyclictest	0	-21	swapper/2	09:25:20	2
5912	99	54	53	cyclictest	0	-21	swapper/2	07:28:32	2
5912	99	54	52	cyclictest	3830	-21	latency_hist	05:38:25	2
5910	99	54	41	cyclictest	0	-21	swapper/0	06:23:37	0
5912	99	53	52	cyclictest	0	-21	swapper/2	08:58:53	2
5912	99	53	52	cyclictest	0	-21	swapper/2	08:53:30	2
5912	99	53	52	cyclictest	0	-21	swapper/2	08:39:14	2
5912	99	53	52	cyclictest	0	-21	swapper/2	08:23:30	2
5912	99	53	52	cyclictest	0	-21	swapper/2	07:53:53	2
5912	99	53	52	cyclictest	0	-21	swapper/2	07:26:54	2
5912	99	53	52	cyclictest	0	-21	swapper/2	07:13:51	2
5912	99	53	52	cyclictest	0	-21	swapper/2	07:05:53	2
5912	99	53	52	cyclictest	0	-21	swapper/2	06:38:35	2
5912	99	53	52	cyclictest	0	-21	swapper/2	06:19:35	2
5912	99	53	52	cyclictest	0	-21	swapper/2	06:18:17	2
5912	99	53	52	cyclictest	0	-21	swapper/2	05:46:00	2
5912	99	53	52	cyclictest	0	-21	swapper/2	05:32:21	2
5912	99	53	52	cyclictest	0	-21	swapper/2	05:18:37	2
5912	99	53	52	cyclictest	0	-21	swapper/2	05:08:39	2
5912	99	53	52	cyclictest	0	-21	swapper/2	05:03:37	2
5912	99	53	52	cyclictest	0	-21	swapper/2	04:55:58	2
5912	99	53	52	cyclictest	0	-21	swapper/2	04:44:57	2
5912	99	53	41	cyclictest	278	-21	usb-storage	07:11:13	2
5912	99	53	41	cyclictest	0	-21	swapper/2	09:33:20	2
5912	99	53	41	cyclictest	0	-21	swapper/2	08:05:57	2
5912	99	53	41	cyclictest	0	-21	swapper/2	06:59:33	2
5912	99	53	41	cyclictest	0	-21	swapper/2	05:51:26	2
5912	99	53	41	cyclictest	0	-21	swapper/2	04:35:13	2
5912	99	53	41	cyclictest	0	-21	swapper/2	04:29:53	2
5910	99	53	52	cyclictest	0	-21	swapper/0	09:02:06	0
5910	99	53	52	cyclictest	0	-21	swapper/0	08:11:38	0
5910	99	53	52	cyclictest	0	-21	swapper/0	06:58:33	0
5910	99	53	52	cyclictest	0	-21	swapper/0	06:28:34	0
5910	99	53	52	cyclictest	0	-21	swapper/0	06:03:35	0
5910	99	53	52	cyclictest	0	-21	swapper/0	05:28:37	0
5910	99	53	51	cyclictest	23666	-21	telnet	08:53:30	0
5910	99	53	41	cyclictest	0	-21	swapper/0	06:36:44	0
5910	99	53	31	cyclictest	0	-21	swapper/0	05:50:04	0
5912	99	52	51	cyclictest	50	50	irq/44-ahci	07:33:58	2
5912	99	52	51	cyclictest	278	-21	usb-storage	09:16:14	2
5912	99	52	51	cyclictest	0	-21	swapper/2	09:49:05	2
5912	99	52	51	cyclictest	0	-21	swapper/2	09:43:43	2
5912	99	52	51	cyclictest	0	-21	swapper/2	09:40:15	2
5912	99	52	51	cyclictest	0	-21	swapper/2	09:32:52	2
5912	99	52	51	cyclictest	0	-21	swapper/2	09:18:44	2
5912	99	52	51	cyclictest	0	-21	swapper/2	09:12:36	2
5912	99	52	51	cyclictest	0	-21	swapper/2	09:04:55	2
5912	99	52	51	cyclictest	0	-21	swapper/2	08:43:48	2
5912	99	52	51	cyclictest	0	-21	swapper/2	08:35:28	2
5912	99	52	51	cyclictest	0	-21	swapper/2	08:29:10	2
5912	99	52	51	cyclictest	0	-21	swapper/2	08:22:40	2
5912	99	52	51	cyclictest	0	-21	swapper/2	08:15:47	2
5912	99	52	51	cyclictest	0	-21	swapper/2	08:08:39	2
5912	99	52	51	cyclictest	0	-21	swapper/2	07:48:32	2
5912	99	52	51	cyclictest	0	-21	swapper/2	07:43:46	2
5912	99	52	51	cyclictest	0	-21	swapper/2	06:53:24	2
5912	99	52	51	cyclictest	0	-21	swapper/2	06:49:06	2
5912	99	52	51	cyclictest	0	-21	swapper/2	06:34:30	2
5912	99	52	51	cyclictest	0	-21	swapper/2	06:30:11	2
5912	99	52	51	cyclictest	0	-21	swapper/2	06:10:03	2
5912	99	52	51	cyclictest	0	-21	swapper/2	06:04:04	2
5912	99	52	51	cyclictest	0	-21	swapper/2	06:01:24	2
5912	99	52	51	cyclictest	0	-21	swapper/2	05:38:35	2
5912	99	52	51	cyclictest	0	-21	swapper/2	05:24:11	2
5912	99	52	51	cyclictest	0	-21	swapper/2	05:24:11	2
5912	99	52	51	cyclictest	0	-21	swapper/2	05:14:45	2
5912	99	52	51	cyclictest	0	-21	swapper/2	04:59:46	2
5912	99	52	51	cyclictest	0	-21	swapper/2	04:38:51	2
5912	99	52	41	cyclictest	0	-21	swapper/2	08:52:45	2
5912	99	52	41	cyclictest	0	-21	swapper/2	08:52:45	2
5912	99	52	41	cyclictest	0	-21	swapper/2	08:01:21	2
5912	99	52	41	cyclictest	0	-21	swapper/2	06:45:14	2
5912	99	52	41	cyclictest	0	-21	swapper/2	05:53:38	2
5910	99	52	51	cyclictest	6087	-21	telnet	05:43:36	0
5910	99	52	51	cyclictest	0	-21	swapper/0	09:50:27	0
5910	99	52	51	cyclictest	0	-21	swapper/0	09:41:27	0
5910	99	52	51	cyclictest	0	-21	swapper/0	08:44:37	0
5910	99	52	51	cyclictest	0	-21	swapper/0	08:26:28	0
5910	99	52	51	cyclictest	0	-21	swapper/0	07:38:25	0
5910	99	52	51	cyclictest	0	-21	swapper/0	07:33:31	0
5910	99	52	51	cyclictest	0	-21	swapper/0	07:31:14	0
5910	99	52	51	cyclictest	0	-21	swapper/0	07:05:54	0
5910	99	52	51	cyclictest	0	-21	swapper/0	06:38:35	0
5910	99	52	51	cyclictest	0	-21	swapper/0	05:38:40	0
5910	99	52	51	cyclictest	0	-21	swapper/0	05:33:35	0
5910	99	52	51	cyclictest	0	-21	swapper/0	05:18:47	0
5910	99	52	51	cyclictest	0	-21	swapper/0	05:16:55	0
5910	99	52	51	cyclictest	0	-21	swapper/0	04:58:38	0
5910	99	52	51	cyclictest	0	-21	swapper/0	04:39:09	0
5910	99	52	41	cyclictest	0	-21	swapper/0	08:36:32	0
5910	99	52	41	cyclictest	0	-21	swapper/0	07:08:33	0
5910	99	52	41	cyclictest	0	-21	swapper/0	05:08:50	0
5910	99	51	50	cyclictest	0	-21	swapper/0	09:23:50	0
5910	99	51	50	cyclictest	0	-21	swapper/0	07:23:33	0
5910	99	51	50	cyclictest	0	-21	swapper/0	06:53:33	0
5910	99	51	50	cyclictest	0	-21	swapper/0	05:23:36	0
5910	99	51	50	cyclictest	0	-21	swapper/0	05:23:36	0
5910	99	51	50	cyclictest	0	-21	swapper/0	04:37:15	0
5910	99	51	41	cyclictest	0	-21	swapper/0	07:52:04	0
5912	99	50	49	cyclictest	0	-21	swapper/2	04:52:10	2
5912	99	50	49	cyclictest	0	-21	swapper/2	04:52:10	2
5910	99	50	49	cyclictest	0	-21	swapper/0	09:33:28	0
5910	99	50	49	cyclictest	0	-21	swapper/0	09:23:17	0
5910	99	50	49	cyclictest	0	-21	swapper/0	07:58:32	0
5910	99	50	49	cyclictest	0	-21	swapper/0	06:09:29	0
5910	99	50	41	cyclictest	0	-21	swapper/0	06:46:36	0
5910	99	49	48	cyclictest	16715	-21	kworker/0:0	07:44:27	0
5910	99	48	47	cyclictest	0	-21	swapper/0	09:05:44	0
5910	99	48	41	cyclictest	0	-21	swapper/0	09:28:42	0
5910	99	48	41	cyclictest	0	-21	swapper/0	09:17:14	0
5910	99	48	41	cyclictest	0	-21	swapper/0	09:12:24	0
5910	99	48	41	cyclictest	0	-21	swapper/0	08:51:07	0
5910	99	48	41	cyclictest	0	-21	swapper/0	08:51:07	0
5910	99	48	41	cyclictest	0	-21	swapper/0	08:39:00	0
5910	99	48	41	cyclictest	0	-21	swapper/0	08:32:40	0
5910	99	48	41	cyclictest	0	-21	swapper/0	08:14:17	0
5910	99	48	41	cyclictest	0	-21	swapper/0	08:07:09	0
5910	99	48	41	cyclictest	0	-21	swapper/0	06:16:39	0
5910	99	48	41	cyclictest	0	-21	swapper/0	04:48:42	0
5910	99	48	41	cyclictest	0	-21	swapper/0	04:48:42	0
5910	99	48	31	cyclictest	0	-21	swapper/0	05:54:28	0
5910	99	47	46	cyclictest	0	-21	swapper/0	09:53:21	0
5910	99	47	46	cyclictest	0	-21	swapper/0	07:18:33	0
5912	99	46	45	cyclictest	0	-21	swapper/2	06:25:32	2
5910	99	44	43	cyclictest	0	-21	swapper/0	04:58:26	0
5910	99	44	42	cyclictest	760	50	irq/18-parport0	05:08:08	0
5910	99	44	42	cyclictest	760	50	irq/18-parport0	04:46:21	0
5910	99	44	42	cyclictest	1876	-21	hald-addon-stor	08:22:14	0
5910	99	44	41	cyclictest	0	-21	swapper/0	07:53:31	0
5910	99	44	41	cyclictest	0	-21	swapper/0	07:13:37	0
5910	99	43	42	cyclictest	0	-21	swapper/0	09:43:40	0
5910	99	43	42	cyclictest	0	-21	swapper/0	05:58:37	0
5910	99	42	41	cyclictest	0	-21	swapper/0	06:48:24	0
7	99	11	0	migration/0	4400	-21	fschecks_time	04:23:41	0
23	1	10	0	ksoftirqd/3	0	-21	swapper/3	04:25:28	3
18	1	10	0	ksoftirqd/2	0	-21	swapper/2	04:25:28	2
12	1	5	0	ksoftirqd/1	4944	-21	ntpdc	04:23:46	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17