OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Tue Nov 25, 2025 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
744	99	121	92	cyclictest	8928	-21	tune2fs	01:06:52	1
747	99	113	112	cyclictest	0	-21	swapper/3	01:02:21	3
744	99	109	102	cyclictest	0	-21	swapper/1	21:32:01	1
744	99	104	102	cyclictest	2205	-21	tune2fs	23:36:56	1
747	99	103	102	cyclictest	0	-21	swapper/3	22:36:57	3
747	99	103	102	cyclictest	0	-21	swapper/3	02:06:51	3
747	99	103	102	cyclictest	0	-21	swapper/3	00:56:54	3
747	99	103	102	cyclictest	0	-21	swapper/3	00:04:25	3
744	99	103	102	cyclictest	0	-21	swapper/1	01:02:21	1
744	99	98	93	cyclictest	0	-21	swapper/1	23:16:56	1
747	99	93	92	cyclictest	0	-21	swapper/3	23:26:53	3
747	99	93	92	cyclictest	0	-21	swapper/3	23:26:53	3
747	99	93	92	cyclictest	0	-21	swapper/3	23:01:57	3
747	99	93	92	cyclictest	0	-21	swapper/3	22:15:46	3
747	99	93	92	cyclictest	0	-21	swapper/3	22:02:00	3
747	99	93	92	cyclictest	0	-21	swapper/3	02:19:38	3
744	99	90	82	cyclictest	17843	-21	tune2fs	01:26:50	1
744	99	89	82	cyclictest	30761	-21	tune2fs	01:56:52	1
744	99	88	81	cyclictest	25386	-21	tune2fs	22:02:00	1
744	99	88	81	cyclictest	19080	-21	tune2fs	23:01:57	1
744	99	88	81	cyclictest	16632	-21	tune2fs	21:41:58	1
744	99	87	82	cyclictest	12	1	ksoftirqd/1	22:25:43	1
744	99	87	82	cyclictest	0	-21	swapper/1	22:51:58	1
744	99	87	82	cyclictest	0	-21	swapper/1	21:21:46	1
744	99	87	82	cyclictest	0	-21	swapper/1	21:21:46	1
744	99	87	82	cyclictest	0	-21	swapper/1	00:45:45	1
744	99	87	82	cyclictest	0	-21	swapper/1	00:36:54	1
744	99	87	82	cyclictest	0	-21	swapper/1	00:32:03	1
744	99	87	81	cyclictest	23876	-21	tune2fs	00:26:55	1
744	99	87	81	cyclictest	19106	-21	aten2.4-expect	00:16:50	1
744	99	86	82	cyclictest	0	-21	swapper/1	23:26:53	1
744	99	86	82	cyclictest	0	-21	swapper/1	23:26:53	1
744	99	86	82	cyclictest	0	-21	swapper/1	23:12:05	1
744	99	86	82	cyclictest	0	-21	swapper/1	23:07:05	1
744	99	86	82	cyclictest	0	-21	swapper/1	22:42:04	1
744	99	86	82	cyclictest	0	-21	swapper/1	22:16:44	1
744	99	86	82	cyclictest	0	-21	swapper/1	21:40:36	1
744	99	86	82	cyclictest	0	-21	swapper/1	02:26:57	1
744	99	86	82	cyclictest	0	-21	swapper/1	01:34:39	1
744	99	86	82	cyclictest	0	-21	swapper/1	01:01:08	1
744	99	86	82	cyclictest	0	-21	swapper/1	00:51:57	1
744	99	86	82	cyclictest	0	-21	swapper/1	00:46:56	1
744	99	86	82	cyclictest	0	-21	swapper/1	00:24:28	1
744	99	86	81	cyclictest	429	-21	md1_raid1	22:37:00	1
747	99	84	72	cyclictest	0	-21	swapper/3	22:51:58	3
744	99	84	72	cyclictest	0	-21	swapper/1	23:41:57	1
747	99	83	82	cyclictest	0	-21	swapper/3	23:47:00	3
747	99	83	82	cyclictest	0	-21	swapper/3	23:42:03	3
747	99	83	82	cyclictest	0	-21	swapper/3	23:37:03	3
747	99	83	82	cyclictest	0	-21	swapper/3	23:32:03	3
747	99	83	82	cyclictest	0	-21	swapper/3	23:21:57	3
747	99	83	82	cyclictest	0	-21	swapper/3	23:21:08	3
747	99	83	82	cyclictest	0	-21	swapper/3	23:11:57	3
747	99	83	82	cyclictest	0	-21	swapper/3	23:07:04	3
747	99	83	82	cyclictest	0	-21	swapper/3	22:56:44	3
747	99	83	82	cyclictest	0	-21	swapper/3	22:49:15	3
747	99	83	82	cyclictest	0	-21	swapper/3	22:42:04	3
747	99	83	82	cyclictest	0	-21	swapper/3	22:32:02	3
747	99	83	82	cyclictest	0	-21	swapper/3	22:17:07	3
747	99	83	82	cyclictest	0	-21	swapper/3	22:07:05	3
747	99	83	82	cyclictest	0	-21	swapper/3	21:57:09	3
747	99	83	82	cyclictest	0	-21	swapper/3	21:42:02	3
747	99	83	82	cyclictest	0	-21	swapper/3	21:32:01	3
747	99	83	82	cyclictest	0	-21	swapper/3	21:26:59	3
747	99	83	82	cyclictest	0	-21	swapper/3	21:22:07	3
747	99	83	82	cyclictest	0	-21	swapper/3	21:06:57	3
747	99	83	82	cyclictest	0	-21	swapper/3	02:31:56	3
747	99	83	82	cyclictest	0	-21	swapper/3	02:26:50	3
747	99	83	82	cyclictest	0	-21	swapper/3	02:21:48	3
747	99	83	82	cyclictest	0	-21	swapper/3	02:01:49	3
747	99	83	82	cyclictest	0	-21	swapper/3	01:47:00	3
747	99	83	82	cyclictest	0	-21	swapper/3	01:42:10	3
747	99	83	82	cyclictest	0	-21	swapper/3	01:37:00	3
747	99	83	82	cyclictest	0	-21	swapper/3	01:21:37	3
747	99	83	82	cyclictest	0	-21	swapper/3	01:17:01	3
747	99	83	82	cyclictest	0	-21	swapper/3	01:12:00	3
747	99	83	82	cyclictest	0	-21	swapper/3	01:06:51	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:46:56	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:45:45	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:37:01	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:32:03	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:26:41	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:21:39	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:12:04	3
747	99	83	82	cyclictest	0	-21	swapper/3	00:10:03	3
744	99	83	82	cyclictest	429	-21	md1_raid1	22:27:08	1
744	99	83	82	cyclictest	0	-21	swapper/1	23:52:00	1
744	99	83	82	cyclictest	0	-21	swapper/1	23:46:56	1
744	99	83	82	cyclictest	0	-21	swapper/1	23:32:01	1
744	99	83	82	cyclictest	0	-21	swapper/1	22:56:44	1
744	99	83	82	cyclictest	0	-21	swapper/1	22:32:02	1
744	99	83	82	cyclictest	0	-21	swapper/1	22:16:59	1
744	99	83	82	cyclictest	0	-21	swapper/1	22:07:01	1
744	99	83	82	cyclictest	0	-21	swapper/1	21:47:02	1
744	99	83	82	cyclictest	0	-21	swapper/1	21:22:07	1
744	99	83	82	cyclictest	0	-21	swapper/1	21:12:11	1
744	99	83	82	cyclictest	0	-21	swapper/1	21:06:57	1
744	99	83	82	cyclictest	0	-21	swapper/1	02:31:56	1
744	99	83	82	cyclictest	0	-21	swapper/1	02:17:00	1
744	99	83	82	cyclictest	0	-21	swapper/1	02:14:45	1
744	99	83	82	cyclictest	0	-21	swapper/1	02:01:49	1
744	99	83	82	cyclictest	0	-21	swapper/1	01:46:57	1
744	99	83	82	cyclictest	0	-21	swapper/1	01:36:59	1
744	99	83	82	cyclictest	0	-21	swapper/1	01:16:30	1
744	99	83	82	cyclictest	0	-21	swapper/1	00:11:40	1
744	99	83	82	cyclictest	0	-21	swapper/1	00:05:54	1
744	99	83	81	cyclictest	3080	-21	tune2fs	02:06:51	1
744	99	83	81	cyclictest	28756	-21	tune2fs	01:51:52	1
744	99	83	81	cyclictest	24356	-21	tune2fs	01:41:52	1
744	99	83	81	cyclictest	15275	-21	tune2fs	00:06:55	1
744	99	83	81	cyclictest	13406	-21	tune2fs	01:16:54	1
744	99	83	81	cyclictest	10294	-21	tune2fs	21:27:02	1
747	99	82	81	cyclictest	0	-21	swapper/3	21:46:59	3
744	99	82	81	cyclictest	0	-21	swapper/1	23:21:58	1
747	99	79	78	cyclictest	0	-21	swapper/3	01:58:41	3
744	99	78	73	cyclictest	0	-21	swapper/1	23:56:41	1
744	99	78	73	cyclictest	0	-21	swapper/1	01:21:50	1
744	99	77	73	cyclictest	0	-21	swapper/1	21:52:53	1
744	99	76	72	cyclictest	0	-21	swapper/1	02:21:53	1
744	99	74	72	cyclictest	0	-21	swapper/1	21:57:11	1
747	99	73	72	cyclictest	0	-21	swapper/3	23:56:54	3
747	99	73	72	cyclictest	0	-21	swapper/3	23:52:00	3
747	99	73	72	cyclictest	0	-21	swapper/3	22:26:59	3
747	99	73	72	cyclictest	0	-21	swapper/3	22:21:57	3
747	99	73	72	cyclictest	0	-21	swapper/3	21:51:58	3
747	99	73	72	cyclictest	0	-21	swapper/3	21:37:11	3
747	99	73	72	cyclictest	0	-21	swapper/3	21:16:57	3
747	99	73	72	cyclictest	0	-21	swapper/3	21:16:57	3
747	99	73	72	cyclictest	0	-21	swapper/3	21:12:34	3
747	99	73	72	cyclictest	0	-21	swapper/3	01:51:53	3
747	99	73	72	cyclictest	0	-21	swapper/3	01:31:49	3
747	99	73	72	cyclictest	0	-21	swapper/3	01:26:47	3
747	99	73	72	cyclictest	0	-21	swapper/3	00:51:51	3
747	99	73	72	cyclictest	0	-21	swapper/3	00:21:52	3
744	99	73	72	cyclictest	0	-21	swapper/1	22:47:01	1
746	99	64	41	cyclictest	0	-21	swapper/2	01:45:45	2
746	99	64	41	cyclictest	0	-21	swapper/2	01:17:14	2
747	99	63	62	cyclictest	0	-21	swapper/3	02:11:42	3
746	99	63	62	cyclictest	0	-21	swapper/2	01:56:30	2
746	99	63	62	cyclictest	0	-21	swapper/2	01:34:06	2
746	99	63	62	cyclictest	0	-21	swapper/2	01:29:02	2
746	99	63	62	cyclictest	0	-21	swapper/2	01:24:07	2
746	99	63	62	cyclictest	0	-21	swapper/2	00:59:34	2
743	99	63	62	cyclictest	0	-21	swapper/0	23:46:17	0
743	99	63	62	cyclictest	0	-21	swapper/0	23:30:55	0
743	99	63	62	cyclictest	0	-21	swapper/0	23:30:55	0
743	99	63	62	cyclictest	0	-21	swapper/0	22:44:29	0
743	99	63	62	cyclictest	0	-21	swapper/0	22:34:09	0
743	99	63	62	cyclictest	0	-21	swapper/0	02:02:57	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:55:50	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:47:35	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:42:13	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:36:38	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:34:17	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:26:42	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:22:55	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:16:40	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:13:51	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:06:43	0
743	99	63	62	cyclictest	0	-21	swapper/0	01:02:11	0
743	99	63	62	cyclictest	0	-21	swapper/0	00:56:42	0
743	99	63	62	cyclictest	0	-21	swapper/0	00:52:07	0
743	99	63	62	cyclictest	0	-21	swapper/0	00:49:13	0
746	99	62	61	cyclictest	0	-21	swapper/2	23:52:51	2
746	99	62	61	cyclictest	0	-21	swapper/2	23:23:25	2
746	99	62	61	cyclictest	0	-21	swapper/2	23:03:26	2
746	99	62	61	cyclictest	0	-21	swapper/2	22:51:55	2
746	99	62	61	cyclictest	0	-21	swapper/2	22:05:09	2
746	99	62	61	cyclictest	0	-21	swapper/2	22:01:20	2
746	99	62	61	cyclictest	0	-21	swapper/2	01:57:13	2
746	99	62	61	cyclictest	0	-21	swapper/2	01:48:05	2
746	99	62	61	cyclictest	0	-21	swapper/2	01:36:38	2
746	99	62	61	cyclictest	0	-21	swapper/2	01:12:08	2
746	99	62	61	cyclictest	0	-21	swapper/2	01:07:31	2
746	99	62	61	cyclictest	0	-21	swapper/2	00:47:52	2
746	99	62	61	cyclictest	0	-21	swapper/2	00:42:38	2
746	99	62	51	cyclictest	0	-21	swapper/2	02:01:44	2
746	99	62	41	cyclictest	0	-21	swapper/2	01:05:36	2
743	99	62	61	cyclictest	50	50	irq/44-ahci	22:11:35	0
743	99	62	61	cyclictest	0	-21	swapper/0	23:58:01	0
743	99	62	61	cyclictest	0	-21	swapper/0	23:35:54	0
743	99	62	61	cyclictest	0	-21	swapper/0	23:00:18	0
743	99	62	61	cyclictest	0	-21	swapper/0	22:13:51	0
743	99	62	61	cyclictest	0	-21	swapper/0	00:42:55	0
743	99	62	61	cyclictest	0	-21	swapper/0	00:40:27	0
743	99	62	61	cyclictest	0	-21	swapper/0	00:33:06	0
743	99	62	61	cyclictest	0	-21	swapper/0	00:30:24	0
743	99	62	61	cyclictest	0	-21	swapper/0	00:15:24	0
743	99	62	51	cyclictest	0	-21	swapper/0	22:19:50	0
743	99	62	41	cyclictest	0	-21	swapper/0	01:58:13	0
746	99	61	60	cyclictest	0	-21	swapper/2	23:57:29	2
746	99	61	60	cyclictest	0	-21	swapper/2	23:27:27	2
746	99	61	60	cyclictest	0	-21	swapper/2	23:27:27	2
746	99	61	60	cyclictest	0	-21	swapper/2	23:07:16	2
746	99	61	60	cyclictest	0	-21	swapper/2	22:39:19	2
746	99	61	60	cyclictest	0	-21	swapper/2	22:33:59	2
746	99	61	60	cyclictest	0	-21	swapper/2	22:18:23	2
746	99	61	60	cyclictest	0	-21	swapper/2	22:09:10	2
746	99	61	60	cyclictest	0	-21	swapper/2	00:51:51	2
746	99	61	60	cyclictest	0	-21	swapper/2	00:38:22	2
746	99	61	60	cyclictest	0	-21	swapper/2	00:33:31	2
746	99	61	60	cyclictest	0	-21	swapper/2	00:27:31	2
746	99	61	59	cyclictest	3175	-21	telnet	21:12:01	2
743	99	61	60	cyclictest	0	-21	swapper/0	23:22:44	0
743	99	61	60	cyclictest	0	-21	swapper/0	22:01:26	0
746	99	60	59	cyclictest	0	-21	swapper/2	23:46:17	2
746	99	60	59	cyclictest	0	-21	swapper/2	23:20:48	2
746	99	60	59	cyclictest	0	-21	swapper/2	23:13:37	2
746	99	60	59	cyclictest	0	-21	swapper/2	22:49:25	2
746	99	60	59	cyclictest	0	-21	swapper/2	22:44:07	2
746	99	60	59	cyclictest	0	-21	swapper/2	22:13:41	2
746	99	60	59	cyclictest	0	-21	swapper/2	00:21:06	2
746	99	60	59	cyclictest	0	-21	swapper/2	00:13:01	2
743	99	60	59	cyclictest	0	-21	swapper/0	22:05:23	0
743	99	60	59	cyclictest	0	-21	swapper/0	00:10:54	0
743	99	60	59	cyclictest	0	-21	swapper/0	00:02:58	0
746	99	59	58	cyclictest	0	-21	swapper/2	23:35:54	2
746	99	59	58	cyclictest	0	-21	swapper/2	23:00:18	2
746	99	59	58	cyclictest	0	-21	swapper/2	21:53:15	2
746	99	59	58	cyclictest	0	-21	swapper/2	21:38:57	2
746	99	59	58	cyclictest	0	-21	swapper/2	21:33:48	2
746	99	59	41	cyclictest	0	-21	swapper/2	21:45:00	2
743	99	59	58	cyclictest	0	-21	swapper/0	22:53:10	0
743	99	59	58	cyclictest	0	-21	swapper/0	00:24:20	0
743	99	59	47	cyclictest	0	-21	swapper/0	22:26:44	0
743	99	59	47	cyclictest	0	-21	swapper/0	00:20:04	0
743	99	59	41	cyclictest	0	-21	swapper/0	23:39:36	0
743	99	59	41	cyclictest	0	-21	swapper/0	21:18:38	0
743	99	59	41	cyclictest	0	-21	swapper/0	21:18:38	0
743	99	59	41	cyclictest	0	-21	swapper/0	02:36:18	0
746	99	58	57	cyclictest	0	-21	swapper/2	00:10:54	2
746	99	58	57	cyclictest	0	-21	swapper/2	00:02:58	2
746	99	58	51	cyclictest	0	-21	swapper/2	21:28:55	2
746	99	58	41	cyclictest	0	-21	swapper/2	21:19:32	2
746	99	58	41	cyclictest	0	-21	swapper/2	21:19:32	2
746	99	57	56	cyclictest	0	-21	swapper/2	21:50:50	2
743	99	57	56	cyclictest	0	-21	swapper/0	23:01:47	0
743	99	57	56	cyclictest	0	-21	swapper/0	21:44:38	0
743	99	57	41	cyclictest	0	-21	swapper/0	21:38:58	0
743	99	57	41	cyclictest	0	-21	swapper/0	21:34:49	0
746	99	56	55	cyclictest	0	-21	swapper/2	21:21:48	2
746	99	56	55	cyclictest	0	-21	swapper/2	00:24:20	2
746	99	56	51	cyclictest	0	-21	swapper/2	22:23:32	2
746	99	56	51	cyclictest	0	-21	swapper/2	21:06:57	2
743	99	56	55	cyclictest	0	-21	swapper/0	22:40:14	0
743	99	56	55	cyclictest	0	-21	swapper/0	22:24:27	0
743	99	56	45	cyclictest	0	-21	swapper/0	23:15:58	0
743	99	56	43	cyclictest	50	50	irq/44-ahci	21:53:15	0
743	99	56	41	cyclictest	0	-21	swapper/0	21:48:00	0
746	99	55	44	cyclictest	0	-21	swapper/2	22:26:44	2
743	99	55	53	cyclictest	50	50	irq/44-ahci	21:23:12	0
743	99	55	53	cyclictest	50	50	irq/44-ahci	21:12:20	0
743	99	55	53	cyclictest	50	50	irq/44-ahci	21:07:34	0
743	99	55	51	cyclictest	0	-21	swapper/0	23:49:46	0
743	99	55	42	cyclictest	3	1	ksoftirqd/0	21:26:57	0
746	99	54	51	cyclictest	0	-21	swapper/2	02:06:47	2
746	99	54	41	cyclictest	0	-21	swapper/2	23:49:56	2
743	99	54	53	cyclictest	0	-21	swapper/0	23:20:14	0
743	99	54	42	cyclictest	50	50	irq/44-ahci	23:09:44	0
743	99	54	42	cyclictest	0	-21	swapper/0	02:17:05	0
743	99	54	41	cyclictest	0	-21	swapper/0	02:07:53	0
746	99	53	52	cyclictest	0	-21	swapper/2	02:22:14	2
746	99	53	51	cyclictest	1877	-21	hald-addon-stor	02:32:36	2
746	99	53	51	cyclictest	1877	-21	hald-addon-stor	02:26:54	2
746	99	53	51	cyclictest	0	-21	swapper/2	23:37:45	2
746	99	53	41	cyclictest	0	-21	swapper/2	02:18:47	2
746	99	53	41	cyclictest	0	-21	swapper/2	02:12:45	2
743	99	53	52	cyclictest	0	-21	swapper/0	23:51:51	0
743	99	53	52	cyclictest	0	-21	swapper/0	22:46:44	0
743	99	53	41	cyclictest	3	1	ksoftirqd/0	02:21:54	0
743	99	53	41	cyclictest	0	-21	swapper/0	02:27:20	0
743	99	53	41	cyclictest	0	-21	swapper/0	02:14:30	0
3	1	13	0	ksoftirqd/0	503	-40	yum-updatesd-he	21:05:59	0
50	50	11	0	irq/44-ahci	0	-21	swapper/2	21:03:32	2
12	1	10	0	ksoftirqd/1	1465	-21	irqbalance	21:02:12	1
23	1	8	0	ksoftirqd/3	0	-21	swapper/3	21:02:08	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17