OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Tue Nov 18, 2025 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
10035	99	127	112	cyclictest	0	-21	swapper/1	23:26:34	1
10035	99	119	102	cyclictest	0	-21	swapper/1	00:51:38	1
10035	99	118	102	cyclictest	0	-21	swapper/1	00:18:19	1
10035	99	117	102	cyclictest	0	-21	swapper/1	22:53:28	1
10035	99	117	102	cyclictest	0	-21	swapper/1	21:48:06	1
10035	99	117	102	cyclictest	0	-21	swapper/1	01:28:12	1
10037	99	113	112	cyclictest	0	-21	swapper/3	01:38:15	3
10035	99	108	102	cyclictest	2129	-21	tune2fs	22:08:23	1
10035	99	106	92	cyclictest	0	-21	swapper/1	01:03:11	1
10035	99	106	102	cyclictest	0	-21	swapper/1	02:33:28	1
10035	99	106	102	cyclictest	0	-21	swapper/1	00:45:33	1
10035	99	106	102	cyclictest	0	-21	swapper/1	00:11:51	1
10035	99	103	102	cyclictest	0	-21	swapper/1	01:38:15	1
10035	99	96	92	cyclictest	0	-21	swapper/1	22:36:20	1
10035	99	96	92	cyclictest	0	-21	swapper/1	22:27:48	1
10035	99	96	92	cyclictest	0	-21	swapper/1	02:05:45	1
10035	99	96	92	cyclictest	0	-21	swapper/1	01:53:24	1
10035	99	95	92	cyclictest	0	-21	swapper/1	02:40:24	1
10035	99	95	92	cyclictest	0	-21	swapper/1	02:24:05	1
10035	99	95	92	cyclictest	0	-21	swapper/1	02:16:29	1
10035	99	95	92	cyclictest	0	-21	swapper/1	02:11:09	1
10035	99	95	92	cyclictest	0	-21	swapper/1	01:51:46	1
10037	99	93	92	cyclictest	0	-21	swapper/3	22:35:15	3
10037	99	93	92	cyclictest	0	-21	swapper/3	21:53:18	3
10037	99	93	92	cyclictest	0	-21	swapper/3	21:53:18	3
10037	99	93	92	cyclictest	0	-21	swapper/3	01:58:13	3
10037	99	93	92	cyclictest	0	-21	swapper/3	01:35:41	3
10037	99	93	92	cyclictest	0	-21	swapper/3	01:17:33	3
10037	99	93	92	cyclictest	0	-21	swapper/3	00:29:47	3
10037	99	93	92	cyclictest	0	-21	swapper/3	00:08:21	3
10035	99	93	92	cyclictest	0	-21	swapper/1	00:53:12	1
10035	99	88	81	cyclictest	9312	-21	tune2fs	23:38:22	1
10035	99	88	72	cyclictest	0	-21	swapper/1	23:18:27	1
10035	99	88	72	cyclictest	0	-21	swapper/1	00:03:03	1
10035	99	87	83	cyclictest	0	-21	swapper/1	02:01:49	1
10035	99	87	82	cyclictest	0	-21	swapper/1	23:08:16	1
10035	99	87	82	cyclictest	0	-21	swapper/1	22:58:29	1
10035	99	87	82	cyclictest	0	-21	swapper/1	22:48:19	1
10035	99	87	82	cyclictest	0	-21	swapper/1	22:44:21	1
10035	99	87	82	cyclictest	0	-21	swapper/1	22:13:28	1
10035	99	87	82	cyclictest	0	-21	swapper/1	21:33:06	1
10035	99	87	82	cyclictest	0	-21	swapper/1	01:08:16	1
10035	99	87	81	cyclictest	32289	-21	tune2fs	22:03:21	1
10035	99	87	72	cyclictest	0	-21	swapper/1	23:43:20	1
10035	99	87	72	cyclictest	0	-21	swapper/1	22:38:31	1
10035	99	87	72	cyclictest	0	-21	swapper/1	21:53:27	1
10035	99	87	72	cyclictest	0	-21	swapper/1	21:53:27	1
10035	99	87	72	cyclictest	0	-21	swapper/1	21:43:17	1
10035	99	87	72	cyclictest	0	-21	swapper/1	00:23:19	1
10035	99	87	71	cyclictest	0	-21	swapper/1	23:35:54	1
10035	99	87	71	cyclictest	0	-21	swapper/1	23:28:15	1
10035	99	87	71	cyclictest	0	-21	swapper/1	21:18:22	1
10035	99	87	71	cyclictest	0	-21	swapper/1	21:13:23	1
10035	99	87	71	cyclictest	0	-21	swapper/1	01:21:29	1
10035	99	87	71	cyclictest	0	-21	swapper/1	00:42:06	1
10035	99	86	82	cyclictest	0	-21	swapper/1	23:58:14	1
10035	99	86	82	cyclictest	0	-21	swapper/1	23:57:52	1
10035	99	86	82	cyclictest	0	-21	swapper/1	22:28:30	1
10035	99	86	82	cyclictest	0	-21	swapper/1	22:18:32	1
10035	99	86	82	cyclictest	0	-21	swapper/1	21:23:08	1
10035	99	86	82	cyclictest	0	-21	swapper/1	01:13:11	1
10035	99	86	82	cyclictest	0	-21	swapper/1	00:58:17	1
10035	99	86	82	cyclictest	0	-21	swapper/1	00:33:17	1
10035	99	86	82	cyclictest	0	-21	swapper/1	00:31:18	1
10035	99	86	71	cyclictest	0	-21	swapper/1	23:48:15	1
10035	99	86	71	cyclictest	0	-21	swapper/1	23:03:19	1
10035	99	86	71	cyclictest	0	-21	swapper/1	21:58:22	1
10035	99	86	71	cyclictest	0	-21	swapper/1	21:38:21	1
10035	99	86	71	cyclictest	0	-21	swapper/1	21:35:06	1
10035	99	86	71	cyclictest	0	-21	swapper/1	01:27:42	1
10035	99	86	71	cyclictest	0	-21	swapper/1	00:15:59	1
10035	99	85	82	cyclictest	0	-21	swapper/1	23:13:20	1
10035	99	85	82	cyclictest	0	-21	swapper/1	02:20:41	1
10035	99	85	82	cyclictest	0	-21	swapper/1	01:33:08	1
10035	99	85	81	cyclictest	0	-21	swapper/1	01:43:15	1
10035	99	85	71	cyclictest	0	-21	swapper/1	02:28:17	1
10037	99	84	72	cyclictest	0	-21	swapper/3	22:00:48	3
10037	99	83	82	cyclictest	0	-21	swapper/3	23:58:16	3
10037	99	83	82	cyclictest	0	-21	swapper/3	23:50:25	3
10037	99	83	82	cyclictest	0	-21	swapper/3	23:28:23	3
10037	99	83	82	cyclictest	0	-21	swapper/3	23:19:01	3
10037	99	83	82	cyclictest	0	-21	swapper/3	23:04:22	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:53:29	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:48:23	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:38:04	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:30:14	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:23:04	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:13:21	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:12:03	3
10037	99	83	82	cyclictest	0	-21	swapper/3	22:03:22	3
10037	99	83	82	cyclictest	0	-21	swapper/3	21:40:07	3
10037	99	83	82	cyclictest	0	-21	swapper/3	21:33:06	3
10037	99	83	82	cyclictest	0	-21	swapper/3	21:30:52	3
10037	99	83	82	cyclictest	0	-21	swapper/3	21:18:26	3
10037	99	83	82	cyclictest	0	-21	swapper/3	21:13:38	3
10037	99	83	82	cyclictest	0	-21	swapper/3	02:33:11	3
10037	99	83	82	cyclictest	0	-21	swapper/3	02:24:05	3
10037	99	83	82	cyclictest	0	-21	swapper/3	02:18:19	3
10037	99	83	82	cyclictest	0	-21	swapper/3	02:13:15	3
10037	99	83	82	cyclictest	0	-21	swapper/3	02:08:59	3
10037	99	83	82	cyclictest	0	-21	swapper/3	01:52:26	3
10037	99	83	82	cyclictest	0	-21	swapper/3	01:32:58	3
10037	99	83	82	cyclictest	0	-21	swapper/3	01:26:00	3
10037	99	83	82	cyclictest	0	-21	swapper/3	01:18:20	3
10037	99	83	82	cyclictest	0	-21	swapper/3	01:12:58	3
10037	99	83	82	cyclictest	0	-21	swapper/3	00:59:37	3
10037	99	83	82	cyclictest	0	-21	swapper/3	00:53:22	3
10037	99	83	82	cyclictest	0	-21	swapper/3	00:48:21	3
10037	99	83	82	cyclictest	0	-21	swapper/3	00:37:02	3
10037	99	83	82	cyclictest	0	-21	swapper/3	00:28:00	3
10037	99	83	81	cyclictest	423	-21	md2_raid1	00:42:59	3
10037	99	82	81	cyclictest	0	-21	swapper/3	01:53:18	3
10037	99	74	73	cyclictest	15492	-21	fschecks_count	23:53:32	3
10037	99	74	72	cyclictest	31862	-21	taskset	23:15:56	3
10037	99	73	72	cyclictest	0	-21	swapper/3	23:43:04	3
10037	99	73	72	cyclictest	0	-21	swapper/3	23:38:28	3
10037	99	73	72	cyclictest	0	-21	swapper/3	23:33:15	3
10037	99	73	72	cyclictest	0	-21	swapper/3	23:23:22	3
10037	99	73	72	cyclictest	0	-21	swapper/3	23:08:16	3
10037	99	73	72	cyclictest	0	-21	swapper/3	22:58:18	3
10037	99	73	72	cyclictest	0	-21	swapper/3	22:43:05	3
10037	99	73	72	cyclictest	0	-21	swapper/3	22:18:28	3
10037	99	73	72	cyclictest	0	-21	swapper/3	21:48:22	3
10037	99	73	72	cyclictest	0	-21	swapper/3	21:43:21	3
10037	99	73	72	cyclictest	0	-21	swapper/3	21:23:19	3
10037	99	73	72	cyclictest	0	-21	swapper/3	02:38:02	3
10037	99	73	72	cyclictest	0	-21	swapper/3	02:27:57	3
10037	99	73	72	cyclictest	0	-21	swapper/3	02:02:58	3
10037	99	73	72	cyclictest	0	-21	swapper/3	01:43:10	3
10037	99	73	72	cyclictest	0	-21	swapper/3	01:03:17	3
10037	99	73	72	cyclictest	0	-21	swapper/3	00:43:17	3
10037	99	73	72	cyclictest	0	-21	swapper/3	00:18:15	3
10037	99	73	72	cyclictest	0	-21	swapper/3	00:13:13	3
10037	99	73	61	cyclictest	0	-21	swapper/3	00:03:18	3
10036	99	63	62	cyclictest	0	-21	swapper/2	23:49:53	2
10036	99	63	62	cyclictest	0	-21	swapper/2	23:33:00	2
10036	99	63	62	cyclictest	0	-21	swapper/2	22:10:07	2
10036	99	63	62	cyclictest	0	-21	swapper/2	01:23:33	2
10036	99	63	62	cyclictest	0	-21	swapper/2	01:19:01	2
10036	99	63	62	cyclictest	0	-21	swapper/2	01:00:50	2
10036	99	63	62	cyclictest	0	-21	swapper/2	00:53:03	2
10036	99	63	62	cyclictest	0	-21	swapper/2	00:52:34	2
10036	99	63	62	cyclictest	0	-21	swapper/2	00:38:07	2
10036	99	63	62	cyclictest	0	-21	swapper/2	00:28:59	2
10036	99	63	62	cyclictest	0	-21	swapper/2	00:17:02	2
10036	99	63	62	cyclictest	0	-21	swapper/2	00:11:28	2
10036	99	63	61	cyclictest	0	-21	swapper/2	00:43:48	2
10036	99	63	41	cyclictest	0	-21	swapper/2	23:04:58	2
10034	99	63	62	cyclictest	0	-21	swapper/0	01:23:08	0
10034	99	63	62	cyclictest	0	-21	swapper/0	01:19:36	0
10034	99	63	62	cyclictest	0	-21	swapper/0	01:03:04	0
10034	99	63	62	cyclictest	0	-21	swapper/0	00:59:30	0
10034	99	63	62	cyclictest	0	-21	swapper/0	00:56:46	0
10034	99	63	62	cyclictest	0	-21	swapper/0	00:50:13	0
10034	99	63	62	cyclictest	0	-21	swapper/0	00:43:16	0
10034	99	63	62	cyclictest	0	-21	swapper/0	00:35:17	0
10036	99	62	61	cyclictest	0	-21	swapper/2	23:57:47	2
10036	99	62	61	cyclictest	0	-21	swapper/2	23:15:24	2
10036	99	62	61	cyclictest	0	-21	swapper/2	22:59:14	2
10036	99	62	61	cyclictest	0	-21	swapper/2	22:17:02	2
10036	99	62	61	cyclictest	0	-21	swapper/2	22:02:30	2
10036	99	62	61	cyclictest	0	-21	swapper/2	21:50:31	2
10036	99	62	61	cyclictest	0	-21	swapper/2	21:24:53	2
10036	99	62	61	cyclictest	0	-21	swapper/2	21:18:24	2
10036	99	62	61	cyclictest	0	-21	swapper/2	21:15:19	2
10036	99	62	61	cyclictest	0	-21	swapper/2	02:13:26	2
10036	99	62	61	cyclictest	0	-21	swapper/2	02:11:19	2
10036	99	62	61	cyclictest	0	-21	swapper/2	01:14:35	2
10036	99	62	61	cyclictest	0	-21	swapper/2	00:33:37	2
10036	99	62	61	cyclictest	0	-21	swapper/2	00:23:13	2
10036	99	62	61	cyclictest	0	-21	swapper/2	00:18:52	2
10036	99	62	61	cyclictest	0	-21	swapper/2	00:04:52	2
10036	99	62	41	cyclictest	0	-21	swapper/2	22:06:48	2
10034	99	62	61	cyclictest	0	-21	swapper/0	23:21:13	0
10034	99	62	61	cyclictest	0	-21	swapper/0	23:02:10	0
10034	99	62	61	cyclictest	0	-21	swapper/0	22:48:17	0
10034	99	62	61	cyclictest	0	-21	swapper/0	22:41:07	0
10034	99	62	61	cyclictest	0	-21	swapper/0	01:14:04	0
10034	99	62	61	cyclictest	0	-21	swapper/0	01:08:48	0
10034	99	62	61	cyclictest	0	-21	swapper/0	00:41:39	0
10036	99	61	60	cyclictest	0	-21	swapper/2	23:24:57	2
10036	99	61	60	cyclictest	0	-21	swapper/2	01:12:10	2
10036	99	61	60	cyclictest	0	-21	swapper/2	00:01:58	2
10036	99	61	51	cyclictest	0	-21	swapper/2	22:45:59	2
10034	99	61	60	cyclictest	0	-21	swapper/0	22:56:55	0
10034	99	61	60	cyclictest	0	-21	swapper/0	21:52:52	0
10034	99	61	60	cyclictest	0	-21	swapper/0	01:28:49	0
10034	99	61	60	cyclictest	0	-21	swapper/0	00:32:29	0
10034	99	61	60	cyclictest	0	-21	swapper/0	00:03:14	0
10036	99	60	59	cyclictest	0	-21	swapper/2	23:10:06	2
10036	99	60	59	cyclictest	0	-21	swapper/2	22:19:08	2
10036	99	60	59	cyclictest	0	-21	swapper/2	21:35:53	2
10036	99	60	59	cyclictest	0	-21	swapper/2	01:03:30	2
10036	99	59	58	cyclictest	0	-21	swapper/2	23:41:33	2
10036	99	59	58	cyclictest	0	-21	swapper/2	22:31:53	2
10036	99	59	58	cyclictest	0	-21	swapper/2	21:47:00	2
10036	99	59	58	cyclictest	0	-21	swapper/2	01:29:15	2
10036	99	59	55	cyclictest	0	-21	swapper/2	21:31:27	2
10034	99	59	58	cyclictest	0	-21	swapper/0	02:13:29	0
10034	99	59	58	cyclictest	0	-21	swapper/0	00:13:14	0
10034	99	59	48	cyclictest	0	-21	swapper/0	22:00:56	0
10036	99	58	57	cyclictest	0	-21	swapper/2	22:53:25	2
10034	99	58	41	cyclictest	0	-21	swapper/0	23:45:09	0
10036	99	57	56	cyclictest	0	-21	swapper/2	23:45:09	2
10036	99	57	56	cyclictest	0	-21	swapper/2	21:40:16	2
10036	99	57	41	cyclictest	0	-21	swapper/2	02:07:11	2
10034	99	57	50	cyclictest	0	-21	swapper/0	21:45:59	0
10036	99	56	55	cyclictest	0	-21	swapper/2	23:21:59	2
10036	99	56	41	cyclictest	0	-21	swapper/2	21:53:31	2
10036	99	56	41	cyclictest	0	-21	swapper/2	21:53:31	2
10036	99	55	54	cyclictest	3133	-21	munin-node	01:53:17	2
10036	99	55	54	cyclictest	23233	-21	munin-node	02:38:14	2
10036	99	55	54	cyclictest	14542	-21	munin-node	02:18:13	2
10036	99	55	51	cyclictest	0	-21	swapper/2	22:39:50	2
10036	99	55	51	cyclictest	0	-21	swapper/2	22:27:59	2
10036	99	55	41	cyclictest	0	-21	swapper/2	22:49:27	2
10036	99	55	41	cyclictest	0	-21	swapper/2	22:37:03	2
10034	99	55	54	cyclictest	0	-21	swapper/0	23:32:24	0
10034	99	55	54	cyclictest	0	-21	swapper/0	02:08:32	0
10034	99	55	54	cyclictest	0	-21	swapper/0	02:03:11	0
10034	99	55	54	cyclictest	0	-21	swapper/0	00:12:28	0
10034	99	55	52	cyclictest	0	-21	swapper/0	00:26:38	0
10034	99	55	51	cyclictest	0	-21	swapper/0	00:02:35	0
10034	99	55	41	cyclictest	0	-21	swapper/0	23:04:53	0
10034	99	55	41	cyclictest	0	-21	swapper/0	21:26:45	0
10034	99	55	41	cyclictest	0	-21	swapper/0	00:22:48	0
10036	99	54	53	cyclictest	7632	-21	munin-node	23:33:27	2
10036	99	54	53	cyclictest	5918	-21	munin-node	01:58:14	2
10036	99	54	53	cyclictest	30737	-31	99-raid-check	01:43:00	2
10036	99	54	53	cyclictest	29796	-21	munin-node	01:38:17	2
10036	99	54	52	cyclictest	18	1	ksoftirqd/2	02:37:01	2
10034	99	54	53	cyclictest	0	-21	swapper/0	23:42:43	0
10034	99	54	53	cyclictest	0	-21	swapper/0	22:33:29	0
10034	99	54	52	cyclictest	0	-21	swapper/0	21:19:08	0
10034	99	54	50	cyclictest	0	-21	swapper/0	23:37:29	0
10034	99	54	50	cyclictest	0	-21	swapper/0	23:13:10	0
10034	99	54	47	cyclictest	0	-21	swapper/0	22:43:57	0
10036	99	53	52	cyclictest	27581	-21	munin-node	01:33:14	2
10036	99	53	48	cyclictest	0	-21	swapper/2	02:23:41	2
10036	99	53	41	cyclictest	0	-21	swapper/2	02:28:37	2
10036	99	53	41	cyclictest	0	-21	swapper/2	01:50:53	2
10034	99	53	52	cyclictest	745	50	irq/18-parport0	02:33:12	0
10034	99	53	52	cyclictest	745	50	irq/18-parport0	02:32:02	0
10034	99	53	52	cyclictest	50	50	irq/44-ahci	21:39:05	0
10034	99	53	52	cyclictest	0	-21	swapper/0	23:51:25	0
10034	99	53	52	cyclictest	0	-21	swapper/0	23:24:02	0
10034	99	53	52	cyclictest	0	-21	swapper/0	22:23:45	0
10034	99	53	52	cyclictest	0	-21	swapper/0	22:18:16	0
10034	99	53	52	cyclictest	0	-21	swapper/0	22:04:47	0
10034	99	53	52	cyclictest	0	-21	swapper/0	21:54:15	0
10034	99	53	52	cyclictest	0	-21	swapper/0	21:54:15	0
10034	99	53	52	cyclictest	0	-21	swapper/0	21:33:10	0
10034	99	53	52	cyclictest	0	-21	swapper/0	01:53:15	0
10034	99	53	51	cyclictest	0	-21	swapper/0	22:09:04	0
10034	99	53	48	cyclictest	0	-21	swapper/0	01:51:42	0
10034	99	53	41	cyclictest	50	50	irq/44-ahci	23:53:52	0
10034	99	53	41	cyclictest	28583	-21	munin-node	01:38:18	0
10034	99	53	41	cyclictest	0	-21	swapper/0	23:08:16	0
10034	99	53	41	cyclictest	0	-21	swapper/0	22:15:32	0
10034	99	53	41	cyclictest	0	-21	swapper/0	21:31:30	0
10034	99	53	41	cyclictest	0	-21	swapper/0	21:13:26	0
10034	99	53	41	cyclictest	0	-21	swapper/0	02:39:23	0
10034	99	53	41	cyclictest	0	-21	swapper/0	01:44:02	0
10034	99	52	51	cyclictest	745	50	irq/18-parport0	01:58:22	0
10034	99	52	51	cyclictest	0	-21	swapper/0	22:28:18	0
10034	99	52	51	cyclictest	0	-21	swapper/0	02:23:41	0
10034	99	52	51	cyclictest	0	-21	swapper/0	01:34:33	0
10034	99	52	41	cyclictest	0	-21	swapper/0	02:19:04	0
18	1	15	0	ksoftirqd/2	18642	-21	md1_resync	21:09:10	2
23	1	13	0	ksoftirqd/3	18642	-21	md1_resync	21:11:04	3
50	50	11	0	irq/44-ahci	429	-21	md1_raid1	21:09:12	0
12	1	8	0	ksoftirqd/1	0	-21	swapper/1	21:08:51	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17