OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sat Oct 25, 2025 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
22898	99	107	92	cyclictest	0	-21	swapper/3	01:45:08	3
22898	99	107	102	cyclictest	0	-21	swapper/3	23:10:12	3
22898	99	107	102	cyclictest	0	-21	swapper/3	02:55:00	3
22898	99	107	102	cyclictest	0	-21	swapper/3	01:55:06	3
22898	99	106	92	cyclictest	0	-21	swapper/3	23:40:12	3
22898	99	106	92	cyclictest	0	-21	swapper/3	23:30:12	3
22898	99	106	92	cyclictest	0	-21	swapper/3	21:50:17	3
22898	99	106	92	cyclictest	0	-21	swapper/3	01:15:08	3
22898	99	106	103	cyclictest	0	-21	swapper/3	02:14:43	3
22898	99	105	102	cyclictest	0	-21	swapper/3	22:30:18	3
22898	99	105	102	cyclictest	0	-21	swapper/3	00:34:46	3
22898	99	105	102	cyclictest	0	-21	swapper/3	00:34:46	3
22896	99	104	102	cyclictest	25541	-21	tune2fs	21:40:08	1
22896	99	104	102	cyclictest	10402	-21	aten2.4-expect	02:04:55	1
22898	99	103	102	cyclictest	0	-21	swapper/3	21:45:07	3
22897	99	99	97	cyclictest	0	-21	swapper/2	21:34:53	2
22898	99	97	92	cyclictest	0	-21	swapper/3	02:15:04	3
22898	99	95	92	cyclictest	0	-21	swapper/3	23:45:13	3
22898	99	95	92	cyclictest	0	-21	swapper/3	23:36:39	3
22898	99	95	92	cyclictest	0	-21	swapper/3	02:53:21	3
22898	99	95	92	cyclictest	0	-21	swapper/3	01:25:03	3
22898	99	95	92	cyclictest	0	-21	swapper/3	00:48:05	3
22898	99	91	90	cyclictest	5380	-21	sed	01:50:10	3
22898	99	89	82	cyclictest	0	-21	swapper/3	23:54:48	3
22898	99	88	83	cyclictest	0	-21	swapper/3	21:35:08	3
22898	99	88	72	cyclictest	0	-21	swapper/3	02:35:09	3
22898	99	88	72	cyclictest	0	-21	swapper/3	00:15:04	3
22898	99	87	82	cyclictest	0	-21	swapper/3	23:55:04	3
22898	99	87	82	cyclictest	0	-21	swapper/3	23:25:03	3
22898	99	87	82	cyclictest	0	-21	swapper/3	23:20:04	3
22898	99	87	82	cyclictest	0	-21	swapper/3	23:05:09	3
22898	99	87	82	cyclictest	0	-21	swapper/3	23:00:05	3
22898	99	87	82	cyclictest	0	-21	swapper/3	22:55:06	3
22898	99	87	82	cyclictest	0	-21	swapper/3	22:50:17	3
22898	99	87	82	cyclictest	0	-21	swapper/3	22:45:16	3
22898	99	87	82	cyclictest	0	-21	swapper/3	22:20:13	3
22898	99	87	82	cyclictest	0	-21	swapper/3	22:05:12	3
22898	99	87	82	cyclictest	0	-21	swapper/3	21:40:08	3
22898	99	87	82	cyclictest	0	-21	swapper/3	02:30:09	3
22898	99	87	82	cyclictest	0	-21	swapper/3	01:30:03	3
22898	99	87	82	cyclictest	0	-21	swapper/3	01:20:01	3
22898	99	87	82	cyclictest	0	-21	swapper/3	01:14:45	3
22898	99	87	82	cyclictest	0	-21	swapper/3	00:55:13	3
22898	99	87	82	cyclictest	0	-21	swapper/3	00:35:02	3
22898	99	87	82	cyclictest	0	-21	swapper/3	00:25:05	3
22898	99	87	82	cyclictest	0	-21	swapper/3	00:20:02	3
22898	99	87	82	cyclictest	0	-21	swapper/3	00:05:09	3
22898	99	87	82	cyclictest	0	-21	swapper/3	00:00:10	3
22898	99	87	72	cyclictest	0	-21	swapper/3	22:35:10	3
22898	99	87	71	cyclictest	0	-21	swapper/3	21:55:08	3
22898	99	87	71	cyclictest	0	-21	swapper/3	02:44:41	3
22898	99	87	71	cyclictest	0	-21	swapper/3	02:39:58	3
22898	99	87	71	cyclictest	0	-21	swapper/3	02:24:57	3
22898	99	87	71	cyclictest	0	-21	swapper/3	02:04:57	3
22898	99	87	71	cyclictest	0	-21	swapper/3	00:10:08	3
22898	99	86	82	cyclictest	0	-21	swapper/3	23:18:41	3
22898	99	86	82	cyclictest	0	-21	swapper/3	22:40:04	3
22898	99	86	82	cyclictest	0	-21	swapper/3	22:15:13	3
22898	99	86	82	cyclictest	0	-21	swapper/3	22:15:13	3
22898	99	86	82	cyclictest	0	-21	swapper/3	22:10:16	3
22898	99	86	82	cyclictest	0	-21	swapper/3	03:00:03	3
22898	99	86	82	cyclictest	0	-21	swapper/3	02:19:55	3
22898	99	86	82	cyclictest	0	-21	swapper/3	01:59:43	3
22898	99	86	82	cyclictest	0	-21	swapper/3	01:39:56	3
22898	99	86	82	cyclictest	0	-21	swapper/3	01:05:01	3
22898	99	86	82	cyclictest	0	-21	swapper/3	00:59:59	3
22898	99	86	82	cyclictest	0	-21	swapper/3	00:52:12	3
22898	99	86	82	cyclictest	0	-21	swapper/3	00:39:59	3
22898	99	86	81	cyclictest	0	-21	swapper/3	01:35:01	3
22898	99	85	82	cyclictest	0	-21	swapper/3	22:25:12	3
22898	99	85	82	cyclictest	0	-21	swapper/3	22:00:15	3
22896	99	84	82	cyclictest	1940	-21	tune2fs	00:30:03	1
22896	99	84	82	cyclictest	1940	-21	tune2fs	00:30:03	1
22896	99	84	82	cyclictest	17331	-21	tune2fs	01:05:00	1
22896	99	83	82	cyclictest	0	-21	swapper/1	23:50:12	1
22896	99	83	82	cyclictest	0	-21	swapper/1	23:47:55	1
22896	99	83	82	cyclictest	0	-21	swapper/1	23:37:53	1
22896	99	83	82	cyclictest	0	-21	swapper/1	22:50:15	1
22896	99	83	82	cyclictest	0	-21	swapper/1	22:45:07	1
22896	99	83	82	cyclictest	0	-21	swapper/1	22:35:13	1
22896	99	83	82	cyclictest	0	-21	swapper/1	22:17:41	1
22896	99	83	82	cyclictest	0	-21	swapper/1	22:17:41	1
22896	99	83	82	cyclictest	0	-21	swapper/1	22:05:10	1
22896	99	83	82	cyclictest	0	-21	swapper/1	22:04:52	1
22896	99	83	82	cyclictest	0	-21	swapper/1	21:59:52	1
22896	99	83	82	cyclictest	0	-21	swapper/1	21:35:15	1
22896	99	83	82	cyclictest	0	-21	swapper/1	02:55:04	1
22896	99	83	82	cyclictest	0	-21	swapper/1	02:53:21	1
22896	99	83	82	cyclictest	0	-21	swapper/1	02:45:03	1
22896	99	83	82	cyclictest	0	-21	swapper/1	02:44:41	1
22896	99	83	82	cyclictest	0	-21	swapper/1	02:25:05	1
22896	99	83	82	cyclictest	0	-21	swapper/1	02:20:05	1
22896	99	83	82	cyclictest	0	-21	swapper/1	02:13:16	1
22896	99	83	82	cyclictest	0	-21	swapper/1	01:58:13	1
22896	99	83	82	cyclictest	0	-21	swapper/1	01:48:12	1
22896	99	83	82	cyclictest	0	-21	swapper/1	01:18:09	1
22896	99	83	82	cyclictest	0	-21	swapper/1	01:10:10	1
22896	99	83	82	cyclictest	0	-21	swapper/1	01:00:08	1
22896	99	83	82	cyclictest	0	-21	swapper/1	00:50:09	1
22896	99	83	82	cyclictest	0	-21	swapper/1	00:25:10	1
22896	99	83	81	cyclictest	6335	-21	tune2fs	23:25:05	1
22896	99	83	81	cyclictest	26094	-21	tune2fs	01:25:00	1
22896	99	83	81	cyclictest	25592	-21	tune2fs	22:55:10	1
22896	99	83	81	cyclictest	1506	-21	aten2.4-expect	23:15:08	1
22896	99	83	81	cyclictest	10553	-21	tune2fs	22:20:08	1
22896	99	82	81	cyclictest	27615	-21	tune2fs	21:45:07	1
22895	99	79	41	cyclictest	0	-21	swapper/0	22:50:14	0
22895	99	76	41	cyclictest	0	-21	swapper/0	02:27:31	0
22896	99	73	72	cyclictest	0	-21	swapper/1	23:40:09	1
22896	99	73	72	cyclictest	0	-21	swapper/1	23:05:01	1
22896	99	73	72	cyclictest	0	-21	swapper/1	23:04:49	1
22896	99	73	72	cyclictest	0	-21	swapper/1	22:25:13	1
22896	99	73	72	cyclictest	0	-21	swapper/1	02:01:18	1
22896	99	73	72	cyclictest	0	-21	swapper/1	01:40:01	1
22896	99	73	72	cyclictest	0	-21	swapper/1	01:30:11	1
22896	99	73	72	cyclictest	0	-21	swapper/1	00:10:12	1
22896	99	73	72	cyclictest	0	-21	swapper/1	00:06:24	1
22896	99	73	72	cyclictest	0	-21	swapper/1	00:00:07	1
22896	99	73	71	cyclictest	29505	-21	aten2.4-expect	21:50:07	1
22896	99	73	71	cyclictest	21876	-21	tune2fs	02:30:00	1
22895	99	73	41	cyclictest	1877	-21	hald-addon-stor	21:37:54	0
22895	99	73	41	cyclictest	0	-21	swapper/0	00:39:43	0
22896	99	72	71	cyclictest	0	-21	swapper/1	23:10:12	1
22896	99	72	71	cyclictest	0	-21	swapper/1	03:00:06	1
22896	99	72	71	cyclictest	0	-21	swapper/1	01:50:10	1
22895	99	72	41	cyclictest	0	-21	swapper/0	21:40:44	0
22895	99	72	41	cyclictest	0	-21	swapper/0	02:41:45	0
22895	99	72	41	cyclictest	0	-21	swapper/0	00:51:33	0
22895	99	72	41	cyclictest	0	-21	swapper/0	00:31:38	0
22895	99	72	41	cyclictest	0	-21	swapper/0	00:31:38	0
22895	99	70	41	cyclictest	0	-21	swapper/0	23:52:49	0
22895	99	70	41	cyclictest	0	-21	swapper/0	23:23:00	0
22895	99	70	41	cyclictest	0	-21	swapper/0	23:00:59	0
22895	99	70	41	cyclictest	0	-21	swapper/0	22:12:15	0
22895	99	70	41	cyclictest	0	-21	swapper/0	01:26:26	0
22895	99	69	41	cyclictest	0	-21	swapper/0	02:57:22	0
22895	99	69	41	cyclictest	0	-21	swapper/0	02:07:52	0
22896	99	68	66	cyclictest	27917	-21	tune2fs	00:15:03	1
22895	99	68	51	cyclictest	0	-21	swapper/0	00:56:09	0
22895	99	68	41	cyclictest	0	-21	swapper/0	21:52:34	0
22895	99	68	41	cyclictest	0	-21	swapper/0	02:20:22	0
22895	99	68	41	cyclictest	0	-21	swapper/0	02:18:06	0
22895	99	68	41	cyclictest	0	-21	swapper/0	01:46:25	0
22895	99	67	41	cyclictest	0	-21	swapper/0	23:35:01	0
22895	99	67	41	cyclictest	0	-21	swapper/0	23:34:42	0
22895	99	67	41	cyclictest	0	-21	swapper/0	23:17:49	0
22895	99	67	41	cyclictest	0	-21	swapper/0	22:28:22	0
22895	99	67	41	cyclictest	0	-21	swapper/0	02:39:35	0
22895	99	67	41	cyclictest	0	-21	swapper/0	02:30:21	0
22895	99	67	41	cyclictest	0	-21	swapper/0	01:30:09	0
22895	99	67	41	cyclictest	0	-21	swapper/0	01:03:05	0
22895	99	67	41	cyclictest	0	-21	swapper/0	00:44:07	0
22895	99	67	41	cyclictest	0	-21	swapper/0	00:10:19	0
22895	99	67	41	cyclictest	0	-21	swapper/0	00:00:02	0
22896	99	66	62	cyclictest	0	-21	swapper/1	00:35:10	1
22896	99	66	62	cyclictest	0	-21	swapper/1	00:24:46	1
22895	99	66	41	cyclictest	0	-21	swapper/0	23:55:11	0
22895	99	66	41	cyclictest	0	-21	swapper/0	23:41:51	0
22895	99	66	41	cyclictest	0	-21	swapper/0	00:20:04	0
22895	99	66	41	cyclictest	0	-21	swapper/0	00:05:22	0
22896	99	65	64	cyclictest	0	-21	swapper/1	00:44:46	1
22896	99	65	62	cyclictest	0	-21	swapper/1	02:36:07	1
22896	99	65	62	cyclictest	0	-21	swapper/1	01:35:09	1
22896	99	65	61	cyclictest	0	-21	swapper/1	23:30:03	1
22895	99	65	41	cyclictest	0	-21	swapper/0	02:59:49	0
22896	99	64	62	cyclictest	18840	-21	aten2.4-expect	22:40:05	1
22895	99	64	41	cyclictest	0	-21	swapper/0	23:26:14	0
22896	99	63	62	cyclictest	0	-21	swapper/1	23:55:02	1
22896	99	63	62	cyclictest	0	-21	swapper/1	23:20:02	1
22896	99	63	62	cyclictest	0	-21	swapper/1	22:09:52	1
22896	99	63	62	cyclictest	0	-21	swapper/1	02:14:57	1
22896	99	63	62	cyclictest	0	-21	swapper/1	01:20:00	1
22896	99	63	62	cyclictest	0	-21	swapper/1	00:54:58	1
22896	99	63	62	cyclictest	0	-21	swapper/1	00:45:01	1
22896	99	63	52	cyclictest	0	-21	swapper/1	22:30:07	1
22895	99	63	41	cyclictest	0	-21	swapper/0	22:04:51	0
22895	99	61	52	cyclictest	745	50	irq/18-parport0	22:39:44	0
22895	99	61	52	cyclictest	745	50	irq/18-parport0	22:06:33	0
22895	99	59	41	cyclictest	0	-21	swapper/0	02:47:35	0
22897	99	58	56	cyclictest	27466	-21	telnet	23:00:03	2
22897	99	58	56	cyclictest	21061	-21	telnet	00:00:01	2
22895	99	58	51	cyclictest	745	50	irq/18-parport0	00:48:17	0
22895	99	58	46	cyclictest	0	-21	swapper/0	23:47:47	0
22895	99	58	41	cyclictest	0	-21	swapper/0	23:13:37	0
22895	99	57	51	cyclictest	745	50	irq/18-parport0	02:11:12	0
22895	99	57	41	cyclictest	0	-21	swapper/0	23:05:17	0
22895	99	57	41	cyclictest	0	-21	swapper/0	22:33:10	0
22895	99	57	41	cyclictest	0	-21	swapper/0	22:21:17	0
22895	99	57	41	cyclictest	0	-21	swapper/0	22:14:53	0
22895	99	57	41	cyclictest	0	-21	swapper/0	22:14:53	0
22895	99	57	41	cyclictest	0	-21	swapper/0	21:54:58	0
22897	99	56	54	cyclictest	0	-21	swapper/2	02:04:55	2
22897	99	56	51	cyclictest	18	1	ksoftirqd/2	21:41:52	2
22895	99	56	41	cyclictest	0	-21	swapper/0	22:40:36	0
22895	99	56	41	cyclictest	0	-21	swapper/0	21:45:04	0
22895	99	56	41	cyclictest	0	-21	swapper/0	01:55:23	0
22895	99	56	41	cyclictest	0	-21	swapper/0	01:18:42	0
22897	99	55	51	cyclictest	0	-21	swapper/2	00:24:22	2
22895	99	55	52	cyclictest	0	-21	swapper/0	01:08:28	0
22895	99	55	41	cyclictest	0	-21	swapper/0	22:59:07	0
22897	99	54	53	cyclictest	18	1	ksoftirqd/2	01:16:18	2
22897	99	54	53	cyclictest	0	-21	swapper/2	02:10:01	2
22897	99	54	52	cyclictest	50	50	irq/44-ahci	00:58:43	2
22897	99	54	52	cyclictest	3132	-21	kworker/2:2	23:35:52	2
22897	99	54	42	cyclictest	0	-21	swapper/2	23:50:35	2
22897	99	54	42	cyclictest	0	-21	swapper/2	01:36:23	2
22897	99	54	41	cyclictest	275	-21	usb-storage	22:23:35	2
22895	99	54	52	cyclictest	745	50	irq/18-parport0	02:00:24	0
22897	99	53	52	cyclictest	3132	-21	kworker/2:2	23:32:00	2
22897	99	53	52	cyclictest	275	-21	usb-storage	23:19:59	2
22897	99	53	52	cyclictest	275	-21	usb-storage	03:00:14	2
22897	99	53	52	cyclictest	275	-21	usb-storage	02:55:44	2
22897	99	53	52	cyclictest	275	-21	usb-storage	02:23:14	2
22897	99	53	52	cyclictest	275	-21	usb-storage	02:16:30	2
22897	99	53	52	cyclictest	275	-21	usb-storage	01:57:25	2
22897	99	53	52	cyclictest	275	-21	usb-storage	01:46:41	2
22897	99	53	52	cyclictest	275	-21	usb-storage	00:44:49	2
22897	99	53	52	cyclictest	1868	-21	hald-addon-stor	02:00:24	2
22897	99	53	52	cyclictest	18	1	ksoftirqd/2	01:20:42	2
22897	99	53	52	cyclictest	0	-21	swapper/2	23:56:05	2
22897	99	53	52	cyclictest	0	-21	swapper/2	23:40:38	2
22897	99	53	52	cyclictest	0	-21	swapper/2	23:25:36	2
22897	99	53	52	cyclictest	0	-21	swapper/2	23:15:03	2
22897	99	53	52	cyclictest	0	-21	swapper/2	23:13:23	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:59:13	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:52:02	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:45:38	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:35:30	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:31:36	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:15:04	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:15:04	2
22897	99	53	52	cyclictest	0	-21	swapper/2	22:10:43	2
22897	99	53	52	cyclictest	0	-21	swapper/2	21:45:44	2
22897	99	53	52	cyclictest	0	-21	swapper/2	02:52:52	2
22897	99	53	52	cyclictest	0	-21	swapper/2	02:42:21	2
22897	99	53	52	cyclictest	0	-21	swapper/2	02:37:09	2
22897	99	53	52	cyclictest	0	-21	swapper/2	02:26:43	2
22897	99	53	52	cyclictest	0	-21	swapper/2	01:42:45	2
22897	99	53	52	cyclictest	0	-21	swapper/2	01:30:02	2
22897	99	53	52	cyclictest	0	-21	swapper/2	01:27:02	2
22897	99	53	52	cyclictest	0	-21	swapper/2	01:12:54	2
22897	99	53	52	cyclictest	0	-21	swapper/2	01:01:31	2
22897	99	53	52	cyclictest	0	-21	swapper/2	00:41:05	2
22897	99	53	52	cyclictest	0	-21	swapper/2	00:34:50	2
22897	99	53	52	cyclictest	0	-21	swapper/2	00:26:24	2
22897	99	53	52	cyclictest	0	-21	swapper/2	00:15:20	2
22897	99	53	52	cyclictest	0	-21	swapper/2	00:10:35	2
22897	99	53	52	cyclictest	0	-21	swapper/2	00:05:45	2
22897	99	53	51	cyclictest	50	50	irq/44-ahci	02:45:21	2
22897	99	53	51	cyclictest	50	50	irq/44-ahci	02:30:22	2
22897	99	53	51	cyclictest	50	50	irq/44-ahci	01:04:51	2
22897	99	53	51	cyclictest	3981	-21	telnet	01:49:56	2
22897	99	53	51	cyclictest	18	1	ksoftirqd/2	21:50:30	2
22897	99	53	51	cyclictest	12212	-21	telnet	22:25:03	2
22897	99	53	51	cyclictest	0	-21	swapper/2	00:31:50	2
22897	99	53	51	cyclictest	0	-21	swapper/2	00:31:50	2
22897	99	53	41	cyclictest	0	-21	swapper/2	23:47:47	2
22897	99	53	41	cyclictest	0	-21	swapper/2	23:06:11	2
22897	99	53	41	cyclictest	0	-21	swapper/2	22:40:28	2
22897	99	53	41	cyclictest	0	-21	swapper/2	22:07:31	2
22895	99	53	52	cyclictest	0	-21	swapper/0	22:45:03	0
22895	99	53	52	cyclictest	0	-21	swapper/0	02:50:33	0
22895	99	53	52	cyclictest	0	-21	swapper/0	01:49:56	0
22895	99	53	52	cyclictest	0	-21	swapper/0	01:37:03	0
22895	99	53	52	cyclictest	0	-21	swapper/0	01:20:01	0
22895	99	53	52	cyclictest	0	-21	swapper/0	00:16:34	0
22895	99	53	46	cyclictest	0	-21	swapper/0	01:10:58	0
22897	99	52	51	cyclictest	0	-21	swapper/2	21:59:54	2
22897	99	52	51	cyclictest	0	-21	swapper/2	21:54:54	2
22897	99	52	51	cyclictest	0	-21	swapper/2	00:49:55	2
22895	99	52	51	cyclictest	0	-21	swapper/0	01:44:03	0
22895	99	51	50	cyclictest	0	-21	swapper/0	00:24:48	0
7	99	14	0	migration/0	22561	-21	runrttasks	21:32:48	0
12	1	13	0	ksoftirqd/1	0	-21	swapper/1	21:32:53	1
23	1	12	0	ksoftirqd/3	0	-21	swapper/3	21:32:53	3
18	1	12	0	ksoftirqd/2	0	-21	swapper/2	21:32:53	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17