OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Wed Dec 03, 2025 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
19978	99	104	102	cyclictest	27190	-21	tune2fs	23:44:44	1
19978	99	104	102	cyclictest	16485	-21	tune2fs	22:04:44	1
20002	99	103	102	cyclictest	0	-21	swapper/3	23:44:44	3
20002	99	103	102	cyclictest	0	-21	swapper/3	22:24:50	3
20002	99	103	102	cyclictest	0	-21	swapper/3	22:04:44	3
19978	99	103	102	cyclictest	0	-21	swapper/1	02:28:11	1
20002	99	93	92	cyclictest	0	-21	swapper/3	23:04:48	3
20002	99	93	92	cyclictest	0	-21	swapper/3	22:39:29	3
20002	99	93	92	cyclictest	0	-21	swapper/3	22:29:29	3
20002	99	93	92	cyclictest	0	-21	swapper/3	22:19:30	3
20002	99	93	92	cyclictest	0	-21	swapper/3	21:44:55	3
20002	99	93	92	cyclictest	0	-21	swapper/3	01:44:43	3
20002	99	93	92	cyclictest	0	-21	swapper/3	01:39:21	3
20002	99	93	92	cyclictest	0	-21	swapper/3	00:09:25	3
19978	99	93	92	cyclictest	0	-21	swapper/1	23:39:27	1
20002	99	87	82	cyclictest	0	-21	swapper/3	00:34:39	3
20002	99	84	82	cyclictest	0	-21	swapper/3	01:14:23	3
19978	99	84	82	cyclictest	3680	-21	tune2fs	22:49:43	1
19978	99	84	82	cyclictest	0	-21	swapper/1	01:14:23	1
19978	99	84	72	cyclictest	0	-21	swapper/1	01:24:36	1
20002	99	83	82	cyclictest	0	-21	swapper/3	23:59:40	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:54:40	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:49:41	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:49:41	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:39:39	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:34:40	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:29:43	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:24:43	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:19:43	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:14:40	3
20002	99	83	82	cyclictest	0	-21	swapper/3	23:09:41	3
20002	99	83	82	cyclictest	0	-21	swapper/3	22:59:42	3
20002	99	83	82	cyclictest	0	-21	swapper/3	22:54:40	3
20002	99	83	82	cyclictest	0	-21	swapper/3	22:49:43	3
20002	99	83	82	cyclictest	0	-21	swapper/3	22:44:54	3
20002	99	83	82	cyclictest	0	-21	swapper/3	22:39:42	3
20002	99	83	82	cyclictest	0	-21	swapper/3	22:19:50	3
20002	99	83	82	cyclictest	0	-21	swapper/3	22:09:45	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:59:44	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:54:43	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:49:46	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:39:44	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:34:45	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:29:53	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:24:47	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:19:46	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:15:13	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:09:46	3
20002	99	83	82	cyclictest	0	-21	swapper/3	21:04:57	3
20002	99	83	82	cyclictest	0	-21	swapper/3	20:59:46	3
20002	99	83	82	cyclictest	0	-21	swapper/3	02:24:35	3
20002	99	83	82	cyclictest	0	-21	swapper/3	02:19:33	3
20002	99	83	82	cyclictest	0	-21	swapper/3	02:14:39	3
20002	99	83	82	cyclictest	0	-21	swapper/3	02:09:34	3
20002	99	83	82	cyclictest	0	-21	swapper/3	02:04:36	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:59:36	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:54:41	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:49:33	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:39:35	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:29:36	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:24:35	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:19:37	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:09:38	3
20002	99	83	82	cyclictest	0	-21	swapper/3	01:04:40	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:59:36	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:54:38	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:49:38	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:49:38	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:44:40	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:39:39	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:29:38	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:24:39	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:19:38	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:14:38	3
20002	99	83	82	cyclictest	0	-21	swapper/3	00:09:37	3
19978	99	83	82	cyclictest	0	-21	swapper/1	23:59:40	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:54:46	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:49:45	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:49:45	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:42:45	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:19:42	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:14:40	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:09:41	1
19978	99	83	82	cyclictest	0	-21	swapper/1	23:04:42	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:59:43	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:54:46	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:44:54	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:39:42	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:34:42	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:29:45	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:24:42	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:19:50	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:14:50	1
19978	99	83	82	cyclictest	0	-21	swapper/1	22:09:45	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:59:51	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:54:51	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:49:47	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:44:47	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:39:46	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:34:46	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:29:54	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:24:48	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:19:46	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:15:18	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:09:45	1
19978	99	83	82	cyclictest	0	-21	swapper/1	21:04:58	1
19978	99	83	82	cyclictest	0	-21	swapper/1	20:59:49	1
19978	99	83	82	cyclictest	0	-21	swapper/1	02:19:34	1
19978	99	83	82	cyclictest	0	-21	swapper/1	02:14:36	1
19978	99	83	82	cyclictest	0	-21	swapper/1	02:09:39	1
19978	99	83	82	cyclictest	0	-21	swapper/1	02:04:36	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:59:36	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:54:41	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:49:34	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:44:35	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:39:35	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:34:43	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:29:37	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:19:37	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:09:38	1
19978	99	83	82	cyclictest	0	-21	swapper/1	01:04:44	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:59:37	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:49:38	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:49:38	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:44:37	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:39:42	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:34:40	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:19:39	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:14:45	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:09:38	1
19978	99	83	82	cyclictest	0	-21	swapper/1	00:04:44	1
19978	99	83	81	cyclictest	25105	-21	tune2fs	00:54:39	1
19978	99	83	81	cyclictest	18616	-21	tune2fs	23:24:44	1
19978	99	83	81	cyclictest	14398	-21	tune2fs	00:29:40	1
19978	99	83	81	cyclictest	12251	-21	tune2fs	00:24:40	1
19978	99	73	72	cyclictest	0	-21	swapper/1	23:29:43	1
19987	99	63	61	cyclictest	18150	-21	telnet	22:09:44	2
19987	99	62	61	cyclictest	22548	-21	telnet	23:34:39	2
19987	99	61	60	cyclictest	0	-21	swapper/2	00:19:37	2
19968	99	60	59	cyclictest	0	-21	swapper/0	01:09:37	0
19968	99	60	59	cyclictest	0	-21	swapper/0	00:14:37	0
19968	99	59	52	cyclictest	0	-21	swapper/0	21:41:08	0
19968	99	59	52	cyclictest	0	-21	swapper/0	02:12:02	0
19968	99	59	41	cyclictest	0	-21	swapper/0	23:22:08	0
19968	99	58	57	cyclictest	0	-21	swapper/0	21:24:46	0
19968	99	58	52	cyclictest	0	-21	swapper/0	23:58:35	0
19968	99	58	52	cyclictest	0	-21	swapper/0	21:56:21	0
19968	99	58	52	cyclictest	0	-21	swapper/0	01:57:12	0
19968	99	58	52	cyclictest	0	-21	swapper/0	01:38:15	0
19968	99	58	52	cyclictest	0	-21	swapper/0	01:08:34	0
19968	99	58	52	cyclictest	0	-21	swapper/0	00:36:53	0
19968	99	58	41	cyclictest	0	-21	swapper/0	01:31:01	0
19968	99	58	41	cyclictest	0	-21	swapper/0	00:22:22	0
19968	99	57	56	cyclictest	0	-21	swapper/0	22:34:40	0
19968	99	57	51	cyclictest	0	-21	swapper/0	23:29:16	0
19968	99	57	51	cyclictest	0	-21	swapper/0	22:28:32	0
19968	99	57	51	cyclictest	0	-21	swapper/0	22:13:33	0
19968	99	57	51	cyclictest	0	-21	swapper/0	21:03:35	0
19968	99	57	51	cyclictest	0	-21	swapper/0	01:24:04	0
19968	99	57	51	cyclictest	0	-21	swapper/0	01:03:06	0
19968	99	57	51	cyclictest	0	-21	swapper/0	00:55:21	0
19987	99	54	53	cyclictest	275	-21	usb-storage	02:26:49	2
19987	99	54	53	cyclictest	18	1	ksoftirqd/2	02:23:33	2
19987	99	54	53	cyclictest	18	1	ksoftirqd/2	00:10:00	2
19987	99	54	52	cyclictest	0	-21	swapper/2	22:14:42	2
19968	99	54	53	cyclictest	0	-21	swapper/0	23:09:40	0
19968	99	54	53	cyclictest	0	-21	swapper/0	21:30:41	0
19968	99	54	52	cyclictest	50	50	irq/44-ahci	00:31:02	0
19968	99	54	51	cyclictest	0	-21	swapper/0	23:05:07	0
19987	99	53	52	cyclictest	50	50	irq/44-ahci	22:25:04	2
19987	99	53	52	cyclictest	275	-21	usb-storage	22:01:13	2
19987	99	53	52	cyclictest	1877	-21	hald-addon-stor	00:03:03	2
19987	99	53	52	cyclictest	0	-21	swapper/2	23:56:39	2
19987	99	53	52	cyclictest	0	-21	swapper/2	23:42:15	2
19987	99	53	52	cyclictest	0	-21	swapper/2	23:33:20	2
19987	99	53	52	cyclictest	0	-21	swapper/2	23:24:42	2
19987	99	53	52	cyclictest	0	-21	swapper/2	23:09:40	2
19987	99	53	52	cyclictest	0	-21	swapper/2	22:50:43	2
19987	99	53	52	cyclictest	0	-21	swapper/2	22:29:40	2
19987	99	53	52	cyclictest	0	-21	swapper/2	22:19:49	2
19987	99	53	52	cyclictest	0	-21	swapper/2	22:06:35	2
19987	99	53	52	cyclictest	0	-21	swapper/2	21:54:04	2
19987	99	53	52	cyclictest	0	-21	swapper/2	21:26:07	2
19987	99	53	52	cyclictest	0	-21	swapper/2	21:19:44	2
19987	99	53	52	cyclictest	0	-21	swapper/2	21:15:13	2
19987	99	53	52	cyclictest	0	-21	swapper/2	01:34:35	2
19987	99	53	52	cyclictest	0	-21	swapper/2	01:20:18	2
19987	99	53	52	cyclictest	0	-21	swapper/2	01:10:50	2
19987	99	53	52	cyclictest	0	-21	swapper/2	00:59:35	2
19987	99	53	52	cyclictest	0	-21	swapper/2	00:34:37	2
19987	99	53	52	cyclictest	0	-21	swapper/2	00:32:26	2
19987	99	53	51	cyclictest	7532	-21	telnet	00:14:37	2
19987	99	53	51	cyclictest	50	50	irq/44-ahci	21:46:34	2
19987	99	53	51	cyclictest	50	50	irq/44-ahci	01:55:14	2
19987	99	53	51	cyclictest	50	50	irq/44-ahci	01:39:59	2
19987	99	53	51	cyclictest	29142	-21	telnet	01:04:38	2
19987	99	53	51	cyclictest	28851	-21	telnet	22:34:40	2
19987	99	53	51	cyclictest	22654	-21	telnet	00:49:36	2
19987	99	53	51	cyclictest	22654	-21	telnet	00:49:36	2
19987	99	53	51	cyclictest	20229	-21	telnet	20:59:45	2
19987	99	53	51	cyclictest	18290	-21	aten2.4_r3power	00:39:36	2
19987	99	53	41	cyclictest	1877	-21	hald-addon-stor	21:55:10	2
19987	99	53	41	cyclictest	0	-21	swapper/2	23:02:30	2
19987	99	53	41	cyclictest	0	-21	swapper/2	22:45:28	2
19987	99	53	41	cyclictest	0	-21	swapper/2	21:29:42	2
19987	99	53	41	cyclictest	0	-21	swapper/2	02:19:12	2
19987	99	53	41	cyclictest	0	-21	swapper/2	01:44:33	2
19987	99	53	41	cyclictest	0	-21	swapper/2	01:30:11	2
19987	99	53	41	cyclictest	0	-21	swapper/2	00:44:43	2
19968	99	53	52	cyclictest	745	50	irq/18-parport0	02:14:22	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:59:39	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:49:40	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:49:40	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:44:36	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:39:38	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:34:38	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:29:38	0
19968	99	53	52	cyclictest	0	-21	swapper/0	23:14:39	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:59:51	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:54:38	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:49:34	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:44:30	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:39:41	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:29:40	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:19:43	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:14:41	0
19968	99	53	52	cyclictest	0	-21	swapper/0	22:04:41	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:59:31	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:49:44	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:44:47	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:34:43	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:19:56	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:15:12	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:09:44	0
19968	99	53	52	cyclictest	0	-21	swapper/0	21:04:50	0
19968	99	53	52	cyclictest	0	-21	swapper/0	02:19:32	0
19968	99	53	52	cyclictest	0	-21	swapper/0	02:04:25	0
19968	99	53	52	cyclictest	0	-21	swapper/0	01:59:39	0
19968	99	53	52	cyclictest	0	-21	swapper/0	01:49:32	0
19968	99	53	52	cyclictest	0	-21	swapper/0	01:44:27	0
19968	99	53	52	cyclictest	0	-21	swapper/0	01:39:41	0
19968	99	53	52	cyclictest	0	-21	swapper/0	01:24:26	0
19968	99	53	52	cyclictest	0	-21	swapper/0	01:14:39	0
19968	99	53	52	cyclictest	0	-21	swapper/0	00:44:28	0
19968	99	53	52	cyclictest	0	-21	swapper/0	00:39:35	0
19968	99	53	52	cyclictest	0	-21	swapper/0	00:24:38	0
19968	99	53	52	cyclictest	0	-21	swapper/0	00:09:36	0
19968	99	53	52	cyclictest	0	-21	swapper/0	00:04:35	0
19968	99	53	51	cyclictest	50	50	irq/44-ahci	00:49:24	0
19968	99	53	51	cyclictest	50	50	irq/44-ahci	00:49:24	0
19968	99	53	41	cyclictest	50	50	irq/44-ahci	02:24:20	0
20002	99	52	51	cyclictest	0	-21	swapper/3	20:59:33	3
19987	99	52	51	cyclictest	275	-21	usb-storage	23:49:59	2
19987	99	52	51	cyclictest	275	-21	usb-storage	23:49:59	2
19987	99	52	51	cyclictest	275	-21	usb-storage	23:15:26	2
19987	99	52	51	cyclictest	275	-21	usb-storage	22:55:49	2
19987	99	52	51	cyclictest	275	-21	usb-storage	21:11:55	2
19987	99	52	51	cyclictest	275	-21	usb-storage	00:05:57	2
19987	99	52	51	cyclictest	24781	-21	telnet	00:54:36	2
19987	99	52	51	cyclictest	18	1	ksoftirqd/2	21:39:36	2
19987	99	52	51	cyclictest	0	-21	swapper/2	23:44:49	2
19987	99	52	51	cyclictest	0	-21	swapper/2	23:19:36	2
19987	99	52	51	cyclictest	0	-21	swapper/2	23:04:31	2
19987	99	52	51	cyclictest	0	-21	swapper/2	22:42:54	2
19987	99	52	51	cyclictest	0	-21	swapper/2	21:36:06	2
19987	99	52	51	cyclictest	0	-21	swapper/2	21:04:59	2
19987	99	52	51	cyclictest	0	-21	swapper/2	02:09:22	2
19987	99	52	51	cyclictest	0	-21	swapper/2	02:04:24	2
19987	99	52	51	cyclictest	0	-21	swapper/2	01:59:54	2
19987	99	52	51	cyclictest	0	-21	swapper/2	01:50:13	2
19987	99	52	51	cyclictest	0	-21	swapper/2	01:25:01	2
19987	99	52	51	cyclictest	0	-21	swapper/2	01:14:24	2
19987	99	52	51	cyclictest	0	-21	swapper/2	00:26:30	2
19978	99	42	41	cyclictest	0	-21	swapper/1	20:59:33	1
19987	99	32	31	cyclictest	0	-21	swapper/2	20:59:33	2
19968	99	32	31	cyclictest	0	-21	swapper/0	20:59:33	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17