OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Aug 03, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
28396	99	108	102	cyclictest	11940	-21	tune2fs	06:51:55	1
28396	99	107	92	cyclictest	0	-21	swapper/1	04:07:07	1
28415	99	106	104	cyclictest	32552	-21	sed	08:52:01	3
28415	99	103	102	cyclictest	0	-21	swapper/3	06:32:00	3
28396	99	103	102	cyclictest	24810	-21	tune2fs	04:52:00	1
28396	99	103	102	cyclictest	0	-21	swapper/1	08:49:59	1
28396	99	103	102	cyclictest	0	-21	swapper/1	06:32:00	1
28396	99	103	102	cyclictest	0	-21	swapper/1	04:57:06	1
28396	99	103	102	cyclictest	0	-21	swapper/1	03:57:10	1
28396	99	96	92	cyclictest	0	-21	swapper/1	06:26:56	1
28396	99	93	92	cyclictest	0	-21	swapper/1	06:51:41	1
28396	99	93	92	cyclictest	0	-21	swapper/1	06:22:02	1
28396	99	93	92	cyclictest	0	-21	swapper/1	05:17:06	1
28396	99	93	82	cyclictest	0	-21	swapper/1	08:21:52	1
28396	99	89	72	cyclictest	0	-21	swapper/1	06:41:55	1
28396	99	87	86	cyclictest	0	-21	swapper/1	05:06:58	1
28396	99	87	81	cyclictest	3473	-21	tune2fs	09:01:51	1
28396	99	86	82	cyclictest	0	-21	swapper/1	08:41:55	1
28396	99	86	82	cyclictest	0	-21	swapper/1	07:02:02	1
28396	99	86	82	cyclictest	0	-21	swapper/1	06:04:03	1
28396	99	86	82	cyclictest	0	-21	swapper/1	05:32:00	1
28396	99	86	82	cyclictest	0	-21	swapper/1	04:42:59	1
28396	99	86	82	cyclictest	0	-21	swapper/1	04:02:04	1
28415	99	84	72	cyclictest	0	-21	swapper/3	08:31:48	3
28396	99	84	81	cyclictest	0	-21	swapper/1	07:49:49	1
28396	99	84	81	cyclictest	0	-21	swapper/1	07:21:59	1
28396	99	84	81	cyclictest	0	-21	swapper/1	07:12:04	1
28396	99	84	81	cyclictest	0	-21	swapper/1	06:17:03	1
28415	99	83	82	cyclictest	0	-21	swapper/3	09:11:53	3
28415	99	83	82	cyclictest	0	-21	swapper/3	09:06:58	3
28415	99	83	82	cyclictest	0	-21	swapper/3	09:02:00	3
28415	99	83	82	cyclictest	0	-21	swapper/3	09:00:00	3
28415	99	83	82	cyclictest	0	-21	swapper/3	08:41:58	3
28415	99	83	82	cyclictest	0	-21	swapper/3	08:26:57	3
28415	99	83	82	cyclictest	0	-21	swapper/3	08:16:59	3
28415	99	83	82	cyclictest	0	-21	swapper/3	08:14:53	3
28415	99	83	82	cyclictest	0	-21	swapper/3	08:06:57	3
28415	99	83	82	cyclictest	0	-21	swapper/3	07:51:51	3
28415	99	83	82	cyclictest	0	-21	swapper/3	07:41:58	3
28415	99	83	82	cyclictest	0	-21	swapper/3	07:36:53	3
28415	99	83	82	cyclictest	0	-21	swapper/3	07:29:46	3
28415	99	83	82	cyclictest	0	-21	swapper/3	07:17:01	3
28415	99	83	82	cyclictest	0	-21	swapper/3	07:07:02	3
28415	99	83	82	cyclictest	0	-21	swapper/3	07:01:57	3
28415	99	83	82	cyclictest	0	-21	swapper/3	06:57:03	3
28415	99	83	82	cyclictest	0	-21	swapper/3	06:47:00	3
28415	99	83	82	cyclictest	0	-21	swapper/3	06:26:56	3
28415	99	83	82	cyclictest	0	-21	swapper/3	06:21:56	3
28415	99	83	82	cyclictest	0	-21	swapper/3	06:19:36	3
28415	99	83	82	cyclictest	0	-21	swapper/3	06:02:04	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:52:03	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:47:04	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:46:43	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:39:30	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:27:04	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:22:06	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:17:08	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:14:25	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:07:06	3
28415	99	83	82	cyclictest	0	-21	swapper/3	05:01:46	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:52:06	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:44:20	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:37:02	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:37:02	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:32:03	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:16:47	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:07:07	3
28415	99	83	82	cyclictest	0	-21	swapper/3	04:06:48	3
28415	99	83	82	cyclictest	0	-21	swapper/3	03:57:03	3
28415	99	83	61	cyclictest	0	-21	swapper/3	06:36:53	3
28415	99	83	61	cyclictest	0	-21	swapper/3	05:31:55	3
28415	99	83	61	cyclictest	0	-21	swapper/3	04:26:59	3
28396	99	83	82	cyclictest	0	-21	swapper/1	09:11:56	1
28396	99	83	82	cyclictest	0	-21	swapper/1	09:06:57	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:56:57	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:51:52	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:37:00	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:31:48	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:26:54	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:16:51	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:11:59	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:06:54	1
28396	99	83	82	cyclictest	0	-21	swapper/1	08:01:52	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:56:54	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:51:51	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:41:58	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:36:54	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:32:02	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:26:54	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:16:52	1
28396	99	83	82	cyclictest	0	-21	swapper/1	07:06:59	1
28396	99	83	82	cyclictest	0	-21	swapper/1	06:57:03	1
28396	99	83	82	cyclictest	0	-21	swapper/1	06:36:59	1
28396	99	83	82	cyclictest	0	-21	swapper/1	06:12:01	1
28396	99	83	82	cyclictest	0	-21	swapper/1	06:07:04	1
28396	99	83	82	cyclictest	0	-21	swapper/1	05:52:03	1
28396	99	83	82	cyclictest	0	-21	swapper/1	05:46:56	1
28396	99	83	82	cyclictest	0	-21	swapper/1	05:42:06	1
28396	99	83	82	cyclictest	0	-21	swapper/1	05:37:01	1
28396	99	83	82	cyclictest	0	-21	swapper/1	05:27:05	1
28396	99	83	82	cyclictest	0	-21	swapper/1	05:11:56	1
28396	99	83	82	cyclictest	0	-21	swapper/1	05:02:06	1
28396	99	83	82	cyclictest	0	-21	swapper/1	04:47:03	1
28396	99	83	82	cyclictest	0	-21	swapper/1	04:32:10	1
28396	99	83	82	cyclictest	0	-21	swapper/1	04:27:08	1
28396	99	83	82	cyclictest	0	-21	swapper/1	04:24:16	1
28396	99	83	82	cyclictest	0	-21	swapper/1	04:12:09	1
28396	99	83	82	cyclictest	0	-21	swapper/1	03:52:03	1
28396	99	83	82	cyclictest	0	-21	swapper/1	03:49:10	1
28396	99	83	81	cyclictest	5286	-21	tune2fs	05:22:00	1
28396	99	83	81	cyclictest	20439	-21	tune2fs	05:56:56	1
28415	99	82	81	cyclictest	0	-21	swapper/3	08:36:51	3
28415	99	82	81	cyclictest	0	-21	swapper/3	08:01:53	3
28415	99	82	81	cyclictest	0	-21	swapper/3	07:31:56	3
28415	99	82	81	cyclictest	0	-21	swapper/3	07:21:53	3
28415	99	82	81	cyclictest	0	-21	swapper/3	06:11:58	3
28415	99	82	81	cyclictest	0	-21	swapper/3	03:56:48	3
28396	99	77	61	cyclictest	0	-21	swapper/1	04:16:57	1
28396	99	74	72	cyclictest	0	-21	swapper/1	04:37:02	1
28396	99	74	72	cyclictest	0	-21	swapper/1	04:37:02	1
28415	99	73	72	cyclictest	0	-21	swapper/3	07:51:39	3
28415	99	73	72	cyclictest	0	-21	swapper/3	04:57:10	3
28415	99	73	72	cyclictest	0	-21	swapper/3	04:51:01	3
28415	99	73	71	cyclictest	8368	-21	grep	06:42:00	3
28384	99	68	59	cyclictest	0	-21	swapper/0	04:53:37	0
28384	99	67	59	cyclictest	0	-21	swapper/0	09:05:15	0
28384	99	67	59	cyclictest	0	-21	swapper/0	04:39:31	0
28384	99	67	59	cyclictest	0	-21	swapper/0	04:39:31	0
28415	99	65	62	cyclictest	0	-21	swapper/3	06:52:02	3
28415	99	64	51	cyclictest	0	-21	swapper/3	07:14:43	3
28384	99	64	56	cyclictest	0	-21	swapper/0	08:53:58	0
28384	99	64	56	cyclictest	0	-21	swapper/0	08:38:24	0
28415	99	63	62	cyclictest	0	-21	swapper/3	08:46:38	3
28415	99	63	62	cyclictest	0	-21	swapper/3	08:21:50	3
28415	99	63	62	cyclictest	0	-21	swapper/3	07:56:49	3
28415	99	63	62	cyclictest	0	-21	swapper/3	06:06:55	3
28415	99	63	62	cyclictest	0	-21	swapper/3	04:21:59	3
28415	99	63	62	cyclictest	0	-21	swapper/3	04:16:57	3
28415	99	63	62	cyclictest	0	-21	swapper/3	03:46:59	3
28415	99	63	51	cyclictest	0	-21	swapper/3	05:56:54	3
28396	99	63	62	cyclictest	0	-21	swapper/1	03:46:49	1
28384	99	61	60	cyclictest	0	-21	swapper/0	06:16:22	0
28384	99	61	60	cyclictest	0	-21	swapper/0	04:29:48	0
28384	99	61	60	cyclictest	0	-21	swapper/0	04:14:34	0
28405	99	59	57	cyclictest	20046	-21	telnet	04:41:59	2
28405	99	59	51	cyclictest	278	-21	usb-storage	04:27:08	2
28384	99	59	58	cyclictest	0	-21	swapper/0	06:07:22	0
28384	99	59	58	cyclictest	0	-21	swapper/0	06:02:58	0
28384	99	59	58	cyclictest	0	-21	swapper/0	05:33:09	0
28384	99	59	52	cyclictest	0	-21	swapper/0	05:09:42	0
28384	99	59	42	cyclictest	0	-21	swapper/0	08:45:44	0
28384	99	59	42	cyclictest	0	-21	swapper/0	07:39:01	0
28384	99	58	41	cyclictest	0	-21	swapper/0	07:28:53	0
28384	99	58	41	cyclictest	0	-21	swapper/0	06:55:40	0
28384	99	58	41	cyclictest	0	-21	swapper/0	06:21:50	0
28384	99	58	41	cyclictest	0	-21	swapper/0	05:53:35	0
28384	99	58	41	cyclictest	0	-21	swapper/0	04:05:27	0
28384	99	57	56	cyclictest	0	-21	swapper/0	09:00:04	0
28384	99	57	50	cyclictest	0	-21	swapper/0	07:12:20	0
28384	99	57	50	cyclictest	0	-21	swapper/0	06:43:05	0
28405	99	56	42	cyclictest	0	-21	swapper/2	05:20:48	2
28384	99	56	49	cyclictest	0	-21	swapper/0	03:59:25	0
28384	99	56	41	cyclictest	0	-21	swapper/0	05:37:16	0
28405	99	55	43	cyclictest	18	1	ksoftirqd/2	07:57:12	2
28405	99	55	42	cyclictest	278	-21	usb-storage	04:22:22	2
28384	99	55	48	cyclictest	0	-21	swapper/0	06:58:58	0
28405	99	54	42	cyclictest	278	-21	usb-storage	05:57:19	2
28405	99	54	42	cyclictest	278	-21	usb-storage	05:54:19	2
28405	99	54	42	cyclictest	278	-21	usb-storage	05:08:56	2
28405	99	54	41	cyclictest	50	50	irq/44-ahci	08:42:26	2
28405	99	54	41	cyclictest	2302	-21	lldpd	07:16:40	2
28384	99	54	53	cyclictest	28289	-21	kworker/0:0	09:10:37	0
28384	99	54	53	cyclictest	0	-21	swapper/0	05:16:56	0
28384	99	54	53	cyclictest	0	-21	swapper/0	04:19:44	0
28384	99	54	52	cyclictest	760	50	irq/18-parport0	08:50:14	0
28384	99	54	41	cyclictest	0	-21	swapper/0	06:18:44	0
28405	99	53	52	cyclictest	0	-21	swapper/2	07:41:51	2
28405	99	53	52	cyclictest	0	-21	swapper/2	07:41:35	2
28405	99	53	52	cyclictest	0	-21	swapper/2	06:43:15	2
28405	99	53	52	cyclictest	0	-21	swapper/2	06:15:22	2
28405	99	53	52	cyclictest	0	-21	swapper/2	05:12:26	2
28405	99	53	51	cyclictest	278	-21	usb-storage	07:07:26	2
28405	99	53	41	cyclictest	278	-21	usb-storage	09:04:05	2
28405	99	53	41	cyclictest	1876	-21	hald-addon-stor	07:22:03	2
28405	99	53	41	cyclictest	0	-21	swapper/2	09:13:31	2
28405	99	53	41	cyclictest	0	-21	swapper/2	09:06:49	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:56:47	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:53:46	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:46:46	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:38:02	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:31:59	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:29:15	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:23:47	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:16:57	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:14:15	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:07:46	2
28405	99	53	41	cyclictest	0	-21	swapper/2	08:04:04	2
28405	99	53	41	cyclictest	0	-21	swapper/2	07:52:14	2
28405	99	53	41	cyclictest	0	-21	swapper/2	07:49:40	2
28405	99	53	41	cyclictest	0	-21	swapper/2	07:32:01	2
28405	99	53	41	cyclictest	0	-21	swapper/2	07:30:15	2
28405	99	53	41	cyclictest	0	-21	swapper/2	07:20:07	2
28405	99	53	41	cyclictest	0	-21	swapper/2	07:01:48	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:49:17	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:36:53	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:33:42	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:26:53	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:22:56	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:16:54	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:07:06	2
28405	99	53	41	cyclictest	0	-21	swapper/2	06:02:58	2
28405	99	53	41	cyclictest	0	-21	swapper/2	05:50:13	2
28405	99	53	41	cyclictest	0	-21	swapper/2	05:41:56	2
28405	99	53	41	cyclictest	0	-21	swapper/2	05:38:45	2
28405	99	53	41	cyclictest	0	-21	swapper/2	05:31:56	2
28405	99	53	41	cyclictest	0	-21	swapper/2	05:26:56	2
28405	99	53	41	cyclictest	0	-21	swapper/2	05:23:58	2
28405	99	53	41	cyclictest	0	-21	swapper/2	05:03:07	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:56:47	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:52:34	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:50:05	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:38:58	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:38:58	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:16:54	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:13:48	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:08:43	2
28405	99	53	41	cyclictest	0	-21	swapper/2	04:05:09	2
28405	99	53	41	cyclictest	0	-21	swapper/2	03:56:59	2
28405	99	53	41	cyclictest	0	-21	swapper/2	03:51:57	2
28405	99	53	41	cyclictest	0	-21	swapper/2	03:49:23	2
28384	99	53	52	cyclictest	760	50	irq/18-parport0	09:12:01	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	08:16:45	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	07:18:55	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	07:04:18	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	06:32:13	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	06:27:27	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	05:12:56	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	05:02:01	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	04:59:11	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	04:48:35	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	04:43:15	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	04:35:54	0
28384	99	53	52	cyclictest	760	50	irq/18-parport0	04:08:59	0
28384	99	53	52	cyclictest	30455	-21	kworker/0:0	07:51:43	0
28384	99	53	52	cyclictest	15794	-21	telnet	05:46:56	0
28384	99	53	52	cyclictest	0	-21	swapper/0	08:05:06	0
28384	99	53	52	cyclictest	0	-21	swapper/0	07:47:50	0
28384	99	53	52	cyclictest	0	-21	swapper/0	07:42:11	0
28384	99	53	52	cyclictest	0	-21	swapper/0	07:06:53	0
28384	99	53	52	cyclictest	0	-21	swapper/0	05:59:12	0
28384	99	53	52	cyclictest	0	-21	swapper/0	05:41:57	0
28384	99	53	51	cyclictest	50	50	irq/44-ahci	08:07:13	0
28384	99	53	51	cyclictest	50	50	irq/44-ahci	07:57:47	0
28384	99	53	51	cyclictest	50	50	irq/44-ahci	06:37:16	0
28384	99	53	51	cyclictest	50	50	irq/44-ahci	05:25:20	0
28384	99	53	51	cyclictest	1286	50	irq/46-eth0	08:13:25	0
28384	99	53	41	cyclictest	0	-21	swapper/0	08:34:41	0
28384	99	53	41	cyclictest	0	-21	swapper/0	08:24:05	0
28384	99	53	41	cyclictest	0	-21	swapper/0	07:31:53	0
28384	99	53	41	cyclictest	0	-21	swapper/0	05:27:05	0
28384	99	53	41	cyclictest	0	-21	swapper/0	03:51:59	0
28384	99	53	41	cyclictest	0	-21	swapper/0	03:47:28	0
28405	99	52	51	cyclictest	0	-21	swapper/2	04:32:00	2
28405	99	52	41	cyclictest	0	-21	swapper/2	06:56:54	2
28405	99	52	41	cyclictest	0	-21	swapper/2	06:52:18	2
28384	99	52	51	cyclictest	0	-21	swapper/0	07:21:50	0
28384	99	52	51	cyclictest	0	-21	swapper/0	06:46:53	0
28384	99	52	51	cyclictest	0	-21	swapper/0	04:23:06	0
28384	99	52	41	cyclictest	0	-21	swapper/0	08:26:49	0
28415	99	46	41	cyclictest	28422	-21	latency_hist	03:46:49	3
28405	99	42	41	cyclictest	0	-21	swapper/2	03:46:49	2
28384	99	39	36	cyclictest	0	-21	swapper/0	03:46:49	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17