OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Apr 20, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
30911	99	105	102	cyclictest	10073	-21	tune2fs	05:47:07	1
30911	99	104	102	cyclictest	31364	-21	tune2fs	05:22:07	1
30911	99	104	102	cyclictest	27690	-21	tune2fs	10:11:58	1
30913	99	103	102	cyclictest	0	-21	swapper/3	06:42:13	3
30911	99	103	102	cyclictest	0	-21	swapper/1	10:16:56	1
30911	99	103	102	cyclictest	0	-21	swapper/1	10:07:04	1
30911	99	103	102	cyclictest	0	-21	swapper/1	07:24:39	1
30911	99	103	102	cyclictest	0	-21	swapper/1	07:11:50	1
30911	99	103	102	cyclictest	0	-21	swapper/1	07:02:11	1
30911	99	103	102	cyclictest	0	-21	swapper/1	06:17:16	1
30911	99	97	92	cyclictest	0	-21	swapper/1	09:12:56	1
30911	99	94	92	cyclictest	31196	-21	aten2.4-expect	07:51:59	1
30913	99	93	92	cyclictest	0	-21	swapper/3	09:16:45	3
30913	99	93	92	cyclictest	0	-21	swapper/3	07:11:50	3
30913	99	93	92	cyclictest	0	-21	swapper/3	05:22:07	3
30911	99	93	92	cyclictest	7594	-21	aten2.4-expect	09:26:56	1
30911	99	93	92	cyclictest	5351	-21	aten2.4-expect	08:06:59	1
30911	99	93	92	cyclictest	0	-21	swapper/1	06:02:09	1
30911	99	93	92	cyclictest	0	-21	swapper/1	05:32:14	1
30911	99	89	72	cyclictest	0	-21	swapper/1	09:41:57	1
30911	99	88	82	cyclictest	0	-21	swapper/1	09:51:58	1
30911	99	88	81	cyclictest	0	-21	swapper/1	08:27:04	1
30911	99	87	81	cyclictest	1684	-21	tune2fs	10:26:57	1
30911	99	86	82	cyclictest	0	-21	swapper/1	06:07:16	1
30911	99	86	81	cyclictest	0	-21	swapper/1	08:37:01	1
30911	99	85	81	cyclictest	0	-21	swapper/1	07:57:10	1
30913	99	84	72	cyclictest	15251	-21	sed	05:57:16	3
30911	99	84	82	cyclictest	20909	-21	tune2fs	08:41:58	1
30911	99	84	82	cyclictest	0	-21	swapper/1	08:21:58	1
30911	99	84	81	cyclictest	0	-21	swapper/1	09:57:04	1
30911	99	84	81	cyclictest	0	-21	swapper/1	09:57:04	1
30911	99	84	72	cyclictest	0	-21	swapper/1	08:47:02	1
30913	99	83	82	cyclictest	0	-21	swapper/3	10:46:57	3
30913	99	83	82	cyclictest	0	-21	swapper/3	10:42:03	3
30913	99	83	82	cyclictest	0	-21	swapper/3	10:31:58	3
30913	99	83	82	cyclictest	0	-21	swapper/3	10:21:43	3
30913	99	83	82	cyclictest	0	-21	swapper/3	10:11:58	3
30913	99	83	82	cyclictest	0	-21	swapper/3	10:07:01	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:52:05	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:41:57	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:40:23	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:32:03	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:31:44	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:22:02	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:10:20	3
30913	99	83	82	cyclictest	0	-21	swapper/3	09:02:07	3
30913	99	83	82	cyclictest	0	-21	swapper/3	08:57:02	3
30913	99	83	82	cyclictest	0	-21	swapper/3	08:55:18	3
30913	99	83	82	cyclictest	0	-21	swapper/3	08:37:10	3
30913	99	83	82	cyclictest	0	-21	swapper/3	08:27:07	3
30913	99	83	82	cyclictest	0	-21	swapper/3	08:17:06	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:57:07	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:52:09	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:47:04	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:42:02	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:37:03	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:36:48	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:31:49	3
30913	99	83	82	cyclictest	0	-21	swapper/3	07:22:11	3
30913	99	83	82	cyclictest	0	-21	swapper/3	06:57:11	3
30913	99	83	82	cyclictest	0	-21	swapper/3	06:37:13	3
30913	99	83	82	cyclictest	0	-21	swapper/3	06:17:10	3
30913	99	83	82	cyclictest	0	-21	swapper/3	06:14:30	3
30913	99	83	82	cyclictest	0	-21	swapper/3	06:02:09	3
30913	99	83	82	cyclictest	0	-21	swapper/3	05:54:26	3
30913	99	83	82	cyclictest	0	-21	swapper/3	05:47:14	3
30913	99	83	81	cyclictest	2763	-21	unixbench_singl	10:27:06	3
30913	99	83	71	cyclictest	0	-21	swapper/3	08:41:58	3
30911	99	83	82	cyclictest	0	-21	swapper/1	10:46:57	1
30911	99	83	82	cyclictest	0	-21	swapper/1	10:42:03	1
30911	99	83	82	cyclictest	0	-21	swapper/1	10:31:55	1
30911	99	83	82	cyclictest	0	-21	swapper/1	10:22:03	1
30911	99	83	82	cyclictest	0	-21	swapper/1	09:47:05	1
30911	99	83	82	cyclictest	0	-21	swapper/1	09:31:44	1
30911	99	83	82	cyclictest	0	-21	swapper/1	09:02:07	1
30911	99	83	82	cyclictest	0	-21	swapper/1	08:57:01	1
30911	99	83	82	cyclictest	0	-21	swapper/1	08:52:06	1
30911	99	83	82	cyclictest	0	-21	swapper/1	08:35:15	1
30911	99	83	82	cyclictest	0	-21	swapper/1	08:17:06	1
30911	99	83	82	cyclictest	0	-21	swapper/1	08:12:07	1
30911	99	83	82	cyclictest	0	-21	swapper/1	07:27:11	1
30911	99	83	82	cyclictest	0	-21	swapper/1	07:17:01	1
30911	99	83	82	cyclictest	0	-21	swapper/1	07:16:50	1
30911	99	83	82	cyclictest	0	-21	swapper/1	06:57:11	1
30911	99	83	82	cyclictest	0	-21	swapper/1	06:52:08	1
30911	99	83	82	cyclictest	0	-21	swapper/1	06:37:13	1
30911	99	83	82	cyclictest	0	-21	swapper/1	06:12:13	1
30911	99	83	82	cyclictest	0	-21	swapper/1	05:52:15	1
30911	99	83	82	cyclictest	0	-21	swapper/1	05:42:14	1
30911	99	83	82	cyclictest	0	-21	swapper/1	05:37:14	1
30911	99	83	81	cyclictest	31824	-21	tune2fs	09:06:59	1
30911	99	83	81	cyclictest	29632	-21	tune2fs	07:47:04	1
30911	99	83	81	cyclictest	27209	-21	tune2fs	07:42:02	1
30911	99	83	81	cyclictest	27202	-21	tune2fs	06:27:06	1
30911	99	83	81	cyclictest	25130	-21	tune2fs	07:37:03	1
30911	99	83	81	cyclictest	22940	-21	tune2fs	07:32:04	1
30911	99	83	81	cyclictest	1451	-21	tune2fs	06:42:05	1
30911	99	83	81	cyclictest	1166	-21	tune2fs	05:27:07	1
30911	99	83	72	cyclictest	0	-21	swapper/1	06:32:11	1
30911	99	83	71	cyclictest	0	-21	swapper/1	08:02:05	1
30913	99	82	81	cyclictest	0	-21	swapper/3	05:42:07	3
30913	99	82	81	cyclictest	0	-21	swapper/3	05:27:07	3
30911	99	82	81	cyclictest	0	-21	swapper/1	09:17:06	1
30911	99	76	72	cyclictest	0	-21	swapper/1	10:01:55	1
30911	99	76	72	cyclictest	0	-21	swapper/1	06:47:10	1
30911	99	76	72	cyclictest	0	-21	swapper/1	06:22:08	1
30911	99	76	72	cyclictest	0	-21	swapper/1	05:57:04	1
30911	99	75	71	cyclictest	0	-21	swapper/1	09:21:56	1
30911	99	74	71	cyclictest	0	-21	swapper/1	09:40:23	1
30913	99	73	72	cyclictest	0	-21	swapper/3	10:22:03	3
30913	99	73	72	cyclictest	0	-21	swapper/3	08:47:09	3
30913	99	73	72	cyclictest	0	-21	swapper/3	08:35:15	3
30913	99	73	72	cyclictest	0	-21	swapper/3	08:15:12	3
30913	99	73	72	cyclictest	0	-21	swapper/3	07:17:10	3
30913	99	73	72	cyclictest	0	-21	swapper/3	06:32:11	3
30913	99	73	72	cyclictest	0	-21	swapper/3	06:22:13	3
30913	99	73	72	cyclictest	0	-21	swapper/3	06:07:04	3
30913	99	73	71	cyclictest	3094	-21	aten2.4-expect	06:47:03	3
30911	99	73	72	cyclictest	0	-21	swapper/1	10:36:53	1
30913	99	72	71	cyclictest	0	-21	swapper/3	09:56:58	3
30913	99	72	71	cyclictest	0	-21	swapper/3	09:56:58	3
30913	99	72	71	cyclictest	0	-21	swapper/3	08:22:02	3
30913	99	72	71	cyclictest	0	-21	swapper/3	05:32:05	3
30912	99	67	60	cyclictest	0	-21	swapper/2	09:38:01	2
30912	99	66	51	cyclictest	0	-21	swapper/2	09:11:54	2
30912	99	66	41	cyclictest	0	-21	swapper/2	10:01:59	2
30912	99	66	41	cyclictest	0	-21	swapper/2	08:51:58	2
30912	99	65	61	cyclictest	0	-21	swapper/2	07:35:06	2
30912	99	64	51	cyclictest	278	-21	usb-storage	09:03:05	2
30912	99	64	50	cyclictest	0	-21	swapper/2	08:36:26	2
30912	99	64	49	cyclictest	0	-21	swapper/2	08:22:24	2
30912	99	64	49	cyclictest	0	-21	swapper/2	06:16:40	2
30913	99	63	62	cyclictest	0	-21	swapper/3	10:36:42	3
30913	99	63	62	cyclictest	0	-21	swapper/3	09:46:54	3
30913	99	63	62	cyclictest	0	-21	swapper/3	09:16:56	3
30913	99	63	62	cyclictest	0	-21	swapper/3	08:06:59	3
30913	99	63	62	cyclictest	0	-21	swapper/3	08:02:00	3
30913	99	63	62	cyclictest	0	-21	swapper/3	07:12:00	3
30913	99	63	62	cyclictest	0	-21	swapper/3	07:02:01	3
30913	99	63	62	cyclictest	0	-21	swapper/3	06:52:03	3
30913	99	63	62	cyclictest	0	-21	swapper/3	06:27:03	3
30913	99	63	62	cyclictest	0	-21	swapper/3	05:37:05	3
30913	99	63	51	cyclictest	0	-21	swapper/3	10:01:57	3
30910	99	63	62	cyclictest	0	-21	swapper/0	10:46:54	0
30910	99	61	60	cyclictest	0	-21	swapper/0	08:07:00	0
30912	99	59	51	cyclictest	0	-21	swapper/2	07:18:25	2
30910	99	59	41	cyclictest	0	-21	swapper/0	06:39:24	0
30912	99	58	53	cyclictest	5455	-21	telnet	09:21:57	2
30912	99	58	53	cyclictest	0	-21	swapper/2	09:17:48	2
30912	99	58	51	cyclictest	0	-21	swapper/2	10:47:23	2
30912	99	58	51	cyclictest	0	-21	swapper/2	08:12:00	2
30912	99	58	42	cyclictest	27713	-21	hddtemp_smartct	08:57:00	2
30912	99	58	41	cyclictest	0	-21	swapper/2	07:02:21	2
30910	99	58	51	cyclictest	0	-21	swapper/0	08:28:38	0
30910	99	58	41	cyclictest	0	-21	swapper/0	09:27:20	0
30910	99	58	41	cyclictest	0	-21	swapper/0	09:22:38	0
30910	99	58	41	cyclictest	0	-21	swapper/0	08:19:30	0
30910	99	58	41	cyclictest	0	-21	swapper/0	06:05:31	0
30912	99	57	53	cyclictest	0	-21	swapper/2	10:29:14	2
30912	99	57	53	cyclictest	0	-21	swapper/2	09:33:02	2
30912	99	57	53	cyclictest	0	-21	swapper/2	07:59:41	2
30912	99	57	53	cyclictest	0	-21	swapper/2	07:49:42	2
30912	99	57	53	cyclictest	0	-21	swapper/2	07:42:01	2
30912	99	57	53	cyclictest	0	-21	swapper/2	06:56:14	2
30912	99	57	53	cyclictest	0	-21	swapper/2	06:47:03	2
30912	99	57	53	cyclictest	0	-21	swapper/2	05:55:54	2
30912	99	57	53	cyclictest	0	-21	swapper/2	05:27:04	2
30912	99	57	52	cyclictest	278	-21	usb-storage	09:28:32	2
30912	99	57	52	cyclictest	0	-21	swapper/2	06:37:03	2
30912	99	57	52	cyclictest	0	-21	swapper/2	05:57:03	2
30912	99	57	52	cyclictest	0	-21	swapper/2	05:37:05	2
30912	99	57	32	cyclictest	0	-21	swapper/2	08:05:17	2
30912	99	57	31	cyclictest	0	-21	swapper/2	09:07:01	2
30910	99	57	56	cyclictest	0	-21	swapper/0	07:34:57	0
30912	99	56	52	cyclictest	0	-21	swapper/2	08:41:55	2
30912	99	56	52	cyclictest	0	-21	swapper/2	08:26:58	2
30912	99	56	52	cyclictest	0	-21	swapper/2	06:23:49	2
30912	99	56	51	cyclictest	50	50	irq/44-ahci	05:36:09	2
30912	99	56	51	cyclictest	31051	-21	telnet	05:22:05	2
30912	99	56	51	cyclictest	278	-21	usb-storage	10:35:45	2
30912	99	56	51	cyclictest	278	-21	usb-storage	09:58:59	2
30912	99	56	51	cyclictest	278	-21	usb-storage	09:58:59	2
30912	99	56	51	cyclictest	278	-21	usb-storage	08:07:29	2
30912	99	56	51	cyclictest	278	-21	usb-storage	05:43:26	2
30912	99	56	51	cyclictest	1876	-21	hald-addon-stor	07:10:07	2
30912	99	56	51	cyclictest	1876	-21	hald-addon-stor	06:06:53	2
30912	99	56	51	cyclictest	0	-21	swapper/2	10:37:27	2
30912	99	56	51	cyclictest	0	-21	swapper/2	09:56:41	2
30912	99	56	51	cyclictest	0	-21	swapper/2	08:17:00	2
30912	99	56	51	cyclictest	0	-21	swapper/2	07:51:59	2
30912	99	56	51	cyclictest	0	-21	swapper/2	06:18:49	2
30912	99	56	51	cyclictest	0	-21	swapper/2	05:47:38	2
30912	99	56	41	cyclictest	0	-21	swapper/2	10:06:55	2
30912	99	56	41	cyclictest	0	-21	swapper/2	08:37:02	2
30912	99	56	41	cyclictest	0	-21	swapper/2	06:03:10	2
30912	99	55	51	cyclictest	50	50	irq/44-ahci	07:27:26	2
30912	99	55	51	cyclictest	0	-21	swapper/2	10:42:29	2
30912	99	55	51	cyclictest	0	-21	swapper/2	10:23:14	2
30912	99	55	51	cyclictest	0	-21	swapper/2	10:16:53	2
30912	99	55	51	cyclictest	0	-21	swapper/2	10:11:46	2
30912	99	55	51	cyclictest	0	-21	swapper/2	09:48:09	2
30912	99	55	51	cyclictest	0	-21	swapper/2	09:45:39	2
30912	99	55	51	cyclictest	0	-21	swapper/2	08:49:39	2
30912	99	55	51	cyclictest	0	-21	swapper/2	07:37:04	2
30912	99	55	51	cyclictest	0	-21	swapper/2	07:21:51	2
30912	99	55	51	cyclictest	0	-21	swapper/2	07:12:01	2
30912	99	55	51	cyclictest	0	-21	swapper/2	07:00:17	2
30912	99	55	51	cyclictest	0	-21	swapper/2	06:43:40	2
30912	99	55	51	cyclictest	0	-21	swapper/2	06:27:11	2
30912	99	55	41	cyclictest	0	-21	swapper/2	06:32:08	2
30910	99	55	54	cyclictest	0	-21	swapper/0	07:42:01	0
30910	99	54	53	cyclictest	0	-21	swapper/0	10:45:09	0
30910	99	54	52	cyclictest	760	50	irq/18-parport0	06:28:43	0
30910	99	54	52	cyclictest	760	50	irq/18-parport0	05:25:49	0
30910	99	53	52	cyclictest	760	50	irq/18-parport0	10:33:21	0
30910	99	53	52	cyclictest	760	50	irq/18-parport0	10:11:50	0
30910	99	53	52	cyclictest	760	50	irq/18-parport0	08:02:37	0
30910	99	53	52	cyclictest	3	1	ksoftirqd/0	05:47:40	0
30910	99	53	52	cyclictest	0	-21	swapper/0	10:37:32	0
30910	99	53	52	cyclictest	0	-21	swapper/0	10:26:06	0
30910	99	53	52	cyclictest	0	-21	swapper/0	10:01:54	0
30910	99	53	52	cyclictest	0	-21	swapper/0	09:56:56	0
30910	99	53	52	cyclictest	0	-21	swapper/0	09:56:56	0
30910	99	53	52	cyclictest	0	-21	swapper/0	09:42:35	0
30910	99	53	52	cyclictest	0	-21	swapper/0	09:37:03	0
30910	99	53	52	cyclictest	0	-21	swapper/0	09:32:26	0
30910	99	53	52	cyclictest	0	-21	swapper/0	09:16:57	0
30910	99	53	52	cyclictest	0	-21	swapper/0	09:09:44	0
30910	99	53	52	cyclictest	0	-21	swapper/0	08:48:27	0
30910	99	53	52	cyclictest	0	-21	swapper/0	08:44:27	0
30910	99	53	52	cyclictest	0	-21	swapper/0	08:37:55	0
30910	99	53	52	cyclictest	0	-21	swapper/0	08:25:45	0
30910	99	53	52	cyclictest	0	-21	swapper/0	08:11:58	0
30910	99	53	52	cyclictest	0	-21	swapper/0	07:57:01	0
30910	99	53	52	cyclictest	0	-21	swapper/0	07:52:58	0
30910	99	53	52	cyclictest	0	-21	swapper/0	07:37:01	0
30910	99	53	52	cyclictest	0	-21	swapper/0	07:27:02	0
30910	99	53	52	cyclictest	0	-21	swapper/0	07:20:19	0
30910	99	53	52	cyclictest	0	-21	swapper/0	07:09:15	0
30910	99	53	52	cyclictest	0	-21	swapper/0	07:01:59	0
30910	99	53	52	cyclictest	0	-21	swapper/0	06:58:39	0
30910	99	53	52	cyclictest	0	-21	swapper/0	06:52:46	0
30910	99	53	52	cyclictest	0	-21	swapper/0	06:47:48	0
30910	99	53	52	cyclictest	0	-21	swapper/0	06:36:36	0
30910	99	53	52	cyclictest	0	-21	swapper/0	06:26:21	0
30910	99	53	52	cyclictest	0	-21	swapper/0	06:14:49	0
30910	99	53	52	cyclictest	0	-21	swapper/0	05:57:04	0
30910	99	53	52	cyclictest	0	-21	swapper/0	05:52:06	0
30910	99	53	52	cyclictest	0	-21	swapper/0	05:41:54	0
30910	99	53	52	cyclictest	0	-21	swapper/0	05:32:04	0
30910	99	53	51	cyclictest	760	50	irq/18-parport0	10:06:52	0
30910	99	53	42	cyclictest	0	-21	swapper/0	07:12:03	0
30910	99	53	41	cyclictest	0	-21	swapper/0	09:13:04	0
30910	99	53	41	cyclictest	0	-21	swapper/0	09:01:58	0
30910	99	53	41	cyclictest	0	-21	swapper/0	06:17:04	0
30910	99	53	41	cyclictest	0	-21	swapper/0	06:09:21	0
30910	99	53	41	cyclictest	0	-21	swapper/0	05:37:04	0
30910	99	52	51	cyclictest	0	-21	swapper/0	10:26:46	0
30910	99	52	51	cyclictest	0	-21	swapper/0	10:17:42	0
30910	99	52	51	cyclictest	0	-21	swapper/0	09:55:41	0
30910	99	52	51	cyclictest	0	-21	swapper/0	09:47:19	0
30910	99	52	51	cyclictest	0	-21	swapper/0	08:57:42	0
30910	99	52	51	cyclictest	0	-21	swapper/0	08:51:57	0
30910	99	52	51	cyclictest	0	-21	swapper/0	08:32:21	0
30910	99	52	51	cyclictest	0	-21	swapper/0	07:47:01	0
30910	99	52	51	cyclictest	0	-21	swapper/0	07:22:06	0
30910	99	52	51	cyclictest	0	-21	swapper/0	06:42:02	0
30910	99	52	51	cyclictest	0	-21	swapper/0	05:30:09	0
50	50	12	0	irq/44-ahci	18	1	ksoftirqd/2	05:21:38	2
1286	50	11	0	irq/46-eth0	30052	-21	taskset	05:17:14	0
12	1	10	0	ksoftirqd/1	0	-21	swapper/1	05:17:10	1
23	1	6	0	ksoftirqd/3	28708	-21	aten2.4_r3power	05:17:05	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17