OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Fri Apr 24, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3734	99	108	92	cyclictest	0	-21	swapper/1	07:38:33	1
3734	99	108	92	cyclictest	0	-21	swapper/1	06:48:28	1
3734	99	104	102	cyclictest	4337	-21	tune2fs	06:33:27	1
3734	99	104	102	cyclictest	4337	-21	tune2fs	06:33:27	1
3736	99	103	102	cyclictest	0	-21	swapper/3	05:18:29	3
3734	99	103	102	cyclictest	0	-21	swapper/1	07:15:32	1
3734	99	103	102	cyclictest	0	-21	swapper/1	07:10:32	1
3734	99	103	102	cyclictest	0	-21	swapper/1	06:55:30	1
3734	99	95	91	cyclictest	0	-21	swapper/1	06:59:22	1
3734	99	93	92	cyclictest	0	-21	swapper/1	09:45:52	1
3734	99	93	82	cyclictest	0	-21	swapper/1	09:13:20	1
3734	99	89	72	cyclictest	0	-21	swapper/1	10:03:20	1
3736	99	88	83	cyclictest	0	-21	swapper/3	08:59:51	3
3736	99	88	82	cyclictest	0	-21	swapper/3	10:23:18	3
3736	99	88	82	cyclictest	0	-21	swapper/3	10:23:18	3
3736	99	88	82	cyclictest	0	-21	swapper/3	08:28:09	3
3736	99	88	82	cyclictest	0	-21	swapper/3	07:53:24	3
3734	99	88	81	cyclictest	11359	-21	tune2fs	10:33:18	1
3736	99	87	82	cyclictest	0	-21	swapper/3	08:41:42	3
3736	99	87	82	cyclictest	0	-21	swapper/3	08:13:23	3
3736	99	87	82	cyclictest	0	-21	swapper/3	07:23:23	3
3736	99	87	82	cyclictest	0	-21	swapper/3	07:08:25	3
3736	99	87	81	cyclictest	0	-21	swapper/3	10:43:26	3
3734	99	87	81	cyclictest	7016	-21	tune2fs	10:23:18	1
3734	99	87	81	cyclictest	7016	-21	tune2fs	10:23:18	1
3734	99	87	81	cyclictest	15247	-21	tune2fs	08:13:23	1
3736	99	86	82	cyclictest	0	-21	swapper/3	06:48:34	3
3736	99	86	71	cyclictest	0	-21	swapper/3	07:50:37	3
3734	99	86	82	cyclictest	0	-21	swapper/1	09:40:40	1
3734	99	86	82	cyclictest	0	-21	swapper/1	09:23:18	1
3734	99	86	82	cyclictest	0	-21	swapper/1	08:53:28	1
3734	99	86	82	cyclictest	0	-21	swapper/1	08:52:05	1
3734	99	86	82	cyclictest	0	-21	swapper/1	08:43:32	1
3734	99	86	82	cyclictest	0	-21	swapper/1	08:40:32	1
3734	99	86	82	cyclictest	0	-21	swapper/1	08:06:33	1
3734	99	86	82	cyclictest	0	-21	swapper/1	07:03:52	1
3734	99	86	82	cyclictest	0	-21	swapper/1	05:58:36	1
3734	99	86	82	cyclictest	0	-21	swapper/1	05:38:30	1
3734	99	86	82	cyclictest	0	-21	swapper/1	05:18:22	1
3734	99	84	82	cyclictest	4655	-21	tune2fs	10:18:19	1
3734	99	84	82	cyclictest	0	-21	swapper/1	07:53:30	1
3734	99	84	82	cyclictest	0	-21	swapper/1	06:25:25	1
3734	99	84	72	cyclictest	0	-21	swapper/1	08:59:51	1
3736	99	83	82	cyclictest	0	-21	swapper/3	10:33:04	3
3736	99	83	82	cyclictest	0	-21	swapper/3	10:08:18	3
3736	99	83	82	cyclictest	0	-21	swapper/3	10:05:56	3
3736	99	83	82	cyclictest	0	-21	swapper/3	09:43:26	3
3736	99	83	82	cyclictest	0	-21	swapper/3	09:38:20	3
3736	99	83	82	cyclictest	0	-21	swapper/3	09:28:20	3
3736	99	83	82	cyclictest	0	-21	swapper/3	08:33:22	3
3736	99	83	82	cyclictest	0	-21	swapper/3	08:08:22	3
3736	99	83	82	cyclictest	0	-21	swapper/3	08:08:22	3
3736	99	83	82	cyclictest	0	-21	swapper/3	07:58:31	3
3736	99	83	82	cyclictest	0	-21	swapper/3	07:43:28	3
3736	99	83	82	cyclictest	0	-21	swapper/3	07:18:31	3
3736	99	83	82	cyclictest	0	-21	swapper/3	06:53:34	3
3736	99	83	82	cyclictest	0	-21	swapper/3	06:41:17	3
3736	99	83	82	cyclictest	0	-21	swapper/3	06:08:35	3
3736	99	83	82	cyclictest	0	-21	swapper/3	05:26:31	3
3734	99	83	82	cyclictest	0	-21	swapper/1	10:38:24	1
3734	99	83	82	cyclictest	0	-21	swapper/1	10:08:17	1
3734	99	83	82	cyclictest	0	-21	swapper/1	09:53:09	1
3734	99	83	82	cyclictest	0	-21	swapper/1	09:48:26	1
3734	99	83	82	cyclictest	0	-21	swapper/1	09:28:20	1
3734	99	83	82	cyclictest	0	-21	swapper/1	09:18:26	1
3734	99	83	82	cyclictest	0	-21	swapper/1	09:08:25	1
3734	99	83	82	cyclictest	0	-21	swapper/1	09:03:23	1
3734	99	83	82	cyclictest	0	-21	swapper/1	08:33:22	1
3734	99	83	82	cyclictest	0	-21	swapper/1	08:28:21	1
3734	99	83	82	cyclictest	0	-21	swapper/1	08:18:29	1
3734	99	83	82	cyclictest	0	-21	swapper/1	08:08:23	1
3734	99	83	82	cyclictest	0	-21	swapper/1	08:08:23	1
3734	99	83	82	cyclictest	0	-21	swapper/1	07:58:30	1
3734	99	83	82	cyclictest	0	-21	swapper/1	07:48:21	1
3734	99	83	82	cyclictest	0	-21	swapper/1	07:43:31	1
3734	99	83	82	cyclictest	0	-21	swapper/1	07:33:25	1
3734	99	83	82	cyclictest	0	-21	swapper/1	07:28:23	1
3734	99	83	82	cyclictest	0	-21	swapper/1	07:23:29	1
3734	99	83	82	cyclictest	0	-21	swapper/1	07:18:31	1
3734	99	83	82	cyclictest	0	-21	swapper/1	06:43:33	1
3734	99	83	82	cyclictest	0	-21	swapper/1	06:38:31	1
3734	99	83	82	cyclictest	0	-21	swapper/1	06:28:25	1
3734	99	83	82	cyclictest	0	-21	swapper/1	06:13:34	1
3734	99	83	82	cyclictest	0	-21	swapper/1	06:08:35	1
3734	99	83	82	cyclictest	0	-21	swapper/1	06:03:36	1
3734	99	83	82	cyclictest	0	-21	swapper/1	05:53:35	1
3734	99	83	82	cyclictest	0	-21	swapper/1	05:48:37	1
3734	99	83	82	cyclictest	0	-21	swapper/1	05:43:29	1
3734	99	83	82	cyclictest	0	-21	swapper/1	05:33:36	1
3734	99	83	82	cyclictest	0	-21	swapper/1	05:28:37	1
3734	99	83	81	cyclictest	6353	-21	tune2fs	05:23:30	1
3734	99	83	81	cyclictest	30426	-21	tune2fs	06:18:28	1
3736	99	82	81	cyclictest	0	-21	swapper/3	10:18:19	3
3736	99	82	81	cyclictest	0	-21	swapper/3	09:13:28	3
3736	99	82	81	cyclictest	0	-21	swapper/3	08:48:22	3
3736	99	82	81	cyclictest	0	-21	swapper/3	08:43:24	3
3736	99	82	81	cyclictest	0	-21	swapper/3	07:28:25	3
3736	99	82	81	cyclictest	0	-21	swapper/3	07:13:26	3
3736	99	82	81	cyclictest	0	-21	swapper/3	06:33:27	3
3736	99	82	81	cyclictest	0	-21	swapper/3	06:33:27	3
3734	99	75	61	cyclictest	0	-21	swapper/1	09:58:21	1
3736	99	73	72	cyclictest	0	-21	swapper/3	08:03:28	3
3736	99	73	72	cyclictest	0	-21	swapper/3	06:58:23	3
3736	99	73	72	cyclictest	0	-21	swapper/3	06:05:23	3
3736	99	73	61	cyclictest	10524	-21	df_abs	05:33:28	3
3734	99	73	72	cyclictest	0	-21	swapper/1	10:43:21	1
3734	99	73	72	cyclictest	0	-21	swapper/1	10:28:17	1
3734	99	73	72	cyclictest	0	-21	swapper/1	10:13:28	1
3734	99	73	72	cyclictest	0	-21	swapper/1	09:33:20	1
3734	99	73	72	cyclictest	0	-21	swapper/1	08:23:19	1
3736	99	72	71	cyclictest	0	-21	swapper/3	10:33:18	3
3736	99	72	71	cyclictest	0	-21	swapper/3	09:23:21	3
3736	99	72	71	cyclictest	0	-21	swapper/3	06:28:27	3
3736	99	72	71	cyclictest	0	-21	swapper/3	06:23:35	3
3736	99	72	71	cyclictest	0	-21	swapper/3	06:18:28	3
3736	99	72	71	cyclictest	0	-21	swapper/3	05:38:36	3
3736	99	69	67	cyclictest	20246	-21	sendmail_mailqu	05:53:35	3
3736	99	67	62	cyclictest	0	-21	swapper/3	07:38:24	3
3736	99	66	62	cyclictest	0	-21	swapper/3	09:33:27	3
3735	99	64	41	cyclictest	278	-21	usb-storage	09:22:25	2
3735	99	64	41	cyclictest	278	-21	usb-storage	07:23:47	2
3736	99	63	62	cyclictest	0	-21	swapper/3	10:38:16	3
3736	99	63	62	cyclictest	0	-21	swapper/3	10:13:05	3
3736	99	63	62	cyclictest	0	-21	swapper/3	09:58:06	3
3736	99	63	62	cyclictest	0	-21	swapper/3	09:53:12	3
3736	99	63	62	cyclictest	0	-21	swapper/3	09:48:22	3
3736	99	63	62	cyclictest	0	-21	swapper/3	09:18:18	3
3736	99	63	62	cyclictest	0	-21	swapper/3	09:08:19	3
3736	99	63	62	cyclictest	0	-21	swapper/3	09:03:08	3
3736	99	63	62	cyclictest	0	-21	swapper/3	08:53:18	3
3736	99	63	62	cyclictest	0	-21	swapper/3	08:28:23	3
3736	99	63	62	cyclictest	0	-21	swapper/3	08:18:23	3
3736	99	63	62	cyclictest	0	-21	swapper/3	07:33:25	3
3736	99	63	62	cyclictest	0	-21	swapper/3	07:03:23	3
3736	99	63	62	cyclictest	0	-21	swapper/3	06:43:24	3
3736	99	63	62	cyclictest	0	-21	swapper/3	06:13:27	3
3736	99	63	62	cyclictest	0	-21	swapper/3	05:58:26	3
3736	99	63	62	cyclictest	0	-21	swapper/3	05:48:15	3
3736	99	63	62	cyclictest	0	-21	swapper/3	05:43:27	3
3736	99	63	62	cyclictest	0	-21	swapper/3	05:28:31	3
3735	99	63	62	cyclictest	0	-21	swapper/2	08:30:05	2
3735	99	63	62	cyclictest	0	-21	swapper/2	06:17:16	2
3735	99	63	61	cyclictest	278	-21	usb-storage	08:11:27	2
3735	99	63	61	cyclictest	278	-21	usb-storage	08:11:27	2
3735	99	63	51	cyclictest	278	-21	usb-storage	06:09:12	2
3735	99	62	61	cyclictest	0	-21	swapper/2	10:33:50	2
3735	99	62	61	cyclictest	0	-21	swapper/2	10:03:41	2
3735	99	62	61	cyclictest	0	-21	swapper/2	09:43:14	2
3735	99	62	61	cyclictest	0	-21	swapper/2	08:37:38	2
3735	99	62	61	cyclictest	0	-21	swapper/2	08:03:56	2
3735	99	62	61	cyclictest	0	-21	swapper/2	07:56:00	2
3735	99	62	61	cyclictest	0	-21	swapper/2	07:52:20	2
3735	99	62	61	cyclictest	0	-21	swapper/2	06:07:46	2
3735	99	62	61	cyclictest	0	-21	swapper/2	06:02:46	2
3735	99	62	61	cyclictest	0	-21	swapper/2	05:30:17	2
3735	99	62	61	cyclictest	0	-21	swapper/2	05:26:23	2
3735	99	62	51	cyclictest	278	-21	usb-storage	06:39:15	2
3735	99	62	50	cyclictest	0	-21	swapper/2	10:02:05	2
3735	99	62	50	cyclictest	0	-21	swapper/2	08:59:37	2
3735	99	61	60	cyclictest	0	-21	swapper/2	10:21:04	2
3735	99	61	60	cyclictest	0	-21	swapper/2	09:40:46	2
3735	99	61	60	cyclictest	0	-21	swapper/2	09:36:08	2
3735	99	61	60	cyclictest	0	-21	swapper/2	08:52:38	2
3735	99	61	60	cyclictest	0	-21	swapper/2	08:15:19	2
3735	99	61	60	cyclictest	0	-21	swapper/2	07:43:10	2
3735	99	61	60	cyclictest	0	-21	swapper/2	07:32:37	2
3735	99	61	60	cyclictest	0	-21	swapper/2	05:51:07	2
3735	99	61	60	cyclictest	0	-21	swapper/2	05:37:17	2
3735	99	61	59	cyclictest	278	-21	usb-storage	06:29:35	2
3735	99	61	59	cyclictest	0	-21	swapper/2	06:44:51	2
3735	99	61	49	cyclictest	278	-21	usb-storage	07:47:30	2
3735	99	60	59	cyclictest	0	-21	swapper/2	10:48:03	2
3735	99	60	59	cyclictest	0	-21	swapper/2	09:57:55	2
3735	99	60	59	cyclictest	0	-21	swapper/2	09:03:15	2
3735	99	60	59	cyclictest	0	-21	swapper/2	08:01:30	2
3735	99	60	59	cyclictest	0	-21	swapper/2	07:18:01	2
3735	99	60	59	cyclictest	0	-21	swapper/2	05:47:41	2
3735	99	59	58	cyclictest	0	-21	swapper/2	10:29:26	2
3735	99	59	58	cyclictest	0	-21	swapper/2	09:11:15	2
3735	99	59	58	cyclictest	0	-21	swapper/2	08:26:11	2
3735	99	59	58	cyclictest	0	-21	swapper/2	08:19:37	2
3735	99	59	58	cyclictest	0	-21	swapper/2	07:10:40	2
3735	99	59	58	cyclictest	0	-21	swapper/2	06:21:35	2
3735	99	58	57	cyclictest	0	-21	swapper/2	10:16:07	2
3735	99	58	57	cyclictest	0	-21	swapper/2	09:27:02	2
3735	99	58	57	cyclictest	0	-21	swapper/2	08:42:38	2
3735	99	58	57	cyclictest	0	-21	swapper/2	05:54:20	2
3735	99	58	56	cyclictest	278	-21	usb-storage	07:22:31	2
3735	99	57	56	cyclictest	0	-21	swapper/2	10:42:14	2
3735	99	57	56	cyclictest	0	-21	swapper/2	06:56:34	2
3735	99	57	55	cyclictest	278	-21	usb-storage	07:37:59	2
3735	99	56	55	cyclictest	0	-21	swapper/2	06:23:59	2
3735	99	55	54	cyclictest	0	-21	swapper/2	10:24:50	2
3735	99	55	54	cyclictest	0	-21	swapper/2	10:24:50	2
3735	99	55	54	cyclictest	0	-21	swapper/2	08:57:00	2
3735	99	54	53	cyclictest	0	-21	swapper/2	07:03:40	2
3733	99	54	53	cyclictest	0	-21	swapper/0	07:23:23	0
3733	99	54	29	cyclictest	0	-21	swapper/0	09:49:20	0
3735	99	53	51	cyclictest	50	50	irq/44-ahci	10:09:43	2
3735	99	53	51	cyclictest	50	50	irq/44-ahci	08:43:09	2
3735	99	53	51	cyclictest	50	50	irq/44-ahci	06:58:18	2
3735	99	53	51	cyclictest	15004	-21	telnet	09:28:18	2
3735	99	53	48	cyclictest	0	-21	swapper/2	06:52:10	2
3735	99	53	41	cyclictest	278	-21	usb-storage	05:18:42	2
3735	99	53	41	cyclictest	0	-21	swapper/2	09:49:44	2
3735	99	53	41	cyclictest	0	-21	swapper/2	09:13:19	2
3735	99	53	41	cyclictest	0	-21	swapper/2	06:34:00	2
3735	99	53	41	cyclictest	0	-21	swapper/2	06:34:00	2
3735	99	53	41	cyclictest	0	-21	swapper/2	05:40:03	2
3733	99	53	52	cyclictest	760	50	irq/18-parport0	09:27:48	0
3733	99	53	52	cyclictest	760	50	irq/18-parport0	08:59:39	0
3733	99	53	52	cyclictest	760	50	irq/18-parport0	08:28:59	0
3733	99	53	52	cyclictest	760	50	irq/18-parport0	07:19:19	0
3733	99	53	52	cyclictest	760	50	irq/18-parport0	06:18:22	0
3733	99	53	52	cyclictest	760	50	irq/18-parport0	06:11:34	0
3733	99	53	52	cyclictest	760	50	irq/18-parport0	06:02:54	0
3733	99	53	52	cyclictest	760	50	irq/18-parport0	05:38:19	0
3733	99	53	52	cyclictest	0	-21	swapper/0	10:19:19	0
3733	99	53	52	cyclictest	0	-21	swapper/0	10:13:17	0
3733	99	53	52	cyclictest	0	-21	swapper/0	09:53:18	0
3733	99	53	52	cyclictest	0	-21	swapper/0	09:18:18	0
3733	99	53	52	cyclictest	0	-21	swapper/0	08:57:02	0
3733	99	53	52	cyclictest	0	-21	swapper/0	08:05:02	0
3733	99	53	52	cyclictest	0	-21	swapper/0	07:38:22	0
3733	99	53	52	cyclictest	0	-21	swapper/0	07:16:31	0
3733	99	53	41	cyclictest	0	-21	swapper/0	10:28:17	0
3733	99	53	41	cyclictest	0	-21	swapper/0	08:03:06	0
3733	99	53	41	cyclictest	0	-21	swapper/0	06:33:24	0
3733	99	53	41	cyclictest	0	-21	swapper/0	06:33:24	0
3733	99	53	41	cyclictest	0	-21	swapper/0	05:43:27	0
3733	99	53	28	cyclictest	0	-21	swapper/0	07:36:15	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	10:28:04	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	10:28:04	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	10:00:45	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	09:04:47	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	08:16:33	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	07:50:08	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	06:39:01	0
3733	99	52	51	cyclictest	760	50	irq/18-parport0	05:20:12	0
3733	99	52	51	cyclictest	1876	-21	hald-addon-stor	08:22:41	0
3733	99	52	51	cyclictest	0	-21	swapper/0	10:43:16	0
3733	99	52	51	cyclictest	0	-21	swapper/0	10:38:52	0
3733	99	52	51	cyclictest	0	-21	swapper/0	10:33:39	0
3733	99	52	51	cyclictest	0	-21	swapper/0	10:08:40	0
3733	99	52	51	cyclictest	0	-21	swapper/0	10:03:56	0
3733	99	52	51	cyclictest	0	-21	swapper/0	09:44:24	0
3733	99	52	51	cyclictest	0	-21	swapper/0	09:39:26	0
3733	99	52	51	cyclictest	0	-21	swapper/0	09:33:34	0
3733	99	52	51	cyclictest	0	-21	swapper/0	09:13:37	0
3733	99	52	51	cyclictest	0	-21	swapper/0	09:10:33	0
3733	99	52	51	cyclictest	0	-21	swapper/0	08:52:02	0
3733	99	52	51	cyclictest	0	-21	swapper/0	08:39:08	0
3733	99	52	51	cyclictest	0	-21	swapper/0	08:35:04	0
3733	99	52	51	cyclictest	0	-21	swapper/0	08:24:09	0
3733	99	52	51	cyclictest	0	-21	swapper/0	07:53:41	0
3733	99	52	51	cyclictest	0	-21	swapper/0	07:44:18	0
3733	99	52	51	cyclictest	0	-21	swapper/0	07:11:20	0
3733	99	52	51	cyclictest	0	-21	swapper/0	06:58:14	0
3733	99	52	51	cyclictest	0	-21	swapper/0	06:47:00	0
3733	99	52	51	cyclictest	0	-21	swapper/0	06:15:26	0
3733	99	52	51	cyclictest	0	-21	swapper/0	06:03:34	0
3733	99	52	51	cyclictest	0	-21	swapper/0	05:55:04	0
3733	99	52	51	cyclictest	0	-21	swapper/0	05:25:28	0
3733	99	52	41	cyclictest	0	-21	swapper/0	07:28:21	0
3733	99	51	50	cyclictest	0	-21	swapper/0	09:28:34	0
3733	99	48	41	cyclictest	0	-21	swapper/0	08:45:14	0
3733	99	48	41	cyclictest	0	-21	swapper/0	06:29:29	0
3733	99	48	41	cyclictest	0	-21	swapper/0	05:52:44	0
3733	99	48	41	cyclictest	0	-21	swapper/0	05:32:45	0
3733	99	46	45	cyclictest	0	-21	swapper/0	05:33:16	0
3733	99	45	44	cyclictest	0	-21	swapper/0	07:05:02	0
3733	99	43	42	cyclictest	0	-21	swapper/0	08:08:10	0
3733	99	43	42	cyclictest	0	-21	swapper/0	08:08:10	0
3733	99	43	42	cyclictest	0	-21	swapper/0	06:53:13	0
3733	99	43	42	cyclictest	0	-21	swapper/0	06:23:29	0
3733	99	42	41	cyclictest	0	-21	swapper/0	06:53:14	0
8	99	10	0	watchdog/0	2725	-21	runrttasks	05:13:43	0
23	1	10	0	ksoftirqd/3	0	-21	swapper/3	05:13:36	3
16	99	10	0	migration/2	3324	-21	runrttasks	05:15:13	2
10	99	10	0	migration/1	2670	-21	missed_timers	05:13:34	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17