OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Jul 27, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
30721	99	133	132	cyclictest	0	-21	swapper/1	05:48:07	1
30742	99	114	112	cyclictest	15917	-40	yum-updatesd-he	05:48:07	3
30742	99	107	102	cyclictest	0	-21	swapper/3	07:08:17	3
30721	99	104	102	cyclictest	3800	-21	tune2fs	06:33:15	1
30721	99	104	102	cyclictest	27247	-21	tune2fs	04:58:19	1
30721	99	104	102	cyclictest	27247	-21	tune2fs	04:58:19	1
30742	99	103	92	cyclictest	0	-21	swapper/3	04:58:19	3
30742	99	103	92	cyclictest	0	-21	swapper/3	04:58:19	3
30721	99	103	102	cyclictest	0	-21	swapper/1	07:48:11	1
30742	99	93	92	cyclictest	0	-21	swapper/3	07:48:13	3
30742	99	93	92	cyclictest	0	-21	swapper/3	06:13:03	3
30742	99	89	72	cyclictest	0	-21	swapper/3	08:03:22	3
30742	99	88	72	cyclictest	0	-21	swapper/3	07:38:24	3
30742	99	87	82	cyclictest	0	-21	swapper/3	09:22:56	3
30742	99	87	82	cyclictest	0	-21	swapper/3	09:08:10	3
30742	99	87	82	cyclictest	0	-21	swapper/3	08:53:16	3
30742	99	87	82	cyclictest	0	-21	swapper/3	08:28:16	3
30742	99	87	82	cyclictest	0	-21	swapper/3	05:38:20	3
30742	99	87	82	cyclictest	0	-21	swapper/3	04:03:22	3
30742	99	87	82	cyclictest	0	-21	swapper/3	03:53:23	3
30742	99	87	72	cyclictest	0	-21	swapper/3	08:18:11	3
30742	99	87	71	cyclictest	0	-21	swapper/3	09:13:13	3
30742	99	86	82	cyclictest	0	-21	swapper/3	08:48:18	3
30742	99	86	82	cyclictest	0	-21	swapper/3	08:12:58	3
30742	99	86	82	cyclictest	0	-21	swapper/3	06:43:19	3
30742	99	86	72	cyclictest	0	-21	swapper/3	08:38:16	3
30742	99	86	72	cyclictest	0	-21	swapper/3	05:03:22	3
30742	99	86	71	cyclictest	0	-21	swapper/3	09:03:12	3
30742	99	86	71	cyclictest	0	-21	swapper/3	08:58:13	3
30742	99	86	71	cyclictest	0	-21	swapper/3	08:27:58	3
30742	99	86	71	cyclictest	0	-21	swapper/3	08:13:21	3
30742	99	86	71	cyclictest	0	-21	swapper/3	07:58:13	3
30742	99	86	71	cyclictest	0	-21	swapper/3	07:53:14	3
30742	99	86	71	cyclictest	0	-21	swapper/3	07:28:14	3
30742	99	86	71	cyclictest	0	-21	swapper/3	07:23:15	3
30742	99	86	71	cyclictest	0	-21	swapper/3	07:23:15	3
30742	99	86	71	cyclictest	0	-21	swapper/3	06:53:19	3
30742	99	86	71	cyclictest	0	-21	swapper/3	06:33:17	3
30742	99	86	71	cyclictest	0	-21	swapper/3	05:53:19	3
30742	99	86	71	cyclictest	0	-21	swapper/3	04:53:27	3
30742	99	86	71	cyclictest	0	-21	swapper/3	04:43:19	3
30742	99	86	71	cyclictest	0	-21	swapper/3	04:38:18	3
30742	99	86	71	cyclictest	0	-21	swapper/3	04:33:17	3
30742	99	85	82	cyclictest	0	-21	swapper/3	07:15:55	3
30742	99	85	82	cyclictest	0	-21	swapper/3	06:00:44	3
30742	99	85	71	cyclictest	0	-21	swapper/3	08:33:13	3
30742	99	85	71	cyclictest	0	-21	swapper/3	07:43:16	3
30742	99	85	71	cyclictest	0	-21	swapper/3	07:38:00	3
30742	99	85	71	cyclictest	0	-21	swapper/3	07:03:13	3
30742	99	85	71	cyclictest	0	-21	swapper/3	06:58:26	3
30742	99	85	71	cyclictest	0	-21	swapper/3	06:38:16	3
30742	99	85	71	cyclictest	0	-21	swapper/3	06:18:14	3
30742	99	85	71	cyclictest	0	-21	swapper/3	06:13:26	3
30742	99	85	71	cyclictest	0	-21	swapper/3	05:33:20	3
30742	99	85	71	cyclictest	0	-21	swapper/3	05:28:29	3
30742	99	85	71	cyclictest	0	-21	swapper/3	05:23:24	3
30742	99	85	71	cyclictest	0	-21	swapper/3	05:18:22	3
30742	99	85	71	cyclictest	0	-21	swapper/3	05:13:27	3
30742	99	85	71	cyclictest	0	-21	swapper/3	05:08:19	3
30742	99	85	71	cyclictest	0	-21	swapper/3	04:48:23	3
30742	99	85	71	cyclictest	0	-21	swapper/3	04:18:23	3
30742	99	85	71	cyclictest	0	-21	swapper/3	04:13:22	3
30742	99	85	71	cyclictest	0	-21	swapper/3	04:08:24	3
30742	99	85	71	cyclictest	0	-21	swapper/3	03:58:29	3
30721	99	85	82	cyclictest	0	-21	swapper/1	05:05:37	1
30742	99	84	81	cyclictest	0	-21	swapper/3	08:46:08	3
30742	99	84	81	cyclictest	0	-21	swapper/3	06:03:24	3
30742	99	83	82	cyclictest	0	-21	swapper/3	06:48:17	3
30742	99	83	82	cyclictest	0	-21	swapper/3	06:28:24	3
30742	99	83	82	cyclictest	0	-21	swapper/3	05:43:21	3
30742	99	83	82	cyclictest	0	-21	swapper/3	04:25:33	3
30721	99	83	82	cyclictest	392	-21	md2_raid1	06:13:03	1
30721	99	83	82	cyclictest	0	-21	swapper/1	09:03:18	1
30721	99	83	82	cyclictest	0	-21	swapper/1	08:43:15	1
30721	99	83	82	cyclictest	0	-21	swapper/1	08:38:17	1
30721	99	83	82	cyclictest	0	-21	swapper/1	08:36:06	1
30721	99	83	82	cyclictest	0	-21	swapper/1	08:22:59	1
30721	99	83	82	cyclictest	0	-21	swapper/1	08:16:04	1
30721	99	83	82	cyclictest	0	-21	swapper/1	07:38:22	1
30721	99	83	82	cyclictest	0	-21	swapper/1	07:13:01	1
30721	99	83	82	cyclictest	0	-21	swapper/1	06:53:21	1
30721	99	83	82	cyclictest	0	-21	swapper/1	05:58:24	1
30721	99	83	82	cyclictest	0	-21	swapper/1	05:55:43	1
30721	99	83	82	cyclictest	0	-21	swapper/1	05:40:41	1
30721	99	83	82	cyclictest	0	-21	swapper/1	04:43:28	1
30721	99	83	82	cyclictest	0	-21	swapper/1	04:38:07	1
30721	99	83	82	cyclictest	0	-21	swapper/1	04:23:28	1
30721	99	83	82	cyclictest	0	-21	swapper/1	04:13:25	1
30721	99	83	82	cyclictest	0	-21	swapper/1	04:13:07	1
30721	99	83	81	cyclictest	24882	-21	tune2fs	04:53:22	1
30721	99	83	81	cyclictest	18875	-21	tune2fs	07:08:17	1
30721	99	83	81	cyclictest	1598	-21	tune2fs	08:58:13	1
30721	99	83	81	cyclictest	1458	-21	tune2fs	06:28:18	1
30721	99	83	81	cyclictest	14416	-21	tune2fs	05:43:21	1
30721	99	83	81	cyclictest	10233	-21	tune2fs	06:48:16	1
30721	99	83	81	cyclictest	10036	-21	tune2fs	05:33:19	1
30742	99	82	81	cyclictest	0	-21	swapper/3	04:28:24	3
30721	99	82	81	cyclictest	3266	-21	tune2fs	04:03:21	1
30721	99	82	81	cyclictest	21230	-21	tune2fs	08:28:13	1
30742	99	76	71	cyclictest	0	-21	swapper/3	06:23:15	3
30721	99	73	72	cyclictest	0	-21	swapper/1	09:18:14	1
30721	99	73	72	cyclictest	0	-21	swapper/1	09:15:13	1
30721	99	73	72	cyclictest	0	-21	swapper/1	09:08:16	1
30721	99	73	72	cyclictest	0	-21	swapper/1	08:53:19	1
30721	99	73	72	cyclictest	0	-21	swapper/1	08:48:18	1
30721	99	73	72	cyclictest	0	-21	swapper/1	08:23:14	1
30721	99	73	72	cyclictest	0	-21	swapper/1	08:12:21	1
30721	99	73	72	cyclictest	0	-21	swapper/1	08:03:14	1
30721	99	73	72	cyclictest	0	-21	swapper/1	07:58:19	1
30721	99	73	72	cyclictest	0	-21	swapper/1	07:53:15	1
30721	99	73	72	cyclictest	0	-21	swapper/1	07:43:13	1
30721	99	73	72	cyclictest	0	-21	swapper/1	07:33:16	1
30721	99	73	72	cyclictest	0	-21	swapper/1	07:28:14	1
30721	99	73	72	cyclictest	0	-21	swapper/1	07:18:17	1
30721	99	73	72	cyclictest	0	-21	swapper/1	06:58:15	1
30721	99	73	72	cyclictest	0	-21	swapper/1	06:43:20	1
30721	99	73	72	cyclictest	0	-21	swapper/1	06:38:14	1
30721	99	73	72	cyclictest	0	-21	swapper/1	06:23:26	1
30721	99	73	72	cyclictest	0	-21	swapper/1	06:18:16	1
30721	99	73	72	cyclictest	0	-21	swapper/1	06:13:19	1
30721	99	73	72	cyclictest	0	-21	swapper/1	06:03:24	1
30721	99	73	72	cyclictest	0	-21	swapper/1	05:28:28	1
30721	99	73	72	cyclictest	0	-21	swapper/1	05:23:20	1
30721	99	73	72	cyclictest	0	-21	swapper/1	05:12:37	1
30721	99	73	72	cyclictest	0	-21	swapper/1	04:48:17	1
30721	99	73	72	cyclictest	0	-21	swapper/1	04:33:19	1
30721	99	73	72	cyclictest	0	-21	swapper/1	04:28:22	1
30721	99	73	72	cyclictest	0	-21	swapper/1	04:18:21	1
30721	99	73	72	cyclictest	0	-21	swapper/1	04:02:29	1
30721	99	73	72	cyclictest	0	-21	swapper/1	03:58:01	1
30721	99	72	71	cyclictest	0	-21	swapper/1	07:03:20	1
30721	99	72	61	cyclictest	0	-21	swapper/1	05:13:23	1
30742	99	67	62	cyclictest	0	-21	swapper/3	03:53:08	3
30742	99	66	62	cyclictest	0	-21	swapper/3	07:23:00	3
30721	99	64	61	cyclictest	0	-21	swapper/1	07:25:24	1
30721	99	64	61	cyclictest	0	-21	swapper/1	07:25:24	1
30721	99	63	62	cyclictest	0	-21	swapper/1	05:18:16	1
30721	99	63	62	cyclictest	0	-21	swapper/1	03:53:08	1
30733	99	61	60	cyclictest	0	-21	swapper/2	08:43:09	2
30733	99	61	46	cyclictest	0	-21	swapper/2	08:05:16	2
30733	99	60	56	cyclictest	0	-21	swapper/2	05:53:17	2
30733	99	60	56	cyclictest	0	-21	swapper/2	05:43:18	2
30733	99	60	45	cyclictest	0	-21	swapper/2	06:43:14	2
30733	99	59	55	cyclictest	0	-21	swapper/2	04:23:19	2
30733	99	59	43	cyclictest	0	-21	swapper/2	06:53:34	2
30733	99	58	31	cyclictest	0	-21	swapper/2	06:52:43	2
30733	99	57	41	cyclictest	50	50	irq/44-ahci	05:28:43	2
30733	99	57	41	cyclictest	0	-21	swapper/2	08:48:28	2
30733	99	57	41	cyclictest	0	-21	swapper/2	06:13:42	2
30733	99	57	41	cyclictest	0	-21	swapper/2	06:08:15	2
30733	99	57	41	cyclictest	0	-21	swapper/2	04:03:27	2
30733	99	57	41	cyclictest	0	-21	swapper/2	03:53:20	2
30733	99	56	51	cyclictest	0	-21	swapper/2	08:33:12	2
30733	99	56	51	cyclictest	0	-21	swapper/2	08:18:11	2
30733	99	56	51	cyclictest	0	-21	swapper/2	08:08:12	2
30733	99	56	51	cyclictest	0	-21	swapper/2	07:33:13	2
30733	99	56	51	cyclictest	0	-21	swapper/2	07:28:12	2
30733	99	56	51	cyclictest	0	-21	swapper/2	07:03:12	2
30733	99	56	51	cyclictest	0	-21	swapper/2	06:58:13	2
30733	99	56	51	cyclictest	0	-21	swapper/2	06:28:15	2
30733	99	56	51	cyclictest	0	-21	swapper/2	04:58:17	2
30733	99	56	51	cyclictest	0	-21	swapper/2	04:58:17	2
30733	99	56	51	cyclictest	0	-21	swapper/2	04:13:20	2
30733	99	56	51	cyclictest	0	-21	swapper/2	03:58:21	2
30733	99	56	41	cyclictest	0	-21	swapper/2	06:23:37	2
30733	99	56	41	cyclictest	0	-21	swapper/2	06:19:50	2
30733	99	56	41	cyclictest	0	-21	swapper/2	04:43:45	2
30733	99	55	54	cyclictest	0	-21	swapper/2	04:38:18	2
30733	99	55	51	cyclictest	0	-21	swapper/2	09:08:09	2
30733	99	55	51	cyclictest	0	-21	swapper/2	08:38:12	2
30733	99	55	51	cyclictest	0	-21	swapper/2	08:28:09	2
30733	99	55	51	cyclictest	0	-21	swapper/2	07:51:11	2
30733	99	55	51	cyclictest	0	-21	swapper/2	07:08:15	2
30733	99	55	51	cyclictest	0	-21	swapper/2	05:33:16	2
30733	99	55	51	cyclictest	0	-21	swapper/2	05:23:18	2
30733	99	55	51	cyclictest	0	-21	swapper/2	05:10:31	2
30733	99	55	51	cyclictest	0	-21	swapper/2	05:03:17	2
30733	99	55	41	cyclictest	0	-21	swapper/2	07:20:21	2
30733	99	54	48	cyclictest	0	-21	swapper/2	09:02:52	2
30733	99	54	31	cyclictest	0	-21	swapper/2	08:53:13	2
30717	99	54	53	cyclictest	3	1	ksoftirqd/0	04:38:47	0
30717	99	54	53	cyclictest	0	-21	swapper/0	06:34:01	0
30717	99	54	53	cyclictest	0	-21	swapper/0	05:58:15	0
30717	99	54	50	cyclictest	0	-21	swapper/0	07:38:27	0
30733	99	53	52	cyclictest	7679	-21	telnet	07:58:13	2
30733	99	53	52	cyclictest	0	-21	swapper/2	09:13:08	2
30733	99	53	52	cyclictest	0	-21	swapper/2	04:49:12	2
30733	99	53	52	cyclictest	0	-21	swapper/2	04:28:21	2
30733	99	53	51	cyclictest	9436	-21	telnet	04:18:21	2
30733	99	53	51	cyclictest	50	50	irq/44-ahci	07:41:17	2
30733	99	53	51	cyclictest	22489	-21	telnet	06:03:15	2
30733	99	53	41	cyclictest	50	50	irq/44-ahci	04:53:26	2
30733	99	53	31	cyclictest	18584	-21	cpuspeed	08:23:12	2
30717	99	53	52	cyclictest	760	50	irq/18-parport0	05:42:56	0
30717	99	53	52	cyclictest	50	50	irq/44-ahci	04:13:13	0
30717	99	53	52	cyclictest	3	1	ksoftirqd/0	07:23:35	0
30717	99	53	52	cyclictest	3	1	ksoftirqd/0	07:23:35	0
30717	99	53	52	cyclictest	0	-21	swapper/0	05:03:18	0
30717	99	53	51	cyclictest	50	50	irq/44-ahci	05:28:58	0
30717	99	53	51	cyclictest	50	50	irq/44-ahci	04:03:43	0
30717	99	53	41	cyclictest	50	50	irq/44-ahci	05:53:36	0
30733	99	52	51	cyclictest	997	-21	telnet	07:43:11	2
30733	99	52	51	cyclictest	278	-21	usb-storage	06:01:43	2
30733	99	52	51	cyclictest	24882	-21	telnet	07:23:13	2
30733	99	52	51	cyclictest	24882	-21	telnet	07:23:13	2
30733	99	52	51	cyclictest	20528	-21	telnet	07:13:13	2
30733	99	52	51	cyclictest	1876	-21	hald-addon-stor	09:22:39	2
30733	99	52	51	cyclictest	11682	-21	telnet	05:38:17	2
30733	99	52	51	cyclictest	0	-21	swapper/2	05:18:17	2
30733	99	52	51	cyclictest	0	-21	swapper/2	05:13:35	2
30733	99	52	49	cyclictest	0	-21	swapper/2	06:41:56	2
30733	99	52	44	cyclictest	0	-21	swapper/2	09:06:46	2
30717	99	52	51	cyclictest	760	50	irq/18-parport0	08:47:27	0
30717	99	52	51	cyclictest	760	50	irq/18-parport0	08:29:37	0
30717	99	52	51	cyclictest	760	50	irq/18-parport0	07:54:11	0
30717	99	52	51	cyclictest	760	50	irq/18-parport0	06:42:35	0
30717	99	52	51	cyclictest	760	50	irq/18-parport0	05:13:17	0
30717	99	52	51	cyclictest	760	50	irq/18-parport0	05:11:13	0
30717	99	52	51	cyclictest	0	-21	swapper/0	09:11:00	0
30717	99	52	51	cyclictest	0	-21	swapper/0	08:37:41	0
30717	99	52	51	cyclictest	0	-21	swapper/0	07:31:44	0
30717	99	52	51	cyclictest	0	-21	swapper/0	07:15:20	0
30717	99	52	51	cyclictest	0	-21	swapper/0	06:53:55	0
30717	99	52	51	cyclictest	0	-21	swapper/0	06:48:36	0
30717	99	52	51	cyclictest	0	-21	swapper/0	04:56:39	0
30733	99	51	41	cyclictest	0	-21	swapper/2	06:37:28	2
30717	99	51	50	cyclictest	0	-21	swapper/0	09:14:08	0
30717	99	51	50	cyclictest	0	-21	swapper/0	07:44:05	0
30717	99	51	50	cyclictest	0	-21	swapper/0	05:02:11	0
30717	99	51	50	cyclictest	0	-21	swapper/0	05:02:11	0
30733	99	50	44	cyclictest	0	-21	swapper/2	04:12:09	2
30717	99	50	49	cyclictest	0	-21	swapper/0	09:03:09	0
30717	99	50	49	cyclictest	0	-21	swapper/0	08:00:31	0
30717	99	50	49	cyclictest	0	-21	swapper/0	07:10:20	0
30717	99	50	49	cyclictest	0	-21	swapper/0	04:35:02	0
30733	99	49	48	cyclictest	0	-21	swapper/2	08:13:34	2
30733	99	49	43	cyclictest	0	-21	swapper/2	05:49:23	2
30733	99	49	43	cyclictest	0	-21	swapper/2	04:38:04	2
30717	99	49	48	cyclictest	0	-21	swapper/0	05:46:22	0
30717	99	49	48	cyclictest	0	-21	swapper/0	04:28:29	0
30717	99	49	48	cyclictest	0	-21	swapper/0	03:59:26	0
30733	99	48	43	cyclictest	0	-21	swapper/2	07:57:51	2
30717	99	48	47	cyclictest	0	-21	swapper/0	04:19:31	0
30717	99	48	31	cyclictest	0	-21	swapper/0	08:57:28	0
30717	99	47	46	cyclictest	0	-21	swapper/0	07:48:27	0
30717	99	47	46	cyclictest	0	-21	swapper/0	06:21:30	0
30717	99	47	45	cyclictest	50	50	irq/44-ahci	08:48:34	0
30717	99	47	31	cyclictest	0	-21	swapper/0	08:16:08	0
30733	99	46	41	cyclictest	0	-21	swapper/2	03:53:08	2
30717	99	46	45	cyclictest	0	-21	swapper/0	06:59:33	0
30717	99	45	44	cyclictest	0	-21	swapper/0	08:20:20	0
30717	99	45	44	cyclictest	0	-21	swapper/0	05:33:12	0
30717	99	44	43	cyclictest	0	-21	swapper/0	06:25:08	0
30717	99	43	42	cyclictest	13330	-21	kworker/0:1	07:18:25	0
30717	99	43	42	cyclictest	0	-21	swapper/0	08:37:58	0
30717	99	43	42	cyclictest	0	-21	swapper/0	08:08:22	0
30717	99	43	42	cyclictest	0	-21	swapper/0	06:08:20	0
30717	99	43	42	cyclictest	0	-21	swapper/0	05:23:20	0
30717	99	43	42	cyclictest	0	-21	swapper/0	05:18:27	0
30717	99	43	42	cyclictest	0	-21	swapper/0	04:48:26	0
30717	99	43	42	cyclictest	0	-21	swapper/0	04:43:29	0
30717	99	43	42	cyclictest	0	-21	swapper/0	04:23:27	0
30717	99	43	42	cyclictest	0	-21	swapper/0	03:53:20	0
30717	99	43	41	cyclictest	842	-21	telnet	06:28:15	0
30717	99	43	41	cyclictest	26703	-21	kworker/0:0	09:01:16	0
30717	99	43	31	cyclictest	0	-21	swapper/0	09:18:09	0
30717	99	43	31	cyclictest	0	-21	swapper/0	08:22:59	0
30717	99	43	31	cyclictest	0	-21	swapper/0	08:03:12	0
30717	99	43	31	cyclictest	0	-21	swapper/0	07:33:14	0
30717	99	43	31	cyclictest	0	-21	swapper/0	06:43:02	0
30717	99	43	31	cyclictest	0	-21	swapper/0	06:17:50	0
30717	99	43	31	cyclictest	0	-21	swapper/0	05:48:20	0
30717	99	42	41	cyclictest	0	-21	swapper/0	07:03:13	0
30717	99	42	41	cyclictest	0	-21	swapper/0	06:03:15	0
30717	99	42	41	cyclictest	0	-21	swapper/0	04:08:12	0
30717	99	42	41	cyclictest	0	-21	swapper/0	03:53:08	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17