OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sun Jun 07, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
15324	99	124	123	cyclictest	0	-21	swapper/1	09:43:27	1
15326	99	123	122	cyclictest	0	-21	swapper/3	07:03:34	3
15326	99	109	103	cyclictest	0	-21	swapper/3	06:33:35	3
15326	99	108	102	cyclictest	32453	-40	yum-updatesd-he	06:31:25	3
15326	99	107	102	cyclictest	0	-21	swapper/3	08:13:32	3
15324	99	105	103	cyclictest	1385	-17	sedispatch	07:38:19	1
15324	99	103	102	cyclictest	810	-21	tune2fs	07:48:32	1
15326	99	94	92	cyclictest	21187	-21	sed	04:48:47	3
15326	99	88	71	cyclictest	0	-21	swapper/3	06:48:33	3
15326	99	87	82	cyclictest	0	-21	swapper/3	07:58:37	3
15326	99	87	82	cyclictest	0	-21	swapper/3	05:53:39	3
15326	99	86	82	cyclictest	0	-21	swapper/3	09:46:15	3
15326	99	86	82	cyclictest	0	-21	swapper/3	08:56:08	3
15326	99	86	82	cyclictest	0	-21	swapper/3	08:06:00	3
15326	99	86	82	cyclictest	0	-21	swapper/3	07:25:54	3
15326	99	86	82	cyclictest	0	-21	swapper/3	07:08:40	3
15326	99	86	82	cyclictest	0	-21	swapper/3	06:08:42	3
15326	99	86	82	cyclictest	0	-21	swapper/3	05:48:44	3
15326	99	86	82	cyclictest	0	-21	swapper/3	05:40:37	3
15326	99	86	82	cyclictest	0	-21	swapper/3	05:18:44	3
15324	99	85	82	cyclictest	0	-21	swapper/1	06:31:25	1
15326	99	84	72	cyclictest	0	-21	swapper/3	07:33:32	3
15324	99	84	82	cyclictest	18484	-21	tune2fs	08:28:30	1
15324	99	84	82	cyclictest	13929	-21	tune2fs	07:03:34	1
15326	99	83	82	cyclictest	0	-21	swapper/3	10:01:17	3
15326	99	83	82	cyclictest	0	-21	swapper/3	09:53:30	3
15326	99	83	82	cyclictest	0	-21	swapper/3	09:33:36	3
15326	99	83	82	cyclictest	0	-21	swapper/3	09:13:36	3
15326	99	83	82	cyclictest	0	-21	swapper/3	09:11:09	3
15326	99	83	82	cyclictest	0	-21	swapper/3	08:58:36	3
15326	99	83	82	cyclictest	0	-21	swapper/3	08:28:37	3
15326	99	83	82	cyclictest	0	-21	swapper/3	08:18:35	3
15326	99	83	82	cyclictest	0	-21	swapper/3	07:40:56	3
15326	99	83	82	cyclictest	0	-21	swapper/3	06:53:36	3
15326	99	83	82	cyclictest	0	-21	swapper/3	06:53:36	3
15326	99	83	82	cyclictest	0	-21	swapper/3	06:38:41	3
15326	99	83	82	cyclictest	0	-21	swapper/3	06:03:44	3
15326	99	83	82	cyclictest	0	-21	swapper/3	05:58:23	3
15326	99	83	82	cyclictest	0	-21	swapper/3	05:08:46	3
15326	99	83	82	cyclictest	0	-21	swapper/3	04:43:47	3
15326	99	83	71	cyclictest	0	-21	swapper/3	05:13:38	3
15324	99	83	82	cyclictest	11165	-21	tune2fs	09:23:29	1
15324	99	83	82	cyclictest	0	-21	swapper/1	10:03:34	1
15324	99	83	82	cyclictest	0	-21	swapper/1	09:48:34	1
15324	99	83	82	cyclictest	0	-21	swapper/1	09:31:12	1
15324	99	83	82	cyclictest	0	-21	swapper/1	09:21:11	1
15324	99	83	82	cyclictest	0	-21	swapper/1	09:16:10	1
15324	99	83	82	cyclictest	0	-21	swapper/1	09:08:35	1
15324	99	83	82	cyclictest	0	-21	swapper/1	09:06:09	1
15324	99	83	82	cyclictest	0	-21	swapper/1	09:01:09	1
15324	99	83	82	cyclictest	0	-21	swapper/1	08:51:07	1
15324	99	83	82	cyclictest	0	-21	swapper/1	08:26:03	1
15324	99	83	82	cyclictest	0	-21	swapper/1	08:13:39	1
15324	99	83	82	cyclictest	0	-21	swapper/1	08:03:39	1
15324	99	83	82	cyclictest	0	-21	swapper/1	07:43:39	1
15324	99	83	82	cyclictest	0	-21	swapper/1	07:08:33	1
15324	99	83	82	cyclictest	0	-21	swapper/1	06:35:45	1
15324	99	83	82	cyclictest	0	-21	swapper/1	06:23:42	1
15324	99	83	82	cyclictest	0	-21	swapper/1	06:15:42	1
15324	99	83	82	cyclictest	0	-21	swapper/1	06:03:42	1
15324	99	83	82	cyclictest	0	-21	swapper/1	05:58:42	1
15324	99	83	82	cyclictest	0	-21	swapper/1	05:55:39	1
15324	99	83	82	cyclictest	0	-21	swapper/1	05:38:44	1
15324	99	83	82	cyclictest	0	-21	swapper/1	05:35:36	1
15324	99	83	82	cyclictest	0	-21	swapper/1	05:28:45	1
15324	99	83	82	cyclictest	0	-21	swapper/1	05:03:45	1
15324	99	83	82	cyclictest	0	-21	swapper/1	04:53:45	1
15324	99	83	82	cyclictest	0	-21	swapper/1	04:38:46	1
15324	99	83	81	cyclictest	5381	-21	tune2fs	07:58:30	1
15324	99	83	81	cyclictest	3260	-21	tune2fs	07:53:32	1
15324	99	83	81	cyclictest	30966	-21	tune2fs	05:13:38	1
15324	99	83	81	cyclictest	24131	-21	tune2fs	08:38:31	1
15324	99	83	81	cyclictest	24131	-21	tune2fs	08:38:31	1
15324	99	83	81	cyclictest	18427	-21	tune2fs	07:13:34	1
15324	99	83	81	cyclictest	13805	-21	tune2fs	05:48:37	1
15324	99	83	81	cyclictest	11967	-21	tune2fs	06:58:34	1
15326	99	82	81	cyclictest	0	-21	swapper/3	07:18:30	3
15326	99	77	72	cyclictest	0	-21	swapper/3	10:03:25	3
15326	99	77	72	cyclictest	0	-21	swapper/3	09:48:34	3
15326	99	77	72	cyclictest	0	-21	swapper/3	07:03:20	3
15326	99	75	63	cyclictest	7265	-21	rs:main		3
15324	99	74	72	cyclictest	0	-21	swapper/1	06:18:36	1
15324	99	74	62	cyclictest	24252	-21	aten2.4-expect	07:28:29	1
15326	99	73	72	cyclictest	0	-21	swapper/3	09:23:36	3
15326	99	73	72	cyclictest	0	-21	swapper/3	09:18:36	3
15326	99	73	72	cyclictest	0	-21	swapper/3	09:03:36	3
15326	99	73	72	cyclictest	0	-21	swapper/3	08:43:38	3
15326	99	73	72	cyclictest	0	-21	swapper/3	05:48:22	3
15324	99	73	72	cyclictest	0	-21	swapper/1	09:53:24	1
15324	99	73	72	cyclictest	0	-21	swapper/1	09:38:29	1
15324	99	73	72	cyclictest	0	-21	swapper/1	08:53:34	1
15324	99	73	72	cyclictest	0	-21	swapper/1	08:43:36	1
15324	99	73	72	cyclictest	0	-21	swapper/1	08:33:33	1
15324	99	73	72	cyclictest	0	-21	swapper/1	08:18:37	1
15324	99	73	72	cyclictest	0	-21	swapper/1	07:23:33	1
15324	99	73	72	cyclictest	0	-21	swapper/1	06:53:35	1
15324	99	73	72	cyclictest	0	-21	swapper/1	06:53:35	1
15324	99	73	72	cyclictest	0	-21	swapper/1	06:48:30	1
15324	99	73	72	cyclictest	0	-21	swapper/1	06:43:36	1
15324	99	73	72	cyclictest	0	-21	swapper/1	06:38:32	1
15324	99	73	72	cyclictest	0	-21	swapper/1	05:43:36	1
15324	99	73	72	cyclictest	0	-21	swapper/1	05:26:51	1
15324	99	73	72	cyclictest	0	-21	swapper/1	05:18:46	1
15324	99	73	72	cyclictest	0	-21	swapper/1	05:08:36	1
15324	99	73	72	cyclictest	0	-21	swapper/1	04:58:38	1
15324	99	73	72	cyclictest	0	-21	swapper/1	04:48:36	1
15324	99	73	72	cyclictest	0	-21	swapper/1	04:43:38	1
15324	99	73	71	cyclictest	22095	-21	aten2.4-expect	06:08:34	1
15326	99	72	71	cyclictest	0	-21	swapper/3	08:36:04	3
15326	99	72	71	cyclictest	0	-21	swapper/3	07:53:32	3
15326	99	72	71	cyclictest	0	-21	swapper/3	07:13:34	3
15326	99	72	71	cyclictest	0	-21	swapper/3	05:03:37	3
15326	99	72	71	cyclictest	0	-21	swapper/3	05:00:03	3
15326	99	72	71	cyclictest	0	-21	swapper/3	04:38:31	3
15324	99	72	71	cyclictest	0	-21	swapper/1	08:08:29	1
15326	99	70	62	cyclictest	0	-21	swapper/3	05:33:42	3
15326	99	69	62	cyclictest	0	-21	swapper/3	09:33:14	3
15326	99	69	62	cyclictest	0	-21	swapper/3	07:43:38	3
15326	99	69	61	cyclictest	0	-21	swapper/3	07:28:30	3
15326	99	68	62	cyclictest	0	-21	swapper/3	08:48:34	3
15326	99	68	62	cyclictest	0	-21	swapper/3	08:08:18	3
15326	99	68	62	cyclictest	0	-21	swapper/3	07:49:00	3
15326	99	68	62	cyclictest	0	-21	swapper/3	06:28:21	3
15326	99	68	62	cyclictest	0	-21	swapper/3	06:16:00	3
15326	99	68	62	cyclictest	0	-21	swapper/3	05:33:23	3
15326	99	67	62	cyclictest	0	-21	swapper/3	09:38:28	3
15326	99	67	62	cyclictest	0	-21	swapper/3	05:28:24	3
15324	99	64	62	cyclictest	0	-21	swapper/1	07:18:40	1
15326	99	63	62	cyclictest	0	-21	swapper/3	08:38:30	3
15326	99	63	62	cyclictest	0	-21	swapper/3	08:38:30	3
15326	99	63	62	cyclictest	0	-21	swapper/3	08:23:32	3
15326	99	63	62	cyclictest	0	-21	swapper/3	06:43:32	3
15326	99	63	62	cyclictest	0	-21	swapper/3	06:18:33	3
15324	99	63	62	cyclictest	0	-21	swapper/1	09:58:25	1
15324	99	63	62	cyclictest	0	-21	swapper/1	09:33:27	1
15324	99	63	62	cyclictest	0	-21	swapper/1	07:38:28	1
15323	99	62	61	cyclictest	0	-21	swapper/0	07:39:02	0
15323	99	61	60	cyclictest	0	-21	swapper/0	05:53:34	0
15325	99	58	57	cyclictest	0	-21	swapper/2	05:58:32	2
15325	99	57	56	cyclictest	0	-21	swapper/2	07:30:36	2
15325	99	57	52	cyclictest	5745	-21	munin-node	07:58:32	2
15325	99	56	55	cyclictest	0	-21	swapper/2	10:03:25	2
15325	99	55	54	cyclictest	9565	-21	munin-node	09:18:33	2
15325	99	55	54	cyclictest	6688	-21	munin-node	09:13:29	2
15325	99	55	54	cyclictest	651	-21	munin-node	06:33:34	2
15325	99	55	54	cyclictest	6219	-21	munin-node	06:43:44	2
15325	99	55	54	cyclictest	27651	-21	munin-node	06:18:44	2
15325	99	55	54	cyclictest	1901	-21	latency_hist	09:03:16	2
15325	99	55	54	cyclictest	11459	-21	munin-node	05:43:38	2
15325	99	55	51	cyclictest	18	1	ksoftirqd/2	05:22:27	2
15325	99	55	50	cyclictest	23425	-21	sendmail_mailqu	07:23:39	2
15325	99	55	43	cyclictest	0	-21	swapper/2	09:09:09	2
15323	99	55	47	cyclictest	0	-21	swapper/0	07:30:02	0
15323	99	55	41	cyclictest	0	-21	swapper/0	08:33:29	0
15325	99	54	53	cyclictest	8235	-21	munin-node	08:03:37	2
15325	99	54	53	cyclictest	7949	-21	munin-node	05:33:42	2
15325	99	54	53	cyclictest	31678	-21	munin-node	05:13:43	2
15325	99	54	53	cyclictest	31480	-21	munin-node	08:53:38	2
15325	99	54	53	cyclictest	27377	-21	munin-node	07:33:35	2
15325	99	54	53	cyclictest	26671	-21	munin-node	09:58:29	2
15325	99	54	53	cyclictest	25543	-21	munin-node	04:58:47	2
15325	99	54	53	cyclictest	21586	-21	munin-node	08:33:30	2
15325	99	54	53	cyclictest	19672	-21	munin-node	04:48:36	2
15325	99	54	53	cyclictest	19256	-21	munin-node	08:28:37	2
15325	99	54	53	cyclictest	18371	-21	munin-node	09:38:33	2
15325	99	54	53	cyclictest	17712	-21	munin-node	04:43:39	2
15325	99	54	53	cyclictest	16680	-21	munin-node	05:53:42	2
15325	99	54	53	cyclictest	16047	-21	munin-node	08:23:31	2
15325	99	54	53	cyclictest	14392	-21	munin-node	07:03:37	2
15325	99	54	53	cyclictest	12310	-21	munin-node	06:58:36	2
15325	99	54	53	cyclictest	10609	-21	munin-node	08:08:38	2
15325	99	54	53	cyclictest	10176	-21	munin-node	06:53:36	2
15325	99	54	53	cyclictest	10176	-21	munin-node	06:53:36	2
15325	99	54	53	cyclictest	0	-21	swapper/2	09:31:46	2
15325	99	54	53	cyclictest	0	-21	swapper/2	07:18:33	2
15325	99	54	52	cyclictest	50	50	irq/44-ahci	05:04:14	2
15325	99	54	52	cyclictest	0	-21	swapper/2	09:53:25	2
15325	99	54	51	cyclictest	0	-21	swapper/2	08:43:30	2
15325	99	54	50	cyclictest	0	-21	swapper/2	06:51:20	2
15323	99	54	52	cyclictest	50	50	irq/44-ahci	09:10:51	0
15323	99	54	51	cyclictest	0	-21	swapper/0	06:14:34	0
15325	99	53	52	cyclictest	278	-21	usb-storage	04:38:45	2
15325	99	53	52	cyclictest	2768	-21	telnet	06:38:33	2
15325	99	53	52	cyclictest	25211	-21	needreboot	06:13:40	2
15325	99	53	52	cyclictest	20355	-21	mdstat	09:43:32	2
15325	99	53	52	cyclictest	1876	-21	hald-addon-stor	08:19:03	2
15325	99	53	52	cyclictest	15606	-21	telnet	07:08:30	2
15325	99	53	52	cyclictest	10354	-21	munin-node	05:38:45	2
15325	99	53	52	cyclictest	0	-21	swapper/2	09:48:27	2
15325	99	53	52	cyclictest	0	-21	swapper/2	09:33:22	2
15325	99	53	52	cyclictest	0	-21	swapper/2	09:24:48	2
15325	99	53	52	cyclictest	0	-21	swapper/2	08:49:39	2
15325	99	53	52	cyclictest	0	-21	swapper/2	08:38:24	2
15325	99	53	52	cyclictest	0	-21	swapper/2	08:38:24	2
15325	99	53	52	cyclictest	0	-21	swapper/2	08:13:35	2
15325	99	53	52	cyclictest	0	-21	swapper/2	07:54:12	2
15325	99	53	52	cyclictest	0	-21	swapper/2	07:38:28	2
15325	99	53	52	cyclictest	0	-21	swapper/2	06:28:32	2
15325	99	53	52	cyclictest	0	-21	swapper/2	06:23:33	2
15325	99	53	52	cyclictest	0	-21	swapper/2	06:11:01	2
15325	99	53	52	cyclictest	0	-21	swapper/2	05:52:32	2
15325	99	53	52	cyclictest	0	-21	swapper/2	05:28:39	2
15325	99	53	52	cyclictest	0	-21	swapper/2	05:23:36	2
15325	99	53	52	cyclictest	0	-21	swapper/2	04:53:44	2
15325	99	53	51	cyclictest	50	50	irq/44-ahci	07:48:24	2
15325	99	53	51	cyclictest	28401	-21	telnet	05:08:36	2
15325	99	53	51	cyclictest	2031	-21	telnet	09:03:27	2
15325	99	53	51	cyclictest	19786	-21	telnet	06:03:33	2
15325	99	53	51	cyclictest	17883	-21	telnet	07:13:32	2
15325	99	53	41	cyclictest	0	-21	swapper/2	07:43:30	2
15323	99	53	52	cyclictest	760	50	irq/18-parport0	10:03:17	0
15323	99	53	52	cyclictest	760	50	irq/18-parport0	09:57:09	0
15323	99	53	52	cyclictest	760	50	irq/18-parport0	09:39:36	0
15323	99	53	52	cyclictest	760	50	irq/18-parport0	09:16:10	0
15323	99	53	52	cyclictest	760	50	irq/18-parport0	07:06:47	0
15323	99	53	52	cyclictest	760	50	irq/18-parport0	06:19:19	0
15323	99	53	52	cyclictest	760	50	irq/18-parport0	05:48:38	0
15323	99	53	52	cyclictest	760	50	irq/18-parport0	05:38:23	0
15323	99	53	52	cyclictest	24732	-21	kworker/0:1	09:43:35	0
15323	99	53	52	cyclictest	0	-21	swapper/0	08:53:27	0
15323	99	53	52	cyclictest	0	-21	swapper/0	07:53:29	0
15323	99	53	52	cyclictest	0	-21	swapper/0	06:03:58	0
15323	99	53	52	cyclictest	0	-21	swapper/0	05:58:32	0
15323	99	53	52	cyclictest	0	-21	swapper/0	05:05:50	0
15323	99	53	52	cyclictest	0	-21	swapper/0	04:43:38	0
15323	99	53	51	cyclictest	1286	50	irq/46-eth0	09:00:03	0
15323	99	53	51	cyclictest	1286	50	irq/46-eth0	04:57:02	0
15323	99	53	41	cyclictest	0	-21	swapper/0	09:18:28	0
15323	99	53	41	cyclictest	0	-21	swapper/0	09:03:38	0
15323	99	53	41	cyclictest	0	-21	swapper/0	08:39:10	0
15323	99	53	41	cyclictest	0	-21	swapper/0	08:39:10	0
15323	99	53	41	cyclictest	0	-21	swapper/0	08:28:38	0
15323	99	53	41	cyclictest	0	-21	swapper/0	08:23:45	0
15323	99	53	41	cyclictest	0	-21	swapper/0	08:13:29	0
15323	99	53	41	cyclictest	0	-21	swapper/0	08:03:40	0
15323	99	53	41	cyclictest	0	-21	swapper/0	07:58:32	0
15323	99	53	41	cyclictest	0	-21	swapper/0	07:50:54	0
15323	99	53	41	cyclictest	0	-21	swapper/0	07:43:40	0
15323	99	53	41	cyclictest	0	-21	swapper/0	07:37:06	0
15323	99	53	41	cyclictest	0	-21	swapper/0	07:18:34	0
15323	99	53	41	cyclictest	0	-21	swapper/0	07:13:32	0
15323	99	53	41	cyclictest	0	-21	swapper/0	07:08:32	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:53:30	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:53:30	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:50:09	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:43:44	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:38:36	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:33:35	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:28:41	0
15323	99	53	41	cyclictest	0	-21	swapper/0	06:23:34	0
15323	99	53	41	cyclictest	0	-21	swapper/0	05:45:16	0
15323	99	53	41	cyclictest	0	-21	swapper/0	05:38:48	0
15323	99	53	41	cyclictest	0	-21	swapper/0	05:23:44	0
15323	99	53	41	cyclictest	0	-21	swapper/0	05:13:36	0
15323	99	53	41	cyclictest	0	-21	swapper/0	05:08:47	0
15323	99	53	41	cyclictest	0	-21	swapper/0	04:58:35	0
15323	99	53	41	cyclictest	0	-21	swapper/0	04:48:51	0
15323	99	53	41	cyclictest	0	-21	swapper/0	04:40:02	0
15323	99	52	51	cyclictest	1876	-21	hald-addon-stor	07:26:35	0
15323	99	52	51	cyclictest	0	-21	swapper/0	10:00:45	0
15323	99	52	51	cyclictest	0	-21	swapper/0	09:48:25	0
15323	99	52	51	cyclictest	0	-21	swapper/0	09:33:27	0
15323	99	52	51	cyclictest	0	-21	swapper/0	09:28:51	0
15323	99	52	51	cyclictest	0	-21	swapper/0	09:23:27	0
15323	99	52	51	cyclictest	0	-21	swapper/0	08:44:26	0
15323	99	52	51	cyclictest	0	-21	swapper/0	08:18:45	0
15323	99	52	51	cyclictest	0	-21	swapper/0	08:09:05	0
15323	99	52	51	cyclictest	0	-21	swapper/0	07:00:10	0
15323	99	52	51	cyclictest	0	-21	swapper/0	06:08:33	0
15323	99	52	51	cyclictest	0	-21	swapper/0	05:28:35	0
15323	99	52	51	cyclictest	0	-21	swapper/0	05:18:35	0
15323	99	43	41	cyclictest	0	-21	swapper/0	08:48:22	0
21	99	11	0	migration/3	14601	-21	munin-node	04:33:48	3
7	99	10	0	migration/0	15041	-21	taskset	04:37:16	0
16	99	10	0	migration/2	14790	-21	runrttasks	04:34:17	2
12	1	7	0	ksoftirqd/1	1461	-21	irqbalance	04:38:09	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17