OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Aug 10, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
12343	99	103	102	cyclictest	0	-21	swapper/1	06:05:44	1
12345	99	93	92	cyclictest	11955	-21	sed	06:05:44	3
12343	99	87	82	cyclictest	0	-21	swapper/1	07:55:35	1
12343	99	87	82	cyclictest	0	-21	swapper/1	07:43:22	1
12343	99	87	82	cyclictest	0	-21	swapper/1	06:32:41	1
12343	99	87	82	cyclictest	0	-21	swapper/1	04:47:29	1
12343	99	87	81	cyclictest	12754	-21	tune2fs	03:40:41	1
12343	99	87	72	cyclictest	0	-21	swapper/1	04:24:09	1
12343	99	86	82	cyclictest	0	-21	swapper/1	07:45:39	1
12343	99	86	82	cyclictest	0	-21	swapper/1	07:10:32	1
12343	99	86	82	cyclictest	0	-21	swapper/1	05:20:46	1
12343	99	86	82	cyclictest	0	-21	swapper/1	04:35:47	1
12343	99	84	83	cyclictest	1384	-13	audispd	05:45:23	1
12345	99	83	82	cyclictest	0	-21	swapper/3	08:53:40	3
12345	99	83	82	cyclictest	0	-21	swapper/3	08:45:28	3
12345	99	83	82	cyclictest	0	-21	swapper/3	08:40:38	3
12345	99	83	82	cyclictest	0	-21	swapper/3	08:30:32	3
12345	99	83	82	cyclictest	0	-21	swapper/3	08:25:39	3
12345	99	83	82	cyclictest	0	-21	swapper/3	08:18:36	3
12345	99	83	82	cyclictest	0	-21	swapper/3	08:08:34	3
12345	99	83	82	cyclictest	0	-21	swapper/3	07:50:40	3
12345	99	83	82	cyclictest	0	-21	swapper/3	07:40:38	3
12345	99	83	82	cyclictest	0	-21	swapper/3	07:30:41	3
12345	99	83	82	cyclictest	0	-21	swapper/3	07:22:03	3
12345	99	83	82	cyclictest	0	-21	swapper/3	07:15:41	3
12345	99	83	82	cyclictest	0	-21	swapper/3	07:05:41	3
12345	99	83	82	cyclictest	0	-21	swapper/3	06:53:23	3
12345	99	83	82	cyclictest	0	-21	swapper/3	06:40:42	3
12345	99	83	82	cyclictest	0	-21	swapper/3	06:39:24	3
12345	99	83	82	cyclictest	0	-21	swapper/3	06:30:40	3
12345	99	83	82	cyclictest	0	-21	swapper/3	06:16:45	3
12345	99	83	82	cyclictest	0	-21	swapper/3	06:13:19	3
12345	99	83	82	cyclictest	0	-21	swapper/3	06:02:06	3
12345	99	83	82	cyclictest	0	-21	swapper/3	05:40:44	3
12345	99	83	82	cyclictest	0	-21	swapper/3	05:30:45	3
12345	99	83	82	cyclictest	0	-21	swapper/3	05:20:36	3
12345	99	83	82	cyclictest	0	-21	swapper/3	05:15:44	3
12345	99	83	82	cyclictest	0	-21	swapper/3	05:13:10	3
12345	99	83	82	cyclictest	0	-21	swapper/3	05:05:45	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:50:46	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:45:46	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:36:04	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:30:48	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:26:55	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:25:26	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:10:39	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:05:48	3
12345	99	83	82	cyclictest	0	-21	swapper/3	04:00:40	3
12345	99	83	82	cyclictest	0	-21	swapper/3	03:45:48	3
12345	99	83	82	cyclictest	0	-21	swapper/3	03:45:48	3
12345	99	83	82	cyclictest	0	-21	swapper/3	03:40:41	3
12345	99	83	81	cyclictest	0	-21	swapper/3	08:20:31	3
12345	99	83	71	cyclictest	0	-21	swapper/3	06:00:23	3
12345	99	83	71	cyclictest	0	-21	swapper/3	06:00:23	3
12343	99	83	82	cyclictest	2405	-21	tune2fs	05:45:39	1
12343	99	83	82	cyclictest	0	-21	swapper/1	08:15:38	1
12343	99	83	82	cyclictest	0	-21	swapper/1	08:10:39	1
12343	99	83	82	cyclictest	0	-21	swapper/1	07:50:34	1
12343	99	83	82	cyclictest	0	-21	swapper/1	07:30:39	1
12343	99	83	82	cyclictest	0	-21	swapper/1	07:25:40	1
12343	99	83	82	cyclictest	0	-21	swapper/1	07:18:27	1
12343	99	83	82	cyclictest	0	-21	swapper/1	06:39:24	1
12343	99	83	82	cyclictest	0	-21	swapper/1	06:25:43	1
12343	99	83	82	cyclictest	0	-21	swapper/1	06:15:43	1
12343	99	83	82	cyclictest	0	-21	swapper/1	06:10:42	1
12343	99	83	82	cyclictest	0	-21	swapper/1	05:55:43	1
12343	99	83	82	cyclictest	0	-21	swapper/1	05:55:43	1
12343	99	83	82	cyclictest	0	-21	swapper/1	05:50:43	1
12343	99	83	82	cyclictest	0	-21	swapper/1	05:35:43	1
12343	99	83	82	cyclictest	0	-21	swapper/1	05:31:23	1
12343	99	83	82	cyclictest	0	-21	swapper/1	05:15:24	1
12343	99	83	82	cyclictest	0	-21	swapper/1	05:05:38	1
12343	99	83	82	cyclictest	0	-21	swapper/1	04:58:08	1
12343	99	83	82	cyclictest	0	-21	swapper/1	04:50:46	1
12343	99	83	82	cyclictest	0	-21	swapper/1	04:35:25	1
12343	99	83	82	cyclictest	0	-21	swapper/1	04:10:10	1
12343	99	83	82	cyclictest	0	-21	swapper/1	03:55:50	1
12343	99	83	81	cyclictest	4738	-21	tune2fs	07:05:34	1
12343	99	83	81	cyclictest	17564	-21	tune2fs	07:35:33	1
12343	99	83	81	cyclictest	15437	-21	tune2fs	08:45:28	1
12343	99	83	81	cyclictest	15121	-21	tune2fs	05:00:39	1
12343	99	83	81	cyclictest	15085	-21	tune2fs	03:45:41	1
12343	99	83	81	cyclictest	15085	-21	tune2fs	03:45:41	1
12345	99	82	81	cyclictest	0	-21	swapper/3	06:20:36	3
12345	99	82	81	cyclictest	0	-21	swapper/3	05:50:37	3
12345	99	82	81	cyclictest	0	-21	swapper/3	04:15:38	3
12343	99	77	72	cyclictest	0	-21	swapper/1	06:00:34	1
12343	99	77	72	cyclictest	0	-21	swapper/1	04:26:55	1
12343	99	76	72	cyclictest	0	-21	swapper/1	08:30:34	1
12343	99	76	72	cyclictest	0	-21	swapper/1	07:22:03	1
12343	99	76	62	cyclictest	0	-21	swapper/1	08:23:10	1
12345	99	74	72	cyclictest	0	-21	swapper/3	05:02:38	3
12343	99	74	66	cyclictest	30456	-21	tune2fs	06:50:34	1
12345	99	73	72	cyclictest	0	-21	swapper/3	07:25:30	3
12345	99	73	72	cyclictest	0	-21	swapper/3	07:10:32	3
12345	99	73	72	cyclictest	0	-21	swapper/3	06:45:34	3
12343	99	73	72	cyclictest	0	-21	swapper/1	09:05:29	1
12343	99	73	72	cyclictest	0	-21	swapper/1	09:05:16	1
12343	99	73	72	cyclictest	0	-21	swapper/1	08:55:15	1
12343	99	73	72	cyclictest	0	-21	swapper/1	08:45:16	1
12343	99	73	72	cyclictest	0	-21	swapper/1	08:25:36	1
12343	99	73	72	cyclictest	0	-21	swapper/1	08:05:31	1
12343	99	73	72	cyclictest	0	-21	swapper/1	07:00:33	1
12343	99	73	72	cyclictest	0	-21	swapper/1	04:15:40	1
12343	99	73	72	cyclictest	0	-21	swapper/1	04:13:02	1
12343	99	73	72	cyclictest	0	-21	swapper/1	03:50:47	1
12343	99	73	71	cyclictest	19479	-21	aten2.4-expect	08:55:29	1
12343	99	73	62	cyclictest	0	-21	swapper/1	06:48:56	1
12345	99	72	71	cyclictest	0	-21	swapper/3	07:35:33	3
12345	99	72	71	cyclictest	0	-21	swapper/3	06:25:36	3
12343	99	69	68	cyclictest	0	-21	swapper/1	08:00:39	1
12345	99	68	67	cyclictest	0	-21	swapper/3	07:55:29	3
12343	99	68	67	cyclictest	0	-21	swapper/1	06:20:34	1
12343	99	66	64	cyclictest	21520	-21	tune2fs	04:00:40	1
12343	99	66	62	cyclictest	0	-21	swapper/1	08:37:50	1
12343	99	66	62	cyclictest	0	-21	swapper/1	05:20:17	1
12343	99	66	51	cyclictest	0	-21	swapper/1	04:43:59	1
12345	99	64	62	cyclictest	0	-21	swapper/3	07:00:42	3
12345	99	63	62	cyclictest	0	-21	swapper/3	09:05:28	3
12345	99	63	62	cyclictest	0	-21	swapper/3	09:00:31	3
12345	99	63	62	cyclictest	0	-21	swapper/3	08:55:29	3
12345	99	63	62	cyclictest	0	-21	swapper/3	08:35:30	3
12345	99	63	62	cyclictest	0	-21	swapper/3	08:10:31	3
12345	99	63	62	cyclictest	0	-21	swapper/3	08:00:30	3
12345	99	63	62	cyclictest	0	-21	swapper/3	07:45:30	3
12345	99	63	62	cyclictest	0	-21	swapper/3	06:55:20	3
12345	99	63	62	cyclictest	0	-21	swapper/3	05:45:38	3
12345	99	63	62	cyclictest	0	-21	swapper/3	05:35:29	3
12345	99	63	62	cyclictest	0	-21	swapper/3	05:25:38	3
12345	99	63	62	cyclictest	0	-21	swapper/3	04:55:38	3
12345	99	63	62	cyclictest	0	-21	swapper/3	03:55:40	3
12345	99	63	51	cyclictest	0	-21	swapper/3	04:40:37	3
12345	99	63	51	cyclictest	0	-21	swapper/3	03:50:42	3
12343	99	63	62	cyclictest	0	-21	swapper/1	06:55:33	1
12343	99	63	62	cyclictest	0	-21	swapper/1	06:40:33	1
12343	99	63	62	cyclictest	0	-21	swapper/1	05:25:38	1
12342	99	62	61	cyclictest	0	-21	swapper/0	05:59:50	0
12342	99	62	61	cyclictest	0	-21	swapper/0	05:59:50	0
12344	99	58	57	cyclictest	0	-21	swapper/2	03:55:40	2
12342	99	58	41	cyclictest	0	-21	swapper/0	06:54:42	0
12344	99	57	52	cyclictest	278	-21	usb-storage	07:31:48	2
12344	99	57	51	cyclictest	0	-21	swapper/2	07:10:13	2
12342	99	57	50	cyclictest	0	-21	swapper/0	06:33:51	0
12344	99	56	55	cyclictest	278	-21	usb-storage	06:49:14	2
12344	99	56	41	cyclictest	0	-21	swapper/2	09:00:35	2
12344	99	55	54	cyclictest	23240	-21	latency_hist	05:20:24	2
12344	99	55	54	cyclictest	17022	-21	munin-node	05:05:37	2
12344	99	55	51	cyclictest	0	-21	swapper/2	06:41:56	2
12344	99	55	51	cyclictest	0	-21	swapper/2	04:03:50	2
12342	99	55	48	cyclictest	0	-21	swapper/0	05:02:02	0
12342	99	55	48	cyclictest	0	-21	swapper/0	04:15:26	0
12342	99	55	47	cyclictest	0	-21	swapper/0	03:49:51	0
12342	99	55	47	cyclictest	0	-21	swapper/0	03:49:51	0
12344	99	54	53	cyclictest	32163	-21	munin-node	06:55:33	2
12344	99	54	53	cyclictest	28465	-21	munin-node	04:15:41	2
12344	99	54	53	cyclictest	22759	-21	munin-node	07:45:39	2
12344	99	54	53	cyclictest	13828	-21	munin-node	07:25:37	2
12344	99	54	53	cyclictest	12008	-21	timerandwakeup	07:20:43	2
12344	99	54	52	cyclictest	50	50	irq/44-ahci	07:40:44	2
12344	99	54	41	cyclictest	392	-21	md2_raid1	06:25:26	2
12344	99	53	52	cyclictest	9894	-21	munin-node	06:00:48	2
12344	99	53	52	cyclictest	5431	-21	munin-node	08:20:37	2
12344	99	53	52	cyclictest	31518	-21	munin-node	06:50:43	2
12344	99	53	52	cyclictest	25710	-21	munin-node	07:55:28	2
12344	99	53	52	cyclictest	23429	-21	aten2.4_r3power	05:20:37	2
12344	99	53	52	cyclictest	2001	-21	telnet	08:15:28	2
12344	99	53	52	cyclictest	0	-21	swapper/2	08:45:25	2
12344	99	53	52	cyclictest	0	-21	swapper/2	08:05:31	2
12344	99	53	52	cyclictest	0	-21	swapper/2	07:50:31	2
12344	99	53	52	cyclictest	0	-21	swapper/2	06:10:33	2
12344	99	53	52	cyclictest	0	-21	swapper/2	06:05:32	2
12344	99	53	52	cyclictest	0	-21	swapper/2	05:40:43	2
12344	99	53	52	cyclictest	0	-21	swapper/2	05:35:34	2
12344	99	53	52	cyclictest	0	-21	swapper/2	04:10:38	2
12344	99	53	52	cyclictest	0	-21	swapper/2	03:43:33	2
12344	99	53	51	cyclictest	8272	-21	telnet	04:45:37	2
12344	99	53	51	cyclictest	6182	-21	telnet	05:55:34	2
12344	99	53	51	cyclictest	6182	-21	telnet	05:55:34	2
12344	99	53	51	cyclictest	50	50	irq/44-ahci	08:39:28	2
12344	99	53	51	cyclictest	50	50	irq/44-ahci	04:25:39	2
12344	99	53	51	cyclictest	3854	-21	telnet	04:35:38	2
12344	99	53	51	cyclictest	278	-21	usb-storage	07:19:17	2
12344	99	53	51	cyclictest	278	-21	usb-storage	05:54:22	2
12344	99	53	51	cyclictest	278	-21	usb-storage	05:33:45	2
12344	99	53	51	cyclictest	1917	-21	telnet	07:00:32	2
12344	99	53	51	cyclictest	1876	-21	hald-addon-stor	08:53:17	2
12344	99	53	51	cyclictest	18	1	ksoftirqd/2	06:33:51	2
12344	99	53	51	cyclictest	17128	-21	telnet	07:35:30	2
12344	99	53	51	cyclictest	14895	-21	telnet	06:15:34	2
12344	99	53	50	cyclictest	0	-21	swapper/2	05:29:01	2
12344	99	53	41	cyclictest	6608	-21	df_abs	08:25:31	2
12344	99	53	41	cyclictest	2947	-21	proc_pri	04:30:46	2
12344	99	53	41	cyclictest	18387	-21	timerandwakeup	06:20:44	2
12344	99	53	41	cyclictest	0	-21	swapper/2	08:30:30	2
12344	99	53	41	cyclictest	0	-21	swapper/2	05:45:37	2
12344	99	53	41	cyclictest	0	-21	swapper/2	03:45:38	2
12344	99	53	41	cyclictest	0	-21	swapper/2	03:45:38	2
12342	99	53	52	cyclictest	0	-21	swapper/0	06:38:00	0
12342	99	53	52	cyclictest	0	-21	swapper/0	06:10:33	0
12342	99	53	50	cyclictest	0	-21	swapper/0	07:43:30	0
12342	99	53	49	cyclictest	0	-21	swapper/0	08:28:52	0
12342	99	53	46	cyclictest	0	-21	swapper/0	07:52:30	0
12344	99	52	51	cyclictest	6077	-21	telnet	04:40:37	2
12344	99	52	51	cyclictest	29778	-21	telnet	04:20:37	2
12344	99	52	51	cyclictest	24608	-21	munin-node	06:35:40	2
12344	99	52	51	cyclictest	23246	-21	telnet	04:05:39	2
12344	99	52	51	cyclictest	14721	-21	telnet	05:00:37	2
12344	99	52	51	cyclictest	0	-21	swapper/2	09:08:57	2
12344	99	52	51	cyclictest	0	-21	swapper/2	08:55:29	2
12344	99	52	51	cyclictest	0	-21	swapper/2	07:10:35	2
12344	99	52	51	cyclictest	0	-21	swapper/2	05:11:42	2
12344	99	52	51	cyclictest	0	-21	swapper/2	04:50:36	2
12344	99	52	41	cyclictest	325	-21	fschecks_time	08:10:32	2
12344	99	52	41	cyclictest	13110	-21	cpuspeed	08:40:29	2
12344	99	52	41	cyclictest	0	-21	swapper/2	03:50:48	2
12342	99	52	51	cyclictest	760	50	irq/18-parport0	05:28:53	0
12342	99	52	51	cyclictest	0	-21	swapper/0	08:08:11	0
12342	99	52	51	cyclictest	0	-21	swapper/0	07:36:31	0
12342	99	52	51	cyclictest	0	-21	swapper/0	07:33:29	0
12342	99	52	51	cyclictest	0	-21	swapper/0	07:20:21	0
12342	99	52	51	cyclictest	0	-21	swapper/0	07:07:55	0
12342	99	52	51	cyclictest	0	-21	swapper/0	06:25:34	0
12342	99	52	51	cyclictest	0	-21	swapper/0	06:03:36	0
12342	99	52	51	cyclictest	0	-21	swapper/0	05:40:01	0
12342	99	52	51	cyclictest	0	-21	swapper/0	05:22:55	0
12342	99	52	51	cyclictest	0	-21	swapper/0	05:20:17	0
12342	99	52	51	cyclictest	0	-21	swapper/0	04:36:41	0
12342	99	52	51	cyclictest	0	-21	swapper/0	04:00:34	0
12342	99	52	50	cyclictest	0	-21	swapper/0	04:44:11	0
12342	99	51	50	cyclictest	0	-21	swapper/0	08:56:51	0
12342	99	51	50	cyclictest	0	-21	swapper/0	08:45:26	0
12342	99	51	50	cyclictest	0	-21	swapper/0	08:40:50	0
12342	99	51	50	cyclictest	0	-21	swapper/0	08:32:22	0
12342	99	51	50	cyclictest	0	-21	swapper/0	08:20:17	0
12342	99	51	50	cyclictest	0	-21	swapper/0	08:12:45	0
12342	99	51	50	cyclictest	0	-21	swapper/0	07:46:34	0
12342	99	51	50	cyclictest	0	-21	swapper/0	07:03:59	0
12342	99	51	50	cyclictest	0	-21	swapper/0	06:55:30	0
12342	99	51	50	cyclictest	0	-21	swapper/0	06:47:56	0
12342	99	51	50	cyclictest	0	-21	swapper/0	06:20:49	0
12342	99	51	50	cyclictest	0	-21	swapper/0	06:06:02	0
12342	99	51	50	cyclictest	0	-21	swapper/0	05:50:46	0
12342	99	51	50	cyclictest	0	-21	swapper/0	05:44:28	0
12342	99	51	50	cyclictest	0	-21	swapper/0	05:32:35	0
12342	99	51	50	cyclictest	0	-21	swapper/0	05:14:23	0
12342	99	51	50	cyclictest	0	-21	swapper/0	04:50:55	0
12342	99	51	50	cyclictest	0	-21	swapper/0	04:35:21	0
12342	99	51	50	cyclictest	0	-21	swapper/0	04:23:04	0
12342	99	51	50	cyclictest	0	-21	swapper/0	04:19:50	0
12342	99	51	50	cyclictest	0	-21	swapper/0	04:05:50	0
12342	99	51	50	cyclictest	0	-21	swapper/0	03:55:48	0
12342	99	51	50	cyclictest	0	-21	swapper/0	03:40:59	0
12342	99	51	49	cyclictest	0	-21	swapper/0	07:58:45	0
12342	99	51	49	cyclictest	0	-21	swapper/0	05:45:28	0
12342	99	51	44	cyclictest	0	-21	swapper/0	09:07:17	0
12344	99	50	49	cyclictest	28738	-21	munin-node	08:00:34	2
12342	99	50	49	cyclictest	0	-21	swapper/0	09:03:00	0
12342	99	50	49	cyclictest	0	-21	swapper/0	08:52:15	0
12342	99	50	49	cyclictest	0	-21	swapper/0	08:37:18	0
12342	99	50	49	cyclictest	0	-21	swapper/0	08:02:13	0
12342	99	50	49	cyclictest	0	-21	swapper/0	07:17:21	0
12342	99	50	49	cyclictest	0	-21	swapper/0	06:16:52	0
12342	99	50	49	cyclictest	0	-21	swapper/0	05:08:00	0
12342	99	50	49	cyclictest	0	-21	swapper/0	04:48:26	0
12342	99	50	49	cyclictest	0	-21	swapper/0	04:28:39	0
12342	99	50	29	cyclictest	0	-21	swapper/0	03:50:55	0
12344	99	49	48	cyclictest	0	-21	swapper/2	04:59:14	2
12342	99	49	48	cyclictest	0	-21	swapper/0	07:25:30	0
12342	99	49	48	cyclictest	0	-21	swapper/0	06:43:22	0
12342	99	49	48	cyclictest	0	-21	swapper/0	04:55:30	0
12342	99	48	47	cyclictest	0	-21	swapper/0	08:25:08	0
12342	99	43	42	cyclictest	0	-21	swapper/0	07:10:32	0
21	99	11	0	migration/3	11003	-21	gltestperf	03:35:43	3
16	99	11	0	migration/2	10801	-21	fschecks_time	03:35:42	2
8	99	9	0	watchdog/0	0	-21	swapper/0	03:36:03	0
12	1	5	0	ksoftirqd/1	11815	-40	yum-updatesd-he	03:36:05	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17