OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Wed Sep 02, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
18654	99	123	122	cyclictest	23073	-21	sadc	05:59:32	3
18654	99	123	122	cyclictest	23073	-21	sadc	05:59:32	3
18652	99	104	102	cyclictest	28037	-21	tune2fs	04:54:48	1
18654	99	103	102	cyclictest	0	-21	swapper/3	03:29:52	3
18652	99	103	92	cyclictest	0	-21	swapper/1	07:44:42	1
18652	99	103	102	cyclictest	0	-21	swapper/1	05:59:32	1
18652	99	103	102	cyclictest	0	-21	swapper/1	05:59:32	1
18654	99	101	100	cyclictest	0	-21	swapper/3	05:19:46	3
18654	99	93	92	cyclictest	0	-21	swapper/3	04:54:48	3
18652	99	93	92	cyclictest	0	-21	swapper/1	05:47:33	1
18654	99	91	79	cyclictest	0	-21	swapper/3	07:54:38	3
18652	99	85	82	cyclictest	17173	-21	tune2fs	04:29:49	1
18654	99	84	83	cyclictest	8779	-21	gltestperf	04:09:50	3
18654	99	84	72	cyclictest	0	-21	swapper/3	08:24:40	3
18654	99	84	72	cyclictest	0	-21	swapper/3	06:49:52	3
18654	99	84	72	cyclictest	0	-21	swapper/3	05:52:53	3
18654	99	84	72	cyclictest	0	-21	swapper/3	05:44:49	3
18654	99	84	72	cyclictest	0	-21	swapper/3	05:34:50	3
18654	99	84	72	cyclictest	0	-21	swapper/3	04:34:49	3
18654	99	84	72	cyclictest	0	-21	swapper/3	04:14:51	3
18652	99	84	83	cyclictest	0	-21	swapper/1	08:24:29	1
18652	99	84	82	cyclictest	8962	-21	tune2fs	07:54:39	1
18652	99	84	82	cyclictest	8635	-21	tune2fs	04:09:50	1
18652	99	84	82	cyclictest	30001	-21	tune2fs	03:44:51	1
18652	99	84	82	cyclictest	23941	-21	tune2fs	07:14:41	1
18654	99	83	82	cyclictest	0	-21	swapper/3	08:49:25	3
18654	99	83	82	cyclictest	0	-21	swapper/3	08:42:59	3
18654	99	83	82	cyclictest	0	-21	swapper/3	08:29:47	3
18654	99	83	82	cyclictest	0	-21	swapper/3	08:16:01	3
18654	99	83	82	cyclictest	0	-21	swapper/3	08:09:43	3
18654	99	83	82	cyclictest	0	-21	swapper/3	07:59:48	3
18654	99	83	82	cyclictest	0	-21	swapper/3	07:49:42	3
18654	99	83	82	cyclictest	0	-21	swapper/3	07:44:47	3
18654	99	83	82	cyclictest	0	-21	swapper/3	07:24:51	3
18654	99	83	82	cyclictest	0	-21	swapper/3	07:19:50	3
18654	99	83	82	cyclictest	0	-21	swapper/3	07:04:52	3
18654	99	83	82	cyclictest	0	-21	swapper/3	06:44:42	3
18654	99	83	82	cyclictest	0	-21	swapper/3	06:39:51	3
18654	99	83	82	cyclictest	0	-21	swapper/3	06:04:53	3
18654	99	83	82	cyclictest	0	-21	swapper/3	05:39:51	3
18654	99	83	82	cyclictest	0	-21	swapper/3	04:59:54	3
18654	99	83	82	cyclictest	0	-21	swapper/3	04:19:56	3
18654	99	83	82	cyclictest	0	-21	swapper/3	03:59:50	3
18654	99	83	82	cyclictest	0	-21	swapper/3	03:52:17	3
18654	99	83	82	cyclictest	0	-21	swapper/3	03:24:50	3
18654	99	83	71	cyclictest	0	-21	swapper/3	08:19:42	3
18654	99	83	71	cyclictest	0	-21	swapper/3	07:14:29	3
18654	99	83	71	cyclictest	0	-21	swapper/3	06:24:44	3
18654	99	83	71	cyclictest	0	-21	swapper/3	05:24:44	3
18654	99	83	71	cyclictest	0	-21	swapper/3	04:29:47	3
18652	99	83	82	cyclictest	23391	-21	tune2fs	03:29:51	1
18652	99	83	82	cyclictest	0	-21	swapper/1	08:44:46	1
18652	99	83	82	cyclictest	0	-21	swapper/1	08:42:54	1
18652	99	83	82	cyclictest	0	-21	swapper/1	08:14:47	1
18652	99	83	82	cyclictest	0	-21	swapper/1	07:34:45	1
18652	99	83	82	cyclictest	0	-21	swapper/1	07:29:49	1
18652	99	83	82	cyclictest	0	-21	swapper/1	07:24:47	1
18652	99	83	82	cyclictest	0	-21	swapper/1	07:04:44	1
18652	99	83	82	cyclictest	0	-21	swapper/1	06:59:51	1
18652	99	83	82	cyclictest	0	-21	swapper/1	06:54:43	1
18652	99	83	82	cyclictest	0	-21	swapper/1	06:44:52	1
18652	99	83	82	cyclictest	0	-21	swapper/1	06:39:48	1
18652	99	83	82	cyclictest	0	-21	swapper/1	06:34:48	1
18652	99	83	82	cyclictest	0	-21	swapper/1	06:12:37	1
18652	99	83	82	cyclictest	0	-21	swapper/1	06:04:51	1
18652	99	83	82	cyclictest	0	-21	swapper/1	05:42:32	1
18652	99	83	82	cyclictest	0	-21	swapper/1	05:24:52	1
18652	99	83	82	cyclictest	0	-21	swapper/1	05:19:50	1
18652	99	83	82	cyclictest	0	-21	swapper/1	05:14:51	1
18652	99	83	82	cyclictest	0	-21	swapper/1	05:10:14	1
18652	99	83	82	cyclictest	0	-21	swapper/1	05:04:55	1
18652	99	83	82	cyclictest	0	-21	swapper/1	04:49:52	1
18652	99	83	82	cyclictest	0	-21	swapper/1	04:39:35	1
18652	99	83	82	cyclictest	0	-21	swapper/1	04:14:54	1
18652	99	83	81	cyclictest	6691	-21	tune2fs	07:49:42	1
18652	99	83	81	cyclictest	4111	-21	tune2fs	03:59:50	1
18652	99	83	81	cyclictest	30100	-21	tune2fs	06:14:45	1
18652	99	83	81	cyclictest	27917	-21	tune2fs	03:39:52	1
18652	99	83	81	cyclictest	23915	-21	tune2fs	08:29:40	1
18652	99	83	81	cyclictest	21323	-21	tune2fs	03:24:50	1
18652	99	83	81	cyclictest	19670	-21	tune2fs	08:19:40	1
18652	99	83	81	cyclictest	19393	-21	tune2fs	03:19:52	1
18652	99	83	81	cyclictest	19393	-21	tune2fs	03:19:52	1
18652	99	83	81	cyclictest	13061	-21	tune2fs	08:04:41	1
18652	99	83	71	cyclictest	0	-21	swapper/1	05:34:47	1
18654	99	82	81	cyclictest	0	-21	swapper/3	08:04:38	3
18654	99	82	81	cyclictest	0	-21	swapper/3	07:14:39	3
18654	99	82	81	cyclictest	0	-21	swapper/3	03:44:51	3
18654	99	82	81	cyclictest	0	-21	swapper/3	03:39:52	3
18654	99	82	81	cyclictest	0	-21	swapper/3	03:19:52	3
18654	99	82	81	cyclictest	0	-21	swapper/3	03:19:52	3
18654	99	82	80	cyclictest	0	-21	swapper/3	05:14:48	3
18654	99	82	71	cyclictest	0	-21	swapper/3	06:14:45	3
18653	99	82	80	cyclictest	0	-21	swapper/2	03:19:38	2
18653	99	82	80	cyclictest	0	-21	swapper/2	03:19:38	2
18654	99	81	80	cyclictest	0	-21	swapper/3	05:29:48	3
18654	99	81	80	cyclictest	0	-21	swapper/3	05:09:45	3
18654	99	81	80	cyclictest	0	-21	swapper/3	05:07:16	3
18654	99	81	80	cyclictest	0	-21	swapper/3	04:24:47	3
18654	99	80	79	cyclictest	0	-21	swapper/3	07:39:41	3
18654	99	75	74	cyclictest	25690	-21	fschecks_count	04:49:47	3
18654	99	73	72	cyclictest	0	-21	swapper/3	04:39:52	3
18654	99	73	72	cyclictest	0	-21	swapper/3	04:05:15	3
18654	99	73	72	cyclictest	0	-21	swapper/3	03:34:49	3
18652	99	73	72	cyclictest	0	-21	swapper/1	08:34:44	1
18652	99	73	72	cyclictest	0	-21	swapper/1	08:09:44	1
18652	99	73	72	cyclictest	0	-21	swapper/1	07:59:42	1
18652	99	73	72	cyclictest	0	-21	swapper/1	07:39:46	1
18652	99	73	72	cyclictest	0	-21	swapper/1	07:21:30	1
18652	99	73	72	cyclictest	0	-21	swapper/1	07:09:40	1
18652	99	73	72	cyclictest	0	-21	swapper/1	06:50:16	1
18652	99	73	72	cyclictest	0	-21	swapper/1	06:24:44	1
18652	99	73	72	cyclictest	0	-21	swapper/1	06:19:42	1
18652	99	73	72	cyclictest	0	-21	swapper/1	05:59:53	1
18652	99	73	72	cyclictest	0	-21	swapper/1	05:49:44	1
18652	99	73	72	cyclictest	0	-21	swapper/1	05:29:44	1
18652	99	73	72	cyclictest	0	-21	swapper/1	04:59:45	1
18652	99	73	72	cyclictest	0	-21	swapper/1	04:45:41	1
18652	99	73	72	cyclictest	0	-21	swapper/1	04:41:55	1
18652	99	73	72	cyclictest	0	-21	swapper/1	04:19:53	1
18652	99	73	72	cyclictest	0	-21	swapper/1	04:04:49	1
18652	99	73	72	cyclictest	0	-21	swapper/1	03:54:56	1
18652	99	73	72	cyclictest	0	-21	swapper/1	03:49:48	1
18652	99	73	72	cyclictest	0	-21	swapper/1	03:34:48	1
18654	99	72	71	cyclictest	6233	-21	cpu	06:34:43	3
18654	99	72	71	cyclictest	0	-21	swapper/3	08:34:38	3
18654	99	72	71	cyclictest	0	-21	swapper/3	07:34:42	3
18654	99	72	71	cyclictest	0	-21	swapper/3	07:29:43	3
18654	99	72	71	cyclictest	0	-21	swapper/3	06:59:44	3
18654	99	72	71	cyclictest	0	-21	swapper/3	06:54:42	3
18654	99	72	71	cyclictest	0	-21	swapper/3	06:29:35	3
18654	99	72	71	cyclictest	0	-21	swapper/3	06:19:42	3
18654	99	72	71	cyclictest	0	-21	swapper/3	06:09:43	3
18654	99	72	71	cyclictest	0	-21	swapper/3	05:59:46	3
18654	99	72	71	cyclictest	0	-21	swapper/3	04:44:49	3
18654	99	72	71	cyclictest	0	-21	swapper/3	03:54:47	3
18652	99	72	71	cyclictest	0	-21	swapper/1	04:26:45	1
18652	99	67	62	cyclictest	0	-21	swapper/1	06:29:44	1
18651	99	59	52	cyclictest	0	-21	swapper/0	07:42:55	0
18651	99	58	41	cyclictest	0	-21	swapper/0	07:34:27	0
18651	99	57	50	cyclictest	0	-21	swapper/0	06:34:00	0
18653	99	54	49	cyclictest	0	-21	swapper/2	04:11:23	2
18651	99	54	53	cyclictest	0	-21	swapper/0	04:42:34	0
18653	99	53	52	cyclictest	0	-21	swapper/2	07:04:43	2
18653	99	53	52	cyclictest	0	-21	swapper/2	06:24:43	2
18653	99	53	41	cyclictest	50	50	irq/44-ahci	05:25:00	2
18653	99	53	41	cyclictest	278	-21	usb-storage	05:33:40	2
18653	99	53	31	cyclictest	278	-21	usb-storage	05:08:15	2
18653	99	53	31	cyclictest	0	-21	swapper/2	05:54:19	2
18651	99	53	52	cyclictest	50	50	irq/44-ahci	07:04:43	0
18651	99	53	52	cyclictest	0	-21	swapper/0	08:34:37	0
18651	99	53	52	cyclictest	0	-21	swapper/0	08:24:38	0
18651	99	53	52	cyclictest	0	-21	swapper/0	08:19:16	0
18651	99	53	52	cyclictest	0	-21	swapper/0	08:04:39	0
18651	99	53	52	cyclictest	0	-21	swapper/0	08:03:10	0
18651	99	53	52	cyclictest	0	-21	swapper/0	07:49:39	0
18651	99	53	52	cyclictest	0	-21	swapper/0	07:34:40	0
18651	99	53	52	cyclictest	0	-21	swapper/0	07:11:12	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:59:42	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:54:40	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:44:41	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:34:42	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:24:44	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:19:42	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:14:43	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:09:48	0
18651	99	53	52	cyclictest	0	-21	swapper/0	06:04:44	0
18651	99	53	52	cyclictest	0	-21	swapper/0	05:49:44	0
18651	99	53	52	cyclictest	0	-21	swapper/0	05:39:45	0
18651	99	53	52	cyclictest	0	-21	swapper/0	05:34:44	0
18651	99	53	52	cyclictest	0	-21	swapper/0	05:14:45	0
18651	99	53	52	cyclictest	0	-21	swapper/0	05:13:29	0
18651	99	53	52	cyclictest	0	-21	swapper/0	05:04:47	0
18651	99	53	52	cyclictest	0	-21	swapper/0	04:59:45	0
18651	99	53	52	cyclictest	0	-21	swapper/0	04:54:45	0
18651	99	53	52	cyclictest	0	-21	swapper/0	04:44:48	0
18651	99	53	52	cyclictest	0	-21	swapper/0	04:19:47	0
18651	99	53	52	cyclictest	0	-21	swapper/0	04:14:45	0
18651	99	53	52	cyclictest	0	-21	swapper/0	04:09:47	0
18651	99	53	52	cyclictest	0	-21	swapper/0	03:28:51	0
18651	99	53	52	cyclictest	0	-21	swapper/0	03:19:48	0
18651	99	53	52	cyclictest	0	-21	swapper/0	03:19:48	0
18651	99	53	41	cyclictest	0	-21	swapper/0	05:55:53	0
18651	99	53	41	cyclictest	0	-21	swapper/0	05:55:53	0
18651	99	53	41	cyclictest	0	-21	swapper/0	03:50:32	0
18653	99	52	51	cyclictest	278	-21	usb-storage	03:49:40	2
18653	99	52	51	cyclictest	27587	-21	telnet	06:09:42	2
18653	99	52	51	cyclictest	0	-21	swapper/2	08:34:37	2
18653	99	52	51	cyclictest	0	-21	swapper/2	08:24:38	2
18653	99	52	51	cyclictest	0	-21	swapper/2	08:04:39	2
18653	99	52	51	cyclictest	0	-21	swapper/2	07:59:45	2
18653	99	52	51	cyclictest	0	-21	swapper/2	07:49:39	2
18653	99	52	51	cyclictest	0	-21	swapper/2	07:39:39	2
18653	99	52	51	cyclictest	0	-21	swapper/2	07:29:40	2
18653	99	52	51	cyclictest	0	-21	swapper/2	07:24:41	2
18653	99	52	51	cyclictest	0	-21	swapper/2	07:09:40	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:59:42	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:54:40	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:44:41	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:34:42	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:29:42	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:19:42	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:14:43	2
18653	99	52	51	cyclictest	0	-21	swapper/2	06:04:44	2
18653	99	52	51	cyclictest	0	-21	swapper/2	05:54:44	2
18653	99	52	51	cyclictest	0	-21	swapper/2	05:54:44	2
18653	99	52	51	cyclictest	0	-21	swapper/2	05:44:44	2
18653	99	52	51	cyclictest	0	-21	swapper/2	05:39:45	2
18653	99	52	51	cyclictest	0	-21	swapper/2	05:34:44	2
18653	99	52	51	cyclictest	0	-21	swapper/2	05:14:44	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:59:45	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:54:45	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:49:46	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:48:56	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:42:34	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:34:48	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:29:47	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:19:47	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:14:47	2
18653	99	52	51	cyclictest	0	-21	swapper/2	04:01:32	2
18653	99	52	51	cyclictest	0	-21	swapper/2	03:39:48	2
18653	99	52	51	cyclictest	0	-21	swapper/2	03:24:48	2
18653	99	52	41	cyclictest	278	-21	usb-storage	08:15:50	2
18651	99	52	51	cyclictest	0	-21	swapper/0	08:39:37	0
18651	99	52	51	cyclictest	0	-21	swapper/0	08:29:37	0
18651	99	52	51	cyclictest	0	-21	swapper/0	08:09:37	0
18651	99	52	51	cyclictest	0	-21	swapper/0	07:14:38	0
18651	99	52	51	cyclictest	0	-21	swapper/0	06:43:29	0
18651	99	52	51	cyclictest	0	-21	swapper/0	05:44:44	0
18651	99	52	51	cyclictest	0	-21	swapper/0	05:32:22	0
18651	99	52	51	cyclictest	0	-21	swapper/0	04:04:48	0
18651	99	52	51	cyclictest	0	-21	swapper/0	03:39:49	0
18651	99	52	51	cyclictest	0	-21	swapper/0	03:29:50	0
18651	99	51	50	cyclictest	0	-21	swapper/0	08:19:37	0
18651	99	51	50	cyclictest	0	-21	swapper/0	07:56:47	0
18651	99	51	50	cyclictest	0	-21	swapper/0	05:59:44	0
18651	99	51	50	cyclictest	0	-21	swapper/0	04:49:46	0
18651	99	51	50	cyclictest	0	-21	swapper/0	04:34:48	0
18651	99	51	50	cyclictest	0	-21	swapper/0	04:33:40	0
18651	99	51	50	cyclictest	0	-21	swapper/0	03:38:46	0
18653	99	50	49	cyclictest	0	-21	swapper/2	07:54:36	2
18651	99	50	49	cyclictest	0	-21	swapper/0	03:44:49	0
18651	99	48	41	cyclictest	0	-21	swapper/0	08:47:17	0
18651	99	48	41	cyclictest	0	-21	swapper/0	07:48:35	0
18651	99	48	41	cyclictest	0	-21	swapper/0	07:27:48	0
18651	99	48	41	cyclictest	0	-21	swapper/0	07:21:36	0
18651	99	48	41	cyclictest	0	-21	swapper/0	06:53:45	0
18651	99	48	41	cyclictest	0	-21	swapper/0	05:23:20	0
18651	99	48	41	cyclictest	0	-21	swapper/0	03:56:16	0
18653	99	47	46	cyclictest	0	-21	swapper/2	03:45:44	2
18653	99	46	45	cyclictest	0	-21	swapper/2	08:24:16	2
18653	99	46	45	cyclictest	0	-21	swapper/2	05:10:25	2
18653	99	46	45	cyclictest	0	-21	swapper/2	03:38:46	2
18651	99	46	45	cyclictest	0	-21	swapper/0	04:02:02	0
18653	99	45	44	cyclictest	28931	-21	munin-node	08:39:45	2
18653	99	45	31	cyclictest	0	-21	swapper/2	08:44:45	2
18653	99	44	43	cyclictest	25276	-21	runrttasks	08:32:21	2
18653	99	44	42	cyclictest	18	1	ksoftirqd/2	03:54:57	2
18653	99	43	42	cyclictest	1109	-21	kauditd	06:49:30	2
18653	99	43	42	cyclictest	0	-21	swapper/2	08:09:41	2
18653	99	43	42	cyclictest	0	-21	swapper/2	07:34:40	2
18653	99	43	42	cyclictest	0	-21	swapper/2	04:24:50	2
18653	99	43	42	cyclictest	0	-21	swapper/2	04:05:19	2
18653	99	43	41	cyclictest	50	50	irq/44-ahci	06:02:33	2
18653	99	43	41	cyclictest	278	-21	usb-storage	07:23:12	2
18653	99	43	31	cyclictest	278	-21	usb-storage	05:19:57	2
18653	99	43	31	cyclictest	0	-21	swapper/2	07:17:12	2
18653	99	43	31	cyclictest	0	-21	swapper/2	06:42:50	2
18651	99	43	41	cyclictest	0	-21	swapper/0	05:24:36	0
18653	99	42	41	cyclictest	0	-21	swapper/2	07:44:28	2
18653	99	42	41	cyclictest	0	-21	swapper/2	03:29:43	2
18651	99	42	41	cyclictest	0	-21	swapper/0	04:24:41	0
8	99	10	0	watchdog/0	17703	-21	ntpq	03:14:57	0
21	99	10	0	migration/3	17543	-21	munin-node	03:14:55	3
16	99	9	0	migration/2	16624	-21	runrttasks	03:14:50	2
12	1	7	0	ksoftirqd/1	18193	-40	yum-updatesd-he	03:16:12	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17