OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Jun 22, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
31219	99	105	102	cyclictest	19070	-21	tune2fs	05:10:04	1
31219	99	104	102	cyclictest	3913	-21	tune2fs	05:50:02	1
31222	99	103	102	cyclictest	0	-21	swapper/3	05:50:02	3
31222	99	103	102	cyclictest	0	-21	swapper/3	05:10:04	3
31219	99	94	92	cyclictest	20919	-21	tune2fs	05:15:03	1
31222	99	93	92	cyclictest	0	-21	swapper/3	08:46:14	3
31222	99	93	92	cyclictest	0	-21	swapper/3	06:56:58	3
31219	99	93	92	cyclictest	0	-21	swapper/1	07:15:44	1
31222	99	92	91	cyclictest	20191	-21	timerandwakeup	08:55:01	3
31219	99	88	86	cyclictest	17590	-21	ps	06:20:06	1
31222	99	86	73	cyclictest	0	-21	swapper/3	05:45:07	3
31219	99	86	81	cyclictest	4066	-21	tune2fs	08:19:55	1
31222	99	85	73	cyclictest	0	-21	swapper/3	09:44:55	3
31222	99	85	73	cyclictest	0	-21	swapper/3	09:19:53	3
31222	99	85	73	cyclictest	0	-21	swapper/3	07:25:00	3
31222	99	85	73	cyclictest	0	-21	swapper/3	07:14:58	3
31222	99	85	73	cyclictest	0	-21	swapper/3	07:09:56	3
31222	99	85	73	cyclictest	0	-21	swapper/3	06:10:01	3
31222	99	85	73	cyclictest	0	-21	swapper/3	05:59:47	3
31222	99	85	73	cyclictest	0	-21	swapper/3	04:50:08	3
31222	99	85	73	cyclictest	0	-21	swapper/3	04:35:04	3
31222	99	84	82	cyclictest	0	-21	swapper/3	05:15:03	3
31222	99	84	82	cyclictest	0	-21	swapper/3	04:30:02	3
31222	99	84	72	cyclictest	0	-21	swapper/3	07:50:06	3
31219	99	84	82	cyclictest	29605	-21	tune2fs	05:35:01	1
31222	99	83	82	cyclictest	0	-21	swapper/3	09:49:49	3
31222	99	83	82	cyclictest	0	-21	swapper/3	09:39:40	3
31222	99	83	82	cyclictest	0	-21	swapper/3	09:34:49	3
31222	99	83	82	cyclictest	0	-21	swapper/3	09:29:52	3
31222	99	83	82	cyclictest	0	-21	swapper/3	09:24:52	3
31222	99	83	82	cyclictest	0	-21	swapper/3	09:14:52	3
31222	99	83	82	cyclictest	0	-21	swapper/3	09:09:52	3
31222	99	83	82	cyclictest	0	-21	swapper/3	09:04:50	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:59:52	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:49:53	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:39:53	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:34:51	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:29:52	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:24:52	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:19:54	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:14:55	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:09:55	3
31222	99	83	82	cyclictest	0	-21	swapper/3	08:04:56	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:59:53	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:54:54	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:44:55	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:39:43	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:34:54	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:29:57	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:29:57	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:19:58	3
31222	99	83	82	cyclictest	0	-21	swapper/3	07:04:57	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:59:56	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:49:58	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:44:54	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:40:05	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:34:59	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:30:05	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:24:58	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:19:58	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:15:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	06:05:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:59:58	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:40:00	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:35:00	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:29:56	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:25:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:20:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:05:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	05:00:05	3
31222	99	83	82	cyclictest	0	-21	swapper/3	04:55:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	04:55:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	04:45:01	3
31222	99	83	82	cyclictest	0	-21	swapper/3	04:40:05	3
31222	99	83	82	cyclictest	0	-21	swapper/3	04:25:02	3
31219	99	83	82	cyclictest	0	-21	swapper/1	07:00:06	1
31219	99	83	82	cyclictest	0	-21	swapper/1	06:55:03	1
31219	99	83	82	cyclictest	0	-21	swapper/1	06:15:05	1
31219	99	83	82	cyclictest	0	-21	swapper/1	05:24:48	1
31219	99	83	82	cyclictest	0	-21	swapper/1	04:30:09	1
31219	99	83	82	cyclictest	0	-21	swapper/1	04:25:11	1
31219	99	83	81	cyclictest	6028	-21	grep	04:40:05	1
31219	99	83	81	cyclictest	32399	-21	tune2fs	09:24:53	1
31219	99	83	81	cyclictest	27540	-21	tune2fs	06:44:57	1
31219	99	83	81	cyclictest	25632	-21	tune2fs	07:54:55	1
31219	99	83	81	cyclictest	23634	-21	tune2fs	09:04:53	1
31219	99	83	81	cyclictest	23544	-21	tune2fs	07:49:57	1
31219	99	83	81	cyclictest	23261	-21	tune2fs	05:20:03	1
31219	99	83	81	cyclictest	2198	-21	tune2fs	09:29:53	1
31219	99	83	81	cyclictest	21308	-21	tune2fs	07:44:57	1
31219	99	83	81	cyclictest	17115	-21	tune2fs	08:49:56	1
31219	99	83	81	cyclictest	16730	-21	tune2fs	05:05:03	1
31219	99	83	81	cyclictest	1458	-21	tune2fs	05:45:01	1
31219	99	83	81	cyclictest	10620	-21	tune2fs	07:19:58	1
31219	99	83	81	cyclictest	10390	-21	tune2fs	06:05:01	1
31219	99	83	71	cyclictest	6148	-21	tune2fs	07:09:55	1
31219	99	83	71	cyclictest	0	-21	swapper/1	06:30:00	1
31219	99	82	81	cyclictest	10319	-21	tune2fs	04:50:03	1
31219	99	75	61	cyclictest	0	-21	swapper/1	08:09:53	1
31219	99	73	72	cyclictest	0	-21	swapper/1	09:44:52	1
31219	99	73	72	cyclictest	0	-21	swapper/1	09:41:18	1
31219	99	73	72	cyclictest	0	-21	swapper/1	09:19:53	1
31219	99	73	72	cyclictest	0	-21	swapper/1	09:14:55	1
31219	99	73	72	cyclictest	0	-21	swapper/1	09:09:52	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:59:52	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:54:51	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:46:39	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:40:26	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:34:54	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:30:01	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:14:58	1
31219	99	73	72	cyclictest	0	-21	swapper/1	08:04:59	1
31219	99	73	72	cyclictest	0	-21	swapper/1	07:59:59	1
31219	99	73	72	cyclictest	0	-21	swapper/1	07:31:29	1
31219	99	73	72	cyclictest	0	-21	swapper/1	07:31:29	1
31219	99	73	72	cyclictest	0	-21	swapper/1	07:24:57	1
31219	99	73	72	cyclictest	0	-21	swapper/1	07:04:56	1
31219	99	73	72	cyclictest	0	-21	swapper/1	06:40:01	1
31219	99	73	72	cyclictest	0	-21	swapper/1	06:34:56	1
31219	99	73	72	cyclictest	0	-21	swapper/1	06:25:12	1
31219	99	73	72	cyclictest	0	-21	swapper/1	06:10:05	1
31219	99	73	72	cyclictest	0	-21	swapper/1	06:00:02	1
31219	99	73	72	cyclictest	0	-21	swapper/1	05:55:04	1
31219	99	73	72	cyclictest	0	-21	swapper/1	05:39:48	1
31219	99	73	72	cyclictest	0	-21	swapper/1	05:30:05	1
31219	99	73	72	cyclictest	0	-21	swapper/1	04:59:50	1
31219	99	73	72	cyclictest	0	-21	swapper/1	04:55:05	1
31219	99	73	72	cyclictest	0	-21	swapper/1	04:55:05	1
31219	99	73	72	cyclictest	0	-21	swapper/1	04:45:05	1
31219	99	73	72	cyclictest	0	-21	swapper/1	04:35:09	1
31219	99	73	71	cyclictest	4150	-21	tune2fs	09:34:52	1
31219	99	73	61	cyclictest	0	-21	swapper/1	08:24:53	1
31219	99	73	61	cyclictest	0	-21	swapper/1	07:34:55	1
31219	99	72	71	cyclictest	0	-21	swapper/1	09:49:56	1
31219	99	72	71	cyclictest	0	-21	swapper/1	07:40:04	1
31218	99	66	41	cyclictest	0	-21	swapper/0	05:39:49	0
31219	99	65	62	cyclictest	0	-21	swapper/1	06:54:24	1
31218	99	65	41	cyclictest	0	-21	swapper/0	09:27:54	0
31218	99	63	59	cyclictest	0	-21	swapper/0	08:04:48	0
31218	99	61	41	cyclictest	0	-21	swapper/0	09:14:25	0
31218	99	60	41	cyclictest	0	-21	swapper/0	09:37:48	0
31218	99	60	41	cyclictest	0	-21	swapper/0	04:35:15	0
31218	99	58	41	cyclictest	0	-21	swapper/0	04:50:00	0
31218	99	58	41	cyclictest	0	-21	swapper/0	04:30:30	0
31218	99	57	56	cyclictest	0	-21	swapper/0	06:59:55	0
31218	99	57	52	cyclictest	0	-21	swapper/0	08:58:14	0
31218	99	57	51	cyclictest	0	-21	swapper/0	09:04:50	0
31218	99	57	41	cyclictest	0	-21	swapper/0	09:47:04	0
31218	99	57	41	cyclictest	0	-21	swapper/0	07:39:55	0
31218	99	57	41	cyclictest	0	-21	swapper/0	06:34:03	0
31218	99	57	41	cyclictest	0	-21	swapper/0	04:57:59	0
31218	99	57	41	cyclictest	0	-21	swapper/0	04:57:59	0
31218	99	56	55	cyclictest	0	-21	swapper/0	08:09:52	0
31218	99	56	52	cyclictest	0	-21	swapper/0	05:49:45	0
31218	99	56	51	cyclictest	0	-21	swapper/0	09:19:51	0
31218	99	56	51	cyclictest	0	-21	swapper/0	08:44:54	0
31218	99	56	51	cyclictest	0	-21	swapper/0	07:09:53	0
31218	99	56	51	cyclictest	0	-21	swapper/0	06:24:58	0
31218	99	56	41	cyclictest	0	-21	swapper/0	08:51:06	0
31218	99	56	41	cyclictest	0	-21	swapper/0	08:24:47	0
31218	99	56	41	cyclictest	0	-21	swapper/0	06:11:08	0
31218	99	56	41	cyclictest	0	-21	swapper/0	05:10:46	0
31221	99	55	54	cyclictest	0	-21	swapper/2	04:39:00	2
31218	99	55	51	cyclictest	0	-21	swapper/0	05:00:11	0
31218	99	55	41	cyclictest	0	-21	swapper/0	06:53:22	0
31218	99	55	41	cyclictest	0	-21	swapper/0	06:06:56	0
31218	99	55	41	cyclictest	0	-21	swapper/0	05:27:39	0
31218	99	55	41	cyclictest	0	-21	swapper/0	05:16:38	0
31218	99	55	41	cyclictest	0	-21	swapper/0	04:28:36	0
31221	99	54	42	cyclictest	50	50	irq/44-ahci	04:29:00	2
31218	99	54	50	cyclictest	0	-21	swapper/0	06:20:03	0
31218	99	54	41	cyclictest	0	-21	swapper/0	09:43:56	0
31218	99	54	41	cyclictest	0	-21	swapper/0	06:49:40	0
31218	99	54	41	cyclictest	0	-21	swapper/0	06:04:44	0
31218	99	54	41	cyclictest	0	-21	swapper/0	05:58:08	0
31218	99	54	41	cyclictest	0	-21	swapper/0	05:30:45	0
31221	99	53	41	cyclictest	0	-21	swapper/2	08:24:53	2
31218	99	53	52	cyclictest	760	50	irq/18-parport0	07:39:07	0
31218	99	53	52	cyclictest	0	-21	swapper/0	07:24:56	0
31218	99	53	52	cyclictest	0	-21	swapper/0	07:19:55	0
31218	99	53	52	cyclictest	0	-21	swapper/0	04:45:01	0
31218	99	53	51	cyclictest	7868	-21	telnet	07:14:55	0
31218	99	53	51	cyclictest	5478	-21	telnet	04:40:02	0
31218	99	53	51	cyclictest	29286	-21	telnet	05:34:58	0
31218	99	53	51	cyclictest	22942	-21	telnet	06:34:56	0
31218	99	53	41	cyclictest	0	-21	swapper/0	09:29:44	0
31218	99	53	41	cyclictest	0	-21	swapper/0	08:32:08	0
31218	99	53	41	cyclictest	0	-21	swapper/0	07:59:52	0
31218	99	53	41	cyclictest	0	-21	swapper/0	07:49:48	0
31221	99	52	51	cyclictest	0	-21	swapper/2	09:12:37	2
31221	99	52	51	cyclictest	0	-21	swapper/2	07:56:24	2
31221	99	52	51	cyclictest	0	-21	swapper/2	06:55:02	2
31221	99	52	51	cyclictest	0	-21	swapper/2	06:49:56	2
31221	99	52	51	cyclictest	0	-21	swapper/2	05:27:29	2
31221	99	52	41	cyclictest	0	-21	swapper/2	04:41:11	2
31218	99	52	51	cyclictest	760	50	irq/18-parport0	09:52:53	0
31218	99	52	51	cyclictest	0	-21	swapper/0	09:19:23	0
31218	99	52	51	cyclictest	0	-21	swapper/0	08:59:50	0
31218	99	52	51	cyclictest	0	-21	swapper/0	08:42:54	0
31218	99	52	51	cyclictest	0	-21	swapper/0	08:34:44	0
31218	99	52	51	cyclictest	0	-21	swapper/0	08:19:52	0
31218	99	52	51	cyclictest	0	-21	swapper/0	08:14:52	0
31218	99	52	51	cyclictest	0	-21	swapper/0	07:56:24	0
31218	99	52	51	cyclictest	0	-21	swapper/0	07:44:55	0
31218	99	52	51	cyclictest	0	-21	swapper/0	07:04:55	0
31218	99	52	51	cyclictest	0	-21	swapper/0	06:39:49	0
31218	99	52	51	cyclictest	0	-21	swapper/0	05:49:59	0
31218	99	52	51	cyclictest	0	-21	swapper/0	05:20:00	0
31221	99	51	50	cyclictest	0	-21	swapper/2	07:39:07	2
31221	99	51	50	cyclictest	0	-21	swapper/2	06:02:10	2
31221	99	51	50	cyclictest	0	-21	swapper/2	05:37:06	2
31218	99	51	41	cyclictest	0	-21	swapper/0	07:29:57	0
31218	99	51	41	cyclictest	0	-21	swapper/0	07:29:57	0
31221	99	50	49	cyclictest	0	-21	swapper/2	09:53:39	2
31221	99	50	49	cyclictest	0	-21	swapper/2	08:21:02	2
31221	99	50	49	cyclictest	0	-21	swapper/2	08:04:46	2
31221	99	50	49	cyclictest	0	-21	swapper/2	07:51:04	2
31221	99	50	49	cyclictest	0	-21	swapper/2	06:45:04	2
31221	99	50	49	cyclictest	0	-21	swapper/2	06:29:43	2
31221	99	50	49	cyclictest	0	-21	swapper/2	06:20:35	2
31221	99	50	49	cyclictest	0	-21	swapper/2	06:15:46	2
31221	99	50	49	cyclictest	0	-21	swapper/2	06:09:58	2
31221	99	50	49	cyclictest	0	-21	swapper/2	05:45:09	2
31221	99	50	49	cyclictest	0	-21	swapper/2	04:52:01	2
31221	99	49	48	cyclictest	0	-21	swapper/2	09:19:23	2
31221	99	49	48	cyclictest	0	-21	swapper/2	09:03:37	2
31221	99	49	48	cyclictest	0	-21	swapper/2	08:56:02	2
31221	99	49	48	cyclictest	0	-21	swapper/2	08:13:45	2
31221	99	49	48	cyclictest	0	-21	swapper/2	08:00:35	2
31221	99	49	48	cyclictest	0	-21	swapper/2	07:40:02	2
31221	99	49	48	cyclictest	0	-21	swapper/2	07:16:27	2
31221	99	49	48	cyclictest	0	-21	swapper/2	05:43:49	2
31221	99	49	48	cyclictest	0	-21	swapper/2	05:01:44	2
31221	99	49	48	cyclictest	0	-21	swapper/2	04:55:11	2
31221	99	49	48	cyclictest	0	-21	swapper/2	04:55:11	2
31221	99	48	47	cyclictest	0	-21	swapper/2	08:49:53	2
31221	99	48	47	cyclictest	0	-21	swapper/2	08:37:34	2
31221	99	48	47	cyclictest	0	-21	swapper/2	07:10:08	2
31221	99	48	47	cyclictest	0	-21	swapper/2	07:03:02	2
31221	99	48	47	cyclictest	0	-21	swapper/2	06:05:20	2
31221	99	48	47	cyclictest	0	-21	swapper/2	05:50:00	2
31221	99	48	47	cyclictest	0	-21	swapper/2	05:17:30	2
31218	99	48	42	cyclictest	0	-21	swapper/0	05:05:03	0
31218	99	48	41	cyclictest	0	-21	swapper/0	06:56:56	0
31218	99	48	41	cyclictest	0	-21	swapper/0	06:14:50	0
31221	99	47	46	cyclictest	0	-21	swapper/2	09:40:16	2
31221	99	47	46	cyclictest	0	-21	swapper/2	08:15:09	2
31221	99	47	46	cyclictest	0	-21	swapper/2	05:59:10	2
31221	99	46	45	cyclictest	0	-21	swapper/2	09:39:00	2
31221	99	46	45	cyclictest	0	-21	swapper/2	09:05:53	2
31221	99	46	45	cyclictest	0	-21	swapper/2	05:32:59	2
31221	99	46	45	cyclictest	0	-21	swapper/2	05:22:34	2
31221	99	46	44	cyclictest	3694	-21	cpuspeed	07:04:56	2
31221	99	46	44	cyclictest	24925	-21	latency_hist	06:39:46	2
31221	99	45	44	cyclictest	2688	-21	needreboot	09:29:56	2
31221	99	45	44	cyclictest	0	-21	swapper/2	09:24:49	2
31221	99	45	44	cyclictest	0	-21	swapper/2	09:24:25	2
31221	99	45	44	cyclictest	0	-21	swapper/2	07:46:40	2
31221	99	45	44	cyclictest	0	-21	swapper/2	05:05:37	2
31221	99	45	43	cyclictest	24998	-21	sh	06:39:56	2
31221	99	45	43	cyclictest	15353	-21	load	07:29:59	2
31221	99	45	43	cyclictest	15353	-21	load	07:29:59	2
31221	99	44	43	cyclictest	8869	-21	munin-node	08:29:57	2
31221	99	44	43	cyclictest	0	-21	swapper/2	09:44:49	2
31221	99	44	43	cyclictest	0	-21	swapper/2	08:39:56	2
31221	99	44	43	cyclictest	0	-21	swapper/2	07:23:08	2
31221	99	44	43	cyclictest	0	-21	swapper/2	05:13:16	2
31221	99	44	42	cyclictest	12940	-21	sh	07:24:59	2
31221	99	43	42	cyclictest	0	-21	swapper/2	06:30:01	2
31221	99	43	42	cyclictest	0	-21	swapper/2	04:47:11	2
31221	99	43	31	cyclictest	50	50	irq/44-ahci	04:33:36	2
31221	99	43	31	cyclictest	0	-21	swapper/2	08:44:53	2
7	99	11	0	migration/0	30770	-21	taskset	04:21:39	0
21	99	10	0	migration/3	30792	-21	runrttasks	04:21:52	3
50	50	8	0	irq/44-ahci	0	-21	swapper/2	04:22:38	2
30692	2	5	0	sleep1	0	-21	swapper/1	04:21:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17