OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Mon Sep 14, 2026 12:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
5865	99	109	102	cyclictest	21898	-21	tune2fs	04:58:56	1
5865	99	104	102	cyclictest	24325	-21	tune2fs	07:33:52	1
5865	99	104	102	cyclictest	21681	-21	tune2fs	03:43:58	1
5865	99	104	102	cyclictest	17401	-21	tune2fs	04:48:55	1
5885	99	103	102	cyclictest	0	-21	swapper/3	08:18:48	3
5885	99	103	102	cyclictest	0	-21	swapper/3	04:53:54	3
5865	99	103	92	cyclictest	8943	-21	tune2fs	05:43:53	1
5885	99	94	92	cyclictest	11066	-21	gltestperf	03:19:00	3
5865	99	93	82	cyclictest	0	-21	swapper/1	08:30:23	1
5865	99	93	82	cyclictest	0	-21	swapper/1	08:12:49	1
5865	99	93	82	cyclictest	0	-21	swapper/1	03:37:24	1
5865	99	92	81	cyclictest	0	-21	swapper/1	04:20:50	1
5865	99	89	82	cyclictest	28451	-21	tune2fs	06:28:51	1
5865	99	89	82	cyclictest	13456	-21	tune2fs	08:23:47	1
5865	99	89	72	cyclictest	0	-21	swapper/1	08:03:47	1
5865	99	88	82	cyclictest	0	-21	swapper/1	07:38:59	1
5865	99	88	81	cyclictest	23949	-21	tune2fs	03:48:58	1
5865	99	87	82	cyclictest	0	-21	swapper/1	06:43:51	1
5865	99	87	82	cyclictest	0	-21	swapper/1	05:32:40	1
5885	99	86	85	cyclictest	0	-21	swapper/3	05:43:53	3
5885	99	86	82	cyclictest	0	-21	swapper/3	06:48:56	3
5865	99	86	82	cyclictest	0	-21	swapper/1	08:37:07	1
5865	99	86	82	cyclictest	0	-21	swapper/1	08:13:55	1
5865	99	86	82	cyclictest	0	-21	swapper/1	07:13:58	1
5865	99	86	82	cyclictest	0	-21	swapper/1	07:06:55	1
5865	99	86	82	cyclictest	0	-21	swapper/1	07:06:55	1
5865	99	86	82	cyclictest	0	-21	swapper/1	06:56:53	1
5865	99	86	82	cyclictest	0	-21	swapper/1	04:56:35	1
5865	99	86	82	cyclictest	0	-21	swapper/1	04:29:03	1
5865	99	86	82	cyclictest	0	-21	swapper/1	04:06:27	1
5865	99	86	82	cyclictest	0	-21	swapper/1	04:01:26	1
5865	99	86	82	cyclictest	0	-21	swapper/1	03:41:23	1
5865	99	86	82	cyclictest	0	-21	swapper/1	03:24:06	1
5865	99	86	82	cyclictest	0	-21	swapper/1	03:19:06	1
5885	99	85	71	cyclictest	0	-21	swapper/3	03:56:26	3
5865	99	84	82	cyclictest	19583	-21	tune2fs	06:08:51	1
5885	99	83	82	cyclictest	0	-21	swapper/3	08:38:33	3
5885	99	83	82	cyclictest	0	-21	swapper/3	08:23:55	3
5885	99	83	82	cyclictest	0	-21	swapper/3	07:53:52	3
5885	99	83	82	cyclictest	0	-21	swapper/3	07:48:55	3
5885	99	83	82	cyclictest	0	-21	swapper/3	07:23:56	3
5885	99	83	82	cyclictest	0	-21	swapper/3	06:53:57	3
5885	99	83	82	cyclictest	0	-21	swapper/3	06:38:57	3
5885	99	83	82	cyclictest	0	-21	swapper/3	06:34:01	3
5885	99	83	82	cyclictest	0	-21	swapper/3	06:28:57	3
5885	99	83	82	cyclictest	0	-21	swapper/3	06:26:49	3
5885	99	83	82	cyclictest	0	-21	swapper/3	06:08:59	3
5885	99	83	82	cyclictest	0	-21	swapper/3	05:53:58	3
5885	99	83	82	cyclictest	0	-21	swapper/3	05:48:59	3
5885	99	83	82	cyclictest	0	-21	swapper/3	05:36:41	3
5885	99	83	82	cyclictest	0	-21	swapper/3	05:32:40	3
5885	99	83	82	cyclictest	0	-21	swapper/3	05:23:53	3
5885	99	83	82	cyclictest	0	-21	swapper/3	05:19:02	3
5885	99	83	82	cyclictest	0	-21	swapper/3	04:59:00	3
5885	99	83	82	cyclictest	0	-21	swapper/3	04:49:03	3
5885	99	83	82	cyclictest	0	-21	swapper/3	04:39:01	3
5885	99	83	82	cyclictest	0	-21	swapper/3	04:24:04	3
5885	99	83	82	cyclictest	0	-21	swapper/3	04:04:06	3
5885	99	83	82	cyclictest	0	-21	swapper/3	03:44:04	3
5885	99	83	82	cyclictest	0	-21	swapper/3	03:34:03	3
5885	99	83	82	cyclictest	0	-21	swapper/3	03:29:04	3
5885	99	83	82	cyclictest	0	-21	swapper/3	03:14:06	3
5885	99	83	81	cyclictest	32343	-21	tune2fs	04:08:57	3
5885	99	83	81	cyclictest	1385	-17	sedispatch	05:08:41	3
5885	99	83	81	cyclictest	1385	-17	sedispatch	05:08:41	3
5865	99	83	82	cyclictest	0	-21	swapper/1	08:01:22	1
5865	99	83	82	cyclictest	0	-21	swapper/1	07:53:49	1
5865	99	83	82	cyclictest	0	-21	swapper/1	07:28:56	1
5865	99	83	82	cyclictest	0	-21	swapper/1	07:18:56	1
5865	99	83	82	cyclictest	0	-21	swapper/1	06:51:53	1
5865	99	83	82	cyclictest	0	-21	swapper/1	06:23:53	1
5865	99	83	82	cyclictest	0	-21	swapper/1	06:13:58	1
5865	99	83	82	cyclictest	0	-21	swapper/1	06:04:00	1
5865	99	83	82	cyclictest	0	-21	swapper/1	06:01:45	1
5865	99	83	82	cyclictest	0	-21	swapper/1	05:54:01	1
5865	99	83	82	cyclictest	0	-21	swapper/1	05:28:40	1
5865	99	83	82	cyclictest	0	-21	swapper/1	05:23:26	1
5865	99	83	82	cyclictest	0	-21	swapper/1	05:09:02	1
5865	99	83	82	cyclictest	0	-21	swapper/1	05:09:02	1
5865	99	83	82	cyclictest	0	-21	swapper/1	04:38:59	1
5865	99	83	82	cyclictest	0	-21	swapper/1	04:34:03	1
5865	99	83	81	cyclictest	6455	-21	tune2fs	03:08:59	1
5865	99	83	81	cyclictest	32324	-21	tune2fs	04:08:57	1
5865	99	83	81	cyclictest	30814	-21	tune2fs	07:48:49	1
5865	99	83	81	cyclictest	20036	-21	tune2fs	07:23:50	1
5865	99	83	81	cyclictest	13361	-21	tune2fs	07:08:49	1
5865	99	83	81	cyclictest	11292	-21	tune2fs	08:18:47	1
5885	99	82	81	cyclictest	24398	-21	gltestperf	07:33:52	3
5885	99	82	81	cyclictest	0	-21	swapper/3	08:13:49	3
5885	99	82	81	cyclictest	0	-21	swapper/3	06:43:48	3
5885	99	82	81	cyclictest	0	-21	swapper/3	04:33:57	3
5865	99	77	72	cyclictest	0	-21	swapper/1	06:23:38	1
5865	99	77	72	cyclictest	0	-21	swapper/1	03:33:45	1
5865	99	76	72	cyclictest	0	-21	swapper/1	06:58:49	1
5865	99	76	72	cyclictest	0	-21	swapper/1	05:08:41	1
5885	99	74	73	cyclictest	4984	-21	fschecks_time	08:03:48	3
5885	99	73	72	cyclictest	0	-21	swapper/3	08:30:46	3
5885	99	73	72	cyclictest	0	-21	swapper/3	08:09:47	3
5885	99	73	72	cyclictest	0	-21	swapper/3	07:32:55	3
5885	99	73	72	cyclictest	0	-21	swapper/3	07:14:41	3
5885	99	73	72	cyclictest	0	-21	swapper/3	07:01:04	3
5885	99	73	72	cyclictest	0	-21	swapper/3	06:08:39	3
5885	99	73	72	cyclictest	0	-21	swapper/3	05:59:42	3
5885	99	73	72	cyclictest	0	-21	swapper/3	04:33:02	3
5885	99	73	72	cyclictest	0	-21	swapper/3	04:20:50	3
5885	99	73	72	cyclictest	0	-21	swapper/3	04:03:41	3
5885	99	73	72	cyclictest	0	-21	swapper/3	03:24:03	3
5885	99	73	72	cyclictest	0	-21	swapper/3	03:09:56	3
5885	99	73	71	cyclictest	12488	-21	runrttasks	07:06:19	3
5885	99	73	71	cyclictest	12488	-21	runrttasks	07:06:19	3
5865	99	73	72	cyclictest	0	-21	swapper/1	07:45:50	1
5865	99	73	72	cyclictest	0	-21	swapper/1	06:38:48	1
5865	99	73	72	cyclictest	0	-21	swapper/1	05:38:54	1
5865	99	73	72	cyclictest	0	-21	swapper/1	05:33:55	1
5865	99	73	72	cyclictest	0	-21	swapper/1	05:13:51	1
5865	99	73	72	cyclictest	0	-21	swapper/1	03:53:56	1
5885	99	72	71	cyclictest	0	-21	swapper/3	07:08:56	3
5885	99	72	71	cyclictest	0	-21	swapper/3	04:46:33	3
5865	99	72	71	cyclictest	278	-21	usb-storage	04:27:18	1
5865	99	72	71	cyclictest	0	-21	swapper/1	06:36:50	1
5885	99	68	67	cyclictest	3428	-21	processes	07:58:54	3
5885	99	65	61	cyclictest	29428	-21	runrttasks	05:14:57	3
5885	99	64	52	cyclictest	0	-21	swapper/3	07:38:50	3
5885	99	63	62	cyclictest	0	-21	swapper/3	07:43:48	3
5885	99	63	62	cyclictest	0	-21	swapper/3	07:18:47	3
5885	99	63	62	cyclictest	0	-21	swapper/3	06:18:38	3
5885	99	63	62	cyclictest	0	-21	swapper/3	06:13:51	3
5885	99	63	62	cyclictest	0	-21	swapper/3	05:38:51	3
5885	99	63	62	cyclictest	0	-21	swapper/3	05:03:44	3
5885	99	63	62	cyclictest	0	-21	swapper/3	04:13:56	3
5885	99	63	62	cyclictest	0	-21	swapper/3	03:48:55	3
5885	99	63	62	cyclictest	0	-21	swapper/3	03:38:59	3
5885	99	63	62	cyclictest	0	-21	swapper/3	03:08:46	3
5865	99	63	62	cyclictest	0	-21	swapper/1	05:48:51	1
5865	99	63	62	cyclictest	0	-21	swapper/1	04:43:52	1
5865	99	63	62	cyclictest	0	-21	swapper/1	04:13:56	1
5865	99	63	62	cyclictest	0	-21	swapper/1	03:13:58	1
5865	99	63	62	cyclictest	0	-21	swapper/1	03:08:46	1
5877	99	62	61	cyclictest	0	-21	swapper/2	08:37:39	2
5877	99	62	61	cyclictest	0	-21	swapper/2	06:42:47	2
5877	99	62	61	cyclictest	0	-21	swapper/2	06:14:04	2
5877	99	62	61	cyclictest	0	-21	swapper/2	04:03:47	2
5877	99	62	61	cyclictest	0	-21	swapper/2	03:34:06	2
5864	99	61	60	cyclictest	0	-21	swapper/0	06:53:48	0
5877	99	60	59	cyclictest	0	-21	swapper/2	08:28:44	2
5877	99	60	59	cyclictest	0	-21	swapper/2	03:58:55	2
5877	99	58	53	cyclictest	278	-21	usb-storage	04:29:28	2
5877	99	58	52	cyclictest	31995	-21	sshd	07:52:12	2
5877	99	58	52	cyclictest	24449	-21	iostat	06:18:54	2
5877	99	57	56	cyclictest	0	-21	swapper/2	07:33:49	2
5877	99	57	56	cyclictest	0	-21	swapper/2	03:48:56	2
5877	99	57	52	cyclictest	0	-21	swapper/2	05:43:13	2
5877	99	57	52	cyclictest	0	-21	swapper/2	05:24:56	2
5877	99	57	52	cyclictest	0	-21	swapper/2	05:14:24	2
5877	99	57	51	cyclictest	13532	-21	iostat	04:38:57	2
5877	99	57	51	cyclictest	0	-21	swapper/2	04:53:52	2
5877	99	56	52	cyclictest	0	-21	swapper/2	07:19:02	2
5877	99	56	52	cyclictest	0	-21	swapper/2	03:10:50	2
5877	99	56	51	cyclictest	2107	-21	telnet	06:43:49	2
5877	99	56	51	cyclictest	18	1	ksoftirqd/2	03:57:53	2
5877	99	56	51	cyclictest	0	-21	swapper/2	03:22:02	2
5877	99	56	51	cyclictest	0	-21	swapper/2	03:14:14	2
5877	99	56	50	cyclictest	24546	-21	needreboot	05:04:00	2
5877	99	55	51	cyclictest	0	-21	swapper/2	05:19:35	2
5877	99	55	51	cyclictest	0	-21	swapper/2	03:30:10	2
5877	99	55	50	cyclictest	0	-21	swapper/2	06:08:02	2
5877	99	55	50	cyclictest	0	-21	swapper/2	04:18:54	2
5877	99	54	53	cyclictest	851	-21	mdstat	07:53:52	2
5877	99	54	53	cyclictest	29677	-21	sshd	07:45:12	2
5877	99	54	53	cyclictest	17832	-21	iostat	04:48:57	2
5864	99	54	42	cyclictest	760	50	irq/18-parport0	07:01:34	0
5864	99	54	41	cyclictest	0	-21	swapper/0	08:34:34	0
5877	99	53	52	cyclictest	6108	-21	sshd	04:23:52	2
5877	99	53	52	cyclictest	0	-21	swapper/2	07:40:39	2
5877	99	53	52	cyclictest	0	-21	swapper/2	07:16:40	2
5877	99	53	52	cyclictest	0	-21	swapper/2	07:06:50	2
5877	99	53	52	cyclictest	0	-21	swapper/2	07:06:50	2
5877	99	53	52	cyclictest	0	-21	swapper/2	06:53:48	2
5877	99	53	52	cyclictest	0	-21	swapper/2	06:52:42	2
5877	99	53	52	cyclictest	0	-21	swapper/2	06:23:50	2
5877	99	53	52	cyclictest	0	-21	swapper/2	05:48:51	2
5877	99	53	52	cyclictest	0	-21	swapper/2	05:37:35	2
5877	99	53	52	cyclictest	0	-21	swapper/2	05:32:25	2
5877	99	53	52	cyclictest	0	-21	swapper/2	03:43:57	2
5877	99	53	51	cyclictest	10313	-21	runrttasks	05:47:25	2
5877	99	53	48	cyclictest	0	-21	swapper/2	06:02:10	2
5877	99	53	48	cyclictest	0	-21	swapper/2	04:17:36	2
5877	99	53	42	cyclictest	0	-21	swapper/2	08:18:49	2
5877	99	53	42	cyclictest	0	-21	swapper/2	06:28:53	2
5877	99	53	42	cyclictest	0	-21	swapper/2	04:36:19	2
5877	99	53	42	cyclictest	0	-21	swapper/2	03:24:01	2
5877	99	53	41	cyclictest	0	-21	swapper/2	06:58:49	2
5877	99	53	41	cyclictest	0	-21	swapper/2	03:38:57	2
5864	99	53	52	cyclictest	0	-21	swapper/0	07:19:15	0
5864	99	53	52	cyclictest	0	-21	swapper/0	07:05:04	0
5864	99	53	52	cyclictest	0	-21	swapper/0	07:05:04	0
5864	99	53	52	cyclictest	0	-21	swapper/0	06:31:15	0
5864	99	53	52	cyclictest	0	-21	swapper/0	05:36:33	0
5864	99	53	52	cyclictest	0	-21	swapper/0	05:14:20	0
5864	99	53	52	cyclictest	0	-21	swapper/0	05:04:57	0
5864	99	53	52	cyclictest	0	-21	swapper/0	04:45:31	0
5864	99	53	52	cyclictest	0	-21	swapper/0	03:48:49	0
5864	99	53	52	cyclictest	0	-21	swapper/0	03:16:43	0
5864	99	53	52	cyclictest	0	-21	swapper/0	03:12:25	0
5864	99	53	51	cyclictest	50	50	irq/44-ahci	07:54:12	0
5864	99	53	51	cyclictest	50	50	irq/44-ahci	05:49:11	0
5864	99	53	51	cyclictest	50	50	irq/44-ahci	05:29:36	0
5864	99	53	41	cyclictest	3	1	ksoftirqd/0	04:24:27	0
5877	99	52	51	cyclictest	0	-21	swapper/2	08:23:45	2
5877	99	52	51	cyclictest	0	-21	swapper/2	08:13:46	2
5877	99	52	51	cyclictest	0	-21	swapper/2	08:09:34	2
5877	99	52	51	cyclictest	0	-21	swapper/2	08:04:00	2
5877	99	52	51	cyclictest	0	-21	swapper/2	08:02:34	2
5877	99	52	51	cyclictest	0	-21	swapper/2	07:29:23	2
5877	99	52	51	cyclictest	0	-21	swapper/2	07:23:47	2
5877	99	52	51	cyclictest	0	-21	swapper/2	07:08:47	2
5877	99	52	51	cyclictest	0	-21	swapper/2	06:33:51	2
5877	99	52	51	cyclictest	0	-21	swapper/2	06:08:49	2
5877	99	52	51	cyclictest	0	-21	swapper/2	05:53:52	2
5877	99	52	51	cyclictest	0	-21	swapper/2	05:09:00	2
5877	99	52	51	cyclictest	0	-21	swapper/2	05:09:00	2
5877	99	52	51	cyclictest	0	-21	swapper/2	04:59:54	2
5877	99	52	51	cyclictest	0	-21	swapper/2	04:45:01	2
5864	99	52	51	cyclictest	760	50	irq/18-parport0	05:57:15	0
5864	99	52	51	cyclictest	50	50	irq/44-ahci	06:39:27	0
5864	99	52	51	cyclictest	478	-21	kjournald	05:02:20	0
5864	99	52	51	cyclictest	478	-21	kjournald	03:25:27	0
5864	99	52	51	cyclictest	0	-21	swapper/0	08:28:45	0
5864	99	52	51	cyclictest	0	-21	swapper/0	08:14:23	0
5864	99	52	51	cyclictest	0	-21	swapper/0	08:08:37	0
5864	99	52	51	cyclictest	0	-21	swapper/0	08:05:02	0
5864	99	52	51	cyclictest	0	-21	swapper/0	07:58:56	0
5864	99	52	51	cyclictest	0	-21	swapper/0	07:44:12	0
5864	99	52	51	cyclictest	0	-21	swapper/0	07:35:24	0
5864	99	52	51	cyclictest	0	-21	swapper/0	07:29:13	0
5864	99	52	51	cyclictest	0	-21	swapper/0	07:09:10	0
5864	99	52	51	cyclictest	0	-21	swapper/0	06:49:48	0
5864	99	52	51	cyclictest	0	-21	swapper/0	06:43:49	0
5864	99	52	51	cyclictest	0	-21	swapper/0	06:24:13	0
5864	99	52	51	cyclictest	0	-21	swapper/0	06:21:36	0
5864	99	52	51	cyclictest	0	-21	swapper/0	06:15:14	0
5864	99	52	51	cyclictest	0	-21	swapper/0	06:04:38	0
5864	99	52	51	cyclictest	0	-21	swapper/0	05:45:19	0
5864	99	52	51	cyclictest	0	-21	swapper/0	05:40:53	0
5864	99	52	51	cyclictest	0	-21	swapper/0	05:21:28	0
5864	99	52	51	cyclictest	0	-21	swapper/0	04:57:49	0
5864	99	52	51	cyclictest	0	-21	swapper/0	04:34:52	0
5864	99	52	51	cyclictest	0	-21	swapper/0	04:12:07	0
5864	99	52	51	cyclictest	0	-21	swapper/0	03:33:57	0
5864	99	52	51	cyclictest	0	-21	swapper/0	03:29:38	0
5864	99	52	51	cyclictest	0	-21	swapper/0	03:20:17	0
5864	99	52	41	cyclictest	0	-21	swapper/0	08:19:08	0
5864	99	52	41	cyclictest	0	-21	swapper/0	07:38:58	0
5864	99	52	41	cyclictest	0	-21	swapper/0	06:34:01	0
5864	99	52	41	cyclictest	0	-21	swapper/0	04:41:21	0
5864	99	52	40	cyclictest	2527	-21	crond	05:23:40	0
5877	99	51	50	cyclictest	0	-21	swapper/2	04:08:46	2
5864	99	51	50	cyclictest	0	-21	swapper/0	07:49:54	0
5864	99	51	50	cyclictest	0	-21	swapper/0	07:13:56	0
5864	99	51	50	cyclictest	0	-21	swapper/0	04:52:27	0
5864	99	51	50	cyclictest	0	-21	swapper/0	04:16:10	0
5864	99	51	50	cyclictest	0	-21	swapper/0	04:03:53	0
5864	99	51	49	cyclictest	0	-21	swapper/0	03:53:45	0
5864	99	50	49	cyclictest	0	-21	swapper/0	08:24:29	0
5864	99	50	49	cyclictest	0	-21	swapper/0	06:02:10	0
5864	99	50	49	cyclictest	0	-21	swapper/0	04:19:54	0
5864	99	50	49	cyclictest	0	-21	swapper/0	03:42:08	0
5864	99	49	48	cyclictest	0	-21	swapper/0	04:29:01	0
5864	99	48	47	cyclictest	0	-21	swapper/0	03:45:26	0
5864	99	48	41	cyclictest	0	-21	swapper/0	04:02:23	0
5864	99	46	45	cyclictest	0	-21	swapper/0	06:13:39	0
5877	99	43	42	cyclictest	0	-21	swapper/2	03:08:46	2
5864	99	43	42	cyclictest	0	-21	swapper/0	07:23:46	0
5864	99	42	41	cyclictest	0	-21	swapper/0	05:08:50	0
5864	99	42	41	cyclictest	0	-21	swapper/0	05:08:50	0
5864	99	42	41	cyclictest	0	-21	swapper/0	03:08:46	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17