OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Thu Apr 23, 2026 12:43:27)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
29571	99	103	102	cyclictest	0	-21	swapper/3	06:54:22	3
29551	99	103	102	cyclictest	6778	-21	tune2fs	06:54:22	1
29551	99	94	92	cyclictest	0	-21	swapper/1	06:34:19	1
29551	99	86	71	cyclictest	28277	-21	tune2fs	06:29:22	1
29551	99	84	82	cyclictest	6840	-21	tune2fs	08:09:18	1
29551	99	84	82	cyclictest	4441	-21	tune2fs	08:04:18	1
29551	99	84	82	cyclictest	26094	-21	tune2fs	06:24:24	1
29551	99	84	82	cyclictest	21834	-21	tune2fs	06:14:22	1
29571	99	83	82	cyclictest	0	-21	swapper/3	10:44:11	3
29571	99	83	82	cyclictest	0	-21	swapper/3	10:39:15	3
29571	99	83	82	cyclictest	0	-21	swapper/3	10:33:59	3
29571	99	83	82	cyclictest	0	-21	swapper/3	10:28:58	3
29571	99	83	82	cyclictest	0	-21	swapper/3	10:09:18	3
29571	99	83	82	cyclictest	0	-21	swapper/3	10:04:13	3
29571	99	83	82	cyclictest	0	-21	swapper/3	09:54:12	3
29571	99	83	82	cyclictest	0	-21	swapper/3	09:24:01	3
29571	99	83	82	cyclictest	0	-21	swapper/3	09:14:16	3
29571	99	83	82	cyclictest	0	-21	swapper/3	09:09:18	3
29571	99	83	82	cyclictest	0	-21	swapper/3	09:04:02	3
29571	99	83	82	cyclictest	0	-21	swapper/3	08:34:04	3
29571	99	83	82	cyclictest	0	-21	swapper/3	08:24:18	3
29571	99	83	82	cyclictest	0	-21	swapper/3	08:24:04	3
29571	99	83	82	cyclictest	0	-21	swapper/3	08:09:25	3
29571	99	83	82	cyclictest	0	-21	swapper/3	08:04:17	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:59:04	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:49:28	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:49:28	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:34:22	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:29:27	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:29:06	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:09:23	3
29571	99	83	82	cyclictest	0	-21	swapper/3	07:04:19	3
29571	99	83	82	cyclictest	0	-21	swapper/3	06:34:19	3
29571	99	83	82	cyclictest	0	-21	swapper/3	06:29:22	3
29571	99	83	82	cyclictest	0	-21	swapper/3	06:10:29	3
29571	99	83	82	cyclictest	0	-21	swapper/3	06:04:23	3
29571	99	83	82	cyclictest	0	-21	swapper/3	05:34:30	3
29551	99	83	81	cyclictest	4802	-21	tune2fs	09:19:15	1
29551	99	83	81	cyclictest	32484	-21	tune2fs	07:54:19	1
29551	99	83	81	cyclictest	32459	-21	tune2fs	06:39:21	1
29551	99	83	81	cyclictest	15292	-21	tune2fs	07:14:20	1
29551	99	83	81	cyclictest	13002	-21	tune2fs	05:54:21	1
29551	99	83	81	cyclictest	13002	-21	tune2fs	05:54:21	1
29551	99	83	81	cyclictest	10885	-21	tune2fs	05:49:24	1
29571	99	82	81	cyclictest	23712	-21	uniq	06:19:22	3
29571	99	82	81	cyclictest	0	-21	swapper/3	09:42:20	3
29571	99	82	81	cyclictest	0	-21	swapper/3	08:52:12	3
29571	99	82	81	cyclictest	0	-21	swapper/3	08:44:22	3
29571	99	82	81	cyclictest	0	-21	swapper/3	08:14:24	3
29571	99	82	81	cyclictest	0	-21	swapper/3	07:42:01	3
29571	99	82	81	cyclictest	0	-21	swapper/3	07:14:20	3
29571	99	82	81	cyclictest	0	-21	swapper/3	06:51:53	3
29571	99	82	81	cyclictest	0	-21	swapper/3	06:44:27	3
29571	99	82	81	cyclictest	0	-21	swapper/3	06:39:21	3
29571	99	82	81	cyclictest	0	-21	swapper/3	06:24:24	3
29571	99	82	81	cyclictest	0	-21	swapper/3	06:14:22	3
29571	99	82	81	cyclictest	0	-21	swapper/3	05:54:21	3
29571	99	82	81	cyclictest	0	-21	swapper/3	05:54:21	3
29571	99	82	81	cyclictest	0	-21	swapper/3	05:49:24	3
29571	99	82	81	cyclictest	0	-21	swapper/3	05:49:09	3
29571	99	82	81	cyclictest	0	-21	swapper/3	05:39:24	3
29571	99	82	81	cyclictest	0	-21	swapper/3	05:21:40	3
29571	99	82	81	cyclictest	0	-21	swapper/3	05:21:40	3
29551	99	82	81	cyclictest	13263	-21	tune2fs	08:24:18	1
29571	99	76	75	cyclictest	0	-21	swapper/3	09:44:21	3
29551	99	74	72	cyclictest	371	-21	tune2fs	09:09:15	1
29551	99	73	72	cyclictest	0	-21	swapper/1	09:37:19	1
29551	99	73	72	cyclictest	0	-21	swapper/1	09:07:14	1
29551	99	73	72	cyclictest	0	-21	swapper/1	09:04:02	1
29551	99	73	72	cyclictest	0	-21	swapper/1	08:54:03	1
29551	99	73	72	cyclictest	0	-21	swapper/1	08:34:04	1
29551	99	73	72	cyclictest	0	-21	swapper/1	08:24:04	1
29551	99	73	72	cyclictest	0	-21	swapper/1	07:59:20	1
29551	99	73	72	cyclictest	0	-21	swapper/1	07:06:56	1
29551	99	73	72	cyclictest	0	-21	swapper/1	05:34:10	1
29551	99	73	71	cyclictest	23805	-21	tune2fs	06:19:22	1
29551	99	73	71	cyclictest	0	-21	swapper/1	10:19:10	1
29551	99	73	71	cyclictest	0	-21	swapper/1	10:19:10	1
29571	99	72	71	cyclictest	0	-21	swapper/3	07:44:26	3
29551	99	72	71	cyclictest	0	-21	swapper/1	10:48:58	1
29551	99	72	71	cyclictest	0	-21	swapper/1	10:42:27	1
29551	99	72	71	cyclictest	0	-21	swapper/1	10:33:59	1
29551	99	72	71	cyclictest	0	-21	swapper/1	10:14:17	1
29551	99	72	71	cyclictest	0	-21	swapper/1	10:04:13	1
29551	99	72	71	cyclictest	0	-21	swapper/1	09:29:22	1
29551	99	72	71	cyclictest	0	-21	swapper/1	08:49:03	1
29551	99	72	71	cyclictest	0	-21	swapper/1	08:19:03	1
29551	99	72	71	cyclictest	0	-21	swapper/1	07:47:02	1
29551	99	72	71	cyclictest	0	-21	swapper/1	07:37:01	1
29551	99	72	71	cyclictest	0	-21	swapper/1	07:29:27	1
29551	99	72	71	cyclictest	0	-21	swapper/1	06:49:24	1
29551	99	72	71	cyclictest	0	-21	swapper/1	06:49:07	1
29551	99	72	71	cyclictest	0	-21	swapper/1	05:59:29	1
29551	99	72	71	cyclictest	0	-21	swapper/1	05:24:32	1
29571	99	64	62	cyclictest	0	-21	swapper/3	05:34:10	3
29571	99	63	62	cyclictest	0	-21	swapper/3	10:34:14	3
29571	99	63	62	cyclictest	0	-21	swapper/3	10:19:18	3
29571	99	63	62	cyclictest	0	-21	swapper/3	10:19:18	3
29571	99	63	62	cyclictest	0	-21	swapper/3	10:14:17	3
29571	99	63	62	cyclictest	0	-21	swapper/3	09:49:14	3
29571	99	63	62	cyclictest	0	-21	swapper/3	09:34:14	3
29571	99	63	62	cyclictest	0	-21	swapper/3	09:29:15	3
29571	99	63	62	cyclictest	0	-21	swapper/3	09:24:16	3
29571	99	63	62	cyclictest	0	-21	swapper/3	08:39:16	3
29571	99	63	62	cyclictest	0	-21	swapper/3	08:34:17	3
29571	99	63	62	cyclictest	0	-21	swapper/3	07:59:20	3
29571	99	63	62	cyclictest	0	-21	swapper/3	07:19:18	3
29571	99	63	62	cyclictest	0	-21	swapper/3	05:24:32	3
29571	99	63	61	cyclictest	26236	-21	fschecks_time	08:54:18	3
29571	99	63	51	cyclictest	0	-21	swapper/3	09:04:14	3
29571	99	63	51	cyclictest	0	-21	swapper/3	06:59:18	3
29571	99	63	51	cyclictest	0	-21	swapper/3	05:59:29	3
29551	99	63	62	cyclictest	0	-21	swapper/1	10:34:58	1
29551	99	63	62	cyclictest	0	-21	swapper/1	09:39:13	1
29551	99	63	62	cyclictest	0	-21	swapper/1	09:14:16	1
29551	99	63	62	cyclictest	0	-21	swapper/1	07:49:24	1
29551	99	63	62	cyclictest	0	-21	swapper/1	07:49:24	1
29551	99	63	62	cyclictest	0	-21	swapper/1	07:24:21	1
29551	99	63	62	cyclictest	0	-21	swapper/1	06:04:23	1
29551	99	63	62	cyclictest	0	-21	swapper/1	05:34:30	1
29551	99	63	61	cyclictest	6422	-21	tune2fs	05:39:24	1
29551	99	63	61	cyclictest	32763	-21	tune2fs	10:24:14	1
29551	99	63	61	cyclictest	26415	-21	tune2fs	10:09:13	1
29551	99	63	61	cyclictest	26229	-21	tune2fs	08:54:18	1
29551	99	63	61	cyclictest	20001	-21	tune2fs	09:54:15	1
29551	99	63	61	cyclictest	19740	-21	tune2fs	08:39:16	1
29551	99	63	61	cyclictest	19479	-21	tune2fs	06:09:23	1
29551	99	63	61	cyclictest	15654	-21	tune2fs	09:44:14	1
29551	99	63	61	cyclictest	13054	-21	tune2fs	07:09:20	1
29551	99	63	61	cyclictest	0	-21	swapper/1	07:39:17	1
29551	99	63	51	cyclictest	0	-21	swapper/1	05:49:09	1
29571	99	62	61	cyclictest	0	-21	swapper/3	09:59:00	3
29551	99	62	61	cyclictest	0	-21	swapper/1	10:02:23	1
29551	99	62	61	cyclictest	0	-21	swapper/1	05:19:30	1
29551	99	62	61	cyclictest	0	-21	swapper/1	05:19:30	1
29540	99	62	61	cyclictest	0	-21	swapper/0	07:15:58	0
29551	99	61	60	cyclictest	0	-21	swapper/1	07:00:12	1
29540	99	61	60	cyclictest	0	-21	swapper/0	07:02:50	0
29540	99	60	59	cyclictest	0	-21	swapper/0	10:03:35	0
29540	99	60	59	cyclictest	0	-21	swapper/0	08:35:41	0
29540	99	60	59	cyclictest	0	-21	swapper/0	07:59:58	0
29540	99	60	59	cyclictest	0	-21	swapper/0	06:23:42	0
29560	99	59	58	cyclictest	0	-21	swapper/2	10:19:09	2
29560	99	59	58	cyclictest	0	-21	swapper/2	10:19:09	2
29560	99	59	58	cyclictest	0	-21	swapper/2	06:19:19	2
29540	99	59	58	cyclictest	0	-21	swapper/0	10:23:17	0
29540	99	59	58	cyclictest	0	-21	swapper/0	10:23:17	0
29560	99	58	57	cyclictest	0	-21	swapper/2	10:04:10	2
29560	99	55	43	cyclictest	50	50	irq/44-ahci	10:38:54	2
29560	99	55	41	cyclictest	0	-21	swapper/2	08:11:39	2
29560	99	55	41	cyclictest	0	-21	swapper/2	05:30:18	2
29540	99	55	54	cyclictest	0	-21	swapper/0	10:27:44	0
29540	99	55	52	cyclictest	760	50	irq/18-parport0	07:23:05	0
29540	99	55	51	cyclictest	0	-21	swapper/0	06:07:42	0
29540	99	55	41	cyclictest	0	-21	swapper/0	09:41:12	0
29560	99	54	52	cyclictest	0	-21	swapper/2	05:39:22	2
29560	99	54	51	cyclictest	50	50	irq/44-ahci	07:51:50	2
29560	99	54	51	cyclictest	50	50	irq/44-ahci	07:51:50	2
29560	99	54	42	cyclictest	278	-21	usb-storage	09:15:51	2
29540	99	54	53	cyclictest	19159	-21	telnet	07:24:18	0
29540	99	54	53	cyclictest	1876	-21	hald-addon-stor	08:43:08	0
29560	99	53	52	cyclictest	12754	-21	telnet	08:24:15	2
29560	99	53	52	cyclictest	0	-21	swapper/2	10:24:11	2
29560	99	53	52	cyclictest	0	-21	swapper/2	09:44:12	2
29560	99	53	52	cyclictest	0	-21	swapper/2	09:29:13	2
29560	99	53	52	cyclictest	0	-21	swapper/2	07:29:18	2
29560	99	53	52	cyclictest	0	-21	swapper/2	07:24:18	2
29560	99	53	52	cyclictest	0	-21	swapper/2	07:19:15	2
29560	99	53	52	cyclictest	0	-21	swapper/2	06:09:21	2
29560	99	53	52	cyclictest	0	-21	swapper/2	05:59:20	2
29560	99	53	52	cyclictest	0	-21	swapper/2	05:49:21	2
29560	99	53	52	cyclictest	0	-21	swapper/2	05:34:21	2
29560	99	53	51	cyclictest	50	50	irq/44-ahci	10:41:16	2
29560	99	53	41	cyclictest	278	-21	usb-storage	09:24:17	2
29560	99	53	41	cyclictest	0	-21	swapper/2	09:54:13	2
29560	99	53	41	cyclictest	0	-21	swapper/2	09:41:06	2
29560	99	53	41	cyclictest	0	-21	swapper/2	09:10:13	2
29560	99	53	41	cyclictest	0	-21	swapper/2	08:54:04	2
29560	99	53	41	cyclictest	0	-21	swapper/2	07:04:23	2
29560	99	53	41	cyclictest	0	-21	swapper/2	06:34:20	2
29560	99	53	41	cyclictest	0	-21	swapper/2	06:04:20	2
29551	99	53	52	cyclictest	0	-21	swapper/1	09:49:21	1
29551	99	53	52	cyclictest	0	-21	swapper/1	09:24:16	1
29551	99	53	31	cyclictest	0	-21	swapper/1	08:36:47	1
29540	99	53	52	cyclictest	760	50	irq/18-parport0	09:08:33	0
29540	99	53	52	cyclictest	760	50	irq/18-parport0	08:54:10	0
29540	99	53	52	cyclictest	760	50	irq/18-parport0	08:24:59	0
29540	99	53	52	cyclictest	760	50	irq/18-parport0	06:31:59	0
29540	99	53	52	cyclictest	760	50	irq/18-parport0	05:56:35	0
29540	99	53	52	cyclictest	760	50	irq/18-parport0	05:56:35	0
29540	99	53	52	cyclictest	760	50	irq/18-parport0	05:45:39	0
29540	99	53	52	cyclictest	760	50	irq/18-parport0	05:33:12	0
29540	99	53	52	cyclictest	0	-21	swapper/0	10:06:37	0
29540	99	53	52	cyclictest	0	-21	swapper/0	09:24:17	0
29540	99	53	52	cyclictest	0	-21	swapper/0	09:21:21	0
29540	99	53	52	cyclictest	0	-21	swapper/0	09:10:33	0
29540	99	53	52	cyclictest	0	-21	swapper/0	07:45:41	0
29540	99	53	52	cyclictest	0	-21	swapper/0	07:11:02	0
29540	99	53	41	cyclictest	50	50	irq/44-ahci	10:46:16	0
29540	99	53	41	cyclictest	50	50	irq/44-ahci	10:33:59	0
29540	99	53	41	cyclictest	50	50	irq/44-ahci	08:49:52	0
29540	99	53	41	cyclictest	50	50	irq/44-ahci	06:47:30	0
29540	99	53	41	cyclictest	50	50	irq/44-ahci	05:50:22	0
29540	99	53	41	cyclictest	0	-21	swapper/0	10:18:09	0
29540	99	53	41	cyclictest	0	-21	swapper/0	09:35:32	0
29540	99	53	41	cyclictest	0	-21	swapper/0	09:01:08	0
29540	99	53	41	cyclictest	0	-21	swapper/0	08:33:47	0
29540	99	53	41	cyclictest	0	-21	swapper/0	08:21:53	0
29540	99	53	41	cyclictest	0	-21	swapper/0	08:09:18	0
29540	99	53	41	cyclictest	0	-21	swapper/0	08:06:00	0
29540	99	53	41	cyclictest	0	-21	swapper/0	07:55:28	0
29540	99	53	41	cyclictest	0	-21	swapper/0	07:50:52	0
29540	99	53	41	cyclictest	0	-21	swapper/0	07:50:52	0
29540	99	53	41	cyclictest	0	-21	swapper/0	07:35:03	0
29540	99	53	41	cyclictest	0	-21	swapper/0	07:30:59	0
29540	99	53	41	cyclictest	0	-21	swapper/0	07:05:10	0
29540	99	53	41	cyclictest	0	-21	swapper/0	06:56:42	0
29540	99	53	41	cyclictest	0	-21	swapper/0	06:39:53	0
29540	99	53	41	cyclictest	0	-21	swapper/0	06:12:43	0
29540	99	53	41	cyclictest	0	-21	swapper/0	06:00:47	0
29540	99	53	41	cyclictest	0	-21	swapper/0	05:39:56	0
29540	99	53	41	cyclictest	0	-21	swapper/0	05:37:41	0
29560	99	52	51	cyclictest	31863	-21	telnet	05:24:22	2
29560	99	52	51	cyclictest	29696	-21	telnet	05:19:20	2
29560	99	52	51	cyclictest	29696	-21	telnet	05:19:20	2
29560	99	52	51	cyclictest	278	-21	usb-storage	08:49:52	2
29560	99	52	51	cyclictest	278	-21	usb-storage	06:39:53	2
29560	99	52	51	cyclictest	278	-21	usb-storage	05:45:57	2
29560	99	52	51	cyclictest	1794	-21	telnet	07:59:16	2
29560	99	52	51	cyclictest	12585	-21	telnet	05:54:19	2
29560	99	52	51	cyclictest	12585	-21	telnet	05:54:19	2
29560	99	52	51	cyclictest	10692	-21	telnet	08:19:15	2
29560	99	52	51	cyclictest	0	-21	swapper/2	10:48:36	2
29560	99	52	51	cyclictest	0	-21	swapper/2	10:30:14	2
29560	99	52	51	cyclictest	0	-21	swapper/2	10:14:41	2
29560	99	52	51	cyclictest	0	-21	swapper/2	10:11:17	2
29560	99	52	51	cyclictest	0	-21	swapper/2	09:59:02	2
29560	99	52	51	cyclictest	0	-21	swapper/2	09:49:14	2
29560	99	52	51	cyclictest	0	-21	swapper/2	09:34:42	2
29560	99	52	51	cyclictest	0	-21	swapper/2	09:19:37	2
29560	99	52	51	cyclictest	0	-21	swapper/2	09:05:18	2
29560	99	52	51	cyclictest	0	-21	swapper/2	08:59:12	2
29560	99	52	51	cyclictest	0	-21	swapper/2	08:47:00	2
29560	99	52	51	cyclictest	0	-21	swapper/2	08:39:41	2
29560	99	52	51	cyclictest	0	-21	swapper/2	08:34:13	2
29560	99	52	51	cyclictest	0	-21	swapper/2	08:32:21	2
29560	99	52	51	cyclictest	0	-21	swapper/2	08:14:49	2
29560	99	52	51	cyclictest	0	-21	swapper/2	08:05:44	2
29560	99	52	51	cyclictest	0	-21	swapper/2	07:54:16	2
29560	99	52	51	cyclictest	0	-21	swapper/2	07:45:15	2
29560	99	52	51	cyclictest	0	-21	swapper/2	07:41:11	2
29560	99	52	51	cyclictest	0	-21	swapper/2	07:37:59	2
29560	99	52	51	cyclictest	0	-21	swapper/2	07:14:17	2
29560	99	52	51	cyclictest	0	-21	swapper/2	07:09:12	2
29560	99	52	51	cyclictest	0	-21	swapper/2	06:59:58	2
29560	99	52	51	cyclictest	0	-21	swapper/2	06:56:48	2
29560	99	52	51	cyclictest	0	-21	swapper/2	06:50:31	2
29560	99	52	51	cyclictest	0	-21	swapper/2	06:44:15	2
29560	99	52	51	cyclictest	0	-21	swapper/2	06:29:23	2
29560	99	52	51	cyclictest	0	-21	swapper/2	06:27:30	2
29560	99	52	51	cyclictest	0	-21	swapper/2	06:14:20	2
29551	99	52	51	cyclictest	0	-21	swapper/1	07:19:18	1
29540	99	52	51	cyclictest	21253	-21	telnet	06:14:20	0
29540	99	52	51	cyclictest	0	-21	swapper/0	10:39:00	0
29540	99	52	51	cyclictest	0	-21	swapper/0	10:30:14	0
29540	99	52	51	cyclictest	0	-21	swapper/0	10:09:07	0
29540	99	52	51	cyclictest	0	-21	swapper/0	09:54:02	0
29540	99	52	51	cyclictest	0	-21	swapper/0	09:49:11	0
29540	99	52	51	cyclictest	0	-21	swapper/0	09:44:12	0
29540	99	52	51	cyclictest	0	-21	swapper/0	09:29:07	0
29540	99	52	51	cyclictest	0	-21	swapper/0	09:14:05	0
29540	99	52	51	cyclictest	0	-21	swapper/0	08:44:12	0
29540	99	52	51	cyclictest	0	-21	swapper/0	07:39:13	0
29540	99	52	51	cyclictest	0	-21	swapper/0	06:49:18	0
29540	99	52	51	cyclictest	0	-21	swapper/0	06:34:11	0
29540	99	52	51	cyclictest	0	-21	swapper/0	06:24:21	0
29540	99	52	51	cyclictest	0	-21	swapper/0	05:24:22	0
29540	99	52	51	cyclictest	0	-21	swapper/0	05:19:20	0
29540	99	52	51	cyclictest	0	-21	swapper/0	05:19:20	0
29540	99	52	41	cyclictest	0	-21	swapper/0	08:14:45	0
29571	99	43	41	cyclictest	29572	-21	latency_hist	05:19:11	3
29560	99	33	31	cyclictest	29647	-21	latency_hist	05:19:11	2
29551	99	33	31	cyclictest	0	-21	swapper/1	05:19:11	1
29540	99	32	31	cyclictest	0	-21	swapper/0	05:19:11	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17