OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Fri Aug 07, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4396	99	104	102	cyclictest	24850	-21	tune2fs	08:13:14	1
4396	99	104	102	cyclictest	13999	-21	tune2fs	07:48:15	1
4417	99	103	102	cyclictest	0	-21	swapper/3	08:13:14	3
4417	99	103	102	cyclictest	0	-21	swapper/3	07:58:15	3
4417	99	103	102	cyclictest	0	-21	swapper/3	07:48:15	3
4417	99	103	102	cyclictest	0	-21	swapper/3	04:33:21	3
4396	99	103	102	cyclictest	26447	-21	tune2fs	04:33:21	1
4396	99	103	102	cyclictest	18374	-21	tune2fs	07:58:15	1
4417	99	93	92	cyclictest	0	-21	swapper/3	07:13:22	3
4417	99	93	92	cyclictest	0	-21	swapper/3	06:58:15	3
4396	99	93	92	cyclictest	0	-21	swapper/1	05:08:22	1
4396	99	85	73	cyclictest	0	-21	swapper/1	07:13:22	1
4396	99	84	82	cyclictest	7652	-21	tune2fs	07:33:16	1
4396	99	84	72	cyclictest	0	-21	swapper/1	06:43:19	1
4417	99	83	82	cyclictest	0	-21	swapper/3	09:12:59	3
4417	99	83	82	cyclictest	0	-21	swapper/3	09:03:14	3
4417	99	83	82	cyclictest	0	-21	swapper/3	08:58:20	3
4417	99	83	82	cyclictest	0	-21	swapper/3	08:38:14	3
4417	99	83	82	cyclictest	0	-21	swapper/3	08:23:21	3
4417	99	83	82	cyclictest	0	-21	swapper/3	08:18:13	3
4417	99	83	82	cyclictest	0	-21	swapper/3	07:46:53	3
4417	99	83	82	cyclictest	0	-21	swapper/3	07:38:23	3
4417	99	83	82	cyclictest	0	-21	swapper/3	07:33:16	3
4417	99	83	82	cyclictest	0	-21	swapper/3	06:53:04	3
4417	99	83	82	cyclictest	0	-21	swapper/3	06:43:04	3
4417	99	83	82	cyclictest	0	-21	swapper/3	06:08:27	3
4417	99	83	82	cyclictest	0	-21	swapper/3	05:53:06	3
4417	99	83	82	cyclictest	0	-21	swapper/3	05:43:20	3
4417	99	83	82	cyclictest	0	-21	swapper/3	05:13:25	3
4417	99	83	82	cyclictest	0	-21	swapper/3	05:08:22	3
4417	99	83	82	cyclictest	0	-21	swapper/3	04:43:22	3
4417	99	83	82	cyclictest	0	-21	swapper/3	04:38:33	3
4417	99	83	82	cyclictest	0	-21	swapper/3	04:28:31	3
4417	99	83	82	cyclictest	0	-21	swapper/3	04:26:21	3
4417	99	83	82	cyclictest	0	-21	swapper/3	04:23:09	3
4417	99	83	82	cyclictest	0	-21	swapper/3	04:03:32	3
4417	99	83	82	cyclictest	0	-21	swapper/3	04:03:10	3
4417	99	83	82	cyclictest	0	-21	swapper/3	03:53:31	3
4417	99	83	82	cyclictest	0	-21	swapper/3	03:48:31	3
4417	99	83	82	cyclictest	0	-21	swapper/3	03:43:24	3
4396	99	83	82	cyclictest	24237	-21	aten2.4-expect	06:58:15	1
4396	99	83	82	cyclictest	0	-21	swapper/1	09:02:58	1
4396	99	83	82	cyclictest	0	-21	swapper/1	08:48:10	1
4396	99	83	82	cyclictest	0	-21	swapper/1	08:28:16	1
4396	99	83	82	cyclictest	0	-21	swapper/1	08:18:22	1
4396	99	83	82	cyclictest	0	-21	swapper/1	07:53:22	1
4396	99	83	82	cyclictest	0	-21	swapper/1	06:48:23	1
4396	99	83	82	cyclictest	0	-21	swapper/1	06:33:19	1
4396	99	83	82	cyclictest	0	-21	swapper/1	06:33:04	1
4396	99	83	82	cyclictest	0	-21	swapper/1	06:23:28	1
4396	99	83	82	cyclictest	0	-21	swapper/1	06:18:29	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:59:29	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:48:24	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:43:21	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:28:26	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:23:27	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:22:10	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:13:26	1
4396	99	83	82	cyclictest	0	-21	swapper/1	05:03:29	1
4396	99	83	82	cyclictest	0	-21	swapper/1	04:58:23	1
4396	99	83	82	cyclictest	0	-21	swapper/1	03:56:54	1
4396	99	83	81	cyclictest	3118	-21	tune2fs	08:38:14	1
4396	99	83	81	cyclictest	3057	-21	tune2fs	06:08:20	1
4396	99	83	81	cyclictest	22515	-21	tune2fs	06:53:16	1
4396	99	83	81	cyclictest	20625	-21	tune2fs	08:03:16	1
4396	99	83	81	cyclictest	13512	-21	tune2fs	04:03:24	1
4396	99	83	71	cyclictest	5302	-21	tune2fs	06:13:18	1
4417	99	82	81	cyclictest	0	-21	swapper/3	08:03:16	3
4417	99	82	81	cyclictest	0	-21	swapper/3	07:08:17	3
4417	99	82	81	cyclictest	0	-21	swapper/3	06:43:18	3
4417	99	82	81	cyclictest	0	-21	swapper/3	06:13:18	3
4417	99	82	81	cyclictest	0	-21	swapper/3	05:33:20	3
4396	99	82	71	cyclictest	0	-21	swapper/1	08:53:15	1
4417	99	81	80	cyclictest	6808	-21	vsftpd	07:32:59	3
4396	99	75	63	cyclictest	0	-21	swapper/1	08:13:01	1
4417	99	74	62	cyclictest	0	-21	swapper/3	04:48:20	3
4417	99	73	72	cyclictest	0	-21	swapper/3	08:53:10	3
4417	99	73	72	cyclictest	0	-21	swapper/3	08:48:51	3
4417	99	73	72	cyclictest	0	-21	swapper/3	08:43:10	3
4417	99	73	72	cyclictest	0	-21	swapper/3	08:35:17	3
4417	99	73	72	cyclictest	0	-21	swapper/3	08:31:04	3
4417	99	73	72	cyclictest	0	-21	swapper/3	07:53:19	3
4417	99	73	72	cyclictest	0	-21	swapper/3	07:26:50	3
4417	99	73	72	cyclictest	0	-21	swapper/3	07:18:17	3
4417	99	73	72	cyclictest	0	-21	swapper/3	07:06:12	3
4417	99	73	72	cyclictest	0	-21	swapper/3	06:53:22	3
4417	99	73	72	cyclictest	0	-21	swapper/3	06:34:53	3
4417	99	73	72	cyclictest	0	-21	swapper/3	06:28:16	3
4417	99	73	72	cyclictest	0	-21	swapper/3	06:25:14	3
4417	99	73	72	cyclictest	0	-21	swapper/3	06:03:27	3
4417	99	73	72	cyclictest	0	-21	swapper/3	05:38:07	3
4417	99	73	72	cyclictest	0	-21	swapper/3	05:28:23	3
4417	99	73	72	cyclictest	0	-21	swapper/3	05:27:20	3
4417	99	73	72	cyclictest	0	-21	swapper/3	05:22:21	3
4417	99	73	72	cyclictest	0	-21	swapper/3	05:06:27	3
4417	99	73	72	cyclictest	0	-21	swapper/3	04:59:03	3
4417	99	73	72	cyclictest	0	-21	swapper/3	04:53:25	3
4396	99	73	72	cyclictest	0	-21	swapper/1	08:23:20	1
4396	99	73	72	cyclictest	0	-21	swapper/1	07:38:15	1
4396	99	73	72	cyclictest	0	-21	swapper/1	07:03:19	1
4396	99	73	72	cyclictest	0	-21	swapper/1	05:53:22	1
4396	99	73	72	cyclictest	0	-21	swapper/1	04:18:28	1
4396	99	73	72	cyclictest	0	-21	swapper/1	04:08:25	1
4396	99	73	72	cyclictest	0	-21	swapper/1	04:08:25	1
4396	99	73	72	cyclictest	0	-21	swapper/1	03:58:24	1
4396	99	73	71	cyclictest	0	-21	swapper/1	05:33:20	1
4417	99	72	71	cyclictest	17858	-21	fschecks_count	04:13:22	3
4417	99	72	71	cyclictest	15389	-21	aten2.4-expect	04:08:22	3
4417	99	72	71	cyclictest	15389	-21	aten2.4-expect	04:08:22	3
4396	99	72	71	cyclictest	0	-21	swapper/1	09:08:11	1
4396	99	72	71	cyclictest	0	-21	swapper/1	09:03:12	1
4396	99	72	71	cyclictest	0	-21	swapper/1	08:43:11	1
4396	99	72	71	cyclictest	0	-21	swapper/1	08:33:12	1
4396	99	72	71	cyclictest	0	-21	swapper/1	07:43:14	1
4396	99	72	71	cyclictest	0	-21	swapper/1	07:28:21	1
4396	99	72	71	cyclictest	0	-21	swapper/1	07:23:13	1
4396	99	72	71	cyclictest	0	-21	swapper/1	07:18:18	1
4396	99	72	71	cyclictest	0	-21	swapper/1	07:08:14	1
4396	99	72	71	cyclictest	0	-21	swapper/1	06:38:18	1
4396	99	72	71	cyclictest	0	-21	swapper/1	06:03:15	1
4396	99	72	71	cyclictest	0	-21	swapper/1	05:38:07	1
4396	99	72	71	cyclictest	0	-21	swapper/1	04:53:20	1
4396	99	72	71	cyclictest	0	-21	swapper/1	04:48:23	1
4396	99	72	71	cyclictest	0	-21	swapper/1	04:43:20	1
4396	99	72	71	cyclictest	0	-21	swapper/1	04:38:25	1
4396	99	72	71	cyclictest	0	-21	swapper/1	04:28:21	1
4396	99	72	71	cyclictest	0	-21	swapper/1	04:23:21	1
4396	99	72	71	cyclictest	0	-21	swapper/1	04:13:23	1
4396	99	72	71	cyclictest	0	-21	swapper/1	03:48:25	1
4396	99	72	71	cyclictest	0	-21	swapper/1	03:43:21	1
4417	99	68	67	cyclictest	6846	-21	runrttasks	06:18:09	3
4417	99	64	62	cyclictest	0	-21	swapper/3	08:08:14	3
4417	99	63	62	cyclictest	0	-21	swapper/3	05:58:16	3
4417	99	63	62	cyclictest	0	-21	swapper/3	05:53:06	3
4407	99	63	62	cyclictest	0	-21	swapper/2	05:54:39	2
4384	99	62	61	cyclictest	0	-21	swapper/0	08:13:33	0
4384	99	62	61	cyclictest	0	-21	swapper/0	06:58:15	0
4384	99	62	56	cyclictest	0	-21	swapper/0	07:13:08	0
4407	99	61	60	cyclictest	0	-21	swapper/2	08:13:33	2
4407	99	61	60	cyclictest	0	-21	swapper/2	06:58:15	2
4384	99	60	59	cyclictest	0	-21	swapper/0	07:28:14	0
4407	99	59	58	cyclictest	0	-21	swapper/2	07:13:15	2
4407	99	58	57	cyclictest	0	-21	swapper/2	07:28:14	2
4384	99	58	41	cyclictest	0	-21	swapper/0	08:48:11	0
4384	99	58	41	cyclictest	0	-21	swapper/0	08:00:32	0
4384	99	58	41	cyclictest	0	-21	swapper/0	06:44:49	0
4384	99	58	41	cyclictest	0	-21	swapper/0	04:26:06	0
4384	99	56	55	cyclictest	0	-21	swapper/0	04:53:19	0
4407	99	55	54	cyclictest	0	-21	swapper/2	04:53:19	2
4384	99	55	41	cyclictest	0	-21	swapper/0	04:08:41	0
4384	99	55	41	cyclictest	0	-21	swapper/0	04:08:41	0
4407	99	54	53	cyclictest	278	-21	usb-storage	09:11:40	2
4407	99	54	53	cyclictest	278	-21	usb-storage	05:50:23	2
4407	99	54	53	cyclictest	0	-21	swapper/2	07:33:14	2
4407	99	54	52	cyclictest	50	50	irq/44-ahci	04:02:59	2
4407	99	54	51	cyclictest	4723	-21	telnet	04:58:21	2
4384	99	54	53	cyclictest	0	-21	swapper/0	07:33:14	0
4384	99	54	52	cyclictest	760	50	irq/18-parport0	05:59:37	0
4407	99	53	52	cyclictest	0	-21	swapper/2	08:49:13	2
4407	99	53	52	cyclictest	0	-21	swapper/2	05:30:38	2
4407	99	53	52	cyclictest	0	-21	swapper/2	04:33:20	2
4407	99	53	52	cyclictest	0	-21	swapper/2	04:25:32	2
4407	99	53	51	cyclictest	50	50	irq/44-ahci	07:27:24	2
4407	99	53	51	cyclictest	278	-21	usb-storage	04:03:15	2
4407	99	53	51	cyclictest	23979	-21	telnet	04:28:22	2
4407	99	53	51	cyclictest	1876	-21	hald-addon-stor	05:10:53	2
4407	99	53	41	cyclictest	50	50	irq/44-ahci	03:53:41	2
4407	99	53	41	cyclictest	0	-21	swapper/2	09:03:10	2
4407	99	53	41	cyclictest	0	-21	swapper/2	07:57:07	2
4407	99	53	41	cyclictest	0	-21	swapper/2	07:20:05	2
4407	99	53	41	cyclictest	0	-21	swapper/2	07:12:42	2
4407	99	53	41	cyclictest	0	-21	swapper/2	06:48:32	2
4407	99	53	41	cyclictest	0	-21	swapper/2	06:08:18	2
4407	99	53	41	cyclictest	0	-21	swapper/2	05:38:10	2
4407	99	53	41	cyclictest	0	-21	swapper/2	05:13:23	2
4407	99	53	41	cyclictest	0	-21	swapper/2	04:48:16	2
4407	99	53	41	cyclictest	0	-21	swapper/2	03:51:42	2
4384	99	53	52	cyclictest	760	50	irq/18-parport0	08:23:32	0
4384	99	53	52	cyclictest	760	50	irq/18-parport0	06:27:02	0
4384	99	53	52	cyclictest	0	-21	swapper/0	09:05:44	0
4384	99	53	52	cyclictest	0	-21	swapper/0	08:43:09	0
4384	99	53	52	cyclictest	0	-21	swapper/0	08:03:13	0
4384	99	53	52	cyclictest	0	-21	swapper/0	07:43:12	0
4384	99	53	52	cyclictest	0	-21	swapper/0	05:48:15	0
4384	99	53	52	cyclictest	0	-21	swapper/0	05:33:18	0
4384	99	53	52	cyclictest	0	-21	swapper/0	05:23:24	0
4384	99	53	52	cyclictest	0	-21	swapper/0	05:13:17	0
4384	99	53	52	cyclictest	0	-21	swapper/0	05:08:20	0
4384	99	53	52	cyclictest	0	-21	swapper/0	04:33:20	0
4384	99	53	52	cyclictest	0	-21	swapper/0	04:03:22	0
4384	99	53	51	cyclictest	0	-21	swapper/0	04:58:21	0
4384	99	53	41	cyclictest	0	-21	swapper/0	07:57:07	0
4384	99	53	41	cyclictest	0	-21	swapper/0	07:20:05	0
4384	99	53	41	cyclictest	0	-21	swapper/0	07:11:06	0
4384	99	53	41	cyclictest	0	-21	swapper/0	05:54:40	0
4384	99	53	41	cyclictest	0	-21	swapper/0	05:38:10	0
4384	99	53	41	cyclictest	0	-21	swapper/0	05:28:48	0
4384	99	53	41	cyclictest	0	-21	swapper/0	04:48:16	0
4407	99	52	51	cyclictest	9241	-21	telnet	07:38:15	2
4407	99	52	51	cyclictest	19708	-21	telnet	05:33:17	2
4407	99	52	51	cyclictest	1876	-21	hald-addon-stor	08:41:41	2
4407	99	52	51	cyclictest	1876	-21	hald-addon-stor	06:24:20	2
4407	99	52	51	cyclictest	13337	-21	telnet	05:18:19	2
4407	99	52	51	cyclictest	0	-21	swapper/2	08:54:18	2
4407	99	52	51	cyclictest	0	-21	swapper/2	08:43:09	2
4407	99	52	51	cyclictest	0	-21	swapper/2	08:29:47	2
4407	99	52	51	cyclictest	0	-21	swapper/2	08:20:08	2
4407	99	52	51	cyclictest	0	-21	swapper/2	08:08:42	2
4407	99	52	51	cyclictest	0	-21	swapper/2	08:03:13	2
4407	99	52	51	cyclictest	0	-21	swapper/2	08:00:26	2
4407	99	52	51	cyclictest	0	-21	swapper/2	07:48:12	2
4407	99	52	51	cyclictest	0	-21	swapper/2	07:43:11	2
4407	99	52	51	cyclictest	0	-21	swapper/2	06:53:45	2
4407	99	52	51	cyclictest	0	-21	swapper/2	06:04:15	2
4407	99	52	51	cyclictest	0	-21	swapper/2	05:58:16	2
4407	99	52	51	cyclictest	0	-21	swapper/2	04:44:24	2
4407	99	52	51	cyclictest	0	-21	swapper/2	04:14:07	2
4407	99	52	51	cyclictest	0	-21	swapper/2	04:08:45	2
4407	99	52	51	cyclictest	0	-21	swapper/2	04:08:45	2
4407	99	52	41	cyclictest	0	-21	swapper/2	06:45:52	2
4407	99	52	41	cyclictest	0	-21	swapper/2	06:35:38	2
4384	99	52	51	cyclictest	760	50	irq/18-parport0	06:04:15	0
4384	99	52	51	cyclictest	0	-21	swapper/0	09:12:00	0
4384	99	52	51	cyclictest	0	-21	swapper/0	09:00:36	0
4384	99	52	51	cyclictest	0	-21	swapper/0	08:53:06	0
4384	99	52	51	cyclictest	0	-21	swapper/0	08:41:41	0
4384	99	52	51	cyclictest	0	-21	swapper/0	08:08:42	0
4384	99	52	51	cyclictest	0	-21	swapper/0	07:48:12	0
4384	99	52	51	cyclictest	0	-21	swapper/0	07:38:15	0
4384	99	52	51	cyclictest	0	-21	swapper/0	07:27:24	0
4384	99	52	51	cyclictest	0	-21	swapper/0	07:04:38	0
4384	99	52	51	cyclictest	0	-21	swapper/0	06:53:43	0
4384	99	52	51	cyclictest	0	-21	swapper/0	06:51:31	0
4384	99	52	51	cyclictest	0	-21	swapper/0	06:33:36	0
4384	99	52	51	cyclictest	0	-21	swapper/0	06:20:40	0
4384	99	52	51	cyclictest	0	-21	swapper/0	06:13:40	0
4384	99	52	51	cyclictest	0	-21	swapper/0	05:43:52	0
4384	99	52	51	cyclictest	0	-21	swapper/0	05:18:19	0
4384	99	52	51	cyclictest	0	-21	swapper/0	05:04:35	0
4384	99	52	51	cyclictest	0	-21	swapper/0	04:44:24	0
4384	99	52	51	cyclictest	0	-21	swapper/0	04:28:21	0
4384	99	52	51	cyclictest	0	-21	swapper/0	04:13:55	0
4384	99	52	51	cyclictest	0	-21	swapper/0	04:02:59	0
4384	99	52	51	cyclictest	0	-21	swapper/0	03:53:22	0
4384	99	52	51	cyclictest	0	-21	swapper/0	03:47:42	0
4384	99	52	41	cyclictest	0	-21	swapper/0	03:52:44	0
4407	99	51	48	cyclictest	0	-21	swapper/2	06:28:09	2
4384	99	51	50	cyclictest	0	-21	swapper/0	08:34:45	0
4384	99	51	50	cyclictest	0	-21	swapper/0	08:20:20	0
4384	99	51	50	cyclictest	0	-21	swapper/0	06:08:52	0
4384	99	51	50	cyclictest	0	-21	swapper/0	04:42:18	0
4407	99	50	49	cyclictest	0	-21	swapper/2	08:34:45	2
4407	99	50	49	cyclictest	0	-21	swapper/2	08:25:45	2
4407	99	50	49	cyclictest	0	-21	swapper/2	06:16:37	2
4407	99	50	49	cyclictest	0	-21	swapper/2	05:26:08	2
4407	99	50	49	cyclictest	0	-21	swapper/2	04:42:18	2
4384	99	50	49	cyclictest	0	-21	swapper/0	06:28:09	0
4407	99	49	48	cyclictest	0	-21	swapper/2	06:43:03	2
4407	99	48	41	cyclictest	0	-21	swapper/2	03:45:22	2
4384	99	47	41	cyclictest	0	-21	swapper/0	04:18:35	0
4407	99	44	43	cyclictest	0	-21	swapper/2	06:23:00	2
4417	99	43	41	cyclictest	0	-21	swapper/3	03:43:11	3
4407	99	43	41	cyclictest	7872	-21	missed_timers	05:03:26	2
4407	99	43	41	cyclictest	50	50	irq/44-ahci	08:58:15	2
4407	99	43	41	cyclictest	50	50	irq/44-ahci	05:43:19	2
4407	99	43	41	cyclictest	278	-21	usb-storage	04:19:33	2
4384	99	43	41	cyclictest	0	-21	swapper/0	06:38:53	0
4407	99	42	41	cyclictest	0	-21	swapper/2	07:03:05	2
4396	99	42	41	cyclictest	0	-21	swapper/1	03:43:11	1
4384	99	42	41	cyclictest	0	-21	swapper/0	08:28:14	0
4384	99	32	31	cyclictest	0	-21	swapper/0	03:43:11	0
4407	99	31	20	cyclictest	4418	-21	latency_hist	03:43:11	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17