OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 376 highest latencies:

System rack3slot1.osadl.org (updated Thu Apr 30, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3968	99	104	102	cyclictest	10032	-21	tune2fs	10:27:52	1
3970	99	103	102	cyclictest	0	-21	swapper/3	09:12:59	3
3968	99	93	92	cyclictest	0	-21	swapper/1	10:04:15	1
3968	99	93	92	cyclictest	0	-21	swapper/1	08:41:08	1
3968	99	86	82	cyclictest	0	-21	swapper/1	05:15:36	1
3970	99	84	82	cyclictest	0	-21	swapper/3	08:52:57	3
3970	99	84	82	cyclictest	0	-21	swapper/3	07:53:02	3
3970	99	84	72	cyclictest	0	-21	swapper/3	06:23:00	3
3970	99	84	72	cyclictest	0	-21	swapper/3	06:23:00	3
3970	99	84	72	cyclictest	0	-21	swapper/3	05:57:20	3
3968	99	84	82	cyclictest	8714	-21	tune2fs	05:23:03	1
3970	99	83	82	cyclictest	0	-21	swapper/3	10:37:53	3
3970	99	83	82	cyclictest	0	-21	swapper/3	10:31:23	3
3970	99	83	82	cyclictest	0	-21	swapper/3	10:27:38	3
3970	99	83	82	cyclictest	0	-21	swapper/3	10:12:57	3
3970	99	83	82	cyclictest	0	-21	swapper/3	10:07:53	3
3970	99	83	82	cyclictest	0	-21	swapper/3	10:04:15	3
3970	99	83	82	cyclictest	0	-21	swapper/3	09:51:19	3
3970	99	83	82	cyclictest	0	-21	swapper/3	09:42:57	3
3970	99	83	82	cyclictest	0	-21	swapper/3	09:38:02	3
3970	99	83	82	cyclictest	0	-21	swapper/3	09:32:59	3
3970	99	83	82	cyclictest	0	-21	swapper/3	09:27:55	3
3970	99	83	82	cyclictest	0	-21	swapper/3	09:07:59	3
3970	99	83	82	cyclictest	0	-21	swapper/3	08:58:04	3
3970	99	83	82	cyclictest	0	-21	swapper/3	08:42:56	3
3970	99	83	82	cyclictest	0	-21	swapper/3	08:28:03	3
3970	99	83	82	cyclictest	0	-21	swapper/3	08:22:58	3
3970	99	83	82	cyclictest	0	-21	swapper/3	08:12:59	3
3970	99	83	82	cyclictest	0	-21	swapper/3	08:08:14	3
3970	99	83	82	cyclictest	0	-21	swapper/3	08:03:06	3
3970	99	83	82	cyclictest	0	-21	swapper/3	07:33:03	3
3970	99	83	82	cyclictest	0	-21	swapper/3	07:23:15	3
3970	99	83	82	cyclictest	0	-21	swapper/3	06:40:50	3
3970	99	83	82	cyclictest	0	-21	swapper/3	06:40:50	3
3970	99	83	82	cyclictest	0	-21	swapper/3	06:32:47	3
3970	99	83	82	cyclictest	0	-21	swapper/3	06:13:04	3
3970	99	83	82	cyclictest	0	-21	swapper/3	05:58:09	3
3970	99	83	82	cyclictest	0	-21	swapper/3	05:43:12	3
3970	99	83	82	cyclictest	0	-21	swapper/3	05:33:09	3
3970	99	83	82	cyclictest	0	-21	swapper/3	05:20:37	3
3970	99	83	71	cyclictest	0	-21	swapper/3	07:12:58	3
3968	99	83	82	cyclictest	4813	-21	tune2fs	06:28:01	1
3968	99	83	82	cyclictest	20415	-21	tune2fs	08:22:55	1
3968	99	83	82	cyclictest	0	-21	swapper/1	10:32:51	1
3968	99	83	82	cyclictest	0	-21	swapper/1	10:22:39	1
3968	99	83	82	cyclictest	0	-21	swapper/1	10:22:39	1
3968	99	83	82	cyclictest	0	-21	swapper/1	10:12:57	1
3968	99	83	82	cyclictest	0	-21	swapper/1	09:37:59	1
3968	99	83	82	cyclictest	0	-21	swapper/1	09:12:59	1
3968	99	83	82	cyclictest	0	-21	swapper/1	09:07:58	1
3968	99	83	82	cyclictest	0	-21	swapper/1	08:56:10	1
3968	99	83	82	cyclictest	0	-21	swapper/1	08:31:07	1
3968	99	83	82	cyclictest	0	-21	swapper/1	08:22:43	1
3968	99	83	82	cyclictest	0	-21	swapper/1	07:47:56	1
3968	99	83	82	cyclictest	0	-21	swapper/1	07:41:00	1
3968	99	83	82	cyclictest	0	-21	swapper/1	07:25:58	1
3968	99	83	82	cyclictest	0	-21	swapper/1	06:48:05	1
3968	99	83	82	cyclictest	0	-21	swapper/1	06:20:47	1
3968	99	83	82	cyclictest	0	-21	swapper/1	06:13:07	1
3968	99	83	82	cyclictest	0	-21	swapper/1	06:08:10	1
3968	99	83	82	cyclictest	0	-21	swapper/1	05:58:11	1
3968	99	83	82	cyclictest	0	-21	swapper/1	05:48:09	1
3968	99	83	82	cyclictest	0	-21	swapper/1	05:42:49	1
3968	99	83	82	cyclictest	0	-21	swapper/1	05:35:40	1
3968	99	83	82	cyclictest	0	-21	swapper/1	05:32:50	1
3968	99	83	82	cyclictest	0	-21	swapper/1	05:18:06	1
3968	99	83	81	cyclictest	7995	-21	tune2fs	10:22:51	1
3968	99	83	81	cyclictest	29534	-21	tune2fs	09:57:54	1
3968	99	83	81	cyclictest	25716	-21	aten2.4-expect	06:03:01	1
3968	99	83	81	cyclictest	24658	-21	tune2fs	08:32:56	1
3968	99	83	81	cyclictest	18667	-21	tune2fs	09:32:55	1
3968	99	83	81	cyclictest	15977	-21	tune2fs	08:12:59	1
3970	99	82	81	cyclictest	0	-21	swapper/3	09:57:54	3
3970	99	82	81	cyclictest	0	-21	swapper/3	08:37:56	3
3970	99	82	81	cyclictest	0	-21	swapper/3	06:28:01	3
3970	99	82	81	cyclictest	0	-21	swapper/3	05:13:01	3
3968	99	82	81	cyclictest	14096	-21	tune2fs	08:08:13	1
3970	99	73	72	cyclictest	0	-21	swapper/3	10:33:54	3
3970	99	73	72	cyclictest	0	-21	swapper/3	10:21:39	3
3970	99	73	72	cyclictest	0	-21	swapper/3	10:21:39	3
3970	99	73	72	cyclictest	0	-21	swapper/3	09:56:57	3
3970	99	73	72	cyclictest	0	-21	swapper/3	09:22:52	3
3970	99	73	72	cyclictest	0	-21	swapper/3	09:19:00	3
3970	99	73	72	cyclictest	0	-21	swapper/3	08:48:00	3
3970	99	73	72	cyclictest	0	-21	swapper/3	08:34:51	3
3970	99	73	72	cyclictest	0	-21	swapper/3	07:58:02	3
3970	99	73	72	cyclictest	0	-21	swapper/3	07:47:56	3
3970	99	73	72	cyclictest	0	-21	swapper/3	07:43:26	3
3970	99	73	72	cyclictest	0	-21	swapper/3	07:38:02	3
3970	99	73	72	cyclictest	0	-21	swapper/3	07:17:57	3
3970	99	73	72	cyclictest	0	-21	swapper/3	07:07:58	3
3970	99	73	72	cyclictest	0	-21	swapper/3	07:03:04	3
3970	99	73	72	cyclictest	0	-21	swapper/3	06:59:48	3
3970	99	73	72	cyclictest	0	-21	swapper/3	06:53:28	3
3970	99	73	72	cyclictest	0	-21	swapper/3	06:18:01	3
3970	99	73	72	cyclictest	0	-21	swapper/3	06:10:32	3
3970	99	73	72	cyclictest	0	-21	swapper/3	06:03:09	3
3970	99	73	72	cyclictest	0	-21	swapper/3	05:48:09	3
3970	99	73	72	cyclictest	0	-21	swapper/3	05:38:00	3
3970	99	73	72	cyclictest	0	-21	swapper/3	05:28:01	3
3970	99	73	72	cyclictest	0	-21	swapper/3	05:25:51	3
3968	99	73	72	cyclictest	24619	-21	aten2.4-expect	09:47:51	1
3968	99	73	72	cyclictest	0	-21	swapper/1	09:27:00	1
3968	99	73	72	cyclictest	0	-21	swapper/1	05:57:20	1
3968	99	73	71	cyclictest	16009	-21	aten2.4-expect	09:27:53	1
3968	99	72	71	cyclictest	0	-21	swapper/1	08:03:08	1
3968	99	72	71	cyclictest	0	-21	swapper/1	07:35:59	1
3968	99	70	69	cyclictest	0	-21	swapper/1	06:23:08	1
3968	99	70	69	cyclictest	0	-21	swapper/1	06:23:08	1
3968	99	69	68	cyclictest	0	-21	swapper/1	07:27:58	1
3968	99	67	65	cyclictest	9593	-21	tune2fs	07:57:59	1
3968	99	66	62	cyclictest	0	-21	swapper/1	05:39:57	1
3968	99	64	62	cyclictest	0	-21	swapper/1	10:11:21	1
3968	99	64	62	cyclictest	0	-21	swapper/1	06:38:08	1
3968	99	64	62	cyclictest	0	-21	swapper/1	06:38:08	1
3970	99	63	62	cyclictest	0	-21	swapper/3	09:02:45	3
3970	99	63	62	cyclictest	0	-21	swapper/3	08:17:53	3
3970	99	63	62	cyclictest	0	-21	swapper/3	07:27:49	3
3970	99	63	62	cyclictest	0	-21	swapper/3	06:47:58	3
3970	99	63	62	cyclictest	0	-21	swapper/3	06:42:57	3
3968	99	63	62	cyclictest	0	-21	swapper/1	09:17:54	1
3968	99	63	62	cyclictest	0	-21	swapper/1	09:02:55	1
3968	99	63	62	cyclictest	0	-21	swapper/1	08:57:55	1
3968	99	63	62	cyclictest	0	-21	swapper/1	08:47:56	1
3968	99	63	62	cyclictest	0	-21	swapper/1	08:42:53	1
3968	99	63	62	cyclictest	0	-21	swapper/1	07:53:02	1
3968	99	63	62	cyclictest	0	-21	swapper/1	07:43:00	1
3968	99	63	62	cyclictest	0	-21	swapper/1	07:12:46	1
3968	99	63	62	cyclictest	0	-21	swapper/1	07:02:47	1
3968	99	63	62	cyclictest	0	-21	swapper/1	06:57:56	1
3968	99	63	62	cyclictest	0	-21	swapper/1	06:53:46	1
3968	99	63	62	cyclictest	0	-21	swapper/1	06:42:58	1
3968	99	63	62	cyclictest	0	-21	swapper/1	06:32:47	1
3968	99	63	61	cyclictest	27116	-21	tune2fs	09:52:54	1
3968	99	63	61	cyclictest	24514	-21	tune2fs	07:17:59	1
3968	99	63	61	cyclictest	19959	-21	aten2.4-expect	07:07:58	1
3968	99	63	61	cyclictest	14279	-21	tune2fs	10:37:52	1
3968	99	63	51	cyclictest	0	-21	swapper/1	09:42:53	1
3969	99	59	58	cyclictest	0	-21	swapper/2	05:18:12	2
3960	99	58	41	cyclictest	0	-21	swapper/0	06:54:58	0
3969	99	57	45	cyclictest	0	-21	swapper/2	10:27:50	2
3969	99	55	53	cyclictest	18	1	ksoftirqd/2	10:13:32	2
3969	99	55	50	cyclictest	0	-21	swapper/2	05:47:50	2
3969	99	55	41	cyclictest	0	-21	swapper/2	09:57:23	2
3960	99	55	47	cyclictest	0	-21	swapper/0	09:58:05	0
3969	99	54	51	cyclictest	0	-21	swapper/2	06:23:21	2
3969	99	54	51	cyclictest	0	-21	swapper/2	06:23:21	2
3960	99	54	48	cyclictest	0	-21	swapper/0	06:35:33	0
3969	99	53	52	cyclictest	0	-21	swapper/2	10:36:26	2
3969	99	53	52	cyclictest	0	-21	swapper/2	09:38:58	2
3969	99	53	52	cyclictest	0	-21	swapper/2	09:23:56	2
3969	99	53	52	cyclictest	0	-21	swapper/2	09:20:50	2
3969	99	53	52	cyclictest	0	-21	swapper/2	08:53:07	2
3969	99	53	52	cyclictest	0	-21	swapper/2	08:42:54	2
3969	99	53	52	cyclictest	0	-21	swapper/2	08:38:52	2
3969	99	53	52	cyclictest	0	-21	swapper/2	08:08:11	2
3969	99	53	52	cyclictest	0	-21	swapper/2	08:02:55	2
3969	99	53	52	cyclictest	0	-21	swapper/2	08:00:17	2
3969	99	53	52	cyclictest	0	-21	swapper/2	07:45:42	2
3969	99	53	52	cyclictest	0	-21	swapper/2	07:35:32	2
3969	99	53	52	cyclictest	0	-21	swapper/2	07:26:55	2
3969	99	53	52	cyclictest	0	-21	swapper/2	07:17:57	2
3969	99	53	52	cyclictest	0	-21	swapper/2	07:04:00	2
3969	99	53	52	cyclictest	0	-21	swapper/2	06:32:55	2
3969	99	53	52	cyclictest	0	-21	swapper/2	06:22:33	2
3969	99	53	52	cyclictest	0	-21	swapper/2	06:12:50	2
3969	99	53	52	cyclictest	0	-21	swapper/2	06:12:14	2
3969	99	53	52	cyclictest	0	-21	swapper/2	05:39:51	2
3969	99	53	51	cyclictest	50	50	irq/44-ahci	08:48:33	2
3969	99	53	51	cyclictest	50	50	irq/44-ahci	06:42:53	2
3969	99	53	41	cyclictest	278	-21	usb-storage	07:28:59	2
3969	99	53	41	cyclictest	0	-21	swapper/2	10:41:49	2
3969	99	53	41	cyclictest	0	-21	swapper/2	10:26:36	2
3969	99	53	41	cyclictest	0	-21	swapper/2	10:08:29	2
3969	99	53	41	cyclictest	0	-21	swapper/2	10:02:50	2
3969	99	53	41	cyclictest	0	-21	swapper/2	09:50:21	2
3969	99	53	41	cyclictest	0	-21	swapper/2	09:42:51	2
3969	99	53	41	cyclictest	0	-21	swapper/2	09:34:24	2
3969	99	53	41	cyclictest	0	-21	swapper/2	08:58:03	2
3969	99	53	41	cyclictest	0	-21	swapper/2	08:32:54	2
3969	99	53	41	cyclictest	0	-21	swapper/2	08:24:39	2
3969	99	53	41	cyclictest	0	-21	swapper/2	08:17:54	2
3969	99	53	41	cyclictest	0	-21	swapper/2	07:57:34	2
3969	99	53	41	cyclictest	0	-21	swapper/2	07:13:36	2
3969	99	53	41	cyclictest	0	-21	swapper/2	07:09:05	2
3969	99	53	41	cyclictest	0	-21	swapper/2	06:58:54	2
3969	99	53	41	cyclictest	0	-21	swapper/2	06:56:50	2
3969	99	53	41	cyclictest	0	-21	swapper/2	06:48:00	2
3969	99	53	41	cyclictest	0	-21	swapper/2	06:04:32	2
3969	99	53	41	cyclictest	0	-21	swapper/2	05:59:24	2
3969	99	53	41	cyclictest	0	-21	swapper/2	05:52:54	2
3969	99	53	41	cyclictest	0	-21	swapper/2	05:43:59	2
3969	99	53	41	cyclictest	0	-21	swapper/2	05:33:01	2
3969	99	53	41	cyclictest	0	-21	swapper/2	05:28:03	2
3969	99	53	41	cyclictest	0	-21	swapper/2	05:22:57	2
3960	99	53	52	cyclictest	760	50	irq/18-parport0	10:34:04	0
3960	99	53	52	cyclictest	760	50	irq/18-parport0	05:43:49	0
3960	99	53	52	cyclictest	0	-21	swapper/0	10:02:50	0
3960	99	53	52	cyclictest	0	-21	swapper/0	09:57:19	0
3960	99	53	52	cyclictest	0	-21	swapper/0	09:04:03	0
3960	99	53	52	cyclictest	0	-21	swapper/0	07:02:57	0
3960	99	53	52	cyclictest	0	-21	swapper/0	06:40:28	0
3960	99	53	52	cyclictest	0	-21	swapper/0	06:40:28	0
3960	99	53	52	cyclictest	0	-21	swapper/0	06:30:19	0
3960	99	53	52	cyclictest	0	-21	swapper/0	06:12:52	0
3960	99	53	52	cyclictest	0	-21	swapper/0	05:26:25	0
3960	99	53	46	cyclictest	0	-21	swapper/0	07:20:05	0
3960	99	53	41	cyclictest	760	50	irq/18-parport0	07:28:47	0
3969	99	52	51	cyclictest	0	-21	swapper/2	10:17:48	2
3969	99	52	51	cyclictest	0	-21	swapper/2	10:17:48	2
3969	99	52	51	cyclictest	0	-21	swapper/2	08:13:01	2
3969	99	52	51	cyclictest	0	-21	swapper/2	06:27:58	2
3969	99	52	51	cyclictest	0	-21	swapper/2	05:15:52	2
3969	99	52	41	cyclictest	0	-21	swapper/2	09:28:20	2
3969	99	52	41	cyclictest	0	-21	swapper/2	09:16:55	2
3969	99	52	41	cyclictest	0	-21	swapper/2	09:04:45	2
3969	99	52	41	cyclictest	0	-21	swapper/2	08:28:06	2
3960	99	52	51	cyclictest	760	50	irq/18-parport0	10:39:03	0
3960	99	52	51	cyclictest	760	50	irq/18-parport0	08:31:08	0
3960	99	52	51	cyclictest	0	-21	swapper/0	10:28:01	0
3960	99	52	51	cyclictest	0	-21	swapper/0	10:14:38	0
3960	99	52	51	cyclictest	0	-21	swapper/0	09:36:06	0
3960	99	52	51	cyclictest	0	-21	swapper/0	09:31:46	0
3960	99	52	51	cyclictest	0	-21	swapper/0	08:38:04	0
3960	99	52	51	cyclictest	0	-21	swapper/0	08:13:01	0
3960	99	52	51	cyclictest	0	-21	swapper/0	07:59:22	0
3960	99	52	51	cyclictest	0	-21	swapper/0	07:53:14	0
3960	99	52	51	cyclictest	0	-21	swapper/0	07:46:24	0
3960	99	52	51	cyclictest	0	-21	swapper/0	07:12:56	0
3960	99	52	51	cyclictest	0	-21	swapper/0	05:38:49	0
3960	99	52	51	cyclictest	0	-21	swapper/0	05:19:35	0
3960	99	52	51	cyclictest	0	-21	swapper/0	05:13:02	0
3969	99	51	50	cyclictest	0	-21	swapper/2	10:02:03	2
3969	99	51	50	cyclictest	0	-21	swapper/2	06:40:37	2
3969	99	51	50	cyclictest	0	-21	swapper/2	06:40:37	2
3960	99	51	50	cyclictest	0	-21	swapper/0	07:33:13	0
3960	99	51	50	cyclictest	0	-21	swapper/0	06:46:04	0
3960	99	51	50	cyclictest	0	-21	swapper/0	06:21:23	0
3960	99	51	50	cyclictest	0	-21	swapper/0	05:57:38	0
3960	99	51	50	cyclictest	0	-21	swapper/0	05:52:04	0
3960	99	51	41	cyclictest	0	-21	swapper/0	07:38:16	0
3969	99	50	49	cyclictest	0	-21	swapper/2	07:47:55	2
3960	99	50	49	cyclictest	0	-21	swapper/0	10:25:26	0
3960	99	50	49	cyclictest	0	-21	swapper/0	09:39:56	0
3960	99	50	49	cyclictest	0	-21	swapper/0	08:54:11	0
3960	99	50	49	cyclictest	0	-21	swapper/0	08:50:46	0
3960	99	50	49	cyclictest	0	-21	swapper/0	08:43:40	0
3960	99	50	49	cyclictest	0	-21	swapper/0	08:22:59	0
3960	99	50	48	cyclictest	0	-21	swapper/0	10:09:43	0
3969	99	49	48	cyclictest	0	-21	swapper/2	09:08:59	2
3969	99	49	48	cyclictest	0	-21	swapper/2	07:38:21	2
3960	99	49	48	cyclictest	0	-21	swapper/0	10:21:12	0
3960	99	49	48	cyclictest	0	-21	swapper/0	10:21:12	0
3960	99	49	48	cyclictest	0	-21	swapper/0	07:10:47	0
3960	99	49	48	cyclictest	0	-21	swapper/0	06:57:56	0
3960	99	49	48	cyclictest	0	-21	swapper/0	06:23:21	0
3960	99	49	48	cyclictest	0	-21	swapper/0	06:23:21	0
3960	99	49	41	cyclictest	0	-21	swapper/0	09:45:04	0
3960	99	48	47	cyclictest	0	-21	swapper/0	08:08:15	0
3960	99	48	47	cyclictest	0	-21	swapper/0	07:23:26	0
3960	99	48	47	cyclictest	0	-21	swapper/0	06:48:08	0
3960	99	48	47	cyclictest	0	-21	swapper/0	06:08:08	0
3960	99	48	47	cyclictest	0	-21	swapper/0	05:58:56	0
3960	99	48	47	cyclictest	0	-21	swapper/0	05:30:01	0
3960	99	48	41	cyclictest	0	-21	swapper/0	09:49:07	0
3960	99	48	41	cyclictest	0	-21	swapper/0	07:48:00	0
3960	99	48	41	cyclictest	0	-21	swapper/0	06:05:12	0
3960	99	47	46	cyclictest	0	-21	swapper/0	09:20:12	0
3960	99	47	46	cyclictest	0	-21	swapper/0	08:57:54	0
3960	99	45	44	cyclictest	0	-21	swapper/0	09:07:53	0
3960	99	44	42	cyclictest	50	50	irq/44-ahci	09:23:29	0
3960	99	44	42	cyclictest	50	50	irq/44-ahci	08:33:36	0
3960	99	43	42	cyclictest	0	-21	swapper/0	08:02:57	0
3960	99	43	42	cyclictest	0	-21	swapper/0	05:35:57	0
3960	99	43	41	cyclictest	9892	-21	tune2fs	09:12:56	0
3960	99	43	31	cyclictest	0	-21	swapper/0	08:17:54	0
3960	99	22	21	cyclictest	0	-21	swapper/0	05:12:51	0
21	99	10	0	migration/3	3455	-21	runrttasks	05:08:41	3
18	1	10	0	ksoftirqd/2	0	-21	swapper/2	05:10:36	2
12	1	10	0	ksoftirqd/1	0	-21	swapper/1	05:09:44	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17