OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sat Aug 01, 2026 12:43:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
13621	99	123	122	cyclictest	0	-21	swapper/3	08:53:40	3
13619	99	109	103	cyclictest	0	-21	swapper/1	08:18:41	1
13619	99	105	104	cyclictest	0	-21	swapper/1	04:53:48	1
13621	99	103	102	cyclictest	0	-21	swapper/3	08:23:42	3
13621	99	103	102	cyclictest	0	-21	swapper/3	04:33:48	3
13619	99	103	102	cyclictest	0	-21	swapper/1	07:43:47	1
13619	99	103	102	cyclictest	0	-21	swapper/1	07:33:51	1
13619	99	103	102	cyclictest	0	-21	swapper/1	06:03:56	1
13621	99	93	92	cyclictest	0	-21	swapper/3	07:13:55	3
13621	99	93	92	cyclictest	0	-21	swapper/3	04:43:53	3
13619	99	93	92	cyclictest	20732	-21	tune2fs	06:33:47	1
13619	99	88	82	cyclictest	0	-21	swapper/1	04:23:56	1
13619	99	88	72	cyclictest	0	-21	swapper/1	06:53:44	1
13619	99	88	72	cyclictest	0	-21	swapper/1	06:03:31	1
13619	99	87	82	cyclictest	0	-21	swapper/1	05:23:51	1
13619	99	87	81	cyclictest	21030	-21	tune2fs	07:48:45	1
13619	99	87	81	cyclictest	1022	-21	tune2fs	04:33:48	1
13619	99	87	72	cyclictest	0	-21	swapper/1	09:03:48	1
13619	99	86	82	cyclictest	0	-21	swapper/1	09:13:46	1
13619	99	86	82	cyclictest	0	-21	swapper/1	08:53:47	1
13619	99	86	82	cyclictest	0	-21	swapper/1	08:48:48	1
13619	99	86	82	cyclictest	0	-21	swapper/1	07:38:41	1
13619	99	86	82	cyclictest	0	-21	swapper/1	07:13:54	1
13619	99	86	82	cyclictest	0	-21	swapper/1	05:38:55	1
13619	99	86	82	cyclictest	0	-21	swapper/1	05:03:55	1
13619	99	86	82	cyclictest	0	-21	swapper/1	04:43:53	1
13619	99	86	82	cyclictest	0	-21	swapper/1	04:38:58	1
13619	99	86	82	cyclictest	0	-21	swapper/1	04:19:00	1
13619	99	86	82	cyclictest	0	-21	swapper/1	04:16:09	1
13619	99	86	82	cyclictest	0	-21	swapper/1	04:03:57	1
13621	99	85	82	cyclictest	0	-21	swapper/3	05:21:17	3
13619	99	85	81	cyclictest	0	-21	swapper/1	05:33:48	1
13621	99	84	82	cyclictest	14156	-21	fschecks_time	03:48:51	3
13619	99	84	82	cyclictest	31297	-21	aten2.4-expect	08:13:38	1
13621	99	83	82	cyclictest	0	-21	swapper/3	09:08:46	3
13621	99	83	82	cyclictest	0	-21	swapper/3	09:06:53	3
13621	99	83	82	cyclictest	0	-21	swapper/3	08:43:46	3
13621	99	83	82	cyclictest	0	-21	swapper/3	08:38:47	3
13621	99	83	82	cyclictest	0	-21	swapper/3	08:33:42	3
13621	99	83	82	cyclictest	0	-21	swapper/3	08:21:45	3
13621	99	83	82	cyclictest	0	-21	swapper/3	08:13:48	3
13621	99	83	82	cyclictest	0	-21	swapper/3	08:03:48	3
13621	99	83	82	cyclictest	0	-21	swapper/3	07:58:41	3
13621	99	83	82	cyclictest	0	-21	swapper/3	07:53:48	3
13621	99	83	82	cyclictest	0	-21	swapper/3	07:48:52	3
13621	99	83	82	cyclictest	0	-21	swapper/3	07:43:45	3
13621	99	83	82	cyclictest	0	-21	swapper/3	07:23:43	3
13621	99	83	82	cyclictest	0	-21	swapper/3	07:06:32	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:48:53	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:43:48	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:41:28	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:33:54	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:28:42	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:23:52	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:18:52	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:16:24	3
13621	99	83	82	cyclictest	0	-21	swapper/3	06:03:47	3
13621	99	83	82	cyclictest	0	-21	swapper/3	05:53:53	3
13621	99	83	82	cyclictest	0	-21	swapper/3	05:48:32	3
13621	99	83	82	cyclictest	0	-21	swapper/3	05:33:56	3
13621	99	83	82	cyclictest	0	-21	swapper/3	05:23:47	3
13621	99	83	82	cyclictest	0	-21	swapper/3	05:13:54	3
13621	99	83	82	cyclictest	0	-21	swapper/3	05:13:54	3
13621	99	83	82	cyclictest	0	-21	swapper/3	05:08:46	3
13621	99	83	82	cyclictest	0	-21	swapper/3	04:58:54	3
13621	99	83	82	cyclictest	0	-21	swapper/3	04:28:50	3
13621	99	83	82	cyclictest	0	-21	swapper/3	04:18:59	3
13621	99	83	82	cyclictest	0	-21	swapper/3	04:06:07	3
13621	99	83	82	cyclictest	0	-21	swapper/3	03:58:56	3
13621	99	83	82	cyclictest	0	-21	swapper/3	03:53:48	3
13619	99	83	82	cyclictest	0	-21	swapper/1	08:58:46	1
13619	99	83	82	cyclictest	0	-21	swapper/1	08:43:46	1
13619	99	83	82	cyclictest	0	-21	swapper/1	08:38:46	1
13619	99	83	82	cyclictest	0	-21	swapper/1	08:33:48	1
13619	99	83	82	cyclictest	0	-21	swapper/1	08:28:44	1
13619	99	83	82	cyclictest	0	-21	swapper/1	08:23:41	1
13619	99	83	82	cyclictest	0	-21	swapper/1	08:08:38	1
13619	99	83	82	cyclictest	0	-21	swapper/1	08:03:48	1
13619	99	83	82	cyclictest	0	-21	swapper/1	07:58:48	1
13619	99	83	82	cyclictest	0	-21	swapper/1	07:53:48	1
13619	99	83	82	cyclictest	0	-21	swapper/1	07:28:44	1
13619	99	83	82	cyclictest	0	-21	swapper/1	07:23:43	1
13619	99	83	82	cyclictest	0	-21	swapper/1	07:18:42	1
13619	99	83	82	cyclictest	0	-21	swapper/1	07:08:43	1
13619	99	83	82	cyclictest	0	-21	swapper/1	07:03:41	1
13619	99	83	82	cyclictest	0	-21	swapper/1	06:58:45	1
13619	99	83	82	cyclictest	0	-21	swapper/1	06:48:53	1
13619	99	83	82	cyclictest	0	-21	swapper/1	06:43:48	1
13619	99	83	82	cyclictest	0	-21	swapper/1	06:23:52	1
13619	99	83	82	cyclictest	0	-21	swapper/1	06:21:25	1
13619	99	83	82	cyclictest	0	-21	swapper/1	06:13:53	1
13619	99	83	82	cyclictest	0	-21	swapper/1	06:11:23	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:53:51	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:48:50	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:43:32	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:28:54	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:18:55	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:13:54	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:13:54	1
13619	99	83	82	cyclictest	0	-21	swapper/1	05:08:56	1
13619	99	83	82	cyclictest	0	-21	swapper/1	04:48:52	1
13619	99	83	82	cyclictest	0	-21	swapper/1	04:28:57	1
13619	99	83	82	cyclictest	0	-21	swapper/1	03:53:56	1
13619	99	83	82	cyclictest	0	-21	swapper/1	03:48:54	1
13619	99	83	81	cyclictest	23205	-21	tune2fs	06:38:46	1
13619	99	83	81	cyclictest	22742	-21	tune2fs	04:08:51	1
13619	99	83	81	cyclictest	18526	-21	tune2fs	03:58:50	1
13621	99	82	81	cyclictest	0	-21	swapper/3	08:28:40	3
13621	99	82	81	cyclictest	0	-21	swapper/3	07:18:44	3
13621	99	82	81	cyclictest	0	-21	swapper/3	06:08:46	3
13621	99	82	81	cyclictest	0	-21	swapper/3	05:38:48	3
13621	99	82	81	cyclictest	0	-21	swapper/3	05:28:47	3
13621	99	82	81	cyclictest	0	-21	swapper/3	04:48:50	3
13621	99	82	81	cyclictest	0	-21	swapper/3	04:23:50	3
13619	99	77	76	cyclictest	0	-21	swapper/1	06:28:42	1
13619	99	76	75	cyclictest	0	-21	swapper/1	04:59:35	1
13621	99	75	73	cyclictest	0	-21	swapper/3	07:33:45	3
13621	99	73	72	cyclictest	0	-21	swapper/3	09:16:55	3
13621	99	73	72	cyclictest	0	-21	swapper/3	09:03:25	3
13621	99	73	72	cyclictest	0	-21	swapper/3	08:48:49	3
13621	99	73	72	cyclictest	0	-21	swapper/3	07:30:08	3
13621	99	73	72	cyclictest	0	-21	swapper/3	07:13:29	3
13621	99	73	72	cyclictest	0	-21	swapper/3	05:08:34	3
13619	99	73	72	cyclictest	0	-21	swapper/1	09:08:33	1
13621	99	72	71	cyclictest	0	-21	swapper/3	04:13:57	3
13621	99	72	71	cyclictest	0	-21	swapper/3	04:08:51	3
13621	99	68	67	cyclictest	0	-21	swapper/3	06:01:29	3
13620	99	68	52	cyclictest	278	-21	usb-storage	07:31:22	2
13620	99	66	51	cyclictest	0	-21	swapper/2	04:08:49	2
13621	99	65	63	cyclictest	0	-21	swapper/3	08:08:39	3
13620	99	65	50	cyclictest	0	-21	swapper/2	04:45:58	2
13620	99	65	50	cyclictest	0	-21	swapper/2	04:29:29	2
13621	99	63	62	cyclictest	0	-21	swapper/3	07:38:28	3
13621	99	63	62	cyclictest	0	-21	swapper/3	06:58:43	3
13621	99	63	62	cyclictest	0	-21	swapper/3	06:53:42	3
13621	99	63	62	cyclictest	0	-21	swapper/3	05:43:45	3
13621	99	63	62	cyclictest	0	-21	swapper/3	04:38:48	3
13621	99	63	51	cyclictest	0	-21	swapper/3	04:53:46	3
13620	99	63	47	cyclictest	0	-21	swapper/2	07:33:42	2
13620	99	62	58	cyclictest	0	-21	swapper/2	05:51:08	2
13620	99	61	55	cyclictest	29077	-21	df_inode	04:23:49	2
13618	99	61	60	cyclictest	0	-21	swapper/0	08:13:39	0
13620	99	59	52	cyclictest	0	-21	swapper/2	05:47:10	2
13620	99	59	31	cyclictest	0	-21	swapper/2	04:33:47	2
13620	99	58	54	cyclictest	0	-21	swapper/2	05:53:44	2
13620	99	58	31	cyclictest	0	-21	swapper/2	06:38:44	2
13618	99	58	41	cyclictest	0	-21	swapper/0	09:17:34	0
13618	99	58	41	cyclictest	0	-21	swapper/0	08:54:29	0
13618	99	58	41	cyclictest	0	-21	swapper/0	08:47:01	0
13618	99	58	41	cyclictest	0	-21	swapper/0	08:29:30	0
13618	99	58	41	cyclictest	0	-21	swapper/0	08:03:57	0
13618	99	58	41	cyclictest	0	-21	swapper/0	07:43:11	0
13618	99	58	41	cyclictest	0	-21	swapper/0	07:23:02	0
13618	99	58	41	cyclictest	0	-21	swapper/0	07:14:32	0
13618	99	58	41	cyclictest	0	-21	swapper/0	06:49:05	0
13618	99	58	41	cyclictest	0	-21	swapper/0	06:25:34	0
13618	99	58	41	cyclictest	0	-21	swapper/0	05:45:46	0
13618	99	58	41	cyclictest	0	-21	swapper/0	04:49:44	0
13618	99	58	41	cyclictest	0	-21	swapper/0	04:27:51	0
13618	99	58	41	cyclictest	0	-21	swapper/0	04:12:35	0
13620	99	57	52	cyclictest	0	-21	swapper/2	07:39:51	2
13620	99	57	52	cyclictest	0	-21	swapper/2	05:03:47	2
13620	99	57	51	cyclictest	9479	-21	telnet	04:53:46	2
13620	99	57	51	cyclictest	20629	-21	telnet	09:03:38	2
13620	99	57	31	cyclictest	0	-21	swapper/2	07:11:40	2
13620	99	57	31	cyclictest	0	-21	swapper/2	06:53:38	2
13620	99	56	52	cyclictest	0	-21	swapper/2	09:08:37	2
13620	99	56	52	cyclictest	0	-21	swapper/2	08:55:23	2
13620	99	56	52	cyclictest	0	-21	swapper/2	08:23:40	2
13620	99	56	52	cyclictest	0	-21	swapper/2	08:11:56	2
13620	99	56	52	cyclictest	0	-21	swapper/2	07:58:11	2
13620	99	56	52	cyclictest	0	-21	swapper/2	06:28:24	2
13620	99	56	52	cyclictest	0	-21	swapper/2	06:04:03	2
13620	99	56	52	cyclictest	0	-21	swapper/2	06:00:55	2
13620	99	56	52	cyclictest	0	-21	swapper/2	05:33:45	2
13620	99	56	52	cyclictest	0	-21	swapper/2	05:30:04	2
13620	99	56	52	cyclictest	0	-21	swapper/2	05:18:39	2
13620	99	56	52	cyclictest	0	-21	swapper/2	05:13:45	2
13620	99	56	52	cyclictest	0	-21	swapper/2	05:13:45	2
13620	99	56	52	cyclictest	0	-21	swapper/2	04:15:53	2
13620	99	56	52	cyclictest	0	-21	swapper/2	04:04:10	2
13620	99	56	52	cyclictest	0	-21	swapper/2	03:58:47	2
13620	99	56	52	cyclictest	0	-21	swapper/2	03:53:51	2
13620	99	56	51	cyclictest	9933	-21	telnet	08:38:38	2
13620	99	56	51	cyclictest	9756	-21	telnet	07:23:41	2
13620	99	56	51	cyclictest	20631	-21	telnet	07:48:43	2
13620	99	56	51	cyclictest	0	-21	swapper/2	07:15:26	2
13620	99	56	50	cyclictest	0	-21	swapper/2	03:51:08	2
13620	99	56	41	cyclictest	0	-21	swapper/2	08:52:55	2
13620	99	56	41	cyclictest	0	-21	swapper/2	08:44:37	2
13620	99	56	41	cyclictest	0	-21	swapper/2	08:33:15	2
13620	99	56	41	cyclictest	0	-21	swapper/2	07:23:14	2
13620	99	56	41	cyclictest	0	-21	swapper/2	07:07:19	2
13620	99	56	41	cyclictest	0	-21	swapper/2	05:08:46	2
13618	99	56	41	cyclictest	0	-21	swapper/0	09:04:24	0
13620	99	55	52	cyclictest	0	-21	swapper/2	08:17:40	2
13620	99	55	51	cyclictest	0	-21	swapper/2	08:58:36	2
13620	99	55	51	cyclictest	0	-21	swapper/2	05:28:10	2
13620	99	55	50	cyclictest	0	-21	swapper/2	07:45:43	2
13620	99	55	50	cyclictest	0	-21	swapper/2	05:39:04	2
13620	99	55	41	cyclictest	0	-21	swapper/2	06:45:57	2
13618	99	55	43	cyclictest	3	1	ksoftirqd/0	07:28:54	0
13620	99	54	53	cyclictest	0	-21	swapper/2	08:38:01	2
13620	99	54	49	cyclictest	0	-21	swapper/2	06:31:54	2
13620	99	54	49	cyclictest	0	-21	swapper/2	04:22:41	2
13618	99	54	41	cyclictest	0	-21	swapper/0	04:33:32	0
13620	99	53	52	cyclictest	0	-21	swapper/2	08:01:43	2
13620	99	53	51	cyclictest	31325	-21	telnet	06:58:44	2
13620	99	53	51	cyclictest	24952	-21	telnet	09:13:36	2
13620	99	53	49	cyclictest	0	-21	swapper/2	04:39:32	2
13620	99	53	48	cyclictest	0	-21	swapper/2	06:48:44	2
13620	99	53	48	cyclictest	0	-21	swapper/2	06:34:16	2
13620	99	53	41	cyclictest	0	-21	swapper/2	08:04:21	2
13620	99	53	41	cyclictest	0	-21	swapper/2	04:58:45	2
13618	99	53	52	cyclictest	760	50	irq/18-parport0	07:45:27	0
13618	99	53	52	cyclictest	760	50	irq/18-parport0	05:06:15	0
13618	99	53	52	cyclictest	0	-21	swapper/0	09:08:32	0
13618	99	53	52	cyclictest	0	-21	swapper/0	08:58:36	0
13618	99	53	52	cyclictest	0	-21	swapper/0	08:39:02	0
13618	99	53	52	cyclictest	0	-21	swapper/0	08:35:25	0
13618	99	53	52	cyclictest	0	-21	swapper/0	08:24:25	0
13618	99	53	52	cyclictest	0	-21	swapper/0	08:02:14	0
13618	99	53	52	cyclictest	0	-21	swapper/0	07:27:10	0
13618	99	53	52	cyclictest	0	-21	swapper/0	07:08:42	0
13618	99	53	52	cyclictest	0	-21	swapper/0	07:07:55	0
13618	99	53	52	cyclictest	0	-21	swapper/0	07:00:56	0
13618	99	53	52	cyclictest	0	-21	swapper/0	06:56:51	0
13618	99	53	52	cyclictest	0	-21	swapper/0	06:46:16	0
13618	99	53	52	cyclictest	0	-21	swapper/0	06:38:57	0
13618	99	53	52	cyclictest	0	-21	swapper/0	06:35:16	0
13618	99	53	52	cyclictest	0	-21	swapper/0	06:14:15	0
13618	99	53	52	cyclictest	0	-21	swapper/0	06:13:01	0
13618	99	53	52	cyclictest	0	-21	swapper/0	06:02:01	0
13618	99	53	52	cyclictest	0	-21	swapper/0	05:53:45	0
13618	99	53	52	cyclictest	0	-21	swapper/0	05:51:33	0
13618	99	53	52	cyclictest	0	-21	swapper/0	05:28:41	0
13618	99	53	52	cyclictest	0	-21	swapper/0	05:19:11	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:57:07	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:45:27	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:38:56	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:34:48	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:19:12	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:13:36	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:05:25	0
13618	99	53	52	cyclictest	0	-21	swapper/0	04:02:37	0
13618	99	53	52	cyclictest	0	-21	swapper/0	03:51:01	0
13618	99	53	41	cyclictest	0	-21	swapper/0	08:49:43	0
13618	99	53	41	cyclictest	0	-21	swapper/0	06:30:18	0
13618	99	53	41	cyclictest	0	-21	swapper/0	05:41:28	0
13620	99	52	51	cyclictest	9665	-21	telnet	06:08:43	2
13620	99	52	51	cyclictest	0	-21	swapper/2	08:19:14	2
13620	99	52	51	cyclictest	0	-21	swapper/2	06:19:06	2
13620	99	52	51	cyclictest	0	-21	swapper/2	06:16:27	2
13620	99	52	51	cyclictest	0	-21	swapper/2	04:48:42	2
13618	99	52	51	cyclictest	0	-21	swapper/0	08:18:42	0
13618	99	52	51	cyclictest	0	-21	swapper/0	08:10:06	0
13618	99	52	51	cyclictest	0	-21	swapper/0	07:53:31	0
13618	99	52	51	cyclictest	0	-21	swapper/0	07:48:37	0
13618	99	52	51	cyclictest	0	-21	swapper/0	07:37:38	0
13618	99	52	51	cyclictest	0	-21	swapper/0	06:19:56	0
13618	99	52	51	cyclictest	0	-21	swapper/0	06:03:43	0
13618	99	52	51	cyclictest	0	-21	swapper/0	05:33:46	0
13618	99	52	51	cyclictest	0	-21	swapper/0	05:23:43	0
13618	99	52	51	cyclictest	0	-21	swapper/0	05:15:35	0
13618	99	52	51	cyclictest	0	-21	swapper/0	05:15:35	0
13618	99	52	51	cyclictest	0	-21	swapper/0	05:11:31	0
13618	99	52	51	cyclictest	0	-21	swapper/0	04:58:45	0
13618	99	52	51	cyclictest	0	-21	swapper/0	03:56:28	0
1286	50	12	0	irq/46-eth0	11456	-21	munin-node	03:43:57	0
18	1	11	0	ksoftirqd/2	0	-21	swapper/2	03:47:59	2
23	1	10	0	ksoftirqd/3	0	-21	swapper/3	03:46:57	3
12	1	10	0	ksoftirqd/1	0	-21	swapper/1	03:47:59	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17