OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #1

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the highest latencies:

System rack3slot1.osadl.org (updated Sat Jan 03, 2026 00:43:25)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
28430	99	127	122	cyclictest	0	-21	swapper/1	21:04:32	1
28432	99	106	102	cyclictest	4191	-21	sed	20:29:29	3
28432	99	104	92	cyclictest	0	-21	swapper/3	21:04:32	3
28432	99	103	102	cyclictest	0	-21	swapper/3	19:14:21	3
28430	99	94	82	cyclictest	0	-21	swapper/1	21:53:12	1
28432	99	93	92	cyclictest	0	-21	swapper/3	20:49:22	3
28430	99	93	92	cyclictest	0	-21	swapper/1	21:42:34	1
28430	99	93	92	cyclictest	0	-21	swapper/1	19:08:56	1
28430	99	92	91	cyclictest	22556	-21	tune2fs	21:14:21	1
28430	99	88	82	cyclictest	31052	-21	tune2fs	21:34:20	1
28430	99	88	82	cyclictest	13771	-21	tune2fs	20:54:23	1
28430	99	88	82	cyclictest	0	-21	swapper/1	22:59:16	1
28430	99	88	81	cyclictest	20164	-21	tune2fs	22:24:18	1
28430	99	88	81	cyclictest	20164	-21	tune2fs	22:24:18	1
28430	99	88	71	cyclictest	0	-21	swapper/1	23:40:16	1
28430	99	88	71	cyclictest	0	-21	swapper/1	20:34:31	1
28430	99	88	71	cyclictest	0	-21	swapper/1	20:34:31	1
28430	99	87	71	cyclictest	0	-21	swapper/1	22:49:23	1
28430	99	86	82	cyclictest	0	-21	swapper/1	23:59:23	1
28430	99	86	82	cyclictest	0	-21	swapper/1	23:34:22	1
28430	99	86	82	cyclictest	0	-21	swapper/1	23:09:24	1
28430	99	86	82	cyclictest	0	-21	swapper/1	22:44:24	1
28430	99	86	82	cyclictest	0	-21	swapper/1	21:19:27	1
28430	99	86	82	cyclictest	0	-21	swapper/1	21:09:27	1
28430	99	86	82	cyclictest	0	-21	swapper/1	20:39:29	1
28430	99	86	82	cyclictest	0	-21	swapper/1	19:19:31	1
28430	99	86	81	cyclictest	3061	-21	tune2fs	21:44:18	1
28430	99	85	81	cyclictest	0	-21	swapper/1	20:09:08	1
28432	99	84	82	cyclictest	7561	-21	tune2fs	19:24:25	3
28432	99	83	82	cyclictest	0	-21	swapper/3	23:50:18	3
28432	99	83	82	cyclictest	0	-21	swapper/3	23:45:52	3
28432	99	83	82	cyclictest	0	-21	swapper/3	23:29:17	3
28432	99	83	82	cyclictest	0	-21	swapper/3	23:24:58	3
28432	99	83	82	cyclictest	0	-21	swapper/3	23:19:22	3
28432	99	83	82	cyclictest	0	-21	swapper/3	23:14:19	3
28432	99	83	82	cyclictest	0	-21	swapper/3	23:14:19	3
28432	99	83	82	cyclictest	0	-21	swapper/3	22:54:23	3
28432	99	83	82	cyclictest	0	-21	swapper/3	22:49:53	3
28432	99	83	82	cyclictest	0	-21	swapper/3	22:44:52	3
28432	99	83	82	cyclictest	0	-21	swapper/3	22:19:24	3
28432	99	83	82	cyclictest	0	-21	swapper/3	22:14:17	3
28432	99	83	82	cyclictest	0	-21	swapper/3	22:14:04	3
28432	99	83	82	cyclictest	0	-21	swapper/3	22:04:24	3
28432	99	83	82	cyclictest	0	-21	swapper/3	21:59:22	3
28432	99	83	82	cyclictest	0	-21	swapper/3	21:49:05	3
28432	99	83	82	cyclictest	0	-21	swapper/3	21:34:26	3
28432	99	83	82	cyclictest	0	-21	swapper/3	21:14:38	3
28432	99	83	82	cyclictest	0	-21	swapper/3	21:09:37	3
28432	99	83	82	cyclictest	0	-21	swapper/3	20:44:29	3
28432	99	83	82	cyclictest	0	-21	swapper/3	20:39:32	3
28432	99	83	82	cyclictest	0	-21	swapper/3	20:34:29	3
28432	99	83	82	cyclictest	0	-21	swapper/3	20:34:29	3
28432	99	83	82	cyclictest	0	-21	swapper/3	20:24:30	3
28432	99	83	82	cyclictest	0	-21	swapper/3	20:14:31	3
28432	99	83	82	cyclictest	0	-21	swapper/3	20:04:32	3
28432	99	83	82	cyclictest	0	-21	swapper/3	19:59:31	3
28432	99	83	82	cyclictest	0	-21	swapper/3	19:54:30	3
28432	99	83	82	cyclictest	0	-21	swapper/3	19:49:31	3
28432	99	83	82	cyclictest	0	-21	swapper/3	19:39:23	3
28432	99	83	82	cyclictest	0	-21	swapper/3	19:09:35	3
28432	99	83	82	cyclictest	0	-21	swapper/3	19:04:30	3
28432	99	83	82	cyclictest	0	-21	swapper/3	00:19:24	3
28432	99	83	82	cyclictest	0	-21	swapper/3	00:09:12	3
28432	99	83	82	cyclictest	0	-21	swapper/3	00:04:22	3
28430	99	83	82	cyclictest	0	-21	swapper/1	23:49:21	1
28430	99	83	82	cyclictest	0	-21	swapper/1	23:45:52	1
28430	99	83	82	cyclictest	0	-21	swapper/1	23:32:04	1
28430	99	83	82	cyclictest	0	-21	swapper/1	23:20:29	1
28430	99	83	82	cyclictest	0	-21	swapper/1	23:14:09	1
28430	99	83	82	cyclictest	0	-21	swapper/1	23:14:09	1
28430	99	83	82	cyclictest	0	-21	swapper/1	23:04:24	1
28430	99	83	82	cyclictest	0	-21	swapper/1	22:29:09	1
28430	99	83	82	cyclictest	0	-21	swapper/1	22:18:15	1
28430	99	83	82	cyclictest	0	-21	swapper/1	22:09:26	1
28430	99	83	82	cyclictest	0	-21	swapper/1	21:29:40	1
28430	99	83	82	cyclictest	0	-21	swapper/1	20:59:30	1
28430	99	83	82	cyclictest	0	-21	swapper/1	20:29:29	1
28430	99	83	82	cyclictest	0	-21	swapper/1	20:19:31	1
28430	99	83	82	cyclictest	0	-21	swapper/1	19:55:58	1
28430	99	83	82	cyclictest	0	-21	swapper/1	19:34:34	1
28430	99	83	82	cyclictest	0	-21	swapper/1	19:09:35	1
28430	99	83	82	cyclictest	0	-21	swapper/1	00:14:19	1
28430	99	83	81	cyclictest	26755	-21	tune2fs	22:39:16	1
28430	99	83	81	cyclictest	26613	-21	tune2fs	23:54:14	1
28432	99	82	81	cyclictest	0	-21	swapper/3	23:09:17	3
28432	99	82	81	cyclictest	0	-21	swapper/3	21:54:19	3
28432	99	82	81	cyclictest	0	-21	swapper/3	19:29:24	3
28432	99	82	81	cyclictest	0	-21	swapper/3	00:14:12	3
28430	99	82	81	cyclictest	28719	-21	aten2.4-expect	18:59:25	1
28430	99	82	81	cyclictest	28719	-21	aten2.4-expect	18:59:25	1
28430	99	82	81	cyclictest	2735	-21	aten2.4_r3power	19:14:21	1
28430	99	82	81	cyclictest	0	-21	swapper/1	20:12:06	1
28430	99	79	71	cyclictest	9176	-21	aten2.4-expect	20:44:20	1
28430	99	78	72	cyclictest	0	-21	swapper/1	22:04:15	1
28430	99	78	72	cyclictest	0	-21	swapper/1	19:39:24	1
28430	99	78	71	cyclictest	26340	-21	aten2.4-expect	21:24:18	1
28430	99	77	72	cyclictest	0	-21	swapper/1	22:59:02	1
28430	99	77	72	cyclictest	0	-21	swapper/1	21:59:04	1
28430	99	77	72	cyclictest	0	-21	swapper/1	20:54:07	1
28430	99	77	72	cyclictest	0	-21	swapper/1	20:04:09	1
28430	99	77	72	cyclictest	0	-21	swapper/1	18:59:11	1
28430	99	77	72	cyclictest	0	-21	swapper/1	00:23:59	1
28430	99	77	72	cyclictest	0	-21	swapper/1	00:09:00	1
28430	99	76	72	cyclictest	0	-21	swapper/1	21:59:14	1
28432	99	73	72	cyclictest	0	-21	swapper/3	23:34:22	3
28432	99	73	72	cyclictest	0	-21	swapper/3	23:04:55	3
28432	99	73	72	cyclictest	0	-21	swapper/3	22:59:54	3
28432	99	73	72	cyclictest	0	-21	swapper/3	19:19:24	3
28430	99	73	72	cyclictest	0	-21	swapper/1	23:24:23	1
28430	99	73	72	cyclictest	0	-21	swapper/1	22:34:14	1
28430	99	73	72	cyclictest	0	-21	swapper/1	22:19:15	1
28430	99	73	72	cyclictest	0	-21	swapper/1	20:29:08	1
28430	99	73	72	cyclictest	0	-21	swapper/1	20:14:22	1
28430	99	73	72	cyclictest	0	-21	swapper/1	19:54:09	1
28430	99	73	72	cyclictest	0	-21	swapper/1	19:49:09	1
28430	99	73	72	cyclictest	0	-21	swapper/1	19:29:25	1
28430	99	73	72	cyclictest	0	-21	swapper/1	19:24:21	1
28430	99	73	72	cyclictest	0	-21	swapper/1	00:09:15	1
28432	99	72	71	cyclictest	0	-21	swapper/3	21:39:26	3
28432	99	72	71	cyclictest	0	-21	swapper/3	20:59:30	3
28432	99	72	71	cyclictest	0	-21	swapper/3	00:24:19	3
28431	99	72	71	cyclictest	0	-21	swapper/2	20:42:51	2
28432	99	71	70	cyclictest	0	-21	swapper/3	20:19:22	3
28431	99	71	70	cyclictest	0	-21	swapper/2	22:32:59	2
28432	99	70	69	cyclictest	0	-21	swapper/3	21:19:17	3
28430	99	70	69	cyclictest	0	-21	swapper/1	00:24:26	1
28432	99	67	61	cyclictest	13815	-21	fschecks_count	20:54:23	3
28432	99	64	63	cyclictest	0	-21	swapper/3	19:01:05	3
28432	99	64	63	cyclictest	0	-21	swapper/3	19:01:05	3
28432	99	64	62	cyclictest	0	-21	swapper/3	22:29:03	3
28432	99	64	62	cyclictest	0	-21	swapper/3	22:29:03	3
28432	99	64	62	cyclictest	0	-21	swapper/3	20:09:23	3
28432	99	64	62	cyclictest	0	-21	swapper/3	19:34:33	3
28432	99	63	62	cyclictest	0	-21	swapper/3	23:59:13	3
28432	99	63	62	cyclictest	0	-21	swapper/3	23:54:11	3
28432	99	63	62	cyclictest	0	-21	swapper/3	23:39:12	3
28432	99	63	62	cyclictest	0	-21	swapper/3	22:39:14	3
28432	99	63	62	cyclictest	0	-21	swapper/3	22:34:03	3
28432	99	63	62	cyclictest	0	-21	swapper/3	22:29:04	3
28432	99	63	62	cyclictest	0	-21	swapper/3	21:49:18	3
28432	99	63	62	cyclictest	0	-21	swapper/3	21:29:15	3
28432	99	63	62	cyclictest	0	-21	swapper/3	21:24:19	3
28432	99	63	62	cyclictest	0	-21	swapper/3	18:59:11	3
28432	99	63	51	cyclictest	1384	-13	audispd	19:44:10	3
28431	99	62	41	cyclictest	0	-21	swapper/2	22:24:25	2
28431	99	62	41	cyclictest	0	-21	swapper/2	22:24:25	2
28429	99	62	61	cyclictest	0	-21	swapper/0	23:30:12	0
28429	99	62	61	cyclictest	0	-21	swapper/0	23:24:11	0
28429	99	62	61	cyclictest	0	-21	swapper/0	21:52:24	0
28429	99	62	61	cyclictest	0	-21	swapper/0	21:09:18	0
28429	99	62	61	cyclictest	0	-21	swapper/0	19:59:46	0
28429	99	62	61	cyclictest	0	-21	swapper/0	19:32:30	0
28429	99	62	61	cyclictest	0	-21	swapper/0	19:27:10	0
28429	99	62	61	cyclictest	0	-21	swapper/0	19:06:32	0
28431	99	61	42	cyclictest	0	-21	swapper/2	20:07:26	2
28429	99	61	60	cyclictest	0	-21	swapper/0	22:09:17	0
28431	99	60	41	cyclictest	278	-21	usb-storage	20:12:20	2
28431	99	58	52	cyclictest	278	-21	usb-storage	19:58:36	2
28431	99	57	51	cyclictest	278	-21	usb-storage	22:20:13	2
28431	99	57	51	cyclictest	2656	-21	telnet	20:29:18	2
28431	99	57	51	cyclictest	22079	-21	telnet	21:14:18	2
28431	99	57	51	cyclictest	0	-21	swapper/2	21:01:52	2
28431	99	57	41	cyclictest	12013	-21	iostat	23:19:18	2
28431	99	57	41	cyclictest	0	-21	swapper/2	21:43:56	2
28431	99	57	41	cyclictest	0	-21	swapper/2	19:59:30	2
28431	99	57	41	cyclictest	0	-21	swapper/2	19:51:41	2
28431	99	57	41	cyclictest	0	-21	swapper/2	19:26:56	2
28431	99	57	41	cyclictest	0	-21	swapper/2	00:14:09	2
28431	99	56	51	cyclictest	0	-21	swapper/2	23:54:53	2
28431	99	56	51	cyclictest	0	-21	swapper/2	22:51:32	2
28431	99	56	51	cyclictest	0	-21	swapper/2	22:46:52	2
28431	99	56	51	cyclictest	0	-21	swapper/2	21:58:24	2
28431	99	56	51	cyclictest	0	-21	swapper/2	19:40:49	2
28431	99	56	51	cyclictest	0	-21	swapper/2	19:16:28	2
28431	99	56	51	cyclictest	0	-21	swapper/2	00:20:26	2
28431	99	56	50	cyclictest	0	-21	swapper/2	22:57:02	2
28431	99	56	41	cyclictest	0	-21	swapper/2	22:39:36	2
28431	99	56	41	cyclictest	0	-21	swapper/2	22:18:29	2
28431	99	56	41	cyclictest	0	-21	swapper/2	22:08:39	2
28431	99	56	41	cyclictest	0	-21	swapper/2	21:51:14	2
28431	99	56	41	cyclictest	0	-21	swapper/2	20:36:45	2
28431	99	56	41	cyclictest	0	-21	swapper/2	20:36:45	2
28431	99	56	41	cyclictest	0	-21	swapper/2	20:16:54	2
28431	99	56	41	cyclictest	0	-21	swapper/2	19:46:15	2
28431	99	56	41	cyclictest	0	-21	swapper/2	19:36:11	2
28431	99	56	41	cyclictest	0	-21	swapper/2	19:30:59	2
28431	99	56	41	cyclictest	0	-21	swapper/2	19:10:20	2
28431	99	56	41	cyclictest	0	-21	swapper/2	00:24:46	2
28431	99	56	31	cyclictest	0	-21	swapper/2	23:45:08	2
28431	99	56	31	cyclictest	0	-21	swapper/2	23:42:46	2
28431	99	56	31	cyclictest	0	-21	swapper/2	23:29:36	2
28431	99	56	31	cyclictest	0	-21	swapper/2	20:25:53	2
28431	99	56	31	cyclictest	0	-21	swapper/2	19:19:18	2
28431	99	56	31	cyclictest	0	-21	swapper/2	18:59:53	2
28431	99	56	31	cyclictest	0	-21	swapper/2	18:59:53	2
28431	99	55	51	cyclictest	0	-21	swapper/2	00:03:13	2
28431	99	55	31	cyclictest	278	-21	usb-storage	21:24:35	2
28431	99	55	31	cyclictest	278	-21	usb-storage	21:08:42	2
28431	99	55	31	cyclictest	278	-21	usb-storage	20:51:52	2
28431	99	54	52	cyclictest	50	50	irq/44-ahci	00:09:31	2
28429	99	54	42	cyclictest	50	50	irq/44-ahci	23:44:55	0
28431	99	53	52	cyclictest	32081	-21	sshd	00:04:39	2
28431	99	53	52	cyclictest	0	-21	swapper/2	21:29:15	2
28431	99	53	52	cyclictest	0	-21	swapper/2	21:09:18	2
28431	99	53	52	cyclictest	0	-21	swapper/2	20:48:32	2
28431	99	53	52	cyclictest	0	-21	swapper/2	20:22:05	2
28431	99	53	52	cyclictest	0	-21	swapper/2	19:04:14	2
28431	99	53	41	cyclictest	0	-21	swapper/2	23:34:02	2
28431	99	53	41	cyclictest	0	-21	swapper/2	23:15:49	2
28431	99	53	41	cyclictest	0	-21	swapper/2	23:15:49	2
28431	99	53	41	cyclictest	0	-21	swapper/2	21:45:10	2
28431	99	53	41	cyclictest	0	-21	swapper/2	21:23:57	2
28431	99	53	41	cyclictest	0	-21	swapper/2	20:56:08	2
28429	99	53	52	cyclictest	760	50	irq/18-parport0	23:13:17	0
28429	99	53	52	cyclictest	760	50	irq/18-parport0	19:44:17	0
28429	99	53	51	cyclictest	760	50	irq/18-parport0	22:01:50	0
28429	99	53	51	cyclictest	50	50	irq/44-ahci	21:54:43	0
28429	99	53	51	cyclictest	50	50	irq/44-ahci	20:30:00	0
28429	99	53	41	cyclictest	0	-21	swapper/0	23:34:20	0
28431	99	52	51	cyclictest	1876	-21	hald-addon-stor	21:34:31	2
28431	99	52	51	cyclictest	18	1	ksoftirqd/2	23:03:33	2
28431	99	52	51	cyclictest	0	-21	swapper/2	23:25:15	2
28431	99	52	51	cyclictest	0	-21	swapper/2	23:05:59	2
28431	99	52	51	cyclictest	0	-21	swapper/2	22:35:00	2
28431	99	52	51	cyclictest	0	-21	swapper/2	22:09:17	2
28431	99	52	51	cyclictest	0	-21	swapper/2	21:59:34	2
28431	99	52	41	cyclictest	0	-21	swapper/2	23:10:45	2
28429	99	52	51	cyclictest	760	50	irq/18-parport0	23:06:27	0
28429	99	52	51	cyclictest	760	50	irq/18-parport0	22:51:00	0
28429	99	52	51	cyclictest	760	50	irq/18-parport0	22:21:57	0
28429	99	52	51	cyclictest	760	50	irq/18-parport0	21:31:23	0
28429	99	52	51	cyclictest	760	50	irq/18-parport0	20:16:42	0
28429	99	52	51	cyclictest	760	50	irq/18-parport0	19:41:07	0
28429	99	52	51	cyclictest	50	50	irq/44-ahci	22:14:10	0
28429	99	52	51	cyclictest	478	-21	kjournald	00:19:19	0
28429	99	52	51	cyclictest	0	-21	swapper/0	23:56:13	0
28429	99	52	51	cyclictest	0	-21	swapper/0	23:49:20	0
28429	99	52	51	cyclictest	0	-21	swapper/0	23:14:49	0
28429	99	52	51	cyclictest	0	-21	swapper/0	23:14:49	0
28429	99	52	51	cyclictest	0	-21	swapper/0	22:55:56	0
28429	99	52	51	cyclictest	0	-21	swapper/0	22:44:42	0
28429	99	52	51	cyclictest	0	-21	swapper/0	22:36:06	0
28429	99	52	51	cyclictest	0	-21	swapper/0	22:25:55	0
28429	99	52	51	cyclictest	0	-21	swapper/0	22:25:55	0
28429	99	52	51	cyclictest	0	-21	swapper/0	22:06:56	0
28429	99	52	51	cyclictest	0	-21	swapper/0	21:42:28	0
28429	99	52	51	cyclictest	0	-21	swapper/0	21:38:45	0
28429	99	52	51	cyclictest	0	-21	swapper/0	21:21:11	0
28429	99	52	51	cyclictest	0	-21	swapper/0	21:14:18	0
28429	99	52	51	cyclictest	0	-21	swapper/0	21:08:00	0
28429	99	52	51	cyclictest	0	-21	swapper/0	21:01:12	0
28429	99	52	51	cyclictest	0	-21	swapper/0	20:55:00	0
28429	99	52	51	cyclictest	0	-21	swapper/0	20:50:16	0
28429	99	52	51	cyclictest	0	-21	swapper/0	20:46:07	0
28429	99	52	51	cyclictest	0	-21	swapper/0	20:27:13	0
28429	99	52	51	cyclictest	0	-21	swapper/0	20:20:00	0
28429	99	52	51	cyclictest	0	-21	swapper/0	19:57:16	0
28429	99	52	51	cyclictest	0	-21	swapper/0	19:52:19	0
28429	99	52	51	cyclictest	0	-21	swapper/0	19:34:57	0
28429	99	52	51	cyclictest	0	-21	swapper/0	19:14:20	0
28429	99	52	51	cyclictest	0	-21	swapper/0	19:01:39	0
28429	99	52	51	cyclictest	0	-21	swapper/0	19:01:39	0
28429	99	52	51	cyclictest	0	-21	swapper/0	00:25:10	0
28429	99	52	51	cyclictest	0	-21	swapper/0	00:17:01	0
28429	99	52	41	cyclictest	0	-21	swapper/0	23:21:25	0
28429	99	52	31	cyclictest	0	-21	swapper/0	22:39:28	0
28431	99	51	41	cyclictest	0	-21	swapper/2	23:49:14	2
28429	99	51	50	cyclictest	0	-21	swapper/0	23:59:37	0
28429	99	51	50	cyclictest	0	-21	swapper/0	23:41:24	0
28429	99	51	50	cyclictest	0	-21	swapper/0	22:29:35	0
28429	99	51	50	cyclictest	0	-21	swapper/0	21:24:33	0
28429	99	51	50	cyclictest	0	-21	swapper/0	20:42:29	0
28429	99	51	50	cyclictest	0	-21	swapper/0	20:36:37	0
28429	99	51	50	cyclictest	0	-21	swapper/0	20:36:37	0
28429	99	51	50	cyclictest	0	-21	swapper/0	20:10:54	0
28429	99	51	50	cyclictest	0	-21	swapper/0	20:06:58	0
28429	99	51	50	cyclictest	0	-21	swapper/0	00:07:01	0
28429	99	50	49	cyclictest	0	-21	swapper/0	22:59:26	0
28429	99	50	49	cyclictest	0	-21	swapper/0	19:20:24	0
28429	99	47	46	cyclictest	0	-21	swapper/0	00:10:57	0
28431	99	46	41	cyclictest	0	-21	swapper/2	18:59:11	2
28429	99	46	45	cyclictest	0	-21	swapper/0	21:44:30	0
28429	99	46	45	cyclictest	0	-21	swapper/0	19:13:12	0
28429	99	42	41	cyclictest	0	-21	swapper/0	18:59:11	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17