OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack3slot6.osadl.org (updated Thu May 28, 2026 00:44:59)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3926	2	97	34,46	sleep0	0	-21	swapper/0	19:05:15	0
5628	99	95	25,64	cyclictest	0	-21	swapper/1	00:00:13	1
5624	99	90	53,20	cyclictest	14	-21	ksoftirqd/0	21:05:12	0
5624	99	89	50,22	cyclictest	14	-21	ksoftirqd/0	22:20:12	0
5624	99	88	51,20	cyclictest	14	-21	ksoftirqd/0	23:05:14	0
5628	99	86	64,11	cyclictest	26	-21	ksoftirqd/1	00:15:12	1
5628	99	84	52,19	cyclictest	26	-21	ksoftirqd/1	19:55:12	1
5624	99	84	55,19	cyclictest	14	-21	ksoftirqd/0	22:05:13	0
5628	99	83	54,16	cyclictest	26	-21	ksoftirqd/1	21:10:12	1
5628	99	78	49,18	cyclictest	26	-21	ksoftirqd/1	19:45:11	1
5624	99	78	12,49	cyclictest	0	-21	swapper/0	19:25:12	0
5628	99	77	47,17	cyclictest	26	-21	ksoftirqd/1	23:45:13	1
5316	2	76	18,45	sleep1	0	-21	swapper/1	19:08:35	1
5628	99	75	48,16	cyclictest	26	-21	ksoftirqd/1	23:55:13	1
5628	99	75	46,18	cyclictest	26	-21	ksoftirqd/1	20:00:13	1
5628	99	74	43,23	cyclictest	18232	-21	cat	21:15:19	1
5628	99	74	43,23	cyclictest	18232	-21	cat	21:15:19	1
5628	99	71	44,21	cyclictest	26	-21	ksoftirqd/1	00:20:14	1
5624	99	71	28,35	cyclictest	27338	-21	aten2.4-expect	20:10:16	0
5628	99	70	27,39	cyclictest	26	-21	ksoftirqd/1	22:40:37	1
5628	99	69	37,19	cyclictest	0	-21	swapper/1	20:50:14	1
5628	99	68	38,17	cyclictest	0	-21	swapper/1	20:05:14	1
5624	99	68	4,23	cyclictest	18087	-21	aten2.4-expect	21:15:17	0
5624	99	68	4,23	cyclictest	18087	-21	aten2.4-expect	21:15:17	0
5624	99	67	6,48	cyclictest	0	-21	swapper/0	19:35:14	0
13548	2	67	0,5	sleep1	25	1	rcuc/1	19:30:20	1
5628	99	66	38,17	cyclictest	26	-21	ksoftirqd/1	21:35:13	1
5628	99	65	39,16	cyclictest	0	-21	swapper/1	20:40:11	1
5628	99	65	21,40	cyclictest	26	-21	ksoftirqd/1	23:30:23	1
5624	99	65	45,12	cyclictest	14	-21	ksoftirqd/0	22:30:12	0
5624	99	65	32,20	cyclictest	503	-21	snmpd	23:25:14	0
5628	99	64	51,8	cyclictest	26	-21	ksoftirqd/1	23:40:00	1
5628	99	64	51,8	cyclictest	26	-21	ksoftirqd/1	23:40:00	1
5628	99	63	37,18	cyclictest	26	-21	ksoftirqd/1	22:10:25	1
5628	99	63	36,21	cyclictest	26	-21	ksoftirqd/1	20:25:11	1
5628	99	63	36,20	cyclictest	26	-21	ksoftirqd/1	21:40:21	1
5628	99	63	33,17	cyclictest	0	-21	swapper/1	20:20:11	1
5628	99	63	32,25	cyclictest	26	-21	ksoftirqd/1	21:00:25	1
5624	99	63	39,19	cyclictest	14	-21	ksoftirqd/0	23:35:16	0
5624	99	63	39,19	cyclictest	14	-21	ksoftirqd/0	23:35:15	0
5628	99	62	9,7	cyclictest	0	-21	swapper/1	21:07:19	1
5628	99	62	37,10	cyclictest	26	-21	ksoftirqd/1	19:50:15	1
5628	99	62	36,17	cyclictest	26	-21	ksoftirqd/1	21:20:34	1
5628	99	61	46,9	cyclictest	26	-21	ksoftirqd/1	00:35:44	1
5628	99	61	37,18	cyclictest	26	-21	ksoftirqd/1	20:55:22	1
5628	99	61	37,18	cyclictest	26	-21	ksoftirqd/1	20:35:01	1
5628	99	61	37,17	cyclictest	26	-21	ksoftirqd/1	19:20:23	1
5628	99	61	36,18	cyclictest	26	-21	ksoftirqd/1	23:40:36	1
5628	99	61	36,18	cyclictest	26	-21	ksoftirqd/1	22:45:27	1
5628	99	61	35,18	cyclictest	26	-21	ksoftirqd/1	19:10:26	1
5628	99	61	35,18	cyclictest	26	-21	ksoftirqd/1	00:30:28	1
5628	99	61	31,20	cyclictest	21341	-21	cron	22:55:00	1
5628	99	61	29,24	cyclictest	26	-21	ksoftirqd/1	22:20:00	1
5624	99	61	6,13	cyclictest	0	-21	swapper/0	00:35:22	0
5624	99	61	35,21	cyclictest	14	-21	ksoftirqd/0	21:39:00	0
17895	2	61	0,37	sleep0	17	1	rcuc/0	21:15:01	0
5628	99	60	8,19	cyclictest	32045	-21	apt-get	23:25:14	1
5628	99	60	6,16	cyclictest	13669	-21	apt-get	00:05:13	1
5628	99	60	37,18	cyclictest	26	-21	ksoftirqd/1	20:35:16	1
5628	99	60	35,19	cyclictest	26	-21	ksoftirqd/1	19:15:17	1
5628	99	60	35,18	cyclictest	26	-21	ksoftirqd/1	23:10:01	1
5628	99	60	34,20	cyclictest	26	-21	ksoftirqd/1	20:10:12	1
5628	99	60	33,21	cyclictest	26	-21	ksoftirqd/1	22:25:22	1
5628	99	60	33,21	cyclictest	26	-21	ksoftirqd/1	19:35:15	1
5628	99	60	18,35	cyclictest	0	-21	swapper/1	22:55:14	1
5628	99	59	40,11	cyclictest	0	-21	swapper/1	22:05:12	1
5628	99	59	35,17	cyclictest	26	-21	ksoftirqd/1	23:55:01	1
5628	99	59	34,17	cyclictest	26	-21	ksoftirqd/1	20:45:14	1
5628	99	59	31,23	cyclictest	26	-21	ksoftirqd/1	23:00:13	1
5624	99	59	38,16	cyclictest	14	-21	ksoftirqd/0	23:15:15	0
5624	99	59	34,19	cyclictest	14	-21	ksoftirqd/0	23:55:17	0
5624	99	59	34,19	cyclictest	14	-21	ksoftirqd/0	20:55:16	0
5628	99	58	38,10	cyclictest	26	-21	ksoftirqd/1	22:25:00	1
5628	99	58	37,12	cyclictest	26	-21	ksoftirqd/1	21:45:37	1
5628	99	58	35,17	cyclictest	26	-21	ksoftirqd/1	23:10:23	1
5628	99	58	34,18	cyclictest	26	-21	ksoftirqd/1	00:10:02	1
5628	99	58	34,17	cyclictest	26	-21	ksoftirqd/1	22:30:17	1
5628	99	58	32,18	cyclictest	26	-21	ksoftirqd/1	23:20:33	1
5628	99	58	31,21	cyclictest	3190	-21	cron	22:05:00	1
5628	99	58	17,36	cyclictest	24812	-21	idleruntime-cro	21:35:00	1
5624	99	58	38,15	cyclictest	14	-21	ksoftirqd/0	21:30:17	0
5624	99	58	37,16	cyclictest	14	-21	ksoftirqd/0	22:10:14	0
5624	99	58	37,15	cyclictest	14	-21	ksoftirqd/0	23:50:15	0
5624	99	58	35,18	cyclictest	14	-21	ksoftirqd/0	00:25:15	0
5624	99	58	31,23	cyclictest	14	-21	ksoftirqd/0	22:35:23	0
5624	99	58	31,20	cyclictest	14	-21	ksoftirqd/0	00:10:05	0
5628	99	57	36,16	cyclictest	26	-21	ksoftirqd/1	21:50:33	1
5628	99	57	35,17	cyclictest	26	-21	ksoftirqd/1	00:25:22	1
5628	99	57	33,18	cyclictest	26	-21	ksoftirqd/1	20:15:15	1
5628	99	57	33,17	cyclictest	26	-21	ksoftirqd/1	23:15:32	1
5628	99	57	31,18	cyclictest	26	-21	ksoftirqd/1	22:00:00	1
5624	99	57	9,43	cyclictest	0	-21	swapper/0	19:55:28	0
5624	99	57	9,42	cyclictest	0	-21	swapper/0	23:10:30	0
5624	99	57	43,9	cyclictest	14	-21	ksoftirqd/0	19:45:01	0
14916	2	57	7,44	sleep1	0	-21	swapper/1	22:35:30	1
5628	99	56	39,9	cyclictest	26	-21	ksoftirqd/1	21:30:00	1
5628	99	56	38,10	cyclictest	26	-21	ksoftirqd/1	19:40:22	1
5624	99	56	9,42	cyclictest	0	-21	swapper/0	19:50:19	0
5624	99	56	36,15	cyclictest	36	-21	kcompactd0	21:00:22	0
5624	99	56	36,15	cyclictest	14	-21	ksoftirqd/0	22:25:29	0
5624	99	56	35,16	cyclictest	14	-21	ksoftirqd/0	23:30:16	0
5624	99	56	34,16	cyclictest	14	-21	ksoftirqd/0	19:20:15	0
5624	99	56	33,18	cyclictest	14	-21	ksoftirqd/0	21:55:17	0
5624	99	56	27,12	cyclictest	14	-21	ksoftirqd/0	21:40:05	0
5624	99	56	26,12	cyclictest	14	-21	ksoftirqd/0	23:00:25	0
5628	99	55	38,10	cyclictest	26	-21	ksoftirqd/1	19:25:19	1
5624	99	55	7,27	cyclictest	31527	-21	sshd	23:21:22	0
5624	99	55	6,44	cyclictest	0	-21	swapper/0	20:45:20	0
5624	99	55	40,10	cyclictest	503	-21	snmpd	22:40:26	0
5624	99	55	36,15	cyclictest	14	-21	ksoftirqd/0	22:55:17	0
5624	99	55	36,15	cyclictest	14	-21	ksoftirqd/0	20:40:15	0
5624	99	55	14,16	cyclictest	4945	-21	aten2.4-expect	23:40:15	0
5624	99	54	35,13	cyclictest	19102	-21	sendmail-msp	00:20:00	0
5624	99	54	33,7	cyclictest	14	-21	ksoftirqd/0	21:30:00	0
5624	99	54	32,8	cyclictest	14	-21	ksoftirqd/0	22:20:01	0
5624	99	54	32,8	cyclictest	14	-21	ksoftirqd/0	19:15:02	0
5624	99	54	30,19	cyclictest	14	-21	ksoftirqd/0	19:30:17	0
5624	99	53	5,43	cyclictest	0	-21	swapper/0	00:08:53	0
5624	99	53	5,21	cyclictest	0	-21	swapper/0	00:03:10	0
5624	99	53	37,10	cyclictest	14	-21	ksoftirqd/0	22:45:18	0
5624	99	53	33,15	cyclictest	14	-21	ksoftirqd/0	21:45:16	0
5624	99	53	31,8	cyclictest	14	-21	ksoftirqd/0	00:25:01	0
5624	99	53	30,17	cyclictest	0	-21	swapper/0	20:35:14	0
5624	99	53	29,9	cyclictest	14	-21	ksoftirqd/0	21:20:10	0
5624	99	53	16,17	cyclictest	26576	-21	grep	20:05:36	0
5624	99	53	15,11	cyclictest	0	-21	swapper/0	22:55:01	0
5624	99	52	5,42	cyclictest	0	-21	swapper/0	20:54:06	0
5624	99	52	35,11	cyclictest	14	-21	ksoftirqd/0	20:25:19	0
5624	99	52	35,10	cyclictest	14	-21	ksoftirqd/0	19:10:18	0
5624	99	52	11,19	cyclictest	14	-21	ksoftirqd/0	23:50:01	0
5624	99	51	5,41	cyclictest	0	-21	swapper/0	19:45:25	0
5624	99	51	36,9	cyclictest	14	-21	ksoftirqd/0	20:15:25	0
5624	99	51	36,10	cyclictest	2557	-21	ntp_states	20:30:30	0
5624	99	51	35,9	cyclictest	14	-21	ksoftirqd/0	21:51:29	0
5624	99	51	25,19	cyclictest	24321	-21	http	00:35:00	0
5624	99	50	30,16	cyclictest	14	-21	ksoftirqd/0	22:00:20	0
5624	99	50	2,43	cyclictest	30808	-21	aten2.4-expect	20:20:15	0
5624	99	49	5,20	cyclictest	0	-21	swapper/0	20:05:00	0
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17