OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot6.osadl.org (updated Tue Sep 08, 2026 12:45:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
20480	2	118	34,66	sleep0	0	-21	swapper/0	07:07:20	0
20917	99	114	83,18	cyclictest	26	-21	ksoftirqd/1	07:45:12	1
20915	99	112	14,78	cyclictest	0	-21	swapper/0	09:45:25	0
32204	2	111	0,6	sleep0	31781	-21	diskmemload	09:10:18	0
20917	99	111	81,19	cyclictest	26	-21	ksoftirqd/1	12:00:15	1
20917	99	109	80,19	cyclictest	26	-21	ksoftirqd/1	10:55:12	1
20915	99	109	10,78	cyclictest	0	-21	swapper/0	08:00:12	0
20915	99	108	13,76	cyclictest	0	-21	swapper/0	11:00:14	0
20915	99	108	13,76	cyclictest	0	-21	swapper/0	11:00:14	0
20917	99	107	79,17	cyclictest	26	-21	ksoftirqd/1	12:25:14	1
20917	99	107	75,18	cyclictest	26	-21	ksoftirqd/1	11:25:12	1
20917	99	107	75,18	cyclictest	26	-21	ksoftirqd/1	09:05:13	1
20915	99	107	16,68	cyclictest	0	-21	swapper/0	07:25:22	0
20915	99	106	12,71	cyclictest	0	-21	swapper/0	08:15:11	0
20915	99	104	12,69	cyclictest	0	-21	swapper/0	10:10:16	0
20917	99	102	71,21	cyclictest	26	-21	ksoftirqd/1	12:10:13	1
20917	99	102	70,21	cyclictest	26	-21	ksoftirqd/1	09:10:12	1
20915	99	101	13,19	cyclictest	0	-21	swapper/0	09:35:13	0
20915	99	101	11,67	cyclictest	0	-21	swapper/0	08:45:14	0
20915	99	100	42,41	cyclictest	14	-21	ksoftirqd/0	09:20:14	0
20915	99	100	11,66	cyclictest	0	-21	swapper/0	07:45:15	0
20915	99	99	13,65	cyclictest	0	-21	swapper/0	10:15:27	0
20917	99	97	67,18	cyclictest	26	-21	ksoftirqd/1	10:20:11	1
20917	99	97	67,18	cyclictest	26	-21	ksoftirqd/1	10:20:11	1
20915	99	97	7,80	cyclictest	18995	-21	apt-get	08:33:40	0
20915	99	97	32,45	cyclictest	14	-21	ksoftirqd/0	11:50:11	0
20915	99	97	13,22	cyclictest	0	-21	swapper/0	10:35:16	0
20915	99	96	14,65	cyclictest	0	-21	swapper/0	08:05:12	0
20915	99	96	11,20	cyclictest	0	-21	swapper/0	09:50:23	0
20915	99	96	10,24	cyclictest	0	-21	swapper/0	07:55:14	0
20915	99	95	12,22	cyclictest	0	-21	swapper/0	09:30:15	0
20915	99	95	10,22	cyclictest	0	-21	swapper/0	07:10:12	0
20915	99	94	8,22	cyclictest	0	-21	swapper/0	07:50:13	0
20915	99	93	8,22	cyclictest	0	-21	swapper/0	11:10:12	0
20915	99	93	23,55	cyclictest	14	-21	ksoftirqd/0	10:00:13	0
20915	99	93	12,62	cyclictest	0	-21	swapper/0	12:00:12	0
20915	99	93	12,54	cyclictest	0	-21	swapper/0	10:50:13	0
20915	99	93	11,21	cyclictest	0	-21	swapper/0	11:40:25	0
20917	99	92	60,20	cyclictest	26	-21	ksoftirqd/1	12:35:15	1
20917	99	92	60,20	cyclictest	26	-21	ksoftirqd/1	12:35:15	1
20915	99	92	9,22	cyclictest	0	-21	swapper/0	07:30:18	0
20915	99	92	9,21	cyclictest	0	-21	swapper/0	09:55:15	0
20915	99	92	6,25	cyclictest	15319	-21	apt-get	11:25:12	0
20915	99	92	11,22	cyclictest	0	-21	swapper/0	08:55:23	0
20915	99	92	10,22	cyclictest	0	-21	swapper/0	12:20:13	0
20915	99	92	10,22	cyclictest	0	-21	swapper/0	12:20:13	0
20915	99	92	10,20	cyclictest	0	-21	swapper/0	08:25:16	0
20915	99	91	8,23	cyclictest	0	-21	swapper/0	07:35:14	0
20915	99	91	8,23	cyclictest	0	-21	swapper/0	07:35:14	0
20917	99	90	57,21	cyclictest	26	-21	ksoftirqd/1	10:35:15	1
20915	99	90	9,22	cyclictest	0	-21	swapper/0	09:40:14	0
20915	99	90	8,18	cyclictest	0	-21	swapper/0	11:05:14	0
20915	99	90	7,23	cyclictest	0	-21	swapper/0	09:05:15	0
20915	99	90	13,22	cyclictest	0	-21	swapper/0	08:10:12	0
20451	2	90	29,48	sleep1	0	-21	swapper/1	07:07:01	1
20915	99	89	9,21	cyclictest	0	-21	swapper/0	10:40:16	0
20915	99	89	9,20	cyclictest	0	-21	swapper/0	12:10:14	0
20915	99	89	9,20	cyclictest	0	-21	swapper/0	11:15:13	0
20915	99	89	8,22	cyclictest	0	-21	swapper/0	10:55:15	0
20915	99	89	8,21	cyclictest	0	-21	swapper/0	09:25:14	0
20915	99	89	12,21	cyclictest	0	-21	swapper/0	09:00:11	0
20915	99	89	10,18	cyclictest	0	-21	swapper/0	12:35:13	0
20915	99	89	10,18	cyclictest	0	-21	swapper/0	12:35:13	0
20915	99	88	8,25	cyclictest	0	-21	swapper/0	10:05:13	0
20917	99	87	55,19	cyclictest	26	-21	ksoftirqd/1	10:40:14	1
20915	99	87	12,65	cyclictest	0	-21	swapper/0	08:35:14	0
20917	99	86	9,51	cyclictest	562	-21	runrttasks	10:25:12	1
20917	99	86	58,17	cyclictest	26	-21	ksoftirqd/1	08:55:22	1
20917	99	86	53,22	cyclictest	26	-21	ksoftirqd/1	09:35:15	1
20917	99	86	49,24	cyclictest	26	-21	ksoftirqd/1	11:35:15	1
20917	99	85	59,17	cyclictest	26	-21	ksoftirqd/1	08:35:13	1
20915	99	85	7,24	cyclictest	13582	-21	apt-get	11:20:14	0
20915	99	85	10,23	cyclictest	0	-21	swapper/0	11:30:14	0
20915	99	85	10,23	cyclictest	0	-21	swapper/0	08:20:15	0
20917	99	84	54,20	cyclictest	26	-21	ksoftirqd/1	09:55:12	1
20917	99	84	49,23	cyclictest	26	-21	ksoftirqd/1	09:40:15	1
20915	99	84	9,19	cyclictest	0	-21	swapper/0	11:35:14	0
20915	99	84	8,16	cyclictest	0	-21	swapper/0	10:20:12	0
20915	99	84	8,16	cyclictest	0	-21	swapper/0	10:20:12	0
20917	99	83	52,20	cyclictest	26	-21	ksoftirqd/1	09:50:25	1
20917	99	83	47,25	cyclictest	26	-21	ksoftirqd/1	10:05:13	1
20917	99	83	45,26	cyclictest	26	-21	ksoftirqd/1	08:40:14	1
20915	99	83	11,62	cyclictest	0	-21	swapper/0	07:20:16	0
20915	99	83	11,62	cyclictest	0	-21	swapper/0	07:20:16	0
20917	99	82	49,22	cyclictest	26	-21	ksoftirqd/1	12:15:14	1
20917	99	82	43,27	cyclictest	26	-21	ksoftirqd/1	07:20:15	1
20917	99	82	43,27	cyclictest	26	-21	ksoftirqd/1	07:20:15	1
20917	99	82	37,32	cyclictest	26	-21	ksoftirqd/1	09:20:12	1
20915	99	82	7,18	cyclictest	26712	-21	apt-get	10:25:13	0
20917	99	81	8,59	cyclictest	32202	-31	find	07:40:13	1
20917	99	81	50,20	cyclictest	26	-21	ksoftirqd/1	08:00:13	1
20917	99	81	38,32	cyclictest	26	-21	ksoftirqd/1	11:20:14	1
20915	99	81	7,23	cyclictest	28457	-21	apt-get	10:30:16	0
20915	99	81	11,60	cyclictest	0	-21	swapper/0	08:40:17	0
20917	99	80	39,31	cyclictest	26	-21	ksoftirqd/1	11:50:13	1
20917	99	80	14,33	cyclictest	0	-21	swapper/1	11:55:13	1
20917	99	80	14,33	cyclictest	0	-21	swapper/1	11:55:13	1
20915	99	80	24,48	cyclictest	14	-21	ksoftirqd/0	12:25:13	0
20917	99	79	40,28	cyclictest	26	-21	ksoftirqd/1	12:30:13	1
20917	99	78	39,30	cyclictest	26	-21	ksoftirqd/1	08:05:14	1
20915	99	78	7,20	cyclictest	5977	-21	apt-get	12:30:13	0
20915	99	78	3,36	cyclictest	65	-21	kswapd0	07:40:15	0
20917	99	77	47,21	cyclictest	26	-21	ksoftirqd/1	07:15:13	1
20917	99	77	12,53	cyclictest	0	-21	swapper/1	09:15:14	1
20915	99	77	9,20	cyclictest	29630	-21	apt-get	12:05:13	0
20915	99	77	8,23	cyclictest	0	-21	swapper/0	07:15:16	0
20915	99	77	11,56	cyclictest	0	-21	swapper/0	12:15:12	0
20917	99	76	35,30	cyclictest	26	-21	ksoftirqd/1	10:10:17	1
20917	99	76	31,36	cyclictest	26	-21	ksoftirqd/1	08:10:15	1
20915	99	76	6,22	cyclictest	24621	-21	apt-get	08:50:14	0
20917	99	75	37,28	cyclictest	26	-21	ksoftirqd/1	12:20:11	1
20917	99	75	37,28	cyclictest	26	-21	ksoftirqd/1	12:20:10	1
20917	99	75	3,37	cyclictest	26	-21	ksoftirqd/1	12:05:12	1
20915	99	75	7,19	cyclictest	1264	-21	apt-get	09:15:14	0
20915	99	75	14,16	cyclictest	26228	-21	aten2.4-expect	11:55:16	0
20915	99	75	14,16	cyclictest	26228	-21	aten2.4-expect	11:55:16	0
20917	99	74	4,30	cyclictest	26	-21	ksoftirqd/1	10:50:15	1
20915	99	73	5,19	cyclictest	1314	-21	apt-get	10:45:13	0
20917	99	72	25,38	cyclictest	26	-21	ksoftirqd/1	10:45:14	1
20917	99	71	17,45	cyclictest	26	-21	ksoftirqd/1	07:30:17	1
20917	99	70	15,43	cyclictest	26	-21	ksoftirqd/1	08:50:11	1
20915	99	70	6,19	cyclictest	22656	-21	apt-get	11:45:12	0
20917	99	69	9,20	cyclictest	0	-21	swapper/1	11:45:13	1
20917	99	69	24,32	cyclictest	26	-21	ksoftirqd/1	09:45:27	1
20917	99	69	19,18	cyclictest	15	1	rcu_preempt	11:10:11	1
20917	99	69	13,45	cyclictest	26	-21	ksoftirqd/1	07:10:14	1
20917	99	68	3,22	cyclictest	26	-21	ksoftirqd/1	08:25:14	1
20917	99	68	23,36	cyclictest	26	-21	ksoftirqd/1	08:45:12	1
20917	99	68	17,39	cyclictest	26	-21	ksoftirqd/1	07:25:24	1
20917	99	67	18,40	cyclictest	26	-21	ksoftirqd/1	09:25:12	1
20917	99	67	18,40	cyclictest	26	-21	ksoftirqd/1	07:50:10	1
20917	99	66	31,25	cyclictest	0	-21	swapper/1	08:15:12	1
20917	99	66	12,40	cyclictest	20916	-21	apt-get	11:40:15	1
20917	99	65	14,32	cyclictest	0	-21	swapper/1	10:30:17	1
20917	99	64	6,25	cyclictest	26	-21	ksoftirqd/1	08:33:42	1
20917	99	64	20,30	cyclictest	26	-21	ksoftirqd/1	11:30:14	1
20917	99	64	14,39	cyclictest	26	-21	ksoftirqd/1	10:15:25	1
20917	99	64	13,39	cyclictest	26	-21	ksoftirqd/1	08:20:14	1
20917	99	63	25,29	cyclictest	26	-21	ksoftirqd/1	07:35:11	1
20917	99	63	25,29	cyclictest	26	-21	ksoftirqd/1	07:35:11	1
20917	99	63	25,28	cyclictest	0	-21	swapper/1	09:30:13	1
20917	99	63	10,39	cyclictest	26	-21	ksoftirqd/1	11:00:15	1
20917	99	63	10,39	cyclictest	26	-21	ksoftirqd/1	11:00:15	1
20917	99	62	17,34	cyclictest	0	-21	swapper/1	11:15:12	1
20917	99	62	15,31	cyclictest	26	-21	ksoftirqd/1	07:55:13	1
20917	99	60	16,32	cyclictest	0	-21	swapper/1	09:00:13	1
20917	99	55	37,11	cyclictest	26	-21	ksoftirqd/1	10:05:00	1
20917	99	54	16,18	cyclictest	15	1	rcu_preempt	11:05:12	1
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17