OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #6

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack3slot6.osadl.org (updated Tue Jun 09, 2026 12:44:59)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
16959	2	123	0,3	sleep0	17	1	rcuc/0	11:00:32	0
31169	99	113	7,86	cyclictest	0	-21	swapper/0	11:45:13	0
31605	2	110	0,7	chrt	31604	-21	sed	11:40:34	0
31169	99	104	7,19	cyclictest	0	-21	swapper/0	08:30:12	0
31008	2	104	20,39	sleep0	0	-21	swapper/0	07:09:48	0
31169	99	103	7,18	cyclictest	0	-21	swapper/0	10:40:14	0
31169	99	98	11,69	cyclictest	0	-21	swapper/0	08:40:13	0
31169	99	97	9,67	cyclictest	0	-21	swapper/0	07:25:10	0
31169	99	97	7,72	cyclictest	0	-21	swapper/0	10:20:16	0
31169	99	96	7,18	cyclictest	0	-21	swapper/0	07:10:12	0
31169	99	96	7,12	cyclictest	0	-21	swapper/0	07:35:12	0
31169	99	96	6,16	cyclictest	0	-21	swapper/0	07:55:13	0
31172	99	94	18,19	cyclictest	0	-21	swapper/1	12:30:10	1
31172	99	93	64,18	cyclictest	26	-21	ksoftirqd/1	07:20:22	1
31169	99	93	6,20	cyclictest	0	-21	swapper/0	12:25:13	0
31169	99	92	5,73	cyclictest	0	-21	swapper/0	11:50:15	0
31169	99	91	10,63	cyclictest	0	-21	swapper/0	12:10:17	0
31169	99	90	7,65	cyclictest	0	-21	swapper/0	09:55:12	0
31169	99	90	10,16	cyclictest	0	-21	swapper/0	10:15:10	0
31169	99	90	10,16	cyclictest	0	-21	swapper/0	08:45:16	0
31169	99	89	6,13	cyclictest	0	-21	swapper/0	12:15:12	0
31172	99	88	60,19	cyclictest	26	-21	ksoftirqd/1	07:40:12	1
31169	99	88	6,19	cyclictest	0	-21	swapper/0	10:55:12	0
31169	99	88	11,16	cyclictest	0	-21	swapper/0	10:30:11	0
31169	99	88	10,18	cyclictest	0	-21	swapper/0	12:00:14	0
31169	99	88	10,18	cyclictest	0	-21	swapper/0	12:00:14	0
31169	99	87	8,60	cyclictest	0	-21	swapper/0	08:25:13	0
31169	99	87	6,15	cyclictest	0	-21	swapper/0	11:25:14	0
31169	99	86	10,16	cyclictest	0	-21	swapper/0	09:50:12	0
31169	99	85	6,17	cyclictest	0	-21	swapper/0	08:50:15	0
31169	99	85	3,75	cyclictest	2759	-21	latency_hist	07:20:01	0
31169	99	85	3,74	cyclictest	23843	-21	diskstats	11:20:24	0
12753	2	84	0,6	sleep1	12756	-21	needreboot	12:20:27	1
31169	99	83	7,17	cyclictest	0	-21	swapper/0	11:05:13	0
31169	99	83	6,17	cyclictest	0	-21	swapper/0	08:35:11	0
31169	99	83	10,14	cyclictest	0	-21	swapper/0	12:30:11	0
31169	99	82	9,17	cyclictest	0	-21	swapper/0	08:05:24	0
31169	99	82	7,17	cyclictest	0	-21	swapper/0	10:25:11	0
31169	99	82	7,17	cyclictest	0	-21	swapper/0	09:20:12	0
31169	99	82	7,14	cyclictest	0	-21	swapper/0	08:15:15	0
31169	99	82	6,19	cyclictest	0	-21	swapper/0	10:35:17	0
31169	99	82	6,18	cyclictest	0	-21	swapper/0	09:35:14	0
31169	99	82	6,15	cyclictest	0	-21	swapper/0	09:00:11	0
31169	99	81	7,18	cyclictest	0	-21	swapper/0	11:15:13	0
31169	99	81	7,14	cyclictest	0	-21	swapper/0	09:30:11	0
31169	99	81	7,14	cyclictest	0	-21	swapper/0	08:10:09	0
31169	99	81	7,13	cyclictest	0	-21	swapper/0	11:10:24	0
31169	99	81	7,13	cyclictest	0	-21	swapper/0	09:45:15	0
31169	99	81	6,13	cyclictest	0	-21	swapper/0	12:05:11	0
31169	99	81	6,13	cyclictest	0	-21	swapper/0	07:50:14	0
31169	99	81	11,15	cyclictest	0	-21	swapper/0	12:35:15	0
31169	99	80	8,13	cyclictest	0	-21	swapper/0	10:10:22	0
31169	99	80	7,14	cyclictest	0	-21	swapper/0	11:55:17	0
31169	99	80	7,14	cyclictest	0	-21	swapper/0	07:45:12	0
31169	99	80	7,13	cyclictest	0	-21	swapper/0	07:30:13	0
31169	99	80	6,14	cyclictest	0	-21	swapper/0	09:05:11	0
31169	99	80	6,13	cyclictest	0	-21	swapper/0	11:30:12	0
31169	99	80	5,14	cyclictest	0	-21	swapper/0	10:00:13	0
31172	99	79	50,18	cyclictest	26	-21	ksoftirqd/1	11:10:22	1
31169	99	79	8,18	cyclictest	0	-21	swapper/0	10:45:11	0
31169	99	79	6,17	cyclictest	0	-21	swapper/0	07:40:14	0
31169	99	79	6,13	cyclictest	0	-21	swapper/0	08:20:12	0
31169	99	79	6,11	cyclictest	0	-21	swapper/0	10:05:15	0
31169	99	79	6,11	cyclictest	0	-21	swapper/0	08:00:11	0
31169	99	79	18,22	cyclictest	457	-21	dbus-daemon	11:39:01	0
31169	99	78	7,11	cyclictest	0	-21	swapper/0	09:40:12	0
31169	99	78	6,12	cyclictest	0	-21	swapper/0	07:20:23	0
31169	99	77	7,14	cyclictest	0	-21	swapper/0	08:55:14	0
31169	99	75	5,65	cyclictest	0	-21	swapper/0	09:26:28	0
31169	99	74	7,14	cyclictest	0	-21	swapper/0	10:50:14	0
31172	99	73	42,20	cyclictest	26	-21	ksoftirqd/1	08:45:13	1
31169	99	72	6,15	cyclictest	0	-21	swapper/0	12:20:13	0
31172	99	71	39,25	cyclictest	26	-21	ksoftirqd/1	07:38:46	1
31169	99	71	5,19	cyclictest	11474	-21	apt-get	09:15:15	0
31172	99	70	42,18	cyclictest	26	-21	ksoftirqd/1	10:50:13	1
29404	2	70	26,33	sleep1	0	-21	swapper/1	07:05:05	1
31169	99	69	14,11	cyclictest	9900	-21	aten2.4-expect	09:10:18	0
31172	99	67	37,18	cyclictest	26	-21	ksoftirqd/1	10:04:16	1
31172	99	67	33,26	cyclictest	457	-21	dbus-daemon	09:50:00	1
31172	99	67	32,26	cyclictest	26	-21	ksoftirqd/1	09:35:13	1
31172	99	66	39,17	cyclictest	26	-21	ksoftirqd/1	12:35:13	1
31172	99	66	38,21	cyclictest	31161	-21	cyclictest	11:50:12	1
31172	99	66	21,39	cyclictest	503	-21	snmpd	07:49:02	1
31172	99	65	6,49	cyclictest	13236	-21	apt-get	09:20:12	1
31172	99	64	43,13	cyclictest	26	-21	ksoftirqd/1	09:05:19	1
31172	99	63	35,20	cyclictest	31161	-21	cyclictest	12:10:14	1
31172	99	63	27,26	cyclictest	26	-21	ksoftirqd/1	10:15:12	1
31172	99	62	43,12	cyclictest	26	-21	ksoftirqd/1	08:40:19	1
31172	99	62	42,12	cyclictest	26	-21	ksoftirqd/1	11:25:01	1
31172	99	62	30,26	cyclictest	26	-21	ksoftirqd/1	08:22:06	1
31172	99	62	30,22	cyclictest	503	-21	snmpd	08:10:28	1
31172	99	61	9,41	cyclictest	0	-21	swapper/1	09:25:16	1
31172	99	61	5,16	cyclictest	11474	-21	apt-get	09:15:12	1
31172	99	61	41,12	cyclictest	26	-21	ksoftirqd/1	10:25:21	1
31172	99	61	38,9	cyclictest	26	-21	ksoftirqd/1	11:05:33	1
31172	99	61	32,10	cyclictest	26	-21	ksoftirqd/1	08:35:15	1
31172	99	61	31,22	cyclictest	457	-21	dbus-daemon	09:55:00	1
31172	99	60	43,10	cyclictest	26	-21	ksoftirqd/1	10:10:04	1
31172	99	60	43,10	cyclictest	26	-21	ksoftirqd/1	08:55:26	1
31172	99	60	42,11	cyclictest	26	-21	ksoftirqd/1	12:25:31	1
31172	99	60	42,11	cyclictest	26	-21	ksoftirqd/1	11:25:34	1
31172	99	60	42,11	cyclictest	26	-21	ksoftirqd/1	10:55:33	1
31172	99	60	42,11	cyclictest	26	-21	ksoftirqd/1	07:30:19	1
31172	99	60	41,12	cyclictest	26	-21	ksoftirqd/1	12:00:34	1
31172	99	60	41,12	cyclictest	26	-21	ksoftirqd/1	12:00:34	1
31172	99	60	41,12	cyclictest	26	-21	ksoftirqd/1	09:30:25	1
31172	99	60	41,11	cyclictest	26	-21	ksoftirqd/1	11:30:21	1
31172	99	60	40,13	cyclictest	26	-21	ksoftirqd/1	10:35:28	1
31172	99	60	36,17	cyclictest	26	-21	ksoftirqd/1	11:35:16	1
31172	99	60	13,11	cyclictest	0	-21	swapper/1	10:34:25	1
31172	99	60	12,42	cyclictest	0	-21	swapper/1	07:28:26	1
31172	99	59	42,11	cyclictest	503	-21	snmpd	08:34:11	1
31172	99	59	42,10	cyclictest	26	-21	ksoftirqd/1	11:55:26	1
31172	99	59	42,10	cyclictest	26	-21	ksoftirqd/1	09:40:31	1
31172	99	59	42,10	cyclictest	26	-21	ksoftirqd/1	08:50:26	1
31172	99	59	41,11	cyclictest	26	-21	ksoftirqd/1	11:45:27	1
31172	99	59	41,11	cyclictest	26	-21	ksoftirqd/1	11:15:18	1
31172	99	59	41,11	cyclictest	26	-21	ksoftirqd/1	10:05:21	1
31172	99	59	41,11	cyclictest	26	-21	ksoftirqd/1	08:05:42	1
31172	99	59	41,11	cyclictest	26	-21	ksoftirqd/1	08:00:16	1
31172	99	59	40,12	cyclictest	26	-21	ksoftirqd/1	12:15:26	1
31172	99	59	40,11	cyclictest	11028	-21	aten2.4_r3power	10:45:16	1
31172	99	59	39,13	cyclictest	26	-21	ksoftirqd/1	12:09:54	1
31172	99	59	38,13	cyclictest	26	-21	ksoftirqd/1	10:20:27	1
31172	99	59	35,9	cyclictest	26	-21	ksoftirqd/1	10:40:18	1
31172	99	58	42,10	cyclictest	26	-21	ksoftirqd/1	11:40:20	1
31172	99	58	41,11	cyclictest	26	-21	ksoftirqd/1	11:00:20	1
31172	99	58	41,10	cyclictest	26	-21	ksoftirqd/1	09:10:17	1
31172	99	58	40,12	cyclictest	0	-21	swapper/1	07:15:04	1
31172	99	58	40,11	cyclictest	26	-21	ksoftirqd/1	09:55:19	1
31172	99	58	40,11	cyclictest	26	-21	ksoftirqd/1	09:00:33	1
31172	99	58	40,11	cyclictest	26	-21	ksoftirqd/1	08:25:18	1
31172	99	58	40,11	cyclictest	26	-21	ksoftirqd/1	08:15:21	1
31172	99	58	40,10	cyclictest	26	-21	ksoftirqd/1	07:10:18	1
31172	99	58	18,31	cyclictest	26	-21	ksoftirqd/1	07:50:12	1
31172	99	57	35,16	cyclictest	26	-21	ksoftirqd/1	07:55:28	1
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	3
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
none	08:08:41	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17