OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #c, slot #4

Intel(R) Celeron(R) CPU N3350 @ 1.10GHz, Linux 5.13.0-27-generic (Profile)

Latency plot of system in rack #c, slot #4

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackcslot4.osadl.org (updated Tue Jan 18, 2022 12:43:48)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
7053	99	31	2,18	cyclictest	7555	-21	lsb_release	10:50:00	1
7052	99	31	15,10	cyclictest	14863	-21	apt-get	11:15:16	0
7053	99	29	0,19	cyclictest	13336	-21	cat	11:10:01	1
7053	99	28	0,18	cyclictest	16219	-21	wc	11:20:01	1
7053	99	27	18,5	cyclictest	24728	-21	apt-get	08:05:20	1
7053	99	27	1,2	cyclictest	11	1	rcu_preempt	12:35:07	1
7053	99	27	1,22	cyclictest	26962	-21	apt-get	11:55:25	1
7053	99	26	2,17	cyclictest	0	-21	swapper/1	09:59:59	1
7053	99	25	14,7	cyclictest	15328	-21	apt-get	09:25:18	1
7053	99	25	13,7	cyclictest	28545	-21	apt-get	10:10:19	1
7053	99	25	0,17	cyclictest	0	-21	swapper/1	12:05:00	1
7052	99	25	3,15	cyclictest	20916	-21	apt-get	11:35:18	0
7053	99	24	2,15	cyclictest	29856	-21	apt-esm-hook	12:05:20	1
7052	99	24	1,17	cyclictest	25227	-21	apt-get	11:50:19	0
7053	99	23	2,7	cyclictest	9584	-21	apt-get	09:05:17	1
7053	99	23	2,14	cyclictest	25238	-21	apt-esm-hook	11:50:19	1
7053	99	23	15,5	cyclictest	3375	-21	apt-get	10:35:19	1
7053	99	23	10,9	cyclictest	7585	-21	apt-get	07:10:18	1
7053	99	23	10,8	cyclictest	8150	-21	apt-get	09:00:19	1
7052	99	23	3,15	cyclictest	6701	-21	apt-esm-hook	08:55:17	0
7052	99	23	2,15	cyclictest	28416	-21	apt-get	12:00:17	0
7052	99	23	2,14	cyclictest	1772	-21	apt-get	12:20:16	0
7052	99	23	2,14	cyclictest	10791	-21	apt-esm-hook	07:20:17	0
7053	99	22	3,8	cyclictest	21374	-21	apt-get	09:45:18	1
7053	99	22	3,13	cyclictest	31485	-21	apt-esm-hook	10:20:18	1
7053	99	22	3,13	cyclictest	29052	-21	apt-esm-hook	08:20:17	1
7053	99	22	2,14	cyclictest	6690	-21	apt-get	08:55:17	1
7053	99	22	2,14	cyclictest	32703	-21	apt-get	12:15:18	1
7053	99	22	2,14	cyclictest	30479	-21	apt-esm-hook	08:25:19	1
7053	99	22	2,14	cyclictest	20112	-21	apt-get	07:50:18	1
7053	99	22	2,14	cyclictest	19958	-21	apt-esm-hook	09:40:17	1
7053	99	22	2,14	cyclictest	13435	-21	apt-get	11:10:17	1
7053	99	22	2,13	cyclictest	7705	-21	apt-esm-hook	10:50:19	1
7053	99	22	2,13	cyclictest	16318	-21	apt-get	11:20:16	1
7053	99	22	15,4	cyclictest	17051	-40	apt-check	09:30:06	1
7053	99	22	1,18	cyclictest	16473	-21	munin-run	07:40:01	1
7053	99	22	10,8	cyclictest	3830	-21	apt-get	08:45:18	1
7052	99	22	3,12	cyclictest	30468	-21	apt-get	08:25:18	0
7052	99	22	2,14	cyclictest	7694	-21	apt-get	10:50:18	0
7052	99	22	2,14	cyclictest	17076	-21	apt-esm-hook	09:30:19	0
7052	99	22	2,14	cyclictest	12220	-21	apt-esm-hook	07:25:18	0
7052	99	22	2,13	cyclictest	3841	-21	apt-esm-hook	08:45:18	0
7052	99	22	2,13	cyclictest	3204	-21	apt-get	12:25:16	0
7052	99	22	2,13	cyclictest	2413	-21	apt-esm-hook	08:40:17	0
7052	99	22	2,13	cyclictest	17910	-21	apt-get	07:45:14	0
7052	99	22	2,13	cyclictest	13446	-21	apt-esm-hook	11:10:16	0
7052	99	22	1,15	cyclictest	22367	-21	apt-get	11:40:18	0
7053	99	21	3,13	cyclictest	27584	-21	apt-get	08:15:18	1
7053	99	21	2,14	cyclictest	19486	-21	apt-get	11:30:20	1
7053	99	21	2,14	cyclictest	13675	-21	apt-esm-hook	07:30:19	1
7053	99	21	2,14	cyclictest	10575	-21	apt-get	11:00:16	1
7053	99	21	2,13	cyclictest	31285	-21	apt-esm-hook	12:10:18	1
7053	99	21	2,13	cyclictest	21847	-21	apt-get	07:55:18	1
7053	99	21	2,13	cyclictest	11025	-21	apt-esm-hook	09:10:19	1
7053	99	21	2,13	cyclictest	10780	-21	apt-get	07:20:18	1
7053	99	21	1,3	cyclictest	23692	-21	latency_hist	11:45:00	1
7053	99	21	1,17	cyclictest	15191	-21	lsb_release	09:25:00	1
7052	99	21	3,12	cyclictest	31904	-21	apt-get	08:30:19	0
7052	99	21	3,12	cyclictest	27584	-21	apt-get	08:15:18	0
7052	99	21	2,13	cyclictest	9134	-21	apt-esm-hook	10:55:18	0
7052	99	21	2,13	cyclictest	4633	-21	apt-get	12:30:18	0
7052	99	21	2,13	cyclictest	29845	-21	apt-get	12:05:20	0
7052	99	21	2,13	cyclictest	28545	-21	apt-get	10:10:19	0
7052	99	21	2,13	cyclictest	24244	-21	apt-esm-hook	09:55:21	0
7052	99	21	2,13	cyclictest	23298	-21	apt-get	08:00:17	0
7052	99	21	2,13	cyclictest	1943	-21	apt-get	10:30:19	0
7052	99	21	2,13	cyclictest	19026	-21	apt-get	11:30:15	0
7052	99	21	2,13	cyclictest	10586	-21	apt-esm-hook	11:00:18	0
7052	99	21	1,14	cyclictest	447	-21	apt-get	10:25:15	0
7052	99	21	1,14	cyclictest	12442	-21	apt-get	09:15:17	0
7052	99	21	1,13	cyclictest	21858	-21	apt-esm-hook	07:55:19	0
7053	99	20	7,8	cyclictest	2402	-21	apt-get	08:40:17	1
7053	99	20	5,13	cyclictest	0	-21	swapper/1	10:35:00	1
7053	99	20	2,16	cyclictest	29972	-21	apt-get	10:15:18	1
7053	99	20	2,13	cyclictest	26157	-21	apt-get	08:10:18	1
7053	99	20	2,13	cyclictest	23309	-21	apt-esm-hook	08:00:19	1
7053	99	20	2,12	cyclictest	5270	-21	apt-esm-hook	08:50:19	1
7053	99	20	2,12	cyclictest	4645	-21	apt-esm-hook	12:30:17	1
7053	99	20	2,12	cyclictest	22817	-21	apt-esm-hook	09:50:19	1
7053	99	20	2,12	cyclictest	20927	-21	apt-esm-hook	11:35:18	1
7053	99	20	2,12	cyclictest	17747	-21	apt-get	11:25:16	1
7053	99	20	15,3	cyclictest	9311	-40	apt-check	07:15:07	1
7053	99	20	0,3	cyclictest	31904	-21	apt-get	08:30:19	1
7053	99	20	0,3	cyclictest	19961	-1	kworker/1:0H	10:55:16	1
7052	99	20	9,7	cyclictest	25685	-21	apt-get	10:00:18	0
7052	99	20	8,8	cyclictest	6255	-21	apt-get	10:45:17	0
7052	99	20	2,13	cyclictest	3375	-21	apt-get	10:35:20	0
7052	99	20	2,13	cyclictest	16635	-21	apt-get	07:40:19	0
7052	99	20	2,13	cyclictest	11014	-21	apt-get	09:10:19	0
7052	99	20	2,12	cyclictest	9595	-21	apt-esm-hook	09:05:19	0
7052	99	20	2,12	cyclictest	5259	-21	apt-get	08:50:19	0
7052	99	20	2,12	cyclictest	4836	-21	apt-esm-hook	10:40:18	0
7052	99	20	2,12	cyclictest	18507	-21	apt-esm-hook	09:35:20	0
7052	99	20	2,12	cyclictest	12018	-21	apt-esm-hook	11:05:19	0
7052	99	20	0,17	cyclictest	20697	-21	pmu-power	09:40:26	0
7053	99	19	4,13	cyclictest	0	-21	swapper/1	10:10:00	1
7053	99	19	2,2	cyclictest	17908	-21	dump-pmu-power	07:45:00	1
7053	99	19	2,12	cyclictest	447	-21	apt-get	10:25:17	1
7053	99	19	2,12	cyclictest	23806	-21	apt-esm-hook	11:45:17	1
7053	99	19	2,12	cyclictest	18496	-21	apt-get	09:35:20	1
7053	99	19	2,12	cyclictest	1783	-21	apt-esm-hook	12:20:17	1
7053	99	19	1,13	cyclictest	12453	-21	apt-esm-hook	09:15:18	1
7053	99	19	1,12	cyclictest	18383	-21	apt-esm-hook	07:45:18	1
7053	99	19	0,17	cyclictest	19	-21	ksoftirqd/1	08:40:00	1
7053	99	19	0,17	cyclictest	13557	-21	cat	07:30:00	1
7052	99	19	4,9	cyclictest	6374	-21	apt-get	12:35:22	0
7052	99	19	2,12	cyclictest	9335	-21	apt-esm-hook	07:15:18	0
7052	99	19	2,12	cyclictest	925	-21	apt-get	08:35:19	0
7052	99	19	2,12	cyclictest	8161	-21	apt-esm-hook	09:00:19	0
7052	99	19	2,12	cyclictest	7597	-21	apt-esm-hook	07:10:18	0
7052	99	19	2,12	cyclictest	31274	-21	apt-get	12:10:19	0
7052	99	19	2,12	cyclictest	26168	-21	apt-esm-hook	08:10:18	0
7052	99	19	2,12	cyclictest	21385	-21	apt-esm-hook	09:45:17	0
7052	99	19	2,12	cyclictest	13899	-21	apt-get	09:20:16	0
7052	99	19	2,10	cyclictest	31474	-21	apt-get	10:20:17	0
7052	99	19	1,13	cyclictest	26976	-21	apt-esm-hook	11:55:24	0
7053	99	18	7,2	cyclictest	11	1	rcu_preempt	12:25:21	1
7053	99	18	3,8	cyclictest	4825	-21	apt-get	10:40:17	1
7053	99	18	1,12	cyclictest	25696	-21	apt-esm-hook	10:00:18	1
7052	99	18	4,9	cyclictest	13664	-21	apt-get	07:30:19	0
7052	99	18	2,11	cyclictest	29983	-21	apt-esm-hook	10:15:18	0
7052	99	18	1,13	cyclictest	27137	-21	apt-esm-json-ho	10:05:20	0
7052	99	18	1,13	cyclictest	16127	-21	snmp_o5powerctl	07:35:35	0
7052	99	18	1,12	cyclictest	32703	-21	apt-get	12:15:17	0
7052	99	18	1,12	cyclictest	29041	-21	apt-get	08:20:16	0
7052	99	18	1,12	cyclictest	24739	-21	apt-esm-hook	08:05:20	0
7052	99	18	1,12	cyclictest	23795	-21	apt-get	11:45:18	0
7052	99	18	1,12	cyclictest	20123	-21	apt-esm-hook	07:50:19	0
7052	99	18	1,12	cyclictest	16330	-21	apt-esm-hook	11:20:17	0
7052	99	18	1,12	cyclictest	15339	-21	apt-esm-hook	09:25:18	0
7052	99	17	1,11	cyclictest	17758	-21	apt-esm-hook	11:25:16	0
7052	99	16	1,12	cyclictest	23743	-21	snmp_o5powerctl	09:50:31	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17