OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

x86 Intel Pentium N4200 @1100 MHz, Linux 5.9.1-rt18 (Profile)

Latency plot of shadow in rack #c, slot #4

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackcslot4s.osadl.org (updated Wed Jul 06, 2022 12:44:31)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
20470	2	283	180,68	sleep2	0	-21	swapper/2	07:05:01	2
22187	2	269	203,33	sleep3	0	-21	swapper/3	07:08:05	3
21943	2	246	188,45	sleep1	0	-21	swapper/1	07:05:54	1
22267	2	245	194,37	sleep0	0	-21	swapper/0	07:08:48	0
26926	2	143	0,2	sleep1	0	-21	swapper/1	09:40:19	1
14340	2	68	0,1	chrt	14339	-21	ntp_states	10:25:19	1
29681	2	52	0,3	sleep2	29682	-21	grep	11:00:20	2
26877	2	49	0,3	sleep1	0	-21	swapper/1	08:30:15	1
25587	2	48	0,4	sleep0	25589	-21	cron	12:05:00	0
17091	2	38	0,1	sleep1	0	-21	swapper/1	08:05:24	1
22734	99	30	18,8	cyclictest	14585	-21	apt-get	09:15:12	1
4309	2	28	0,16	sleep2	25	-21	ksoftirqd/2	12:30:01	2
22737	99	28	17,6	cyclictest	5144	-21	apt-get	11:20:14	2
22737	99	28	1,23	cyclictest	9846	-21	apt-get	11:30:18	2
22737	99	27	2,20	cyclictest	32390	-21	apt-get	12:20:12	2
22737	99	27	1,9	cyclictest	15496	-21	perf	08:05:00	2
22737	99	27	1,21	cyclictest	12382	-21	apt-get	11:35:14	2
22740	99	26	1,11	cyclictest	15562	2	grep	11:40:22	3
22737	99	26	2,6	cyclictest	20073	-21	apt-get	10:40:13	2
22737	99	26	1,6	cyclictest	22245	-21	apt-get	10:45:14	2
22737	99	26	1,4	cyclictest	16806	-21	apt-get	09:20:23	2
22737	99	26	1,21	cyclictest	31333	-40	apt-check	08:40:06	2
22737	99	26	1,21	cyclictest	31333	-40	apt-check	08:40:06	2
22737	99	26	1,20	cyclictest	28806	-21	apt-get	08:35:12	2
22737	99	26	1,20	cyclictest	28806	-21	apt-get	08:35:12	2
22737	99	26	0,21	cyclictest	4807	-21	apt-get	10:05:12	2
22734	99	26	13,8	cyclictest	26421	-21	sort	08:30:00	1
22737	99	25	2,4	cyclictest	4479	-21	apt-get	07:40:12	2
22737	99	25	2,4	cyclictest	10232	-21	apt-get	09:05:12	2
22737	99	25	2,19	cyclictest	14585	-21	apt-get	11:40:12	2
22737	99	25	2,19	cyclictest	14585	-21	apt-get	09:15:13	2
22737	99	25	12,8	cyclictest	15700	-21	apt-get	10:30:14	2
22737	99	24	1,19	cyclictest	19287	-21	apt-get	11:50:15	2
22737	99	24	1,15	cyclictest	8079	-21	runrttasks	09:00:12	2
22734	99	24	14,5	cyclictest	504	-21	latency_hist	11:10:00	1
22734	99	24	14,5	cyclictest	14314	-21	latency_hist	11:40:00	1
22734	99	24	11,8	cyclictest	19287	-21	apt-get	11:50:17	1
22740	99	23	13,6	cyclictest	31	-21	ksoftirqd/3	12:05:12	3
22737	99	23	2,6	cyclictest	15727	-21	apt-get	08:05:12	2
22737	99	23	15,4	cyclictest	5255	-21	latency_hist	08:55:00	2
22737	99	23	1,18	cyclictest	10203	-21	snmp_o5powerctl	10:15:21	2
22737	99	23	11,7	cyclictest	6535	-21	apt-get	12:35:13	2
22737	99	23	0,6	cyclictest	6347	-21	cat	12:35:00	2
22734	99	23	2,15	cyclictest	28023	-21	apt-get	07:20:12	1
22734	99	23	2,14	cyclictest	9867	-21	apt-esm-hook	11:30:15	1
22734	99	23	15,5	cyclictest	1995	-21	grep	07:35:00	1
22734	99	23	1,13	cyclictest	6699	-21	runrttasks	10:09:49	1
22740	99	22	11,7	cyclictest	8060	-21	apt-get	09:00:12	3
22737	99	22	15,4	cyclictest	7836	-21	sendmail	09:00:00	2
22737	99	22	1,3	cyclictest	9187	-21	apt-get	07:50:16	2
22737	99	22	1,18	cyclictest	23179	-40	apt-check	07:10:06	2
22734	99	22	2,14	cyclictest	9155	-40	apt-check	07:50:06	1
22734	99	22	2,13	cyclictest	28839	-21	apt-esm-hook	08:35:12	1
22734	99	22	2,13	cyclictest	28839	-21	apt-esm-hook	08:35:12	1
22734	99	22	2,13	cyclictest	13571	-21	apt-esm-hook	08:00:13	1
22734	99	22	16,3	cyclictest	28741	-21	cat	11:00:01	1
22734	99	22	13,5	cyclictest	16769	-21	swap	10:30:27	1
22734	99	22	1,14	cyclictest	6698	-21	chrt	07:45:12	1
22734	99	22	1,14	cyclictest	30748	-21	apt-get	08:40:14	1
22734	99	22	1,14	cyclictest	30748	-21	apt-get	08:40:14	1
22734	99	22	0,5	cyclictest	0	-21	swapper/1	10:18:02	1
22727	99	22	0,4	cyclictest	0	-21	swapper/0	09:12:52	0
22740	99	21	14,5	cyclictest	11351	-21	apt	10:20:10	3
22740	99	21	13,6	cyclictest	1378	-21	df_inode	08:45:14	3
22740	99	21	13,6	cyclictest	10115	-21	awk	11:30:20	3
22740	99	21	12,7	cyclictest	5282	-21	lsb_release	08:55:00	3
22740	99	21	1,14	cyclictest	19258	-40	apt-check	11:50:10	3
22737	99	21	3,16	cyclictest	25659	-21	awk	09:40:00	2
22737	99	21	2,13	cyclictest	2277	-21	apt-get	07:35:13	2
22737	99	21	2,13	cyclictest	20924	-21	latency_hist	09:30:00	2
22737	99	21	2,13	cyclictest	17917	-21	apt-esm-hook	08:10:13	2
22737	99	21	2,12	cyclictest	20087	-21	apt-esm-hook	08:15:11	2
22737	99	21	1,8	cyclictest	25593	2	sh	12:05:00	2
22737	99	21	1,15	cyclictest	0	-21	swapper/2	11:10:12	2
22737	99	21	1,14	cyclictest	11357	-21	apt-get	07:55:12	2
22737	99	21	0,6	cyclictest	1887	-21	snmpd	10:03:47	2
22734	99	21	2,14	cyclictest	16839	-21	apt-esm-hook	09:20:23	1
22734	99	21	2,13	cyclictest	366	-21	apt-get	09:55:16	1
22734	99	21	2,13	cyclictest	366	-21	apt-get	09:55:16	1
22734	99	21	2,13	cyclictest	32404	-21	apt-esm-hook	12:20:12	1
22734	99	21	2,13	cyclictest	30204	-21	apt-esm-hook	12:15:14	1
22734	99	21	2,12	cyclictest	3348	-21	apt-esm-hook	08:50:13	1
22734	99	21	2,12	cyclictest	28014	-21	apt-get	12:10:12	1
22734	99	21	2,12	cyclictest	28014	-21	apt-get	12:10:12	1
22734	99	21	14,5	cyclictest	8636	-21	awk	11:25:24	1
22734	99	21	1,14	cyclictest	8077	-21	runrttasks	09:00:12	1
22734	99	21	0,5	cyclictest	0	-21	swapper/1	12:03:23	1
22734	99	21	0,4	cyclictest	0	-21	swapper/1	08:23:42	1
22734	99	21	0,4	cyclictest	0	-21	swapper/1	07:39:32	1
22734	99	21	0,4	cyclictest	0	-21	swapper/1	07:16:10	1
22734	99	21	0,4	cyclictest	0	-21	swapper/1	07:14:26	1
22727	99	21	14,5	cyclictest	2887	-21	sed	12:25:19	0
22727	99	21	12,7	cyclictest	26988	-21	snmp_o5powerctl	09:40:22	0
22727	99	21	12,6	cyclictest	27225	-21	users	12:05:25	0
30473	2	20	0,3	sleep2	30476	-21	fschecks_count	12:15:16	2
22740	99	20	1,9	cyclictest	27421	-21	ntp_states	10:55:20	3
22740	99	20	15,3	cyclictest	23553	-21	sh	09:35:13	3
22740	99	20	14,3	cyclictest	18650	-21	grep	09:24:34	3
22740	99	20	13,5	cyclictest	7548	-21	which	12:35:21	3
22740	99	20	13,5	cyclictest	5417	-21	snmp_o5powerctl	12:30:23	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17