OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

x86 AMD Ryzen XXXX @3300 MHz, Linux 4.18.7-rt5 (Profile)

Latency plot of shadow in rack #c, slot #3

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackcslot3s (updated Sun Jul 03, 2022 12:50:21)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
32616	2	616	604,8	sleep7	0	-21	swapper/7	07:06:30	7
323	2	603	594,4	sleep2	0	-21	swapper/2	07:08:58	2
383	2	510	497,9	sleep4	0	-21	swapper/4	07:09:47	4
32683	2	450	435,8	sleep0	0	-21	swapper/0	07:07:27	0
308	2	437	416,15	sleep5	0	-21	swapper/5	07:08:44	5
393	2	385	367,12	sleep3	0	-21	swapper/3	07:09:55	3
376	2	362	346,12	sleep6	0	-21	swapper/6	07:09:42	6
32729	2	324	303,15	sleep1	0	-21	swapper/1	07:08:08	1
859	99	79	78,0	cyclictest	18243	-21	cron	10:00:00	2
861	99	72	71,0	cyclictest	2568	-21	grep	07:10:40	4
25331	2	59	0,1	sleep4	0	-21	swapper/4	08:00:00	4
864	99	58	56,1	cyclictest	24189	-21	apt	09:05:00	7
21444	2	58	0,0	sleep2	0	-21	swapper/2	12:20:16	2
21444	2	58	0,0	sleep2	0	-21	swapper/2	12:20:16	2
864	99	57	33,22	cyclictest	27792	-21	latency_hist	10:19:59	7
857	99	57	36,20	cyclictest	975	-21	head	09:20:36	0
862	99	55	29,25	cyclictest	10535	-21	cut	10:50:12	5
864	99	53	52,0	cyclictest	29543	-21	tr	09:15:13	7
863	99	53	52,0	cyclictest	5524	-21	grep	08:25:14	6
864	99	52	22,29	cyclictest	11594	-21	grep	12:00:12	7
862	99	51	49,1	cyclictest	29719	-21	tr	11:30:14	5
863	99	50	48,1	cyclictest	32492	-21	taskset	08:15:01	6
862	99	50	48,1	cyclictest	2571	-21	unixbench_singl	07:10:41	5
858	99	50	5,33	cyclictest	0	-21	swapper/1	09:27:10	1
864	99	48	46,1	cyclictest	20847	-21	cut	11:10:22	7
863	99	48	16,16	cyclictest	0	-21	swapper/6	12:38:36	6
861	99	48	46,1	cyclictest	10948	-21	sh	12:00:00	4
857	99	48	46,1	cyclictest	32159	-21	unixbench_multi	10:25:32	0
862	99	46	44,1	cyclictest	22491	-21	grep	11:15:12	5
861	99	46	44,1	cyclictest	23600	-21	tr	10:10:12	4
864	99	45	43,1	cyclictest	13794	-21	tr	07:35:13	7
863	99	45	7,13	cyclictest	0	-21	swapper/6	11:15:12	6
863	99	44	43,0	cyclictest	12919	-21	tr	08:40:13	6
857	99	44	42,1	cyclictest	29054	-21	cat	09:15:00	0
862	99	43	41,1	cyclictest	20957	-21	cpuspeed_turbos	07:50:15	5
861	99	43	42,0	cyclictest	17773	-21	grep	12:10:37	4
861	99	43	42,0	cyclictest	17773	-21	grep	12:10:37	4
860	99	43	7,28	cyclictest	0	-21	swapper/3	10:11:57	3
859	99	43	0,42	cyclictest	0	-21	swapper/2	09:30:34	2
858	99	43	13,14	cyclictest	0	-21	swapper/1	12:20:04	1
858	99	43	13,14	cyclictest	0	-21	swapper/1	12:20:04	1
857	99	43	40,2	cyclictest	21982	-21	needreboot	10:05:23	0
863	99	42	32,6	cyclictest	71	-21	ksoftirqd/6	10:32:57	6
860	99	42	40,1	cyclictest	11297	-21	grep	08:35:34	3
858	99	42	40,1	cyclictest	14309	-21	unixbench_multi	10:55:32	1
857	99	42	40,1	cyclictest	10575	-21	cpuspeed_turbos	10:50:12	0
863	99	41	40,0	cyclictest	22267	-21	grep	10:05:32	6
862	99	41	39,1	cyclictest	32043	-21	cpuspeed_turbos	09:20:13	5
862	99	41	39,1	cyclictest	21375	-21	grep	08:55:36	5
859	99	41	39,1	cyclictest	8313	-21	head	09:35:32	2
859	99	41	39,1	cyclictest	25614	-21	needreboot	11:20:24	2
859	99	41	39,1	cyclictest	23381	-21	tr	07:55:14	2
858	99	41	40,0	cyclictest	24434	-21	cat	11:20:00	1
857	99	41	39,1	cyclictest	5946	-21	cat	08:25:23	0
864	99	40	32,7	cyclictest	11332	-21	cut	07:30:15	7
862	99	40	38,1	cyclictest	31344	-21	apt	09:20:00	5
859	99	40	4,17	cyclictest	0	-21	swapper/2	07:15:02	2
858	99	40	4,32	cyclictest	0	-21	swapper/1	09:52:01	1
857	99	40	38,1	cyclictest	32463	-21	latency_hist	08:15:01	0
864	99	39	37,1	cyclictest	28269	-21	tr	12:35:13	7
864	99	39	28,9	cyclictest	9043	-21	cpuspeed_turbos	07:25:14	7
863	99	39	4,24	cyclictest	0	-21	swapper/6	09:28:09	6
862	99	39	37,1	cyclictest	17740	-21	tr	11:05:13	5
862	99	39	0,38	cyclictest	0	-21	swapper/5	09:44:59	5
861	99	39	5,23	cyclictest	0	-21	swapper/4	12:00:20	4
860	99	39	24,13	cyclictest	15130	-21	unixbench_multi	07:35:33	3
857	99	39	37,1	cyclictest	14885	-21	wc	07:35:32	0
864	99	38	28,9	cyclictest	32738	-21	latency_hist	10:30:00	7
864	99	38	12,8	cyclictest	0	-21	swapper/7	11:59:57	7
863	99	38	37,0	cyclictest	9018	-21	cpuspeed_turbos	07:25:13	6
863	99	38	12,12	cyclictest	0	-21	swapper/6	11:08:32	6
862	99	38	36,1	cyclictest	29189	-21	latency_hist	09:15:00	5
861	99	38	37,0	cyclictest	17295	-21	timerandwakeup	07:40:36	4
860	99	38	37,0	cyclictest	25135	-21	latency_hist	08:00:01	3
859	99	38	36,1	cyclictest	22459	-21	cpuspeed_turbos	09:00:14	2
858	99	38	36,1	cyclictest	23626	-21	cpuspeed_turbos	10:10:13	1
857	99	38	36,1	cyclictest	10353	-21	wc	11:55:33	0
857	99	38	35,1	cyclictest	2228	-21	tr	09:25:14	0
864	99	37	35,1	cyclictest	21975	-21	grep	10:05:24	7
863	99	37	35,1	cyclictest	3592	-21	cat	07:15:02	6
863	99	37	35,1	cyclictest	24244	-21	grep	12:25:23	6
863	99	37	35,1	cyclictest	24244	-21	grep	12:25:22	6
863	99	37	35,1	cyclictest	18555	-21	wc	08:50:32	6
863	99	37	29,3	cyclictest	5497	-21	snmpd	09:05:04	6
862	99	37	35,1	cyclictest	21677	-21	wc	12:20:21	5
862	99	37	35,1	cyclictest	21677	-21	wc	12:20:21	5
861	99	37	36,0	cyclictest	21220	-21	tr	12:20:13	4
861	99	37	36,0	cyclictest	21220	-21	tr	12:20:13	4
861	99	37	35,1	cyclictest	20625	-21	grep	12:20:00	4
861	99	37	35,1	cyclictest	20625	-21	grep	12:19:59	4
861	99	37	35,1	cyclictest	0	-21	swapper/4	10:35:36	4
860	99	37	0,36	cyclictest	0	-21	swapper/3	10:45:13	3
859	99	37	35,1	cyclictest	6836	-21	tr	11:50:12	2
859	99	37	35,1	cyclictest	663	-21	timerandwakeup	09:20:35	2
859	99	37	35,1	cyclictest	0	-21	swapper/2	12:25:16	2
859	99	37	35,1	cyclictest	0	-21	swapper/2	12:25:16	2
859	99	37	14,1	cyclictest	19602	-21	strings	10:00:24	2
858	99	37	36,0	cyclictest	15746	-21	sh	12:10:00	1
857	99	37	35,1	cyclictest	25938	-21	grep	12:30:13	0
857	99	37	35,1	cyclictest	16642	-21	head	08:45:40	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17