OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

x86 Intel Pentium G4400 @3300 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of shadow in rack #8, slot #7

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack8slot7s.osadl.org (updated Mon Mar 27, 2023 12:43:41)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
9263	2	47	0,0	sleep1	0	-21	swapper/1	09:35:25	1
5964	2	31	0,0	sleep1	0	-21	swapper/1	09:25:19	1
19908	99	22	0,16	cyclictest	0	-21	swapper/1	09:30:19	1
19907	99	22	0,8	cyclictest	4462	-21	apt-get	12:20:12	0
19907	99	22	0,8	cyclictest	21185	-21	apt-get	08:40:12	0
19908	99	21	21,0	cyclictest	0	-21	swapper/1	10:18:12	1
19908	99	21	0,16	cyclictest	0	-21	swapper/1	09:45:13	1
19908	99	21	0,15	cyclictest	0	-21	swapper/1	10:45:15	1
19908	99	21	0,14	cyclictest	0	-21	swapper/1	12:10:13	1
19907	99	21	0,18	cyclictest	31988	-21	diskmemload	11:46:08	0
19908	99	20	0,17	cyclictest	0	-21	swapper/1	10:35:30	1
19908	99	20	0,17	cyclictest	0	-21	swapper/1	07:10:13	1
19908	99	20	0,15	cyclictest	0	-21	swapper/1	11:05:19	1
19908	99	20	0,14	cyclictest	0	-21	swapper/1	11:10:19	1
19908	99	20	0,14	cyclictest	0	-21	swapper/1	07:20:17	1
19907	99	20	2,8	cyclictest	29024	-21	apt-get	10:30:18	0
19908	99	19	1,17	cyclictest	0	-21	swapper/1	10:25:20	1
19908	99	19	0,18	cyclictest	0	-21	swapper/1	10:50:17	1
19908	99	19	0,16	cyclictest	0	-21	swapper/1	07:35:13	1
19908	99	19	0,15	cyclictest	0	-21	swapper/1	11:35:10	1
19908	99	19	0,14	cyclictest	0	-21	swapper/1	08:10:16	1
19908	99	19	0,12	cyclictest	0	-21	swapper/1	12:25:13	1
19908	99	19	0,12	cyclictest	0	-21	swapper/1	10:05:13	1
19908	99	19	0,0	cyclictest	0	-21	swapper/1	07:25:13	1
19907	99	19	6,7	cyclictest	9438	-21	apt-get	11:05:19	0
19907	99	19	0,18	cyclictest	31988	-21	diskmemload	12:11:52	0
19907	99	19	0,18	cyclictest	31988	-21	diskmemload	10:01:21	0
19907	99	19	0,10	cyclictest	26669	-21	apt-get	08:55:13	0
19908	99	18	2,15	cyclictest	0	-21	swapper/1	09:50:13	1
19908	99	18	1,15	cyclictest	0	-21	swapper/1	07:15:01	1
19908	99	18	0,1	cyclictest	0	-21	swapper/1	11:30:20	1
19908	99	18	0,16	cyclictest	0	-21	swapper/1	11:20:17	1
19908	99	18	0,15	cyclictest	0	-21	swapper/1	11:15:22	1
19908	99	18	0,13	cyclictest	0	-21	swapper/1	08:15:13	1
19908	99	18	0,12	cyclictest	0	-21	swapper/1	12:35:17	1
19908	99	18	0,12	cyclictest	0	-21	swapper/1	12:20:12	1
19908	99	18	0,12	cyclictest	0	-21	swapper/1	11:55:24	1
19908	99	18	0,10	cyclictest	0	-21	swapper/1	11:45:11	1
19908	99	18	0,10	cyclictest	0	-21	swapper/1	10:40:13	1
19908	99	18	0,0	cyclictest	0	-21	swapper/1	07:50:23	1
19907	99	18	2,15	cyclictest	31988	-21	diskmemload	10:41:11	0
19907	99	18	0,8	cyclictest	29535	-21	apt-get	12:00:13	0
19907	99	18	0,11	cyclictest	26004	-21	apt-get	07:25:13	0
19908	99	17	5,7	cyclictest	0	-21	swapper/1	10:20:21	1
19908	99	17	2,11	cyclictest	0	-21	swapper/1	08:35:15	1
19908	99	17	1,15	cyclictest	0	-21	swapper/1	10:30:27	1
19908	99	17	0,2	cyclictest	0	-21	swapper/1	09:40:22	1
19908	99	17	0,16	cyclictest	0	-21	swapper/1	12:15:22	1
19908	99	17	0,16	cyclictest	0	-21	swapper/1	09:11:34	1
19908	99	17	0,16	cyclictest	0	-21	swapper/1	08:44:42	1
19908	99	17	0,16	cyclictest	0	-21	swapper/1	08:00:17	1
19908	99	17	0,13	cyclictest	0	-21	swapper/1	12:00:12	1
19908	99	17	0,13	cyclictest	0	-21	swapper/1	09:05:14	1
19908	99	17	0,13	cyclictest	0	-21	swapper/1	08:58:16	1
19908	99	17	0,12	cyclictest	0	-21	swapper/1	09:55:14	1
19908	99	17	0,12	cyclictest	0	-21	swapper/1	08:30:21	1
19908	99	17	0,11	cyclictest	0	-21	swapper/1	10:00:12	1
19908	99	17	0,10	cyclictest	0	-21	swapper/1	08:20:13	1
19907	99	17	8,4	cyclictest	19931	-21	apt-get	07:10:13	0
19907	99	17	3,4	cyclictest	7095	-21	apt-get	09:30:18	0
19907	99	17	2,7	cyclictest	5783	-21	apt-get	10:55:17	0
19907	99	17	1,9	cyclictest	29702	-21	apt-get	07:35:13	0
18901	2	17	1,3	sleep0	18989	-21	sensors_temp	07:05:24	0
19908	99	16	5,9	cyclictest	0	-21	swapper/1	11:54:04	1
19908	99	16	2,13	cyclictest	0	-21	swapper/1	09:15:19	1
19908	99	16	2,10	cyclictest	0	-21	swapper/1	12:30:19	1
19908	99	16	0,15	cyclictest	0	-21	swapper/1	12:05:23	1
19908	99	16	0,13	cyclictest	0	-21	swapper/1	08:50:13	1
19908	99	16	0,12	cyclictest	0	-21	swapper/1	07:42:55	1
19908	99	16	0,11	cyclictest	0	-21	swapper/1	10:55:18	1
19908	99	16	0,10	cyclictest	24241	-21	chrt	08:45:27	1
19908	99	16	0,10	cyclictest	0	-21	swapper/1	07:55:13	1
19908	99	16	0,0	cyclictest	0	-21	swapper/1	09:20:25	1
19907	99	16	5,5	cyclictest	3948	-21	apt-get	10:50:17	0
19907	99	16	2,6	cyclictest	27201	-21	apt-get	10:25:20	0
19907	99	16	10,5	cyclictest	547	-21	in:imuxsock	11:40:00	0
19907	99	16	0,15	cyclictest	19949	-21	meminfo	08:35:17	0
19908	99	15	3,11	cyclictest	29147	-21	chrt	07:31:23	1
19908	99	15	0,9	cyclictest	0	-21	swapper/1	11:40:13	1
19908	99	15	0,14	cyclictest	0	-21	swapper/1	11:25:16	1
19908	99	15	0,11	cyclictest	0	-21	swapper/1	07:45:20	1
19908	99	15	0,0	cyclictest	0	-21	swapper/1	09:00:12	1
19907	99	15	7,7	cyclictest	7603	-21	apt-get	11:00:13	0
19907	99	15	5,4	cyclictest	23535	-21	apt-get	10:15:14	0
19907	99	15	3,8	cyclictest	27836	-21	apt-get	07:30:13	0
19907	99	15	1,9	cyclictest	28495	-21	apt-get	09:00:13	0
19907	99	15	0,6	cyclictest	15700	-21	apt-get	08:25:14	0
19907	99	15	0,14	cyclictest	32229	-21	meminfo	07:40:24	0
19907	99	15	0,10	cyclictest	27328	-21	seq	11:52:50	0
19908	99	14	2,9	cyclictest	0	-21	swapper/1	08:05:13	1
19908	99	14	1,12	cyclictest	0	-21	swapper/1	10:10:14	1
19908	99	14	1,12	cyclictest	0	-21	swapper/1	08:25:14	1
19908	99	14	0,12	cyclictest	0	-21	swapper/1	11:00:13	1
19907	99	14	6,7	cyclictest	10749	-21	apt-get	09:40:20	0
19907	99	14	3,6	cyclictest	1589	-21	apt-get	09:15:19	0
19907	99	14	2,8	cyclictest	13083	-21	apt-get	11:15:14	0
19907	99	14	1,8	cyclictest	16741	-21	apt-get	11:25:12	0
19907	99	14	1,8	cyclictest	13873	-21	apt-get	08:20:12	0
19907	99	14	1,8	cyclictest	12043	-21	apt-get	08:15:14	0
19907	99	14	0,5	cyclictest	2116	-21	apt-get	10:45:15	0
19907	99	13	6,5	cyclictest	16220	-21	apt-get	09:55:14	0
19907	99	13	4,6	cyclictest	6296	-21	apt-get	12:25:13	0
19907	99	13	3,9	cyclictest	30323	-21	apt-get	09:05:14	0
19907	99	13	3,7	cyclictest	2902	-21	apt-get	07:50:14	0
19907	99	13	3,5	cyclictest	17525	-21	apt-get	08:30:13	0
19907	99	13	2,7	cyclictest	23015	-21	apt-get	08:45:13	0
19907	99	13	2,4	cyclictest	14919	-21	apt-get	11:20:17	0
19907	99	13	12,0	cyclictest	7460	-21	grep	08:00:21	0
19907	99	13	1,1	cyclictest	25908	-21	cat	07:25:00	0
19907	99	13	0,9	cyclictest	0	-21	swapper/0	11:30:02	0
19907	99	13	0,6	cyclictest	2631	-21	apt-get	12:15:12	0
19907	99	12	6,4	cyclictest	31378	-21	apt-get	12:05:22	0
19907	99	12	4,7	cyclictest	22230	-21	apt-get	11:40:13	0
19907	99	12	4,5	cyclictest	11257	-21	apt-get	11:10:12	0
19907	99	12	3,5	cyclictest	9465	-21	ls	08:05:23	0
19907	99	12	2,6	cyclictest	4731	-21	apt-get	07:55:14	0
19907	99	12	2,5	cyclictest	30844	-21	apt-get	10:35:13	0
19907	99	12	1,6	cyclictest	8925	-21	apt-get	09:35:22	0
19907	99	12	1,5	cyclictest	3429	-21	apt-get	09:20:16	0
19907	99	11	7,3	cyclictest	1780	-21	snmpd	12:37:35	0
19907	99	11	7,3	cyclictest	1426	-21	gmain	07:49:16	0
19907	99	11	3,7	cyclictest	21708	-21	apt-get	10:10:14	0
19907	99	11	2,5	cyclictest	22345	-21	apt-get	07:15:13	0
19907	99	11	2,5	cyclictest	19876	-21	apt-get	10:05:12	0
19907	99	11	1,5	cyclictest	5260	-21	apt-get	09:25:14	0
19338	2	11	1,2	sleep1	0	-21	swapper/1	07:05:54	1
19907	99	10	8,1	cyclictest	24842	-21	apt-get	08:50:13	0
19907	99	10	3,6	cyclictest	10217	-21	apt-get	08:10:14	0
19907	99	10	2,6	cyclictest	14392	-21	apt-get	09:50:13	0
19907	99	10	1,8	cyclictest	153	50	irq/140-nvme0q1	09:45:37	0
19907	99	10	1,6	cyclictest	27716	-21	apt-get	11:55:18	0
19907	99	10	1,4	cyclictest	1780	-21	snmpd	09:10:02	0
19907	99	10	10,0	cyclictest	0	-21	swapper/0	12:30:45	0
19907	99	10	0,9	cyclictest	31988	-21	diskmemload	10:20:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17