OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

x86 Intel Pentium G4400 @3300 MHz, Linux 4.19.37-rt19 (Profile)

Latency plot of shadow in rack #8, slot #7

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the alll highest latencies:

System rack8slot7s.osadl.org (updated Mon Mar 20, 2023 12:43:41)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
21818	99	20	0,0	cyclictest	0	-21	swapper/1	11:25:23	1
21817	99	19	2,8	cyclictest	18715	-21	apt-get	11:25:14	0
21818	99	18	0,15	cyclictest	0	-21	swapper/1	12:07:36	1
21817	99	18	5,10	cyclictest	23666	-21	munin-node	09:50:36	0
21817	99	18	0,9	cyclictest	14541	-21	apt-get	09:45:16	0
21817	99	18	0,6	cyclictest	1558	-21	diskmemload	11:55:05	0
21817	99	18	0,11	cyclictest	7232	-21	apt-get	09:25:14	0
21817	99	18	0,11	cyclictest	2788	-21	apt-get	12:10:20	0
21817	99	17	1,15	cyclictest	1558	-21	diskmemload	09:15:16	0
21818	99	16	1,14	cyclictest	0	-21	swapper/1	11:10:00	1
21817	99	16	5,9	cyclictest	10889	-21	apt-get	09:35:16	0
21817	99	16	5,8	cyclictest	2263	-21	apt-get	10:40:14	0
21817	99	16	3,8	cyclictest	12718	-21	apt-get	09:40:17	0
21818	99	15	2,4	cyclictest	0	-21	swapper/1	10:25:14	1
21817	99	15	3,5	cyclictest	24200	-21	apt-get	11:40:13	0
21817	99	15	1,6	cyclictest	20552	-21	apt-get	11:30:21	0
21817	99	15	15,0	cyclictest	1558	-21	diskmemload	10:27:28	0
21817	99	15	0,9	cyclictest	27339	-21	apt-get	10:20:15	0
21817	99	15	0,6	cyclictest	9065	-21	apt-get	09:30:18	0
21817	99	15	0,14	cyclictest	31058	-21	meminfo	09:00:18	0
21817	99	15	0,14	cyclictest	24849	-21	meminfo	07:15:21	0
21817	99	15	0,14	cyclictest	23745	-21	meminfo	08:40:16	0
21817	99	15	0,14	cyclictest	1558	-21	diskmemload	10:59:01	0
21818	99	14	3,4	cyclictest	0	-21	swapper/1	08:50:00	1
21818	99	14	3,4	cyclictest	0	-21	swapper/1	07:45:17	1
21818	99	14	3,3	cyclictest	0	-21	swapper/1	09:25:16	1
21818	99	14	1,8	cyclictest	0	-21	swapper/1	11:30:23	1
21817	99	14	5,7	cyclictest	31614	-21	apt-get	07:35:13	0
21817	99	14	3,8	cyclictest	4099	-21	apt-get	10:45:19	0
21817	99	14	3,6	cyclictest	6712	-21	apt-get	07:55:16	0
21817	99	14	3,6	cyclictest	10102	-21	apt-get	12:30:18	0
21817	99	14	3,5	cyclictest	1015	-21	apt-get	07:40:13	0
21817	99	14	2,8	cyclictest	19220	-21	ls	09:55:22	0
21817	99	14	2,7	cyclictest	10360	-21	apt-get	08:05:12	0
21817	99	14	1,8	cyclictest	5930	-21	apt-get	10:50:18	0
21817	99	14	1,7	cyclictest	27912	-21	apt-get	07:25:13	0
21817	99	14	0,9	cyclictest	26812	-21	apt-get	08:50:12	0
21424	2	14	2,2	sleep0	0	-21	swapper/0	07:07:50	0
17476	2	14	0,1	sleep1	0	-21	swapper/1	11:20:19	1
4848	2	13	0,1	sleep1	0	-21	swapper/1	09:16:02	1
21818	99	13	6,1	cyclictest	10894	-21	taskset	11:01:29	1
21818	99	13	4,4	cyclictest	0	-21	swapper/1	10:55:17	1
21818	99	13	4,3	cyclictest	0	-21	swapper/1	12:35:19	1
21818	99	13	4,2	cyclictest	0	-21	swapper/1	09:45:16	1
21818	99	13	3,4	cyclictest	0	-21	swapper/1	08:50:20	1
21818	99	13	2,5	cyclictest	0	-21	swapper/1	09:20:14	1
21818	99	13	1,5	cyclictest	0	-21	swapper/1	10:20:15	1
21818	99	13	0,7	cyclictest	0	-21	swapper/1	10:48:48	1
21818	99	13	0,7	cyclictest	0	-21	swapper/1	08:35:19	1
21818	99	13	0,6	cyclictest	0	-21	swapper/1	12:20:18	1
21818	99	13	0,6	cyclictest	0	-21	swapper/1	09:00:12	1
21818	99	13	0,5	cyclictest	0	-21	swapper/1	07:10:12	1
21818	99	13	0,3	cyclictest	0	-21	swapper/1	12:30:06	1
21817	99	13	6,3	cyclictest	19497	-21	apt-get	08:30:13	0
21817	99	13	5,6	cyclictest	29747	-21	apt-get	07:30:13	0
21817	99	13	5,3	cyclictest	27861	-21	apt-get	11:50:18	0
21817	99	13	4,7	cyclictest	9587	-21	apt-get	11:00:21	0
21817	99	13	4,3	cyclictest	22371	-21	apt-get	11:35:14	0
21817	99	13	3,7	cyclictest	23680	-21	apt-get	10:10:13	0
21817	99	13	3,7	cyclictest	21326	-21	apt-get	08:35:13	0
21817	99	13	3,3	cyclictest	919	-21	apt-get	12:05:19	0
21817	99	13	2,5	cyclictest	15059	-21	apt-get	11:15:15	0
21817	99	13	2,5	cyclictest	13240	-21	apt-get	11:10:20	0
21817	99	13	2,10	cyclictest	4589	-21	cat	07:50:01	0
21817	99	13	1,6	cyclictest	4710	-21	apt-get	07:50:12	0
21817	99	13	1,5	cyclictest	31513	-21	apt-get	12:00:16	0
21817	99	13	0,7	cyclictest	11932	-21	apt-get	12:35:19	0
4275	2	12	0,1	sleep1	0	-21	swapper/1	12:13:24	1
21818	99	12	3,8	cyclictest	0	-21	swapper/1	11:55:14	1
21818	99	12	3,4	cyclictest	0	-21	swapper/1	07:54:20	1
21818	99	12	2,5	cyclictest	0	-21	swapper/1	08:55:12	1
21818	99	12	2,4	cyclictest	0	-21	swapper/1	09:05:24	1
21818	99	12	2,3	cyclictest	0	-21	swapper/1	12:25:20	1
21818	99	12	1,7	cyclictest	0	-21	swapper/1	08:40:12	1
21818	99	12	12,0	cyclictest	0	-21	swapper/1	12:00:04	1
21818	99	12	0,4	cyclictest	0	-21	swapper/1	09:55:12	1
21818	99	12	0,3	cyclictest	0	-21	swapper/1	08:15:14	1
21818	99	12	0,3	cyclictest	0	-21	swapper/1	07:20:14	1
21817	99	12	5,6	cyclictest	14015	-21	apt-get	08:15:14	0
21817	99	12	5,5	cyclictest	21839	-21	apt-get	07:10:12	0
21817	99	12	2,8	cyclictest	11408	-21	apt-get	11:05:15	0
21817	99	12	2,7	cyclictest	8546	-21	apt-get	08:00:22	0
21817	99	12	2,7	cyclictest	6314	-21	/usr/sbin/munin	09:20:22	0
21817	99	12	2,6	cyclictest	28640	-21	apt-get	08:55:13	0
21817	99	12	2,6	cyclictest	1730	-21	apt-get	09:10:13	0
21817	99	12	1,6	cyclictest	4610	-21	apt-get	12:15:15	0
21817	99	12	1,6	cyclictest	12186	-21	apt-get	08:10:12	0
21817	99	12	0,6	cyclictest	24994	-21	apt-get	08:45:17	0
21817	99	12	0,6	cyclictest	17669	-21	/usr/sbin/munin	08:25:21	0
21817	99	12	0,3	cyclictest	1558	-21	diskmemload	12:21:15	0
20479	2	12	1,4	sleep1	0	-21	swapper/1	07:05:18	1
21818	99	11	6,2	cyclictest	0	-21	swapper/1	10:15:14	1
21818	99	11	4,1	cyclictest	0	-21	swapper/1	08:10:13	1
21818	99	11	3,2	cyclictest	0	-21	swapper/1	07:35:14	1
21818	99	11	3,2	cyclictest	0	-21	swapper/1	07:25:12	1
21818	99	11	2,5	cyclictest	0	-21	swapper/1	10:35:15	1
21818	99	11	2,1	cyclictest	0	-21	swapper/1	11:50:20	1
21818	99	11	2,1	cyclictest	0	-21	swapper/1	11:10:22	1
21818	99	11	1,6	cyclictest	0	-21	swapper/1	09:35:16	1
21818	99	11	1,4	cyclictest	0	-21	swapper/1	11:15:15	1
21818	99	11	1,4	cyclictest	0	-21	swapper/1	10:40:14	1
21818	99	11	1,3	cyclictest	0	-21	swapper/1	11:40:13	1
21818	99	11	1,2	cyclictest	0	-21	swapper/1	09:50:20	1
21818	99	11	1,2	cyclictest	0	-21	swapper/1	07:15:01	1
21818	99	11	1,1	cyclictest	0	-21	swapper/1	08:25:12	1
21818	99	11	0,7	cyclictest	0	-21	swapper/1	10:00:19	1
21818	99	11	0,6	cyclictest	0	-21	swapper/1	07:40:13	1
21818	99	11	0,5	cyclictest	0	-21	swapper/1	10:10:14	1
21818	99	11	0,5	cyclictest	0	-21	swapper/1	07:55:16	1
21818	99	11	0,4	cyclictest	0	-21	swapper/1	10:50:18	1
21818	99	11	0,4	cyclictest	0	-21	swapper/1	08:20:14	1
21818	99	11	0,3	cyclictest	0	-21	swapper/1	09:40:18	1
21817	99	11	3,5	cyclictest	356	-21	apt-get	10:35:14	0
21817	99	11	2,7	cyclictest	15847	-21	apt-get	08:20:15	0
21817	99	11	2,6	cyclictest	16887	-21	apt-get	11:20:14	0
21817	99	11	1,6	cyclictest	32302	-21	apt-get	09:05:18	0
21817	99	11	1,5	cyclictest	21855	-21	apt-get	10:05:14	0
21817	99	11	1,4	cyclictest	20027	-21	apt-get	10:00:19	0
21817	99	11	0,4	cyclictest	8277	-21	apt-get	12:25:20	0
21817	99	11	0,4	cyclictest	30996	-21	apt-get	10:30:16	0
21817	99	11	0,10	cyclictest	27189	-21	lsb_release	10:19:59	0
21818	99	10	3,3	cyclictest	0	-21	swapper/1	10:30:16	1
21818	99	10	3,0	cyclictest	0	-21	swapper/1	07:30:13	1
21818	99	10	2,5	cyclictest	0	-21	swapper/1	10:05:15	1
21818	99	10	1,3	cyclictest	0	-21	swapper/1	08:30:13	1
21818	99	10	0,9	cyclictest	0	-21	swapper/1	09:30:08	1
21818	99	10	0,3	cyclictest	0	-21	swapper/1	11:45:20	1
21817	99	10	2,7	cyclictest	1569	-21	irqbalance	07:22:10	0
21818	99	9	1,2	cyclictest	0	-21	swapper/1	11:37:20	1
21818	99	9	1,1	cyclictest	0	-21	swapper/1	09:10:05	1
21818	99	9	0,6	cyclictest	0	-21	swapper/1	08:05:12	1
21818	99	9	0,4	cyclictest	0	-21	swapper/1	12:15:13	1
21817	99	9	1,5	cyclictest	26036	-21	apt-get	11:45:19	0
21818	99	8	0,4	cyclictest	0	-21	swapper/1	08:00:21	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17