OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rackfslot4s.osadl.org (updated Sun Apr 28, 2024 00:44:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
16254	2	117	0,2	sleep0	16322	-21	cut	19:10:29	0
1010	2	116	0,2	sleep0	1011	-21	cpu	20:51:20	0
4366	2	114	0,2	chrt	4367	-21	if_err_can0	21:56:02	0
23343	2	114	0,3	chrt	23342	-21	awk	23:27:08	0
1657	2	112	0,3	chrt	1654	-21	cat	19:45:54	0
20862	2	109	0,1	sleep0	20860	-21	uptime	23:22:18	0
12690	2	109	0,2	sleep0	12691	-21	cpuspeed	20:10:28	0
12063	2	107	0,3	chrt	12064	-21	sleep	20:09:20	0
28614	2	105	0,2	chrt	28615	-21	cat	20:40:47	0
14066	2	104	0,2	chrt	14067	-21	sleep	00:07:43	0
28491	2	102	0,2	chrt	28490	-21	ssh	22:38:37	0
22660	2	100	0,2	chrt	22661	-21	sh	19:21:58	0
31366	2	99	0,1	sleep0	31369	-21	irqrtprio	23:41:46	0
25320	2	98	0,2	chrt	25321	-21	sh	19:27:29	0
7609	2	96	0,1	sleep0	7611	-21	apt	23:00:00	0
17125	2	86	0,4	chrt	17108	-21	hddtemp_smartct	21:20:57	0
10899	2	85	0,2	sleep0	10900	-21	apt-key	21:10:14	0
17484	2	83	0,2	sleep0	17485	-21	sh	23:16:28	0
21469	2	78	0,2	sleep0	21468	-21	perl	22:26:25	0
14763	2	78	8,23	sleep0	14768	-21	/usr/sbin/munin	19:06:02	0
11274	2	75	0,2	sleep0	11275	-21	df	23:06:10	0
24088	2	73	0,1	sleep0	24086	-21	ssh	21:32:51	0
29722	2	72	0,2	sleep0	29724	-21	sort	22:41:00	0
14229	2	59	0,2	sleep0	14255	-21	cut	23:11:06	0
17962	2	58	0,1	sleep0	17964	-21	cut	20:20:36	0
8314	2	56	0,2	sleep0	8325	-21	cut	23:57:53	0
8479	2	55	3,7	sleep0	8483	-21	df_inode	21:05:29	0
4554	2	55	0,2	sleep0	4555	-21	rm	22:54:10	0
17626	2	53	0,3	sleep0	17629	-21	latency_hist	00:15:04	0
25034	2	52	2,6	sleep0	25064	-21	ps	22:32:11	0
21653	2	51	0,3	chrt	21633	-21	ntpq	00:21:19	0
25560	2	50	3,7	sleep0	25551	-21	ssh	21:36:04	0
11183	2	50	3,39	sleep0	11175	-21	ssh	22:07:30	0
15814	90	49	19,23	cyclictest	0	-21	swapper	23:02:49	0
15814	90	49	19,23	cyclictest	0	-21	swapper	00:27:56	0
14948	2	49	3,37	sleep0	14954	-21	apt	22:15:10	0
15814	90	48	19,22	cyclictest	0	-21	swapper	00:32:59	0
1628	2	47	3,37	sleep0	1624	-21	ssh	21:51:04	0
15814	90	47	18,20	cyclictest	0	-21	swapper	23:47:36	0
15814	90	46	19,19	cyclictest	0	-21	swapper	19:43:06	0
15814	90	46	17,23	cyclictest	0	-21	swapper	21:43:26	0
15814	90	46	17,22	cyclictest	0	-21	swapper	23:38:14	0
15814	90	45	16,23	cyclictest	19591	-21	runrttasks	22:22:24	0
15814	90	45	15,23	cyclictest	0	-21	swapper	21:28:05	0
15814	90	44	17,21	cyclictest	4940	-21	aten2.4_rfpower	19:55:35	0
15814	90	44	13,22	cyclictest	0	-21	swapper	00:17:19	0
15814	90	43	4,12	cyclictest	25446	-21	snmpd	20:00:23	0
15814	90	43	19,17	cyclictest	31526	-21	ssh	00:40:02	0
15814	90	43	15,9	cyclictest	11	-21	ksoftirqd/0	20:26:09	0
27984	2	42	0,2	chrt	27985	-21	sh	19:33:00	0
15814	90	42	5,19	cyclictest	893	-21	runrttasks	00:00:51	0
15814	90	42	5,12	cyclictest	7669	-21	ntpq	22:01:18	0
15814	90	42	4,10	cyclictest	23654	-21	ntpq	20:30:58	0
15814	90	42	21,13	cyclictest	0	-21	swapper	22:12:47	0
15814	90	42	17,11	cyclictest	25285	-21	if_err_eth0	23:31:00	0
15814	90	41	5,9	cyclictest	31945	-21	ssh	22:45:25	0
15814	90	41	4,18	cyclictest	4183	-21	ntpq	20:56:11	0
15814	90	41	17,17	cyclictest	5111	-21	ssh	23:52:22	0
15814	90	40	4,18	cyclictest	31715	-21	ntpq	21:46:21	0
15814	90	40	4,10	cyclictest	6704	-21	ntpq	21:01:00	0
15814	90	40	15,20	cyclictest	0	-21	swapper	19:17:03	0
15814	90	40	13,9	cyclictest	13819	-21	telnet	21:15:31	0
15814	90	39	14,18	cyclictest	15558	-21	irqrtprio	20:15:42	0
15814	90	38	4,26	cyclictest	26275	-21	ntpq	20:36:11	0
15814	90	38	11,10	cyclictest	0	-21	swapper	20:49:59	0
15814	90	37	5,11	cyclictest	29744	-21	ntpq	19:36:06	0
15814	90	37	11,19	cyclictest	0	-21	swapper	19:52:23	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39