OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs

Characteristics of the 100 highest latencies:

System rackcslot4s.osadl.org (updated Wed Jul 26, 2023 12:44:21)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
20721	99	36	1,1	cyclictest	0	-21	swapper/3	08:20:06	3
20721	99	33	0,7	cyclictest	5192	-21	apt-key	12:35:01	3
20721	99	31	13,1	cyclictest	0	-21	swapper/3	10:08:36	3
20721	99	31	12,4	cyclictest	8061	-21	grep	09:35:35	3
20721	99	31	10,5	cyclictest	29546	-21	grep	10:35:30	3
20721	99	30	2,7	cyclictest	2999	-21	python3	10:55:01	3
20721	99	30	2,7	cyclictest	2999	-21	python3	10:55:01	3
20721	99	30	0,28	cyclictest	12152	-21	cat	11:20:01	3
20721	99	29	3,6	cyclictest	31941	-40	apt-check	07:40:06	3
20721	99	28	8,5	cyclictest	19580	-21	sed	11:40:27	3
20721	99	28	2,5	cyclictest	25394	-21	munin-run	08:55:01	3
20721	99	28	1,11	cyclictest	30118	-21	snmp_o5powerctl	09:05:31	3
20721	99	28	1,10	cyclictest	24426	-21	date	10:25:02	3
20721	99	28	10,4	cyclictest	9114	-21	sed	09:40:24	3
20721	99	27	9,3	cyclictest	27887	-21	lsb_release	07:30:00	3
20721	99	27	7,5	cyclictest	25649	-21	ls	12:00:00	3
20721	99	27	2,3	cyclictest	6836	-21	munin-run	11:05:00	3
20721	99	27	2,3	cyclictest	6836	-21	munin-run	11:05:00	3
20721	99	27	11,3	cyclictest	22789	-21	lsb_release	07:15:00	3
20721	99	27	11,2	cyclictest	28620	-21	if_enp2s0	07:30:22	3
20721	99	27	1,12	cyclictest	21523	-21	head	11:45:29	3
20721	99	26	8,5	cyclictest	31	-21	ksoftirqd/3	09:30:19	3
20721	99	26	8,5	cyclictest	25419	-21	sed	10:25:22	3
20721	99	26	6,5	cyclictest	31208	-21	expr	12:15:22	3
20721	99	26	10,5	cyclictest	7300	-21	ntpq	08:00:28	3
20721	99	26	0,5	cyclictest	13225	-21	latency_hist	08:20:00	3
20721	99	26	0,11	cyclictest	20964	-21	gltestperf	08:40:23	3
20721	99	25	9,2	cyclictest	25136	-21	hwlatdetect	07:20:22	3
20721	99	25	9,2	cyclictest	25136	-21	hwlatdetect	07:20:22	3
20721	99	25	8,5	cyclictest	18191	-21	expr	11:35:36	3
20721	99	25	8,4	cyclictest	6503	-21	cat	12:35:30	3
20721	99	25	8,15	cyclictest	0	-21	swapper/3	08:35:00	3
20721	99	25	1,9	cyclictest	299	-21	systemd-journal	09:29:59	3
20721	99	25	0,1	cyclictest	2999	-21	python3	10:55:00	3
20721	99	24	3,5	cyclictest	29153	-21	apt-get	12:10:21	3
20721	99	24	1,9	cyclictest	32233	-21	lsb_release	09:15:00	3
20721	99	24	1,20	cyclictest	31244	-21	/usr/sbin/munin	10:40:26	3
20721	99	24	1,12	cyclictest	8750	-21	apt-get	11:10:21	3
20721	99	24	11,2	cyclictest	29937	-21	/usr/sbin/munin	07:35:34	3
20721	99	24	1,11	cyclictest	32551	-21	apt-get	12:20:18	3
20721	99	24	0,12	cyclictest	31	-21	ksoftirqd/3	08:35:22	3
20718	99	24	12,8	cyclictest	31683	-21	dpkg	07:40:01	1
20721	99	23	1,10	cyclictest	16800	-21	munin-run	10:05:00	3
20718	99	23	15,6	cyclictest	30120	-21	snmp_o5powerctl	09:05:31	1
20717	99	23	16,4	cyclictest	29661	-21	file	07:35:00	0
20717	99	23	15,6	cyclictest	15016	-21	users	09:55:35	0
20717	99	23	14,7	cyclictest	19024	-21	df	08:35:24	0
20717	99	23	14,6	cyclictest	3304	-21	ubuntu-distro-i	10:55:01	0
20717	99	23	14,6	cyclictest	26625	-21	tune2fs	07:25:20	0
20717	99	23	0,20	cyclictest	3173	-21	/usr/sbin/munin	09:20:40	0
20721	99	22	8,4	cyclictest	22269	-21	/usr/sbin/munin	08:45:24	3
20721	99	22	12,7	cyclictest	2909	-21	snmp_o5powerctl	12:25:33	3
20719	99	22	14,6	cyclictest	1217	-21	sed	09:15:32	2
20719	99	22	13,6	cyclictest	31880	-21	snmp_o5powerctl	12:15:33	2
20718	99	22	15,4	cyclictest	1176	-21	dump-pmu-power	07:45:00	1
20718	99	22	14,6	cyclictest	5743	-21	sed	09:30:21	1
20718	99	22	14,6	cyclictest	14677	-21	ntpq	11:25:29	1
20718	99	22	13,7	cyclictest	22195	-21	sed	11:50:00	1
20717	99	22	17,3	cyclictest	29022	-21	fschecks_time	10:35:23	0
20717	99	22	14,6	cyclictest	7164	-21	memory	08:00:26	0
20717	99	22	14,6	cyclictest	17722	-21	cat	11:35:27	0
20721	99	21	13,5	cyclictest	26655	-21	apt-key	10:30:00	3
20721	99	21	0,3	cyclictest	3244	-21	perf	09:24:59	3
20719	99	21	15,3	cyclictest	17009	-21	turbostat	11:35:00	2
20719	99	21	13,6	cyclictest	4329	-21	awk	09:25:29	2
20718	99	21	2,13	cyclictest	5722	-21	apt-get	12:35:22	1
20718	99	21	2,12	cyclictest	6521	-21	apt-get	08:00:20	1
20718	99	21	14,5	cyclictest	11562	-21	sed	08:15:00	1
20718	99	21	14,5	cyclictest	1114	-21	sed	09:15:33	1
20718	99	21	13,6	cyclictest	29378	-21	wc	10:35:28	1
20718	99	21	13,6	cyclictest	1339	-21	sed	12:20:35	1
20718	99	21	1,16	cyclictest	24147	-21	python3	10:25:00	1
20717	99	21	14,5	cyclictest	25620	-21	awk	10:25:26	0
20717	99	21	14,5	cyclictest	23895	-21	sed	08:50:01	0
20717	99	21	14,5	cyclictest	11224	-21	unixbench_singl	08:10:33	0
20717	99	21	13,6	cyclictest	9866	-21	cat	11:10:37	0
20717	99	21	13,6	cyclictest	29950	-21	awk	09:05:28	0
20717	99	21	13,6	cyclictest	21291	-21	memory	11:45:26	0
20717	99	21	10,7	cyclictest	11927	-21	apt-get	09:50:18	0
20721	99	20	9,7	cyclictest	24517	-21	cut	07:20:00	3
20721	99	20	2,16	cyclictest	27181	-21	awk	12:05:00	3
20721	99	20	13,5	cyclictest	12775	-21	sed	11:20:26	3
20721	99	20	13,5	cyclictest	11205	-21	grep	09:45:31	3
20719	99	20	15,3	cyclictest	11527	-21	switchtime	11:15:37	2
20719	99	20	13,5	cyclictest	26603	-21	awk	07:25:21	2
20719	99	20	13,5	cyclictest	23270	-21	cut	07:15:19	2
20719	99	20	13,5	cyclictest	19970	-21	sed	08:35:35	2
20719	99	20	13,5	cyclictest	1428	-21	grep	12:20:36	2
20719	99	20	13,5	cyclictest	13246	-21	grep	09:50:33	2
20719	99	20	13,5	cyclictest	1041	-21	awk	07:40:33	2
20719	99	20	12,6	cyclictest	27171	-21	diskstats	10:30:19	2
20719	99	20	12,6	cyclictest	21586	-21	tune2fs	07:10:18	2
20719	99	20	12,5	cyclictest	1716	-21	nmbd	11:40:19	2
20719	99	20	11,6	cyclictest	5595	-21	ntpq	07:55:27	2
20719	99	20	11,6	cyclictest	30561	-21	basename	09:10:01	2
20718	99	20	13,5	cyclictest	17808	-21	sed	11:35:32	1
20718	99	20	12,5	cyclictest	20024	-21	nfs4_client	10:10:26	1
20718	99	20	1,13	cyclictest	25730	-21	apt-get	12:00:21	1
20718	99	20	1,13	cyclictest	1496	-21	apt-get	10:50:20	1
20718	99	20	1,13	cyclictest	1496	-21	apt-get	10:50:20	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17