OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack5slot7s.osadl.org (updated Thu Sep 04, 2025 00:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
5763	2	2390	2170,166	sleep0	0	-21	swapper	19:06:02	0
6254	99	165	17,123	cyclictest	24272	-21	apt-get	21:02:03	0
6254	99	160	24,108	cyclictest	1997	-21	irqstats	22:00:36	0
6254	99	158	12,25	cyclictest	11001	-21	apt-get	22:56:34	0
6254	99	157	21,107	cyclictest	7062	-21	munin-node	19:15:10	0
6254	99	157	16,24	cyclictest	12956	-21	apt-get	23:05:15	0
6254	99	157	15,117	cyclictest	22842	-21	memory	00:05:46	0
6254	99	156	24,18	cyclictest	0	-21	swapper	20:00:59	0
6254	99	155	17,24	cyclictest	25527	-21	df	21:05:34	0
6254	99	155	15,24	cyclictest	15261	-21	munin-run	23:20:02	0
6254	99	155	15,23	cyclictest	7908	-21	memory	22:35:43	0
6254	99	155	14,119	cyclictest	8521	-21	apt-get	22:40:28	0
6254	99	154	17,113	cyclictest	3418	-21	apt-get	22:10:14	0
6254	99	154	17,113	cyclictest	24277	-21	/usr/sbin/munin	21:00:06	0
6254	99	154	15,116	cyclictest	303	-21	diskstats	21:50:33	0
6254	99	154	10,99	cyclictest	2821	-21	snmpd	20:40:16	0
6254	99	153	31,24	cyclictest	13075	-21	sort	19:50:04	0
6254	99	153	20,26	cyclictest	5047	-21	apt-get	22:20:19	0
6254	99	153	19,38	cyclictest	7045	-21	apt	19:15:01	0
6254	99	153	15,24	cyclictest	18468	-21	apt	23:40:00	0
6254	99	153	15,21	cyclictest	5912	-21	apt-get	22:25:27	0
6254	99	153	14,98	cyclictest	16240	-21	munin-run	20:10:01	0
6254	99	153	12,115	cyclictest	11414	-21	munin-run	19:40:03	0
6254	99	152	15,37	cyclictest	28760	-21	diskstats	21:25:35	0
6254	99	152	15,114	cyclictest	16108	-21	sort	23:25:03	0
6254	99	152	12,116	cyclictest	16603	-21	find	23:25:55	0
6254	99	151	22,20	cyclictest	0	-21	swapper	21:23:34	0
6254	99	151	17,109	cyclictest	11646	-21	diskstats	19:40:34	0
6254	99	151	16,25	cyclictest	31183	-21	diskstats	21:40:33	0
6254	99	151	15,94	cyclictest	17852	-21	munin-run	20:20:02	0
6254	99	151	15,112	cyclictest	27126	-21	df_inode	21:15:36	0
6254	99	151	14,23	cyclictest	9858	-21	/usr/sbin/munin	22:46:01	0
6254	99	151	14,112	cyclictest	20604	-21	zcat	23:50:54	0
6254	99	151	13,38	cyclictest	997	-21	/usr/sbin/munin	21:55:35	0
6254	99	151	12,116	cyclictest	18761	-21	irqstats	23:40:34	0
6254	99	151	11,40	cyclictest	7563	-21	modprobe	22:35:02	0
6254	99	151	11,24	cyclictest	10323	-21	awk	19:30:52	0
6254	99	150	23,27	cyclictest	13750	-21	apt-get	23:10:20	0
6254	99	150	14,111	cyclictest	29556	-21	diskstats	21:30:28	0
6254	99	150	13,27	cyclictest	24196	-21	kworker/u2:9	00:40:04	0
6254	99	150	12,27	cyclictest	30708	-21	cut	21:35:59	0
6254	99	150	12,23	cyclictest	31943	-21	wc	21:45:25	0
6254	99	150	12,114	cyclictest	21149	-21	wc	20:40:05	0
6254	99	150	12,110	cyclictest	23520	-21	latency_hist	20:55:04	0
6254	99	150	10,116	cyclictest	22127	-21	/usr/sbin/munin	20:45:34	0
6254	99	149	15,107	cyclictest	26616	-21	apt-get	00:30:17	0
6254	99	149	13,113	cyclictest	26495	-21	sshd	00:28:33	0
6254	99	149	10,97	cyclictest	25153	-21	sshd	00:20:34	0
6254	99	148	17,105	cyclictest	26224	-21	apt-get	21:10:19	0
6254	99	148	12,29	cyclictest	3034	-21	ps	22:05:56	0
6254	99	147	9,114	cyclictest	21057	-21	ls	23:55:25	0
6254	99	147	33,20	cyclictest	24897	-21	sh	00:20:00	0
6254	99	147	17,28	cyclictest	8493	-21	irqstats	19:20:40	0
6254	99	147	16,37	cyclictest	4323	-21	diskstats	22:15:36	0
6254	99	147	16,25	cyclictest	14020	-21	df	19:55:23	0
6254	99	147	16,106	cyclictest	9813	-21	munin-run	19:30:01	0
6254	99	147	13,113	cyclictest	17670	-21	munin-run	23:35:02	0
6254	99	147	12,112	cyclictest	20008	-21	grep	23:46:02	0
6254	99	147	12,110	cyclictest	20308	-21	sort	20:35:03	0
6254	99	146	20,26	cyclictest	11003	-21	munin-run	22:55:04	0
6254	99	146	16,26	cyclictest	16455	-21	diskstats	20:10:34	0
6254	99	145	16,25	cyclictest	21913	-21	diskstats	00:00:34	0
6254	99	144	18,103	cyclictest	13822	-21	munin-run	19:55:02	0
6254	99	144	18,102	cyclictest	2821	-21	snmpd	20:28:43	0
6254	99	144	14,27	cyclictest	23394	-21	/usr/sbin/munin	00:11:01	0
6254	99	144	12,108	cyclictest	17971	-21	/usr/sbin/munin	20:20:34	0
6254	99	144	11,27	cyclictest	12259	-21	/usr/sbin/munin	23:00:32	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17