OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack5slot7s.osadl.org (updated Wed Dec 10, 2025 00:45:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
30089	2	2440	2197,97	sleep0	0	-21	swapper	19:08:57	0
30251	99	159	10,128	cyclictest	31863	-21	snmpd	22:05:03	0
30251	99	157	9,123	cyclictest	32330	-21	wc	22:35:05	0
30251	99	157	17,25	cyclictest	18449	-21	apt-get	21:16:25	0
30251	99	157	13,125	cyclictest	15344	-1	kworker/u3:3	21:35:17	0
30251	99	155	17,99	cyclictest	30608	-21	apt-get	22:25:29	0
30251	99	155	13,25	cyclictest	822	-21	diskstats	22:40:38	0
30251	99	155	13,118	cyclictest	9752	-21	wc	20:20:22	0
30251	99	155	11,120	cyclictest	11098	-21	wc	20:26:02	0
30251	99	154	30,89	cyclictest	7102	-21	timerandwakeup	23:16:01	0
30251	99	154	22,105	cyclictest	30419	-21	apt-get	19:10:31	0
30251	99	154	16,23	cyclictest	1574	-21	apt-get	22:45:24	0
30251	99	154	14,100	cyclictest	3179	-21	munin-run	19:40:03	0
30251	99	154	12,116	cyclictest	5688	-21	/usr/sbin/munin	19:55:43	0
30251	99	154	11,118	cyclictest	14095	-21	/usr/sbin/munin	00:00:47	0
30251	99	153	28,104	cyclictest	10593	-21	apt-get	23:40:14	0
30251	99	153	19,108	cyclictest	29722	-21	apt-get	22:20:21	0
30251	99	153	13,26	cyclictest	19892	-21	/usr/sbin/munin	21:20:54	0
30251	99	153	11,118	cyclictest	20123	-21	munin-plugin-st	00:40:01	0
30251	99	152	19,108	cyclictest	15441	-21	df	20:55:29	0
30251	99	152	18,109	cyclictest	26146	-21	munin-run	22:00:02	0
30251	99	152	16,113	cyclictest	13654	-21	awk	23:56:10	0
30251	99	152	14,114	cyclictest	3538	-21	memory	19:40:43	0
30251	99	152	13,117	cyclictest	21104	-21	munin-run	21:30:03	0
30251	99	152	13,116	cyclictest	18626	-21	/usr/sbin/munin	00:30:29	0
30251	99	152	13,116	cyclictest	18527	-21	munin-run	00:30:00	0
30251	99	151	16,112	cyclictest	11752	-21	wc	23:45:53	0
30251	99	151	15,25	cyclictest	32542	-21	apt-get	19:20:17	0
30251	99	151	14,112	cyclictest	16623	-21	find	00:15:55	0
30251	99	151	13,114	cyclictest	27757	-21	apt-get	22:11:49	0
30251	99	151	12,115	cyclictest	15768	-21	wc	00:10:55	0
30251	99	151	10,115	cyclictest	12876	-21	sh	23:55:01	0
30251	99	150	17,110	cyclictest	14846	-21	memory	00:05:49	0
30251	99	150	16,112	cyclictest	5647	-21	apt	23:10:00	0
30251	99	150	14,98	cyclictest	8643	-21	awk	23:25:57	0
30251	99	150	14,111	cyclictest	4527	-21	wc	23:00:55	0
30251	99	149	9,59	cyclictest	17936	-21	uname	21:10:43	0
30251	99	149	8,117	cyclictest	12687	-21	grep	20:35:59	0
30251	99	149	22,99	cyclictest	16164	-21	apt-get	21:00:21	0
30251	99	149	16,110	cyclictest	21276	-21	apt	21:30:13	0
30251	99	149	15,23	cyclictest	17197	-21	memory	21:05:45	0
30251	99	149	15,112	cyclictest	591	-21	munin-run	22:40:02	0
30251	99	149	15,111	cyclictest	13986	-21	memory	20:45:44	0
30251	99	149	14,112	cyclictest	7816	-21	mailstats	23:20:58	0
30251	99	149	12,23	cyclictest	1926	-21	sort	19:30:46	0
30251	99	149	11,116	cyclictest	25060	-21	grep	21:50:54	0
30251	99	149	10,42	cyclictest	9622	-21	systemctl	20:20:02	0
30251	99	148	21,100	cyclictest	6515	-21	apt-get	20:00:24	0
30251	99	148	16,24	cyclictest	4337	-21	memory	19:45:42	0
30251	99	148	16,109	cyclictest	1472	-21	sort	19:26:02	0
30251	99	148	13,114	cyclictest	23843	-21	kworker/u2:13	21:45:05	0
30251	99	148	10,116	cyclictest	31710	-21	apt-get	19:15:37	0
30251	99	147	21,99	cyclictest	23054	-21	apt-get	21:40:19	0
30251	99	147	21,101	cyclictest	12951	-21	apt-get	20:40:18	0
30251	99	147	16,24	cyclictest	31863	-21	snmpd	20:11:05	0
30251	99	147	14,92	cyclictest	28997	-21	diskstats	22:15:39	0
30251	99	147	12,113	cyclictest	3520	-21	kernelversion	22:55:43	0
30251	99	147	12,110	cyclictest	9993	-21	latency	23:35:42	0
30251	99	146	17,26	cyclictest	27173	-21	diskstats	22:05:35	0
30251	99	146	15,26	cyclictest	2779	-21	memory	22:50:51	0
30251	99	146	13,35	cyclictest	9276	-21	awk	23:30:49	0
30251	99	146	13,24	cyclictest	7547	-21	/usr/sbin/munin	20:05:44	0
30251	99	146	12,108	cyclictest	5564	-21	sshd	19:51:42	0
30251	99	145	16,89	cyclictest	12026	-21	apt	20:35:02	0
30251	99	144	15,26	cyclictest	17146	-21	diskstats	00:20:36	0
30251	99	144	14,23	cyclictest	15198	-21	users	20:51:07	0
30251	99	142	17,26	cyclictest	5849	-21	df	23:10:28	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17