OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack5slot7s.osadl.org (updated Sun Jul 13, 2025 00:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
30456	2	2440	2198,96	sleep0	0	-21	swapper	19:06:07	0
30985	99	159	17,26	cyclictest	18340	-21	apt-get	21:05:23	0
30985	99	159	13,26	cyclictest	7659	-21	apt-get	23:21:32	0
30985	99	158	17,118	cyclictest	31081	-21	munin-run	22:25:03	0
30985	99	158	13,121	cyclictest	6816	-21	users	23:11:11	0
30985	99	157	20,24	cyclictest	17751	-21	apt-get	00:21:07	0
30985	99	156	21,110	cyclictest	672	-21	apt-get	19:20:30	0
30985	99	156	20,111	cyclictest	30264	-21	munin-run	22:20:04	0
30985	99	156	11,27	cyclictest	4384	-21	ps	19:40:59	0
30985	99	155	18,24	cyclictest	1009	-21	apt	22:40:01	0
30985	99	155	16,24	cyclictest	4453	-21	diskstats	23:00:32	0
30985	99	155	15,119	cyclictest	26246	-21	apt	21:55:02	0
30985	99	155	12,118	cyclictest	8809	-21	/usr/sbin/munin	23:25:39	0
30985	99	154	16,24	cyclictest	9738	-21	apt-get	20:15:36	0
30985	99	154	15,115	cyclictest	13255	-21	latency_hist	20:35:05	0
30985	99	154	13,117	cyclictest	23829	-21	modprobe	21:40:02	0
30985	99	154	13,114	cyclictest	29458	-21	latency_hist	22:15:03	0
30985	99	154	11,26	cyclictest	16790	-21	ntp_kernel_pll_	20:55:50	0
30985	99	154	10,120	cyclictest	21102	-21	grep	00:36:03	0
30985	99	153	27,105	cyclictest	0	-21	swapper	21:22:32	0
30985	99	153	18,31	cyclictest	7054	-21	df	23:15:29	0
30985	99	153	16,111	cyclictest	3307	-21	diskstats	19:35:36	0
30985	99	153	12,26	cyclictest	18970	-21	wc	00:25:29	0
30985	99	153	11,24	cyclictest	21975	-21	find	21:25:59	0
30985	99	153	11,100	cyclictest	16251	-21	apt	00:10:13	0
30985	99	152	37,94	cyclictest	15698	-21	memory	00:05:48	0
30985	99	152	18,111	cyclictest	17188	-21	apt-get	21:00:59	0
30985	99	152	17,21	cyclictest	13950	-21	diskstats	23:55:36	0
30985	99	152	13,39	cyclictest	24609	-21	sed	21:41:06	0
30985	99	152	11,117	cyclictest	5034	-21	apt-get	23:06:36	0
30985	99	152	10,118	cyclictest	4028	-21	wc	22:56:02	0
30985	99	151	9,119	cyclictest	10906	-21	apt-get	20:20:21	0
30985	99	151	19,28	cyclictest	14107	-21	apt-get	20:40:23	0
30985	99	151	13,24	cyclictest	2513	-21	diskstats	19:30:35	0
30985	99	150	9,116	cyclictest	2292	-21	grep	22:45:53	0
30985	99	150	21,29	cyclictest	19240	-21	diskstats	21:10:33	0
30985	99	150	18,104	cyclictest	4817	-21	apt-get	19:45:22	0
30985	99	150	17,106	cyclictest	1136	-21	apt-get	22:40:17	0
30985	99	150	15,111	cyclictest	8354	-21	df	20:05:36	0
30985	99	150	13,23	cyclictest	15331	-21	wc	20:45:58	0
30985	99	150	12,114	cyclictest	20666	-21	grep	21:20:04	0
30985	99	150	11,116	cyclictest	7103	-21	apt-get	20:01:38	0
30985	99	149	35,20	cyclictest	31794	-21	grep	22:26:08	0
30985	99	149	28,100	cyclictest	0	-21	swapper	19:16:11	0
30985	99	149	21,101	cyclictest	9911	-21	df_inode	23:30:55	0
30985	99	149	17,23	cyclictest	26445	-21	df	21:55:25	0
30985	99	149	17,22	cyclictest	0	-21	swapper	20:50:36	0
30985	99	149	16,23	cyclictest	1614	-21	apt-get	19:25:16	0
30985	99	149	11,39	cyclictest	9471	-21	wc	20:11:02	0
30985	99	149	11,115	cyclictest	31657	-21	grep	19:11:06	0
30985	99	149	10,27	cyclictest	28655	-21	apt	22:10:01	0
30985	99	148	27,22	cyclictest	6964	-21	timerandwakeup	19:56:04	0
30985	99	148	18,102	cyclictest	14661	-21	apt-get	00:00:17	0
30985	99	148	15,108	cyclictest	17756	-21	munin-run	00:20:02	0
30985	99	147	8,24	cyclictest	25023	-21	grep	21:45:46	0
30985	99	147	16,109	cyclictest	13987	-21	munin-run	20:40:02	0
30985	99	147	14,26	cyclictest	3140	-21	gzip	22:50:59	0
30985	99	147	12,114	cyclictest	6332	-21	wc	19:55:04	0
30985	99	147	11,112	cyclictest	12324	-21	wc	23:45:27	0
30985	99	147	10,41	cyclictest	10871	-21	memory	23:35:54	0
30985	99	146	17,104	cyclictest	11939	-21	memory	20:25:45	0
30985	99	146	11,24	cyclictest	268	-21	snmpd	23:55:04	0
30985	99	146	11,112	cyclictest	22454	-21	diskstats	21:30:32	0
30985	99	146	10,98	cyclictest	32606	-21	grep	22:31:07	0
30985	99	145	16,105	cyclictest	27267	-21	df	22:00:28	0
30985	99	145	15,20	cyclictest	0	-21	swapper	23:40:57	0
30985	99	145	11,109	cyclictest	19935	-21	/usr/sbin/munin	00:30:44	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17