OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack5slot7s.osadl.org (updated Mon May 18, 2026 00:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1566	2	2433	2189,98	sleep0	0	-21	swapper	19:07:05	0
1938	99	165	13,23	cyclictest	24202	-21	munin-run	21:25:05	0
1938	99	163	11,129	cyclictest	22442	-21	sort	00:27:03	0
1938	99	161	15,120	cyclictest	22665	-21	/usr/sbin/munin	21:15:16	0
1938	99	161	13,25	cyclictest	14697	-21	latency_hist	23:45:04	0
1938	99	160	39,101	cyclictest	27923	-21	latency_hist	21:45:03	0
1938	99	160	17,25	cyclictest	2032	-21	/usr/sbin/munin	19:10:56	0
1938	99	159	18,117	cyclictest	20036	-21	wc	00:15:05	0
1938	99	159	17,118	cyclictest	4247	-21	apt-get	19:25:32	0
1938	99	159	13,122	cyclictest	11746	-21	wc	20:10:05	0
1938	99	158	19,26	cyclictest	17433	-21	apt-get	00:00:19	0
1938	99	158	16,26	cyclictest	2979	-21	df	19:15:23	0
1938	99	157	13,122	cyclictest	24689	-21	cut	21:26:13	0
1938	99	156	19,95	cyclictest	15924	-21	munin-run	20:35:01	0
1938	99	156	16,39	cyclictest	30258	-21	munin-run	22:00:03	0
1938	99	156	10,121	cyclictest	12066	-21	cut	23:25:59	0
1938	99	155	17,116	cyclictest	16724	-21	munin-run	20:40:01	0
1938	99	155	15,98	cyclictest	10071	-21	munin-run	20:00:02	0
1938	99	154	38,24	cyclictest	12245	-21	/usr/sbin/munin	20:10:58	0
1938	99	154	17,111	cyclictest	6641	-21	munin-run	22:55:02	0
1938	99	154	16,115	cyclictest	31869	-21	munin-run	22:10:01	0
1938	99	154	15,22	cyclictest	13068	-21	munin-run	23:35:00	0
1938	99	153	31,22	cyclictest	3556	-21	apt-get	19:20:19	0
1938	99	153	18,23	cyclictest	14687	-21	apt-get	23:46:24	0
1938	99	153	17,113	cyclictest	17313	-21	munin-run	00:00:02	0
1938	99	153	17,109	cyclictest	15819	-21	apt-get	23:50:28	0
1938	99	153	17,108	cyclictest	30378	-21	apt-get	22:00:17	0
1938	99	153	16,36	cyclictest	26822	-21	munin-run	21:40:02	0
1938	99	153	14,21	cyclictest	19124	-21	apt-get	20:55:34	0
1938	99	153	14,115	cyclictest	13872	-21	munin-run	23:40:03	0
1938	99	153	12,19	cyclictest	15067	-21	grep	20:27:04	0
1938	99	152	17,22	cyclictest	21580	-21	munin-run	00:25:03	0
1938	99	152	14,24	cyclictest	546	-21	memory	22:15:46	0
1938	99	151	21,28	cyclictest	10894	-21	diskstats	23:20:33	0
1938	99	151	16,23	cyclictest	32080	-21	diskstats	22:10:33	0
1938	99	151	16,110	cyclictest	18527	-21	df	20:50:25	0
1938	99	151	14,118	cyclictest	20799	-21	sort	00:20:04	0
1938	99	151	14,111	cyclictest	4180	-21	sed	22:36:00	0
1938	99	151	12,114	cyclictest	10156	-21	cat	23:15:41	0
1938	99	150	21,27	cyclictest	23501	-21	apt-get	00:35:21	0
1938	99	150	18,27	cyclictest	5252	-21	df	22:45:28	0
1938	99	150	16,110	cyclictest	18886	-21	users	00:06:05	0
1938	99	150	13,21	cyclictest	29325	-21	sort	21:51:02	0
1938	99	150	10,24	cyclictest	20699	-21	grep	21:01:03	0
1938	99	150	10,117	cyclictest	5829	-21	cut	19:31:04	0
1938	99	149	17,92	cyclictest	7443	-21	munin-run	23:00:03	0
1938	99	149	16,24	cyclictest	22113	-21	memory	21:10:45	0
1938	99	149	16,105	cyclictest	17639	-21	apt-get	20:45:17	0
1938	99	149	15,94	cyclictest	3150	-21	sshd	22:30:56	0
1938	99	149	14,23	cyclictest	4355	-21	apt-get	22:40:17	0
1938	99	149	13,115	cyclictest	6864	-21	munin-run	19:40:03	0
1938	99	149	13,113	cyclictest	22813	-21	df_inode	00:30:38	0
1938	99	149	10,40	cyclictest	7451	-21	mailstats	19:40:59	0
1938	99	148	15,19	cyclictest	28076	-21	diskstats	21:45:41	0
1938	99	148	13,25	cyclictest	9575	-21	zcat	23:10:57	0
1938	99	148	10,115	cyclictest	21513	-21	awk	21:05:59	0
1938	99	147	28,19	cyclictest	8435	-21	cstates	23:05:23	0
1938	99	147	18,106	cyclictest	10429	-21	memory	20:00:43	0
1938	99	147	13,25	cyclictest	7882	-21	df_inode	19:45:29	0
1938	99	147	13,24	cyclictest	13296	-21	sendmail	20:20:02	0
1938	99	147	10,24	cyclictest	14031	-21	sed	20:21:04	0
1938	99	146	9,114	cyclictest	17331	-21	cut	20:40:59	0
1938	99	146	36,89	cyclictest	8902	-21	open_files	19:50:53	0
1938	99	146	15,47	cyclictest	2254	-21	ntp_states	22:25:50	0
1938	99	144	14,23	cyclictest	7885	-21	/usr/sbin/munin	23:00:51	0
1938	99	142	16,25	cyclictest	1241	-21	df	22:20:28	0
1938	99	142	11,107	cyclictest	26101	-21	cat	21:35:06	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17