OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack5slot7s.osadl.org (updated Tue Apr 07, 2026 00:45:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
15343	2	2442	2181,98	sleep0	0	-21	swapper	19:05:07	0
16616	99	161	13,122	cyclictest	30177	-21	munin-plugin-st	23:50:01	0
16616	99	160	17,120	cyclictest	5741	-21	munin-run	00:40:03	0
16616	99	160	13,123	cyclictest	29358	-21	sendmail-mta	20:30:01	0
16616	99	159	11,122	cyclictest	10768	-21	apt-get	21:56:41	0
16616	99	158	14,119	cyclictest	7180	-21	grep	21:30:49	0
16616	99	158	13,102	cyclictest	25781	-21	grep	23:20:47	0
16616	99	157	20,27	cyclictest	17040	-21	apt-get	22:30:24	0
16616	99	157	15,118	cyclictest	22704	-21	munin-run	19:50:01	0
16616	99	156	22,108	cyclictest	25289	-21	apt-get	20:05:32	0
16616	99	156	19,23	cyclictest	32582	-21	modprobe	00:05:00	0
16616	99	156	18,95	cyclictest	13956	-21	memory	22:11:24	0
16616	99	156	18,112	cyclictest	25363	-21	munin-run	23:20:02	0
16616	99	156	17,112	cyclictest	22804	-21	apt-get	19:50:19	0
16616	99	155	20,107	cyclictest	3425	-21	apt-get	21:10:17	0
16616	99	155	15,24	cyclictest	5692	-21	/usr/sbin/munin	21:21:56	0
16616	99	155	12,42	cyclictest	20900	-21	cut	22:50:59	0
16616	99	154	15,21	cyclictest	24549	-21	apt	23:15:01	0
16616	99	154	15,115	cyclictest	8318	-21	users	21:36:01	0
16616	99	154	14,116	cyclictest	28651	-21	wc	20:25:05	0
16616	99	154	13,116	cyclictest	31188	-21	df_inode	20:40:29	0
16616	99	154	13,116	cyclictest	2154	-21	ntpq	21:00:53	0
16616	99	153	8,120	cyclictest	31284	-21	sort	23:55:41	0
16616	99	153	33,103	cyclictest	911	-21	munin-run	20:55:01	0
16616	99	153	22,108	cyclictest	17998	-21	apt-get	22:35:20	0
16616	99	153	21,28	cyclictest	8486	-21	apt-get	21:40:21	0
16616	99	153	18,23	cyclictest	21913	-21	munin-run	23:00:03	0
16616	99	153	16,113	cyclictest	14543	-21	apt-get	22:15:24	0
16616	99	153	15,111	cyclictest	16926	-21	sort	22:30:07	0
16616	99	152	15,27	cyclictest	19594	-21	/usr/sbin/munin	19:30:12	0
16616	99	152	14,114	cyclictest	1457	-21	find	00:10:57	0
16616	99	152	11,117	cyclictest	28160	-21	tr	23:35:48	0
16616	99	152	10,121	cyclictest	30148	-21	modprobe	20:35:00	0
16616	99	152	10,120	cyclictest	4953	-21	kworker/u2:8	21:20:04	0
16616	99	151	9,117	cyclictest	26703	-21	wc	23:25:56	0
16616	99	151	41,89	cyclictest	2877	-21	missed_timers	21:06:12	0
16616	99	151	23,24	cyclictest	10770	-21	munin-run	21:55:04	0
16616	99	151	17,24	cyclictest	21216	-21	apt-get	19:40:12	0
16616	99	151	13,23	cyclictest	25081	-21	users	20:01:22	0
16616	99	151	12,24	cyclictest	27756	-21	readlink	20:20:02	0
16616	99	151	12,114	cyclictest	16894	-21	uname	19:10:40	0
16616	99	150	19,21	cyclictest	0	-21	swapper	22:10:05	0
16616	99	150	19,105	cyclictest	6186	-21	diskstats	21:25:42	0
16616	99	150	18,110	cyclictest	26345	-21	df	20:10:32	0
16616	99	150	17,25	cyclictest	1925	-21	df_inode	00:15:26	0
16616	99	150	17,25	cyclictest	1251	-21	memory	20:55:45	0
16616	99	150	12,40	cyclictest	22649	-21	grep	23:01:03	0
16616	99	150	12,114	cyclictest	24013	-21	awk	19:55:54	0
16616	99	149	20,102	cyclictest	2764	-21	diskstats	00:20:34	0
16616	99	149	12,97	cyclictest	32581	-21	cat	20:50:04	0
16616	99	149	10,114	cyclictest	19284	-21	mailstats	22:40:56	0
16616	99	148	21,100	cyclictest	19728	-21	diskstats	22:45:34	0
16616	99	148	18,27	cyclictest	4485	-21	memory	00:30:43	0
16616	99	148	11,112	cyclictest	15812	-21	awk	22:20:57	0
16616	99	148	10,40	cyclictest	12633	-21	sort	22:05:03	0
16616	99	148	10,25	cyclictest	663	-21	sendmail_mailqu	00:05:56	0
16616	99	147	43,83	cyclictest	27742	-21	sshd	23:31:23	0
16616	99	147	35,20	cyclictest	18732	-21	latency_hist	19:25:04	0
16616	99	147	17,25	cyclictest	30957	-21	apt	20:40:02	0
16616	99	147	11,27	cyclictest	30695	-21	zcat	23:50:54	0
16616	99	147	10,115	cyclictest	19413	-21	grep	19:26:02	0
16616	99	146	14,106	cyclictest	3449	-21	apt-get	00:25:20	0
16616	99	146	12,25	cyclictest	23245	-21	rt-features	23:05:56	0
16616	99	145	17,25	cyclictest	20504	-21	diskstats	19:35:33	0
16616	99	144	10,24	cyclictest	9282	-21	apt-get	21:45:10	0
16616	99	143	17,26	cyclictest	17420	-21	munin-node	19:15:11	0
16616	99	143	12,105	cyclictest	28687	-21	/usr/sbin/munin	23:40:25	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17