OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack5slot7s.osadl.org (updated Mon Dec 01, 2025 00:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
25181	2	2434	2153,116	sleep0	0	-21	swapper	19:06:42	0
25603	99	164	21,114	cyclictest	5090	-21	apt-get	20:20:23	0
25603	99	164	14,20	cyclictest	32583	-21	awk	19:47:08	0
25603	99	161	15,122	cyclictest	30982	-21	munin-run	23:00:03	0
25603	99	160	16,120	cyclictest	13154	-21	/usr/sbin/munin	21:10:22	0
25603	99	160	10,128	cyclictest	112	-21	systemd-journal	21:55:00	0
25603	99	157	42,23	cyclictest	1167	-21	latency_hist	23:15:02	0
25603	99	157	17,23	cyclictest	30977	-21	apt-get	23:01:28	0
25603	99	157	15,41	cyclictest	19261	-21	/usr/sbin/munin	21:45:57	0
25603	99	157	11,124	cyclictest	16462	-21	wc	21:30:25	0
25603	99	156	13,115	cyclictest	16224	-21	grep	21:26:03	0
25603	99	155	17,114	cyclictest	7595	-21	diskstats	20:35:37	0
25603	99	155	15,38	cyclictest	14407	-21	munin-run	00:40:01	0
25603	99	154	17,98	cyclictest	10957	-21	apt-get	00:21:30	0
25603	99	154	12,120	cyclictest	27545	-21	munin-run	19:20:03	0
25603	99	154	12,117	cyclictest	7143	-21	memory	23:50:46	0
25603	99	154	11,119	cyclictest	3207	-21	grep	20:06:00	0
25603	99	153	37,20	cyclictest	12677	-21	sh	21:05:55	0
25603	99	153	17,111	cyclictest	32133	-21	apt-get	23:05:27	0
25603	99	153	13,27	cyclictest	29493	-21	sshd	22:50:25	0
25603	99	152	16,109	cyclictest	25873	-21	irqstats	19:10:42	0
25603	99	152	15,24	cyclictest	4154	-21	apt	20:15:00	0
25603	99	152	13,114	cyclictest	11105	-21	wc	20:55:56	0
25603	99	152	12,25	cyclictest	10957	-21	apt-get	00:20:01	0
25603	99	151	40,22	cyclictest	5123	-21	unixbench_singl	23:36:07	0
25603	99	151	17,24	cyclictest	26965	-21	apt	22:35:01	0
25603	99	151	16,111	cyclictest	27666	-21	apt-get	19:20:22	0
25603	99	151	15,25	cyclictest	25043	-21	proc_pri	22:20:53	0
25603	99	151	15,23	cyclictest	2199	-21	sshd	23:20:27	0
25603	99	151	14,113	cyclictest	3804	-21	diskstats	23:30:35	0
25603	99	151	13,26	cyclictest	14379	-21	sendmail_mailqu	21:15:57	0
25603	99	151	13,115	cyclictest	27887	-21	/usr/sbin/munin	22:40:26	0
25603	99	151	12,116	cyclictest	6322	-21	mailstats	20:25:57	0
25603	99	151	12,112	cyclictest	29257	-21	/usr/sbin/munin	19:30:24	0
25603	99	151	10,25	cyclictest	26016	-21	threads	22:26:02	0
25603	99	150	29,18	cyclictest	0	-21	swapper	20:45:55	0
25603	99	150	17,26	cyclictest	27068	-21	apt-get	22:35:19	0
25603	99	150	16,23	cyclictest	7804	-21	df_inode	23:55:29	0
25603	99	150	12,27	cyclictest	5456	-21	if_eth0	23:40:37	0
25603	99	150	12,119	cyclictest	12109	-21	apt-get	00:25:15	0
25603	99	150	11,27	cyclictest	23402	-21	ps	22:10:55	0
25603	99	149	19,29	cyclictest	2895	-21	apt-get	23:25:21	0
25603	99	149	16,107	cyclictest	30058	-21	apt-get	19:35:21	0
25603	99	149	12,114	cyclictest	10376	-21	awk	20:50:58	0
25603	99	149	12,113	cyclictest	13604	-21	munin-run	00:35:00	0
25603	99	149	10,116	cyclictest	21335	-21	tr	22:00:02	0
25603	99	148	27,101	cyclictest	17176	-21	sshd	21:35:05	0
25603	99	148	19,26	cyclictest	4497	-21	memory	20:15:45	0
25603	99	148	15,46	cyclictest	28804	-21	diskstats	22:45:34	0
25603	99	148	15,24	cyclictest	31577	-21	munin-run	19:45:01	0
25603	99	148	14,25	cyclictest	6688	-21	sshd	20:30:23	0
25603	99	148	13,113	cyclictest	1745	-21	munin-run	20:00:03	0
25603	99	148	12,112	cyclictest	24083	-21	memory	22:15:47	0
25603	99	148	11,49	cyclictest	15219	-21	/usr/sbin/munin	21:20:57	0
25603	99	147	9,115	cyclictest	12171	-21	grep	21:01:04	0
25603	99	147	17,24	cyclictest	28777	-21	ntp_states	19:25:49	0
25603	99	147	16,103	cyclictest	9763	-21	ntp_states	00:10:48	0
25603	99	147	12,113	cyclictest	1317	-21	sshd	23:15:23	0
25603	99	146	12,22	cyclictest	6777	-21	sshd	23:46:23	0
25603	99	145	15,24	cyclictest	8446	-21	df	20:40:28	0
25603	99	145	14,89	cyclictest	9219	-21	munin-run	00:05:00	0
25603	99	145	12,112	cyclictest	30060	-1	kworker/u3:3	19:50:17	0
25603	99	144	31,93	cyclictest	22078	-21	unixbench_singl	22:01:04	0
25603	99	144	12,110	cyclictest	18271	-21	missed_timers	21:40:47	0
25603	99	144	11,109	cyclictest	22830	-21	timerwakeupswit	22:06:03	0
25603	99	143	17,102	cyclictest	1968	-21	df	20:00:28	0
25603	99	140	8,108	cyclictest	9385	-21	cat	00:10:04	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17