OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack5slot7s.osadl.org (updated Sun May 24, 2026 00:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
29474	2	2434	2201,88	sleep0	0	-21	swapper	19:08:20	0
29706	99	168	17,126	cyclictest	23517	-21	apt-get	21:52:01	0
29706	99	164	18,118	cyclictest	1559	-21	users	19:31:06	0
29706	99	161	15,121	cyclictest	13887	-21	irqstats	00:06:11	0
29706	99	159	12,28	cyclictest	30933	-21	/usr/sbin/munin	19:16:09	0
29706	99	158	13,120	cyclictest	16161	-21	/usr/sbin/munin	00:21:10	0
29706	99	157	33,103	cyclictest	15616	-21	tr	00:15:50	0
29706	99	156	15,118	cyclictest	32463	-21	apt	19:25:00	0
29706	99	155	9,123	cyclictest	6067	-21	df_inode	20:00:28	0
29706	99	155	20,29	cyclictest	2371	-21	diskstats	22:55:35	0
29706	99	155	18,113	cyclictest	32162	-21	users	22:36:05	0
29706	99	155	10,120	cyclictest	528	-21	grep	19:25:58	0
29706	99	154	19,23	cyclictest	3975	-21	find	19:47:00	0
29706	99	154	13,40	cyclictest	25560	-21	modprobe	22:00:01	0
29706	99	154	13,115	cyclictest	8924	-21	grep	20:16:07	0
29706	99	154	12,119	cyclictest	2825	-21	awk	19:40:51	0
29706	99	153	23,108	cyclictest	22825	-21	kworker/u2:0	22:00:20	0
29706	99	153	18,111	cyclictest	14153	-21	irqstats	20:50:37	0
29706	99	153	16,113	cyclictest	12640	-21	grep	20:40:44	0
29706	99	152	39,22	cyclictest	14907	-21	if_err_eth0	20:55:34	0
29706	99	152	16,26	cyclictest	10670	-21	munin-run	20:30:03	0
29706	99	152	16,23	cyclictest	30022	-21	df_inode	22:25:29	0
29706	99	152	14,114	cyclictest	12572	-21	cron	00:00:00	0
29706	99	152	12,21	cyclictest	7094	-21	apt-get	23:25:14	0
29706	99	152	11,116	cyclictest	13853	-21	/usr/sbin/munin	20:46:10	0
29706	99	152	10,117	cyclictest	23519	-21	pluginstate	21:50:05	0
29706	99	151	30,23	cyclictest	2075	-21	head	22:51:03	0
29706	99	151	17,24	cyclictest	26367	-21	apt-get	22:06:10	0
29706	99	151	17,23	cyclictest	29221	-21	df	22:20:27	0
29706	99	151	16,111	cyclictest	29000	-21	munin-run	22:20:02	0
29706	99	151	14,25	cyclictest	11386	-21	/usr/sbin/munin	23:50:49	0
29706	99	151	14,115	cyclictest	27492	-21	/usr/sbin/munin	22:10:43	0
29706	99	151	12,115	cyclictest	30513	-21	munin-node	19:15:05	0
29706	99	151	11,115	cyclictest	21031	-21	unixbench_singl	21:31:01	0
29706	99	151	10,27	cyclictest	7972	-21	zcat	20:10:55	0
29706	99	151	10,119	cyclictest	12784	-21	systemd-journal	00:33:10	0
29706	99	150	17,108	cyclictest	10543	-21	memory	23:45:47	0
29706	99	150	16,23	cyclictest	3364	-21	ntpq	23:00:48	0
29706	99	150	16,108	cyclictest	18820	-21	apt-get	21:20:16	0
29706	99	150	12,114	cyclictest	19246	-21	apt	00:40:01	0
29706	99	150	12,113	cyclictest	11694	-21	/usr/sbin/munin	20:35:34	0
29706	99	150	11,116	cyclictest	16218	-21	grep	21:01:02	0
29706	99	150	10,25	cyclictest	18415	-21	find	21:15:57	0
29706	99	150	10,116	cyclictest	512	-21	head	22:41:02	0
29706	99	149	19,104	cyclictest	14539	-21	apt-get	00:10:27	0
29706	99	149	17,109	cyclictest	6176	-21	munin-run	23:20:03	0
29706	99	149	17,107	cyclictest	9508	-21	apt-get	23:40:15	0
29706	99	149	17,106	cyclictest	3877	-21	apt-get	23:05:16	0
29706	99	149	11,116	cyclictest	28293	-1	kworker/u3:0	22:45:15	0
29706	99	149	11,114	cyclictest	20301	-21	modprobe	21:30:01	0
29706	99	149	10,114	cyclictest	17365	-21	irqstats	21:10:39	0
29706	99	148	37,22	cyclictest	6824	-21	cstates	20:05:22	0
29706	99	148	19,27	cyclictest	16508	-21	diskstats	21:05:33	0
29706	99	148	15,110	cyclictest	21861	-21	users	21:36:07	0
29706	99	148	15,109	cyclictest	6539	-21	memory	23:20:42	0
29706	99	148	12,24	cyclictest	5106	-21	mailstats	23:10:55	0
29706	99	147	22,100	cyclictest	5003	-21	users	19:51:13	0
29706	99	147	20,100	cyclictest	30714	-21	apt-get	22:30:20	0
29706	99	147	17,104	cyclictest	12826	-21	diskstats	00:00:34	0
29706	99	147	13,109	cyclictest	8356	-21	awk	23:30:59	0
29706	99	147	11,95	cyclictest	9181	-21	/usr/sbin/munin	20:20:12	0
29706	99	147	11,24	cyclictest	11334	-21	sort	20:31:00	0
29706	99	146	18,27	cyclictest	8796	-21	diskstats	23:35:32	0
29706	99	146	18,103	cyclictest	1700	-21	apt-get	19:35:20	0
29706	99	146	12,27	cyclictest	17633	-21	sshd	00:27:10	0
29706	99	145	16,23	cyclictest	5239	-21	df	19:55:25	0
29706	99	145	13,25	cyclictest	22697	-21	sshd	21:41:10	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17