OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack5slot7s.osadl.org (updated Mon Jun 08, 2026 00:45:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3411	2	2440	2199,98	sleep0	0	-21	swapper	19:07:52	0
3696	99	171	39,36	cyclictest	23357	-21	http	00:25:05	0
3696	99	168	19,124	cyclictest	22010	-21	diskstats	20:55:39	0
3696	99	167	18,123	cyclictest	794	-21	df_inode	22:05:29	0
3696	99	165	41,21	cyclictest	18543	-21	cstates	20:35:25	0
3696	99	160	16,26	cyclictest	21181	-21	sshd	20:50:39	0
3696	99	159	12,123	cyclictest	13144	-21	irqstats	23:20:38	0
3696	99	158	18,99	cyclictest	15728	-21	apt-get	20:21:17	0
3696	99	158	17,25	cyclictest	8486	-21	diskstats	19:35:39	0
3696	99	158	17,19	cyclictest	2990	-21	apt-get	22:20:36	0
3696	99	158	17,116	cyclictest	7248	-21	apt-get	19:31:04	0
3696	99	158	15,118	cyclictest	12856	-21	munin-run	23:20:02	0
3696	99	158	11,24	cyclictest	20611	-21	grep	20:46:02	0
3696	99	157	23,30	cyclictest	10050	-21	apt-get	19:45:32	0
3696	99	156	8,25	cyclictest	25177	-21	pluginstate	00:35:03	0
3696	99	156	43,22	cyclictest	4344	-21	latency	22:25:50	0
3696	99	156	20,28	cyclictest	16542	-21	ntp_states	23:40:52	0
3696	99	156	15,23	cyclictest	27023	-21	awk	21:25:48	0
3696	99	156	14,21	cyclictest	10451	-21	apt	23:05:00	0
3696	99	156	12,122	cyclictest	1779	-21	awk	22:10:50	0
3696	99	155	10,122	cyclictest	11020	-21	apt-get	19:50:20	0
3696	99	154	35,22	cyclictest	13075	-21	awk	20:00:58	0
3696	99	154	16,98	cyclictest	3657	-21	snmpd	23:46:02	0
3696	99	154	16,111	cyclictest	8936	-21	apt-get	22:55:19	0
3696	99	154	15,42	cyclictest	15733	-21	munin-run	20:20:02	0
3696	99	154	14,118	cyclictest	18474	-21	users	23:51:08	0
3696	99	154	11,26	cyclictest	25921	-21	wc	21:20:06	0
3696	99	154	10,120	cyclictest	9813	-21	head	19:41:04	0
3696	99	153	9,25	cyclictest	24995	-21	cron	21:15:01	0
3696	99	153	21,101	cyclictest	14225	-21	apt-get	20:10:21	0
3696	99	153	15,99	cyclictest	6798	-21	memory	19:25:46	0
3696	99	153	15,25	cyclictest	13431	-21	apt-get	20:05:20	0
3696	99	153	15,114	cyclictest	31393	-21	users	21:51:12	0
3696	99	153	11,26	cyclictest	7976	-21	grep	22:46:03	0
3696	99	153	11,118	cyclictest	14298	-21	sort	23:26:00	0
3696	99	153	10,39	cyclictest	12515	-21	systemctl	20:00:02	0
3696	99	153	10,120	cyclictest	6198	-21	awk	22:35:59	0
3696	99	153	10,118	cyclictest	24454	-21	latency_hist	00:30:04	0
3696	99	153	10,117	cyclictest	20092	-21	users	00:01:07	0
3696	99	152	31,19	cyclictest	29143	-21	/usr/sbin/munin	21:41:08	0
3696	99	152	17,110	cyclictest	2451	-21	irqstats	22:15:38	0
3696	99	152	15,22	cyclictest	29026	-21	munin-run	21:40:02	0
3696	99	152	15,107	cyclictest	8142	-21	apt-get	22:50:18	0
3696	99	152	14,98	cyclictest	32538	-21	uname	22:00:42	0
3696	99	152	14,38	cyclictest	12784	-21	systemd-journal	23:10:01	0
3696	99	152	14,23	cyclictest	21993	-21	irqstats	00:15:38	0
3696	99	151	23,106	cyclictest	10626	-21	kworker/u2:6	20:25:15	0
3696	99	151	19,104	cyclictest	14720	-21	diskstats	23:30:31	0
3696	99	151	12,116	cyclictest	3657	-21	snmpd	21:00:42	0
3696	99	151	12,115	cyclictest	7114	-21	wc	22:41:02	0
3696	99	150	23,21	cyclictest	0	-21	swapper	20:40:25	0
3696	99	150	16,112	cyclictest	17843	-21	irqstats	20:30:38	0
3696	99	150	16,104	cyclictest	29942	-21	apt-get	21:45:18	0
3696	99	150	15,25	cyclictest	18610	-21	/usr/sbin/munin	23:55:56	0
3696	99	150	14,23	cyclictest	32234	-21	munin-run	22:00:02	0
3696	99	149	29,97	cyclictest	5388	-21	cut	19:16:15	0
3696	99	149	16,109	cyclictest	3890	-21	df	19:10:23	0
3696	99	149	13,92	cyclictest	25572	-21	ntpq	00:35:48	0
3696	99	149	12,116	cyclictest	21646	-21	sed	00:11:05	0
3696	99	149	11,113	cyclictest	20863	-21	sed	00:06:05	0
3696	99	149	10,23	cyclictest	11517	-21	sshd	23:10:37	0
3696	99	148	17,26	cyclictest	16061	-21	users	23:36:04	0
3696	99	148	16,27	cyclictest	6076	-21	/usr/sbin/munin	19:20:50	0
3696	99	148	14,109	cyclictest	4937	-21	apt-get	22:30:18	0
3696	99	148	11,22	cyclictest	23813	-21	tr	21:05:47	0
3696	99	145	18,28	cyclictest	27639	-21	diskstats	21:30:34	0
3696	99	145	14,111	cyclictest	26555	-21	head	21:21:03	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17