OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rackfslot4s.osadl.org (updated Fri Mar 21, 2025 00:46:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
32376	2	121	0,3	chrt	32373	-21	awk	23:41:10	0
17851	2	118	0,3	chrt	17848	-21	ntpq	23:11:56	0
22443	2	117	0,2	chrt	22441	-21	apt-config	22:15:12	0
10797	2	117	0,3	chrt	10788	-21	ntpq	00:03:29	0
5484	2	116	0,2	chrt	5485	-21	sh	20:33:04	0
22035	2	112	0,2	chrt	21886	-21	sendmail-msp	23:20:13	0
16770	2	111	0,2	chrt	16765	-21	ntpq	19:50:49	0
6361	2	110	0,3	chrt	6362	-21	ssh	23:55:10	0
5825	2	110	0,2	chrt	5827	-21	cut	21:41:06	0
3699	2	108	0,2	chrt	3700	-21	sh	19:23:50	0
1481	2	105	0,2	sleep0	1480	-21	cut	20:25:34	0
8462	2	100	0,2	chrt	8463	-21	sh	20:39:54	0
20160	2	90	0,2	sleep0	20158	-21	if_can0	22:10:54	0
18789	2	88	0,2	sleep0	18791	-21	wc	00:20:07	0
25753	2	87	0,2	sleep0	25754	-21	cat	00:35:04	0
6240	2	86	0,2	sleep0	6241	-21	ls	23:55:02	0
10648	2	85	0,1	sleep0	10650	-21	irqrtprio	21:51:06	0
14510	2	80	0,1	sleep0	14511	-21	latency_hist	23:05:15	0
28706	90	79	14,19	cyclictest	32321	-21	latency_hist	21:30:04	0
28706	90	77	6,20	cyclictest	7107	-21	diskstats	22:50:41	0
28706	90	77	4,25	cyclictest	4755	-21	ntpq	22:45:17	0
28706	90	73	15,9	cyclictest	13309	-21	ssh	00:10:14	0
29112	2	72	0,2	sleep0	29115	-21	cp	23:35:14	0
26276	2	70	11,45	sleep0	26262	-21	apt-get	19:05:17	0
27263	2	60	0,1	sleep0	27264	-21	sh	23:31:12	0
2426	2	54	0,2	sleep0	2428	-21	basename	22:40:01	0
32502	2	51	0,4	sleep0	32499	-21	ssh	21:30:24	0
31193	2	51	0,3	chrt	31191	-21	/usr/sbin/munin	20:20:46	0
28706	90	50	20,23	cyclictest	0	-21	swapper	00:09:59	0
28706	90	50	20,22	cyclictest	0	-21	swapper	23:09:08	0
28706	90	50	18,23	cyclictest	0	-21	swapper	22:55:07	0
21383	2	49	0,2	chrt	21380	-21	smartctl	00:25:32	0
28706	90	48	5,13	cyclictest	13870	-21	ntp_states	19:44:24	0
28706	90	48	20,21	cyclictest	0	-21	swapper	21:48:51	0
28706	90	47	18,22	cyclictest	0	-21	swapper	23:47:21	0
28706	90	47	13,27	cyclictest	9861	-21	seq	20:41:59	0
28706	90	46	18,21	cyclictest	0	-21	swapper	22:33:58	0
19644	2	46	0,2	sleep0	19646	-21	fschecks_time	00:21:56	0
28706	90	45	5,21	cyclictest	19970	-21	memory	21:02:02	0
28706	90	44	6,11	cyclictest	27035	-21	ntpq	22:23:44	0
28706	90	44	17,21	cyclictest	0	-21	swapper	21:13:30	0
28706	90	44	16,21	cyclictest	0	-21	swapper	23:26:44	0
27086	2	44	0,2	sleep0	27087	-21	rm	00:36:36	0
28706	90	43	5,18	cyclictest	30212	-21	ntp_states	21:24:34	0
28706	90	43	15,10	cyclictest	10126	-21	latency	19:35:48	0
28706	90	43	13,23	cyclictest	0	-21	swapper	22:28:58	0
28706	90	43	13,23	cyclictest	0	-21	swapper	21:39:18	0
28706	90	42	6,17	cyclictest	24294	-21	memory	20:05:47	0
28706	90	42	5,18	cyclictest	20758	-21	sendmail-msp	20:00:58	0
28706	90	42	5,17	cyclictest	7734	-21	ntpq	19:30:58	0
28706	90	42	5,11	cyclictest	28110	-21	munin-run	21:20:07	0
28706	90	42	5,11	cyclictest	18637	-21	munin-run	21:00:04	0
28706	90	42	4,10	cyclictest	17449	-21	sh	22:04:42	0
28706	90	41	4,9	cyclictest	5355	-21	ntp_states	19:26:18	0
28706	90	41	4,9	cyclictest	26759	-21	irqstats	20:10:48	0
28706	90	41	19,15	cyclictest	0	-21	swapper	21:58:53	0
28706	90	41	13,21	cyclictest	28650	-21	apt-get	19:10:53	0
28706	90	41	12,23	cyclictest	0	-21	swapper	22:07:11	0
28706	90	40	5,28	cyclictest	29275	-21	irqstats	20:15:41	0
28706	90	40	4,17	cyclictest	14017	-21	/usr/sbin/munin	20:50:32	0
28706	90	40	4,10	cyclictest	20664	-21	ntpq	23:17:01	0
28706	90	39	7,11	cyclictest	19348	-21	sshd	19:55:55	0
28706	90	39	4,17	cyclictest	11166	-21	/usr/sbin/munin	20:45:49	0
28706	90	39	12,10	cyclictest	11653	-21	sendmail-msp	19:45:15	0
28706	90	39	11,19	cyclictest	0	-21	swapper	21:07:30	0
28706	90	38	6,11	cyclictest	5195	-21	users	22:45:32	0
28706	90	38	4,28	cyclictest	32039	-21	hddtemp_smartct	19:15:37	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39