OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot4s.osadl.org (updated Thu Dec 18, 2025 00:44:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3411	2	123	0,2	sleep0	3412	-21	/usr/sbin/munin	21:30:56	0
13186	2	121	0,2	chrt	13187	-21	sort	00:11:24	0
1557	2	120	0,2	chrt	1558	-21	runrttasks	21:27:43	0
13863	2	120	0,2	sleep0	13954	-21	cut	21:46:05	0
11937	2	120	0,3	chrt	11935	-21	ld	22:31:25	0
4448	2	119	0,2	chrt	4148	-21	apt-get	19:51:05	0
9482	2	118	0,3	chrt	9481	-21	sed	21:40:09	0
21000	2	118	0,2	chrt	20994	-21	ntpq	21:56:32	0
29373	2	115	0,3	chrt	29378	-21	tr	21:21:05	0
8738	2	114	0,4	chrt	8739	-21	runrttasks	19:56:26	0
3061	2	114	0,3	chrt	3062	-21	rm	23:06:55	0
9380	2	113	0,3	chrt	9381	-21	sleep	22:27:28	0
24659	2	113	0,2	chrt	24661	-21	sed	23:40:04	0
23446	2	113	0,2	sleep0	23449	-21	open_files	21:12:23	0
15774	2	113	0,2	chrt	15760	-21	ntpq	19:16:05	0
30089	2	110	0,2	chrt	30090	-21	runrttasks	20:30:56	0
27579	2	110	0,3	chrt	27580	-21	chrt	23:44:14	0
25671	2	110	0,2	chrt	25670	-21	seq	22:03:56	0
17783	2	110	0,2	chrt	17785	-21	runrttasks	23:29:40	0
19727	2	109	0,2	chrt	19728	-21	ssh	22:43:17	0
22040	2	108	0,1	sleep0	22041	-21	runrttasks	00:24:31	0
314	2	107	0,2	sleep0	316	-21	seq	23:02:40	0
2133	2	107	0,3	chrt	2134	-21	ld	19:46:19	0
11367	2	107	0,3	chrt	11368	-21	ssh	00:08:19	0
7526	2	105	0,3	chrt	7527	-21	sleep	23:14:01	0
11010	2	104	0,2	chrt	11011	-21	runrttasks	23:19:25	0
21207	2	102	0,3	chrt	21208	-21	sh	21:09:20	0
5791	2	96	0,2	sleep0	5793	-21	grep	20:45:03	0
30123	2	96	0,1	sleep0	30124	-21	chrt	19:40:04	0
25903	2	93	0,2	sleep0	25904	-21	chrt	00:30:09	0
32158	2	92	0,2	sleep0	32156	-21	if_err_eth1	23:51:00	0
22179	2	84	0,1	sleep0	22180	-21	/usr/sbin/munin	22:46:50	0
15000	2	82	0,2	sleep0	15001	-21	chrt	22:36:06	0
18511	2	80	0,3	sleep0	18508	-21	ssh	21:52:44	0
2990	2	72	0,1	sleep0	2991	-21	chrt	22:18:07	0
27494	2	70	0,2	sleep0	27496	-21	cut	22:55:32	0
27102	2	65	0,1	sleep0	27103	-21	seq	19:35:21	0
23474	2	65	0,2	sleep0	23476	-21	ssh	00:26:29	0
18131	2	65	0,2	sleep0	18132	-21	seq	21:04:25	0
2953	2	63	0,3	sleep0	2955	-21	ls	23:55:59	0
26944	2	60	0,1	sleep0	26947	-21	aten2.4_rfpower	22:05:55	0
22046	2	57	4,8	sleep0	22066	-21	ntpq	19:26:09	0
13621	2	57	0,2	sleep0	13624	-21	chrt	20:05:26	0
7746	2	56	0,1	sleep0	7747	-21	chrt	00:02:38	0
22858	2	56	4,8	sleep0	22816	-21	apt-get	20:20:20	0
10184	2	54	3,7	sleep0	10200	-21	ntp_offset	20:51:08	0
4960	2	53	0,1	sleep0	4963	-21	cut	22:21:06	0
5946	2	51	0,2	sleep0	5947	-21	chrt	20:45:22	0
16762	2	50	0,2	sleep0	16764	-21	cut	00:16:06	0
13310	2	50	0,2	sleep0	13322	-21	ls	20:05:02	0
30919	2	48	4,7	sleep0	30921	-21	sleep	23:49:19	0
14109	2	48	0,2	sleep0	14104	-21	sshd	19:14:10	0
8560	2	46	12,20	sleep0	8592	-21	hddtemp_smartct	19:05:26	0
29750	2	46	0,2	sleep0	29751	-21	chrt	22:10:06	0
11158	90	46	5,21	cyclictest	412	-21	snmpd	22:51:16	0
27908	2	45	0,3	sleep0	27909	-21	seq	20:27:28	0
12178	2	45	1,6	sleep0	12203	-21	ssh	23:21:02	0
11158	90	43	4,19	cyclictest	18209	-21	users	20:11:30	0
11158	90	43	4,10	cyclictest	19415	-21	ntpq	23:31:27	0
11158	90	42	4,11	cyclictest	27156	-21	seq	21:17:54	0
11158	90	42	4,10	cyclictest	29063	-21	apt-get	00:35:37	0
11158	90	41	18,15	cyclictest	0	-21	swapper	19:30:26	0
11158	90	40	4,11	cyclictest	13106	-21	ntpq	20:55:51	0
11158	90	40	15,19	cyclictest	9575	-21	apt-get	21:40:13	0
11158	90	40	14,10	cyclictest	20032	-21	diskstats	20:15:34	0
11158	90	39	13,17	cyclictest	17745	-21	apt-get	19:20:17	0
11158	90	36	5,12	cyclictest	32121	-21	apt-get	20:35:18	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39