OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rackfslot4s.osadl.org (updated Mon Nov 17, 2025 00:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
10792	2	132	0,3	sleep0	10794	-21	grep	20:30:27	0
5666	2	115	0,3	chrt	5667	-21	sh	21:22:12	0
9026	2	108	0,2	chrt	9024	-21	swap	00:22:24	0
23215	2	108	0,2	chrt	23216	-21	sleep	20:54:59	0
15009	2	102	0,1	sleep0	15011	-21	cut	23:35:52	0
18114	2	94	0,2	sleep0	18116	-21	basename	21:45:01	0
26531	2	91	0,2	sleep0	26532	-21	timerwakeupswit	22:57:25	0
4454	2	88	0,2	sleep0	4453	-21	sort	00:15:05	0
18603	2	87	0,2	sleep0	18604	-21	ld	19:41:11	0
2710	2	86	0,2	sleep0	2713	-21	sort	20:15:06	0
18208	2	80	0,2	sleep0	18206	-21	grep	22:42:19	0
5352	2	76	0,2	sleep0	5355	-21	irqrtprio	00:16:07	0
20208	2	70	0,2	sleep0	20211	-21	tail	19:45:26	0
23075	2	69	0,2	sleep0	23077	-21	cut	23:50:34	0
2801	2	67	0,1	sleep0	2802	-21	sh	21:17:05	0
12656	2	67	0,2	sleep0	12657	-21	latency_hist	21:35:05	0
32497	2	66	0,1	sleep0	32499	-21	ntp_states	21:12:16	0
2331	2	66	0,2	sleep0	2329	-21	threads	23:12:18	0
16933	2	65	0,2	sleep0	16931	-21	ntp_kernel_err	00:36:20	0
28598	2	61	0,2	sleep0	28599	-21	aten2.4_rfpower	21:05:25	0
5302	2	58	3,44	sleep0	5359	-21	sleep	22:20:05	0
23857	2	56	3,8	sleep0	23868	-21	/usr/sbin/munin	19:51:25	0
11224	2	56	0,2	sleep0	11225	-21	cat	00:26:46	0
639	2	55	0,1	sleep0	640	-21	hddtemp_smartct	20:10:38	0
4838	2	55	2,7	sleep0	4847	-21	cut	19:15:24	0
30499	2	55	3,42	sleep0	30564	-21	aten2.4_rfpower	23:05:38	0
13303	2	55	2,7	sleep0	13305	-21	ssh	21:36:01	0
25662	2	54	2,8	sleep0	25677	-21	apt-config	23:55:12	0
13257	2	53	0,2	sleep0	13255	-21	aten2.4_rfpower	00:30:38	0
27769	2	52	3,39	sleep0	27849	-21	grep	20:00:29	0
25171	2	50	3,38	sleep0	25177	-21	ld	21:56:35	0
18504	2	50	4,7	sleep0	17971	-21	apt-get	20:45:52	0
16049	2	49	0,2	chrt	16041	-21	ssh	22:39:15	0
9225	2	48	0,2	sleep0	9226	-21	sh	21:28:49	0
795	2	48	11,21	sleep0	797	-21	ntpq	19:05:55	0
6485	2	48	3,37	sleep0	6494	-21	ssh	22:21:16	0
4711	2	48	0,3	chrt	4692	-21	ntpq	23:16:45	0
28121	2	48	3,36	sleep0	28125	-21	ntp_states	22:01:55	0
2152	90	48	20,21	cyclictest	0	-21	swapper	22:29:39	0
2152	90	48	19,22	cyclictest	0	-21	swapper	23:25:53	0
2152	90	48	18,14	cyclictest	0	-21	swapper	23:02:49	0
19068	2	48	2,39	sleep0	18991	-21	ssh	23:42:22	0
8729	2	47	2,6	sleep0	8731	-21	ssh	23:24:47	0
2152	90	47	15,15	cyclictest	0	-21	swapper	21:47:38	0
2152	90	46	17,22	cyclictest	0	-21	swapper	22:13:42	0
6646	2	45	0,2	chrt	6647	-21	sh	20:21:14	0
2152	90	45	20,18	cyclictest	30215	-21	sshd	00:02:24	0
2152	90	44	6,10	cyclictest	13349	-21	df	20:35:29	0
2152	90	44	5,19	cyclictest	23428	-21	ntp_states	22:52:10	0
2152	90	44	21,16	cyclictest	0	-21	swapper	21:00:34	0
2152	90	44	17,19	cyclictest	21737	-21	rm	23:47:24	0
2152	90	43	5,29	cyclictest	29604	-21	seq	22:05:29	0
2152	90	43	17,19	cyclictest	0	-21	swapper	23:34:57	0
2152	90	43	15,21	cyclictest	0	-21	swapper	22:33:52	0
2152	90	42	5,20	cyclictest	21166	-21	/usr/sbin/munin	21:51:17	0
2152	90	42	5,18	cyclictest	16380	-21	sed	19:36:28	0
2152	90	42	16,10	cyclictest	30841	-21	diskmemload	00:08:56	0
2152	90	42	12,23	cyclictest	0	-21	swapper	22:48:59	0
2152	90	41	18,15	cyclictest	0	-21	swapper	19:20:31	0
2152	90	41	14,20	cyclictest	0	-21	swapper	19:26:23	0
16090	2	41	0,2	sleep0	16091	-21	smartctl	20:40:41	0
2152	90	40	5,27	cyclictest	30121	-21	/usr/sbin/munin	20:05:44	0
2152	90	40	4,10	cyclictest	27418	-21	munin-run	20:00:02	0
2152	90	39	3,9	cyclictest	3291	-21	ntpq	19:10:59	0
2152	90	39	14,7	cyclictest	24739	-21	python3	20:56:23	0
2152	90	37	6,11	cyclictest	8489	-21	hddtemp_smartct	20:25:40	0
2152	90	37	4,26	cyclictest	13544	-21	ntpq	19:31:14	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39