OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rackfslot4s.osadl.org (updated Tue Nov 25, 2025 00:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
16908	2	145	0,2	sleep0	16910	-21	cut	21:05:43	0
32375	2	120	0,2	chrt	32377	-21	uname	22:31:08	0
5534	2	119	0,2	sleep0	5593	-21	aten2.4_rfpower	19:40:26	0
28849	2	119	0,3	chrt	28837	-21	ntpq	19:21:06	0
26482	2	119	0,4	chrt	26478	-21	ntpq	00:17:04	0
31215	2	118	0,3	chrt	31214	-21	/usr/sbin/munin	20:30:28	0
31482	2	117	0,2	chrt	31483	-21	sh	21:32:09	0
12432	2	116	0,2	chrt	12433	-21	sh	19:53:27	0
25525	2	115	0,2	chrt	25523	-21	ld	23:17:05	0
3949	2	114	0,2	chrt	3950	-21	fschecks_time	20:40:36	0
19320	2	114	0,3	chrt	19318	-21	ld	20:06:01	0
31800	2	112	0,2	chrt	31801	-21	sh	00:26:29	0
18331	2	109	0,2	sleep0	18332	-21	sendmail_mailtr	00:02:13	0
29311	2	107	0,2	sleep0	29313	-21	if_err_eth1	22:26:00	0
24184	2	106	0,2	chrt	24185	-21	sleep	00:12:47	0
12038	2	106	0,2	sleep0	12040	-21	missed_timers	20:55:50	0
26063	2	105	0,2	chrt	26065	-21	wc	19:15:45	0
6522	2	104	0,2	chrt	6523	-21	sleep	22:43:04	0
15675	2	100	0,3	chrt	15677	-21	ntp_kernel_pll_	22:01:32	0
3291	2	94	0,2	sleep0	3292	-21	sh	21:40:12	0
28319	2	94	0,2	sleep0	28320	-21	ssh	21:26:26	0
14252	2	94	0,2	sleep0	14253	-21	ld	22:56:38	0
13517	2	94	0,1	sleep0	13516	-21	awk	19:56:14	0
6362	2	90	0,2	sleep0	6361	-21	basename	21:45:35	0
3313	2	88	0,2	sleep0	3315	-21	fschecks_time	19:35:37	0
22355	2	83	0,1	sleep0	22357	-21	wc	23:11:12	0
19305	2	77	0,2	sleep0	19302	-21	hddtemp_smartct	21:10:58	0
26022	2	72	0,1	sleep0	26021	-21	awk	21:22:21	0
30524	2	71	0,2	sleep0	30527	-21	latency_hist	00:25:04	0
1278	2	64	0,2	sleep0	1281	-21	cut	21:36:05	0
11229	2	63	0,2	sleep0	11230	-21	rm	23:50:18	0
24186	2	62	0,1	sleep0	24188	-21	grep	20:15:48	0
8142	2	54	0,1	sleep0	8200	-21	ls	23:45:05	0
9885	2	53	2,6	sleep0	9875	-21	ssh	23:47:16	0
26276	2	52	0,3	sleep0	26266	-21	ssh	22:20:52	0
19041	2	51	0,3	sleep0	19035	-21	ssh	22:07:46	0
21644	2	50	0,3	chrt	21642	-21	/usr/sbin/munin	22:12:08	0
11548	2	50	3,39	sleep0	11544	-21	ntp_states	22:51:46	0
8893	2	49	3,39	sleep0	8889	-21	ntpq	19:45:51	0
15388	2	49	3,37	sleep0	15380	-21	ntpq	23:57:05	0
22553	90	47	18,14	cyclictest	0	-21	swapper	23:23:35	0
22553	90	47	15,24	cyclictest	0	-21	swapper	23:39:43	0
22553	90	46	19,20	cyclictest	0	-21	swapper	00:38:45	0
22553	90	46	16,22	cyclictest	0	-21	swapper	23:08:12	0
20383	2	46	11,19	sleep0	20404	-21	df	19:05:24	0
1877	2	46	2,37	sleep0	1883	-21	ssh	00:31:10	0
2307	2	45	2,36	sleep0	2295	-21	ssh	22:35:57	0
22553	90	45	17,21	cyclictest	0	-21	swapper	21:50:31	0
22553	90	45	16,22	cyclictest	0	-21	swapper	22:18:24	0
22553	90	44	17,20	cyclictest	0	-21	swapper	23:34:54	0
22553	90	44	14,23	cyclictest	0	-21	swapper	21:59:37	0
22553	90	43	6,19	cyclictest	23710	-21	ntpq	19:11:01	0
22553	90	43	5,19	cyclictest	21802	-21	ntpq	20:10:56	0
22553	90	43	15,22	cyclictest	0	-21	swapper	22:48:14	0
22553	90	43	13,22	cyclictest	0	-21	swapper	21:17:50	0
22553	90	42	5,18	cyclictest	15849	-21	ssh	23:00:26	0
22553	90	42	4,17	cyclictest	1811	-21	irqstats	20:35:45	0
22553	90	42	4,12	cyclictest	30665	-21	memory	23:26:11	0
22553	90	42	12,23	cyclictest	0	-21	swapper	00:08:33	0
2481	2	41	1,32	sleep0	0	-21	swapper	19:34:10	0
22553	90	41	5,18	cyclictest	30587	-21	df_inode	19:25:30	0
22553	90	41	14,9	cyclictest	25920	-21	runrttasks	20:20:20	0
22553	90	40	4,8	cyclictest	16888	-21	ntpq	20:01:13	0
22553	90	40	17,16	cyclictest	14612	-21	ntpq	21:00:51	0
22553	90	39	4,26	cyclictest	6377	-21	df_inode	20:45:31	0
22553	90	39	11,22	cyclictest	9826	-21	ps	20:51:21	0
22553	90	38	14,17	cyclictest	30684	-21	runrttasks	20:29:44	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39