OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rackfslot4s.osadl.org (updated Sat Aug 30, 2025 00:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
31376	2	116	0,2	sleep0	31377	-21	mii-tool	00:31:02	0
26161	2	110	0,2	sleep0	26163	-21	processes	21:27:14	0
24406	2	110	0,2	chrt	24407	-21	sleep	22:21:39	0
29065	2	108	0,2	chrt	29063	-21	diskstats	22:30:45	0
2242	2	107	0,2	chrt	2243	-21	sleep	00:36:38	0
31242	2	106	0,1	sleep0	31243	-21	mailstats	23:32:13	0
12596	2	106	0,2	chrt	12597	-21	sleep	20:00:13	0
7254	2	103	0,2	chrt	7255	-21	sleep	20:51:53	0
25006	2	95	0,2	sleep0	25008	-21	latency_hist	00:20:05	0
31865	2	85	0,2	chrt	31850	-21	python3	21:37:21	0
2916	2	82	0,1	sleep0	2914	-21	ssh	22:41:22	0
25575	2	81	0,2	sleep0	25578	-21	grep	00:20:51	0
22956	2	80	0,2	sleep0	22958	-21	grep	23:17:12	0
19541	2	72	0,2	sleep0	19542	-21	grep	21:15:57	0
12690	2	72	0,2	sleep0	12691	-21	munin-plugin-st	23:00:00	0
12356	2	67	0,2	sleep0	12358	-21	grep	22:00:50	0
21163	2	61	0,1	sleep0	21197	-21	sh	23:15:00	0
24366	2	59	3,8	sleep0	24400	-21	ps	20:22:12	0
23162	2	54	3,9	sleep0	23157	-21	ntpq	21:21:51	0
28175	2	53	0,2	sleep0	28176	-21	aten2.4_rfpower	00:25:37	0
29122	2	52	5,8	sleep0	29119	-21	ntp_states	20:31:09	0
28732	2	52	5,38	sleep0	28723	-21	ntpq	21:31:50	0
1989	2	52	4,40	sleep0	1992	-21	ntp_states	21:42:02	0
3890	2	51	0,3	sleep0	3888	-21	ssh	23:41:19	0
27943	2	50	2,41	sleep0	27941	-21	ssh	23:26:13	0
21281	2	49	0,3	chrt	21278	-21	/usr/sbin/munin	22:16:05	0
19389	90	49	19,23	cyclictest	0	-21	swapper	21:49:55	0
17811	2	49	11,23	sleep0	17813	-21	memory	19:05:37	0
9703	2	48	4,35	sleep0	9656	-21	ssh	21:56:00	0
19389	90	48	18,23	cyclictest	0	-21	swapper	22:52:48	0
19389	90	48	17,24	cyclictest	0	-21	swapper	22:13:15	0
16183	2	48	4,34	sleep0	16187	-21	diskstats	23:05:43	0
13170	2	48	3,37	sleep0	13161	-21	ssh	23:00:30	0
19389	90	47	18,22	cyclictest	0	-21	swapper	23:54:30	0
19389	90	47	18,22	cyclictest	0	-21	swapper	21:53:02	0
14224	2	47	4,34	sleep0	14228	-21	df_inode	00:00:41	0
19389	90	46	17,22	cyclictest	0	-21	swapper	22:38:25	0
19389	90	46	17,22	cyclictest	0	-21	swapper	00:13:53	0
19389	90	46	15,24	cyclictest	0	-21	swapper	20:26:24	0
19389	90	44	15,22	cyclictest	0	-21	swapper	22:08:32	0
19389	90	43	19,18	cyclictest	24453	-21	cpu	23:20:38	0
19389	90	43	18,18	cyclictest	0	-21	swapper	22:49:17	0
19389	90	43	15,21	cyclictest	0	-21	swapper	00:08:30	0
19389	90	43	14,9	cyclictest	5507	-21	munin-run	20:50:00	0
19389	90	43	13,25	cyclictest	20406	-21	memory	19:10:48	0
19389	90	43	13,23	cyclictest	0	-21	swapper	23:48:42	0
19389	90	42	7,10	cyclictest	319	-21	df	23:35:38	0
19389	90	42	5,11	cyclictest	10851	-21	irqstats	19:55:44	0
19389	90	42	4,18	cyclictest	1056	-21	ntp_states	19:36:11	0
19389	90	42	16,20	cyclictest	26286	-21	df_inode	22:25:43	0
19389	90	42	12,14	cyclictest	0	-21	swapper	23:55:10	0
19389	90	41	4,11	cyclictest	29483	-21	apt-get	19:30:46	0
19389	90	41	4,11	cyclictest	17508	-21	ntpq	21:12:04	0
19389	90	41	4,11	cyclictest	16240	-21	ntp_states	20:06:09	0
19389	90	41	4,10	cyclictest	19119	-21	users	20:11:27	0
19389	90	40	5,10	cyclictest	859	-21	snmpd	19:28:55	0
19389	90	40	4,27	cyclictest	14824	-21	python3	21:06:24	0
19389	90	40	4,10	cyclictest	3379	-21	memory	19:40:49	0
19389	90	39	6,16	cyclictest	10555	-21	apt-get	21:00:27	0
19389	90	39	4,9	cyclictest	21146	-21	ntpq	20:15:56	0
19389	90	39	4,17	cyclictest	22533	-21	/usr/sbin/munin	19:15:38	0
19389	90	39	14,9	cyclictest	3077	-21	latency_hist	20:45:02	0
19389	90	39	14,17	cyclictest	4991	-21	apt-get	19:45:15	0
19389	90	38	4,17	cyclictest	25597	-21	ntpq	19:20:57	0
19389	90	38	16,13	cyclictest	8783	-21	/usr/sbin/munin	20:55:44	0
19389	90	38	12,10	cyclictest	0	-21	swapper	19:53:04	0
19389	90	37	6,11	cyclictest	31417	-21	memory	20:35:48	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39