OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackfslot4s.osadl.org (updated Thu Sep 17, 2026 12:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
13002	2	138	0,2	sleep0	13003	-21	seq	10:17:12	0
3285	2	127	0,2	chrt	3283	-21	sort	10:50:49	0
30316	2	124	0,3	chrt	28598	-21	/usr/sbin/munin	10:42:09	0
19925	2	124	0,3	chrt	19924	-21	/usr/sbin/munin	11:15:48	0
9281	2	123	0,2	chrt	9260	-21	ntpq	10:11:27	0
7075	2	122	0,2	chrt	7070	-21	users	07:36:30	0
3324	2	121	0,2	chrt	3316	-21	ntpq	10:02:54	0
21326	2	121	0,3	chrt	21323	-21	ntpq	08:50:56	0
27256	2	119	0,3	chrt	27257	-21	sleep	12:15:35	0
20419	2	118	0,3	chrt	20420	-21	runrttasks	10:28:30	0
4408	2	115	0,2	chrt	4407	-21	seq	12:29:55	0
7267	2	113	0,2	chrt	7268	-21	runrttasks	10:08:48	0
7382	2	112	0,2	sleep0	7417	-21	grep	11:45:48	0
382	2	112	0,3	chrt	383	-21	seq	12:23:36	0
14250	2	112	0,2	chrt	14249	-21	sshd	11:06:41	0
6176	2	109	0,3	chrt	6177	-21	runrttasks	11:43:42	0
12678	2	109	0,3	chrt	12680	-21	sort	11:05:04	0
26449	2	108	0,2	sleep0	26450	-21	chrt	12:14:13	0
9460	2	106	0,3	chrt	9461	-21	seq	09:23:13	0
24958	2	106	0,4	chrt	24959	-21	seq	10:34:45	0
18495	2	106	0,2	chrt	18496	-21	runrttasks	11:13:11	0
16002	2	104	0,2	sleep0	16003	-21	seq	11:58:26	0
8957	2	98	0,2	sleep0	8961	-21	sed	12:36:06	0
32284	2	96	0,2	sleep0	32285	-21	chrt	11:34:25	0
23453	2	95	0,2	sleep0	23454	-21	seq	09:44:57	0
19038	2	95	0,2	sleep0	19039	-21	seq	07:05:20	0
1134	2	87	0,2	sleep0	1135	-21	date	10:00:08	0
16431	2	83	0,2	sleep0	16433	-21	cut	10:22:13	0
26621	2	78	0,1	sleep0	26619	-21	fschecks_count	11:25:49	0
22614	2	78	0,1	sleep0	22617	-21	fschecks_time	07:10:36	0
30153	2	76	0,2	sleep0	30210	-21	latency_hist	09:55:05	0
17663	2	76	0,1	sleep0	17664	-21	seq	08:45:39	0
25986	2	73	0,2	sleep0	25988	-21	sort	11:25:03	0
14935	2	73	0,2	sleep0	14936	-21	chrt	09:31:18	0
29401	2	72	0,2	sleep0	29404	-21	basename	09:05:00	0
6528	2	69	0,2	sleep0	6530	-21	switchtime	12:32:18	0
31720	2	63	0,1	sleep0	31721	-21	missed_timers	08:15:50	0
6649	2	62	9,44	sleep0	6707	-21	cut	10:55:50	0
21480	2	60	0,2	sleep0	21481	-21	grep	08:00:23	0
28487	2	58	0,3	sleep0	28489	-21	aten2.4_rfpower	07:20:23	0
28435	2	58	0,2	sleep0	28438	-21	cut	08:10:44	0
25287	2	58	0,2	sleep0	25290	-21	seq	09:47:01	0
2106	2	57	0,2	sleep0	2105	-21	find	07:30:07	0
10605	2	57	0,1	sleep0	10660	-21	aten2.4-expect	09:25:33	0
360	2	55	0,2	sleep0	361	-21	seq	09:10:34	0
23332	2	55	0,2	sleep0	23340	-21	seq	08:55:11	0
25435	2	54	3,41	sleep0	25502	-21	runrttasks	07:15:25	0
18344	2	54	7,6	sleep0	18338	-21	ssh	09:36:29	0
12288	2	53	0,2	sleep0	12289	-21	aten2.4_rfpower	07:46:13	0
21988	90	52	19,26	cyclictest	0	-21	swapper	07:41:24	0
18074	2	52	7,6	sleep0	18062	-21	apt-get	07:55:13	0
30660	2	51	2,41	sleep0	30671	-21	ntpq	09:05:59	0
3788	2	50	0,4	chrt	3782	-21	apt-config	09:15:19	0
7984	2	49	8,6	sleep0	7790	-21	apt-get	08:30:41	0
24832	2	47	3,36	sleep0	24134	-21	apt-get	08:06:03	0
21988	90	47	21,19	cyclictest	0	-21	swapper	10:39:45	0
21988	90	47	18,21	cyclictest	0	-21	swapper	12:03:23	0
21988	90	47	17,23	cyclictest	0	-21	swapper	12:09:19	0
7537	2	46	0,1	sleep0	7536	-21	wc	08:30:06	0
32174	2	46	0,1	sleep0	32214	-21	aten2.4_rfpower	10:45:36	0
662	2	43	2,34	sleep0	660	-21	ssh	11:35:38	0
21988	90	43	6,19	cyclictest	10681	-21	diskstats	11:50:46	0
21988	90	43	4,10	cyclictest	15209	-21	ntpq	08:41:05	0
21988	90	41	4,18	cyclictest	14951	-21	/usr/sbin/munin	07:50:38	0
21988	90	41	16,18	cyclictest	1406	-21	/usr/sbin/munin	08:20:50	0
21988	90	39	7,12	cyclictest	11243	-21	df	08:35:28	0
21988	90	39	5,16	cyclictest	32691	-21	ntpq	07:26:08	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39