OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackfslot4s.osadl.org (updated Thu May 21, 2026 00:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
14383	2	120	0,2	chrt	13200	-21	/usr/sbin/munin	23:16:18	0
10262	2	120	0,2	chrt	9371	-21	/usr/sbin/munin	19:50:44	0
8600	2	117	0,2	chrt	8595	-21	df_inode	20:40:31	0
15994	2	117	0,2	chrt	15993	-21	/usr/sbin/munin	00:07:13	0
26449	2	116	0,2	sleep0	26450	-21	aten2.4-expect	19:25:22	0
16893	2	116	0,3	chrt	16891	-21	ntpq	20:01:13	0
7751	2	115	0,3	chrt	7750	-21	awk	23:06:14	0
13466	2	115	0,2	chrt	13465	-21	/usr/sbin/munin	21:38:04	0
24472	2	113	0,2	chrt	24463	-21	ps	21:05:44	0
21103	2	112	0,2	chrt	21100	-21	ld	23:26:20	0
12630	2	112	0,3	chrt	12631	-21	sshd	23:14:08	0
15928	2	111	0,2	chrt	15929	-21	sleep	21:41:21	0
16632	2	110	0,2	chrt	16633	-21	seq	23:20:25	0
14381	2	110	0,2	chrt	14382	-21	sleep	20:50:03	0
6946	2	107	0,2	chrt	6947	-21	sleep	23:53:49	0
13909	2	107	0,2	sleep0	13911	-21	cut	19:56:24	0
3267	2	105	0,2	chrt	3270	-21	sed	22:11:11	0
23156	2	105	0,2	chrt	23157	-21	runrttasks	00:17:52	0
32714	2	102	0,2	chrt	32715	-21	sleep	21:18:26	0
5157	2	101	0,2	sleep0	5158	-21	seq	21:25:56	0
5960	2	97	0,2	sleep0	5961	-21	seq	23:04:03	0
5558	2	97	0,2	sleep0	5559	-21	seq	19:43:29	0
20811	2	96	0,2	sleep0	20812	-21	chrt	21:49:16	0
1994	2	96	0,2	sleep0	1995	-21	seq	22:10:04	0
17426	2	95	0,2	sleep0	17428	-21	ls	20:55:03	0
27368	2	94	0,2	sleep0	27369	-21	ssh	21:59:06	0
27350	2	93	0,2	sleep0	27351	-21	chrt	21:10:46	0
29962	2	88	0,2	sleep0	29964	-21	chrt	00:28:13	0
23840	2	88	0,2	sleep0	23843	-21	cpu	23:30:56	0
1592	2	85	0,3	chrt	1501	-21	ntp_states	22:57:11	0
28431	2	82	0,2	sleep0	28433	-21	cut	23:37:15	0
29459	2	81	0,3	chrt	29431	-21	ntpq	22:01:47	0
7880	2	79	0,1	sleep0	7881	-21	stty	23:55:35	0
31406	2	79	0,2	sleep0	31407	-21	chrt	20:25:15	0
16848	90	79	6,62	cyclictest	19810	-21	ntpq	20:05:59	0
32231	2	78	0,1	sleep0	32234	-21	latency_hist	22:55:05	0
10643	2	77	0,2	sleep0	10644	-21	seq	21:34:12	0
2322	2	75	0,2	sleep0	2325	-21	sed	23:46:52	0
16848	90	75	5,49	cyclictest	26272	-21	users	00:22:23	0
16848	90	74	5,58	cyclictest	21046	-21	diskstats	21:00:33	0
16848	90	74	5,47	cyclictest	23027	-21	df_inode	22:41:07	0
16848	90	74	4,59	cyclictest	412	-21	snmpd	22:26:10	0
16848	90	74	4,59	cyclictest	27870	-21	munin-run	20:20:03	0
16848	90	73	6,47	cyclictest	670	-21	munin-run	23:45:05	0
16848	90	73	6,47	cyclictest	27760	-21	users	22:47:27	0
16848	90	73	5,58	cyclictest	2326	-21	seq	21:21:15	0
15706	2	73	8,53	sleep0	15710	-21	sleep	19:07:03	0
16848	90	72	6,56	cyclictest	18889	-21	ssh	22:35:10	0
16848	90	72	5,46	cyclictest	7600	-21	ntpq	19:46:18	0
16848	90	72	16,45	cyclictest	12408	-21	rm	00:01:41	0
16848	90	71	5,56	cyclictest	18733	-21	ssh	00:11:10	0
16848	90	71	4,58	cyclictest	10209	-21	ssh	22:21:36	0
16848	90	71	4,56	cyclictest	2025	-21	ssh	00:35:24	0
16848	90	71	3,9	cyclictest	22535	-21	ld	21:51:18	0
16848	90	70	6,55	cyclictest	5631	-21	hddtemp_smartct	20:35:38	0
16848	90	70	5,56	cyclictest	31048	-21	cat	00:30:15	0
16848	90	70	5,55	cyclictest	15600	-21	apt-get	22:30:19	0
16848	90	70	4,56	cyclictest	6697	-21	ntpq	22:16:21	0
16848	90	70	4,56	cyclictest	17551	-21	apt-get	20:55:12	0
16848	90	70	4,10	cyclictest	18458	-21	python3	19:11:22	0
16848	90	70	3,57	cyclictest	30101	-21	sed	19:30:41	0
16848	90	69	6,51	cyclictest	20081	-21	apt-get	19:15:18	0
16848	90	69	5,9	cyclictest	28420	-21	diskstats	20:20:33	0
16848	90	69	5,55	cyclictest	2499	-21	fschecks_time	20:30:36	0
16848	90	69	4,55	cyclictest	23769	-21	sleep	19:20:39	0
16848	90	69	3,58	cyclictest	24762	-21	seq	20:15:01	0
16848	90	68	4,55	cyclictest	934	-21	cut	19:35:45	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39