OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rackfslot4s.osadl.org (updated Fri Jun 26, 2026 00:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
6487	2	124	0,3	chrt	6490	-21	sed	20:20:42	0
8677	2	123	0,2	sleep0	8678	-21	sh	21:16:01	0
30369	2	121	0,2	sleep0	30370	-21	seq	00:14:29	0
26242	2	121	0,2	sleep0	26245	-21	seq	23:19:23	0
2966	2	115	0,3	chrt	2275	-21	apt-get	20:16:03	0
32550	2	114	0,2	chrt	32546	-21	ps	00:17:16	0
25717	2	114	0,3	chrt	25718	-21	chrt	20:50:54	0
27238	2	112	0,2	chrt	27237	-21	/usr/sbin/munin	20:01:44	0
4511	2	111	0,2	sleep0	4509	-21	irqstats	22:46:08	0
22164	2	111	0,2	chrt	22165	-21	cat	20:45:43	0
9408	2	110	0,2	chrt	9409	-21	sh	00:31:13	0
3077	2	110	0,4	chrt	3078	-21	ls	21:06:29	0
1375	2	110	0,2	chrt	1366	-21	ssh	21:53:15	0
7169	2	109	0,1	sleep0	7170	-21	chrt	23:39:36	0
18394	2	108	0,3	chrt	18395	-21	sh	22:18:55	0
16408	2	108	0,1	sleep0	16409	-21	stty	19:45:22	0
12370	2	107	0,2	chrt	12368	-21	diskstats	20:30:31	0
22852	2	106	0,2	chrt	22853	-21	sleep	21:36:47	0
13839	2	104	0,3	chrt	13840	-21	seq	23:49:39	0
21789	2	96	0,2	sleep0	21792	-21	cut	00:01:11	0
12596	2	96	0,2	sleep0	12597	-21	chrt	22:58:32	0
17225	2	95	0,2	sleep0	17226	-21	chrt	21:28:33	0
3245	2	88	0,2	sleep0	3246	-21	chrt	23:33:08	0
9272	2	82	0,2	sleep0	9273	-21	chrt	20:25:32	0
9041	2	81	0,2	sleep0	9042	-21	sh	22:52:56	0
1737	2	77	0,2	sleep0	1738	-21	seq	00:20:20	0
27755	2	74	0,2	sleep0	27757	-21	cut	19:10:43	0
4989	2	73	0,2	sleep0	4988	-21	sshd	00:25:12	0
11669	2	70	0,2	sleep0	11670	-21	sh	22:08:49	0
25511	2	69	0,2	sleep0	25512	-21	cat	21:41:03	0
16148	2	69	0,2	sleep0	16151	-21	wc	19:45:02	0
15806	2	69	0,2	sleep0	15807	-21	irqrtprio	20:35:44	0
16972	2	65	0,2	sleep0	16974	-21	chrt	23:05:34	0
3980	2	63	0,2	sleep0	3981	-21	seq	21:57:09	0
26842	90	63	36,10	cyclictest	19732	-21	ssh	22:20:59	0
26842	90	62	32,12	cyclictest	8776	-21	ssh	23:41:19	0
26842	90	61	39,13	cyclictest	17784	-21	/usr/sbin/munin	23:55:35	0
26842	90	60	38,13	cyclictest	28317	-21	ntpq	23:21:58	0
26842	90	60	32,21	cyclictest	13433	-21	ssh	23:00:11	0
26842	90	59	37,14	cyclictest	11	-21	ksoftirqd/0	22:29:15	0
26842	90	59	37,13	cyclictest	28929	-21	apt-get	22:35:45	0
26842	90	59	33,17	cyclictest	18318	-21	apt-get	20:40:14	0
26842	90	59	32,21	cyclictest	11588	-21	ssh	00:35:06	0
26842	90	59	32,11	cyclictest	806	-21	ssh	22:40:59	0
26842	90	59	31,21	cyclictest	20637	-21	sshd	19:51:13	0
26842	90	59	31,21	cyclictest	15555	-21	ssh	23:51:37	0
26842	90	59	30,11	cyclictest	10062	-21	apt-get	19:35:15	0
6487	2	58	0,2	sleep0	6488	-21	seq	22:01:05	0
26842	90	58	37,13	cyclictest	12373	-21	apt-get	22:10:12	0
26842	90	58	32,19	cyclictest	21380	-21	ssh	23:11:29	0
25649	2	58	0,4	sleep0	25647	-21	ssh	00:06:49	0
26842	90	57	39,11	cyclictest	10401	-1	kworker/u3:2	21:32:20	0
26842	90	57	36,13	cyclictest	22491	-21	runrttasks	19:55:13	0
26842	90	57	35,15	cyclictest	27383	-21	ssh	22:32:04	0
26842	90	57	30,20	cyclictest	5806	-21	ssh	21:11:20	0
26842	90	56	36,12	cyclictest	28493	-21	/usr/sbin/munin	21:45:38	0
26842	90	56	35,14	cyclictest	12282	-21	cut	21:21:07	0
26842	90	56	35,12	cyclictest	32698	-21	chrt	20:10:46	0
26842	90	56	33,15	cyclictest	11	-21	ksoftirqd/0	21:00:24	0
26842	90	56	31,12	cyclictest	30490	-21	ssh	23:25:45	0
26842	90	55	35,14	cyclictest	7810	-21	cut	19:30:43	0
26842	90	55	35,13	cyclictest	1763	-21	/usr/sbin/munin	19:20:49	0
30725	2	54	0,3	sleep0	30726	-21	chrt	21:00:02	0
26842	90	54	35,12	cyclictest	3844	-21	/usr/sbin/munin	19:25:44	0
26842	90	54	34,13	cyclictest	30210	-21	python3	20:06:26	0
26842	90	53	34,11	cyclictest	30079	-21	sshd	19:15:12	0
24861	2	50	12,21	sleep0	24858	-21	ntpq	19:05:43	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39