OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rackfslot4s.osadl.org (updated Fri Nov 07, 2025 00:44:35)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
10509	2	116	0,2	chrt	10510	-21	fschecks_time	23:35:51	0
3293	2	114	0,2	chrt	3294	-21	sleep	20:25:32	0
3095	2	114	0,3	chrt	3096	-21	sleep	00:20:44	0
28536	2	114	0,2	chrt	28537	-21	sleep	22:12:01	0
17261	2	114	0,3	chrt	17262	-21	sh	21:51:49	0
13243	2	112	0,2	chrt	13244	-21	ld	19:40:59	0
13230	2	112	0,2	chrt	13231	-21	sleep	23:40:50	0
6190	2	109	0,2	sleep0	6191	-21	cat	23:27:17	0
31845	2	109	0,2	chrt	31846	-21	sh	22:17:45	0
27682	2	109	0,2	chrt	27683	-21	vmstat	23:08:09	0
20900	2	96	0,2	sleep0	20898	-21	latency	22:56:14	0
19419	2	95	0,2	sleep0	19420	-21	cat	21:56:03	0
26629	2	89	0,2	sleep0	26630	-21	ssh	22:08:57	0
26812	2	88	0,2	sleep0	26815	-21	sed	00:05:14	0
15097	2	87	0,2	sleep0	15099	-21	grep	19:45:34	0
27773	2	82	9,56	sleep0	27774	-21	ntp_states	19:05:53	0
4058	2	71	0,2	sleep0	4059	-21	sh	22:26:11	0
9627	2	56	0,1	sleep0	9628	-21	rm	21:38:22	0
25029	2	54	0,2	sleep0	25030	-21	ld	00:01:24	0
29133	90	51	18,24	cyclictest	0	-21	swapper	21:34:29	0
29133	90	51	18,23	cyclictest	0	-21	swapper	19:26:27	0
1428	2	51	2,6	sleep0	1408	-21	ssh	22:21:22	0
12634	2	51	3,8	sleep0	12644	-21	ntpq	22:41:23	0
9830	2	50	0,2	sleep0	9833	-21	grep	00:32:16	0
3496	2	50	0,2	sleep0	3498	-21	processes	21:27:17	0
29133	90	50	19,23	cyclictest	0	-21	swapper	23:54:58	0
21453	2	50	0,3	chrt	21451	-21	/usr/sbin/munin	23:55:36	0
968	2	49	0,2	chrt	966	-21	/usr/sbin/munin	21:22:29	0
32462	2	49	0,2	chrt	32447	-21	ssh	00:15:31	0
29133	90	49	18,23	cyclictest	0	-21	swapper	00:26:01	0
29133	90	49	17,23	cyclictest	0	-21	swapper	00:39:49	0
29133	90	48	18,23	cyclictest	0	-21	swapper	23:34:48	0
29133	90	48	18,23	cyclictest	0	-21	swapper	21:48:25	0
29133	90	47	18,22	cyclictest	0	-21	swapper	23:22:35	0
29133	90	47	18,21	cyclictest	0	-21	swapper	23:02:56	0
29133	90	47	17,23	cyclictest	0	-21	swapper	00:13:19	0
29133	90	47	17,21	cyclictest	0	-21	swapper	21:12:42	0
29133	90	47	16,22	cyclictest	0	-21	swapper	21:19:03	0
8238	2	46	0,2	chrt	8236	-21	ld	19:31:11	0
29133	90	46	17,21	cyclictest	0	-21	swapper	23:10:10	0
29133	90	45	5,20	cyclictest	14258	-21	ntp_states	20:46:15	0
29133	90	45	18,20	cyclictest	0	-21	swapper	22:48:11	0
29133	90	45	16,22	cyclictest	0	-21	swapper	22:54:09	0
29133	90	44	5,11	cyclictest	32630	-21	memory	23:16:58	0
10363	2	44	0,2	sleep0	10405	-21	idleruntime-cro	20:40:01	0
29133	90	43	16,9	cyclictest	24778	-21	latency_hist	20:05:04	0
29133	90	43	13,14	cyclictest	0	-21	swapper	22:38:05	0
29133	90	43	12,21	cyclictest	0	-21	swapper	22:00:07	0
29133	90	42	6,29	cyclictest	449	-21	apt-get	20:21:13	0
29133	90	42	3,20	cyclictest	30812	-21	ntpq	19:12:04	0
29133	90	42	15,9	cyclictest	6573	-21	ntpq	20:31:06	0
29133	90	42	15,20	cyclictest	17091	-21	processes	23:47:09	0
29133	90	42	14,12	cyclictest	7633	-21	timerwakeupswit	22:32:23	0
29133	90	42	14,10	cyclictest	25836	-21	ntpq	20:05:58	0
29133	90	42	11,25	cyclictest	20915	-21	apt-get	21:00:34	0
29133	90	41	4,28	cyclictest	10430	-21	sshd	21:40:26	0
29133	90	41	17,16	cyclictest	0	-21	swapper	19:20:39	0
29133	90	41	10,13	cyclictest	0	-21	swapper	20:55:08	0
29133	90	40	4,17	cyclictest	31156	-21	irqstats	20:16:40	0
29133	90	40	4,10	cyclictest	28431	-21	ntpq	20:11:04	0
29133	90	40	16,7	cyclictest	16363	-21	sed	20:50:45	0
29133	90	39	4,9	cyclictest	557	-21	ntpq	19:16:04	0
29133	90	39	4,28	cyclictest	20741	-21	ntpq	19:55:52	0
29133	90	39	14,18	cyclictest	17424	-21	aten2.4_rfpower	19:50:25	0
29133	90	38	13,11	cyclictest	23849	-21	grep	21:05:33	0
29133	90	37	8,11	cyclictest	11663	-21	ld	20:41:07	0
29133	90	36	5,11	cyclictest	9704	-21	sh	19:35:22	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39