OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rackfslot4s.osadl.org (updated Mon Oct 27, 2025 00:44:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
22512	2	128	0,2	sleep0	22514	-21	grep	20:15:26	0
3248	2	124	0,4	chrt	3229	-21	ssh	23:36:01	0
27162	2	124	0,3	chrt	26245	-21	apt-get	23:21:16	0
26137	2	121	0,3	chrt	26136	-21	ssh	21:23:33	0
31968	2	120	0,4	chrt	31972	-21	modprobe	23:30:00	0
5322	2	118	0,2	chrt	5319	-21	sleep	23:40:28	0
20012	2	116	0,2	chrt	20014	-21	mailstats	21:12:26	0
18622	2	109	0,2	chrt	18623	-21	ssh	22:07:46	0
10105	2	103	0,2	sleep0	10106	-21	fschecks_time	22:50:52	0
6364	2	100	0,3	chrt	6365	-21	sh	19:42:41	0
23115	2	97	0,2	sleep0	23116	-21	expr	22:16:24	0
20040	2	93	0,1	sleep0	20041	-21	grep	23:08:11	0
20808	2	92	0,2	sleep0	20810	-21	timerandwakeup	00:07:21	0
21685	2	89	0,2	sleep0	21683	-21	df	19:10:28	0
2942	2	82	0,2	chrt	2539	-21	apt-get	20:40:11	0
968	2	75	0,1	sleep0	969	-21	grep	00:30:51	0
21263	90	74	40,13	cyclictest	30062	-21	seq	22:28:00	0
21263	90	73	42,20	cyclictest	11661	-21	sshd	19:53:44	0
26361	2	72	0,2	sleep0	26365	-21	sh	23:20:07	0
21263	90	72	41,21	cyclictest	21568	-21	diskstats	21:15:52	0
4391	2	71	0,2	sleep0	4392	-21	awk	21:42:23	0
21263	90	71	44,17	cyclictest	6519	-21	ps	20:46:35	0
21263	90	70	41,21	cyclictest	13610	-21	sleep	22:56:36	0
21263	90	70	40,20	cyclictest	23775	-21	kworker/u2:3	21:26:49	0
21263	90	70	39,22	cyclictest	10755	-21	runrttasks	20:55:18	0
21263	90	70	38,23	cyclictest	9701	-21	ssh	23:47:19	0
21263	90	70	38,22	cyclictest	31067	-21	ssh	22:30:30	0
21263	90	70	38,22	cyclictest	2747	-21	ssh	22:37:10	0
21263	90	70	38,12	cyclictest	14659	-21	ntpq	23:56:22	0
21263	90	70	36,14	cyclictest	23155	-21	ntpq	00:11:48	0
20097	2	70	7,15	sleep0	20141	-21	find	19:06:01	0
21263	90	69	44,16	cyclictest	5258	-21	ld	22:41:29	0
21263	90	69	40,20	cyclictest	859	-21	snmpd	00:16:29	0
21263	90	69	38,22	cyclictest	16615	-21	ld	23:02:08	0
21263	90	69	38,13	cyclictest	16665	-21	seq	00:00:35	0
21263	90	69	37,22	cyclictest	7068	-21	aten2.4-expect	22:45:34	0
21263	90	69	37,13	cyclictest	30191	-21	/usr/sbin/munin	00:25:38	0
21263	90	68	42,15	cyclictest	14338	-21	ntpq	21:01:03	0
21263	90	68	37,22	cyclictest	4411	-21	munin-run	19:40:02	0
21263	90	68	37,22	cyclictest	30421	-21	basename	20:31:15	0
21263	90	68	37,13	cyclictest	22366	-21	grep	23:12:10	0
21263	90	68	37,13	cyclictest	20018	-21	fschecks_time	22:10:54	0
21263	90	68	37,12	cyclictest	32191	-21	telnet	19:30:29	0
21263	90	68	36,23	cyclictest	16607	-21	cut	21:05:43	0
21263	90	68	36,22	cyclictest	29151	-21	ssh	00:22:21	0
21263	90	68	34,24	cyclictest	6642	-21	ntpq	21:46:25	0
21263	90	67	38,13	cyclictest	18404	-21	ntp_states	20:06:22	0
21263	90	67	37,22	cyclictest	28424	-21	sleep	19:22:27	0
21263	90	67	37,21	cyclictest	26457	-21	ntpq	22:21:29	0
21263	90	67	37,21	cyclictest	24132	-21	/usr/sbin/munin	19:16:24	0
21263	90	67	36,23	cyclictest	9666	-21	ntp_states	21:51:55	0
21263	90	67	36,13	cyclictest	1014	-21	ntpq	21:36:22	0
21263	90	67	36,12	cyclictest	1252	-21	awk	23:32:16	0
21263	90	66	44,13	cyclictest	27382	-21	sleep	20:25:20	0
21263	90	66	44,13	cyclictest	14990	-21	/usr/sbin/munin	20:00:28	0
21263	90	66	43,14	cyclictest	31217	-21	sh	21:32:21	0
21263	90	66	37,20	cyclictest	14491	-21	hddtemp_smartct	22:00:57	0
21263	90	66	36,22	cyclictest	12038	-21	ntpq	23:51:42	0
21263	90	66	36,12	cyclictest	3494	-21	awk	00:35:35	0
21263	90	66	35,22	cyclictest	664	-21	smartctl	20:35:45	0
21263	90	66	34,23	cyclictest	21411	-21	chrt	20:12:11	0
21263	90	66	34,13	cyclictest	12579	-21	perl	19:55:36	0
21263	90	65	43,15	cyclictest	25120	-21	df	20:20:28	0
21263	90	65	38,8	cyclictest	9181	-21	ntpq	20:50:55	0
21263	90	65	34,22	cyclictest	7434	-21	diskstats	19:45:34	0
21263	90	64	41,13	cyclictest	29265	-21	apt-key	19:25:07	0
21263	90	64	35,20	cyclictest	11644	-21	fschecks_time	21:55:55	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39