OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot4s.osadl.org (updated Sun Apr 12, 2026 12:44:35)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2222	2	230	0,2	sleep0	2224	-21	chrt	07:05:20	0
31499	2	129	0,2	chrt	31492	-21	ntpq	07:51:06	0
25394	2	126	0,3	chrt	25392	-21	python3	07:41:25	0
9839	2	123	0,2	chrt	9837	-21	ssh	12:15:11	0
27080	2	122	0,2	chrt	27081	-21	awk	11:52:12	0
31138	2	118	0,2	chrt	31137	-21	ssh	11:10:21	0
22149	2	118	0,3	chrt	22147	-21	/usr/sbin/munin	07:36:24	0
2973	2	117	0,3	chrt	2974	-21	cut	12:05:05	0
23368	2	117	0,2	chrt	23366	-21	/usr/sbin/munin	08:30:44	0
8313	2	115	0,2	chrt	8314	-21	runrttasks	11:24:49	0
28790	2	115	0,4	chrt	28789	-21	sed	09:30:05	0
10756	2	115	0,3	chrt	10735	-21	diskstats	09:51:22	0
18902	2	114	0,3	chrt	18900	-21	apt-config	09:15:16	0
13796	2	113	0,3	chrt	13795	-21	/usr/sbin/munin	12:20:51	0
13286	2	113	0,2	chrt	13287	-21	latency_hist	08:15:02	0
20322	2	112	0,2	sleep0	20321	-21	seq	11:42:11	0
17004	2	112	0,2	chrt	17003	-21	cut	08:20:36	0
4762	2	109	0,1	sleep0	4763	-21	sshd	11:19:19	0
16133	2	108	0,2	chrt	16134	-21	chrt	09:59:15	0
30787	2	107	0,1	sleep0	30788	-21	cat	09:32:20	0
14300	2	105	0,3	chrt	14301	-21	sh	11:33:16	0
4140	2	99	0,2	sleep0	4145	-21	chrt	10:30:01	0
15254	2	99	0,2	chrt	15255	-21	sh	08:17:03	0
7800	2	98	0,2	sleep0	7803	-21	irqrtprio	09:46:51	0
5744	2	95	0,2	sleep0	5745	-21	chrt	12:08:59	0
20299	2	94	0,2	sleep0	20300	-21	runrttasks	10:53:57	0
11246	2	94	0,2	sleep0	11249	-21	cut	10:40:35	0
8981	2	89	0,2	sleep0	8978	-21	if_eth1	07:15:42	0
7413	2	82	0,2	sleep0	7412	-21	awk	08:05:26	0
9204	2	81	0,2	sleep0	9205	-21	chrt	09:00:20	0
21111	2	79	0,2	sleep0	21112	-21	sshd	10:06:10	0
20792	2	79	0,2	sleep0	20794	-21	cut	12:31:05	0
8178	2	77	0,2	sleep0	8181	-21	wc	07:15:03	0
5091	90	77	6,11	cyclictest	16671	-21	apt-get	10:00:25	0
3477	2	77	0,2	sleep0	3475	-21	df	09:40:39	0
31386	2	77	0,3	sleep0	31388	-21	cut	10:21:51	0
21174	2	77	0,2	sleep0	21176	-21	cut	10:55:34	0
12486	2	77	0,2	sleep0	12488	-21	chrt	07:20:51	0
5091	90	76	5,10	cyclictest	28504	-21	apt-get	11:56:08	0
13181	2	75	0,2	sleep0	13183	-21	grep	09:05:49	0
5091	90	74	6,12	cyclictest	17297	-21	python3	09:12:27	0
5091	90	74	6,11	cyclictest	27171	-21	ntpq	08:36:22	0
5091	90	73	6,58	cyclictest	24068	-21	apt-get	11:01:46	0
5091	90	73	6,10	cyclictest	705	-21	ntpq	08:45:59	0
5091	90	73	4,49	cyclictest	28867	-21	awk	07:47:13	0
4565	2	73	0,2	sleep0	4566	-21	hostname	10:30:34	0
29644	2	73	0,2	sleep0	29647	-21	sort	11:07:19	0
15581	2	73	0,2	sleep0	15582	-21	rm	10:46:24	0
5091	90	72	7,11	cyclictest	29924	-21	memory	08:40:50	0
5091	90	72	6,57	cyclictest	3048	-21	df_inode	08:50:31	0
5091	90	72	5,58	cyclictest	23278	-21	runrttasks	11:46:19	0
5091	90	72	5,13	cyclictest	6807	-21	ssh	12:10:53	0
5091	90	72	5,13	cyclictest	32636	-21	diskstats	09:35:46	0
5091	90	72	5,12	cyclictest	18368	-21	apt-get	11:40:01	0
5091	90	72	5,10	cyclictest	9869	-21	ntpq	11:26:26	0
5091	90	71	7,54	cyclictest	17964	-21	ntpq	12:26:43	0
5091	90	71	6,11	cyclictest	15607	-21	ntpq	07:25:53	0
5091	90	71	5,10	cyclictest	23961	-21	hddtemp_smartct	10:10:56	0
5091	90	71	5,10	cyclictest	2227	-21	ntpq	07:56:15	0
5091	90	71	4,8	cyclictest	7641	-21	apt-get	10:35:18	0
5091	90	71	11,42	cyclictest	28521	-21	seq	10:17:20	0
5091	90	70	5,10	cyclictest	23582	-21	ntpq	09:21:34	0
5091	90	70	4,9	cyclictest	20659	-21	ntpq	08:25:52	0
5091	90	69	5,9	cyclictest	5628	-21	apt-get	08:56:02	0
5091	90	69	5,54	cyclictest	5375	-21	ntpq	08:01:16	0
5091	90	69	5,54	cyclictest	23796	-21	hddtemp_smartct	12:35:57	0
5091	90	69	5,44	cyclictest	17655	-21	apt-get	07:30:11	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-02-27 - 12:39