OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack5slot7s.osadl.org (updated Mon Aug 31, 2026 00:45:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1594	2	2443	2208,90	sleep0	0	-21	swapper	19:09:02	0
1748	99	163	10,112	cyclictest	23347	-21	cat	00:40:07	0
1748	99	161	28,21	cyclictest	0	-21	swapper	22:25:59	0
1748	99	161	13,43	cyclictest	20011	-21	/usr/sbin/munin	00:22:05	0
1748	99	159	17,119	cyclictest	11715	-21	apt-get	20:11:18	0
1748	99	156	16,23	cyclictest	32174	-21	apt-get	22:15:27	0
1748	99	156	11,119	cyclictest	21745	-21	grep	00:30:04	0
1748	99	155	26,34	cyclictest	0	-21	swapper	20:36:00	0
1748	99	155	17,115	cyclictest	26398	-21	munin-run	21:40:03	0
1748	99	155	11,119	cyclictest	19510	-21	/usr/sbin/munin	20:55:43	0
1748	99	155	10,120	cyclictest	27111	-21	timerwakeupswit	21:41:02	0
1748	99	154	16,33	cyclictest	7322	-21	ntpq	19:40:50	0
1748	99	154	15,112	cyclictest	16052	-21	diskstats	23:55:35	0
1748	99	154	14,114	cyclictest	19401	-21	sort	00:15:47	0
1748	99	153	9,43	cyclictest	8193	-21	missed_timers	23:05:46	0
1748	99	153	37,92	cyclictest	6987	-21	latency_hist	19:40:06	0
1748	99	153	29,101	cyclictest	10303	-21	cstates	20:00:25	0
1748	99	153	27,35	cyclictest	0	-21	swapper	21:21:03	0
1748	99	152	28,100	cyclictest	10105	-21	cat	20:00:01	0
1748	99	152	21,28	cyclictest	17661	-21	df	00:05:29	0
1748	99	152	18,107	cyclictest	18476	-21	apt-get	20:50:18	0
1748	99	152	15,114	cyclictest	27424	-21	diskstats	21:45:32	0
1748	99	152	13,113	cyclictest	23193	-21	munin-run	21:20:03	0
1748	99	152	11,103	cyclictest	14425	-21	cstates	23:45:24	0
1748	99	152	10,23	cyclictest	32086	-21	sort	22:15:08	0
1748	99	151	9,25	cyclictest	12823	-21	expr	23:35:25	0
1748	99	151	41,90	cyclictest	29796	-21	cstates	22:00:23	0
1748	99	151	18,24	cyclictest	24107	-21	apt-get	21:25:19	0
1748	99	151	17,29	cyclictest	13554	-21	/usr/sbin/munin	23:40:41	0
1748	99	151	14,113	cyclictest	12024	-21	expr	23:30:24	0
1748	99	151	11,26	cyclictest	7887	-21	cstates	19:45:24	0
1748	99	151	10,24	cyclictest	6837	-21	grep	22:56:01	0
1748	99	151	10,117	cyclictest	2946	-21	sed	22:31:09	0
1748	99	150	16,25	cyclictest	20886	-21	apt	21:05:12	0
1748	99	150	16,111	cyclictest	3803	-21	munin-plugin-st	22:40:01	0
1748	99	150	16,107	cyclictest	4720	-21	apt-get	22:45:20	0
1748	99	150	15,23	cyclictest	15958	-21	apt	20:35:01	0
1748	99	150	14,113	cyclictest	21685	-21	apt-get	21:10:20	0
1748	99	150	11,23	cyclictest	2554	-21	munin-node	19:15:07	0
1748	99	149	28,98	cyclictest	0	-21	swapper	19:15:53	0
1748	99	149	15,26	cyclictest	31023	-21	/usr/sbin/munin	22:06:00	0
1748	99	149	15,25	cyclictest	16881	-21	/usr/sbin/munin	20:40:27	0
1748	99	149	12,113	cyclictest	25420	-21	/usr/sbin/munin	21:31:05	0
1748	99	148	31,20	cyclictest	0	-21	swapper	00:10:56	0
1748	99	148	22,28	cyclictest	28762	-21	users	21:51:06	0
1748	99	148	22,26	cyclictest	5400	-21	apt-get	19:30:21	0
1748	99	148	22,100	cyclictest	16763	-21	apt-get	00:00:21	0
1748	99	148	20,25	cyclictest	7134	-21	apt-get	23:00:13	0
1748	99	148	15,22	cyclictest	6211	-21	munin-run	22:55:02	0
1748	99	148	15,108	cyclictest	22266	-21	awk	00:31:00	0
1748	99	147	21,26	cyclictest	20093	-21	apt-get	21:00:20	0
1748	99	147	21,100	cyclictest	712	-21	apt-get	22:20:30	0
1748	99	147	17,104	cyclictest	4603	-21	/usr/sbin/munin	19:25:35	0
1748	99	147	15,109	cyclictest	15840	-21	munin-run	23:55:01	0
1748	99	147	14,25	cyclictest	11717	-21	munin-run	20:10:05	0
1748	99	147	13,106	cyclictest	28899	-21	/usr/sbin/munin	21:55:55	0
1748	99	147	10,111	cyclictest	8719	-21	/usr/sbin/munin	23:10:21	0
1748	99	146	9,114	cyclictest	9695	-21	uname	23:15:41	0
1748	99	146	28,24	cyclictest	14099	-21	find	20:20:57	0
1748	99	146	17,101	cyclictest	11146	-21	apt-get	23:25:17	0
1748	99	146	13,24	cyclictest	13489	-21	unixbench_singl	20:16:09	0
1748	99	146	12,29	cyclictest	17676	-21	/usr/sbin/munin	20:45:40	0
1748	99	145	14,20	cyclictest	11044	-21	apt	23:25:01	0
1748	99	145	14,109	cyclictest	8607	-21	apt-get	19:50:17	0
1748	99	145	11,108	cyclictest	14648	-21	/usr/sbin/munin	20:25:41	0
1748	99	144	18,30	cyclictest	4035	-21	diskstats	22:40:31	0
1748	99	144	13,24	cyclictest	3807	-21	/usr/sbin/munin	19:20:42	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17