OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack5slot7s.osadl.org (updated Thu Aug 27, 2026 12:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
31612	2	2439	2205,92	sleep0	0	-21	swapper	07:07:01	0
31991	99	165	18,122	cyclictest	10083	-21	apt-get	08:10:25	0
31991	99	161	14,38	cyclictest	5728	-21	apt-get	07:47:02	0
31991	99	160	16,20	cyclictest	21420	-21	apt-get	12:35:51	0
31991	99	159	13,41	cyclictest	1146	-21	apt-get	10:31:34	0
31991	99	159	13,25	cyclictest	3217	-21	/usr/sbin/munin	07:31:36	0
31991	99	158	15,119	cyclictest	15791	-21	munin-run	12:00:02	0
31991	99	157	17,23	cyclictest	1475	-21	munin-run	07:20:02	0
31991	99	157	17,115	cyclictest	32578	-21	apt-get	10:26:14	0
31991	99	157	16,113	cyclictest	31050	-21	apt-get	10:15:21	0
31991	99	156	16,115	cyclictest	25923	-21	munin-run	09:45:05	0
31991	99	155	33,19	cyclictest	0	-21	swapper	12:00:31	0
31991	99	155	28,32	cyclictest	0	-21	swapper	07:20:22	0
31991	99	155	18,23	cyclictest	8688	-21	sort	08:00:41	0
31991	99	155	17,115	cyclictest	12298	-21	irqstats	08:21:11	0
31991	99	155	15,23	cyclictest	22186	-21	irqstats	09:20:38	0
31991	99	155	14,96	cyclictest	14441	-21	apt-get	08:36:30	0
31991	99	154	34,22	cyclictest	11347	-21	ls	11:30:46	0
31991	99	154	17,23	cyclictest	4870	-21	users	07:36:13	0
31991	99	154	15,99	cyclictest	6157	-21	munin-run	11:00:03	0
31991	99	154	12,40	cyclictest	11807	-21	munin-run	08:20:03	0
31991	99	154	12,28	cyclictest	32737	-21	sshd	07:11:12	0
31991	99	153	30,22	cyclictest	0	-21	swapper	10:10:59	0
31991	99	153	18,107	cyclictest	28662	-21	apt-get	10:00:18	0
31991	99	153	17,39	cyclictest	25921	-21	apt-get	09:45:32	0
31991	99	153	12,23	cyclictest	17980	-21	/usr/sbin/munin	08:55:11	0
31991	99	152	21,104	cyclictest	12703	-21	apt-get	11:40:20	0
31991	99	152	18,97	cyclictest	16251	-21	users	08:41:12	0
31991	99	152	13,28	cyclictest	19903	-21	ntpq	09:05:50	0
31991	99	152	12,117	cyclictest	12422	-21	timerandwakeup	11:36:00	0
31991	99	152	11,117	cyclictest	28300	-21	cut	09:55:56	0
31991	99	152	11,115	cyclictest	6968	-21	sh	11:05:00	0
31991	99	152	10,101	cyclictest	24230	-21	sed	09:31:02	0
31991	99	151	19,26	cyclictest	18298	-21	apt-get	12:15:16	0
31991	99	151	14,38	cyclictest	13423	-21	mailstats	08:26:05	0
31991	99	151	12,116	cyclictest	14190	-21	latency_hist	11:50:01	0
31991	99	150	15,110	cyclictest	2951	-21	munin-run	10:40:02	0
31991	99	150	14,114	cyclictest	9966	-21	munin-run	08:10:02	0
31991	99	150	14,111	cyclictest	14443	-21	munin-run	08:35:01	0
31991	99	150	13,112	cyclictest	23555	-21	grep	09:30:05	0
31991	99	150	12,114	cyclictest	21096	-21	cat	09:15:02	0
31991	99	149	19,103	cyclictest	5036	-21	apt-get	07:40:17	0
31991	99	149	16,97	cyclictest	0	-21	swapper	12:06:00	0
31991	99	149	15,23	cyclictest	7868	-21	apt-get	11:10:13	0
31991	99	149	14,47	cyclictest	6954	-21	df	07:50:32	0
31991	99	149	12,25	cyclictest	20456	-21	sort	12:25:58	0
31991	99	149	12,114	cyclictest	5234	-21	wc	10:51:02	0
31991	99	149	11,116	cyclictest	19366	-21	ls	09:01:01	0
31991	99	148	71,53	cyclictest	10287	-21	sshd	11:25:11	0
31991	99	148	29,21	cyclictest	0	-21	swapper	09:51:06	0
31991	99	148	15,23	cyclictest	21096	-21	grep	12:30:54	0
31991	99	148	15,110	cyclictest	3086	-21	munin-run	07:30:01	0
31991	99	148	13,108	cyclictest	19133	-21	/usr/sbin/munin	12:20:23	0
31991	99	148	12,114	cyclictest	17187	-21	dpkg	08:50:12	0
31991	99	147	31,94	cyclictest	17075	-21	modprobe	08:50:00	0
31991	99	147	26,22	cyclictest	0	-21	swapper	10:05:32	0
31991	99	147	21,105	cyclictest	17504	-21	apt-get	12:10:13	0
31991	99	147	20,28	cyclictest	9606	-21	diskstats	11:20:35	0
31991	99	147	17,25	cyclictest	25011	-21	/usr/sbin/munin	09:36:02	0
31991	99	147	13,29	cyclictest	7651	-21	ls	11:06:01	0
31991	99	147	11,112	cyclictest	3075	-21	dpkg	10:40:12	0
31991	99	146	19,28	cyclictest	9316	-21	users	11:16:06	0
31991	99	146	17,106	cyclictest	16882	-21	snmpd	07:56:27	0
31991	99	146	16,27	cyclictest	14400	-21	df_inode	11:50:30	0
31991	99	146	12,47	cyclictest	32423	-21	/usr/sbin/munin	10:21:00	0
31991	99	145	19,26	cyclictest	21190	-21	apt-get	09:15:21	0
31991	99	145	14,93	cyclictest	3967	-21	df	10:45:25	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17