OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack5slot7s.osadl.org (updated Sun Aug 09, 2026 12:45:13)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
31126	2	2449	2195,88	sleep0	0	-21	swapper	07:09:10	0
31266	99	167	18,123	cyclictest	307	-21	munin-run	07:20:02	0
31266	99	163	15,22	cyclictest	7730	-21	apt-get	11:20:56	0
31266	99	160	16,117	cyclictest	27680	-21	apt-get	10:05:31	0
31266	99	159	37,102	cyclictest	32566	-21	ntp_kernel_pll_	10:30:50	0
31266	99	159	19,25	cyclictest	32072	-21	munin-node	07:15:07	0
31266	99	159	10,126	cyclictest	17986	-21	grep	09:05:29	0
31266	99	158	15,22	cyclictest	5929	-21	apt-get	07:57:00	0
31266	99	157	15,26	cyclictest	16155	-21	grep	12:06:03	0
31266	99	157	15,23	cyclictest	23198	-21	grep	09:35:56	0
31266	99	157	12,63	cyclictest	29543	-21	http	10:15:05	0
31266	99	156	20,27	cyclictest	4441	-21	apt-get	07:45:21	0
31266	99	156	17,25	cyclictest	12952	-21	apt	11:50:12	0
31266	99	156	17,115	cyclictest	17252	-21	apt-get	12:15:56	0
31266	99	156	16,114	cyclictest	13743	-21	apt-get	08:40:17	0
31266	99	156	14,116	cyclictest	17015	-21	apt-get	09:00:29	0
31266	99	155	25,109	cyclictest	20666	-21	modprobe	12:35:00	0
31266	99	155	16,36	cyclictest	535	-21	df	07:20:33	0
31266	99	155	15,116	cyclictest	16220	-21	apt-get	12:11:20	0
31266	99	155	13,118	cyclictest	7735	-21	munin-run	11:20:02	0
31266	99	155	12,118	cyclictest	9570	-21	df_inode	08:15:28	0
31266	99	154	34,23	cyclictest	3758	-21	cat	10:55:04	0
31266	99	154	18,23	cyclictest	1601	-21	irqstats	10:40:41	0
31266	99	154	14,100	cyclictest	3061	-21	memory	07:35:45	0
31266	99	154	13,116	cyclictest	29704	-21	apt-get	10:15:24	0
31266	99	154	12,118	cyclictest	26696	-21	munin-run	10:00:03	0
31266	99	154	10,28	cyclictest	24287	-21	sshd	09:44:26	0
31266	99	154	10,27	cyclictest	8507	-21	grep	08:06:04	0
31266	99	153	17,22	cyclictest	8772	-21	df	08:10:28	0
31266	99	153	14,23	cyclictest	12197	-21	diskstats	11:45:33	0
31266	99	153	12,25	cyclictest	10991	-21	latency_hist	08:25:02	0
31266	99	153	11,117	cyclictest	4010	-21	wc	07:40:55	0
31266	99	153	10,100	cyclictest	15154	-21	find	12:00:57	0
31266	99	152	9,117	cyclictest	25458	-21	grep	09:50:46	0
31266	99	152	19,93	cyclictest	21081	-21	cron	09:25:00	0
31266	99	152	17,25	cyclictest	16126	-21	apt-get	08:55:17	0
31266	99	152	15,113	cyclictest	2136	-21	diskstats	07:30:34	0
31266	99	152	14,114	cyclictest	24513	-21	diskstats	09:45:33	0
31266	99	152	12,25	cyclictest	19829	-21	grep	09:15:46	0
31266	99	151	9,117	cyclictest	12784	-21	systemd-journal	12:40:01	0
31266	99	151	21,27	cyclictest	11094	-21	apt-get	08:25:22	0
31266	99	151	21,19	cyclictest	0	-21	swapper	08:45:58	0
31266	99	151	16,112	cyclictest	5907	-21	sshd	07:51:45	0
31266	99	151	14,25	cyclictest	11288	-21	/usr/sbin/munin	11:40:39	0
31266	99	151	14,24	cyclictest	14242	-21	/usr/sbin/munin	11:55:57	0
31266	99	151	11,97	cyclictest	22403	-21	zcat	09:30:56	0
31266	99	151	10,41	cyclictest	11171	-21	munin-run	11:40:01	0
31266	99	150	8,120	cyclictest	19806	-21	grep	12:26:03	0
31266	99	150	35,20	cyclictest	7307	-21	latency	08:00:51	0
31266	99	150	22,27	cyclictest	15442	-21	diskstats	08:50:33	0
31266	99	150	14,113	cyclictest	1390	-21	cat	10:40:05	0
31266	99	149	9,25	cyclictest	12272	-21	cut	08:31:15	0
31266	99	149	85,39	cyclictest	5432	-21	apt-get	11:05:20	0
31266	99	149	7,117	cyclictest	21861	-21	awk	09:26:08	0
31266	99	149	17,25	cyclictest	31374	-21	munin-run	10:25:02	0
31266	99	149	13,116	cyclictest	18869	-21	df	09:10:27	0
31266	99	149	10,118	cyclictest	27515	-21	http	10:05:05	0
31266	99	148	34,90	cyclictest	9519	-21	sed	11:26:10	0
31266	99	147	17,45	cyclictest	13623	-21	munin-run	08:40:04	0
31266	99	147	14,23	cyclictest	6921	-21	apt	11:15:00	0
31266	99	146	21,25	cyclictest	1341	-21	diskstats	07:25:34	0
31266	99	146	13,111	cyclictest	4300	-21	cut	10:55:59	0
31266	99	146	10,23	cyclictest	31835	-21	ps	10:25:52	0
31266	99	145	26,22	cyclictest	0	-21	swapper	12:20:29	0
31266	99	145	16,104	cyclictest	4915	-21	/usr/sbin/munin	11:00:46	0
31266	99	145	10,98	cyclictest	2217	-21	kworker/u2:12	10:45:04	0
31266	99	143	19,24	cyclictest	9785	-21	diskstats	11:30:35	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17