OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack5slot7s.osadl.org (updated Wed Jun 17, 2026 00:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2590	2	2431	2194,90	sleep0	0	-21	swapper	19:08:18	0
2826	99	164	20,29	cyclictest	17045	-21	df_inode	23:50:51	0
2826	99	162	31,34	cyclictest	0	-21	swapper	22:00:05	0
2826	99	160	17,26	cyclictest	25356	-21	apt-get	21:26:25	0
2826	99	159	22,31	cyclictest	13245	-21	apt-get	20:10:33	0
2826	99	159	16,40	cyclictest	7980	-21	apt-get	19:41:31	0
2826	99	159	15,121	cyclictest	15923	-21	df	20:25:24	0
2826	99	158	17,42	cyclictest	24774	-21	diskstats	21:20:33	0
2826	99	158	17,29	cyclictest	24074	-21	memory	21:15:45	0
2826	99	157	19,28	cyclictest	31538	-21	apt-get	22:00:21	0
2826	99	157	18,116	cyclictest	29586	-21	apt-get	21:51:06	0
2826	99	157	16,116	cyclictest	7984	-21	munin-run	19:40:05	0
2826	99	156	12,117	cyclictest	11134	-21	processes	19:55:54	0
2826	99	155	19,112	cyclictest	6165	-21	users	22:41:05	0
2826	99	155	14,116	cyclictest	8591	-21	apt	23:00:02	0
2826	99	154	9,120	cyclictest	24043	-21	grep	00:31:06	0
2826	99	154	15,23	cyclictest	18097	-21	cron	20:40:01	0
2826	99	154	14,23	cyclictest	4002	-21	diskstats	22:30:33	0
2826	99	154	12,106	cyclictest	17319	-21	modprobe	20:35:02	0
2826	99	153	33,20	cyclictest	15610	-21	timerwakeupswit	20:21:02	0
2826	99	153	26,21	cyclictest	0	-21	swapper	19:17:40	0
2826	99	153	12,28	cyclictest	9361	-21	head	23:01:06	0
2826	99	152	31,23	cyclictest	19798	-21	zcat	00:06:00	0
2826	99	152	23,101	cyclictest	19033	-21	apt-get	20:45:20	0
2826	99	152	21,27	cyclictest	12240	-21	users	20:01:05	0
2826	99	152	17,20	cyclictest	24363	-21	irqstats	00:35:36	0
2826	99	152	17,108	cyclictest	11105	-21	apt-get	23:15:20	0
2826	99	152	15,24	cyclictest	7177	-21	apt	19:35:01	0
2826	99	152	14,114	cyclictest	26483	-21	/usr/sbin/munin	21:31:15	0
2826	99	152	13,28	cyclictest	27979	-21	systemctl	21:40:01	0
2826	99	152	12,118	cyclictest	18463	-21	munin-plugin-st	00:00:02	0
2826	99	152	11,29	cyclictest	32329	-21	/usr/sbin/munin	22:05:45	0
2826	99	152	11,115	cyclictest	20542	-21	ps	00:10:53	0
2826	99	151	20,30	cyclictest	29137	-21	memory	21:45:47	0
2826	99	151	17,112	cyclictest	10622	-21	users	19:51:04	0
2826	99	151	16,109	cyclictest	1465	-21	apt-get	22:15:20	0
2826	99	151	16,107	cyclictest	22601	-21	apt-get	00:25:17	0
2826	99	151	11,99	cyclictest	2297	-21	apt-get	22:20:14	0
2826	99	150	9,118	cyclictest	18754	-21	irqstats	00:00:36	0
2826	99	150	17,111	cyclictest	4986	-21	df	19:20:24	0
2826	99	150	11,37	cyclictest	13959	-21	sendmail_mailqu	23:30:55	0
2826	99	149	8,118	cyclictest	5992	-21	awk	19:25:51	0
2826	99	149	21,28	cyclictest	21758	-21	ntp_states	21:00:48	0
2826	99	149	14,25	cyclictest	4790	-21	df_inode	22:35:29	0
2826	99	149	13,98	cyclictest	3618	-21	munin-run	19:15:02	0
2826	99	149	11,39	cyclictest	3838	-21	wc	22:30:04	0
2826	99	149	11,116	cyclictest	20521	-21	munin-plugin-st	20:55:01	0
2826	99	149	10,27	cyclictest	21038	-21	zcat	20:55:56	0
2826	99	148	9,21	cyclictest	16538	-21	sort	23:46:01	0
2826	99	148	22,100	cyclictest	6304	-21	apt-get	22:45:22	0
2826	99	148	16,108	cyclictest	18858	-21	grep	20:41:05	0
2826	99	148	12,111	cyclictest	14296	-21	df	20:15:31	0
2826	99	147	9,24	cyclictest	22491	-21	grep	21:05:46	0
2826	99	147	17,103	cyclictest	7097	-21	apt-get	22:50:18	0
2826	99	147	15,24	cyclictest	21687	-21	munin-run	00:20:02	0
2826	99	147	14,28	cyclictest	14321	-21	/usr/sbin/munin	23:35:22	0
2826	99	147	14,22	cyclictest	28776	-21	sshd	21:43:32	0
2826	99	147	14,110	cyclictest	9414	-21	memory	19:45:43	0
2826	99	147	13,38	cyclictest	13076	-21	munin-run	20:10:05	0
2826	99	147	12,52	cyclictest	13430	-21	munin-run	23:30:01	0
2826	99	146	35,20	cyclictest	12307	-21	proc_pri	23:20:54	0
2826	99	146	28,96	cyclictest	0	-21	swapper	23:10:54	0
2826	99	146	25,100	cyclictest	0	-21	swapper	23:44:25	0
2826	99	146	14,110	cyclictest	22226	-21	grep	00:20:58	0
2826	99	146	12,109	cyclictest	666	-21	/usr/sbin/munin	22:10:09	0
2826	99	145	12,23	cyclictest	9668	-21	if_eth0	23:05:38	0
2826	99	144	17,27	cyclictest	23137	-21	df	21:10:26	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17