OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack5slot7s.osadl.org (updated Mon Nov 10, 2025 12:45:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
16474	2	2443	2201,96	sleep0	0	-21	swapper	07:09:42	0
16552	99	166	18,124	cyclictest	16298	-21	apt-get	10:36:07	0
16552	99	165	12,127	cyclictest	17453	-21	munin-node	12:05:13	0
16552	99	162	20,117	cyclictest	25157	-21	munin-run	08:00:02	0
16552	99	162	17,42	cyclictest	17893	-21	diskstats	07:15:49	0
16552	99	161	19,116	cyclictest	32685	-21	irqstats	08:45:39	0
16552	99	161	18,115	cyclictest	8376	-21	apt-get	09:45:18	0
16552	99	160	38,24	cyclictest	19844	-21	/usr/sbin/munin	07:25:58	0
16552	99	160	20,25	cyclictest	9341	-21	irqstats	09:50:39	0
16552	99	159	16,120	cyclictest	30194	-21	apt	12:00:01	0
16552	99	157	13,120	cyclictest	15444	-21	grep	10:26:03	0
16552	99	157	12,23	cyclictest	16903	-21	sed	07:10:46	0
16552	99	156	16,26	cyclictest	1680	-21	apt	09:00:02	0
16552	99	156	13,119	cyclictest	18613	-21	/usr/sbin/munin	07:20:26	0
16552	99	156	10,27	cyclictest	4175	-21	munin-run	12:40:04	0
16552	99	155	16,115	cyclictest	31243	-21	apt-get	08:36:24	0
16552	99	155	15,24	cyclictest	10671	-21	munin-run	10:00:01	0
16552	99	155	14,116	cyclictest	4605	-21	memory	09:20:40	0
16552	99	154	29,18	cyclictest	0	-21	swapper	10:45:01	0
16552	99	154	17,113	cyclictest	14707	-21	apt	10:25:01	0
16552	99	154	16,23	cyclictest	31863	-21	snmpd	09:31:58	0
16552	99	154	16,22	cyclictest	25152	-21	apt-get	08:00:39	0
16552	99	154	16,114	cyclictest	30852	-21	awk	08:31:38	0
16552	99	154	15,31	cyclictest	7436	-21	sshd	09:39:39	0
16552	99	154	13,118	cyclictest	30219	-21	munin-run	08:30:05	0
16552	99	154	12,119	cyclictest	22627	-21	ps	11:10:53	0
16552	99	153	10,41	cyclictest	5161	-21	/usr/sbin/munin	09:26:08	0
16552	99	152	18,106	cyclictest	28727	-21	apt-get	08:20:21	0
16552	99	152	12,117	cyclictest	32086	-21	/usr/sbin/munin	12:10:40	0
16552	99	152	11,102	cyclictest	25051	-21	ps	11:25:51	0
16552	99	152	11,102	cyclictest	10886	-21	expr	10:00:25	0
16552	99	152	10,120	cyclictest	27275	-21	sshd	11:40:39	0
16552	99	152	10,119	cyclictest	19726	-21	sshd	10:52:43	0
16552	99	152	10,117	cyclictest	21704	-21	apt-get	07:40:43	0
16552	99	151	39,91	cyclictest	28575	-21	sshd	11:46:40	0
16552	99	151	18,109	cyclictest	2178	-21	memory	09:05:44	0
16552	99	151	15,36	cyclictest	21638	-21	irqstats	11:05:40	0
16552	99	151	13,114	cyclictest	15601	-21	/usr/sbin/munin	10:31:10	0
16552	99	151	12,115	cyclictest	21636	-21	sed	07:36:06	0
16552	99	151	11,117	cyclictest	2911	-21	irqstats	09:10:41	0
16552	99	150	9,114	cyclictest	20146	-21	ntpq	10:55:49	0
16552	99	150	30,22	cyclictest	0	-21	swapper	11:00:42	0
16552	99	149	21,28	cyclictest	8234	-21	users	09:41:09	0
16552	99	149	18,26	cyclictest	12383	-21	apt-get	10:10:19	0
16552	99	149	15,23	cyclictest	20311	-21	df_inode	07:30:27	0
16552	99	149	15,112	cyclictest	23824	-21	irqstats	07:50:40	0
16552	99	148	18,106	cyclictest	23381	-21	awk	11:15:55	0
16552	99	148	13,37	cyclictest	31017	-21	munin-plugin-st	12:05:00	0
16552	99	148	13,113	cyclictest	4230	-21	cron	09:20:00	0
16552	99	148	11,24	cyclictest	26567	-21	grep	08:05:53	0
16552	99	148	11,112	cyclictest	2196	-21	ntpq	12:25:52	0
16552	99	148	10,114	cyclictest	26523	-21	memory	11:35:43	0
16552	99	147	8,116	cyclictest	18865	-21	sed	10:46:06	0
16552	99	147	23,98	cyclictest	27207	-21	diskstats	08:10:35	0
16552	99	147	20,28	cyclictest	13175	-21	/usr/sbin/munin	10:16:12	0
16552	99	147	18,106	cyclictest	12243	-21	users	10:06:09	0
16552	99	146	17,25	cyclictest	3037	-21	/usr/sbin/munin	12:30:57	0
16552	99	146	15,107	cyclictest	421	-21	irqstats	12:15:39	0
16552	99	146	12,111	cyclictest	26112	-21	grep	11:31:07	0
16552	99	145	11,26	cyclictest	28626	-21	sendmail-msp	08:20:04	0
16552	99	144	16,36	cyclictest	28806	-21	df_inode	11:50:28	0
16552	99	143	19,26	cyclictest	24003	-21	diskstats	11:20:35	0
16552	99	143	16,26	cyclictest	32398	-21	latency_hist	08:45:04	0
16552	99	143	14,22	cyclictest	1182	-21	df	12:20:28	0
16552	99	142	18,100	cyclictest	23033	-21	irqstats	07:45:49	0
16552	99	142	12,23	cyclictest	1813	-21	sshd	09:02:39	0
16552	99	135	13,22	cyclictest	31863	-21	snmpd	08:51:43	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17