OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 50.5 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack5slot7s.osadl.org (updated Fri May 29, 2026 12:45:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
20323	2	2441	2198,96	sleep0	0	-21	swapper	07:06:08	0
20802	99	176	18,130	cyclictest	18319	-21	apt-get	10:40:27	0
20802	99	162	13,126	cyclictest	20042	-21	snmpd	09:15:02	0
20802	99	161	36,22	cyclictest	6392	-21	apt-get	09:36:34	0
20802	99	161	17,120	cyclictest	1429	-21	munin-run	12:15:05	0
20802	99	159	16,119	cyclictest	3588	-21	grep	09:15:56	0
20802	99	157	15,117	cyclictest	23852	-21	wc	11:10:58	0
20802	99	156	18,25	cyclictest	24069	-21	apt-get	07:40:18	0
20802	99	156	17,24	cyclictest	25091	-21	df	07:50:23	0
20802	99	156	12,119	cyclictest	28986	-21	grep	08:25:53	0
20802	99	155	21,25	cyclictest	13208	-21	users	10:11:06	0
20802	99	155	16,26	cyclictest	9955	-21	sed	09:51:02	0
20802	99	155	15,116	cyclictest	28271	-21	munin-run	11:40:01	0
20802	99	155	15,116	cyclictest	18164	-21	apt	10:40:02	0
20802	99	155	14,24	cyclictest	7425	-21	apt-get	09:41:38	0
20802	99	154	19,26	cyclictest	1319	-21	apt-get	09:05:24	0
20802	99	154	15,116	cyclictest	1427	-21	apt-get	12:16:01	0
20802	99	154	14,25	cyclictest	26494	-21	wc	11:30:06	0
20802	99	154	14,116	cyclictest	5157	-21	df	12:35:24	0
20802	99	154	14,115	cyclictest	26621	-21	apt-get	11:30:29	0
20802	99	153	9,27	cyclictest	17217	-21	sshd	10:34:44	0
20802	99	152	27,107	cyclictest	2598	-21	apt-get	12:20:15	0
20802	99	152	21,26	cyclictest	23772	-21	users	07:31:04	0
20802	99	152	18,24	cyclictest	29653	-21	df_inode	08:35:28	0
20802	99	152	16,113	cyclictest	22073	-21	munin-run	07:20:03	0
20802	99	152	14,23	cyclictest	6208	-21	cat	09:31:00	0
20802	99	152	11,27	cyclictest	22246	-21	sshd	07:20:23	0
20802	99	152	11,23	cyclictest	14653	-21	sendmail_mailqu	10:20:55	0
20802	99	152	10,117	cyclictest	738	-21	grep	09:00:47	0
20802	99	151	9,120	cyclictest	23949	-21	munin-run	07:40:02	0
20802	99	151	14,98	cyclictest	24835	-21	munin-run	11:20:02	0
20802	99	151	14,101	cyclictest	29439	-21	sort	11:45:45	0
20802	99	151	13,115	cyclictest	20899	-21	apt-get	07:10:22	0
20802	99	151	11,117	cyclictest	11657	-21	munin-run	10:05:00	0
20802	99	150	9,25	cyclictest	20188	-21	wc	10:50:22	0
20802	99	150	8,102	cyclictest	27570	-21	latency_hist	08:15:04	0
20802	99	150	17,111	cyclictest	14106	-21	munin-run	10:20:03	0
20802	99	150	17,110	cyclictest	4472	-21	memory	12:30:44	0
20802	99	150	14,112	cyclictest	30074	-21	expr	11:50:23	0
20802	99	150	12,96	cyclictest	31462	-21	modprobe	12:00:01	0
20802	99	150	11,114	cyclictest	31463	-21	irqstats	08:50:38	0
20802	99	149	34,95	cyclictest	32022	-21	/usr/sbin/munin	12:00:55	0
20802	99	149	16,23	cyclictest	324	-21	munin-run	09:00:02	0
20802	99	149	14,25	cyclictest	19427	-21	df_inode	10:45:36	0
20802	99	149	12,25	cyclictest	32662	-21	sort	12:05:44	0
20802	99	149	12,112	cyclictest	11868	-21	diskstats	10:05:34	0
20802	99	149	10,115	cyclictest	28828	-21	awk	11:40:55	0
20802	99	148	20,102	cyclictest	15023	-21	apt-get	10:25:23	0
20802	99	148	18,26	cyclictest	22530	-21	apt-get	11:05:19	0
20802	99	148	17,30	cyclictest	4763	-21	users	09:21:05	0
20802	99	148	15,107	cyclictest	8548	-21	/usr/sbin/munin	09:45:33	0
20802	99	148	13,23	cyclictest	25940	-21	/usr/sbin/munin	08:00:46	0
20802	99	148	13,112	cyclictest	24952	-21	/usr/sbin/munin	11:20:23	0
20802	99	148	12,24	cyclictest	21595	-21	cron	11:00:01	0
20802	99	148	10,26	cyclictest	27359	-21	head	08:06:01	0
20802	99	148	10,25	cyclictest	10810	-21	sshd	09:56:23	0
20802	99	147	17,26	cyclictest	30831	-21	/usr/sbin/munin	08:45:48	0
20802	99	147	16,24	cyclictest	27905	-21	memory	08:15:43	0
20802	99	147	10,113	cyclictest	22101	-21	grep	11:00:53	0
20802	99	146	17,103	cyclictest	4903	-21	apt-get	09:25:14	0
20802	99	146	12,112	cyclictest	25893	-21	cat	08:00:06	0
20802	99	145	17,104	cyclictest	4130	-21	munin-run	12:30:02	0
20802	99	145	17,104	cyclictest	0	-21	swapper	08:22:29	0
20802	99	143	30,20	cyclictest	0	-21	swapper	08:41:57	0
20802	99	141	17,101	cyclictest	24891	-21	munin-run	07:50:01	0
20802	99	141	12,27	cyclictest	20042	-21	snmpd	08:30:21	0
20802	99	139	15,23	cyclictest	23015	-21	munin-run	07:30:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17