OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot7s.osadl.org (updated Sat Apr 18, 2026 00:43:51)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4906	2	122	0,1	sleep2	31	1	rcuc/2	23:07:34	2
6932	2	96	67,6	sleep2	0	-21	swapper/2	19:06:40	2
7128	2	95	65,11	sleep3	0	-21	swapper/3	19:09:14	3
6985	2	95	82,9	sleep0	0	-21	swapper/0	19:07:22	0
7163	2	83	65,14	sleep1	0	-21	swapper/1	19:09:40	1
3821	2	62	0,1	sleep3	3820	-21	ssh	21:30:21	3
7263	99	24	0,23	cyclictest	0	-21	swapper/0	23:08:49	0
20017	2	22	0,0	sleep0	0	-21	swapper/0	22:38:07	0
7270	99	21	0,19	cyclictest	0	-21	swapper/1	21:44:17	1
7270	99	21	0,0	cyclictest	0	-21	swapper/1	23:40:10	1
7263	99	21	20,1	cyclictest	0	-21	swapper/0	00:30:07	0
7263	99	21	20,1	cyclictest	0	-21	swapper/0	00:30:06	0
7263	99	21	19,1	cyclictest	0	-21	swapper/0	22:48:06	0
7263	99	21	0,19	cyclictest	0	-21	swapper/0	23:40:13	0
7278	99	20	0,1	cyclictest	0	-21	swapper/3	20:00:13	3
7275	99	20	0,17	cyclictest	0	-21	swapper/2	22:54:41	2
7278	99	19	7,8	cyclictest	19293	-21	runrttasks	23:15:43	3
7263	99	19	0,19	cyclictest	0	-21	swapper/0	00:38:27	0
7278	99	18	0,1	cyclictest	0	-21	swapper/3	19:30:13	3
7275	99	18	18,0	cyclictest	0	-21	swapper/2	22:07:25	2
7275	99	18	14,3	cyclictest	0	-21	swapper/2	22:16:11	2
7275	99	18	0,3	cyclictest	0	-21	swapper/2	23:29:11	2
7270	99	18	0,2	cyclictest	0	-21	swapper/1	22:00:54	1
7263	99	18	2,2	cyclictest	14	1	rcu_preempt	21:30:15	0
7263	99	18	0,6	cyclictest	0	-21	swapper/0	23:04:22	0
7652	2	17	0,0	sleep0	0	-21	swapper/0	21:14:03	0
7278	99	17	15,2	cyclictest	0	-21	swapper/3	21:05:12	3
7275	99	17	15,1	cyclictest	0	-21	swapper/2	22:37:52	2
7275	99	17	0,1	cyclictest	0	-21	swapper/2	23:42:36	2
7270	99	17	4,13	cyclictest	31695	-21	sh	00:20:46	1
7263	99	17	14,2	cyclictest	13	-21	ksoftirqd/0	23:48:45	0
7275	99	16	3,9	cyclictest	17071	-21	ssh	21:19:44	2
7275	99	16	0,15	cyclictest	0	-21	swapper/2	00:29:10	2
7263	99	16	11,3	cyclictest	7890	-21	ls	22:30:24	0
7263	99	16	0,0	cyclictest	0	-21	swapper/0	23:20:25	0
7278	99	15	14,1	cyclictest	0	-21	swapper/3	22:10:19	3
7278	99	15	12,2	cyclictest	39	-21	ksoftirqd/3	22:58:23	3
7278	99	15	0,0	cyclictest	0	-21	swapper/3	21:47:54	3
7275	99	15	3,9	cyclictest	9278	-21	cups-browsed	00:19:59	2
7275	99	15	1,1	cyclictest	0	-21	swapper/2	23:58:44	2
7275	99	15	0,15	cyclictest	0	-21	swapper/2	22:25:24	2
7275	99	15	0,13	cyclictest	0	-21	swapper/2	19:50:13	2
7270	99	15	1,3	cyclictest	0	-21	swapper/1	00:00:14	1
7270	99	15	13,2	cyclictest	0	-21	swapper/1	23:51:16	1
7270	99	15	1,2	cyclictest	10287	-21	rm	21:54:07	1
7270	99	15	1,13	cyclictest	11931	-21	ssh	21:15:43	1
7270	99	15	10,5	cyclictest	381	50	irq/131-snd_hda	23:19:05	1
7270	99	15	0,2	cyclictest	0	-21	swapper/1	19:35:12	1
7270	99	15	0,0	cyclictest	0	-21	swapper/1	23:00:54	1
7263	99	15	4,5	cyclictest	14028	-21	hddtemp_smartct	22:15:17	0
7263	99	15	14,1	cyclictest	0	-21	swapper/0	21:20:25	0
7263	99	15	0,15	cyclictest	0	-21	swapper/0	23:34:08	0
7278	99	14	7,3	cyclictest	13336	-21	cron	00:30:00	3
7278	99	14	10,3	cyclictest	11467	-21	grep	21:15:27	3
7278	99	14	0,13	cyclictest	0	-21	swapper/3	00:01:05	3
7275	99	14	9,4	cyclictest	1427	-21	chrt	00:22:28	2
7275	99	14	7,1	cyclictest	24774	-21	latency_hist	23:20:00	2
7275	99	14	11,3	cyclictest	32	-21	ksoftirqd/2	23:48:11	2
7275	99	14	10,3	cyclictest	25554	-21	tr	23:20:14	2
7275	99	14	10,3	cyclictest	16347	-21	sed	22:55:16	2
7275	99	14	0,1	cyclictest	0	-21	swapper/2	21:55:11	2
7275	99	14	0,12	cyclictest	0	-21	swapper/2	21:24:17	2
7270	99	14	9,5	cyclictest	24565	-21	ssh	22:40:22	1
7270	99	14	2,1	cyclictest	448	-21	diskmemload	21:31:01	1
7270	99	14	0,13	cyclictest	13808	-21	cron	20:29:59	1
7263	99	14	13,1	cyclictest	0	-21	swapper/0	23:59:37	0
7263	99	14	10,3	cyclictest	28787	-21	ssh	00:00:17	0
7263	99	14	0,8	cyclictest	0	-21	swapper/0	21:55:05	0
7263	99	14	0,2	cyclictest	0	-21	swapper/0	22:10:12	0
7278	99	13	9,3	cyclictest	10203	-21	grep	19:15:14	3
7278	99	13	9,2	cyclictest	24214	-21	grep	22:40:19	3
7278	99	13	7,3	cyclictest	1997	-21	sed	23:05:26	3
7278	99	13	6,3	cyclictest	225	-21	systemd-journal	00:06:26	3
7278	99	13	2,9	cyclictest	448	-21	diskmemload	00:15:16	3
7278	99	13	10,2	cyclictest	831	-21	sed	22:45:25	3
7278	99	13	10,2	cyclictest	8156	-21	tr	22:50:16	3
7278	99	13	10,2	cyclictest	30838	-21	sed	22:25:17	3
7278	99	13	10,2	cyclictest	26197	-21	cut	23:20:16	3
7278	99	13	10,2	cyclictest	24085	-21	grep	20:50:13	3
7278	99	13	10,2	cyclictest	23699	-21	wc	00:35:22	3
7278	99	13	10,2	cyclictest	14818	-21	grep	20:30:17	3
7278	99	13	10,2	cyclictest	11512	-21	cut	23:50:13	3
7278	99	13	0,12	cyclictest	0	-21	swapper/3	21:50:14	3
7275	99	13	9,3	cyclictest	24422	-21	tr	23:00:14	2
7275	99	13	8,4	cyclictest	15044	-21	ls	20:30:19	2
7275	99	13	7,5	cyclictest	8304	-21	runrttasks	22:11:37	2
7275	99	13	12,1	cyclictest	767	-21	ssh	21:29:12	2
7275	99	13	12,1	cyclictest	0	-21	swapper/2	21:32:21	2
7275	99	13	10,2	cyclictest	30187	-21	wc	00:40:00	2
7275	99	13	10,2	cyclictest	19040	-21	chrt	23:54:58	2
7275	99	13	10,2	cyclictest	18094	-21	grep	20:35:25	2
7275	99	13	0,13	cyclictest	0	-21	swapper/2	22:04:52	2
7275	99	13	0,11	cyclictest	23213	-21	wc	22:20:25	2
7270	99	13	5,2	cyclictest	990	-21	ssh	21:10:12	1
7270	99	13	3,8	cyclictest	448	-21	diskmemload	00:00:00	1
7270	99	13	1,1	cyclictest	5552	-21	/usr/sbin/munin	00:05:21	1
7270	99	13	11,1	cyclictest	9056	-21	rm	23:48:44	1
7270	99	13	11,1	cyclictest	32681	-21	tr	22:45:19	1
7270	99	13	10,2	cyclictest	28711	-21	grep	21:00:14	1
7270	99	13	10,2	cyclictest	18737	-21	sh	21:20:16	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17