OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot3s.osadl.org (updated Fri Nov 28, 2025 00:45:05)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
312056	99	74	33,37	cyclictest	1	-21	systemd	20:50:00	2
312050	99	72	7,26	cyclictest	327111	-21	unin-run	00:00:00	0
312054	99	68	27,36	cyclictest	1	-21	systemd	20:40:01	1
312059	99	67	1,11	cyclictest	328870	-21	sshd	00:32:35	3
312059	99	66	25,37	cyclictest	323197	-21	systemd-run	22:45:01	3
312059	99	66	2,16	cyclictest	313548	-21	munin-run	19:40:01	3
312050	99	66	6,18	cyclictest	322909	-21	modprobe	22:39:59	0
312056	99	65	21,12	cyclictest	30	-21	ksoftirqd/2	22:40:00	2
312059	99	64	26,33	cyclictest	320563	-21	cron	21:55:00	3
312059	99	64	2,15	cyclictest	322660	-21	munin-run	22:35:01	3
312059	99	64	1,14	cyclictest	321075	-21	sshd	22:01:35	3
312054	99	64	23,37	cyclictest	322930	-21	tr	22:39:59	1
312059	99	63	2,6	cyclictest	327600	-21	munin-run	00:10:01	3
312059	99	63	2,6	cyclictest	327600	-21	munin-run	00:10:01	3
312059	99	63	2,15	cyclictest	318210	-21	sshd	21:09:34	3
312059	99	63	2,13	cyclictest	325273	-21	munin-run	23:25:01	3
312059	99	63	17,41	cyclictest	314809	-21	cat	20:00:02	3
312059	99	63	1,13	cyclictest	326536	-21	sshd	23:48:18	3
312059	99	63	1,10	cyclictest	323669	-21	sshd	22:52:34	3
312056	99	63	4,19	cyclictest	1	-21	systemd	22:35:00	2
312056	99	63	15,13	cyclictest	1	-21	systemd	00:40:01	2
312056	99	63	15,13	cyclictest	1	-21	systemd	00:40:00	2
312056	99	63	11,13	cyclictest	272	-21	dbus-daemon	00:00:01	2
312054	99	63	19,5	cyclictest	318016	-21	latency_hist	21:05:01	1
312050	99	63	6,21	cyclictest	328110	-21	modprobe	00:19:59	0
312059	99	62	2,13	cyclictest	319538	-21	munin-run	21:35:00	3
312059	99	62	2,13	cyclictest	316939	-21	munin-run	20:45:01	3
312059	99	62	2,13	cyclictest	316939	-21	munin-run	20:45:00	3
312054	99	62	5,52	cyclictest	1	-21	systemd	00:20:01	1
312054	99	62	25,32	cyclictest	313030	-21	latency_hist	19:30:01	1
312054	99	62	24,34	cyclictest	272	-21	dbus-daemon	23:25:49	1
312059	99	61	3,15	cyclictest	315351	-21	modprobe	20:15:00	3
312059	99	60	7,7	cyclictest	324457	-21	sshd	23:08:08	3
312059	99	60	3,18	cyclictest	326032	-21	latency_hist	23:40:00	3
312059	99	60	2,11	cyclictest	320289	-21	sshd	21:45:35	3
312059	99	60	1,12	cyclictest	315091	-21	sshd	20:09:34	3
312054	99	60	1,14	cyclictest	326195	-21	grep	23:40:01	1
312059	99	59	8,11	cyclictest	272	-21	dbus-daemon	20:50:01	3
312059	99	59	2,14	cyclictest	326307	-21	munin-run	23:45:00	3
312059	99	59	2,12	cyclictest	329133	-21	sshd	00:36:37	3
312059	99	59	2,12	cyclictest	329133	-21	sshd	00:36:36	3
312059	99	59	1,10	cyclictest	323417	-21	sshd	22:47:36	3
312050	99	59	1,23	cyclictest	327793	-21	sed	00:10:03	0
312050	99	59	1,23	cyclictest	327793	-21	sed	00:10:02	0
312059	99	58	22,32	cyclictest	325227	-21	latency_hist	23:20:02	3
312059	99	58	2,16	cyclictest	320837	-21	munin-run	22:00:01	3
312059	99	58	2,14	cyclictest	322154	-21	munin-run	22:25:00	3
312059	99	58	1,9	cyclictest	318460	-21	sshd	21:12:35	3
312059	99	58	1,13	cyclictest	327858	-21	systemd-run	00:15:00	3
312056	99	58	4,12	cyclictest	328111	-21	modprobe	00:20:00	2
312059	99	57	2,9	cyclictest	319297	-21	munin-run	21:30:00	3
312059	99	57	2,14	cyclictest	314042	-21	sshd	19:47:35	3
312059	99	57	1,15	cyclictest	319013	-21	sshd	21:24:36	3
312059	99	57	1,15	cyclictest	319013	-21	sshd	21:24:35	3
312059	99	57	1,12	cyclictest	363	-21	snmpd	21:36:51	3
312059	99	57	1,12	cyclictest	363	-21	snmpd	21:36:50	3
312056	99	57	19,5	cyclictest	320751	-21	latency_hist	21:55:03	2
312056	99	57	18,8	cyclictest	30	-21	ksoftirqd/2	23:00:02	2
312054	99	57	25,29	cyclictest	317411	-21	sshd	20:51:35	1
312054	99	57	19,12	cyclictest	1	-21	systemd	21:35:01	1
312054	99	57	17,35	cyclictest	1	-21	systemd	22:45:01	1
312054	99	57	13,10	cyclictest	314617	-21	systemctl	20:00:01	1
312059	99	56	2,7	cyclictest	321360	-21	munin-run	22:10:00	3
312059	99	56	2,17	cyclictest	316686	-21	sendmail-msp	20:40:00	3
312059	99	56	2,15	cyclictest	325753	-21	sshd	23:33:13	3
312059	99	56	2,11	cyclictest	363	-21	snmpd	20:50:17	3
312056	99	56	24,7	cyclictest	326017	-21	cron	23:39:59	2
312056	99	56	19,7	cyclictest	322254	-21	cat	22:25:02	2
312054	99	56	23,29	cyclictest	325071	-21	latency_hist	23:20:02	1
312054	99	56	19,32	cyclictest	324372	-21	latency_hist	23:05:02	1
312054	99	56	15,12	cyclictest	319289	-21	systemd-run	21:30:00	1
312054	99	56	10,41	cyclictest	314869	-21	unin-run	20:05:00	1
312059	99	55	2,7	cyclictest	328154	-21	munin-run	00:20:00	3
312059	99	55	2,13	cyclictest	323977	-21	modprobe	23:00:01	3
312059	99	55	1,12	cyclictest	363	-21	snmpd	19:21:14	3
312056	99	55	4,15	cyclictest	318740	-21	modprobe	21:19:59	2
312054	99	55	28,23	cyclictest	23	-21	ksoftirqd/1	22:20:02	1
312054	99	55	28,23	cyclictest	23	-21	ksoftirqd/1	22:20:02	1
312054	99	55	2,15	cyclictest	317384	-21	latency_hist	20:50:03	1
312050	99	55	38,13	cyclictest	235	-21	systemd-journal	21:15:00	0
312059	99	54	4,4	cyclictest	0	-21	swapper/3	19:10:34	3
312059	99	54	3,6	cyclictest	325538	-21	munin-run	23:30:02	3
312059	99	54	2,6	cyclictest	317702	-21	munin-run	21:00:00	3
312059	99	54	24,25	cyclictest	235	-21	systemd-journal	23:58:34	3
312059	99	54	2,15	cyclictest	321609	-21	munin-run	22:15:00	3
312059	99	54	2,14	cyclictest	1	-21	systemd	00:30:01	3
312059	99	54	2,12	cyclictest	363	-21	snmpd	19:17:40	3
312059	99	54	2,12	cyclictest	313796	-21	sshd	19:43:34	3
312059	99	54	2,12	cyclictest	313260	-21	sshd	19:32:47	3
312059	99	54	2,11	cyclictest	1	-21	systemd	20:05:01	3
312059	99	54	1,9	cyclictest	328366	-21	sshd	00:22:36	3
312059	99	54	1,9	cyclictest	328366	-21	sshd	00:22:36	3
312054	99	54	3,15	cyclictest	412	-21	sshd	21:45:34	1
312054	99	54	2,15	cyclictest	322167	-21	unin-run	22:25:00	1
312054	99	54	20,31	cyclictest	319947	-21	latency_hist	21:40:02	1
312054	99	54	20,31	cyclictest	319947	-21	latency_hist	21:40:02	1
312054	99	54	20,30	cyclictest	316551	-21	latency_hist	20:35:01	1
312054	99	54	15,33	cyclictest	0	-21	swapper/1	20:15:01	1
312050	99	54	30,11	cyclictest	306	-21	in:imuxsock	21:00:00	0
312059	99	53	2,6	cyclictest	320070	-21	munin-run	21:45:00	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:33