OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot3s.osadl.org (updated Tue Dec 23, 2025 00:45:05)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1278436	99	101	1,3	cyclictest	0	-21	swapper/0	23:35:01	0
1278436	99	78	74,2	cyclictest	0	-21	swapper/0	23:05:02	0
1278440	99	73	2,18	cyclictest	1283793	-21	munin-run	20:55:00	1
1278440	99	65	26,34	cyclictest	275	-21	dbus-daemon	00:05:01	1
1278440	99	65	2,16	cyclictest	1282523	-21	munin-run	20:30:02	1
1278440	99	65	2,16	cyclictest	1282523	-21	munin-run	20:30:02	1
1278440	99	65	17,10	cyclictest	1278945	-21	cat	19:20:02	1
1278448	99	64	13,15	cyclictest	37	-21	ksoftirqd/3	19:40:02	3
1278440	99	63	2,18	cyclictest	1292601	-21	cron	23:45:00	1
1278440	99	63	2,16	cyclictest	1287455	-21	munin-run	22:05:02	1
1278440	99	63	18,5	cyclictest	1280183	-21	cron	19:44:59	1
1278440	99	62	2,16	cyclictest	1288043	-21	cat	22:15:02	1
1278436	99	62	1,42	cyclictest	1294062	-21	apt-config	00:10:02	0
1278440	99	61	19,37	cyclictest	1281972	-21	modprobe	20:20:00	1
1278440	99	61	1,20	cyclictest	1280043	-21	latency_hist	19:40:02	1
1278440	99	60	18,14	cyclictest	238	-21	systemd-journal	20:15:01	1
1278440	99	60	18,14	cyclictest	238	-21	systemd-journal	20:15:01	1
1278444	99	59	11,6	cyclictest	13	1	rcu_preempt	23:17:00	2
1278440	99	59	23,33	cyclictest	23	-21	ksoftirqd/1	22:25:01	1
1278440	99	59	2,15	cyclictest	1282262	-21	munin-run	20:25:00	1
1278440	99	59	20,4	cyclictest	1	-21	systemd	20:40:01	1
1278440	99	59	17,6	cyclictest	1282806	-21	sed	20:35:01	1
1278440	99	59	17,11	cyclictest	1288804	-21	cat	22:30:01	1
1278448	99	58	12,9	cyclictest	37	-21	ksoftirqd/3	22:40:02	3
1278440	99	58	18,9	cyclictest	1285893	-21	pluginstate	21:35:01	1
1278440	99	58	17,12	cyclictest	275	-21	dbus-daemon	22:10:00	1
1278440	99	58	1,14	cyclictest	1295359	-21	latency_hist	00:35:02	1
1278448	99	57	9,7	cyclictest	37	-21	ksoftirqd/3	00:30:02	3
1278448	99	57	8,12	cyclictest	37	-21	ksoftirqd/3	22:00:02	3
1278448	99	57	12,5	cyclictest	13	1	rcu_preempt	21:40:00	3
1278448	99	57	10,6	cyclictest	13	1	rcu_preempt	20:40:02	3
1278440	99	57	7,3	cyclictest	13	1	rcu_preempt	23:20:01	1
1278440	99	57	4,16	cyclictest	1284342	-21	latency_hist	21:05:02	1
1278440	99	57	3,18	cyclictest	1294202	-21	munin-run	00:15:01	1
1278440	99	57	3,18	cyclictest	1294202	-21	munin-run	00:15:00	1
1278440	99	57	2,16	cyclictest	1289903	-21	wc	22:50:02	1
1278440	99	57	2,16	cyclictest	1284577	-21	latency_hist	21:10:01	1
1278440	99	57	16,8	cyclictest	1	-21	systemd	22:35:01	1
1278440	99	57	13,8	cyclictest	1285079	-21	sshd	21:19:18	1
1278440	99	57	11,41	cyclictest	1	-21	systemd	21:45:01	1
1278440	99	57	11,41	cyclictest	1	-21	systemd	21:45:01	1
1278436	99	57	4,16	cyclictest	1294993	-21	munin-plugin-st	00:30:00	0
1278448	99	56	36,15	cyclictest	238	-21	systemd-journal	21:35:00	3
1278440	99	56	4,20	cyclictest	275	-21	dbus-daemon	21:25:01	1
1278440	99	56	3,16	cyclictest	1281235	-21	unin-run	20:05:01	1
1278440	99	56	3,10	cyclictest	1292341	-21	run-parts	23:40:00	1
1278440	99	56	24,29	cyclictest	1283463	-21	latency_hist	20:45:01	1
1278448	99	55	6,9	cyclictest	37	-21	ksoftirqd/3	20:00:00	3
1278444	99	55	9,5	cyclictest	13	1	rcu_preempt	21:20:02	2
1278440	99	55	21,10	cyclictest	23	-21	ksoftirqd/1	19:25:01	1
1278436	99	55	40,11	cyclictest	238	-21	systemd-journal	19:50:00	0
1278448	99	54	6,11	cyclictest	37	-21	ksoftirqd/3	19:55:01	3
1278448	99	54	3,11	cyclictest	37	-21	ksoftirqd/3	20:50:01	3
1278444	99	54	24,10	cyclictest	30	-21	ksoftirqd/2	00:00:00	2
1278440	99	54	7,5	cyclictest	13	1	rcu_preempt	00:25:01	1
1278440	99	54	4,15	cyclictest	1284037	-21	modprobe	21:00:00	1
1278440	99	54	19,4	cyclictest	414	-21	sshd	00:09:18	1
1278440	99	54	12,9	cyclictest	238	-21	systemd-journal	22:45:00	1
1278440	99	54	11,24	cyclictest	23	-21	ksoftirqd/1	21:15:01	1
1278448	99	53	6,9	cyclictest	37	-21	ksoftirqd/3	20:35:00	3
1278448	99	53	35,12	cyclictest	37	-21	ksoftirqd/3	00:10:01	3
1278440	99	53	2,16	cyclictest	1293357	-21	cron	00:00:00	1
1278448	99	52	1,8	cyclictest	284	-21	systemd-logind	20:05:01	3
1278444	99	52	5,5	cyclictest	13	1	rcu_preempt	20:05:00	2
1278444	99	52	35,13	cyclictest	238	-21	systemd-journal	21:50:00	2
1278444	99	52	2,6	cyclictest	13	1	rcu_preempt	23:25:01	2
1278444	99	52	21,10	cyclictest	30	-21	ksoftirqd/2	20:10:01	2
1278440	99	52	4,14	cyclictest	275	-21	dbus-daemon	23:30:01	1
1278440	99	52	33,13	cyclictest	275	-21	dbus-daemon	20:50:01	1
1278440	99	52	2,17	cyclictest	1295507	-21	modprobe	00:40:00	1
1278440	99	52	2,16	cyclictest	1280991	-21	cat	20:00:01	1
1278440	99	52	18,4	cyclictest	1290732	-21	latency_hist	23:05:02	1
1278440	99	52	15,6	cyclictest	1291039	-21	latency_hist	23:15:03	1
1278440	99	52	15,6	cyclictest	1291039	-21	latency_hist	23:15:02	1
1278440	99	52	14,8	cyclictest	23	-21	ksoftirqd/1	23:31:42	1
1278436	99	52	39,11	cyclictest	193	50	irq/34-mmc1	22:15:02	0
1278448	99	51	39,8	cyclictest	37	-21	ksoftirqd/3	19:20:00	3
1278448	99	51	1,10	cyclictest	37	-21	ksoftirqd/3	21:15:01	3
1278444	99	51	36,11	cyclictest	238	-21	systemd-journal	23:15:01	2
1278444	99	51	36,11	cyclictest	238	-21	systemd-journal	23:15:00	2
1278448	99	50	5,10	cyclictest	37	-21	ksoftirqd/3	23:35:01	3
1278448	99	50	3,9	cyclictest	37	-21	ksoftirqd/3	20:55:02	3
1278448	99	50	39,8	cyclictest	37	-21	ksoftirqd/3	21:45:00	3
1278448	99	50	39,8	cyclictest	37	-21	ksoftirqd/3	21:45:00	3
1278448	99	50	1,8	cyclictest	1288214	-21	grep	22:20:00	3
1278448	99	50	1,8	cyclictest	1288214	-21	grep	22:20:00	3
1278448	99	50	1,7	cyclictest	1284068	-21	sendmail-msp	21:00:00	3
1278448	99	50	14,9	cyclictest	37	-21	ksoftirqd/3	22:30:01	3
1278444	99	50	2,6	cyclictest	13	1	rcu_preempt	21:00:00	2
1278444	99	50	1,9	cyclictest	30	-21	ksoftirqd/2	22:25:00	2
1278444	99	50	10,6	cyclictest	13	1	rcu_preempt	19:40:00	2
1278440	99	50	3,15	cyclictest	1289441	-21	wc	22:40:02	1
1278440	99	50	3,12	cyclictest	1290265	-21	sendmail	23:00:01	1
1278440	99	50	18,10	cyclictest	1280894	-21	sed	19:55:03	1
1278436	99	50	3,11	cyclictest	0	-21	swapper/0	21:40:01	0
1278448	99	49	34,10	cyclictest	37	-21	ksoftirqd/3	23:50:00	3
1278448	99	49	34,10	cyclictest	37	-21	ksoftirqd/3	23:50:00	3
1278444	99	49	7,6	cyclictest	13	1	rcu_preempt	23:05:00	2
1278444	99	49	38,7	cyclictest	30	-21	ksoftirqd/2	23:10:01	2
1278440	99	49	8,5	cyclictest	0	-21	swapper/1	00:30:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:33