OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot3s.osadl.org (updated Tue Nov 25, 2025 00:45:01)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4135162	99	108	2,3	cyclictest	13	1	rcu_preempt	21:45:02	2
4135155	99	102	1,98	cyclictest	0	-21	swapper/0	00:35:03	0
4135160	99	89	6,5	cyclictest	23	-21	ksoftirqd/1	21:00:02	1
4135155	99	68	1,4	cyclictest	13	1	rcu_preempt	21:50:01	0
4135155	99	66	6,7	cyclictest	12	1	ksoftirqd/0	22:28:20	0
4135155	99	66	4,9	cyclictest	12	-21	ksoftirqd/0	23:40:01	0
4135155	99	66	4,9	cyclictest	12	-21	ksoftirqd/0	23:40:00	0
4135155	99	64	2,5	cyclictest	13	1	rcu_preempt	22:04:21	0
4135166	99	63	4,9	cyclictest	37	-21	ksoftirqd/3	00:00:00	3
4135155	99	63	6,10	cyclictest	12	-21	ksoftirqd/0	22:45:00	0
4135155	99	62	7,25	cyclictest	13	1	rcu_preempt	20:05:02	0
4135160	99	60	14,7	cyclictest	23	-21	ksoftirqd/1	23:30:02	1
4135155	99	60	17,6	cyclictest	13	1	rcu_preempt	20:25:00	0
4135155	99	60	10,6	cyclictest	13	1	rcu_preempt	23:10:02	0
4135155	99	59	6,5	cyclictest	13	1	rcu_preempt	20:00:02	0
4135155	99	59	1,7	cyclictest	12	1	ksoftirqd/0	22:10:21	0
4135155	99	59	1,11	cyclictest	12	-21	ksoftirqd/0	00:15:00	0
4135155	99	59	10,5	cyclictest	13	1	rcu_preempt	22:20:01	0
4135162	99	58	38,15	cyclictest	235	-21	systemd-journal	00:15:00	2
4135155	99	58	9,5	cyclictest	13	1	rcu_preempt	20:15:02	0
4135155	99	58	6,8	cyclictest	12	-21	ksoftirqd/0	20:50:02	0
4135155	99	58	13,5	cyclictest	13	1	rcu_preempt	19:45:02	0
4135155	99	57	11,5	cyclictest	13	1	rcu_preempt	19:50:02	0
4135160	99	56	6,7	cyclictest	23	-21	ksoftirqd/1	00:30:02	1
4135155	99	56	7,6	cyclictest	13	1	rcu_preempt	23:00:01	0
4135155	99	56	6,11	cyclictest	12	-21	ksoftirqd/0	20:30:02	0
4135155	99	56	2,5	cyclictest	13	1	rcu_preempt	00:10:02	0
4135166	99	55	1,5	cyclictest	13	1	rcu_preempt	23:40:01	3
4135166	99	55	1,5	cyclictest	13	1	rcu_preempt	23:40:00	3
4135160	99	55	9,10	cyclictest	23	-21	ksoftirqd/1	23:20:02	1
4135160	99	55	8,8	cyclictest	23	-21	ksoftirqd/1	19:20:00	1
4135160	99	55	5,8	cyclictest	23	-21	ksoftirqd/1	22:30:01	1
4135155	99	55	8,6	cyclictest	13	1	rcu_preempt	00:40:02	0
4135155	99	55	4,6	cyclictest	12	-21	ksoftirqd/0	23:05:02	0
4135155	99	55	24,8	cyclictest	12	-21	ksoftirqd/0	22:40:03	0
4135155	99	55	1,5	cyclictest	13	1	rcu_preempt	21:24:21	0
4135155	99	55	15,10	cyclictest	12	-21	ksoftirqd/0	19:40:01	0
4135160	99	54	9,9	cyclictest	23	-21	ksoftirqd/1	21:55:02	1
4135160	99	54	4,8	cyclictest	23	-21	ksoftirqd/1	21:40:01	1
4135160	99	54	4,8	cyclictest	23	-21	ksoftirqd/1	20:45:02	1
4135160	99	54	3,8	cyclictest	23	-21	ksoftirqd/1	20:40:00	1
4135160	99	54	2,18	cyclictest	23	-21	ksoftirqd/1	22:50:02	1
4135160	99	54	2,18	cyclictest	23	-21	ksoftirqd/1	22:50:02	1
4135155	99	54	7,9	cyclictest	12	-21	ksoftirqd/0	21:55:02	0
4135155	99	54	6,8	cyclictest	12	-21	ksoftirqd/0	20:10:01	0
4135155	99	54	6,6	cyclictest	13	1	rcu_preempt	23:15:02	0
4135155	99	54	13,6	cyclictest	13	1	rcu_preempt	00:00:02	0
4135155	99	54	10,5	cyclictest	13	1	rcu_preempt	22:50:02	0
4135155	99	54	10,5	cyclictest	13	1	rcu_preempt	22:50:02	0
4135166	99	53	6,8	cyclictest	37	-21	ksoftirqd/3	21:20:00	3
4135160	99	53	9,8	cyclictest	23	-21	ksoftirqd/1	19:50:01	1
4135160	99	53	7,9	cyclictest	23	-21	ksoftirqd/1	00:02:56	1
4135160	99	53	6,10	cyclictest	23	-21	ksoftirqd/1	22:55:01	1
4135160	99	53	3,9	cyclictest	23	-21	ksoftirqd/1	21:05:01	1
4135160	99	53	3,10	cyclictest	23	-21	ksoftirqd/1	19:45:02	1
4135160	99	53	21,9	cyclictest	23	-21	ksoftirqd/1	22:00:01	1
4135160	99	53	13,11	cyclictest	23	-21	ksoftirqd/1	22:25:02	1
4135160	99	53	11,10	cyclictest	23	-21	ksoftirqd/1	20:50:02	1
4135155	99	53	9,11	cyclictest	12	-21	ksoftirqd/0	21:15:00	0
4135155	99	53	8,8	cyclictest	12	-21	ksoftirqd/0	22:00:00	0
4135155	99	53	7,9	cyclictest	12	-21	ksoftirqd/0	00:30:00	0
4135155	99	53	6,7	cyclictest	12	-21	ksoftirqd/0	23:55:02	0
4135155	99	53	6,7	cyclictest	12	-21	ksoftirqd/0	23:55:02	0
4135155	99	53	5,9	cyclictest	12	-21	ksoftirqd/0	00:05:00	0
4135155	99	53	44,5	cyclictest	4135158	-21	ls	19:10:02	0
4135155	99	53	10,7	cyclictest	13	1	rcu_preempt	21:40:01	0
4135155	99	53	10,5	cyclictest	13	1	rcu_preempt	19:30:02	0
4135166	99	52	5,8	cyclictest	37	-21	ksoftirqd/3	23:25:02	3
4135166	99	52	32,9	cyclictest	37	-21	ksoftirqd/3	21:35:00	3
4135166	99	52	23,21	cyclictest	36	1	rcuc/3	22:00:02	3
4135162	99	52	45,5	cyclictest	30	-21	ksoftirqd/2	22:35:02	2
4135162	99	52	45,5	cyclictest	30	-21	ksoftirqd/2	22:35:02	2
4135160	99	52	9,9	cyclictest	23	-21	ksoftirqd/1	20:25:01	1
4135160	99	52	8,8	cyclictest	23	-21	ksoftirqd/1	23:00:02	1
4135160	99	52	8,7	cyclictest	23	-21	ksoftirqd/1	21:17:00	1
4135160	99	52	5,9	cyclictest	23	-21	ksoftirqd/1	00:15:01	1
4135160	99	52	5,11	cyclictest	23	-21	ksoftirqd/1	21:45:01	1
4135160	99	52	4,10	cyclictest	23	-21	ksoftirqd/1	00:40:01	1
4135155	99	52	9,5	cyclictest	13	1	rcu_preempt	23:30:02	0
4135155	99	52	3,7	cyclictest	12	-21	ksoftirqd/0	21:30:02	0
4135155	99	52	3,40	cyclictest	4149698	-21	modprobe	23:50:00	0
4135155	99	52	2,8	cyclictest	12	-21	ksoftirqd/0	21:45:01	0
4135155	99	52	14,10	cyclictest	12	-21	ksoftirqd/0	20:20:02	0
4135155	99	52	13,11	cyclictest	12	-21	ksoftirqd/0	20:30:02	0
4135155	99	52	12,6	cyclictest	13	1	rcu_preempt	21:10:02	0
4135155	99	52	10,5	cyclictest	13	1	rcu_preempt	21:20:03	0
4135160	99	51	7,7	cyclictest	23	-21	ksoftirqd/1	22:05:02	1
4135160	99	51	6,7	cyclictest	23	-21	ksoftirqd/1	23:35:02	1
4135160	99	51	5,9	cyclictest	23	-21	ksoftirqd/1	23:40:02	1
4135160	99	51	5,9	cyclictest	23	-21	ksoftirqd/1	23:40:02	1
4135160	99	51	3,9	cyclictest	23	-21	ksoftirqd/1	00:25:02	1
4135160	99	51	34,13	cyclictest	272	-21	dbus-daemon	20:15:01	1
4135160	99	51	2,10	cyclictest	23	-21	ksoftirqd/1	19:15:01	1
4135155	99	51	9,5	cyclictest	13	1	rcu_preempt	00:20:00	0
4135155	99	51	7,6	cyclictest	13	1	rcu_preempt	23:20:01	0
4135155	99	51	6,7	cyclictest	12	-21	ksoftirqd/0	00:25:02	0
4135155	99	51	6,5	cyclictest	13	1	rcu_preempt	19:15:01	0
4135155	99	51	5,8	cyclictest	12	-21	ksoftirqd/0	23:25:01	0
4135155	99	51	11,6	cyclictest	13	1	rcu_preempt	23:45:00	0
4135155	99	51	11,6	cyclictest	13	1	rcu_preempt	22:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:33