OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Tue Apr 07, 2026 00:45:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
17338	99	87	66,18	cyclictest	283	66	irq/58-eth0	23:50:13	3
17321	99	57	2,35	cyclictest	12511	-21	ssh	21:15:14	1
17321	99	56	5,8	cyclictest	13	1	rcu_preempt	23:00:13	1
17330	99	53	1,35	cyclictest	21616	-21	ssh	21:20:15	2
17321	99	53	2,9	cyclictest	21	-21	ksoftirqd/1	20:10:12	1
17321	99	50	4,36	cyclictest	24388	-21	ssh	23:45:13	1
17321	99	50	20,23	cyclictest	22218	-1	kworker/u9:1	22:50:13	1
17338	99	49	5,26	cyclictest	283	66	irq/58-eth0	22:00:13	3
17321	99	49	6,6	cyclictest	13	1	rcu_preempt	22:40:12	1
17330	99	48	22,21	cyclictest	0	-21	swapper/2	22:35:13	2
17321	99	48	8,35	cyclictest	1929	-21	ssh	21:45:10	1
17321	99	47	6,7	cyclictest	13	1	rcu_preempt	19:45:11	1
17321	99	46	2,33	cyclictest	17449	-21	ssh	00:35:12	1
17330	99	45	24,9	cyclictest	9200	-21	apt-get	19:35:13	2
17330	99	44	24,16	cyclictest	16222	-21	apt-get	21:35:09	2
17321	99	44	3,33	cyclictest	20094	-21	ssh	21:55:14	1
17321	99	43	16,21	cyclictest	13	1	rcu_preempt	22:15:11	1
17313	99	43	6,33	cyclictest	18517	-21	ssh	22:30:13	0
17338	99	42	4,24	cyclictest	283	66	irq/58-eth0	20:50:11	3
17338	99	42	1,25	cyclictest	283	66	irq/58-eth0	19:20:11	3
17321	99	42	5,28	cyclictest	29685	-21	ssh	23:30:14	1
17313	99	42	4,27	cyclictest	27544	-21	ssh	22:35:13	0
17321	99	41	2,36	cyclictest	28238	-21	ssh	00:05:14	1
17313	99	41	2,31	cyclictest	6283	-21	ssh	23:35:14	0
17338	99	40	2,23	cyclictest	283	66	irq/58-eth0	22:10:13	3
17321	99	40	1,34	cyclictest	16238	-21	ssh	21:35:11	1
17321	99	40	1,29	cyclictest	29124	-21	ssh	22:00:13	1
17338	99	39	5,20	cyclictest	283	66	irq/58-eth0	21:25:13	3
17338	99	39	2,25	cyclictest	283	66	irq/58-eth0	00:35:11	3
17330	99	39	14,21	cyclictest	0	-21	swapper/2	21:15:14	2
17338	99	38	4,20	cyclictest	0	-21	swapper/3	00:10:13	3
17338	99	38	1,25	cyclictest	283	66	irq/58-eth0	23:25:14	3
17321	99	38	2,28	cyclictest	411	-21	ssh	22:20:14	1
17313	99	38	3,30	cyclictest	25340	-21	ssh	21:40:13	0
17338	99	37	5,23	cyclictest	283	66	irq/58-eth0	21:55:13	3
17321	99	37	3,28	cyclictest	25945	-21	ssh	23:10:12	1
17321	99	37	23,8	cyclictest	21	-21	ksoftirqd/1	00:00:24	1
17321	99	37	21,9	cyclictest	21	-21	ksoftirqd/1	00:23:35	1
17330	99	36	27,6	cyclictest	26	1	rcuc/2	22:45:14	2
17330	99	36	27,6	cyclictest	26	1	rcuc/2	22:45:14	2
17330	99	36	17,13	cyclictest	0	-21	swapper/2	23:35:13	2
17321	99	36	2,4	cyclictest	13	1	rcu_preempt	21:30:12	1
17321	99	36	2,19	cyclictest	21	-21	ksoftirqd/1	21:10:13	1
17313	99	36	3,25	cyclictest	13836	-21	ssh	00:15:12	0
17330	99	35	7,9	cyclictest	4297	-21	processes	20:00:27	2
17321	99	35	1,31	cyclictest	11593	-21	ssh	23:20:11	1
17338	99	34	2,22	cyclictest	283	66	irq/58-eth0	22:35:12	3
17330	99	34	6,19	cyclictest	8793	-21	rm	23:53:58	2
17330	99	34	4,14	cyclictest	20328	-21	grep	00:35:20	2
17330	99	34	2,16	cyclictest	25346	-21	ssh	21:40:14	2
17330	99	33	4,10	cyclictest	24435	-21	usage_Anybus	21:55:30	2
17330	99	33	3,14	cyclictest	30866	-21	latency_hist	21:05:02	2
17330	99	33	27,3	cyclictest	22349	-21	apt-get	19:15:12	2
17330	99	33	22,8	cyclictest	390	-21	apt-get	22:20:14	2
17330	99	33	2,14	cyclictest	13672	-21	ntp_192.168.114	23:55:24	2
17330	99	33	20,7	cyclictest	630	-21	tcf-agent	00:25:13	2
17330	99	33	20,10	cyclictest	28208	-21	apt-get	00:05:14	2
17330	99	33	20,10	cyclictest	22169	-21	apt-get	22:50:14	2
17321	99	33	4,21	cyclictest	21	-21	ksoftirqd/1	00:10:14	1
17321	99	33	3,21	cyclictest	3105	-21	diskmemload	23:40:12	1
17321	99	33	3,21	cyclictest	3105	-21	diskmemload	23:40:12	1
17330	99	32	21,7	cyclictest	223	46	irq/40-dwc2_hso	00:10:13	2
17330	99	32	18,10	cyclictest	11581	-21	apt-get	23:20:11	2
17330	99	32	13,8	cyclictest	0	-21	swapper/2	23:25:13	2
17313	99	32	4,3	cyclictest	13	1	rcu_preempt	00:13:10	0
17313	99	32	2,22	cyclictest	22352	-21	sshd	19:15:13	0
17338	99	31	2,15	cyclictest	283	66	irq/58-eth0	22:40:11	3
17330	99	31	6,21	cyclictest	0	-21	swapper/2	23:10:13	2
17330	99	31	4,8	cyclictest	28032	-21	cat	19:50:29	2
17330	99	31	4,7	cyclictest	21635	-21	ssh	22:12:56	2
17330	99	31	20,3	cyclictest	15326	-21	apt-get	23:40:13	2
17330	99	31	20,3	cyclictest	15326	-21	apt-get	23:40:13	2
17330	99	31	10,14	cyclictest	0	-21	swapper/2	20:10:12	2
17313	99	31	1,2	cyclictest	13	1	rcu_preempt	23:40:12	0
17313	99	31	1,2	cyclictest	13	1	rcu_preempt	23:40:11	0
17338	99	30	4,15	cyclictest	283	66	irq/58-eth0	23:05:14	3
17338	99	30	1,15	cyclictest	283	66	irq/58-eth0	22:20:14	3
17330	99	30	5,4	cyclictest	892	-21	ntp_states	23:30:27	2
17330	99	30	5,11	cyclictest	9365	-21	ssh	23:17:50	2
17330	99	30	4,14	cyclictest	10915	-21	cut	22:25:20	2
17330	99	30	4,10	cyclictest	1191	-21	kthreadcore	19:25:18	2
17330	99	30	2,10	cyclictest	16989	-21	ssh	23:05:14	2
17330	99	30	1,15	cyclictest	23773	-21	ssh	22:15:12	2
17330	99	30	10,9	cyclictest	0	-21	swapper/2	19:10:11	2
17313	99	30	14,11	cyclictest	25927	-21	apt-get	23:10:12	0
17313	99	30	1,23	cyclictest	8078	-21	ssh	23:53:06	0
17338	99	29	3,15	cyclictest	283	66	irq/58-eth0	23:55:13	3
17338	99	29	3,15	cyclictest	283	66	irq/58-eth0	22:30:13	3
17338	99	29	16,8	cyclictest	283	66	irq/58-eth0	21:15:15	3
17330	99	29	6,8	cyclictest	18873	-21	grep	20:50:20	2
17330	99	29	4,13	cyclictest	18588	-21	ls	19:45:01	2
17330	99	29	3,10	cyclictest	23282	-21	cat	19:45:30	2
17330	99	29	22,4	cyclictest	3492	-21	apt-get	21:10:12	2
17313	99	29	9,5	cyclictest	12	-21	ksoftirqd/0	23:30:26	0
17313	99	29	3,5	cyclictest	12	-21	ksoftirqd/0	21:20:02	0
17338	99	28	3,16	cyclictest	0	-21	swapper/3	23:36:24	3
17338	99	28	2,12	cyclictest	283	66	irq/58-eth0	22:15:11	3
17338	99	28	14,6	cyclictest	0	-21	swapper/3	22:50:13	3
17338	99	28	12,9	cyclictest	283	66	irq/58-eth0	23:30:14	3
17330	99	28	5,8	cyclictest	3105	-21	diskmemload	21:53:54	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17