OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Wed Aug 05, 2026 00:45:06)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
30402	99	67	47,15	cyclictest	359	66	irq/58-eth0	21:25:11	3
30402	99	60	37,11	cyclictest	359	66	irq/58-eth0	21:50:13	3
30385	99	60	3,33	cyclictest	13	1	rcu_preempt	22:55:13	1
30377	99	56	10,6	cyclictest	13	1	rcu_preempt	00:20:14	0
30385	99	55	6,45	cyclictest	1636	-21	ssh	23:25:11	1
30385	99	55	6,45	cyclictest	1636	-21	ssh	23:25:10	1
30385	99	52	5,40	cyclictest	31059	-21	ssh	00:35:17	1
30385	99	46	11,10	cyclictest	13	1	rcu_preempt	19:30:14	1
30402	99	45	4,27	cyclictest	359	66	irq/58-eth0	22:25:14	3
30402	99	43	1,23	cyclictest	359	66	irq/58-eth0	22:40:15	3
30402	99	42	3,22	cyclictest	359	66	irq/58-eth0	23:50:12	3
30385	99	42	1,33	cyclictest	10698	-21	ssh	23:30:11	1
30393	99	41	2,25	cyclictest	8468	-21	ssh	22:35:13	2
30402	99	40	3,24	cyclictest	359	66	irq/58-eth0	23:20:12	3
30377	99	39	4,27	cyclictest	18367	-21	ssh	00:10:14	0
30393	99	38	4,6	cyclictest	0	-21	swapper/2	22:10:13	2
30385	99	38	11,19	cyclictest	21	-21	ksoftirqd/1	23:35:17	1
30377	99	38	1,23	cyclictest	2236	-21	ssh	21:20:13	0
30402	99	37	3,19	cyclictest	359	66	irq/58-eth0	23:00:15	3
30402	99	37	3,17	cyclictest	359	66	irq/58-eth0	19:10:13	3
30377	99	37	1,31	cyclictest	12963	-21	ssh	00:25:15	0
30402	99	35	2,17	cyclictest	359	66	irq/58-eth0	00:00:12	3
30402	99	35	19,11	cyclictest	359	66	irq/58-eth0	21:55:13	3
30377	99	35	4,19	cyclictest	16497	-21	ssh	21:10:14	0
30377	99	34	2,28	cyclictest	19864	-21	ssh	23:35:17	0
30402	99	33	1,21	cyclictest	0	-21	swapper/3	21:15:15	3
30377	99	33	7,7	cyclictest	13	1	rcu_preempt	23:20:12	0
30402	99	32	4,18	cyclictest	359	66	irq/58-eth0	22:00:15	3
30402	99	32	16,8	cyclictest	0	-21	swapper/3	21:05:14	3
30402	99	32	1,18	cyclictest	359	66	irq/58-eth0	21:35:15	3
30393	99	32	3,18	cyclictest	273	46	irq/40-dwc2_hso	00:30:13	2
30385	99	32	19,8	cyclictest	0	-21	swapper/1	00:20:13	1
30377	99	32	4,11	cyclictest	12	-21	ksoftirqd/0	23:05:14	0
30402	99	31	14,13	cyclictest	359	66	irq/58-eth0	23:40:14	3
30393	99	31	3,17	cyclictest	0	-21	swapper/2	23:35:17	2
30393	99	31	23,5	cyclictest	273	46	irq/40-dwc2_hso	23:55:13	2
30385	99	31	3,18	cyclictest	13	1	rcu_preempt	20:45:11	1
30385	99	31	2,21	cyclictest	11130	-21	sh	23:46:27	1
30402	99	30	20,6	cyclictest	0	-21	swapper/3	23:35:17	3
30393	99	30	6,18	cyclictest	7902	-1	kworker/2:1H	22:50:04	2
30393	99	30	4,10	cyclictest	2399	-21	kthreadcore	23:25:19	2
30393	99	30	4,10	cyclictest	2399	-21	kthreadcore	23:25:18	2
30393	99	30	3,21	cyclictest	0	-21	swapper/2	23:11:18	2
30393	99	30	3,20	cyclictest	0	-21	swapper/2	19:45:15	2
30393	99	30	3,17	cyclictest	273	46	irq/40-dwc2_hso	22:45:14	2
30385	99	30	10,15	cyclictest	21	-21	ksoftirqd/1	23:05:16	1
30377	99	30	3,4	cyclictest	13	1	rcu_preempt	22:45:13	0
30402	99	29	2,16	cyclictest	359	66	irq/58-eth0	22:55:13	3
30402	99	29	2,10	cyclictest	359	66	irq/58-eth0	23:55:14	3
30393	99	29	3,19	cyclictest	273	46	irq/40-dwc2_hso	19:50:13	2
30393	99	29	3,15	cyclictest	273	46	irq/40-dwc2_hso	20:20:10	2
30393	99	29	2,20	cyclictest	0	-21	swapper/2	23:50:14	2
30393	99	29	2,20	cyclictest	0	-21	swapper/2	20:45:11	2
30393	99	29	2,15	cyclictest	17539	-21	ssh	22:40:14	2
30385	99	29	1,24	cyclictest	22798	-21	ssh	22:25:14	1
30385	99	29	1,21	cyclictest	24169	-21	ssh	21:50:12	1
30385	99	29	1,20	cyclictest	27983	-21	ssh	22:10:15	1
30402	99	28	2,15	cyclictest	359	66	irq/58-eth0	20:25:14	3
30393	99	28	8,12	cyclictest	27	-21	ksoftirqd/2	23:06:12	2
30393	99	28	6,13	cyclictest	273	46	irq/40-dwc2_hso	23:45:13	2
30393	99	28	4,14	cyclictest	273	46	irq/40-dwc2_hso	20:55:15	2
30393	99	28	3,13	cyclictest	27	-21	ksoftirqd/2	20:40:30	2
30393	99	28	2,18	cyclictest	273	46	irq/40-dwc2_hso	20:25:14	2
30385	99	28	5,4	cyclictest	13	1	rcu_preempt	23:55:13	1
30385	99	28	1,20	cyclictest	15119	-21	ssh	21:45:12	1
30385	99	28	11,13	cyclictest	13	1	rcu_preempt	21:25:10	1
30402	99	27	1,17	cyclictest	359	66	irq/58-eth0	23:45:14	3
30393	99	27	8,4	cyclictest	27	-21	ksoftirqd/2	21:17:32	2
30393	99	27	3,18	cyclictest	273	46	irq/40-dwc2_hso	19:15:14	2
30393	99	27	3,11	cyclictest	27	-21	ksoftirqd/2	00:17:24	2
30393	99	27	12,4	cyclictest	27	-21	ksoftirqd/2	23:20:33	2
30385	99	27	5,18	cyclictest	6077	-21	ssh	21:40:15	1
30377	99	27	13,4	cyclictest	12	-21	ksoftirqd/0	23:15:16	0
30393	99	26	6,6	cyclictest	27	-21	ksoftirqd/2	00:21:12	2
30377	99	26	13,4	cyclictest	12	-21	ksoftirqd/0	23:30:19	0
30377	99	26	1,19	cyclictest	31917	-21	ssh	00:35:24	0
30393	99	25	9,3	cyclictest	27	-21	ksoftirqd/2	21:56:09	2
30393	99	25	7,8	cyclictest	27	-21	ksoftirqd/2	21:11:38	2
30393	99	25	5,8	cyclictest	27	-21	ksoftirqd/2	21:25:10	2
30393	99	25	5,13	cyclictest	27	-21	ksoftirqd/2	22:04:56	2
30393	99	25	3,7	cyclictest	13	1	rcu_preempt	21:05:15	2
30393	99	25	3,14	cyclictest	273	46	irq/40-dwc2_hso	23:40:14	2
30393	99	25	1,9	cyclictest	8330	-21	ssh	00:04:20	2
30393	99	25	1,9	cyclictest	16528	-21	ssh	00:08:19	2
30393	99	25	13,9	cyclictest	26	1	rcuc/2	20:30:13	2
30393	99	25	13,9	cyclictest	19435	-21	ssh	22:21:30	2
30393	99	25	1,16	cyclictest	20323	-21	acpi	21:30:12	2
30393	99	25	1,16	cyclictest	16079	-21	diskmemload	23:15:14	2
30393	99	25	0,17	cyclictest	5721	-21	ls	21:40:01	2
30385	99	25	1,17	cyclictest	73	-21	kswapd0	00:30:15	1
30377	99	25	4,13	cyclictest	13	1	rcu_preempt	21:50:10	0
30377	99	25	14,3	cyclictest	12	-21	ksoftirqd/0	22:56:32	0
30377	99	25	1,21	cyclictest	6087	-21	ssh	21:40:15	0
30377	99	25	1,20	cyclictest	29468	-21	ssh	21:35:16	0
30393	99	24	9,3	cyclictest	27	-21	ksoftirqd/2	00:25:03	2
30393	99	24	7,4	cyclictest	27	-21	ksoftirqd/2	22:57:40	2
30393	99	24	6,8	cyclictest	27	-21	ksoftirqd/2	22:07:14	2
30393	99	24	3,16	cyclictest	273	46	irq/40-dwc2_hso	20:00:13	2
30393	99	24	1,14	cyclictest	8242	-21	awk	22:15:24	2
30393	99	24	0,11	cyclictest	10396	-21	timerandwakeup	21:00:30	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17