OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Sat May 09, 2026 12:45:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
8312	99	80	45,26	cyclictest	359	66	irq/58-eth0	11:05:13	3
8296	99	72	3,56	cyclictest	3696	-21	ssh	12:15:11	1
8288	99	70	3,7	cyclictest	13	1	rcu_preempt	07:45:12	0
8312	99	63	57,4	cyclictest	359	66	irq/58-eth0	11:20:12	3
8305	99	63	23,5	cyclictest	16517	-21	ssh	11:10:11	2
8305	99	63	23,5	cyclictest	16517	-21	ssh	11:10:10	2
8288	99	62	5,44	cyclictest	12659	-21	ssh	09:20:14	0
8288	99	54	2,41	cyclictest	5588	-21	ssh	10:10:15	0
8288	99	46	30,7	cyclictest	12	-21	ksoftirqd/0	11:05:11	0
8296	99	45	8,5	cyclictest	13	1	rcu_preempt	10:20:13	1
8288	99	45	25,6	cyclictest	12	-21	ksoftirqd/0	08:10:13	0
8305	99	43	1,34	cyclictest	20126	-21	ssh	11:30:12	2
8312	99	42	4,26	cyclictest	359	66	irq/58-eth0	09:55:14	3
8305	99	42	1,19	cyclictest	3577	-21	ssh	09:15:15	2
8312	99	39	3,23	cyclictest	359	66	irq/58-eth0	10:45:12	3
8312	99	39	2,21	cyclictest	359	66	irq/58-eth0	11:35:12	3
8305	99	39	2,23	cyclictest	12669	-21	ssh	12:20:09	2
8296	99	39	9,18	cyclictest	21	-21	ksoftirqd/1	07:20:12	1
8288	99	38	4,24	cyclictest	12684	-21	ssh	12:20:10	0
8305	99	36	6,18	cyclictest	27	-21	ksoftirqd/2	07:50:12	2
8296	99	36	1,26	cyclictest	0	-21	swapper/1	11:40:14	1
8288	99	36	4,27	cyclictest	9259	-21	ssh	10:30:12	0
8288	99	36	4,20	cyclictest	30689	-21	ssh	12:30:14	0
8305	99	35	2,16	cyclictest	29085	-21	ssh	11:35:13	2
8305	99	35	1,6	cyclictest	13	1	rcu_preempt	12:15:12	2
8288	99	35	19,5	cyclictest	12	-21	ksoftirqd/0	09:40:14	0
8312	99	34	2,18	cyclictest	359	66	irq/58-eth0	12:20:10	3
8296	99	34	20,8	cyclictest	32637	-21	sh	11:55:13	1
8288	99	34	2,29	cyclictest	30988	-21	ssh	11:00:12	0
8288	99	34	1,27	cyclictest	21726	-21	ssh	09:25:13	0
8312	99	33	12,11	cyclictest	0	-21	swapper/3	09:45:13	3
8296	99	33	4,22	cyclictest	7203	-21	ssh	12:35:14	1
8296	99	33	3,22	cyclictest	18279	-21	ssh	10:35:13	1
8296	99	33	13,8	cyclictest	8276	-21	cyclictest	07:55:14	1
8288	99	33	6,19	cyclictest	15	1	rcuc/0	09:35:14	0
8288	99	33	1,27	cyclictest	14607	-21	ssh	10:15:14	0
8312	99	32	1,16	cyclictest	359	66	irq/58-eth0	10:50:12	3
8305	99	32	5,21	cyclictest	8276	-21	cyclictest	10:05:13	2
8305	99	32	5,21	cyclictest	8276	-21	cyclictest	10:05:12	2
8305	99	32	1,17	cyclictest	27171	-21	ssh	12:10:13	2
8296	99	32	23,4	cyclictest	5561	-21	apt-get	10:10:15	1
8288	99	32	3,17	cyclictest	20116	-21	ssh	11:30:13	0
8312	99	31	5,16	cyclictest	359	66	irq/58-eth0	11:00:11	3
8296	99	31	22,4	cyclictest	27743	-21	apt-get	07:30:13	1
8296	99	31	18,8	cyclictest	12659	-21	apt-get	12:20:10	1
8296	99	31	16,8	cyclictest	0	-21	swapper/1	09:25:15	1
8288	99	31	2,24	cyclictest	21727	-21	ssh	12:25:14	0
8288	99	31	2,21	cyclictest	19915	-21	ssh	10:00:12	0
8312	99	30	8,10	cyclictest	359	66	irq/58-eth0	11:40:13	3
8312	99	30	4,15	cyclictest	0	-21	swapper/3	10:15:13	3
8312	99	30	15,6	cyclictest	0	-21	swapper/3	08:55:11	3
8305	99	30	5,15	cyclictest	273	46	irq/40-dwc2_hso	07:40:13	2
8305	99	30	5,15	cyclictest	273	46	irq/40-dwc2_hso	07:40:12	2
8305	99	30	3,16	cyclictest	273	46	irq/40-dwc2_hso	07:25:12	2
8305	99	30	2,18	cyclictest	273	46	irq/40-dwc2_hso	08:45:12	2
8312	99	29	7,13	cyclictest	0	-21	swapper/3	09:30:13	3
8312	99	29	7,11	cyclictest	359	66	irq/58-eth0	11:15:12	3
8312	99	29	4,14	cyclictest	359	66	irq/58-eth0	12:10:12	3
8312	99	29	1,14	cyclictest	359	66	irq/58-eth0	12:25:11	3
8305	99	29	3,14	cyclictest	273	46	irq/40-dwc2_hso	09:45:13	2
8305	99	29	3,11	cyclictest	0	-21	swapper/2	07:35:13	2
8305	99	29	2,20	cyclictest	0	-21	swapper/2	09:05:15	2
8305	99	29	2,15	cyclictest	14571	-21	ssh	11:45:13	2
8305	99	29	1,21	cyclictest	7555	-21	ssh	11:05:12	2
8305	99	28	3,16	cyclictest	273	46	irq/40-dwc2_hso	08:00:12	2
8305	99	28	2,20	cyclictest	0	-21	swapper/2	08:50:14	2
8296	99	28	9,15	cyclictest	0	-21	swapper/1	12:00:14	1
8296	99	28	5,19	cyclictest	3948	-21	ssh	10:45:12	1
8296	99	28	2,18	cyclictest	18146	-21	sh	12:05:14	1
8296	99	28	2,18	cyclictest	18146	-21	sh	12:05:14	1
8312	99	27	0,18	cyclictest	359	66	irq/58-eth0	11:55:12	3
8305	99	27	2,19	cyclictest	0	-21	swapper/2	08:35:16	2
8305	99	27	2,19	cyclictest	0	-21	swapper/2	08:35:16	2
8305	99	27	1,20	cyclictest	32629	-21	ssh	11:55:14	2
8296	99	27	3,19	cyclictest	30680	-21	sh	12:30:14	1
8288	99	27	20,3	cyclictest	12	1	ksoftirqd/0	09:15:13	0
8312	99	26	2,15	cyclictest	359	66	irq/58-eth0	10:35:13	3
8305	99	26	3,13	cyclictest	273	46	irq/40-dwc2_hso	08:05:15	2
8305	99	26	2,15	cyclictest	273	46	irq/40-dwc2_hso	11:20:11	2
8305	99	26	2,10	cyclictest	7184	-21	ssh	12:35:13	2
8296	99	26	18,4	cyclictest	20677	-21	apt-get	08:30:13	1
8288	99	26	8,12	cyclictest	12	-21	ksoftirqd/0	08:40:12	0
8312	99	25	9,9	cyclictest	359	66	irq/58-eth0	11:25:12	3
8312	99	25	3,13	cyclictest	359	66	irq/58-eth0	10:10:14	3
8312	99	25	21,2	cyclictest	0	-21	swapper/3	07:55:13	3
8312	99	25	1,17	cyclictest	359	66	irq/58-eth0	10:05:13	3
8312	99	25	1,17	cyclictest	359	66	irq/58-eth0	10:05:12	3
8305	99	25	4,17	cyclictest	273	46	irq/40-dwc2_hso	10:15:13	2
8305	99	25	3,16	cyclictest	273	46	irq/40-dwc2_hso	09:35:13	2
8305	99	25	3,16	cyclictest	0	-21	swapper/2	10:35:14	2
8305	99	25	2,17	cyclictest	0	-21	swapper/2	11:15:15	2
8305	99	25	2,13	cyclictest	30690	-21	diskmemload	12:30:14	2
8305	99	25	1,15	cyclictest	6042	-21	latency_hist	08:15:01	2
8296	99	25	8,10	cyclictest	0	-21	swapper/1	07:36:26	1
8296	99	25	4,4	cyclictest	21	-21	ksoftirqd/1	10:33:50	1
8296	99	25	18,4	cyclictest	28972	-21	apt-get	10:05:13	1
8296	99	25	18,4	cyclictest	28972	-21	apt-get	10:05:12	1
8296	99	25	14,8	cyclictest	19895	-21	apt-get	10:00:11	1
8288	99	25	1,20	cyclictest	15	1	rcuc/0	09:50:13	0
8312	99	24	4,12	cyclictest	0	-21	swapper/3	12:15:12	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17