OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Wed May 13, 2026 12:45:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
16039	99	72	39,23	cyclictest	359	66	irq/58-eth0	09:10:13	3
15997	99	63	3,44	cyclictest	14864	-21	ssh	12:35:12	0
15997	99	62	4,48	cyclictest	5868	-21	ssh	12:30:13	0
16012	99	54	5,7	cyclictest	13	1	rcu_preempt	08:40:12	1
16012	99	54	23,5	cyclictest	21	-21	ksoftirqd/1	11:05:11	1
16012	99	52	5,8	cyclictest	13	1	rcu_preempt	11:20:13	1
16012	99	52	4,5	cyclictest	13	1	rcu_preempt	12:25:12	1
16012	99	52	2,7	cyclictest	13	1	rcu_preempt	11:00:12	1
16039	99	51	12,24	cyclictest	359	66	irq/58-eth0	11:05:12	3
16025	99	49	1,8	cyclictest	27	-21	ksoftirqd/2	09:50:11	2
16025	99	49	15,15	cyclictest	27	-21	ksoftirqd/2	09:45:13	2
16012	99	48	1,38	cyclictest	31199	-21	ssh	10:20:12	1
16025	99	47	1,36	cyclictest	29408	-21	ssh	10:55:13	2
16025	99	46	2,20	cyclictest	20834	-21	kworker/u8:2	11:10:15	2
16012	99	46	3,34	cyclictest	7850	-21	ssh	10:25:13	1
16012	99	46	2,32	cyclictest	11402	-21	ssh	12:15:13	1
16012	99	45	1,33	cyclictest	9347	-21	ssh	09:50:12	1
15997	99	45	1,29	cyclictest	4150	-21	ssh	10:05:13	0
16039	99	43	2,26	cyclictest	359	66	irq/58-eth0	08:40:14	3
16012	99	43	2,5	cyclictest	13	1	rcu_preempt	12:05:12	1
16012	99	42	16,19	cyclictest	21	-21	ksoftirqd/1	11:30:12	1
16012	99	41	25,11	cyclictest	21	-21	ksoftirqd/1	09:35:14	1
16012	99	40	1,27	cyclictest	25834	-21	ssh	10:35:12	1
15997	99	40	2,27	cyclictest	23803	-21	sh	09:40:13	0
15997	99	40	19,16	cyclictest	12	-21	ksoftirqd/0	08:45:13	0
16039	99	39	4,24	cyclictest	359	66	irq/58-eth0	11:15:12	3
16025	99	38	2,28	cyclictest	11411	-21	ssh	12:15:12	2
16025	99	38	1,28	cyclictest	18400	-21	ssh	09:55:13	2
16025	99	38	1,25	cyclictest	4148	-21	sh	10:05:13	2
16025	99	36	2,18	cyclictest	4410	-21	ssh	12:28:44	2
16012	99	36	16,17	cyclictest	21	-21	ksoftirqd/1	10:50:13	1
16012	99	36	16,17	cyclictest	21	-21	ksoftirqd/1	10:50:12	1
16012	99	35	3,19	cyclictest	21	-21	ksoftirqd/1	09:10:12	1
16012	99	34	2,4	cyclictest	13	1	rcu_preempt	11:55:11	1
16039	99	32	4,15	cyclictest	359	66	irq/58-eth0	10:55:13	3
16039	99	32	3,17	cyclictest	359	66	irq/58-eth0	08:00:13	3
16039	99	32	19,8	cyclictest	359	66	irq/58-eth0	11:25:12	3
16025	99	32	15,11	cyclictest	1496	-21	diskmemload	10:40:13	2
15997	99	32	4,24	cyclictest	22084	-21	sh	10:15:11	0
15997	99	32	2,19	cyclictest	664	-21	ntpd	08:55:13	0
16039	99	31	5,13	cyclictest	359	66	irq/58-eth0	09:35:15	3
16025	99	31	3,21	cyclictest	0	-21	swapper/2	07:15:14	2
16012	99	31	1,24	cyclictest	5878	-21	ssh	12:30:12	1
16025	99	30	2,21	cyclictest	0	-21	swapper/2	09:00:13	2
16025	99	29	19,6	cyclictest	0	-21	swapper/2	12:05:13	2
16025	99	29	12,8	cyclictest	537	-21	apt-get	11:15:12	2
16025	99	29	10,15	cyclictest	0	-21	swapper/2	12:35:11	2
16012	99	29	1,16	cyclictest	22206	-21	ssh	11:45:12	1
15997	99	29	1,25	cyclictest	11481	-21	rm	10:45:13	0
16025	99	28	2,20	cyclictest	0	-21	swapper/2	11:25:13	2
16025	99	28	2,12	cyclictest	930	-21	snmpd	10:25:11	2
16025	99	28	0,21	cyclictest	9589	-21	ssh	11:20:12	2
16012	99	28	2,19	cyclictest	4172	-21	ssh	11:35:15	1
16012	99	28	2,19	cyclictest	4172	-21	ssh	11:35:14	1
15997	99	28	3,9	cyclictest	12	-21	ksoftirqd/0	09:25:01	0
16039	99	27	6,11	cyclictest	0	-21	swapper/3	07:40:13	3
16039	99	27	1,16	cyclictest	359	66	irq/58-eth0	11:10:15	3
16025	99	27	2,21	cyclictest	0	-21	swapper/2	08:45:13	2
16025	99	27	2,11	cyclictest	27549	-21	ssh	11:30:12	2
16025	99	27	2,10	cyclictest	0	-21	swapper/2	07:40:14	2
16012	99	27	7,13	cyclictest	21	-21	ksoftirqd/1	08:10:12	1
16012	99	27	7,11	cyclictest	16874	-21	ssh	10:30:13	1
16012	99	27	4,11	cyclictest	0	-21	swapper/1	12:10:14	1
16012	99	27	3,15	cyclictest	29404	-21	sshd	10:55:12	1
16012	99	27	2,19	cyclictest	13164	-21	ssh	11:40:13	1
16012	99	27	17,6	cyclictest	0	-21	swapper/1	12:20:13	1
15997	99	27	13,10	cyclictest	20921	-21	apt-get	07:15:12	0
15997	99	27	1,22	cyclictest	29075	-21	rm	09:25:12	0
16039	99	26	2,14	cyclictest	359	66	irq/58-eth0	09:40:12	3
16025	99	26	4,4	cyclictest	13	1	rcu_preempt	08:30:13	2
16025	99	26	4,4	cyclictest	13	1	rcu_preempt	08:30:13	2
16025	99	26	3,16	cyclictest	273	46	irq/40-dwc2_hso	07:45:11	2
16025	99	26	1,16	cyclictest	0	-21	swapper/2	12:30:12	2
16012	99	26	10,12	cyclictest	2493	-21	diskmemload	10:40:12	1
15997	99	26	12,10	cyclictest	31187	-21	apt-get	10:20:14	0
16039	99	25	4,15	cyclictest	360	66	irq/59-eth0	10:40:11	3
16039	99	25	3,17	cyclictest	359	66	irq/58-eth0	08:30:14	3
16039	99	25	3,17	cyclictest	359	66	irq/58-eth0	08:30:13	3
16039	99	25	3,15	cyclictest	359	66	irq/58-eth0	10:30:13	3
16039	99	25	2,12	cyclictest	359	66	irq/58-eth0	09:50:10	3
16025	99	25	8,7	cyclictest	27	-21	ksoftirqd/2	11:52:10	2
16025	99	25	6,11	cyclictest	27	-21	ksoftirqd/2	08:00:24	2
16025	99	25	3,13	cyclictest	273	46	irq/40-dwc2_hso	10:35:11	2
16025	99	25	1,13	cyclictest	0	-21	swapper/2	10:10:13	2
16012	99	25	4,13	cyclictest	630	-21	Async	09:36:31	1
16012	99	25	3,14	cyclictest	23787	-21	ssh	09:40:12	1
15997	99	25	7,8	cyclictest	12	-21	ksoftirqd/0	10:38:49	0
15997	99	25	2,6	cyclictest	12	-21	ksoftirqd/0	11:18:42	0
15997	99	25	15,4	cyclictest	24009	-21	apt-get	11:10:14	0
16039	99	24	2,17	cyclictest	359	66	irq/58-eth0	11:30:12	3
16025	99	24	6,4	cyclictest	13	1	rcu_preempt	09:23:20	2
16025	99	24	3,15	cyclictest	273	46	irq/40-dwc2_hso	08:40:12	2
16025	99	24	3,14	cyclictest	273	46	irq/40-dwc2_hso	08:25:12	2
16025	99	24	2,17	cyclictest	273	46	irq/40-dwc2_hso	10:20:11	2
16025	99	24	2,17	cyclictest	1888	-21	ssh	09:10:13	2
16025	99	24	2,15	cyclictest	273	46	irq/40-dwc2_hso	07:30:14	2
16025	99	24	1,9	cyclictest	15868	66	ssh	11:05:18	2
16025	99	24	14,8	cyclictest	0	-21	swapper/2	09:18:44	2
16025	99	24	1,12	cyclictest	6003	-21	ssh	11:00:12	2
15997	99	24	5,3	cyclictest	13	1	rcu_preempt	12:05:26	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17