OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Tue Apr 14, 2026 00:45:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2343	99	81	6,26	cyclictest	27	-21	ksoftirqd/2	19:15:13	2
2343	99	81	6,26	cyclictest	27	-21	ksoftirqd/2	19:15:13	2
2352	99	66	49,10	cyclictest	359	66	irq/58-eth0	21:35:12	3
2343	99	63	4,34	cyclictest	25586	-21	ssh	23:15:14	2
2323	99	63	28,11	cyclictest	12	-21	ksoftirqd/0	22:05:12	0
2323	99	62	4,44	cyclictest	15715	-21	ssh	00:20:13	0
2323	99	60	31,20	cyclictest	11209	-21	ssh	00:00:13	0
2323	99	56	2,45	cyclictest	6511	-21	ssh	00:15:12	0
2323	99	54	3,42	cyclictest	7196	-21	ssh	21:55:12	0
2352	99	52	21,19	cyclictest	359	66	irq/58-eth0	00:35:13	3
2352	99	50	5,25	cyclictest	359	66	irq/58-eth0	00:30:14	3
2323	99	49	2,32	cyclictest	2704	-21	ssh	22:10:13	0
2343	99	47	5,30	cyclictest	7025	-21	ssh	23:05:13	2
2323	99	47	3,29	cyclictest	11735	-21	ssh	22:50:12	0
2323	99	46	2,9	cyclictest	13	1	rcu_preempt	00:35:14	0
2333	99	45	4,33	cyclictest	24929	-21	ssh	00:25:12	1
2333	99	45	4,33	cyclictest	24929	-21	ssh	00:25:12	1
2352	99	44	3,24	cyclictest	359	66	irq/58-eth0	22:30:12	3
2352	99	42	3,24	cyclictest	359	66	irq/58-eth0	00:10:13	3
2333	99	42	5,28	cyclictest	30231	-21	ssh	23:00:13	1
2323	99	42	14,19	cyclictest	12	-21	ksoftirqd/0	20:55:13	0
2323	99	42	1,32	cyclictest	25215	-21	ssh	23:50:14	0
2323	99	42	1,32	cyclictest	25215	-21	ssh	23:50:14	0
2352	99	41	4,26	cyclictest	359	66	irq/58-eth0	22:10:14	3
2343	99	40	1,33	cyclictest	30410	-21	ssh	22:25:12	2
2343	99	40	1,33	cyclictest	30410	-21	ssh	22:25:12	2
2323	99	40	4,26	cyclictest	20932	-21	ssh	21:10:14	0
2323	99	40	4,26	cyclictest	20932	-21	ssh	21:10:14	0
2323	99	40	1,6	cyclictest	13	1	rcu_preempt	00:30:15	0
2352	99	38	5,21	cyclictest	359	66	irq/58-eth0	21:55:12	3
2333	99	38	6,19	cyclictest	8335	-21	kworker/u8:0	21:25:13	1
2352	99	37	5,17	cyclictest	359	66	irq/58-eth0	22:15:14	3
2352	99	37	3,22	cyclictest	359	66	irq/58-eth0	00:20:13	3
2352	99	37	2,27	cyclictest	359	66	irq/58-eth0	23:50:14	3
2352	99	37	2,27	cyclictest	359	66	irq/58-eth0	23:50:14	3
2352	99	35	3,19	cyclictest	359	66	irq/58-eth0	22:35:15	3
2352	99	35	2,20	cyclictest	359	66	irq/58-eth0	22:50:14	3
2343	99	35	7,20	cyclictest	27	-21	ksoftirqd/2	21:50:12	2
2343	99	35	5,16	cyclictest	0	-21	swapper/2	20:50:13	2
2323	99	35	4,20	cyclictest	21225	-21	ssh	22:20:13	0
2323	99	35	1,9	cyclictest	13	1	rcu_preempt	22:40:12	0
2352	99	34	20,7	cyclictest	359	66	irq/58-eth0	00:25:13	3
2352	99	34	20,7	cyclictest	359	66	irq/58-eth0	00:25:13	3
2323	99	34	2,26	cyclictest	16383	-21	ssh	21:25:13	0
2352	99	33	1,20	cyclictest	359	66	irq/58-eth0	21:25:13	3
2333	99	33	2,23	cyclictest	6842	-21	ssh	23:40:14	1
2343	99	31	5,12	cyclictest	25643	-21	ssh	21:30:14	2
2343	99	31	3,23	cyclictest	16465	-21	ssh	22:35:15	2
2343	99	31	3,20	cyclictest	0	-21	swapper/2	22:50:12	2
2333	99	31	21,6	cyclictest	0	-21	swapper/1	00:35:15	1
2323	99	31	2,22	cyclictest	20834	-21	ssh	23:30:14	0
2352	99	30	6,17	cyclictest	0	-21	swapper/3	00:15:13	3
2333	99	30	15,8	cyclictest	0	-21	swapper/1	19:15:15	1
2333	99	30	15,8	cyclictest	0	-21	swapper/1	19:15:14	1
2323	99	30	7,15	cyclictest	12	-21	ksoftirqd/0	23:40:14	0
2323	99	30	2,21	cyclictest	29732	-21	ssh	00:10:14	0
2323	99	30	1,21	cyclictest	16460	-21	ssh	22:35:14	0
2343	99	29	3,18	cyclictest	273	46	irq/40-dwc2_hso	21:05:12	2
2343	99	29	3,10	cyclictest	27	-21	ksoftirqd/2	21:15:14	2
2343	99	29	3,10	cyclictest	27	-21	ksoftirqd/2	21:15:14	2
2352	99	28	13,6	cyclictest	359	66	irq/58-eth0	22:00:13	3
2343	99	28	6,15	cyclictest	13	1	rcu_preempt	19:45:16	2
2343	99	28	1,16	cyclictest	11860	-21	ssh	21:40:14	2
2343	99	28	11,12	cyclictest	26	1	rcuc/2	00:35:15	2
2343	99	27	9,8	cyclictest	27	-21	ksoftirqd/2	22:42:52	2
2343	99	27	5,17	cyclictest	27	-21	ksoftirqd/2	00:20:13	2
2343	99	27	4,11	cyclictest	2309	-21	cyclictest	23:25:11	2
2343	99	27	3,16	cyclictest	273	46	irq/40-dwc2_hso	20:45:14	2
2343	99	27	2,20	cyclictest	0	-21	swapper/2	22:00:15	2
2343	99	27	2,19	cyclictest	0	-21	swapper/2	23:00:15	2
2343	99	27	16,8	cyclictest	5595	-21	sh	23:55:24	2
2343	99	27	1,20	cyclictest	2728	-21	ssh	22:10:14	2
2343	99	27	1,15	cyclictest	7257	-21	rm	22:30:14	2
2333	99	27	6,10	cyclictest	16344	-21	ssh	23:10:13	1
2333	99	27	6,10	cyclictest	16344	-21	ssh	23:10:13	1
2333	99	27	3,19	cyclictest	30224	-21	ssh	21:15:15	1
2333	99	27	3,19	cyclictest	30224	-21	ssh	21:15:15	1
2333	99	27	2,19	cyclictest	20505	-21	diskmemload	00:05:14	1
2333	99	27	11,4	cyclictest	21	-21	ksoftirqd/1	22:24:52	1
2323	99	27	2,18	cyclictest	7256	-21	sh	22:30:14	0
2323	99	27	1,20	cyclictest	2560	-21	ssh	22:45:14	0
2323	99	27	0,18	cyclictest	12	-21	ksoftirqd/0	21:00:14	0
2352	99	26	3,15	cyclictest	359	66	irq/58-eth0	21:45:12	3
2352	99	26	12,10	cyclictest	359	66	irq/58-eth0	22:20:13	3
2343	99	26	8,12	cyclictest	0	-21	swapper/2	19:35:15	2
2343	99	26	4,8	cyclictest	0	-21	swapper/2	22:05:13	2
2343	99	26	2,18	cyclictest	8335	-21	kworker/u8:0	20:40:05	2
2343	99	26	2,10	cyclictest	0	-21	swapper/2	20:20:15	2
2343	99	26	17,4	cyclictest	20462	-21	sh	00:05:14	2
2343	99	26	10,4	cyclictest	27	-21	ksoftirqd/2	21:56:47	2
2333	99	26	17,5	cyclictest	0	-21	swapper/1	20:05:14	1
2333	99	26	15,7	cyclictest	0	-21	swapper/1	20:45:14	1
2333	99	26	14,3	cyclictest	21	-21	ksoftirqd/1	22:09:07	1
2333	99	26	10,11	cyclictest	21	-21	ksoftirqd/1	21:30:15	1
2343	99	25	7,7	cyclictest	26	1	rcuc/2	23:45:15	2
2343	99	25	3,17	cyclictest	273	46	irq/40-dwc2_hso	21:35:12	2
2343	99	25	1,8	cyclictest	32569	-21	find	20:15:13	2
2343	99	25	1,21	cyclictest	11497	-21	ls	00:00:17	2
2343	99	25	1,17	cyclictest	273	46	irq/40-dwc2_hso	20:35:14	2
2333	99	25	8,5	cyclictest	13	1	rcu_preempt	23:05:15	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17