OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Sun Jun 28, 2026 12:45:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
20853	99	71	1,17	cyclictest	12	-21	ksoftirqd/0	11:30:14	0
20853	99	60	3,47	cyclictest	9552	-21	ssh	10:05:13	0
20869	99	55	3,40	cyclictest	28123	-21	ssh	11:45:14	2
20869	99	54	2,37	cyclictest	20876	-21	ssh	11:05:14	2
20861	99	50	1,39	cyclictest	4335	-21	ssh	10:20:13	1
20861	99	49	2,34	cyclictest	23905	-21	ssh	09:55:14	1
20861	99	48	5,39	cyclictest	1000	-21	ssh	11:30:14	1
20869	99	44	1,22	cyclictest	11836	-21	ssh	11:00:12	2
20877	99	42	5,26	cyclictest	359	66	irq/58-eth0	12:15:13	3
20877	99	42	4,25	cyclictest	359	66	irq/58-eth0	09:15:12	3
20861	99	42	7,3	cyclictest	13	1	rcu_preempt	09:45:13	1
20877	99	41	3,33	cyclictest	359	66	irq/58-eth0	09:20:11	3
20869	99	41	5,21	cyclictest	31902	-21	rm	12:05:12	2
20877	99	40	4,22	cyclictest	359	66	irq/58-eth0	10:05:13	3
20861	99	40	3,6	cyclictest	13	1	rcu_preempt	07:45:12	1
20861	99	40	1,32	cyclictest	3072	-21	ssh	12:25:13	1
20877	99	39	7,20	cyclictest	0	-21	swapper/3	10:00:14	3
20853	99	38	15,14	cyclictest	630	-21	Async	09:36:31	0
20853	99	38	1,32	cyclictest	26159	-21	ssh	10:50:13	0
20877	99	37	14,17	cyclictest	359	66	irq/58-eth0	12:00:11	3
20861	99	37	1,25	cyclictest	0	-21	swapper/1	07:55:13	1
20877	99	36	27,5	cyclictest	359	66	irq/58-eth0	09:45:14	3
20877	99	36	22,9	cyclictest	0	-21	swapper/3	10:50:12	3
20853	99	36	3,9	cyclictest	31480	-21	ssh	10:35:13	0
20853	99	36	2,30	cyclictest	551	-21	ssh	10:00:13	0
20877	99	35	4,22	cyclictest	359	66	irq/58-eth0	10:35:14	3
20861	99	35	3,21	cyclictest	13790	-21	ssh	11:55:12	1
20853	99	35	26,4	cyclictest	13	1	rcu_preempt	12:30:12	0
20853	99	35	1,31	cyclictest	27599	-21	ssh	10:15:12	0
20853	99	35	1,26	cyclictest	12	-21	ksoftirqd/0	08:00:12	0
20869	99	34	3,15	cyclictest	877	-21	lldpd	12:20:10	2
20861	99	34	2,24	cyclictest	20040	-21	ssh	09:35:13	1
20853	99	34	3,28	cyclictest	22952	-21	ssh	12:00:14	0
20853	99	34	2,29	cyclictest	17145	-21	ssh	10:45:12	0
20877	99	33	2,21	cyclictest	359	66	irq/58-eth0	11:20:12	3
20877	99	33	11,14	cyclictest	359	66	irq/58-eth0	12:05:12	3
20869	99	33	5,21	cyclictest	273	46	irq/40-dwc2_hso	07:50:12	2
20869	99	33	2,24	cyclictest	20036	-21	ssh	09:35:13	2
20869	99	33	2,21	cyclictest	17450	-21	ssh	12:15:13	2
20861	99	33	6,14	cyclictest	14738	-21	ssh	09:50:12	1
20861	99	33	4,18	cyclictest	26128	-21	ssh	10:50:11	1
20853	99	33	6,18	cyclictest	11002	-21	ssh	09:30:10	0
20853	99	33	5,23	cyclictest	18550	-21	ssh	10:10:12	0
20853	99	33	21,6	cyclictest	13370	-21	sh	10:25:14	0
20877	99	32	15,11	cyclictest	359	66	irq/58-eth0	10:15:12	3
20869	99	32	1,27	cyclictest	15335	-21	ssh	11:20:12	2
20877	99	31	4,15	cyclictest	0	-21	swapper/3	10:45:11	3
20877	99	31	17,7	cyclictest	32	1	rcuc/3	12:30:12	3
20869	99	31	4,15	cyclictest	273	46	irq/40-dwc2_hso	07:15:14	2
20861	99	31	1,4	cyclictest	13	1	rcu_preempt	08:30:13	1
20861	99	31	1,23	cyclictest	13372	-21	ssh	10:25:13	1
20853	99	31	2,23	cyclictest	25300	-21	ssh	09:20:11	0
20853	99	31	1,24	cyclictest	29863	-21	ssh	11:10:14	0
20877	99	30	2,15	cyclictest	359	66	irq/58-eth0	10:30:13	3
20869	99	30	6,15	cyclictest	273	46	irq/40-dwc2_hso	09:00:14	2
20869	99	30	5,18	cyclictest	273	46	irq/40-dwc2_hso	07:35:12	2
20869	99	30	3,19	cyclictest	273	46	irq/40-dwc2_hso	07:55:14	2
20869	99	30	18,10	cyclictest	0	-21	swapper/2	09:10:14	2
20861	99	30	1,5	cyclictest	0	-21	swapper/1	10:05:11	1
20853	99	30	3,18	cyclictest	26449	-21	ssh	12:20:10	0
20877	99	29	3,19	cyclictest	0	-21	swapper/3	12:21:02	3
20869	99	29	4,18	cyclictest	273	46	irq/40-dwc2_hso	10:30:14	2
20869	99	29	19,6	cyclictest	27	-21	ksoftirqd/2	10:35:13	2
20861	99	29	9,12	cyclictest	13	1	rcu_preempt	12:30:11	1
20853	99	29	1,24	cyclictest	8093	-21	ssh	10:40:13	0
20877	99	28	2,15	cyclictest	359	66	irq/58-eth0	11:35:12	3
20869	99	28	6,14	cyclictest	273	46	irq/40-dwc2_hso	07:25:13	2
20869	99	28	3,15	cyclictest	273	46	irq/40-dwc2_hso	11:35:12	2
20869	99	28	3,14	cyclictest	273	46	irq/40-dwc2_hso	08:20:13	2
20869	99	28	2,19	cyclictest	0	-21	swapper/2	08:45:13	2
20869	99	28	2,11	cyclictest	17892	-21	ssh	12:31:39	2
20853	99	28	2,21	cyclictest	1953	-21	ssh	09:25:14	0
20853	99	28	13,9	cyclictest	12	-21	ksoftirqd/0	08:35:18	0
20877	99	27	2,15	cyclictest	359	66	irq/58-eth0	10:40:13	3
20869	99	27	3,14	cyclictest	273	46	irq/40-dwc2_hso	08:25:12	2
20869	99	27	17,7	cyclictest	4329	-21	ssh	10:20:12	2
20869	99	27	1,19	cyclictest	29098	-21	ssh	09:40:14	2
20861	99	27	1,19	cyclictest	28139	-21	ssh	11:45:15	1
20853	99	27	3,19	cyclictest	22421	-21	ssh	10:30:13	0
20877	99	26	18,5	cyclictest	33	-21	ksoftirqd/3	09:35:12	3
20869	99	26	8,8	cyclictest	27	-21	ksoftirqd/2	10:45:14	2
20869	99	26	6,12	cyclictest	273	46	irq/40-dwc2_hso	12:10:13	2
20869	99	26	6,12	cyclictest	273	46	irq/40-dwc2_hso	12:10:13	2
20869	99	26	5,12	cyclictest	273	46	irq/40-dwc2_hso	11:25:13	2
20869	99	26	3,16	cyclictest	273	46	irq/40-dwc2_hso	08:15:12	2
20869	99	26	3,15	cyclictest	273	46	irq/40-dwc2_hso	07:40:13	2
20869	99	26	2,14	cyclictest	273	46	irq/40-dwc2_hso	08:10:12	2
20869	99	26	1,15	cyclictest	27598	-21	ssh	10:15:12	2
20869	99	26	1,10	cyclictest	1169	-21	cut	10:00:19	2
20861	99	26	7,11	cyclictest	0	-21	swapper/1	08:00:12	1
20861	99	26	2,2	cyclictest	13	1	rcu_preempt	09:10:12	1
20853	99	26	2,18	cyclictest	26413	-21	ssh	12:36:05	0
20853	99	26	18,5	cyclictest	0	-21	swapper/0	09:15:12	0
20877	99	25	3,15	cyclictest	359	66	irq/58-eth0	08:25:13	3
20877	99	25	3,11	cyclictest	0	-21	swapper/3	12:25:14	3
20877	99	25	15,5	cyclictest	33	-21	ksoftirqd/3	09:05:14	3
20877	99	25	1,19	cyclictest	0	-21	swapper/3	12:10:14	3
20877	99	25	1,19	cyclictest	0	-21	swapper/3	12:10:14	3
20869	99	25	5,12	cyclictest	273	46	irq/40-dwc2_hso	07:10:14	2
20869	99	25	4,13	cyclictest	273	46	irq/40-dwc2_hso	07:45:13	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17