OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Sat Jul 18, 2026 12:45:19)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
27909	99	74	2,45	cyclictest	14353	-21	ssh	11:15:15	2
27923	99	69	35,28	cyclictest	359	66	irq/58-eth0	10:30:12	3
27899	99	68	2,49	cyclictest	30997	-21	ssh	09:55:15	1
27887	99	66	4,49	cyclictest	11622	-21	ssh	12:25:14	0
27887	99	61	1,53	cyclictest	31234	-21	ssh	12:00:17	0
27887	99	58	4,43	cyclictest	5225	-21	ssh	11:10:13	0
27923	99	57	32,21	cyclictest	359	66	irq/58-eth0	11:25:13	3
27923	99	57	32,21	cyclictest	359	66	irq/58-eth0	11:25:12	3
27887	99	55	2,9	cyclictest	13	1	rcu_preempt	08:40:12	0
27887	99	52	8,27	cyclictest	14362	-21	ssh	11:15:15	0
27887	99	52	7,7	cyclictest	13	1	rcu_preempt	08:55:14	0
27887	99	52	3,4	cyclictest	13	1	rcu_preempt	07:10:15	0
27909	99	51	1,31	cyclictest	19512	-21	ssh	11:00:15	2
27923	99	49	1,33	cyclictest	359	66	irq/58-eth0	09:15:12	3
27887	99	49	2,36	cyclictest	23410	-21	ssh	11:20:13	0
27887	99	49	1,39	cyclictest	3723	-21	ssh	09:40:14	0
27899	99	48	1,35	cyclictest	20690	-21	ssh	10:25:14	1
27887	99	48	3,33	cyclictest	13611	-21	diskmemload	10:00:13	0
27923	99	47	5,14	cyclictest	359	66	irq/58-eth0	10:50:14	3
27887	99	45	0,32	cyclictest	17908	-21	ssh	09:30:13	0
27923	99	44	30,7	cyclictest	359	66	irq/58-eth0	11:40:13	3
27899	99	44	3,30	cyclictest	12830	-21	ssh	09:45:14	1
27887	99	44	2,27	cyclictest	14037	-21	ssh	09:10:14	0
27909	99	43	27,6	cyclictest	27	-21	ksoftirqd/2	07:50:13	2
27887	99	43	1,35	cyclictest	29816	-21	ssh	10:30:11	0
27923	99	42	4,27	cyclictest	359	66	irq/58-eth0	10:40:14	3
27923	99	42	2,23	cyclictest	359	66	irq/58-eth0	09:30:14	3
27923	99	41	2,23	cyclictest	359	66	irq/58-eth0	11:05:14	3
27899	99	41	28,9	cyclictest	29355	-21	apt-get	07:45:14	1
27923	99	40	18,13	cyclictest	359	66	irq/58-eth0	10:00:13	3
27899	99	40	27,9	cyclictest	31865	-21	apt-get	08:55:13	1
27887	99	40	3,28	cyclictest	25760	-21	ssh	12:15:14	0
27887	99	40	3,28	cyclictest	25760	-21	ssh	12:15:13	0
27887	99	40	1,33	cyclictest	10436	-21	ssh	10:55:14	0
27887	99	40	1,33	cyclictest	10436	-21	ssh	10:55:13	0
27899	99	37	31,3	cyclictest	7683	-21	apt-get	08:30:15	1
27923	99	36	2,22	cyclictest	359	66	irq/58-eth0	08:55:15	3
27923	99	36	1,23	cyclictest	359	66	irq/58-eth0	12:00:16	3
27909	99	36	4,22	cyclictest	25775	-21	ssh	12:15:15	2
27909	99	36	4,22	cyclictest	25775	-21	ssh	12:15:14	2
27909	99	36	1,29	cyclictest	18235	-21	ssh	11:35:12	2
27899	99	36	25,7	cyclictest	17401	-21	apt-get	08:40:13	1
27887	99	36	14,16	cyclictest	0	-21	swapper/0	11:45:14	0
27887	99	36	14,16	cyclictest	0	-21	swapper/0	11:45:13	0
27923	99	35	19,10	cyclictest	359	66	irq/58-eth0	11:20:15	3
27923	99	35	1,21	cyclictest	359	66	irq/58-eth0	09:20:13	3
27899	99	35	24,6	cyclictest	20568	-21	apt-get	12:30:13	1
27923	99	34	4,16	cyclictest	0	-21	swapper/3	11:35:13	3
27923	99	34	3,18	cyclictest	359	66	irq/58-eth0	11:15:15	3
27899	99	34	4,22	cyclictest	21882	-21	ssh	09:50:12	1
27899	99	33	1,29	cyclictest	11457	-21	ssh	10:20:12	1
27909	99	32	1,24	cyclictest	21898	-21	ssh	09:50:13	2
27899	99	32	25,4	cyclictest	323	-21	apt-get	07:15:11	1
27887	99	32	2,25	cyclictest	23100	-21	ssh	09:15:14	0
27887	99	32	2,20	cyclictest	27332	-21	ssh	11:40:13	0
27909	99	31	2,21	cyclictest	6523	-21	sh	10:35:16	2
27899	99	31	4,4	cyclictest	13	1	rcu_preempt	07:50:12	1
27899	99	31	24,4	cyclictest	9154	-21	apt-get	11:30:12	1
27887	99	31	1,23	cyclictest	16684	-21	ssh	10:05:11	0
27923	99	30	2,14	cyclictest	359	66	irq/58-eth0	11:45:14	3
27923	99	30	2,14	cyclictest	359	66	irq/58-eth0	11:45:13	3
27909	99	30	3,19	cyclictest	273	46	irq/40-dwc2_hso	08:40:12	2
27899	99	30	2,20	cyclictest	21	-21	ksoftirqd/1	08:50:16	1
27899	99	30	20,6	cyclictest	31207	-21	apt-get	12:00:17	1
27887	99	30	2,19	cyclictest	1405	-21	ssh	10:50:13	0
27923	99	29	2,15	cyclictest	359	66	irq/58-eth0	11:30:13	3
27909	99	29	9,11	cyclictest	27	-21	ksoftirqd/2	10:03:48	2
27899	99	29	3,18	cyclictest	6506	-21	ssh	10:35:14	1
27899	99	29	21,6	cyclictest	14947	-21	apt-get	07:30:14	1
27899	99	29	18,8	cyclictest	0	-21	swapper/1	09:20:14	1
27887	99	29	8,16	cyclictest	12	-21	ksoftirqd/0	10:45:14	0
27887	99	29	2,21	cyclictest	20597	-21	ssh	12:30:15	0
27887	99	29	2,19	cyclictest	29717	-21	ssh	12:35:14	0
27887	99	29	1,20	cyclictest	16787	-21	ssh	12:10:16	0
27923	99	28	3,19	cyclictest	359	66	irq/58-eth0	12:25:13	3
27923	99	28	15,8	cyclictest	0	-21	swapper/3	10:10:15	3
27923	99	28	1,17	cyclictest	359	66	irq/58-eth0	12:15:14	3
27923	99	28	1,17	cyclictest	359	66	irq/58-eth0	12:15:13	3
27909	99	28	3,20	cyclictest	273	46	irq/40-dwc2_hso	07:55:12	2
27909	99	28	2,21	cyclictest	27352	-21	ssh	11:40:15	2
27909	99	28	2,11	cyclictest	0	-21	swapper/2	09:00:15	2
27909	99	28	1,22	cyclictest	9352	-21	cut	11:30:16	2
27909	99	28	0,19	cyclictest	12681	-21	grep	08:35:14	2
27899	99	28	8,15	cyclictest	0	-21	swapper/1	10:15:15	1
27899	99	28	5,6	cyclictest	21121	-21	rm	11:54:16	1
27899	99	28	2,24	cyclictest	29827	-21	ssh	10:30:13	1
27899	99	28	1,24	cyclictest	17920	-21	ssh	09:30:13	1
27887	99	28	1,19	cyclictest	19513	-21	ssh	11:00:14	0
27909	99	27	4,16	cyclictest	273	46	irq/40-dwc2_hso	09:10:14	2
27909	99	27	3,17	cyclictest	0	-21	swapper/2	11:50:05	2
27909	99	27	2,9	cyclictest	27	-21	ksoftirqd/2	12:05:14	2
27909	99	27	2,19	cyclictest	0	-21	swapper/2	07:30:14	2
27909	99	27	10,9	cyclictest	0	-21	swapper/2	10:51:10	2
27909	99	27	10,13	cyclictest	26	1	rcuc/2	11:55:13	2
27909	99	27	10,13	cyclictest	26	1	rcuc/2	11:55:12	2
27899	99	27	5,7	cyclictest	9873	-21	ssh	11:10:33	1
27899	99	27	4,18	cyclictest	7701	-21	sh	12:05:13	1
27899	99	27	19,3	cyclictest	7616	-21	apt-get	10:00:14	1
27909	99	26	9,6	cyclictest	27	-21	ksoftirqd/2	09:24:04	2
27909	99	26	8,3	cyclictest	13	1	rcu_preempt	08:55:29	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17