OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Sun Jun 28, 2026 00:45:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
12163	99	66	5,49	cyclictest	31410	-21	ssh	00:10:15	0
12163	99	66	24,27	cyclictest	15037	-21	ssh	23:25:13	0
12163	99	58	3,11	cyclictest	13	1	rcu_preempt	21:40:13	0
12163	99	56	2,42	cyclictest	23727	-21	ssh	22:00:13	0
12252	99	55	34,12	cyclictest	359	66	irq/58-eth0	00:35:12	3
12181	99	52	4,38	cyclictest	30634	-21	ssh	21:10:12	1
12181	99	51	2,40	cyclictest	25728	-21	ssh	22:55:15	1
12181	99	47	3,39	cyclictest	10920	-21	ssh	21:35:13	1
12181	99	46	17,20	cyclictest	7977	-21	ssh	00:15:14	1
12163	99	46	1,36	cyclictest	16305	-21	ssh	21:20:14	0
12252	99	45	4,28	cyclictest	359	66	irq/58-eth0	21:25:15	3
12181	99	45	6,29	cyclictest	300	-21	ssh	22:05:14	1
12181	99	45	6,29	cyclictest	300	-21	ssh	22:05:14	1
12220	99	44	1,28	cyclictest	2370	-21	ssh	23:00:14	2
12252	99	43	1,28	cyclictest	359	66	irq/58-eth0	21:15:15	3
12252	99	41	4,22	cyclictest	359	66	irq/58-eth0	21:10:12	3
12252	99	40	6,18	cyclictest	359	66	irq/58-eth0	23:55:13	3
12181	99	40	24,12	cyclictest	23186	-21	apt-get	19:55:13	1
12220	99	39	3,28	cyclictest	273	46	irq/40-dwc2_hso	21:55:13	2
12220	99	39	3,28	cyclictest	273	46	irq/40-dwc2_hso	21:55:13	2
12181	99	39	23,11	cyclictest	31399	-21	apt-get	00:10:14	1
12163	99	39	6,23	cyclictest	30252	-21	diskmemload	00:20:13	0
12181	99	38	2,25	cyclictest	0	-21	swapper/1	23:00:13	1
12181	99	38	1,29	cyclictest	14549	-21	ssh	21:55:12	1
12181	99	38	1,29	cyclictest	14549	-21	ssh	21:55:12	1
12181	99	37	9,11	cyclictest	21298	-21	ssh	23:27:09	1
12181	99	37	28,4	cyclictest	23708	-21	apt-get	22:00:12	1
12181	99	37	25,6	cyclictest	19925	-21	apt-get	21:40:13	1
12181	99	37	24,7	cyclictest	18379	-21	apt-get	19:50:11	1
12181	99	37	11,11	cyclictest	11505	-21	ssh	22:28:32	1
12163	99	37	2,25	cyclictest	9396	-21	ssh	22:10:13	0
12252	99	36	4,18	cyclictest	359	66	irq/58-eth0	22:30:11	3
12181	99	36	8,11	cyclictest	7882	-21	diskstats	22:45:15	1
12181	99	36	8,11	cyclictest	7882	-21	diskstats	22:45:15	1
12181	99	36	12,10	cyclictest	7299	-21	ssh	22:44:56	1
12163	99	36	3,21	cyclictest	22165	-21	ssh	22:35:13	0
12252	99	35	4,19	cyclictest	0	-21	swapper/3	23:00:13	3
12181	99	35	9,11	cyclictest	30210	-21	cut	23:50:21	1
12181	99	35	27,3	cyclictest	31604	-21	apt-get	19:30:11	1
12181	99	35	21,10	cyclictest	16293	-21	apt-get	21:20:14	1
12181	99	35	1,30	cyclictest	1907	-21	ssh	21:30:12	1
12181	99	35	11,10	cyclictest	21809	-21	rm	00:20:34	1
12181	99	35	11,10	cyclictest	14540	-21	ssh	22:10:50	1
12181	99	35	10,10	cyclictest	21434	-21	ssh	00:04:27	1
12181	99	35	10,10	cyclictest	21434	-21	ssh	00:04:27	1
12163	99	35	16,7	cyclictest	13	1	rcu_preempt	20:55:12	0
12220	99	34	0,18	cyclictest	24418	-21	ssh	23:46:35	2
12181	99	34	9,10	cyclictest	8921	-21	ssh	00:32:27	1
12181	99	34	26,3	cyclictest	16026	-21	apt-get	20:55:12	1
12181	99	34	23,7	cyclictest	25664	-21	apt-get	21:05:13	1
12181	99	34	13,7	cyclictest	19184	-21	ssh	22:31:56	1
12181	99	34	10,11	cyclictest	8362	-21	ssh	23:38:51	1
12181	99	34	10,11	cyclictest	8362	-21	ssh	23:38:51	1
12181	99	33	12,10	cyclictest	16951	-21	ssh	23:06:25	1
12181	99	33	11,10	cyclictest	26277	-21	ssh	23:11:45	1
12181	99	33	11,10	cyclictest	26277	-21	ssh	23:11:45	1
12252	99	32	14,15	cyclictest	0	-21	swapper/3	23:50:13	3
12220	99	32	6,12	cyclictest	15053	-21	diskmemload	23:25:14	2
12181	99	32	9,9	cyclictest	23515	-21	grep	20:25:28	1
12181	99	32	9,7	cyclictest	30252	-21	diskmemload	23:32:05	1
12181	99	32	8,11	cyclictest	30344	-21	ssh	21:25:40	1
12181	99	32	23,3	cyclictest	14843	-21	apt-get	20:20:14	1
12181	99	32	20,8	cyclictest	0	-21	swapper/1	23:20:12	1
12181	99	32	11,7	cyclictest	30252	-21	diskmemload	21:18:52	1
12181	99	32	10,8	cyclictest	30252	-21	diskmemload	00:06:55	1
12181	99	32	10,8	cyclictest	29435	-21	ssh	22:38:25	1
12181	99	32	10,8	cyclictest	1238	-21	ssh	00:29:02	1
12181	99	32	10,8	cyclictest	1238	-21	ssh	00:29:02	1
12181	99	32	10,7	cyclictest	30252	-21	diskmemload	22:53:17	1
12252	99	31	5,18	cyclictest	359	66	irq/58-eth0	00:00:13	3
12252	99	31	5,18	cyclictest	359	66	irq/58-eth0	00:00:13	3
12252	99	31	4,17	cyclictest	359	66	irq/58-eth0	23:40:13	3
12220	99	31	3,18	cyclictest	273	46	irq/40-dwc2_hso	22:00:12	2
12181	99	31	9,7	cyclictest	14616	-21	ssh	23:40:35	1
12181	99	31	7,8	cyclictest	30252	-21	diskmemload	21:53:44	1
12181	99	31	24,4	cyclictest	27568	-21	apt-get	22:20:14	1
12181	99	31	22,4	cyclictest	29237	-21	apt-get	20:35:12	1
12181	99	31	17,11	cyclictest	0	-21	swapper/1	23:15:11	1
12181	99	31	11,9	cyclictest	30252	-21	diskmemload	00:36:23	1
12181	99	31	10,8	cyclictest	18573	-21	ssh	23:45:05	1
12181	99	31	10,10	cyclictest	12289	-21	sh	23:59:20	1
12163	99	31	1,24	cyclictest	11317	-21	ssh	23:05:12	0
12220	99	30	3,11	cyclictest	27	-21	ksoftirqd/2	23:53:25	2
12220	99	30	1,23	cyclictest	30252	-21	diskmemload	23:05:12	2
12220	99	30	1,18	cyclictest	16320	-21	ssh	21:20:15	2
12181	99	30	23,3	cyclictest	1642	-21	apt-get	20:40:13	1
12163	99	30	3,19	cyclictest	25937	-21	ssh	00:25:15	0
12163	99	30	3,19	cyclictest	25937	-21	ssh	00:25:15	0
12252	99	29	2,11	cyclictest	359	66	irq/58-eth0	22:35:13	3
12252	99	29	14,12	cyclictest	0	-21	swapper/3	22:10:13	3
12220	99	29	7,10	cyclictest	27	-21	ksoftirqd/2	22:15:11	2
12220	99	29	3,19	cyclictest	844	-21	munin-node	20:55:14	2
12220	99	29	3,19	cyclictest	273	46	irq/40-dwc2_hso	20:40:13	2
12220	99	29	3,16	cyclictest	273	46	irq/40-dwc2_hso	19:50:11	2
12220	99	29	2,20	cyclictest	0	-21	swapper/2	19:20:14	2
12220	99	29	1,21	cyclictest	13100	-21	ssh	22:30:10	2
12181	99	29	7,8	cyclictest	30252	-21	diskmemload	22:15:16	1
12181	99	29	6,10	cyclictest	0	-21	swapper/1	19:45:24	1
12181	99	29	22,2	cyclictest	3992	-21	apt-get	19:35:13	1
12252	99	28	3,18	cyclictest	0	-21	swapper/3	23:46:35	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17