OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Sun Sep 20, 2026 00:45:13)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
9767	99	60	4,44	cyclictest	9648	-21	ssh	23:40:12	0
9795	99	59	24,24	cyclictest	359	66	irq/58-eth0	21:45:13	3
9776	99	59	5,7	cyclictest	13	1	rcu_preempt	19:35:13	1
9776	99	57	6,37	cyclictest	26168	-21	ssh	22:20:13	1
9787	99	53	5,34	cyclictest	22609	-21	ssh	00:05:14	2
9787	99	53	2,19	cyclictest	19147	-21	ssh	00:37:47	2
9795	99	50	12,25	cyclictest	359	66	irq/58-eth0	21:50:15	3
9776	99	48	3,31	cyclictest	29043	-21	ssh	23:15:13	1
9795	99	47	30,10	cyclictest	359	66	irq/58-eth0	22:10:16	3
9787	99	47	3,22	cyclictest	13149	-21	ssh	21:55:13	2
9776	99	47	3,4	cyclictest	13	1	rcu_preempt	00:35:15	1
9776	99	46	1,37	cyclictest	9053	-21	ssh	21:35:14	1
9767	99	45	29,8	cyclictest	0	-21	swapper/0	19:55:15	0
9776	99	44	4,27	cyclictest	32365	-21	ssh	21:30:14	1
9767	99	44	4,30	cyclictest	17505	-21	ssh	00:20:14	0
9767	99	44	20,14	cyclictest	12	-21	ksoftirqd/0	19:15:14	0
9787	99	43	1,26	cyclictest	17052	-21	ssh	22:15:14	2
9787	99	43	1,26	cyclictest	17052	-21	ssh	22:15:14	2
9767	99	43	6,31	cyclictest	23282	-21	ssh	21:25:14	0
9767	99	43	2,30	cyclictest	31322	-21	ssh	22:05:14	0
9795	99	41	4,22	cyclictest	359	66	irq/58-eth0	19:15:13	3
9776	99	41	1,5	cyclictest	13	1	rcu_preempt	21:55:13	1
9776	99	41	1,37	cyclictest	18774	-21	ssh	23:45:15	1
9776	99	41	11,19	cyclictest	21	-21	ksoftirqd/1	19:30:14	1
9795	99	39	1,23	cyclictest	359	66	irq/58-eth0	22:25:12	3
9787	99	39	2,18	cyclictest	30215	-21	sh	00:25:25	2
9795	99	38	2,22	cyclictest	359	66	irq/58-eth0	21:20:15	3
9795	99	37	5,20	cyclictest	359	66	irq/58-eth0	22:55:14	3
9776	99	37	2,7	cyclictest	13	1	rcu_preempt	19:40:14	1
9776	99	36	1,26	cyclictest	13521	-21	ssh	00:00:13	1
9795	99	35	3,20	cyclictest	359	66	irq/58-eth0	00:30:13	3
9795	99	35	1,23	cyclictest	359	66	irq/58-eth0	23:50:13	3
9787	99	35	21,8	cyclictest	14171	-21	ssh	21:20:16	2
9776	99	35	4,18	cyclictest	16040	-21	ssh	22:50:15	1
9776	99	35	1,30	cyclictest	10979	-21	ssh	23:05:14	1
9787	99	34	18,11	cyclictest	32379	-21	sh	21:30:16	2
9776	99	34	4,19	cyclictest	10930	-21	kworker/u8:0	23:10:15	1
9776	99	34	0,21	cyclictest	21	-21	ksoftirqd/1	22:25:14	1
9787	99	33	26,3	cyclictest	245	46	irq/40-fe980000	19:20:13	2
9787	99	32	5,16	cyclictest	273	46	irq/40-dwc2_hso	21:35:15	2
9787	99	32	2,14	cyclictest	20244	-21	kworker/u8:0	00:22:44	2
9767	99	32	5,16	cyclictest	844	-21	munin-node	19:50:13	0
9767	99	32	4,19	cyclictest	8017	-21	ssh	22:10:17	0
9767	99	32	2,22	cyclictest	26614	-21	ssh	00:25:15	0
9795	99	31	15,8	cyclictest	0	-21	swapper/3	23:10:13	3
9787	99	31	17,10	cyclictest	21120	-21	sh	22:35:14	2
9787	99	31	1,23	cyclictest	20077	-21	ssh	23:10:15	2
9776	99	31	3,19	cyclictest	27745	-21	ssh	23:50:13	1
9767	99	31	2,5	cyclictest	0	-21	swapper/0	20:05:15	0
9767	99	31	2,5	cyclictest	0	-21	swapper/0	20:05:15	0
9767	99	31	1,20	cyclictest	392	-21	ssh	23:35:11	0
9767	99	31	1,20	cyclictest	0	-21	swapper/0	21:50:15	0
9787	99	30	5,16	cyclictest	273	46	irq/40-dwc2_hso	20:30:13	2
9767	99	30	7,13	cyclictest	630	-21	Async	09:36:31	0
9795	99	29	21,3	cyclictest	33	-21	ksoftirqd/3	22:45:14	3
9795	99	29	1,20	cyclictest	359	66	irq/58-eth0	21:40:15	3
9787	99	29	9,10	cyclictest	27	-21	ksoftirqd/2	19:50:13	2
9787	99	29	2,21	cyclictest	0	-21	swapper/2	00:10:15	2
9787	99	29	2,21	cyclictest	0	-21	swapper/2	00:10:15	2
9787	99	29	1,19	cyclictest	273	46	irq/40-dwc2_hso	23:55:13	2
9776	99	29	12,11	cyclictest	0	-21	swapper/1	20:50:13	1
9776	99	29	12,11	cyclictest	0	-21	swapper/1	20:50:12	1
9767	99	29	2,21	cyclictest	1896	-21	ssh	23:00:14	0
9767	99	29	2,18	cyclictest	31694	-21	ssh	00:10:14	0
9767	99	29	2,18	cyclictest	31694	-21	ssh	00:10:13	0
9795	99	28	16,4	cyclictest	0	-21	swapper/3	21:35:01	3
9776	99	28	14,6	cyclictest	21	-21	ksoftirqd/1	19:10:12	1
9767	99	28	17,6	cyclictest	0	-21	swapper/0	00:05:14	0
9767	99	28	13,3	cyclictest	0	-21	swapper/0	19:45:16	0
9767	99	28	1,21	cyclictest	0	-21	swapper/0	22:00:11	0
9795	99	27	3,14	cyclictest	359	66	irq/58-eth0	19:50:12	3
9787	99	27	3,16	cyclictest	273	46	irq/40-dwc2_hso	23:20:14	2
9787	99	27	3,15	cyclictest	22176	-21	ssh	22:00:12	2
9787	99	27	2,20	cyclictest	0	-21	swapper/2	23:15:14	2
9787	99	27	2,17	cyclictest	273	46	irq/40-dwc2_hso	22:20:14	2
9787	99	27	2,16	cyclictest	273	46	irq/40-dwc2_hso	21:10:13	2
9776	99	27	6,17	cyclictest	17495	-21	ssh	00:20:13	1
9776	99	27	2,19	cyclictest	15117	-21	ssh	00:17:42	1
9776	99	27	1,21	cyclictest	4479	-21	ssh	23:55:15	1
9776	99	27	1,18	cyclictest	2611	-21	ssh	22:05:28	1
9776	99	27	1,18	cyclictest	21123	-21	ssh	22:35:14	1
9767	99	27	18,4	cyclictest	0	-21	swapper/0	21:00:14	0
9767	99	27	16,5	cyclictest	0	-21	swapper/0	20:10:12	0
9767	99	27	1,19	cyclictest	8366	-21	ssh	00:15:15	0
9795	99	26	1,19	cyclictest	0	-21	swapper/3	23:30:14	3
9787	99	26	4,16	cyclictest	273	46	irq/40-dwc2_hso	19:30:13	2
9787	99	26	3,14	cyclictest	273	46	irq/40-dwc2_hso	00:15:14	2
9787	99	26	1,20	cyclictest	24072	-21	ls	19:55:25	2
9767	99	26	9,6	cyclictest	0	-21	swapper/0	23:25:13	0
9767	99	26	9,6	cyclictest	0	-21	swapper/0	23:25:12	0
9767	99	26	1,21	cyclictest	3266	-21	ssh	00:30:14	0
9795	99	25	1,16	cyclictest	0	-21	swapper/3	22:05:14	3
9787	99	25	5,13	cyclictest	273	46	irq/40-dwc2_hso	23:00:14	2
9787	99	25	2,9	cyclictest	0	-21	swapper/2	20:45:14	2
9776	99	25	3,13	cyclictest	0	-21	swapper/1	23:35:12	1
9767	99	25	20,3	cyclictest	12	-21	ksoftirqd/0	22:20:18	0
9767	99	25	14,8	cyclictest	27733	-21	apt-get	23:50:13	0
9767	99	25	12,3	cyclictest	0	-21	swapper/0	22:41:59	0
9767	99	25	1,17	cyclictest	27340	-21	ssh	21:45:13	0
9795	99	24	2,10	cyclictest	0	-21	swapper/3	00:22:44	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17