OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Wed Apr 15, 2026 00:45:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
7184	99	78	5,49	cyclictest	16923	-21	ssh	23:10:13	0
7198	99	59	13,8	cyclictest	13	1	rcu_preempt	20:00:12	1
7218	99	57	46,7	cyclictest	359	66	irq/58-eth0	22:15:15	3
7210	99	53	34,13	cyclictest	7557	-21	ssh	22:45:24	2
7198	99	53	12,18	cyclictest	21	-21	ksoftirqd/1	00:35:10	1
7184	99	50	3,8	cyclictest	12	-21	ksoftirqd/0	00:20:12	0
7184	99	50	30,5	cyclictest	12	-21	ksoftirqd/0	23:20:13	0
7210	99	48	4,33	cyclictest	27364	-21	ssh	22:40:15	2
7218	99	47	18,20	cyclictest	359	66	irq/58-eth0	23:15:16	3
7210	99	44	0,30	cyclictest	26159	-21	ssh	23:15:16	2
7198	99	44	5,36	cyclictest	6453	-21	ssh	23:40:14	1
7218	99	43	4,26	cyclictest	359	66	irq/58-eth0	21:45:14	3
7198	99	42	3,32	cyclictest	10342	-21	ssh	00:00:14	1
7198	99	42	11,18	cyclictest	21	-21	ksoftirqd/1	00:10:15	1
7198	99	42	11,18	cyclictest	21	-21	ksoftirqd/1	00:10:15	1
7184	99	42	2,30	cyclictest	5083	-21	ssh	00:15:13	0
7198	99	41	1,31	cyclictest	3984	-21	ssh	22:45:14	1
7184	99	40	1,5	cyclictest	13	1	rcu_preempt	21:30:15	0
7218	99	39	3,23	cyclictest	359	66	irq/58-eth0	22:50:12	3
7218	99	38	1,23	cyclictest	359	66	irq/58-eth0	23:40:12	3
7218	99	37	1,21	cyclictest	359	66	irq/58-eth0	00:10:13	3
7218	99	37	1,21	cyclictest	359	66	irq/58-eth0	00:10:12	3
7198	99	37	20,11	cyclictest	21	-21	ksoftirqd/1	00:05:16	1
7184	99	37	3,30	cyclictest	9239	-21	ssh	22:30:14	0
7184	99	37	3,29	cyclictest	11355	-21	ssh	21:20:12	0
7218	99	36	5,17	cyclictest	359	66	irq/58-eth0	23:35:13	3
7210	99	36	17,13	cyclictest	273	46	irq/40-dwc2_hso	22:10:11	2
7210	99	36	13,19	cyclictest	13	1	rcu_preempt	00:35:11	2
7198	99	36	5,24	cyclictest	14329	-21	ssh	22:15:15	1
7218	99	35	21,9	cyclictest	359	66	irq/58-eth0	22:00:13	3
7218	99	35	15,11	cyclictest	32	1	rcuc/3	20:50:13	3
7198	99	35	3,21	cyclictest	21	-21	ksoftirqd/1	19:25:14	1
7198	99	35	24,7	cyclictest	25178	-21	diskmemload	22:25:13	1
7198	99	35	24,7	cyclictest	25178	-21	diskmemload	22:25:12	1
7184	99	35	1,23	cyclictest	13062	-21	sh	22:50:14	0
7210	99	34	2,28	cyclictest	32524	-21	ssh	22:25:13	2
7210	99	34	2,28	cyclictest	32524	-21	ssh	22:25:13	2
7198	99	34	4,20	cyclictest	11407	-21	kworker/u8:1	22:05:12	1
7184	99	34	21,5	cyclictest	12	-21	ksoftirqd/0	20:45:14	0
7210	99	33	2,18	cyclictest	273	46	irq/40-dwc2_hso	23:20:15	2
7198	99	33	1,23	cyclictest	2249	-21	ssh	21:15:15	1
7184	99	31	6,19	cyclictest	12	-21	ksoftirqd/0	22:15:14	0
7184	99	31	2,22	cyclictest	5164	-21	ssh	22:10:11	0
7210	99	30	2,21	cyclictest	19162	-21	ntp_192.168.114	23:45:26	2
7210	99	30	2,11	cyclictest	24504	-21	ntp_states	23:30:26	2
7210	99	29	3,20	cyclictest	1263	-21	ssh	23:55:15	2
7210	99	29	3,11	cyclictest	0	-21	swapper/2	21:27:24	2
7210	99	29	2,16	cyclictest	273	46	irq/40-dwc2_hso	20:40:15	2
7198	99	29	2,20	cyclictest	3864	-21	rm	23:37:24	1
7198	99	29	2,20	cyclictest	26850	-21	ntpq	00:25:25	1
7198	99	29	1,21	cyclictest	6212	-21	rm	21:35:14	1
7198	99	29	10,11	cyclictest	7174	-21	cyclictest	00:30:14	1
7184	99	29	1,25	cyclictest	20459	-21	ssh	21:25:13	0
7184	99	29	10,13	cyclictest	12	-21	ksoftirqd/0	19:10:13	0
7210	99	28	4,14	cyclictest	273	46	irq/40-dwc2_hso	22:20:13	2
7210	99	28	4,13	cyclictest	273	46	irq/40-dwc2_hso	19:30:13	2
7210	99	28	3,19	cyclictest	273	46	irq/40-dwc2_hso	19:40:14	2
7210	99	28	3,14	cyclictest	25598	-21	ssh	21:10:15	2
7210	99	28	2,10	cyclictest	0	-21	swapper/2	23:37:25	2
7210	99	28	20,4	cyclictest	27	-21	ksoftirqd/2	23:40:13	2
7210	99	28	1,21	cyclictest	28454	-21	ssh	00:10:15	2
7210	99	28	1,21	cyclictest	28454	-21	ssh	00:10:14	2
7210	99	28	1,16	cyclictest	11775	-21	ssh	23:25:12	2
7198	99	28	3,20	cyclictest	10219	-21	ssh	21:55:14	1
7198	99	28	2,21	cyclictest	19374	-21	ssh	22:00:13	1
7198	99	28	12,11	cyclictest	21	-21	ksoftirqd/1	23:32:25	1
7218	99	27	3,18	cyclictest	0	-21	swapper/3	00:04:26	3
7210	99	27	4,8	cyclictest	0	-21	swapper/2	22:35:13	2
7210	99	27	4,7	cyclictest	24599	-21	ssh	23:50:11	2
7210	99	27	4,18	cyclictest	0	-21	swapper/2	00:20:14	2
7210	99	27	2,17	cyclictest	273	46	irq/40-dwc2_hso	20:35:14	2
7210	99	27	2,10	cyclictest	0	-21	swapper/2	20:00:13	2
7210	99	27	1,21	cyclictest	25027	-21	latency	19:25:22	2
7210	99	27	11,10	cyclictest	0	-21	swapper/2	21:55:13	2
7198	99	27	2,19	cyclictest	29038	-21	ssh	22:21:25	1
7218	99	26	1,17	cyclictest	0	-21	swapper/3	22:45:14	3
7210	99	26	3,19	cyclictest	27	-21	ksoftirqd/2	23:10:14	2
7210	99	26	3,16	cyclictest	273	46	irq/40-dwc2_hso	00:25:13	2
7210	99	26	1,20	cyclictest	1152	-21	ssh	21:50:14	2
7210	99	26	1,12	cyclictest	6308	-21	ssh	21:35:14	2
7198	99	26	7,11	cyclictest	7174	-21	cyclictest	20:40:13	1
7198	99	26	3,17	cyclictest	22137	-21	ssh	22:55:14	1
7198	99	26	2,18	cyclictest	24118	-21	ssh	21:25:26	1
7198	99	26	14,3	cyclictest	21	-21	ksoftirqd/1	22:10:07	1
7218	99	25	12,6	cyclictest	0	-21	swapper/3	21:10:14	3
7210	99	25	1,13	cyclictest	273	46	irq/40-dwc2_hso	19:20:13	2
7198	99	25	1,17	cyclictest	27363	-21	sh	22:40:14	1
7184	99	25	5,16	cyclictest	29843	-21	ssh	23:35:12	0
7184	99	25	4,14	cyclictest	20791	-21	ssh	23:30:11	0
7184	99	25	4,13	cyclictest	0	-21	swapper/0	20:05:12	0
7218	99	24	3,13	cyclictest	0	-21	swapper/3	22:21:24	3
7218	99	24	3,13	cyclictest	0	-21	swapper/3	21:35:13	3
7218	99	24	16,5	cyclictest	359	66	irq/58-eth0	22:05:14	3
7210	99	24	2,18	cyclictest	17314	-21	ssh	21:21:51	2
7210	99	24	1,8	cyclictest	16004	-21	ssh	23:09:26	2
7198	99	24	7,8	cyclictest	21	-21	ksoftirqd/1	23:48:56	1
7198	99	24	2,18	cyclictest	24497	-21	ssh	21:45:14	1
7198	99	24	2,17	cyclictest	25178	-21	diskmemload	23:29:25	1
7198	99	24	1,19	cyclictest	7612	-21	ls	23:05:02	1
7184	99	24	1,17	cyclictest	11802	-21	ssh	23:25:14	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17