OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Sun Apr 19, 2026 00:45:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2432	99	66	3,54	cyclictest	28440	-21	ssh	21:50:11	0
2432	99	55	6,45	cyclictest	23355	-21	ssh	23:35:14	0
2432	99	55	6,45	cyclictest	23355	-21	ssh	23:35:13	0
2432	99	53	3,38	cyclictest	12454	-21	ssh	22:35:12	0
2440	99	48	2,37	cyclictest	15808	-21	ssh	00:25:14	1
2432	99	48	1,35	cyclictest	3403	-21	ssh	22:30:11	0
2432	99	47	2,37	cyclictest	26854	-21	ssh	22:25:11	0
2432	99	47	1,38	cyclictest	30078	-21	ssh	21:15:12	0
2432	99	45	2,34	cyclictest	32092	-21	ssh	22:10:11	0
2432	99	45	0,40	cyclictest	14789	-21	apt-get	20:30:13	0
2432	99	45	0,40	cyclictest	1356	-21	ssh	21:35:12	0
2440	99	44	1,32	cyclictest	1346	-21	ssh	21:35:13	1
2457	99	42	24,15	cyclictest	359	66	irq/58-eth0	23:40:12	3
2432	99	42	1,36	cyclictest	21416	-21	apt-get	22:40:10	0
2449	99	41	18,17	cyclictest	26	1	rcuc/2	20:35:14	2
2440	99	41	1,32	cyclictest	15658	-21	ssh	21:25:13	1
2432	99	41	2,35	cyclictest	2607	-21	apt-get	19:10:12	0
2432	99	41	2,35	cyclictest	2607	-21	apt-get	19:10:12	0
2432	99	40	1,32	cyclictest	0	-21	swapper/0	20:20:12	0
2432	99	39	1,34	cyclictest	0	-21	swapper/0	00:00:13	0
2432	99	39	1,29	cyclictest	0	-21	swapper/0	22:20:13	0
2457	99	38	3,25	cyclictest	359	66	irq/58-eth0	21:10:14	3
2449	99	38	1,17	cyclictest	1365	-21	ssh	21:35:13	2
2440	99	38	3,28	cyclictest	0	-21	swapper/1	22:45:13	1
2432	99	38	3,22	cyclictest	30298	-21	ssh	00:15:12	0
2432	99	38	1,27	cyclictest	0	-21	swapper/0	21:40:13	0
2432	99	38	1,25	cyclictest	4570	-21	sh	23:24:37	0
2432	99	38	0,35	cyclictest	19682	-21	apt-get	20:35:15	0
2432	99	38	0,34	cyclictest	0	-21	swapper/0	20:05:13	0
2432	99	38	0,34	cyclictest	0	-21	swapper/0	00:35:13	0
2432	99	38	0,24	cyclictest	4608	-21	ssh	22:47:33	0
2457	99	37	2,21	cyclictest	359	66	irq/58-eth0	22:00:13	3
2449	99	37	2,29	cyclictest	3579	-21	ssh	23:23:25	2
2449	99	37	1,13	cyclictest	27	-21	ksoftirqd/2	23:10:14	2
2432	99	37	18,14	cyclictest	12	-21	ksoftirqd/0	00:30:13	0
2432	99	37	1,32	cyclictest	1553	-21	apt-get	23:05:12	0
2432	99	37	1,29	cyclictest	10669	-21	apt-get	23:10:13	0
2432	99	37	1,27	cyclictest	15991	-21	ssh	22:55:13	0
2432	99	37	1,23	cyclictest	2472	-21	ntp_192.168.114	19:40:23	0
2432	99	37	0,23	cyclictest	20638	-21	diskmemload	23:50:04	0
2432	99	37	0,22	cyclictest	20638	-21	diskmemload	21:29:40	0
2432	99	37	0,21	cyclictest	12594	-21	ssh	22:51:27	0
2457	99	36	4,25	cyclictest	359	66	irq/58-eth0	23:35:13	3
2457	99	36	4,25	cyclictest	359	66	irq/58-eth0	23:35:12	3
2449	99	36	23,8	cyclictest	27	-21	ksoftirqd/2	22:33:56	2
2449	99	36	2,18	cyclictest	21580	-21	ssh	23:33:27	2
2440	99	36	1,24	cyclictest	28732	-21	ssh	23:20:13	1
2432	99	36	1,21	cyclictest	1038	-21	ssh	23:57:47	0
2432	99	36	1,20	cyclictest	31967	-21	ssh	21:33:21	0
2432	99	36	1,19	cyclictest	13558	-21	ssh	00:22:47	0
2432	99	36	11,18	cyclictest	12	-21	ksoftirqd/0	21:00:11	0
2432	99	36	0,31	cyclictest	0	-21	swapper/0	23:30:12	0
2432	99	36	0,23	cyclictest	18329	-21	ssh	00:06:54	0
2432	99	36	0,22	cyclictest	20978	-21	sh	00:25:54	0
2432	99	35	1,30	cyclictest	0	-21	swapper/0	19:55:11	0
2432	99	35	1,27	cyclictest	21327	-21	ssh	00:10:12	0
2432	99	35	1,20	cyclictest	8173	-21	rm	23:44:41	0
2432	99	35	0,19	cyclictest	13424	-21	ssh	23:29:26	0
2440	99	34	4,21	cyclictest	21	-21	ksoftirqd/1	23:30:13	1
2440	99	34	3,24	cyclictest	5301	-21	sh	23:25:14	1
2440	99	34	3,23	cyclictest	24723	-21	ssh	21:30:13	1
2440	99	34	25,3	cyclictest	20638	-21	diskmemload	21:10:13	1
2440	99	34	22,6	cyclictest	0	-21	swapper/1	23:55:14	1
2440	99	34	19,5	cyclictest	21	-21	ksoftirqd/1	20:30:10	1
2432	99	34	1,29	cyclictest	20448	-21	ntp_192.168.114	19:25:25	0
2432	99	34	1,19	cyclictest	29057	-21	ssh	22:06:50	0
2432	99	34	0,20	cyclictest	27831	-21	ssh	21:49:45	0
2432	99	34	0,19	cyclictest	11706	-21	ssh	21:57:36	0
2449	99	33	2,25	cyclictest	5749	-21	ssh	22:11:56	2
2449	99	33	2,24	cyclictest	5304	-21	ssh	23:25:14	2
2449	99	33	18,9	cyclictest	0	-21	swapper/2	00:15:13	2
2449	99	33	1,16	cyclictest	930	-21	snmpd	19:55:13	2
2432	99	33	19,10	cyclictest	0	-21	swapper/0	20:15:11	0
2432	99	33	1,29	cyclictest	11150	-21	cut	22:15:21	0
2432	99	33	1,29	cyclictest	0	-21	swapper/0	19:20:12	0
2432	99	33	1,28	cyclictest	0	-21	swapper/0	19:15:12	0
2432	99	33	0,28	cyclictest	0	-21	swapper/0	20:00:13	0
2449	99	32	6,16	cyclictest	0	-21	swapper/2	22:25:12	2
2449	99	32	20,8	cyclictest	273	46	irq/40-dwc2_hso	22:20:14	2
2432	99	32	1,28	cyclictest	25018	-21	kthreadcore	19:30:22	0
2449	99	31	7,19	cyclictest	2423	-21	cyclictest	23:19:56	2
2449	99	31	2,19	cyclictest	273	46	irq/40-dwc2_hso	21:30:12	2
2449	99	31	13,7	cyclictest	0	-21	swapper/2	21:20:14	2
2449	99	31	1,18	cyclictest	12464	-21	ssh	22:35:13	2
2440	99	31	2,24	cyclictest	5118	-21	ssh	21:55:14	1
2432	99	31	1,27	cyclictest	4136	-21	kthreadcore	20:50:22	0
2432	99	31	1,27	cyclictest	30239	-21	swap	19:35:28	0
2432	99	31	1,26	cyclictest	32731	-21	ntpq	20:45:25	0
2432	99	31	1,26	cyclictest	29791	-21	latency_hist	21:15:02	0
2432	99	31	1,18	cyclictest	0	-21	swapper/0	22:03:32	0
2432	99	31	0,27	cyclictest	16080	-21	apt-get	21:05:14	0
2457	99	30	3,18	cyclictest	359	66	irq/58-eth0	19:50:12	3
2457	99	30	3,13	cyclictest	359	66	irq/58-eth0	00:25:14	3
2440	99	30	4,19	cyclictest	20	1	rcuc/1	23:10:13	1
2440	99	30	1,22	cyclictest	12345	-21	ssh	00:05:12	1
2432	99	30	18,5	cyclictest	0	-21	swapper/0	19:45:14	0
2432	99	30	1,26	cyclictest	14700	-21	ssh	23:46:50	0
2432	99	30	1,25	cyclictest	9990	-21	/usr/sbin/munin	20:25:23	0
2432	99	30	1,24	cyclictest	0	-21	swapper/0	23:15:11	0
2432	99	30	0,26	cyclictest	27983	-21	find	20:10:10	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17