OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Wed Jun 24, 2026 12:45:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
29919	99	70	5,54	cyclictest	17890	-21	ssh	12:30:12	0
29919	99	57	17,34	cyclictest	8088	-21	ssh	11:30:12	0
29934	99	54	3,40	cyclictest	20275	-21	ssh	11:55:12	1
29919	99	54	5,35	cyclictest	25903	-21	ssh	11:40:12	0
29919	99	53	4,37	cyclictest	5292	-21	ssh	09:40:11	0
29919	99	52	2,36	cyclictest	8768	-21	ssh	10:00:12	0
29934	99	49	35,10	cyclictest	14655	-21	apt-get	12:10:12	1
29934	99	49	35,10	cyclictest	14655	-21	apt-get	12:10:12	1
29943	99	48	1,42	cyclictest	15555	-21	ssh	10:40:12	2
29919	99	47	2,34	cyclictest	1619	-21	ssh	09:20:13	0
29934	99	45	36,6	cyclictest	29906	-21	cyclictest	10:30:14	1
29919	99	45	22,10	cyclictest	12	-21	ksoftirqd/0	12:35:11	0
29954	99	44	3,25	cyclictest	359	66	irq/58-eth0	11:25:11	3
29934	99	44	37,3	cyclictest	3744	-21	apt-get	07:50:11	1
29919	99	44	1,32	cyclictest	25124	-21	ssh	09:15:15	0
29954	99	43	19,18	cyclictest	0	-21	swapper/3	11:32:43	3
29934	99	43	35,4	cyclictest	28681	-21	apt-get	09:35:14	1
29934	99	43	33,4	cyclictest	1027	-21	apt-get	10:50:13	1
29934	99	43	33,4	cyclictest	1027	-21	apt-get	10:50:13	1
29934	99	43	26,12	cyclictest	6582	-21	ssh	10:35:12	1
29934	99	43	2,29	cyclictest	17758	-21	ssh	10:05:14	1
29943	99	42	1,31	cyclictest	20265	-21	ssh	11:55:11	2
29934	99	42	26,11	cyclictest	26843	-21	apt-get	12:35:11	1
29919	99	42	24,5	cyclictest	12	-21	ksoftirqd/0	11:05:14	0
29934	99	41	34,3	cyclictest	10036	-21	apt-get	10:55:11	1
29934	99	41	30,7	cyclictest	2480	-21	apt-get	07:15:12	1
29934	99	41	15,11	cyclictest	21081	-21	ssh	10:25:07	1
29919	99	40	1,32	cyclictest	1054	-21	ssh	10:50:14	0
29919	99	40	1,32	cyclictest	1054	-21	ssh	10:50:14	0
29954	99	39	2,24	cyclictest	359	66	irq/58-eth0	12:00:13	3
29934	99	39	31,5	cyclictest	8757	-21	apt-get	10:00:12	1
29934	99	39	26,8	cyclictest	0	-21	swapper/1	11:20:11	1
29934	99	39	18,7	cyclictest	13611	-21	ssh	12:09:11	1
29934	99	39	15,10	cyclictest	6116	-21	ssh	11:28:06	1
29934	99	39	13,12	cyclictest	14901	-21	ssh	11:50:23	1
29934	99	39	12,10	cyclictest	25008	-21	kthreadcore	12:15:19	1
29954	99	38	5,20	cyclictest	359	66	irq/58-eth0	09:35:15	3
29934	99	38	29,3	cyclictest	31358	-21	apt-get	07:45:13	1
29934	99	38	26,8	cyclictest	23273	-21	apt-get	09:50:14	1
29934	99	38	24,10	cyclictest	12072	-21	apt-get	07:25:11	1
29934	99	38	15,10	cyclictest	20856	-21	rm	09:47:40	1
29934	99	38	12,11	cyclictest	20685	-21	rm	10:24:53	1
29934	99	38	12,10	cyclictest	2025	-21	ssh	10:13:56	1
29919	99	38	2,27	cyclictest	14260	-21	ssh	09:45:12	0
29943	99	37	2,19	cyclictest	23606	-21	ssh	11:37:43	2
29934	99	37	29,5	cyclictest	29100	-21	apt-get	08:50:11	1
29934	99	37	29,5	cyclictest	27840	-21	apt-get	08:15:14	1
29934	99	37	15,8	cyclictest	9477	-21	sh	10:17:12	1
29934	99	37	15,8	cyclictest	20649	-21	ssh	11:18:10	1
29934	99	37	14,15	cyclictest	15655	-21	diskmemload	11:37:35	1
29934	99	37	12,9	cyclictest	7523	-21	ssh	09:21:49	1
29954	99	36	1,22	cyclictest	359	66	irq/58-eth0	12:15:12	3
29943	99	36	6,19	cyclictest	27	-21	ksoftirqd/2	07:10:13	2
29934	99	36	28,3	cyclictest	29285	-21	apt-get	12:00:14	1
29934	99	36	15,8	cyclictest	10551	-21	ssh	11:11:46	1
29934	99	36	15,7	cyclictest	15655	-21	diskmemload	09:30:43	1
29934	99	36	14,8	cyclictest	27811	-21	grep	10:45:22	1
29934	99	36	13,8	cyclictest	27188	-21	ssh	11:04:23	1
29934	99	36	13,7	cyclictest	0	-21	swapper/1	10:44:19	1
29934	99	36	12,9	cyclictest	6107	-21	ssh	12:21:59	1
29934	99	36	12,8	cyclictest	14749	-21	ssh	12:26:38	1
29934	99	36	10,9	cyclictest	21967	-21	ssh	09:11:41	1
29934	99	35	14,7	cyclictest	24983	-21	ssh	09:15:04	1
29934	99	35	13,9	cyclictest	15655	-21	diskmemload	11:06:13	1
29934	99	35	13,7	cyclictest	15655	-21	diskmemload	11:41:25	1
29934	99	35	12,9	cyclictest	18563	-21	cut	12:30:18	1
29954	99	34	3,17	cyclictest	359	66	irq/58-eth0	10:50:12	3
29954	99	34	3,17	cyclictest	359	66	irq/58-eth0	10:50:12	3
29934	99	34	2,27	cyclictest	32257	-21	ssh	09:55:14	1
29934	99	34	18,13	cyclictest	0	-21	swapper/1	08:35:13	1
29934	99	34	16,14	cyclictest	0	-21	swapper/1	11:30:12	1
29934	99	34	13,9	cyclictest	10920	-21	sh	09:41:29	1
29934	99	34	13,8	cyclictest	8798	-21	ssh	11:47:25	1
29943	99	33	18,9	cyclictest	27	-21	ksoftirqd/2	12:35:11	2
29934	99	33	19,11	cyclictest	0	-21	swapper/1	08:45:13	1
29934	99	33	19,11	cyclictest	0	-21	swapper/1	07:20:11	1
29934	99	33	18,11	cyclictest	0	-21	swapper/1	08:30:11	1
29954	99	32	2,21	cyclictest	359	66	irq/58-eth0	10:00:12	3
29943	99	32	23,3	cyclictest	26782	-21	ssh	10:10:12	2
29934	99	32	19,8	cyclictest	0	-21	swapper/1	09:25:10	1
29934	99	32	10,19	cyclictest	12610	-21	kthreadcore	09:05:21	1
29919	99	32	5,17	cyclictest	12	-21	ksoftirqd/0	12:15:11	0
29919	99	32	1,22	cyclictest	0	-21	swapper/0	11:50:11	0
29943	99	31	5,16	cyclictest	273	46	irq/40-dwc2_hso	07:20:11	2
29943	99	31	13,4	cyclictest	27	-21	ksoftirqd/2	09:05:25	2
29934	99	31	9,8	cyclictest	0	-21	swapper/1	07:35:25	1
29934	99	31	19,9	cyclictest	0	-21	swapper/1	07:10:13	1
29943	99	30	8,3	cyclictest	13	1	rcu_preempt	08:40:01	2
29943	99	30	3,18	cyclictest	273	46	irq/40-dwc2_hso	07:55:10	2
29934	99	30	20,7	cyclictest	22888	-21	ntp_192.168.114	08:40:23	1
29934	99	30	18,8	cyclictest	27525	-21	apt-get	08:15:01	1
29934	99	30	18,8	cyclictest	27525	-21	apt-get	08:15:01	1
29934	99	30	17,9	cyclictest	18416	-21	if_err_eth0	08:05:18	1
29934	99	30	17,11	cyclictest	5010	-21	ps	08:55:25	1
29934	99	30	16,10	cyclictest	0	-21	swapper/1	07:55:10	1
29934	99	30	14,13	cyclictest	6569	-21	kthreadcore	08:25:21	1
29934	99	30	13,6	cyclictest	3635	-21	grep	08:20:23	1
29934	99	30	13,6	cyclictest	3635	-21	grep	08:20:22	1
29919	99	30	2,22	cyclictest	3492	-21	ssh	12:02:43	0
29954	99	29	7,17	cyclictest	0	-21	swapper/3	11:10:43	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17