OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Mon Aug 10, 2026 12:45:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
11877	99	56	4,15	cyclictest	21	-21	ksoftirqd/1	09:10:12	1
11885	99	54	1,46	cyclictest	22933	-21	apt-get	07:55:12	2
11885	99	53	2,36	cyclictest	32571	-21	apt-get	10:05:13	2
11877	99	51	3,8	cyclictest	21	-21	ksoftirqd/1	09:40:11	1
11885	99	49	1,38	cyclictest	0	-21	swapper/2	09:50:13	2
11885	99	49	1,36	cyclictest	32695	-21	apt-get	11:35:14	2
11877	99	49	1,8	cyclictest	0	-21	swapper/1	07:15:12	1
11885	99	46	1,33	cyclictest	0	-21	swapper/2	11:10:18	2
11866	99	46	4,11	cyclictest	13	1	rcu_preempt	11:25:13	0
11893	99	45	1,23	cyclictest	359	66	irq/58-eth0	10:20:12	3
11893	99	45	1,23	cyclictest	359	66	irq/58-eth0	10:20:12	3
11885	99	45	1,39	cyclictest	0	-21	swapper/2	11:20:14	2
11877	99	45	6,30	cyclictest	29074	-21	ssh	11:15:13	1
11877	99	45	2,32	cyclictest	1999	-21	ssh	11:00:13	1
11885	99	44	3,36	cyclictest	9799	-21	apt-get	08:15:12	2
11866	99	44	2,37	cyclictest	1841	-21	sh	09:30:14	0
11866	99	44	1,39	cyclictest	18310	-21	ssh	10:15:13	0
11885	99	43	8,26	cyclictest	3844	-21	sh	09:11:41	2
11885	99	43	1,36	cyclictest	15837	-21	apt-get	08:55:18	2
11893	99	42	2,24	cyclictest	359	66	irq/58-eth0	10:25:13	3
11885	99	42	3,35	cyclictest	0	-21	swapper/2	09:15:15	2
11885	99	42	1,37	cyclictest	0	-21	swapper/2	10:40:14	2
11885	99	42	1,37	cyclictest	0	-21	swapper/2	09:45:14	2
11885	99	42	1,29	cyclictest	30648	-21	ssh	10:03:09	2
11885	99	42	1,23	cyclictest	0	-21	swapper/2	11:45:14	2
11885	99	42	1,23	cyclictest	0	-21	swapper/2	11:45:13	2
11885	99	42	0,28	cyclictest	19027	-21	ssh	12:39:10	2
11877	99	42	26,7	cyclictest	13	1	rcu_preempt	12:35:12	1
11866	99	42	1,35	cyclictest	7343	-21	ssh	12:15:10	0
11885	99	41	1,36	cyclictest	19857	-21	apt-get	09:40:13	2
11885	99	41	1,36	cyclictest	0	-21	swapper/2	10:10:14	2
11877	99	41	4,29	cyclictest	16133	-21	ssh	09:20:14	1
11877	99	41	2,27	cyclictest	18263	-21	ssh	11:45:13	1
11877	99	41	2,27	cyclictest	18263	-21	ssh	11:45:12	1
11866	99	41	7,5	cyclictest	13	1	rcu_preempt	11:50:12	0
11866	99	41	12,12	cyclictest	4741	-21	ssh	09:49:34	0
11866	99	41	12,11	cyclictest	23046	-21	ssh	10:52:32	0
11885	99	40	1,32	cyclictest	14489	-21	apt-get	09:55:14	2
11885	99	40	1,23	cyclictest	0	-21	swapper/2	11:58:57	2
11885	99	40	1,22	cyclictest	0	-21	swapper/2	10:20:56	2
11885	99	40	1,22	cyclictest	0	-21	swapper/2	10:20:55	2
11877	99	40	1,29	cyclictest	30827	-21	ssh	12:10:14	1
11866	99	40	28,8	cyclictest	14609	-21	apt-get	08:20:14	0
11866	99	40	28,8	cyclictest	14609	-21	apt-get	08:20:13	0
11866	99	40	14,16	cyclictest	14047	-21	grep	09:35:20	0
11866	99	40	12,11	cyclictest	27705	-21	ssh	11:13:51	0
11885	99	39	1,34	cyclictest	0	-21	swapper/2	11:25:12	2
11885	99	39	0,36	cyclictest	9716	-21	ssh	10:26:40	2
11877	99	39	5,5	cyclictest	13	1	rcu_preempt	08:15:12	1
11877	99	39	1,31	cyclictest	25216	-21	ssh	09:25:12	1
11866	99	39	14,10	cyclictest	21574	-21	ntpq	07:50:25	0
11866	99	39	13,7	cyclictest	18754	-21	ssh	11:08:53	0
11866	99	39	10,11	cyclictest	21372	-21	ssh	12:20:36	0
11866	99	39	10,10	cyclictest	5577	-21	ssh	10:06:10	0
11866	99	39	10,10	cyclictest	10403	-21	sh	10:27:30	0
11885	99	38	3,30	cyclictest	0	-21	swapper/2	09:35:12	2
11885	99	38	1,34	cyclictest	0	-21	swapper/2	08:00:15	2
11885	99	38	1,33	cyclictest	5644	-21	ntp_192.168.114	11:00:24	2
11885	99	38	0,20	cyclictest	11015	-21	apt-get	08:50:14	2
11866	99	38	31,4	cyclictest	24229	-21	apt-get	08:30:14	0
11866	99	38	28,6	cyclictest	5662	-21	apt-get	11:20:15	0
11866	99	38	14,9	cyclictest	28288	-21	sed	08:00:19	0
11866	99	38	14,9	cyclictest	25077	-21	apt-get	12:25:02	0
11866	99	38	11,9	cyclictest	20942	-21	ssh	12:04:26	0
11893	99	37	9,19	cyclictest	359	66	irq/58-eth0	10:05:12	3
11893	99	37	19,10	cyclictest	359	66	irq/58-eth0	11:55:13	3
11885	99	37	2,30	cyclictest	0	-21	swapper/2	10:55:13	2
11885	99	37	1,33	cyclictest	0	-21	swapper/2	08:20:12	2
11885	99	37	1,33	cyclictest	0	-21	swapper/2	08:20:12	2
11885	99	37	1,31	cyclictest	0	-21	swapper/2	10:45:13	2
11885	99	37	0,34	cyclictest	27765	-21	cut	09:05:19	2
11885	99	37	0,24	cyclictest	2835	-21	ssh	11:17:09	2
11885	99	37	0,21	cyclictest	14190	-21	users	11:40:32	2
11866	99	37	9,12	cyclictest	3760	-21	cpuspeed	07:35:14	0
11866	99	37	9,10	cyclictest	14884	-21	ssh	09:19:03	0
11866	99	37	8,11	cyclictest	27700	-21	ssh	09:44:02	0
11866	99	37	30,3	cyclictest	7479	-21	apt-get	10:45:14	0
11866	99	37	24,10	cyclictest	25490	-21	apt-get	10:55:11	0
11866	99	37	11,11	cyclictest	6669	-21	ssh	12:14:38	0
11866	99	37	11,10	cyclictest	24978	-21	latency	07:20:22	0
11885	99	36	1,31	cyclictest	0	-21	swapper/2	09:00:13	2
11885	99	36	1,20	cyclictest	5844	-21	ntp_192.168.114	12:30:27	2
11885	99	36	1,15	cyclictest	0	-21	swapper/2	12:19:50	2
11885	99	36	0,23	cyclictest	26721	-21	sh	10:19:48	2
11885	99	36	0,23	cyclictest	19504	-21	sshd	10:32:36	2
11885	99	36	0,22	cyclictest	4960	-21	sendmail_mailqu	08:40:27	2
11877	99	36	13,16	cyclictest	21	-21	ksoftirqd/1	12:05:12	1
11877	99	36	1,26	cyclictest	25500	-21	ssh	10:55:12	1
11866	99	36	9,18	cyclictest	30688	-21	ssh	10:03:13	0
11866	99	36	9,10	cyclictest	32713	-21	ssh	09:28:39	0
11866	99	36	7,10	cyclictest	28707	-21	ssh	11:30:45	0
11866	99	36	29,3	cyclictest	25484	-21	apt-get	09:05:11	0
11866	99	36	27,5	cyclictest	16809	-21	apt-get	07:15:13	0
11866	99	36	23,9	cyclictest	5509	-21	apt-get	09:50:13	0
11866	99	36	23,7	cyclictest	0	-21	swapper/0	09:10:12	0
11866	99	36	12,10	cyclictest	9315	-21	ssh	11:03:23	0
11866	99	36	11,13	cyclictest	30055	-21	diskmemload	10:42:02	0
11885	99	35	1,31	cyclictest	20115	-21	grep	09:20:28	2
11885	99	35	1,22	cyclictest	0	-21	swapper/2	12:06:20	2
11885	99	35	1,19	cyclictest	0	-21	swapper/2	07:40:12	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17