OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Fri May 22, 2026 00:45:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
21412	99	69	45,14	cyclictest	11427	-21	ssh	23:00:12	1
21412	99	61	4,42	cyclictest	24114	-21	ssh	23:25:14	1
21411	99	57	4,41	cyclictest	11363	-21	ssh	00:30:13	0
21411	99	55	1,42	cyclictest	9626	-21	ssh	22:05:11	0
21427	99	53	16,18	cyclictest	20479	-21	ssh	23:05:14	2
21411	99	52	5,4	cyclictest	13	1	rcu_preempt	23:25:14	0
21427	99	51	2,23	cyclictest	7889	-21	ssh	00:10:12	2
21412	99	51	31,7	cyclictest	21	-21	ksoftirqd/1	23:10:12	1
21412	99	51	31,7	cyclictest	21	-21	ksoftirqd/1	23:10:11	1
21427	99	48	29,6	cyclictest	22278	-21	apt-get	00:00:14	2
21427	99	47	28,15	cyclictest	25904	-21	apt-get	00:20:13	2
21427	99	45	34,4	cyclictest	30270	-21	apt-get	21:00:12	2
21412	99	45	3,7	cyclictest	13	1	rcu_preempt	22:55:14	1
21427	99	44	1,27	cyclictest	31382	-21	ssh	22:35:14	2
21412	99	44	2,4	cyclictest	13	1	rcu_preempt	00:05:12	1
21412	99	44	2,4	cyclictest	13	1	rcu_preempt	00:05:11	1
21435	99	43	30,7	cyclictest	359	66	irq/58-eth0	22:00:12	3
21427	99	43	29,10	cyclictest	13349	-21	apt-get	22:25:14	2
21427	99	42	30,8	cyclictest	4926	-21	apt-get	20:00:12	2
21427	99	42	28,10	cyclictest	11353	-21	apt-get	21:30:14	2
21412	99	42	3,8	cyclictest	13	1	rcu_preempt	19:35:11	1
21411	99	42	3,27	cyclictest	29458	-21	ssh	23:10:12	0
21411	99	42	3,27	cyclictest	29458	-21	ssh	23:10:11	0
21427	99	41	12,24	cyclictest	0	-21	swapper/2	21:20:14	2
21412	99	41	3,30	cyclictest	2470	-21	ssh	00:25:15	1
21412	99	41	3,28	cyclictest	29500	-21	ssh	21:40:11	1
21411	99	41	5,3	cyclictest	13	1	rcu_preempt	21:10:15	0
21411	99	41	2,29	cyclictest	18659	-21	ssh	22:10:13	0
21435	99	40	3,24	cyclictest	359	66	irq/58-eth0	00:35:14	3
21412	99	40	22,7	cyclictest	21	-21	ksoftirqd/1	21:35:14	1
21411	99	40	2,27	cyclictest	16871	-21	ssh	22:45:13	0
21411	99	40	2,27	cyclictest	16871	-21	ssh	22:45:12	0
21435	99	39	3,22	cyclictest	359	66	irq/58-eth0	22:30:12	3
21427	99	39	1,29	cyclictest	20453	-21	sh	21:35:14	2
21411	99	39	15,18	cyclictest	12	-21	ksoftirqd/0	23:45:13	0
21427	99	38	26,7	cyclictest	642	-21	apt-get	23:30:12	2
21427	99	38	22,12	cyclictest	4309	-21	apt-get	22:20:11	2
21427	99	38	19,15	cyclictest	16701	-21	ssh	21:15:15	2
21427	99	38	15,12	cyclictest	0	-21	swapper/2	21:10:13	2
21427	99	38	10,17	cyclictest	9571	-21	ssh	21:28:21	2
21412	99	38	31,3	cyclictest	21	-21	ksoftirqd/1	20:00:11	1
21411	99	38	1,27	cyclictest	22371	-21	ssh	22:30:12	0
21427	99	37	9,19	cyclictest	7607	-21	ssh	22:03:02	2
21427	99	37	9,19	cyclictest	1282	-21	rm	23:46:56	2
21427	99	37	5,25	cyclictest	0	-21	swapper/2	00:30:14	2
21427	99	37	14,18	cyclictest	0	-21	swapper/2	23:35:14	2
21411	99	37	4,8	cyclictest	12	-21	ksoftirqd/0	23:35:12	0
21435	99	36	4,20	cyclictest	359	66	irq/58-eth0	21:15:13	3
21427	99	36	9,9	cyclictest	18037	-21	ssh	22:09:45	2
21427	99	36	9,16	cyclictest	7241	-21	diskmemload	22:18:25	2
21427	99	36	7,14	cyclictest	383	-21	irqcore	19:55:19	2
21427	99	36	5,14	cyclictest	16988	-21	ssh	00:15:14	2
21427	99	36	14,18	cyclictest	21410	-21	cyclictest	23:10:12	2
21427	99	36	14,18	cyclictest	21410	-21	cyclictest	23:10:11	2
21427	99	36	12,17	cyclictest	930	-21	snmpd	20:20:10	2
21427	99	36	10,13	cyclictest	7241	-21	diskmemload	23:19:47	2
21412	99	36	1,31	cyclictest	13369	-21	ssh	22:25:14	1
21411	99	36	5,8	cyclictest	12	-21	ksoftirqd/0	21:20:13	0
21435	99	35	1,18	cyclictest	359	66	irq/58-eth0	22:45:13	3
21435	99	35	1,18	cyclictest	359	66	irq/58-eth0	22:45:12	3
21427	99	35	3,23	cyclictest	27	-21	ksoftirqd/2	21:40:13	2
21427	99	35	27,3	cyclictest	14602	-21	apt-get	20:10:12	2
21412	99	35	18,13	cyclictest	21	-21	ksoftirqd/1	22:00:12	1
21411	99	35	4,22	cyclictest	24144	-21	ssh	21:55:16	0
21411	99	35	4,22	cyclictest	24144	-21	ssh	21:55:15	0
21435	99	34	23,5	cyclictest	359	66	irq/58-eth0	23:00:13	3
21435	99	34	1,24	cyclictest	359	66	irq/58-eth0	19:55:14	3
21427	99	34	9,10	cyclictest	7241	-21	diskmemload	00:06:00	2
21427	99	34	9,10	cyclictest	7241	-21	diskmemload	00:05:59	2
21427	99	34	6,20	cyclictest	0	-21	swapper/2	22:54:09	2
21427	99	34	5,11	cyclictest	91	-21	pr/ttyS0	20:40:02	2
21427	99	34	2,25	cyclictest	16875	-21	ssh	22:45:13	2
21427	99	34	2,25	cyclictest	16875	-21	ssh	22:45:12	2
21427	99	34	17,12	cyclictest	0	-21	swapper/2	23:50:12	2
21412	99	34	19,9	cyclictest	21410	-21	cyclictest	23:40:14	1
21411	99	34	2,28	cyclictest	2344	-21	ssh	21:25:13	0
21435	99	33	2,17	cyclictest	359	66	irq/58-eth0	21:55:16	3
21435	99	33	2,17	cyclictest	359	66	irq/58-eth0	21:55:15	3
21427	99	33	9,7	cyclictest	7241	-21	diskmemload	22:41:40	2
21427	99	33	9,10	cyclictest	7241	-21	diskmemload	23:28:27	2
21427	99	33	8,7	cyclictest	7241	-21	diskmemload	23:04:44	2
21427	99	33	7,18	cyclictest	12987	-21	ssh	21:47:56	2
21427	99	33	7,18	cyclictest	0	-21	swapper/2	21:50:19	2
21427	99	33	6,18	cyclictest	0	-21	swapper/2	23:59:14	2
21427	99	33	6,11	cyclictest	6173	-21	ps	21:05:27	2
21427	99	33	5,14	cyclictest	23664	-21	cat	20:15:30	2
21427	99	33	24,6	cyclictest	3701	-21	apt-get	19:25:15	2
21427	99	33	20,9	cyclictest	20299	-21	ssh	00:35:11	2
21427	99	33	15,13	cyclictest	0	-21	swapper/2	19:35:13	2
21427	99	33	1,23	cyclictest	15067	-21	ssh	23:20:14	2
21427	99	33	10,8	cyclictest	7241	-21	diskmemload	00:25:10	2
21412	99	33	3,18	cyclictest	6052	-21	diskmemload	23:15:12	1
21411	99	33	3,21	cyclictest	648	-21	ssh	23:30:13	0
21427	99	32	8,9	cyclictest	27021	-21	diskmemload	22:14:43	2
21427	99	32	6,17	cyclictest	0	-21	swapper/2	23:40:48	2
21427	99	32	5,10	cyclictest	0	-21	swapper/2	22:33:45	2
21411	99	32	8,4	cyclictest	13	1	rcu_preempt	23:55:14	0
21411	99	32	1,18	cyclictest	27657	-21	ssh	22:15:11	0
21427	99	31	7,15	cyclictest	0	-21	swapper/2	21:58:46	2
21427	99	31	7,15	cyclictest	0	-21	swapper/2	21:58:45	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17