OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack7slot4s.osadl.org (updated Tue Sep 08, 2026 12:45:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
7147	99	57	5,37	cyclictest	7671	-21	ssh	10:30:15	0
7147	99	53	29,18	cyclictest	0	-21	swapper/0	11:35:13	0
7181	99	47	33,6	cyclictest	31060	-21	ssh	10:25:12	2
7159	99	46	3,30	cyclictest	2316	-21	ssh	10:45:14	1
7147	99	46	31,9	cyclictest	9520	-21	apt-get	09:55:14	0
7147	99	46	13,11	cyclictest	31029	-21	munin-node	10:25:10	0
7147	99	45	38,3	cyclictest	25745	-21	apt-get	09:10:12	0
7147	99	45	34,5	cyclictest	21844	-21	apt-get	07:25:12	0
7198	99	44	3,32	cyclictest	359	66	irq/58-eth0	11:45:15	3
7147	99	44	33,6	cyclictest	4161	-21	apt-get	11:40:14	0
7147	99	44	3,32	cyclictest	11281	-21	ssh	09:20:13	0
7147	99	44	28,12	cyclictest	14945	-21	apt-get	09:40:13	0
7198	99	43	1,2	cyclictest	0	-21	swapper/3	11:15:13	3
7147	99	43	30,10	cyclictest	5092	-21	apt-get	08:15:12	0
7147	99	43	2,33	cyclictest	5895	-21	ssh	11:05:12	0
7147	99	43	17,8	cyclictest	12186	-21	ssh	09:37:11	0
7147	99	43	1,33	cyclictest	11341	-21	ssh	12:20:11	0
7181	99	42	2,32	cyclictest	23806	-21	rm	11:15:09	2
7181	99	42	1,22	cyclictest	13067	-21	ssh	10:15:16	2
7159	99	42	4,29	cyclictest	9539	-21	ssh	11:25:12	1
7147	99	42	29,8	cyclictest	16700	-21	ssh	10:35:15	0
7147	99	42	16,10	cyclictest	26751	-21	ssh	12:27:20	0
7147	99	42	15,10	cyclictest	25457	-21	ssh	10:03:05	0
7147	99	42	14,7	cyclictest	30612	-21	munin-run	10:25:01	0
7159	99	41	1,26	cyclictest	16757	-21	ssh	12:05:13	1
7147	99	41	35,3	cyclictest	12120	-21	apt-get	07:15:13	0
7147	99	41	16,10	cyclictest	2245	-21	ssh	09:31:04	0
7147	99	41	14,11	cyclictest	20802	-21	kthreadcore	07:55:21	0
7198	99	40	3,26	cyclictest	359	66	irq/58-eth0	11:50:11	3
7159	99	40	3,21	cyclictest	23939	-21	ssh	09:45:13	1
7147	99	40	15,11	cyclictest	28025	-21	ssh	11:51:48	0
7147	99	40	15,10	cyclictest	7871	-21	ssh	12:16:18	0
7147	99	40	15,10	cyclictest	13263	-21	sh	12:38:29	0
7147	99	39	16,10	cyclictest	6306	-21	ssh	11:58:50	0
7147	99	39	15,11	cyclictest	7099	-21	ssh	11:22:34	0
7147	99	39	15,11	cyclictest	7099	-21	ssh	11:22:33	0
7147	99	39	15,10	cyclictest	18538	-21	ssh	11:46:11	0
7198	99	38	2,2	cyclictest	0	-21	swapper/3	10:20:10	3
7181	99	38	1,26	cyclictest	5938	-21	ssh	12:35:13	2
7159	99	38	17,13	cyclictest	13	1	rcu_preempt	08:30:12	1
7147	99	38	16,10	cyclictest	30175	-21	ssh	11:17:15	0
7147	99	38	15,9	cyclictest	29142	-21	sh	09:45:56	0
7147	99	38	15,8	cyclictest	9426	-21	ssh	09:18:16	0
7147	99	38	15,10	cyclictest	3665	-21	rm	12:32:44	0
7147	99	38	14,8	cyclictest	25357	-21	diskmemload	11:33:31	0
7147	99	38	14,10	cyclictest	19878	-21	ssh	11:10:38	0
7147	99	38	12,8	cyclictest	16731	-21	apt-get	12:05:14	0
7147	99	37	27,7	cyclictest	23110	-21	apt-get	08:00:13	0
7147	99	37	26,9	cyclictest	20331	-21	apt-get	09:25:14	0
7147	99	37	1,32	cyclictest	25682	-21	ssh	10:40:15	0
7198	99	36	2,7	cyclictest	0	-21	swapper/3	11:35:13	3
7198	99	36	2,29	cyclictest	0	-21	swapper/3	11:55:13	3
7198	99	36	1,4	cyclictest	0	-21	swapper/3	11:20:13	3
7198	99	36	1,4	cyclictest	0	-21	swapper/3	11:20:13	3
7181	99	36	23,8	cyclictest	27	-21	ksoftirqd/2	10:20:12	2
7181	99	36	2,28	cyclictest	13944	-21	ssh	09:39:17	2
7159	99	36	1,27	cyclictest	445	-21	ssh	09:50:13	1
7147	99	36	17,15	cyclictest	0	-21	swapper/0	11:00:14	0
7147	99	36	14,8	cyclictest	0	-21	swapper/0	08:45:22	0
7147	99	36	13,7	cyclictest	0	-21	swapper/0	12:11:51	0
7147	99	36	10,10	cyclictest	31580	-21	sed	10:05:29	0
7198	99	35	2,21	cyclictest	359	66	irq/58-eth0	08:25:14	3
7198	99	35	1,2	cyclictest	0	-21	swapper/3	11:10:11	3
7181	99	35	3,24	cyclictest	0	-21	swapper/2	10:40:17	2
7181	99	35	3,18	cyclictest	27	-21	ksoftirqd/2	11:40:14	2
7181	99	35	2,28	cyclictest	28389	-21	ssh	09:29:18	2
7147	99	35	29,3	cyclictest	19532	-21	apt-get	08:30:11	0
7147	99	35	15,8	cyclictest	17256	-21	ssh	10:51:51	0
7147	99	35	14,8	cyclictest	7338	-21	ssh	09:52:53	0
7147	99	35	11,9	cyclictest	23991	-21	ssh	10:55:27	0
7147	99	35	11,9	cyclictest	23991	-21	ssh	10:55:27	0
7198	99	34	18,8	cyclictest	359	66	irq/58-eth0	12:10:13	3
7147	99	34	2,24	cyclictest	8273	-21	ps	12:00:17	0
7147	99	34	21,9	cyclictest	27813	-21	kthreadcore	07:30:23	0
7147	99	34	14,8	cyclictest	4042	-21	ssh	10:10:16	0
7198	99	33	4,21	cyclictest	0	-21	swapper/3	09:50:14	3
7198	99	33	2,7	cyclictest	359	66	irq/58-eth0	11:05:12	3
7198	99	33	1,2	cyclictest	0	-21	swapper/3	09:30:13	3
7198	99	33	1,26	cyclictest	0	-21	swapper/3	12:00:14	3
7159	99	33	3,19	cyclictest	20	1	rcuc/1	09:35:15	1
7159	99	33	11,17	cyclictest	462	-21	ssh	11:20:13	1
7159	99	33	11,17	cyclictest	462	-21	ssh	11:20:12	1
7147	99	33	12,8	cyclictest	18470	-21	ssh	10:16:13	0
7198	99	32	1,3	cyclictest	0	-21	swapper/3	11:25:13	3
7147	99	32	19,10	cyclictest	9535	-21	apt-get	11:25:12	0
7198	99	31	3,2	cyclictest	0	-21	swapper/3	10:15:14	3
7181	99	31	1,10	cyclictest	27559	-21	sh	11:35:12	2
7159	99	31	2,20	cyclictest	4094	-21	ssh	10:10:18	1
7147	99	31	26,2	cyclictest	24316	-21	apt-get	08:35:14	0
7147	99	31	26,2	cyclictest	16012	-21	apt-get	09:00:13	0
7147	99	31	25,4	cyclictest	27922	-21	apt-get	08:05:13	0
7147	99	31	25,3	cyclictest	6997	-21	apt-get	07:10:05	0
7147	99	31	21,7	cyclictest	0	-21	swapper/0	07:20:13	0
7147	99	31	18,9	cyclictest	2540	-21	fschecks_time	10:45:16	0
7147	99	31	18,9	cyclictest	10048	-21	diskstats	08:20:16	0
7147	99	31	16,10	cyclictest	0	-21	swapper/0	08:50:11	0
7198	99	30	2,3	cyclictest	0	-21	swapper/3	09:40:12	3
7198	99	30	1,19	cyclictest	359	66	irq/58-eth0	10:30:15	3
7181	99	30	3,20	cyclictest	0	-21	swapper/2	12:00:14	2
7181	99	30	2,22	cyclictest	25735	-21	ssh	12:10:13	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17