OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack3slot5s.osadl.org (updated Fri Apr 26, 2024 00:43:29)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
13604	99	150	142	cyclictest	0	-21	swapper/1	22:05:54	1
13604	99	148	140	cyclictest	0	-21	swapper/1	19:11:42	1
10204	2	121	0	sleep0	9456	50	irq/30-eth0_g0_	21:14:11	0
12	1	116	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	00:11:05	1
12	1	115	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	20:53:34	1
32203	2	111	0	sleep1	9455	50	irq/29-eth0_g0_	22:45:49	1
12	1	103	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	21:14:58	1
12	1	98	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:06:53	1
12	1	97	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	20:41:47	1
12	1	87	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	21:59:46	0
12	1	87	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	20:44:22	1
12	1	80	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	00:17:57	0
12	1	66	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:27:11	0
18066	2	63	0	chrt	9455	50	irq/29-eth0_g0_	23:59:54	0
3537	2	62	0	sleep1	9455	50	irq/29-eth0_g0_	23:01:46	1
12	1	62	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	22:28:25	0
12	1	62	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	22:28:25	0
12	1	61	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	23:14:35	1
12	1	57	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:19:25	1
12	1	54	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:24:34	1
9456	50	53	0	irq/30-eth0_g0_	13604	99	cyclictest	22:36:05	1
9456	50	53	0	irq/30-eth0_g0_	13604	99	cyclictest	22:36:05	1
26616	2	53	0	sleep1	9456	50	irq/30-eth0_g0_	00:35:06	1
24946	2	53	0	sleep0	9455	50	irq/29-eth0_g0_	22:15:35	0
12	1	53	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	22:19:33	1
12	1	53	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:34:35	0
12	1	52	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:09:27	1
12	1	52	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	00:29:34	0
12	1	52	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	00:24:26	1
12	1	51	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:59:11	1
12	1	51	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:39:24	0
12	1	51	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	19:15:41	1
12	1	51	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	00:23:37	1
12	1	50	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:43:55	1
12	1	50	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:36:09	1
12	1	49	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:54:51	1
12	1	49	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:00:15	1
12	1	49	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:19:19	1
12	1	49	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:10:12	1
12	1	49	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	20:29:07	1
9455	50	48	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	19:04:33	0
25122	2	48	0	sleep1	9455	50	irq/29-eth0_g0_	22:17:39	1
12	1	48	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:59:35	1
12	1	48	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:48:39	0
12	1	48	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	21:31:25	1
12	1	47	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:38:59	1
12	1	47	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:31:40	1
12	1	47	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:24:57	1
12	1	47	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:24:57	1
12	1	47	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	19:54:57	1
12	1	47	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	00:21:01	0
12	1	47	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	23:09:21	1
12	1	47	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:55:48	1
12	1	47	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	00:29:37	1
12	1	46	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	21:49:27	1
12	1	46	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	21:19:23	0
12	1	46	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	20:30:32	0
12	1	46	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:39:43	1
12	1	46	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	00:06:42	1
12	1	45	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:52:30	1
12	1	45	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:42:41	1
12	1	45	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:42:41	1
12	1	45	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:31:54	0
12	1	45	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:31:54	0
12	1	45	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	21:49:30	0
12	1	45	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	22:29:50	1
12	1	45	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	22:29:50	1
12	1	45	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:28:02	1
9455	50	44	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:04:21	0
12	1	44	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:29:31	0
12	1	44	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:04:10	0
12	1	44	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	23:46:58	0
12	1	44	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	21:48:21	1
9455	50	43	0	irq/29-eth0_g0_	1845	-21	runrttasks	21:55:33	0
9455	50	43	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	00:13:48	0
12	1	43	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	22:51:34	0
12	1	42	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	23:40:48	0
9455	50	41	0	irq/29-eth0_g0_	12895	-21	taskset	19:04:31	1
9455	50	41	0	irq/29-eth0_g0_	12	1	ksoftirqd/1	21:15:11	0
13604	99	41	1	cyclictest	7472	-21	unixbench_singl	20:59:39	1
13604	99	41	1	cyclictest	550	-21	latency_hist	20:34:14	1
12	1	41	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	00:14:37	1
12	1	41	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	22:40:11	0
12	1	41	0	ksoftirqd/1	9455	50	irq/29-eth0_g0_	22:40:11	0
13604	99	40	34	cyclictest	16221	-21	/usr/sbin/munin	19:19:29	1
12	1	40	0	ksoftirqd/1	9456	50	irq/30-eth0_g0_	23:52:42	0
12	1	40	0	ksoftirqd/1	13604	99	cyclictest	21:09:15	1
9455	50	39	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	00:34:26	0
9455	50	39	0	irq/29-eth0_g0_	1845	-21	runrttasks	22:35:41	0
9455	50	39	0	irq/29-eth0_g0_	1845	-21	runrttasks	22:35:41	0
9455	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:36:01	0
9455	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:23:56	0
9455	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:23:31	0
9455	50	39	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:08:52	0
13604	99	39	1	cyclictest	29687	-21	iostat	20:19:27	1
13604	99	39	1	cyclictest	25759	-21	ls	20:04:14	1
13604	99	39	1	cyclictest	19868	-21	unixbench_singl	19:34:34	1
9455	50	38	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	23:19:06	0
9455	50	38	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	21:27:15	0
9455	50	38	0	irq/29-eth0_g0_	23700	-21	latency	00:24:33	0
9455	50	38	0	irq/29-eth0_g0_	1845	-21	runrttasks	20:14:10	0
9455	50	38	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:56:23	0
9455	50	38	0	irq/29-eth0_g0_	13	-21	kworker/0:1	23:09:37	0
9455	50	38	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:11:28	0
9455	50	38	0	irq/29-eth0_g0_	0	-21	swapper/0	21:29:26	0
13604	99	38	3	cyclictest	28141	-21	munin-run	20:14:14	1
13604	99	38	2	cyclictest	420	-21	memory	22:49:31	1
13604	99	38	1	cyclictest	675	-21	df_abs	20:34:25	1
13604	99	38	1	cyclictest	28842	-21	timerandwakeup	20:14:40	1
13604	99	38	1	cyclictest	17835	-21	vmstat	19:24:37	1
9455	50	37	0	irq/29-eth0_g0_	29927	-21	proc_pri	20:19:35	0
9455	50	37	0	irq/29-eth0_g0_	26954	-21	latency_hist	20:09:14	0
9455	50	37	0	irq/29-eth0_g0_	1845	-21	runrttasks	20:43:16	0
9455	50	37	0	irq/29-eth0_g0_	1845	-21	runrttasks	00:06:06	0
9455	50	37	0	irq/29-eth0_g0_	13854	-21	/usr/sbin/munin	19:09:27	0
9455	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	22:56:09	0
9455	50	37	0	irq/29-eth0_g0_	13	-21	kworker/0:1	21:44:22	0
9455	50	37	0	irq/29-eth0_g0_	0	-21	swapper/0	20:59:36	0
13604	99	37	2	cyclictest	6071	-21	sendmail_mailqu	20:54:37	1
13604	99	37	1	cyclictest	2478	-21	lldpd	19:32:45	1
12	1	37	0	ksoftirqd/1	13604	99	cyclictest	23:44:32	1
12	1	37	0	ksoftirqd/1	13604	99	cyclictest	19:44:42	1
9455	50	36	0	irq/29-eth0_g0_	3615	-21	find	20:44:36	0
9455	50	36	0	irq/29-eth0_g0_	30687	-21	df	20:24:25	0
9455	50	36	0	irq/29-eth0_g0_	23477	-21	df_abs	19:54:36	0
9455	50	36	0	irq/29-eth0_g0_	22668	-21	proc_pri	19:49:38	0
13604	99	36	1	cyclictest	22465	-21	latency	19:49:33	1
9455	50	35	0	irq/29-eth0_g0_	8532	-21	timerandwakeup	21:04:34	0
9455	50	35	0	irq/29-eth0_g0_	3	1	ksoftirqd/0	19:34:26	0
9455	50	35	0	irq/29-eth0_g0_	29378	-21	latency_hist	20:19:14	0
9455	50	35	0	irq/29-eth0_g0_	1845	-21	runrttasks	20:56:17	0
9455	50	35	0	irq/29-eth0_g0_	17772	-21	grep	19:24:36	0
12	1	35	0	ksoftirqd/1	13604	99	cyclictest	20:04:29	1
12	1	35	0	ksoftirqd/1	13604	99	cyclictest	19:41:15	1
9455	50	34	0	irq/29-eth0_g0_	24744	-21	df_inode	19:59:27	0
9455	50	34	0	irq/29-eth0_g0_	18578	-21	cat	19:29:26	0
9455	50	34	0	irq/29-eth0_g0_	16971	-21	sshd	19:23:13	0
9455	50	34	0	irq/29-eth0_g0_	0	-21	swapper/0	19:43:13	0
9455	50	33	0	irq/29-eth0_g0_	4848	-21	sendmail_mailqu	20:49:36	0
9455	50	33	0	irq/29-eth0_g0_	21108	-21	sed	19:44:30	0
9455	50	33	0	irq/29-eth0_g0_	15484	-21	runrttasks	19:15:11	0
9455	50	33	0	irq/29-eth0_g0_	1172	-21	/usr/sbin/munin	20:34:38	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17