OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Fri Jul 31, 2026 00:45:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
311296	2	367	359,5	sleep14	0	-21	swapper/14	19:08:46	6
311296	2	367	359,5	sleep14	0	-21	swapper/14	19:08:45	6
311371	2	366	359,4	sleep2	0	-21	swapper/2	19:09:37	8
311371	2	366	359,4	sleep2	0	-21	swapper/2	19:09:37	8
311082	2	363	355,5	sleep6	0	-21	swapper/6	19:06:29	12
311082	2	363	355,5	sleep6	0	-21	swapper/6	19:06:28	12
311361	2	358	350,5	sleep9	0	-21	swapper/9	19:09:28	15
311361	2	358	350,5	sleep9	0	-21	swapper/9	19:09:28	15
311317	2	356	349,5	sleep13	0	-21	swapper/13	19:09:01	5
311317	2	356	349,5	sleep13	0	-21	swapper/13	19:09:00	5
311255	2	356	348,5	sleep15	0	-21	swapper/15	19:08:15	7
311255	2	356	348,5	sleep15	0	-21	swapper/15	19:08:14	7
311336	2	354	349,3	sleep5	0	-21	swapper/5	19:09:09	11
311336	2	354	349,3	sleep5	0	-21	swapper/5	19:09:08	11
311315	2	354	347,5	sleep12	0	-21	swapper/12	19:08:59	4
311315	2	354	347,5	sleep12	0	-21	swapper/12	19:08:59	4
311313	2	336	330,4	sleep11	0	-21	swapper/11	19:08:59	3
311313	2	336	330,4	sleep11	0	-21	swapper/11	19:08:58	3
311080	2	334	327,5	sleep4	0	-21	swapper/4	19:06:26	10
311080	2	334	327,5	sleep4	0	-21	swapper/4	19:06:26	10
311266	2	319	310,6	sleep7	0	-21	swapper/7	19:08:23	13
311266	2	319	310,6	sleep7	0	-21	swapper/7	19:08:22	13
311328	2	318	310,5	sleep3	0	-21	swapper/3	19:09:06	9
311328	2	318	310,5	sleep3	0	-21	swapper/3	19:09:06	9
311126	2	294	286,5	sleep10	0	-21	swapper/10	19:07:06	2
311126	2	294	286,5	sleep10	0	-21	swapper/10	19:07:05	2
311370	2	187	180,4	sleep1	0	-21	swapper/1	19:09:37	1
311370	2	187	180,4	sleep1	0	-21	swapper/1	19:09:36	1
311377	2	130	122,5	sleep8	0	-21	swapper/8	19:09:43	14
311377	2	130	122,5	sleep8	0	-21	swapper/8	19:09:43	14
311352	2	89	87,1	sleep0	0	-21	swapper/0	19:09:19	0
311352	2	89	87,1	sleep0	0	-21	swapper/0	19:09:19	0
311867	99	56	51,2	cyclictest	0	-21	swapper/14	20:45:25	6
311853	99	54	52,1	cyclictest	259670	-1	kworker/u33:0+i915_flip	19:20:22	14
311827	99	54	3,39	cyclictest	3578	-21	gnome-shell	19:20:23	0
311863	99	52	52,0	cyclictest	298514	-1	kworker/u33:1+i915_flip	00:31:11	3
311867	99	48	0,23	cyclictest	0	-21	swapper/14	19:29:08	6
311833	99	42	39,3	cyclictest	396199	-21	kworker/u32:5+events_unbound	20:46:40	8
311867	99	41	5,11	cyclictest	0	-21	swapper/14	21:40:56	6
311833	99	41	37,2	cyclictest	354238	-21	kworker/u32:3+events_unbound	20:05:25	8
311849	99	38	34,4	cyclictest	674348	-21	kworker/u32:1+events_unbound	00:34:54	13
311839	99	38	28,10	cyclictest	1774	-21	snmpd	23:58:04	10
311837	99	37	36,1	cyclictest	533811	-21	kworker/u32:1+events_unbound	22:55:21	9
311867	99	36	0,25	cyclictest	0	-21	swapper/14	22:02:55	6
311867	99	36	0,25	cyclictest	0	-21	swapper/14	22:02:54	6
311864	99	36	36,0	cyclictest	298514	-1	kworker/u33:1+i915_flip	00:04:22	4
311833	99	36	3,32	cyclictest	566196	-21	kworker/u32:0+events_unbound	23:44:26	8
311833	99	36	32,3	cyclictest	533811	-21	kworker/u32:1+flush-259:0	22:49:10	8
311827	99	36	35,1	cyclictest	0	-21	swapper/0	22:15:27	0
311867	99	35	0,23	cyclictest	0	-21	swapper/14	21:18:58	6
311867	99	35	0,22	cyclictest	0	-21	swapper/14	21:51:55	6
311849	99	35	33,2	cyclictest	411813	-21	kworker/u32:0+events_unbound	21:15:20	13
311837	99	35	34,1	cyclictest	467361	-21	kworker/u32:1+events_unbound	22:20:17	9
311833	99	35	3,30	cyclictest	267836	-21	kworker/u32:0+flush-259:0	19:17:15	8
311833	99	35	31,3	cyclictest	329042	-21	kworker/u32:4+events_unbound	19:42:39	8
311833	99	35	31,3	cyclictest	267836	-21	kworker/u32:0+events_unbound	19:12:48	8
311833	99	35	31,3	cyclictest	267836	-21	kworker/u32:0+events_unbound	19:12:47	8
311830	99	35	0,35	cyclictest	0	-21	swapper/1	21:15:17	1
311827	99	35	30,1	cyclictest	1774	-21	snmpd	23:23:09	0
311849	99	34	33,1	cyclictest	298514	-1	kworker/u33:1+i915_flip	00:05:09	13
311849	99	34	31,2	cyclictest	467361	-21	kworker/u32:1+events_unbound	22:29:45	13
311837	99	34	33,1	cyclictest	418388	-21	kworker/u32:3+flush-259:0	21:40:22	9
311833	99	34	3,2	cyclictest	551806	-21	kworker/u32:2+flush-259:0	22:59:50	8
311833	99	34	30,3	cyclictest	369844	-21	kworker/u32:0+events_unbound	20:28:09	8
311833	99	34	0,33	cyclictest	544371	-21	/usr/sbin/munin	22:50:19	8
311833	99	34	0,31	cyclictest	630032	-21	ssh	23:58:04	8
311833	99	34	0,31	cyclictest	618598	-21	thunderbird	22:07:12	8
311833	99	34	0,31	cyclictest	618598	-21	thunderbird	22:07:11	8
311867	99	33	0,32	cyclictest	0	-21	swapper/14	22:43:20	6
311849	99	33	31,1	cyclictest	551806	-21	kworker/u32:2+flush-259:0	23:00:31	13
311839	99	33	0,32	cyclictest	0	-21	swapper/4	22:21:19	10
311833	99	33	29,4	cyclictest	618598	-21	thunderbird	19:36:13	8
311833	99	33	29,2	cyclictest	305644	-21	kworker/u32:2+flush-259:0	19:29:19	8
311833	99	33	29,1	cyclictest	618598	-21	thunderbird	22:43:16	8
311833	99	33	28,5	cyclictest	618598	-21	thunderbird	21:22:16	8
311833	99	33	1,32	cyclictest	448172	-21	kworker/u32:1+flush-259:0	21:38:46	8
311833	99	33	0,30	cyclictest	618598	-21	thunderbird	20:14:50	8
311833	99	33	0,30	cyclictest	618598	-21	thunderbird	19:50:39	8
311827	99	33	29,1	cyclictest	0	-21	swapper/0	19:53:53	0
311867	99	32	7,25	cyclictest	618598	-21	thunderbird	00:36:39	6
311864	99	32	29,2	cyclictest	618698	-21	WRScene~ilder#1	21:46:49	4
311859	99	32	30,2	cyclictest	460967	-21	kworker/10:1+events	23:23:39	2
311853	99	32	30,1	cyclictest	428630	-21	mii-tool	21:20:15	14
311853	99	32	0,29	cyclictest	0	-21	swapper/8	19:10:14	14
311853	99	32	0,29	cyclictest	0	-21	swapper/8	19:10:14	14
311849	99	32	32,0	cyclictest	0	-21	swapper/7	22:13:34	13
311849	99	32	32,0	cyclictest	0	-21	swapper/7	22:08:48	13
311849	99	32	32,0	cyclictest	0	-21	swapper/7	22:08:47	13
311849	99	32	31,1	cyclictest	654381	-21	kworker/u32:0+flush-259:0	00:20:16	13
311847	99	32	31,1	cyclictest	0	-21	swapper/6	21:31:09	12
311843	99	32	0,30	cyclictest	0	-21	swapper/5	19:55:11	11
311843	99	32	0,1	cyclictest	0	-21	swapper/5	22:43:16	11
311839	99	32	28,4	cyclictest	1774	-21	snmpd	19:22:35	10
311839	99	32	24,8	cyclictest	417604	-21	ssh	21:10:51	10
311839	99	32	0,0	cyclictest	0	-21	swapper/4	23:00:19	10
311837	99	32	32,0	cyclictest	0	-21	swapper/3	21:34:51	9
311837	99	32	31,1	cyclictest	654381	-21	kworker/u32:0+flush-259:0	00:30:16	9
311833	99	32	27,2	cyclictest	618598	-21	thunderbird	23:07:16	8
311833	99	32	26,3	cyclictest	618598	-21	thunderbird	21:34:31	8
311833	99	32	1,31	cyclictest	354238	-21	kworker/u32:3+events_unbound	19:59:44	8
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17