OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Mon Aug 17, 2026 00:45:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
279384	99	47	12,25	cyclictest	1161449	-21	thunderbird	22:26:44	6
277470	2	46	41,2	sleep8	0	-21	swapper/8	19:05:19	14
4189	98	44	0,43	rtkit-daemon	0	-21	swapper/1	19:08:02	1
278963	2	43	41,1	sleep13	0	-21	swapper/13	19:09:56	5
278690	2	43	40,2	sleep11	0	-21	swapper/11	19:06:26	3
279350	99	41	9,31	cyclictest	604957	-21	kworker/u32:2+events_unbound	00:11:56	8
279350	99	40	36,4	cyclictest	330137	-21	kworker/u32:2+flush-259:0	22:30:18	8
279377	99	39	37,2	cyclictest	417313	-21	kworker/u32:3+flush-259:0	22:13:53	3
278924	2	39	37,1	sleep2	0	-21	swapper/2	19:09:28	8
278901	2	39	37,1	sleep14	0	-21	swapper/14	19:09:08	6
278702	2	39	33,1	sleep4	0	-21	swapper/4	19:06:35	10
278679	2	39	37,1	sleep0	0	-21	swapper/0	19:06:15	0
277164	2	38	36,1	sleep6	0	-21	swapper/6	19:05:17	12
279363	99	37	35,2	cyclictest	404360	-21	kworker/u32:4+flush-259:0	21:35:19	13
278827	2	37	35,1	sleep3	0	-21	swapper/3	19:08:09	9
278648	2	37	34,2	sleep9	0	-21	swapper/9	19:05:52	15
279361	99	36	34,2	cyclictest	404360	-21	kworker/u32:4+flush-259:0	21:35:17	12
278855	2	36	34,1	sleep12	0	-21	swapper/12	19:08:35	4
278696	2	36	34,1	sleep15	0	-21	swapper/15	19:06:29	7
278669	2	36	33,2	sleep7	0	-21	swapper/7	19:06:06	13
279384	99	35	10,1	cyclictest	1161578	-21	IMAP	20:47:53	6
279382	99	35	0,30	cyclictest	0	-21	swapper/13	00:30:18	5
279372	99	35	33,2	cyclictest	296621	-21	kworker/u32:2+flush-259:0	19:34:52	2
279371	99	35	0,10	cyclictest	1161540	-21	WRScene~ilder#1	21:36:06	15
279356	99	35	34,1	cyclictest	295450	-21	kworker/u32:1+events_unbound	19:57:35	10
278624	2	35	33,1	sleep10	0	-21	swapper/10	19:05:37	2
279379	99	34	33,1	cyclictest	398239	-21	kworker/u32:1+events_unbound	21:55:20	4
279371	99	33	0,33	cyclictest	1161449	-21	thunderbird	23:24:31	15
279367	99	33	32,1	cyclictest	997042	-21	ThreadPoolForeg	00:20:54	14
279367	99	33	32,1	cyclictest	997042	-21	ThreadPoolForeg	00:20:54	14
279388	99	32	30,1	cyclictest	997059	-21	ThreadPoolForeg	00:20:54	7
279388	99	32	30,1	cyclictest	997059	-21	ThreadPoolForeg	00:20:54	7
279377	99	32	31,1	cyclictest	330137	-21	kworker/u32:2+events_unbound	22:35:18	3
279371	99	32	0,31	cyclictest	1161449	-21	thunderbird	20:46:44	15
279363	99	32	31,1	cyclictest	0	-21	swapper/7	22:04:59	13
279358	99	32	29,3	cyclictest	0	-21	swapper/5	23:23:13	11
279350	99	32	31,1	cyclictest	0	-21	swapper/2	23:00:26	8
279350	99	32	28,2	cyclictest	1161509	-21	Renderer	22:20:28	8
279350	99	32	0,30	cyclictest	1161542	-21	WRRende~ckend#1	21:18:58	8
279350	99	32	0,30	cyclictest	1161542	-21	WRRende~ckend#1	21:18:57	8
279350	99	32	0,30	cyclictest	1161542	-21	WRRende~ckend#1	20:20:12	8
279350	99	32	0,30	cyclictest	1161540	-21	WRScene~ilder#1	23:26:21	8
279350	99	32	0,30	cyclictest	1161449	-21	thunderbird	21:34:47	8
279350	99	32	0,30	cyclictest	0	-21	swapper/2	20:50:06	8
279350	99	32	0,29	cyclictest	353011	-21	expr	20:35:11	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	22:57:42	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	22:42:42	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	22:26:50	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	21:56:22	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	21:54:50	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	21:08:25	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	00:15:20	8
279350	99	32	0,29	cyclictest	0	-21	swapper/2	00:15:19	8
279347	99	32	30,2	cyclictest	612394	-21	kworker/u32:4+flush-259:0	00:27:03	1
278703	2	32	30,1	sleep5	0	-21	swapper/5	19:06:36	11
279388	99	31	30,1	cyclictest	0	-21	swapper/15	00:01:36	7
279384	99	31	8,11	cyclictest	0	-21	swapper/14	21:09:51	6
279384	99	31	30,1	cyclictest	1774	-21	snmpd	00:12:36	6
279382	99	31	28,3	cyclictest	1774	-21	snmpd	19:38:02	5
279382	99	31	0,30	cyclictest	0	-21	swapper/13	23:31:10	5
279382	99	31	0,30	cyclictest	0	-21	swapper/13	23:05:25	5
279382	99	31	0,30	cyclictest	0	-21	swapper/13	00:24:21	5
279382	99	31	0,30	cyclictest	0	-21	swapper/13	00:24:21	5
279382	99	31	0,30	cyclictest	0	-21	swapper/13	00:16:12	5
279382	99	31	0,30	cyclictest	0	-21	swapper/13	00:16:12	5
279379	99	31	29,2	cyclictest	349965	-21	kworker/u32:3+flush-259:0	21:20:17	4
279379	99	31	29,2	cyclictest	349965	-21	kworker/u32:3+flush-259:0	21:20:17	4
279377	99	31	29,2	cyclictest	612394	-21	kworker/u32:4+flush-259:0	00:20:16	3
279377	99	31	29,2	cyclictest	612394	-21	kworker/u32:4+flush-259:0	00:20:16	3
279377	99	31	0,30	cyclictest	0	-21	swapper/11	22:55:17	3
279377	99	31	0,30	cyclictest	0	-21	swapper/11	22:45:09	3
279377	99	31	0,30	cyclictest	0	-21	swapper/11	20:55:16	3
279372	99	31	0,30	cyclictest	0	-21	swapper/10	20:55:32	2
279371	99	31	30,1	cyclictest	0	-21	swapper/9	23:37:44	15
279371	99	31	29,2	cyclictest	0	-21	swapper/9	21:31:21	15
279367	99	31	29,2	cyclictest	540111	-21	kworker/u32:1+flush-259:0	23:53:21	14
279367	99	31	0,30	cyclictest	0	-21	swapper/8	21:10:13	14
279363	99	31	30,1	cyclictest	0	-21	swapper/7	22:33:11	13
279361	99	31	29,2	cyclictest	611431	-21	kworker/u32:3+flush-259:0	00:30:17	12
279356	99	31	28,2	cyclictest	288269	-21	kworker/u32:5+flush-259:0	19:39:22	10
279356	99	31	0,30	cyclictest	0	-21	swapper/4	21:03:23	10
279352	99	31	30,1	cyclictest	303519	-21	ethtool	19:35:14	9
279350	99	31	8,22	cyclictest	500029	-21	kworker/u32:0+events_unbound	23:16:27	8
279350	99	31	28,2	cyclictest	1161509	-21	Renderer	19:44:53	8
279350	99	31	27,2	cyclictest	782	-21	systemd-journal	20:55:11	8
279350	99	31	25,3	cyclictest	1161449	-21	thunderbird	21:03:24	8
279350	99	31	1,1	cyclictest	404360	-21	kworker/u32:4+flush-259:0	21:27:42	8
279350	99	31	1,1	cyclictest	404360	-21	kworker/u32:4+flush-259:0	21:27:41	8
279350	99	31	0,30	cyclictest	0	-21	swapper/2	20:30:04	8
279350	99	31	0,2	cyclictest	1161509	-21	Renderer	19:17:32	8
279350	99	31	0,29	cyclictest	1161449	-21	thunderbird	19:46:56	8
279350	99	31	0,28	cyclictest	0	-21	swapper/2	23:44:50	8
279350	99	31	0,28	cyclictest	0	-21	swapper/2	20:00:11	8
279350	99	31	0,28	cyclictest	0	-21	swapper/2	19:59:49	8
279350	99	31	0,28	cyclictest	0	-21	swapper/2	19:52:20	8
279350	99	31	0,28	cyclictest	0	-21	swapper/2	19:23:33	8
279350	99	31	0,18	cyclictest	209534	-1	kworker/u33:2+i915_flip	21:36:06	8
279345	99	31	29,2	cyclictest	288269	-21	kworker/u32:5+flush-259:0	20:30:17	0
279345	99	31	0,30	cyclictest	1161449	-21	thunderbird	19:56:12	0
279345	99	31	0,30	cyclictest	0	-21	swapper/0	23:29:28	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17