OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Tue Jul 14, 2026 00:46:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1104482	2	372	366,4	sleep14	0	-21	swapper/14	19:08:02	6
1104598	2	365	358,5	sleep10	0	-21	swapper/10	19:09:35	2
1104446	2	365	346,11	sleep13	0	-21	swapper/13	19:07:29	5
1104459	2	361	321,14	sleep9	0	-21	swapper/9	19:07:40	15
1104465	2	360	316,14	sleep15	0	-21	swapper/15	19:07:47	7
1104344	2	359	340,12	sleep7	0	-21	swapper/7	19:06:19	13
1104522	2	354	333,14	sleep12	0	-21	swapper/12	19:08:33	4
1104489	2	353	334,13	sleep4	0	-21	swapper/4	19:08:08	10
1104545	2	350	331,12	sleep1	0	-21	swapper/1	19:08:53	1
1104339	2	349	329,13	sleep2	0	-21	swapper/2	19:06:13	8
1104515	2	348	327,13	sleep5	0	-21	swapper/5	19:08:26	11
1104361	2	348	328,13	sleep3	0	-21	swapper/3	19:06:31	9
1104320	2	348	329,12	sleep8	0	-21	swapper/8	19:06:04	14
1104502	2	347	328,12	sleep11	0	-21	swapper/11	19:08:16	3
1104533	2	345	325,13	sleep6	0	-21	swapper/6	19:08:43	12
1104605	2	343	323,13	sleep0	0	-21	swapper/0	19:09:41	0
1104965	99	79	76,2	cyclictest	1118337	-21	kworker/u32:1+flush-259:0	20:00:19	1
1104986	99	63	62,1	cyclictest	1350271	-21	kworker/u32:4+flush-259:0	23:07:12	13
1104998	99	57	56,1	cyclictest	1357655	-21	kworker/u32:6+events_unbound	23:17:40	3
1104996	99	57	56,1	cyclictest	1365694	-21	kworker/u32:1+flush-259:0	00:17:35	2
1104971	99	55	52,2	cyclictest	1154866	-21	kworker/u32:0+flush-259:0	20:54:04	8
1104984	99	54	53,1	cyclictest	1389621	-21	kworker/u32:2+events_unbound	23:53:31	12
1105002	99	50	50,0	cyclictest	1337524	-21	kworker/u32:3+flush-259:0	22:59:31	4
1104991	99	50	49,1	cyclictest	1237300	-21	kworker/u32:5+events_unbound	22:11:07	14
1104977	99	50	48,2	cyclictest	1410737	-21	kworker/u32:0+flush-259:0	23:54:33	10
1104998	99	49	47,1	cyclictest	1372342	-21	kworker/u32:4+flush-259:0	23:37:17	3
1104961	99	48	45,3	cyclictest	1215620	-21	kworker/u32:3+events_unbound	21:30:09	0
1104996	99	46	45,1	cyclictest	0	-21	swapper/10	22:41:39	2
1104986	99	46	45,1	cyclictest	1205901	-21	kworker/u32:0+flush-259:0	21:20:19	13
1104981	99	46	42,3	cyclictest	1365694	-21	kworker/u32:1+events_unbound	00:21:40	11
1105005	99	45	14,30	cyclictest	0	-21	swapper/13	19:10:02	5
1104991	99	45	45,0	cyclictest	0	-21	swapper/8	20:14:01	14
1104971	99	45	11,33	cyclictest	1443654	-21	kworker/u32:5+flush-259:0	00:39:21	8
1104965	99	45	44,1	cyclictest	1114004	-21	kworker/u32:3+events_unbound	19:22:09	1
1104971	99	44	42,1	cyclictest	1357655	-21	kworker/u32:6+flush-259:0	23:18:44	8
1104965	99	44	40,2	cyclictest	0	-21	swapper/1	23:17:58	1
1104965	99	42	41,1	cyclictest	1189076	-21	kworker/u32:1+events_unbound	21:45:31	1
1105005	99	39	38,1	cyclictest	1118337	-21	kworker/u32:1+events_unbound	20:15:55	5
1104971	99	39	38,1	cyclictest	1197414	-21	kworker/u32:3+flush-259:0	20:57:16	8
1105012	99	38	37,1	cyclictest	1147281	-21	kworker/u32:3+flush-259:0	20:13:07	7
1105002	99	38	37,1	cyclictest	1423452	-21	kworker/u32:3+events_unbound	00:31:55	4
1104993	99	38	35,2	cyclictest	1285669	-21	kworker/u32:1+flush-259:0	22:30:04	15
1104993	99	38	35,2	cyclictest	1285669	-21	kworker/u32:1+flush-259:0	22:30:04	15
1104984	99	38	35,2	cyclictest	1317968	-21	kworker/u32:0+flush-259:0	22:55:02	12
1104977	99	38	37,1	cyclictest	0	-21	swapper/4	00:27:56	10
1104971	99	38	34,2	cyclictest	1205901	-21	kworker/u32:0+events_unbound	21:23:03	8
1104971	99	38	0,38	cyclictest	3578	-21	gnome-shell	20:13:07	8
1104981	99	37	35,2	cyclictest	1189076	-21	kworker/u32:1+flush-259:0	20:52:48	11
1104965	99	37	37,0	cyclictest	0	-21	swapper/1	00:04:48	1
1104965	99	37	36,1	cyclictest	1154866	-21	kworker/u32:0+events_unbound	20:18:27	1
1105007	99	36	35,1	cyclictest	1189076	-21	kworker/u32:1+flush-259:0	21:18:24	6
1104986	99	36	35,1	cyclictest	1096005	-21	kworker/u32:2+events_unbound	20:03:07	13
1104965	99	36	36,0	cyclictest	0	-21	swapper/1	20:12:25	1
1104965	99	36	35,1	cyclictest	0	-21	swapper/1	22:55:37	1
1104996	99	35	32,1	cyclictest	0	-21	swapper/10	19:36:46	2
1104996	99	35	32,1	cyclictest	0	-21	swapper/10	19:36:46	2
1104977	99	35	35,0	cyclictest	0	-21	swapper/4	19:36:45	10
1104977	99	35	35,0	cyclictest	0	-21	swapper/4	19:36:45	10
1104965	99	35	35,0	cyclictest	0	-21	swapper/1	23:50:52	1
1104965	99	35	35,0	cyclictest	0	-21	swapper/1	20:35:11	1
1104996	99	34	31,1	cyclictest	1075040	-21	kworker/10:1+events	21:16:09	2
1104991	99	34	32,1	cyclictest	1040462	-21	kworker/u32:1+flush-259:0	19:10:19	14
1104977	99	34	34,0	cyclictest	0	-21	swapper/4	00:37:55	10
1104977	99	34	0,3	cyclictest	61	-21	ksoftirqd/4	00:30:23	10
1104971	99	34	28,3	cyclictest	3578	-21	gnome-shell	22:16:34	8
1104971	99	34	0,32	cyclictest	3318	-21	Xorg	20:18:33	8
1104965	99	34	33,1	cyclictest	1176837	-21	kworker/u32:2+flush-259:0	20:50:14	1
1104965	99	34	33,1	cyclictest	0	-21	swapper/1	00:36:53	1
1104961	99	34	32,2	cyclictest	1179282	-21	kworker/u32:3+events_unbound	20:35:24	0
1105007	99	33	0,31	cyclictest	3578	-21	gnome-shell	23:17:40	6
1104996	99	33	30,1	cyclictest	1436262	-21	kworker/10:2+events	00:20:09	2
1104977	99	33	31,1	cyclictest	0	-21	swapper/4	19:33:41	10
1104977	99	33	31,1	cyclictest	0	-21	swapper/4	19:33:41	10
1104971	99	33	30,2	cyclictest	1100264	-21	kworker/u32:0+events_unbound	19:37:31	8
1104971	99	33	30,2	cyclictest	1100264	-21	kworker/u32:0+events_unbound	19:37:31	8
1104971	99	33	0,32	cyclictest	3578	-21	gnome-shell	19:12:09	8
1104971	99	33	0,30	cyclictest	3578	-21	gnome-shell	22:30:33	8
1104971	99	33	0,30	cyclictest	3578	-21	gnome-shell	22:30:33	8
1104971	99	33	0,30	cyclictest	3578	-21	gnome-shell	22:12:57	8
1104971	99	33	0,30	cyclictest	3578	-21	gnome-shell	19:26:57	8
1104971	99	33	0,30	cyclictest	3578	-21	gnome-shell	19:26:56	8
1104971	99	33	0,30	cyclictest	0	-21	swapper/2	21:35:51	8
1104971	99	33	0,30	cyclictest	0	-21	swapper/2	00:06:43	8
1104965	99	33	33,0	cyclictest	0	-21	swapper/1	22:09:03	1
1104965	99	33	33,0	cyclictest	0	-21	swapper/1	21:53:03	1
1104965	99	33	33,0	cyclictest	0	-21	swapper/1	20:20:21	1
1104965	99	33	33,0	cyclictest	0	-21	swapper/1	20:05:27	1
1104996	99	32	31,1	cyclictest	1277646	-21	kworker/10:0+events	22:34:10	2
1104996	99	32	31,1	cyclictest	1277646	-21	kworker/10:0+events	22:34:09	2
1104977	99	32	32,0	cyclictest	0	-21	swapper/4	22:11:49	10
1104977	99	32	32,0	cyclictest	0	-21	swapper/4	19:58:05	10
1104977	99	32	1,30	cyclictest	60	1	ktimers/4	21:28:21	10
1104975	99	32	23,8	cyclictest	0	-21	swapper/3	23:30:14	9
1104975	99	32	0,32	cyclictest	0	-21	swapper/3	23:18:04	9
1104971	99	32	29,3	cyclictest	1308564	-21	kworker/u32:4+events_unbound	22:47:00	8
1104971	99	32	29,3	cyclictest	1279810	-21	ntpq	22:05:19	8
1104971	99	32	0,30	cyclictest	3578	-21	gnome-shell	23:50:57	8
1104971	99	32	0,30	cyclictest	3578	-21	gnome-shell	21:45:45	8
1104971	99	32	0,29	cyclictest	0	-21	swapper/2	23:57:15	8
1104971	99	32	0,29	cyclictest	0	-21	swapper/2	23:48:45	8
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17