OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Tue Aug 04, 2026 00:45:26)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3735487	2	360	352,5	sleep10	0	-21	swapper/10	19:09:01	2
3735308	2	358	352,4	sleep15	0	-21	swapper/15	19:06:40	7
3735213	2	358	351,5	sleep6	0	-21	swapper/6	19:05:28	12
3735336	2	353	346,5	sleep5	0	-21	swapper/5	19:07:03	11
3735364	2	348	340,5	sleep7	0	-21	swapper/7	19:07:22	13
3735365	2	338	330,5	sleep8	0	-21	swapper/8	19:07:23	14
3735239	2	332	323,6	sleep14	0	-21	swapper/14	19:05:51	6
3735384	2	319	310,6	sleep9	0	-21	swapper/9	19:07:39	15
3735262	2	316	306,6	sleep12	0	-21	swapper/12	19:06:06	4
3735335	2	311	305,4	sleep4	0	-21	swapper/4	19:07:02	10
3735469	2	305	300,3	sleep11	0	-21	swapper/11	19:08:46	3
3735543	2	302	294,5	sleep3	0	-21	swapper/3	19:09:42	9
3735413	2	205	193,9	sleep0	0	-21	swapper/0	19:08:03	0
3735542	2	198	191,4	sleep2	0	-21	swapper/2	19:09:41	8
3735323	2	99	97,1	sleep13	0	-21	swapper/13	19:06:54	5
3735497	2	97	93,3	sleep1	0	-21	swapper/1	19:09:08	1
3736112	99	64	14,26	cyclictest	618598	-21	thunderbird	00:20:57	6
3736112	99	63	14,25	cyclictest	618598	-21	thunderbird	23:48:00	6
3736112	99	63	14,25	cyclictest	618598	-21	thunderbird	00:31:56	6
3736112	99	52	14,25	cyclictest	618598	-21	thunderbird	21:14:14	6
3736112	99	52	14,25	cyclictest	618598	-21	thunderbird	21:14:14	6
3736074	99	45	41,3	cyclictest	3837206	-21	kworker/u32:4+events_unbound	21:22:47	8
3736069	99	43	42,1	cyclictest	3675498	-1	kworker/u33:1+i915_flip	21:34:33	0
3736074	99	40	8,30	cyclictest	3734053	-21	kworker/u32:0+events_unbound	19:54:37	8
3736074	99	38	2,32	cyclictest	3787164	-21	kworker/u32:2+flush-259:0	20:56:05	8
3736071	99	38	36,2	cyclictest	3734053	-21	kworker/u32:0+flush-259:0	20:05:17	1
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	23:04:04	6
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	22:09:09	6
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	21:25:13	6
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	20:52:16	6
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	20:41:17	6
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	19:46:21	6
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	19:13:25	6
3736112	99	37	1,11	cyclictest	0	-21	swapper/14	00:09:58	6
3736112	99	37	0,36	cyclictest	0	-21	swapper/14	19:35:23	6
3736091	99	37	18,2	cyclictest	4019344	-21	kworker/u32:2+events_unbound	23:46:50	13
3736080	99	37	36,0	cyclictest	0	-21	swapper/4	21:10:17	10
3736080	99	37	36,0	cyclictest	0	-21	swapper/4	21:10:17	10
3736074	99	37	33,2	cyclictest	3827596	-21	kworker/u32:0+events_unbound	21:00:01	8
3736112	99	36	0,11	cyclictest	0	-21	swapper/14	22:53:05	6
3736112	99	36	0,11	cyclictest	0	-21	swapper/14	22:42:06	6
3736079	99	36	36,0	cyclictest	3675498	-1	kworker/u33:1+i915_flip	20:49:10	9
3736079	99	36	35,1	cyclictest	3929329	-21	kworker/u32:1+flush-259:0	23:00:19	9
3736074	99	36	7,27	cyclictest	3962105	-21	kworker/u32:3+flush-259:0	23:04:27	8
3736074	99	36	32,2	cyclictest	3725650	-21	kworker/u32:1+flush-259:0	19:32:09	8
3736074	99	36	30,3	cyclictest	618598	-21	thunderbird	23:44:39	8
3736071	99	36	35,1	cyclictest	3837206	-21	kworker/u32:4+events_unbound	21:50:21	1
3736112	99	35	0,10	cyclictest	0	-21	swapper/14	19:57:21	6
3736096	99	35	35,0	cyclictest	0	-21	swapper/9	19:53:23	15
3736086	99	35	32,2	cyclictest	3765799	-21	kworker/u32:3+flush-259:0	19:49:11	12
3736084	99	35	29,4	cyclictest	3693173	-1	kworker/u33:2+i915_flip	23:01:04	11
3736080	99	35	35,0	cyclictest	0	-21	swapper/4	22:44:11	10
3736074	99	35	0,32	cyclictest	618598	-21	thunderbird	20:44:35	8
3736071	99	35	34,1	cyclictest	3929329	-21	kworker/u32:1+events_unbound	22:55:13	1
3736112	99	34	9,25	cyclictest	618598	-21	thunderbird	21:47:11	6
3736112	99	34	0,9	cyclictest	0	-21	swapper/14	23:15:03	6
3736096	99	34	34,0	cyclictest	0	-21	swapper/9	23:03:51	15
3736096	99	34	34,0	cyclictest	0	-21	swapper/9	22:27:05	15
3736091	99	34	34,0	cyclictest	0	-21	swapper/7	23:43:53	13
3736079	99	34	33,1	cyclictest	0	-21	swapper/3	23:15:51	9
3736074	99	34	30,2	cyclictest	618598	-21	thunderbird	00:32:23	8
3736074	99	34	0,33	cyclictest	3765799	-21	kworker/u32:3+flush-259:0	19:43:11	8
3736071	99	34	34,0	cyclictest	0	-21	swapper/1	23:30:29	1
3736071	99	34	33,1	cyclictest	0	-21	swapper/1	21:57:51	1
3736102	99	33	0,30	cyclictest	0	-21	swapper/11	19:55:14	3
3736096	99	33	33,0	cyclictest	0	-21	swapper/9	21:57:51	15
3736096	99	33	32,1	cyclictest	3962105	-21	kworker/u32:3+events_unbound	23:10:18	15
3736091	99	33	31,2	cyclictest	3982277	-21	kworker/u32:4+flush-259:0	23:20:22	13
3736086	99	33	32,1	cyclictest	3837206	-21	kworker/u32:4+events_unbound	22:10:18	12
3736086	99	33	32,0	cyclictest	0	-21	swapper/6	21:05:00	12
3736086	99	33	32,0	cyclictest	0	-21	swapper/6	21:05:00	12
3736086	99	33	32,0	cyclictest	0	-21	swapper/6	19:17:52	12
3736080	99	33	32,1	cyclictest	3995853	-21	kworker/4:0-events_power_efficient	23:49:47	10
3736079	99	33	33,0	cyclictest	0	-21	swapper/3	22:44:11	9
3736074	99	33	29,4	cyclictest	618598	-21	thunderbird	22:48:13	8
3736074	99	33	29,4	cyclictest	618598	-21	thunderbird	21:48:22	8
3736074	99	33	27,3	cyclictest	618598	-21	thunderbird	00:09:23	8
3736074	99	33	26,4	cyclictest	618598	-21	thunderbird	20:13:59	8
3736074	99	33	0,33	cyclictest	0	-21	swapper/2	23:12:51	8
3736074	99	33	0,31	cyclictest	618598	-21	thunderbird	19:29:05	8
3736074	99	33	0,30	cyclictest	618598	-21	thunderbird	21:17:35	8
3736074	99	33	0,30	cyclictest	618598	-21	thunderbird	19:20:36	8
3736074	99	33	0,30	cyclictest	618598	-21	thunderbird	19:15:19	8
3736114	99	32	30,2	cyclictest	3982277	-21	kworker/u32:4+events_unbound	23:29:52	7
3736112	99	32	29,1	cyclictest	0	-21	swapper/14	19:29:09	6
3736112	99	32	26,3	cyclictest	678727	-21	glean.dispatche	20:45:23	6
3736104	99	32	0,31	cyclictest	0	-21	swapper/12	22:30:16	4
3736102	99	32	29,3	cyclictest	1774	-21	snmpd	19:38:21	3
3736102	99	32	0,32	cyclictest	0	-21	swapper/11	20:43:19	3
3736102	99	32	0,29	cyclictest	0	-21	swapper/11	21:30:14	3
3736098	99	32	30,1	cyclictest	4064124	-21	kworker/10:0+events	00:25:27	2
3736098	99	32	30,1	cyclictest	3964862	-21	kworker/10:1+events	22:50:03	2
3736098	99	32	29,2	cyclictest	618598	-21	thunderbird	20:30:32	2
3736098	99	32	29,1	cyclictest	3740818	-21	kworker/10:0+events	20:13:59	2
3736098	99	32	28,3	cyclictest	0	-21	swapper/10	20:45:17	2
3736098	99	32	26,6	cyclictest	1774	-21	snmpd	23:41:59	2
3736096	99	32	32,0	cyclictest	0	-21	swapper/9	21:51:07	15
3736096	99	32	31,1	cyclictest	3717258	-21	kworker/u32:3+events_unbound	19:10:19	15
3736091	99	32	32,0	cyclictest	0	-21	swapper/7	22:44:11	13
3736084	99	32	31,1	cyclictest	3787164	-21	kworker/u32:2+events_unbound	20:50:20	11
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17