OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Fri Feb 06, 2026 00:45:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1646637	2	85	65,19	sleep9	0	-21	swapper/9	19:07:29	15
1646766	2	53	51,1	sleep7	0	-21	swapper/7	19:09:04	13
1646556	2	52	50,1	sleep13	0	-21	swapper/13	19:06:29	5
1646630	2	51	49,1	sleep4	0	-21	swapper/4	19:07:24	10
1647367	99	48	44,3	cyclictest	1599766	-21	kworker/u32:0+events_unbound	19:20:19	8
4189	98	47	0,45	rtkit-daemon	0	-21	swapper/2	19:08:08	8
1646505	2	44	42,1	sleep11	0	-21	swapper/11	19:05:55	3
1647367	99	42	39,1	cyclictest	1822280	-21	kworker/u32:2+events_unbound	22:13:49	8
1647388	99	41	39,2	cyclictest	1793837	-21	kworker/u32:4+flush-259:0	22:25:15	15
1647388	99	41	39,1	cyclictest	1701280	-21	kworker/u32:1+events_unbound	20:45:19	15
1647388	99	40	40,0	cyclictest	0	-21	swapper/9	20:29:29	15
1646773	2	40	38,1	sleep12	0	-21	swapper/12	19:09:09	4
1646523	2	40	38,1	sleep5	0	-21	swapper/5	19:06:05	11
1646634	2	39	37,1	sleep8	0	-21	swapper/8	19:07:28	14
1647367	99	38	33,3	cyclictest	1887457	-21	kworker/u32:0+flush-259:0	00:03:53	8
1647367	99	38	33,3	cyclictest	1887457	-21	kworker/u32:0+flush-259:0	00:03:53	8
1647399	99	37	12,16	cyclictest	1984142	-21	kworker/u32:4+events_unbound	00:11:18	5
1647388	99	37	34,1	cyclictest	0	-21	swapper/9	23:00:01	15
1647367	99	37	34,1	cyclictest	1736458	-21	kworker/u32:3+events_unbound	22:02:25	8
1647367	99	37	33,3	cyclictest	1887457	-21	kworker/u32:0+events_unbound	23:30:37	8
1647367	99	37	31,3	cyclictest	1736458	-21	kworker/u32:3+flush-259:0	21:17:29	8
1647367	99	36	3,33	cyclictest	1844608	-21	kworker/u32:3+events_unbound	22:22:21	8
1647367	99	36	32,3	cyclictest	1688597	-21	kworker/u32:0+flush-259:0	20:10:17	8
1646778	2	36	34,1	sleep15	0	-21	swapper/15	19:09:11	7
1646491	2	36	34,1	sleep0	0	-21	swapper/0	19:05:44	0
1643337	2	36	33,2	sleep6	0	-21	swapper/6	19:05:02	12
1647390	99	35	33,2	cyclictest	1887457	-21	kworker/u32:0+flush-259:0	00:05:17	2
1647390	99	35	33,2	cyclictest	1887457	-21	kworker/u32:0+flush-259:0	00:05:17	2
1647367	99	35	30,4	cyclictest	1736458	-21	kworker/u32:3+events_unbound	21:55:19	8
1646821	2	35	33,1	sleep3	0	-21	swapper/3	19:09:48	9
1646815	2	35	32,2	sleep14	0	-21	swapper/14	19:09:42	6
1646551	2	35	33,1	sleep10	0	-21	swapper/10	19:06:26	2
1647401	99	34	8,25	cyclictest	0	-21	swapper/14	20:50:04	6
1647381	99	34	0,28	cyclictest	0	-21	swapper/7	19:35:13	13
1647374	99	34	28,4	cyclictest	70	-21	ksoftirqd/5	22:37:29	11
1647367	99	34	30,4	cyclictest	1617353	-21	thunderbird	23:06:05	8
1647367	99	34	28,3	cyclictest	782	-21	systemd-journal	21:34:47	8
1647367	99	34	28,3	cyclictest	1617353	-21	thunderbird	23:59:46	8
1647367	99	34	28,3	cyclictest	1617353	-21	thunderbird	23:59:45	8
1647367	99	34	28,3	cyclictest	1617353	-21	thunderbird	20:39:41	8
1647367	99	34	27,6	cyclictest	1215525	-21	Renderer	20:41:35	8
1647367	99	34	27,4	cyclictest	3318	-21	Xorg	00:35:23	8
1647367	99	34	2,32	cyclictest	1706611	-21	kworker/u32:2+events_unbound	20:17:11	8
1647362	99	34	32,2	cyclictest	1684409	-21	kworker/u32:2+flush-259:0	19:52:16	1
1646648	2	34	32,1	sleep1	0	-21	swapper/1	19:07:37	1
1647388	99	33	33,0	cyclictest	0	-21	swapper/9	00:39:41	15
1647388	99	33	33,0	cyclictest	0	-21	swapper/9	00:11:17	15
1647367	99	33	3,1	cyclictest	1920370	-21	kworker/u32:3+events_unbound	23:36:17	8
1647367	99	33	29,4	cyclictest	1617353	-21	thunderbird	21:48:47	8
1647367	99	33	29,4	cyclictest	1617353	-21	thunderbird	20:00:43	8
1647367	99	33	29,4	cyclictest	1617353	-21	thunderbird	19:33:49	8
1647367	99	33	29,4	cyclictest	1220421	-21	Isolated	12:05:31	8
1647367	99	33	28,3	cyclictest	782	-21	systemd-journal	22:05:21	8
1647367	99	33	27,3	cyclictest	1617353	-21	thunderbird	23:42:19	8
1647367	99	33	27,3	cyclictest	1617353	-21	thunderbird	22:32:27	8
1647367	99	33	27,3	cyclictest	1617353	-21	thunderbird	20:48:53	8
1647367	99	33	27,3	cyclictest	1617353	-21	thunderbird	19:49:31	8
1647367	99	33	0,30	cyclictest	0	-21	swapper/2	22:17:41	8
1647388	99	32	32,0	cyclictest	0	-21	swapper/9	23:55:41	15
1647388	99	32	32,0	cyclictest	0	-21	swapper/9	23:55:41	15
1647388	99	32	32,0	cyclictest	0	-21	swapper/9	21:47:47	15
1647388	99	32	32,0	cyclictest	0	-21	swapper/9	19:36:03	15
1647388	99	32	32,0	cyclictest	0	-21	swapper/9	00:29:19	15
1647374	99	32	30,2	cyclictest	1920370	-21	kworker/u32:3+events_unbound	23:26:19	11
1647372	99	32	31,1	cyclictest	0	-21	swapper/4	23:51:51	10
1647367	99	32	28,1	cyclictest	1617353	-21	thunderbird	19:25:41	8
1647367	99	32	28,1	cyclictest	1617353	-21	thunderbird	00:06:54	8
1647367	99	32	28,1	cyclictest	1617353	-21	thunderbird	00:06:53	8
1647367	99	32	27,4	cyclictest	3318	-21	Xorg	23:45:39	8
1647367	99	32	27,4	cyclictest	1220421	-21	Isolated	12:05:31	8
1647367	99	32	26,4	cyclictest	0	-21	swapper/2	21:03:55	8
1647367	99	32	26,3	cyclictest	1617353	-21	thunderbird	23:25:17	8
1647367	99	32	26,3	cyclictest	1617353	-21	thunderbird	22:54:31	8
1647367	99	32	26,3	cyclictest	1617353	-21	thunderbird	20:26:53	8
1647367	99	32	26,3	cyclictest	1220421	-21	Isolated	12:05:31	8
1647367	99	32	0,31	cyclictest	1787303	-21	ssh	21:38:15	8
1647367	99	32	0,31	cyclictest	0	-21	swapper/2	22:37:31	8
1647367	99	32	0,30	cyclictest	1617353	-21	thunderbird	22:46:07	8
1647367	99	32	0,30	cyclictest	1617353	-21	thunderbird	22:42:33	8
1647367	99	32	0,30	cyclictest	1617353	-21	thunderbird	21:25:31	8
1647367	99	32	0,30	cyclictest	1617353	-21	thunderbird	21:07:11	8
1647367	99	32	0,30	cyclictest	1617353	-21	thunderbird	21:07:11	8
1647367	99	32	0,29	cyclictest	0	-21	swapper/2	20:20:25	8
1647367	99	32	0,29	cyclictest	0	-21	swapper/2	19:17:31	8
1647367	99	32	0,29	cyclictest	0	-21	swapper/2	00:29:29	8
1647367	99	32	0,29	cyclictest	0	-21	swapper/2	00:20:08	8
1647367	99	32	0,29	cyclictest	0	-21	swapper/2	00:10:44	8
1647404	99	31	0,30	cyclictest	0	-21	swapper/15	20:55:13	7
1647401	99	31	30,1	cyclictest	1774	-21	snmpd	00:24:52	6
1647399	99	31	0,30	cyclictest	0	-21	swapper/13	22:00:15	5
1647399	99	31	0,2	cyclictest	1617353	-21	thunderbird	20:06:23	5
1647393	99	31	30,1	cyclictest	1931946	-21	kworker/u32:2+flush-259:0	23:35:17	3
1647393	99	31	30,1	cyclictest	0	-21	swapper/11	21:47:14	3
1647393	99	31	0,30	cyclictest	0	-21	swapper/11	00:20:17	3
1647390	99	31	30,1	cyclictest	1774	-21	snmpd	00:18:55	2
1647390	99	31	29,2	cyclictest	0	-21	swapper/10	00:20:17	2
1647390	99	31	29,1	cyclictest	1668841	-21	kworker/10:0+events	20:04:27	2
1647388	99	31	31,0	cyclictest	0	-21	swapper/9	22:24:45	15
1647388	99	31	31,0	cyclictest	0	-21	swapper/9	22:15:17	15
1647388	99	31	31,0	cyclictest	0	-21	swapper/9	21:52:31	15
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17