OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Sat Aug 15, 2026 00:45:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1041042	99	79	71,6	cyclictest	1058295	-21	kworker/u32:4+events_unbound	19:49:41	15
1040521	2	61	57,3	sleep0	0	-21	swapper/0	19:08:55	0
1040584	2	59	31,26	sleep15	0	-21	swapper/15	19:09:42	7
1041032	99	58	57,1	cyclictest	1309251	-21	kworker/u32:2+events_unbound	00:09:14	12
1041055	99	57	7,25	cyclictest	1161449	-21	thunderbird	21:01:14	6
4189	98	56	0,54	rtkit-daemon	0	-21	swapper/2	19:08:16	8
1041055	99	53	4,25	cyclictest	1161449	-21	thunderbird	00:07:57	6
1041055	99	52	2,26	cyclictest	1161449	-21	thunderbird	23:24:01	6
1041055	99	52	2,26	cyclictest	1161449	-21	thunderbird	23:24:01	6
1041055	99	51	24,26	cyclictest	1161449	-21	thunderbird	23:35:00	6
1040466	2	46	43,2	sleep7	0	-21	swapper/7	19:08:14	13
1041044	99	45	42,2	cyclictest	1091795	-21	kworker/u32:4+flush-259:0	20:25:14	2
1041044	99	45	42,2	cyclictest	1091795	-21	kworker/u32:4+flush-259:0	20:25:14	2
1041055	99	44	6,25	cyclictest	0	-21	swapper/14	20:17:18	6
1041055	99	44	6,25	cyclictest	0	-21	swapper/14	20:06:19	6
1041055	99	43	5,25	cyclictest	0	-21	swapper/14	19:44:21	6
1041055	99	43	5,25	cyclictest	0	-21	swapper/14	00:18:56	6
1041058	99	42	39,2	cyclictest	1217452	-21	kworker/u32:3+events_unbound	22:15:36	7
1041055	99	42	4,25	cyclictest	0	-21	swapper/14	19:11:24	6
1040554	2	42	40,1	sleep6	0	-21	swapper/6	19:09:17	12
1041055	99	41	3,25	cyclictest	0	-21	swapper/14	23:13:02	6
1041055	99	41	3,25	cyclictest	0	-21	swapper/14	00:29:55	6
1041044	99	41	39,2	cyclictest	1186589	-21	kworker/u32:2+events_unbound	22:12:07	2
1040284	2	41	39,1	sleep3	0	-21	swapper/3	19:06:02	9
1037092	2	41	39,1	sleep8	0	-21	swapper/8	19:05:03	14
1041053	99	40	34,5	cyclictest	1247181	-21	iostat_ios	22:30:15	5
1041044	99	40	39,1	cyclictest	1186589	-21	kworker/u32:2+events_unbound	22:00:19	2
1040355	2	40	37,2	sleep10	0	-21	swapper/10	19:06:57	2
1041055	99	39	14,14	cyclictest	1161449	-21	thunderbird	23:45:59	6
1041044	99	39	38,1	cyclictest	1186589	-21	kworker/u32:2+events_unbound	21:47:18	2
1040404	2	39	36,2	sleep14	0	-21	swapper/14	19:07:33	6
1040382	2	39	37,1	sleep12	0	-21	swapper/12	19:07:15	4
1041032	99	38	37,1	cyclictest	1352320	-21	kworker/u32:4+events_unbound	00:28:19	12
1040318	2	38	36,1	sleep11	0	-21	swapper/11	19:06:26	3
1041044	99	36	34,2	cyclictest	1075153	-21	kworker/u32:2+events_unbound	20:00:14	2
1040340	2	36	34,1	sleep13	0	-21	swapper/13	19:06:43	5
1041047	99	35	33,2	cyclictest	1186589	-21	kworker/u32:2+flush-259:0	22:45:16	3
1041044	99	35	32,1	cyclictest	1058295	-21	kworker/u32:4+events_unbound	19:44:34	2
1041028	99	35	7,28	cyclictest	66	1	irq_work/5	22:08:37	11
1040413	2	35	31,2	sleep4	0	-21	swapper/4	19:07:39	10
1041058	99	34	32,2	cyclictest	1320945	-21	kworker/u32:3+events_unbound	00:05:14	7
1041053	99	34	33,1	cyclictest	1129608	-21	kworker/u32:0+events_unbound	21:00:16	5
1041049	99	34	32,2	cyclictest	1058295	-21	kworker/u32:4+flush-259:0	19:50:19	4
1041044	99	34	33,1	cyclictest	1204057	-21	kworker/u32:1+flush-259:0	22:21:36	2
1041044	99	34	32,2	cyclictest	1058295	-21	kworker/u32:4+flush-259:0	19:45:15	2
1040441	2	34	32,1	sleep9	0	-21	swapper/9	19:07:59	15
1040428	2	34	32,1	sleep1	0	-21	swapper/1	19:07:52	1
1040287	2	34	31,1	sleep5	0	-21	swapper/5	19:06:04	11
1041049	99	33	0,32	cyclictest	0	-21	swapper/12	23:50:14	4
1041049	99	33	0,30	cyclictest	0	-21	swapper/12	00:00:16	4
1041042	99	33	0,32	cyclictest	996744	-21	Compositor	19:41:51	15
1041035	99	33	0,32	cyclictest	0	-21	swapper/7	22:01:33	13
1041026	99	33	32,1	cyclictest	1104603	-21	kworker/u32:2+events_unbound	21:09:02	10
1041017	99	33	29,4	cyclictest	1774	-21	snmpd	00:25:08	1
1041055	99	32	28,4	cyclictest	1196069	-21	mii-tool	21:50:15	6
1041044	99	32	31,1	cyclictest	1104603	-21	kworker/u32:2+events_unbound	20:45:21	2
1041044	99	32	30,2	cyclictest	1309251	-21	kworker/u32:2+events_unbound	00:22:45	2
1041035	99	32	29,2	cyclictest	1104603	-21	kworker/u32:2+flush-259:0	20:55:19	13
1041032	99	32	31,1	cyclictest	1058295	-21	kworker/u32:4+events_unbound	19:47:07	12
1041058	99	31	0,30	cyclictest	0	-21	swapper/15	20:52:10	7
1041055	99	31	6,0	cyclictest	0	-21	swapper/14	21:34:11	6
1041053	99	31	0,30	cyclictest	0	-21	swapper/13	21:33:03	5
1041049	99	31	30,1	cyclictest	1140901	-21	nodev-device-ev	21:05:18	4
1041049	99	31	1,3	cyclictest	1161464	-21	Socket	12:05:31	4
1041047	99	31	0,30	cyclictest	0	-21	swapper/11	23:18:24	3
1041044	99	31	30,1	cyclictest	975060	-21	kworker/10:0+events	19:10:43	2
1041044	99	31	30,1	cyclictest	1255499	-21	kworker/10:2+events	23:41:47	2
1041044	99	31	30,1	cyclictest	1255499	-21	kworker/10:2+events	23:24:31	2
1041044	99	31	30,1	cyclictest	1255499	-21	kworker/10:2+events	23:24:31	2
1041044	99	31	30,1	cyclictest	1231440	-21	kworker/10:1+events	22:36:49	2
1041044	99	31	30,1	cyclictest	1032176	-21	kworker/u32:1+events_unbound	20:18:44	2
1041044	99	31	29,1	cyclictest	1231440	-21	kworker/10:1+events	22:25:43	2
1041042	99	31	0,30	cyclictest	0	-21	swapper/9	20:29:25	15
1041042	99	31	0,30	cyclictest	0	-21	swapper/9	20:29:25	15
1041035	99	31	0,30	cyclictest	1161449	-21	thunderbird	21:20:35	13
1041035	99	31	0,30	cyclictest	0	-21	swapper/7	22:56:56	13
1041028	99	31	30,1	cyclictest	1774	-21	snmpd	00:07:10	11
1041028	99	31	30,1	cyclictest	0	-21	swapper/5	21:48:24	11
1041028	99	31	0,30	cyclictest	0	-21	swapper/5	20:50:15	11
1041026	99	31	30,1	cyclictest	1774	-21	snmpd	22:14:46	10
1041026	99	31	27,4	cyclictest	1323630	-21	mii-tool	23:30:14	10
1041026	99	31	0,30	cyclictest	0	-21	swapper/4	22:55:13	10
1041026	99	31	0,30	cyclictest	0	-21	swapper/4	20:14:39	10
1041023	99	31	30,1	cyclictest	1774	-21	snmpd	23:23:28	9
1041023	99	31	30,1	cyclictest	1774	-21	snmpd	23:23:27	9
1041023	99	31	28,3	cyclictest	1774	-21	snmpd	20:37:22	9
1041023	99	31	28,3	cyclictest	1774	-21	snmpd	20:37:22	9
1041023	99	31	28,2	cyclictest	1161449	-21	thunderbird	21:20:11	9
1041023	99	31	0,30	cyclictest	0	-21	swapper/3	21:42:15	9
1041021	99	31	30,1	cyclictest	1138187	-21	kworker/u32:3+events_unbound	21:50:51	8
1041017	99	31	29,1	cyclictest	1774	-21	snmpd	19:44:03	1
1041017	99	31	0,30	cyclictest	0	-21	swapper/1	20:39:19	1
1041017	99	31	0,30	cyclictest	0	-21	swapper/1	20:39:18	1
1041017	99	31	0,30	cyclictest	0	-21	swapper/1	00:24:32	1
1041017	99	31	0,29	cyclictest	0	-21	swapper/1	19:45:12	1
1041058	99	30	29,1	cyclictest	1774	-21	snmpd	23:07:08	7
1041058	99	30	29,1	cyclictest	1774	-21	snmpd	21:39:33	7
1041058	99	30	29,1	cyclictest	1261845	-21	kworker/u32:0+flush-259:0	23:31:07	7
1041055	99	30	6,24	cyclictest	0	-21	swapper/14	22:29:06	6
1041055	99	30	5,25	cyclictest	0	-21	swapper/14	22:18:07	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17