OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Sat Jul 11, 2026 00:46:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
751912	2	416	396,13	sleep3	0	-21	swapper/3	19:09:24	9
748475	2	380	371,6	sleep6	0	-21	swapper/6	19:05:09	12
751893	2	373	367,4	sleep1	0	-21	swapper/1	19:09:05	1
751808	2	362	323,13	sleep14	0	-21	swapper/14	19:07:58	6
751866	2	357	336,14	sleep9	0	-21	swapper/9	19:08:41	15
751694	2	355	333,13	sleep15	0	-21	swapper/15	19:06:39	7
751803	2	354	335,13	sleep10	0	-21	swapper/10	19:07:54	2
751707	2	354	334,13	sleep5	0	-21	swapper/5	19:06:44	11
751800	2	353	333,13	sleep7	0	-21	swapper/7	19:07:51	13
751952	2	351	331,13	sleep0	0	-21	swapper/0	19:09:53	0
751887	2	351	331,13	sleep13	0	-21	swapper/13	19:09:00	5
751633	2	351	331,13	sleep11	0	-21	swapper/11	19:05:46	3
751825	2	350	331,13	sleep12	0	-21	swapper/12	19:08:12	4
751710	2	348	328,13	sleep8	0	-21	swapper/8	19:06:48	14
751796	2	345	326,13	sleep4	0	-21	swapper/4	19:07:48	10
751740	2	342	323,12	sleep2	0	-21	swapper/2	19:07:14	8
752391	99	63	61,1	cyclictest	743314	-21	kworker/u32:1+flush-259:0	19:40:17	2
752375	99	55	53,2	cyclictest	751856	-21	kworker/u32:2+flush-259:0	20:19:59	10
752366	99	47	46,1	cyclictest	1016662	-21	kworker/u32:4+events_unbound	23:40:37	1
752391	99	46	43,2	cyclictest	1044541	-21	kworker/u32:2+events_unbound	00:21:36	2
752391	99	46	43,2	cyclictest	1044541	-21	kworker/u32:2+events_unbound	00:21:35	2
752407	99	43	42,1	cyclictest	818487	-21	kworker/u32:1+flush-259:0	21:00:18	7
752407	99	40	40,0	cyclictest	0	-21	swapper/15	19:10:00	7
752396	99	40	39,1	cyclictest	811307	-21	kworker/u32:0+events_unbound	20:18:23	3
752403	99	39	36,2	cyclictest	705491	-21	kworker/u32:4+flush-259:0	19:47:21	6
752396	99	39	37,2	cyclictest	790408	-21	kworker/u32:0+events_unbound	19:52:47	3
752371	99	39	36,2	cyclictest	1032610	-21	kworker/u32:0+flush-259:0	23:35:11	9
752366	99	39	37,2	cyclictest	1037541	-21	kworker/u32:5+events_unbound	23:58:32	1
752377	99	38	36,2	cyclictest	1032610	-21	kworker/u32:0+events_unbound	23:48:18	11
752391	99	36	35,1	cyclictest	896505	-21	kworker/u32:1+flush-259:0	21:55:21	2
752391	99	36	34,2	cyclictest	1083583	-21	kworker/u32:4+events_unbound	00:36:56	2
752396	99	35	35,0	cyclictest	0	-21	swapper/11	22:52:41	3
752396	99	35	33,2	cyclictest	947361	-21	kworker/u32:2+events_unbound	22:41:45	3
752386	99	35	34,1	cyclictest	947361	-21	kworker/u32:2+events_unbound	22:30:18	14
752375	99	35	32,2	cyclictest	1016662	-21	kworker/u32:4+flush-259:0	23:33:54	10
752401	99	34	29,1	cyclictest	1774	-21	snmpd	21:32:03	5
752398	99	34	11,23	cyclictest	0	-21	swapper/12	23:08:23	4
752398	99	33	32,1	cyclictest	910650	-21	kworker/u32:3+flush-259:0	22:10:42	4
752396	99	33	33,0	cyclictest	0	-21	swapper/11	00:25:55	3
752396	99	33	33,0	cyclictest	0	-21	swapper/11	00:25:55	3
752396	99	33	32,0	cyclictest	0	-21	swapper/11	00:00:47	3
752396	99	33	29,3	cyclictest	864008	-21	kworker/u32:0+events_unbound	21:35:11	3
752391	99	33	29,3	cyclictest	910650	-21	kworker/u32:3+events_unbound	22:00:47	2
752366	99	33	33,0	cyclictest	0	-21	swapper/1	23:51:57	1
752407	99	32	27,2	cyclictest	1016662	-21	kworker/u32:4+events_unbound	23:22:42	7
752396	99	32	32,0	cyclictest	0	-21	swapper/11	21:55:43	3
752391	99	32	0,29	cyclictest	0	-21	swapper/10	20:50:13	2
752383	99	32	0,29	cyclictest	0	-21	swapper/7	20:20:14	13
752364	99	32	29,3	cyclictest	840526	-21	kworker/u32:2+events_unbound	21:14:42	0
752407	99	31	30,1	cyclictest	1774	-21	snmpd	19:20:59	7
752401	99	31	0,30	cyclictest	0	-21	swapper/13	23:57:54	5
752398	99	31	0,30	cyclictest	0	-21	swapper/12	23:03:41	4
752398	99	31	0,30	cyclictest	0	-21	swapper/12	22:03:22	4
752396	99	31	0,30	cyclictest	0	-21	swapper/11	21:05:20	3
752390	99	31	0,30	cyclictest	0	-21	swapper/9	23:40:24	15
752390	99	31	0,30	cyclictest	0	-21	swapper/9	21:48:15	15
752383	99	31	0,30	cyclictest	0	-21	swapper/7	23:38:57	13
752383	99	31	0,30	cyclictest	0	-21	swapper/7	19:20:47	13
752383	99	31	0,30	cyclictest	0	-21	swapper/7	00:03:00	13
752383	99	31	0,1	cyclictest	0	-21	swapper/7	22:11:52	13
752375	99	31	0,30	cyclictest	0	-21	swapper/4	00:30:46	10
752375	99	31	0,30	cyclictest	0	-21	swapper/4	00:30:46	10
752375	99	31	0,30	cyclictest	0	-21	swapper/4	00:17:34	10
752371	99	31	30,1	cyclictest	1774	-21	snmpd	22:17:37	9
752371	99	31	29,2	cyclictest	751856	-21	kworker/u32:2+flush-259:0	19:42:13	9
752369	99	31	0,30	cyclictest	0	-21	swapper/2	23:15:02	8
752369	99	31	0,1	cyclictest	0	-21	swapper/2	21:39:27	8
752366	99	31	31,0	cyclictest	0	-21	swapper/1	22:49:57	1
752366	99	31	30,1	cyclictest	1097023	-21	kworker/u32:5+events_unbound	00:29:16	1
752366	99	31	30,1	cyclictest	1097023	-21	kworker/u32:5+events_unbound	00:29:16	1
752407	99	30	29,1	cyclictest	984280	-21	ethtool	22:50:15	7
752403	99	30	29,1	cyclictest	1774	-21	snmpd	22:40:53	6
752403	99	30	29,1	cyclictest	1774	-21	snmpd	20:29:31	6
752403	99	30	29,1	cyclictest	1075723	-21	kworker/u32:3+flush-259:0	00:03:20	6
752401	99	30	0,30	cyclictest	0	-21	swapper/13	21:16:31	5
752398	99	30	29,1	cyclictest	1774	-21	snmpd	20:37:40	4
752398	99	30	0,30	cyclictest	0	-21	swapper/12	00:35:34	4
752398	99	30	0,29	cyclictest	0	-21	swapper/12	22:50:44	4
752396	99	30	30,0	cyclictest	0	-21	swapper/11	22:06:53	3
752396	99	30	29,1	cyclictest	1774	-21	snmpd	22:00:49	3
752396	99	30	29,1	cyclictest	1032610	-21	kworker/u32:0+events_unbound	23:43:11	3
752396	99	30	1,29	cyclictest	124	-21	ksoftirqd/11	23:50:37	3
752396	99	30	0,30	cyclictest	0	-21	swapper/11	20:21:07	3
752396	99	30	0,1	cyclictest	0	-21	swapper/11	00:15:49	3
752391	99	30	29,1	cyclictest	776684	-21	kworker/10:2+events	20:20:21	2
752391	99	30	29,1	cyclictest	0	-21	swapper/10	23:29:34	2
752390	99	30	29,1	cyclictest	1774	-21	snmpd	22:31:58	15
752390	99	30	0,29	cyclictest	0	-21	swapper/9	22:07:49	15
752386	99	30	29,1	cyclictest	1774	-21	snmpd	23:32:57	14
752386	99	30	29,1	cyclictest	1774	-21	snmpd	23:10:05	14
752386	99	30	29,1	cyclictest	1774	-21	snmpd	20:40:42	14
752386	99	30	29,1	cyclictest	1774	-21	snmpd	19:14:55	14
752386	99	30	29,1	cyclictest	1099751	-21	ethtool	00:20:15	14
752386	99	30	29,1	cyclictest	1099751	-21	ethtool	00:20:15	14
752386	99	30	0,30	cyclictest	0	-21	swapper/8	20:05:50	14
752383	99	30	29,1	cyclictest	1774	-21	snmpd	23:08:17	13
752383	99	30	29,1	cyclictest	1774	-21	snmpd	21:56:57	13
752383	99	30	28,1	cyclictest	1086874	-21	cat	00:10:13	13
752383	99	30	0,30	cyclictest	0	-21	swapper/7	23:19:41	13
752380	99	30	29,1	cyclictest	1774	-21	snmpd	21:53:03	12
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17