OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Sat Sep 19, 2026 00:46:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3375396	2	367	325,14	sleep4	0	-21	swapper/4	19:07:39	10
3375396	2	367	325,14	sleep4	0	-21	swapper/4	19:07:39	10
3375216	2	365	324,13	sleep5	0	-21	swapper/5	19:05:32	11
3375216	2	365	324,13	sleep5	0	-21	swapper/5	19:05:32	11
3375449	2	356	341,9	sleep3	0	-21	swapper/3	19:08:27	9
3375449	2	356	341,9	sleep3	0	-21	swapper/3	19:08:26	9
3375343	2	355	336,12	sleep10	0	-21	swapper/10	19:06:57	2
3375343	2	355	336,12	sleep10	0	-21	swapper/10	19:06:56	2
3375342	2	354	315,31	sleep9	0	-21	swapper/9	19:06:56	15
3375342	2	354	315,31	sleep9	0	-21	swapper/9	19:06:55	15
3375470	2	352	331,12	sleep15	0	-21	swapper/15	19:08:39	7
3375470	2	352	331,12	sleep15	0	-21	swapper/15	19:08:38	7
3375357	2	350	330,13	sleep7	0	-21	swapper/7	19:07:10	13
3375357	2	350	330,13	sleep7	0	-21	swapper/7	19:07:09	13
3375352	2	350	331,12	sleep2	0	-21	swapper/2	19:07:05	8
3375352	2	350	331,12	sleep2	0	-21	swapper/2	19:07:04	8
3372064	2	349	328,14	sleep13	0	-21	swapper/13	19:05:08	5
3372064	2	349	328,14	sleep13	0	-21	swapper/13	19:05:07	5
3375532	2	348	327,14	sleep11	0	-21	swapper/11	19:09:23	3
3375532	2	348	327,14	sleep11	0	-21	swapper/11	19:09:22	3
3375473	2	348	328,13	sleep1	0	-21	swapper/1	19:08:41	1
3375473	2	348	328,13	sleep1	0	-21	swapper/1	19:08:41	1
3375322	2	348	328,13	sleep8	0	-21	swapper/8	19:06:39	14
3375322	2	348	328,13	sleep8	0	-21	swapper/8	19:06:38	14
3375398	2	346	326,13	sleep6	0	-21	swapper/6	19:07:41	12
3375398	2	346	326,13	sleep6	0	-21	swapper/6	19:07:40	12
3375330	2	344	321,14	sleep14	0	-21	swapper/14	19:06:45	6
3375330	2	344	321,14	sleep14	0	-21	swapper/14	19:06:44	6
3375440	2	343	322,13	sleep12	0	-21	swapper/12	19:08:20	4
3375440	2	343	322,13	sleep12	0	-21	swapper/12	19:08:20	4
3375314	2	342	321,14	sleep0	0	-21	swapper/0	19:06:31	0
3375314	2	342	321,14	sleep0	0	-21	swapper/0	19:06:30	0
3375978	99	63	61,2	cyclictest	3409880	-21	kworker/u32:2+flush-259:0	20:10:18	2
3375990	99	51	48,2	cyclictest	3506830	-21	kworker/u32:0+flush-259:0	21:40:32	6
3375962	99	45	42,2	cyclictest	3495945	-21	kworker/u32:4+flush-259:0	21:27:44	10
3375967	99	40	39,1	cyclictest	3539395	-21	kworker/u32:0+flush-259:0	22:00:19	12
3375985	99	39	37,2	cyclictest	3546248	-21	kworker/u32:3+events_unbound	22:41:35	4
3375978	99	39	38,1	cyclictest	3570774	-21	kworker/u32:4+flush-259:0	22:50:18	2
3375954	99	39	5,30	cyclictest	3546248	-21	kworker/u32:3+flush-259:0	23:21:29	8
3375948	99	38	34,3	cyclictest	3570774	-21	kworker/u32:4+flush-259:0	23:55:35	0
3375954	99	37	33,3	cyclictest	3506830	-21	kworker/u32:0+events_unbound	21:37:58	8
3375954	99	37	31,4	cyclictest	3609096	-21	kworker/u32:2+flush-259:0	22:52:40	8
3375954	99	37	1,32	cyclictest	3570774	-21	kworker/u32:4+flush-259:0	23:10:49	8
3375990	99	36	12,11	cyclictest	3375442	-1	kworker/u33:0-hci0	20:52:50	6
3375978	99	36	31,0	cyclictest	0	-21	swapper/10	21:07:16	2
3375957	99	36	6,23	cyclictest	0	-21	swapper/3	23:53:10	9
3375954	99	36	5,30	cyclictest	3471476	-21	kworker/u32:2+flush-259:0	21:19:53	8
3375948	99	36	34,1	cyclictest	3570774	-21	kworker/u32:4+events_unbound	23:14:52	0
3375978	99	35	34,1	cyclictest	3724301	-21	kworker/u32:0+events_unbound	00:25:19	2
3375954	99	35	31,3	cyclictest	3570774	-21	kworker/u32:4+flush-259:0	23:00:53	8
3375952	99	35	33,1	cyclictest	3641341	-21	kworker/u32:1+events_unbound	23:53:15	1
3375954	99	34	30,3	cyclictest	3422561	-21	kworker/u32:1+flush-259:0	20:19:08	8
3375954	99	34	29,3	cyclictest	3506830	-21	kworker/u32:0+flush-259:0	21:34:07	8
3375954	99	34	27,6	cyclictest	3442167	-21	kworker/u32:3+flush-259:0	20:35:05	8
3375954	99	34	11,1	cyclictest	0	-21	swapper/2	22:49:16	8
3375990	99	33	0,30	cyclictest	0	-21	swapper/14	22:50:14	6
3375978	99	33	32,1	cyclictest	3570774	-21	kworker/u32:4+events_unbound	22:45:14	2
3375978	99	33	31,1	cyclictest	0	-21	swapper/10	23:53:04	2
3375954	99	33	30,3	cyclictest	42	1	ktimers/2	19:16:36	8
3375954	99	33	30,3	cyclictest	42	1	ktimers/2	19:16:35	8
3375954	99	33	29,3	cyclictest	0	-21	swapper/2	22:10:05	8
3375954	99	33	29,3	cyclictest	0	-21	swapper/2	22:10:05	8
3375954	99	33	29,2	cyclictest	3570774	-21	kworker/u32:4+events_unbound	22:24:55	8
3375954	99	33	0,32	cyclictest	782	-21	systemd-journal	21:27:28	8
3375954	99	33	0,30	cyclictest	0	-21	swapper/2	23:06:33	8
3375990	99	32	30,2	cyclictest	3710619	-21	updatedb	00:17:00	6
3375978	99	32	30,1	cyclictest	0	-21	swapper/10	19:36:45	2
3375978	99	32	28,1	cyclictest	3564508	-21	kworker/10:0+events	23:46:57	2
3375973	99	32	28,4	cyclictest	1774	-21	snmpd	00:31:29	14
3375967	99	32	29,1	cyclictest	0	-21	swapper/6	22:31:01	12
3375957	99	32	30,2	cyclictest	0	-21	swapper/3	19:10:15	9
3375957	99	32	30,2	cyclictest	0	-21	swapper/3	19:10:14	9
3375954	99	32	0,30	cyclictest	782	-21	systemd-journal	21:04:01	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	23:55:45	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	23:52:25	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	23:44:55	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	23:31:37	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	23:25:07	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	22:56:09	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	22:44:47	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	21:57:37	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	21:52:05	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	21:14:11	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	21:06:01	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:58:05	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:50:05	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:33:27	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:25:47	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:22:48	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:11:11	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:06:23	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	20:03:13	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:56:09	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:51:12	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:48:08	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:40:56	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:35:57	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:30:32	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:27:17	8
3375954	99	32	0,29	cyclictest	0	-21	swapper/2	19:21:58	8
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17