OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot4s.osadl.org (updated Sat Aug 22, 2026 00:45:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2084739	99	149	138,9	cyclictest	2230834	-21	kworker/u32:2+events_unbound	22:03:38	6
2083897	2	129	126,2	sleep12	0	-21	swapper/12	19:05:44	4
2084739	99	125	123,2	cyclictest	2314446	-21	kworker/u32:2+events_unbound	23:20:26	6
4189	98	74	0,73	rtkit-daemon	0	-21	swapper/15	19:08:50	7
2084029	2	62	60,1	sleep6	0	-21	swapper/6	19:07:14	12
2084703	99	61	56,4	cyclictest	2314446	-21	kworker/u32:2+events_unbound	23:48:11	9
2084693	99	59	58,1	cyclictest	2123028	-21	kworker/u32:0+events_unbound	20:05:18	0
2084735	99	58	55,2	cyclictest	2215051	-21	kworker/u32:3+events_unbound	22:42:02	5
2084047	2	56	54,1	sleep0	0	-21	swapper/0	19:07:23	0
2084700	99	54	47,4	cyclictest	2390912	-21	kworker/u32:4+flush-259:0	00:35:44	8
2084710	99	53	48,5	cyclictest	0	-21	swapper/5	23:25:13	11
2084723	99	50	48,2	cyclictest	2377463	-21	kworker/u32:3+flush-259:0	23:44:28	15
2084005	2	49	47,1	sleep7	0	-21	swapper/7	19:06:59	13
2084716	99	48	47,1	cyclictest	2415971	-21	kworker/u32:3+flush-259:0	00:15:14	13
2084710	99	48	47,1	cyclictest	2294684	-21	kworker/u32:1+events_unbound	23:05:19	11
2084735	99	46	45,1	cyclictest	2110416	-21	kworker/u32:0+events_unbound	19:40:16	5
2084733	99	44	44,0	cyclictest	0	-21	swapper/12	23:50:22	4
2084725	99	44	41,2	cyclictest	2390912	-21	kworker/u32:4+events_unbound	23:54:53	2
2084703	99	44	42,2	cyclictest	2143818	-21	kworker/u32:1+events_unbound	20:17:06	9
2084693	99	44	40,3	cyclictest	2135455	-21	kworker/u32:3+flush-259:0	20:10:33	0
2084739	99	43	18,25	cyclictest	1161449	-21	thunderbird	21:14:55	6
2084716	99	43	41,2	cyclictest	2215051	-21	kworker/u32:3+events_unbound	22:43:12	13
2084713	99	43	41,2	cyclictest	2294684	-21	kworker/u32:1+events_unbound	22:45:35	12
2084733	99	42	40,2	cyclictest	2084338	-21	kworker/u32:2+flush-259:0	19:35:14	4
2084733	99	42	39,2	cyclictest	2215051	-21	kworker/u32:3+events_unbound	22:11:19	4
2084733	99	42	39,2	cyclictest	2215051	-21	kworker/u32:3+events_unbound	22:11:19	4
2084713	99	42	40,1	cyclictest	0	-21	swapper/6	22:03:38	12
2084710	99	42	41,1	cyclictest	2230834	-21	kworker/u32:2+events_unbound	22:04:58	11
2084743	99	40	39,1	cyclictest	2314446	-21	kworker/u32:2+events_unbound	23:48:21	7
2084703	99	40	38,1	cyclictest	2274548	-21	kworker/u32:5+events_unbound	22:25:19	9
2083930	2	40	38,1	sleep4	0	-21	swapper/4	19:06:07	10
2084693	99	39	36,2	cyclictest	2084338	-21	kworker/u32:2+events_unbound	19:55:13	0
2084743	99	38	36,2	cyclictest	2356797	-21	kworker/u32:6+events_unbound	23:21:13	7
2084743	99	38	34,3	cyclictest	2294684	-21	kworker/u32:1+events_unbound	22:49:53	7
2084716	99	38	36,2	cyclictest	2355516	-21	kworker/u32:3+events_unbound	23:31:48	13
2084703	99	38	37,1	cyclictest	2156459	-21	kworker/u32:0+events_unbound	21:33:04	9
2084700	99	38	35,2	cyclictest	2427518	-21	kworker/u32:5+flush-259:0	00:20:12	8
2084117	2	38	36,1	sleep10	0	-21	swapper/10	19:08:06	2
2083939	2	38	35,2	sleep13	0	-21	swapper/13	19:06:17	5
2083927	2	38	35,2	sleep1	0	-21	swapper/1	19:06:04	1
2084733	99	37	36,1	cyclictest	2321396	-21	kworker/u32:4+flush-259:0	23:00:22	4
2084725	99	37	0,32	cyclictest	0	-21	swapper/10	00:16:17	2
2084723	99	37	35,1	cyclictest	2291961	-21	kworker/u32:0+events_unbound	22:50:42	15
2084720	99	37	35,2	cyclictest	2363517	-21	kworker/u32:0+events_unbound	00:05:19	14
2083975	2	37	35,1	sleep5	0	-21	swapper/5	19:06:40	11
2083951	2	37	35,1	sleep8	0	-21	swapper/8	19:06:28	14
2084743	99	36	34,2	cyclictest	2215051	-21	kworker/u32:3+events_unbound	21:50:26	7
2084739	99	36	0,25	cyclictest	0	-21	swapper/14	23:15:44	6
2084723	99	36	33,3	cyclictest	2415971	-21	kworker/u32:3+events_unbound	00:13:12	15
2084716	99	36	34,2	cyclictest	2370907	-21	kworker/u32:1+events_unbound	23:50:14	13
2084710	99	36	36,0	cyclictest	0	-21	swapper/5	21:47:19	11
2084696	99	36	34,2	cyclictest	2156459	-21	kworker/u32:0+events_unbound	21:36:28	1
2083940	2	36	34,1	sleep14	0	-21	swapper/14	19:06:18	6
2083869	2	36	34,1	sleep11	0	-21	swapper/11	19:05:27	3
2084739	99	35	33,2	cyclictest	2427518	-21	kworker/u32:5+events_unbound	00:39:48	6
2084735	99	35	33,2	cyclictest	2156459	-21	kworker/u32:0+events_unbound	20:50:17	5
2084733	99	35	34,1	cyclictest	2215051	-21	kworker/u32:3+flush-259:0	22:40:10	4
2084733	99	35	33,2	cyclictest	2123028	-21	kworker/u32:0+flush-259:0	20:25:23	4
2084716	99	35	34,1	cyclictest	1161449	-21	thunderbird	19:18:56	13
2084716	99	35	34,1	cyclictest	1161449	-21	thunderbird	19:18:56	13
2084716	99	35	34,1	cyclictest	1161449	-21	thunderbird	00:36:13	13
2084716	99	35	33,2	cyclictest	2084338	-21	kworker/u32:2+events_unbound	19:22:18	13
2084716	99	35	33,2	cyclictest	2084338	-21	kworker/u32:2+events_unbound	19:22:17	13
2084710	99	35	33,2	cyclictest	2355516	-21	kworker/u32:3+events_unbound	23:24:30	11
2084700	99	35	34,1	cyclictest	2321396	-21	kworker/u32:4+flush-259:0	22:55:14	8
2084700	99	35	32,2	cyclictest	2210828	-21	kworker/u32:1+flush-259:0	21:45:33	8
2082480	2	35	33,1	sleep2	0	-21	swapper/2	19:05:18	8
2084743	99	34	34,0	cyclictest	0	-21	swapper/15	22:19:43	7
2084743	99	34	34,0	cyclictest	0	-21	swapper/15	22:19:42	7
2084743	99	34	34,0	cyclictest	0	-21	swapper/15	00:29:57	7
2084743	99	34	34,0	cyclictest	0	-21	swapper/15	00:16:59	7
2084743	99	34	33,1	cyclictest	2230834	-21	kworker/u32:2+events_unbound	22:05:23	7
2084743	99	34	33,1	cyclictest	2230834	-21	kworker/u32:2+events_unbound	22:05:22	7
2084743	99	34	33,1	cyclictest	2210828	-21	kworker/u32:1+events_unbound	21:29:57	7
2084743	99	34	33,1	cyclictest	0	-21	swapper/15	21:10:23	7
2084733	99	34	34,0	cyclictest	0	-21	swapper/12	21:39:18	4
2084733	99	34	33,1	cyclictest	2230834	-21	kworker/u32:2+flush-259:0	21:44:59	4
2084733	99	34	32,0	cyclictest	21	1	rcu_preempt	00:29:35	4
2084720	99	34	32,2	cyclictest	2195327	-21	kworker/u32:3+events_unbound	21:15:53	14
2084716	99	34	34,0	cyclictest	0	-21	swapper/7	21:39:19	13
2084716	99	34	34,0	cyclictest	0	-21	swapper/7	00:22:15	13
2084716	99	34	33,1	cyclictest	0	-21	swapper/7	23:37:07	13
2084716	99	34	32,0	cyclictest	21	1	rcu_preempt	21:42:21	13
2084716	99	34	28,5	cyclictest	3578	-21	gnome-shell	23:20:19	13
2084710	99	34	34,0	cyclictest	0	-21	swapper/5	20:27:27	11
2084710	99	34	3,1	cyclictest	0	-21	swapper/5	23:56:41	11
2084693	99	34	0,1	cyclictest	0	-21	swapper/0	20:23:30	0
2084214	2	34	32,1	sleep3	0	-21	swapper/3	19:09:18	9
2080754	2	34	31,2	sleep9	0	-21	swapper/9	19:05:09	15
2084743	99	33	1,31	cyclictest	160	-21	ksoftirqd/15	20:40:23	7
2084733	99	33	32,1	cyclictest	1161449	-21	thunderbird	23:31:11	4
2084733	99	33	32,1	cyclictest	0	-21	swapper/12	00:39:09	4
2084733	99	33	31,2	cyclictest	2294684	-21	kworker/u32:1+events_unbound	22:58:29	4
2084733	99	33	31,2	cyclictest	2152195	-21	kworker/u32:3+events_unbound	20:40:19	4
2084723	99	33	32,1	cyclictest	105	1	ktimers/9	21:28:45	15
2084720	99	33	27,6	cyclictest	2075604	-21	kworker/u32:0+flush-259:0	19:10:19	14
2084716	99	33	32,1	cyclictest	1161449	-21	thunderbird	00:02:39	13
2084716	99	33	31,1	cyclictest	2215051	-21	kworker/u32:3+events_unbound	22:17:56	13
2084716	99	33	31,1	cyclictest	2215051	-21	kworker/u32:3+events_unbound	22:17:55	13
2084713	99	33	33,0	cyclictest	0	-21	swapper/6	00:29:35	12
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17