OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat May 16, 2026 00:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1195693	2	82	0,1	sleep7	1195691	-21	rm	00:13:10	7
512063	99	46	44,2	cyclictest	717472	-21	kworker/u16:1+events_unbound	21:03:26	5
511602	2	45	35,7	sleep5	0	-21	swapper/5	19:05:30	5
512075	99	42	36,5	cyclictest	952304	-21	latency_hist	22:32:55	7
512063	99	42	39,2	cyclictest	1170577	-21	kworker/u16:5+flush-8:0	00:23:24	5
512063	99	41	40,1	cyclictest	660470	-21	kworker/u16:3+events_unbound	21:50:38	5
512063	99	41	39,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	21:42:53	5
512063	99	40	38,2	cyclictest	868233	-21	kworker/u16:4+events_unbound	22:16:31	5
510994	2	40	3,31	sleep7	0	-21	swapper/7	19:03:31	7
512063	99	39	37,2	cyclictest	988724	-21	kworker/u16:5+flush-8:0	23:08:37	5
512063	99	39	37,2	cyclictest	819264	-21	kworker/u16:1+events_unbound	22:11:26	5
512063	99	38	36,2	cyclictest	986442	-21	kworker/u16:4+events_unbound	23:33:37	5
512063	99	38	36,2	cyclictest	986442	-21	kworker/u16:4+events_unbound	23:27:02	5
512063	99	38	36,2	cyclictest	916399	-21	kworker/u16:0+events_unbound	22:34:46	5
512063	99	38	36,2	cyclictest	855502	-21	kworker/u16:2+events_unbound	22:54:01	5
512063	99	38	36,2	cyclictest	819264	-21	kworker/u16:1+events_unbound	21:54:13	5
512063	99	38	36,2	cyclictest	819264	-21	kworker/u16:1+events_unbound	21:54:13	5
512063	99	38	36,2	cyclictest	679397	-21	kworker/u16:2+events_unbound	21:24:50	5
512063	99	38	36,2	cyclictest	660470	-21	kworker/u16:3+events_unbound	22:42:25	5
512063	99	38	36,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	21:14:58	5
512063	99	38	36,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	21:14:58	5
512063	99	37	35,2	cyclictest	986442	-21	kworker/u16:4+events_unbound	22:50:57	5
512063	99	37	35,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	21:44:30	5
512063	99	37	35,2	cyclictest	1084698	-21	kworker/u16:2+events_unbound	23:51:38	5
511554	2	37	26,8	sleep4	0	-21	swapper/4	19:04:49	4
512063	99	36	34,2	cyclictest	986442	-21	kworker/u16:4+events_unbound	23:20:53	5
512063	99	36	34,2	cyclictest	855502	-21	kworker/u16:2+events_unbound	22:44:22	5
512063	99	36	34,2	cyclictest	1022746	-21	kworker/u16:0+events_unbound	23:06:33	5
512063	99	35	33,2	cyclictest	986442	-21	kworker/u16:4+events_unbound	23:39:17	5
512063	99	35	33,2	cyclictest	868233	-21	kworker/u16:4+events_unbound	22:19:53	5
512063	99	35	33,2	cyclictest	868233	-21	kworker/u16:4+events_unbound	22:01:21	5
512063	99	35	33,2	cyclictest	819264	-21	kworker/u16:1+events_unbound	22:05:29	5
512063	99	35	33,2	cyclictest	660470	-21	kworker/u16:3+events_unbound	22:31:50	5
512063	99	35	33,2	cyclictest	660470	-21	kworker/u16:3+events_unbound	21:37:14	5
512063	99	35	33,2	cyclictest	660470	-21	kworker/u16:3+events_unbound	21:09:10	5
512063	99	35	33,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	21:31:29	5
512063	99	35	33,2	cyclictest	1084698	-21	kworker/u16:2+events_unbound	23:45:34	5
512063	99	35	33,2	cyclictest	1084698	-21	kworker/u16:2+events_unbound	00:21:10	5
512063	99	35	33,2	cyclictest	1022746	-21	kworker/u16:0+events_unbound	23:14:30	5
512063	99	34	32,2	cyclictest	986442	-21	kworker/u16:4+events_unbound	00:09:33	5
512063	99	34	32,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	21:19:53	5
512063	99	34	32,2	cyclictest	1216146	-21	kworker/u16:1+events_unbound	00:32:25	5
512063	99	34	32,2	cyclictest	1084698	-21	kworker/u16:2+flush-8:0	23:31:42	5
512063	99	34	32,2	cyclictest	1084698	-21	kworker/u16:2+events_unbound	00:14:30	5
512075	99	33	28,4	cyclictest	843463	-21	latency_hist	21:47:56	7
512063	99	33	31,2	cyclictest	1170577	-21	kworker/u16:5+events_unbound	00:07:26	5
512063	99	33	31,2	cyclictest	1109552	-21	kworker/u16:3+events_unbound	23:54:26	5
512063	99	33	31,2	cyclictest	1084698	-21	kworker/u16:2+flush-8:0	00:01:34	5
512063	99	33	31,2	cyclictest	1084698	-21	kworker/u16:2+flush-8:0	00:01:34	5
512063	99	32	30,2	cyclictest	493876	-21	kworker/u16:1+events_unbound	19:13:24	5
512063	99	32	30,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	20:10:05	5
512063	99	32	30,2	cyclictest	1022746	-21	kworker/u16:0+events_unbound	00:35:46	5
512063	99	31	29,2	cyclictest	553316	-21	kworker/u16:2+events_unbound	19:39:51	5
512063	99	30	28,2	cyclictest	916399	-21	kworker/u16:0+events_unbound	22:26:33	5
512063	99	30	28,2	cyclictest	1022746	-21	kworker/u16:0+events_unbound	23:00:26	5
512075	99	29	23,5	cyclictest	770854	-21	latency_hist	21:17:56	7
512075	99	29	23,5	cyclictest	770854	-21	latency_hist	21:17:56	7
512063	99	29	27,2	cyclictest	679397	-21	kworker/u16:2+events_unbound	20:58:23	5
512063	99	29	27,2	cyclictest	660470	-21	kworker/u16:3+flush-8:0	20:46:50	5
512063	99	29	27,2	cyclictest	660470	-21	kworker/u16:3+flush-8:0	20:39:50	5
512063	99	29	27,2	cyclictest	660470	-21	kworker/u16:3+events_unbound	20:30:50	5
512063	99	29	27,2	cyclictest	553316	-21	kworker/u16:2+flush-8:0	19:23:50	5
512063	99	29	27,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	20:16:51	5
511547	2	29	18,7	sleep6	0	-21	swapper/6	19:04:43	6
512063	99	28	26,2	cyclictest	553316	-21	kworker/u16:2+events_unbound	20:21:58	5
512063	99	27	25,2	cyclictest	534102	-21	kworker/u16:3+events_unbound	19:21:19	5
512063	99	26	24,2	cyclictest	679397	-21	kworker/u16:2+events_unbound	20:50:54	5
512063	99	26	24,2	cyclictest	534102	-21	kworker/u16:3+events_unbound	19:32:51	5
512075	99	25	0,24	cyclictest	124	-21	kswapd0	23:23:09	7
512063	99	25	23,2	cyclictest	717472	-21	kworker/u16:1+events_unbound	20:57:54	5
512063	99	25	23,2	cyclictest	592403	-21	kworker/u16:1+events_unbound	19:55:57	5
512061	99	25	22,2	cyclictest	458313	-21	kworker/u16:0+flush-8:0	20:03:12	4
512063	99	24	22,2	cyclictest	592403	-21	kworker/u16:1+events_unbound	20:00:22	5
512063	99	24	22,2	cyclictest	458313	-21	kworker/u16:0+flush-8:0	20:23:50	5
512061	99	24	22,2	cyclictest	974151	-21	kworker/u16:1+events_unbound	22:48:09	4
512075	99	23	16,6	cyclictest	831364	-21	latency_hist	21:42:56	7
512075	99	22	21,0	cyclictest	0	-21	swapper/7	00:03:10	7
512075	99	22	17,4	cyclictest	635	-21	systemd-journal	22:27:56	7
512063	99	22	20,2	cyclictest	602464	-21	kworker/u16:4+events_unbound	20:37:21	5
512063	99	22	20,2	cyclictest	602464	-21	kworker/u16:4+events_unbound	20:37:21	5
512063	99	22	20,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	19:37:36	5
512061	99	22	19,2	cyclictest	1084698	-21	kworker/u16:2+flush-8:0	00:23:21	4
512075	99	21	13,7	cyclictest	1133878	-21	latency_hist	23:47:56	7
512075	99	20	0,18	cyclictest	1073334	-21	latency_hist	23:22:56	7
512075	99	19	15,3	cyclictest	124	-21	kswapd0	22:46:11	7
512063	99	18	16,2	cyclictest	458313	-21	kworker/u16:0+flush-8:0	20:03:01	5
512063	99	18	16,2	cyclictest	458313	-21	kworker/u16:0+events_unbound	19:09:51	5
512075	99	17	0,15	cyclictest	997701	-21	ssh	22:48:20	7
512075	99	16	7,4	cyclictest	6382	-21	gvfs-afc-volume	23:58:15	7
512075	99	16	7,4	cyclictest	6382	-21	gvfs-afc-volume	23:58:15	7
512075	99	16	15,0	cyclictest	0	-21	swapper/7	20:33:10	7
512075	99	16	15,0	cyclictest	0	-21	swapper/7	20:33:10	7
512075	99	16	13,2	cyclictest	0	-21	swapper/7	23:48:19	7
512075	99	16	10,5	cyclictest	746647	-21	latency_hist	21:07:56	7
512075	99	16	0,14	cyclictest	0	-21	swapper/7	19:48:21	7
512075	99	16	0,14	cyclictest	0	-21	swapper/7	19:48:21	7
512071	99	16	0,16	cyclictest	0	-21	swapper/6	21:05:11	6
512071	99	16	0,16	cyclictest	0	-21	swapper/6	20:34:27	6
512071	99	16	0,16	cyclictest	0	-21	swapper/6	20:34:27	6
512071	99	16	0,16	cyclictest	0	-21	swapper/6	20:23:12	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17