OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Tue Jan 27, 2026 00:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
637361	99	63	61,2	cyclictest	1030180	-21	kworker/u16:2+events_unbound	22:22:13	5
636773	2	54	18,31	sleep7	0	-21	swapper/7	19:02:47	7
636773	2	54	18,31	sleep7	0	-21	swapper/7	19:02:47	7
637361	99	52	50,2	cyclictest	804946	-21	kworker/u16:4+flush-8:0	22:02:24	5
637365	99	50	48,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	20:47:12	6
637365	99	50	48,2	cyclictest	1343634	-21	kworker/u16:3+flush-8:0	00:27:24	6
637361	99	50	48,2	cyclictest	636767	-21	kworker/u16:0+flush-8:0	19:37:23	5
637365	99	49	47,2	cyclictest	921127	-21	kworker/u16:0+events_unbound	21:37:24	6
637365	99	49	47,2	cyclictest	921127	-21	kworker/u16:0+events_unbound	21:37:24	6
637365	99	49	47,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	23:37:10	6
637365	99	49	46,2	cyclictest	1039037	-21	kworker/u16:5+flush-8:0	23:52:10	6
637361	99	47	45,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	19:17:22	5
637361	99	47	45,2	cyclictest	1317289	-21	kworker/u16:1+events_unbound	00:12:24	5
636865	2	47	37,7	sleep4	0	-21	swapper/4	19:04:04	4
636865	2	47	37,7	sleep4	0	-21	swapper/4	19:04:04	4
637365	99	46	44,2	cyclictest	1331044	-21	kworker/u16:2+events_unbound	00:17:29	6
637361	99	46	44,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	20:42:27	5
637361	99	46	43,3	cyclictest	804946	-21	kworker/u16:4+flush-8:0	21:17:11	5
637367	99	45	44,0	cyclictest	0	-21	swapper/7	23:27:24	7
637367	99	45	42,2	cyclictest	823865	-21	sed	20:37:24	7
637367	99	45	42,2	cyclictest	1202186	-21	kthreadcore	23:22:15	7
637365	99	45	43,2	cyclictest	804946	-21	kworker/u16:4+events_unbound	21:17:28	6
637365	99	45	43,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	19:57:20	6
637365	99	45	43,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	00:07:25	6
637361	99	45	43,2	cyclictest	853914	-21	kworker/u16:1+events_unbound	22:12:25	5
6265	89	45	0,38	rtkit-daemon	0	-21	swapper/5	19:04:11	5
6265	89	45	0,38	rtkit-daemon	0	-21	swapper/5	19:04:11	5
637365	99	44	42,2	cyclictest	589112	-21	kworker/u16:2+flush-8:0	19:12:11	6
637367	99	43	41,1	cyclictest	1053270	-21	ssh	22:20:39	7
637361	99	43	40,2	cyclictest	804946	-21	kworker/u16:4+events_unbound	21:22:09	5
637361	99	43	40,2	cyclictest	1067374	-21	kworker/u16:1+events_unbound	22:47:16	5
637361	99	42	40,2	cyclictest	921127	-21	kworker/u16:0+events_unbound	21:52:23	5
637361	99	42	40,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	20:27:24	5
637367	99	41	39,1	cyclictest	1160900	-21	ssh	23:03:43	7
637367	99	41	36,4	cyclictest	872893	-21	diskmemload	22:52:09	7
637365	99	41	39,2	cyclictest	992452	-21	kworker/u16:2+flush-8:0	21:57:10	6
637365	99	41	39,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	23:47:29	6
637367	99	40	39,0	cyclictest	0	-21	swapper/7	22:23:18	7
637365	99	40	38,2	cyclictest	804946	-21	kworker/u16:4+events_unbound	21:12:25	6
637365	99	40	38,2	cyclictest	589112	-21	kworker/u16:2+flush-8:0	20:57:19	6
637365	99	40	38,2	cyclictest	1305167	-21	kworker/u16:0+events_unbound	00:04:51	6
637361	99	40	38,2	cyclictest	1317289	-21	kworker/u16:1+events_unbound	00:17:23	5
637361	99	40	38,2	cyclictest	1067374	-21	kworker/u16:1+events_unbound	22:27:20	5
637361	99	40	38,2	cyclictest	1030180	-21	kworker/u16:2+flush-8:0	22:32:25	5
637367	99	39	0,37	cyclictest	709451	-21	cat	19:42:06	7
637365	99	39	37,2	cyclictest	804946	-21	kworker/u16:4+flush-8:0	21:42:24	6
637365	99	39	37,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	19:22:20	6
637365	99	39	37,2	cyclictest	1067374	-21	kworker/u16:1+events_unbound	22:52:23	6
637361	99	39	37,2	cyclictest	689058	-21	kworker/u16:1+events_unbound	20:17:22	5
637361	99	39	37,2	cyclictest	1331044	-21	kworker/u16:2+events_unbound	00:32:24	5
637361	99	39	36,2	cyclictest	1172586	-21	kworker/u16:4+events_unbound	23:12:09	5
637367	99	38	36,1	cyclictest	1027707	-21	ssh	22:07:59	7
637367	99	38	35,2	cyclictest	814035	-21	ntp_states	20:32:21	7
637365	99	38	36,2	cyclictest	1331044	-21	kworker/u16:2+events_unbound	00:25:01	6
637365	99	38	36,2	cyclictest	1331044	-21	kworker/u16:2+events_unbound	00:25:01	6
637365	99	38	36,2	cyclictest	1172586	-21	kworker/u16:4+events_unbound	23:17:29	6
637365	99	38	36,2	cyclictest	1172586	-21	kworker/u16:4+events_unbound	23:10:43	6
637365	99	38	36,2	cyclictest	1102644	-21	kworker/u16:0+events_unbound	22:47:24	6
637365	99	38	36,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	23:42:17	6
637365	99	38	36,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	23:05:58	6
637361	99	38	36,2	cyclictest	728109	-21	kworker/u16:0+flush-8:0	20:07:39	5
637361	99	38	36,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	20:47:24	5
637361	99	38	36,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	23:50:31	5
637361	99	38	36,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	00:07:12	5
637367	99	37	36,0	cyclictest	0	-21	swapper/7	23:21:22	7
637365	99	37	35,2	cyclictest	853914	-21	kworker/u16:1+flush-8:0	21:07:11	6
637365	99	37	35,2	cyclictest	689058	-21	kworker/u16:1+flush-8:0	20:17:23	6
637365	99	37	35,2	cyclictest	1172586	-21	kworker/u16:4+events_unbound	23:29:03	6
637361	99	37	35,2	cyclictest	921127	-21	kworker/u16:0+events_unbound	21:37:08	5
637361	99	37	35,2	cyclictest	921127	-21	kworker/u16:0+events_unbound	21:37:08	5
637361	99	37	35,2	cyclictest	921127	-21	kworker/u16:0+events_unbound	21:34:30	5
637361	99	37	35,2	cyclictest	589112	-21	kworker/u16:2+events_unbound	20:12:25	5
637361	99	37	35,2	cyclictest	1343634	-21	kworker/u16:3+events_unbound	00:27:21	5
637361	99	37	35,2	cyclictest	1160286	-21	kworker/u16:3+events_unbound	23:06:50	5
636876	2	37	27,7	sleep6	0	-21	swapper/6	19:04:14	6
636876	2	37	27,7	sleep6	0	-21	swapper/6	19:04:14	6
637367	99	36	36,0	cyclictest	0	-21	swapper/7	22:33:23	7
637367	99	36	35,0	cyclictest	0	-21	swapper/7	23:00:51	7
637367	99	36	35,0	cyclictest	0	-21	swapper/7	22:38:58	7
637367	99	36	35,0	cyclictest	0	-21	swapper/7	00:14:43	7
637367	99	36	34,1	cyclictest	0	-21	swapper/7	21:38:38	7
637367	99	36	34,1	cyclictest	0	-21	swapper/7	21:38:38	7
637365	99	36	34,2	cyclictest	617842	-21	kworker/u16:3+events_unbound	19:17:26	6
637365	99	36	34,2	cyclictest	1027680	-21	kworker/u16:0+events_unbound	22:09:02	6
637361	99	36	34,2	cyclictest	921127	-21	kworker/u16:0+events_unbound	21:47:24	5
637361	99	36	34,2	cyclictest	1067374	-21	kworker/u16:1+events_unbound	23:40:23	5
637361	99	36	34,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	23:25:17	5
637361	99	36	34,2	cyclictest	1039037	-21	kworker/u16:5+events_unbound	22:21:46	5
637367	99	35	34,0	cyclictest	0	-21	swapper/7	22:43:23	7
637367	99	35	31,2	cyclictest	1267671	-21	cut	23:47:20	7
637365	99	35	33,2	cyclictest	853914	-21	kworker/u16:1+events_unbound	21:26:57	6
637365	99	35	33,2	cyclictest	804946	-21	kworker/u16:4+flush-8:0	21:22:28	6
637365	99	35	33,2	cyclictest	1365519	-21	kworker/u16:1+events_unbound	00:32:15	6
637365	99	35	33,2	cyclictest	1138868	-21	kworker/u16:2+events_unbound	22:57:16	6
637365	99	35	33,2	cyclictest	1030180	-21	kworker/u16:2+events_unbound	22:40:43	6
637361	99	35	33,2	cyclictest	853914	-21	kworker/u16:1+events_unbound	21:12:17	5
637361	99	35	33,2	cyclictest	804946	-21	kworker/u16:4+events_unbound	20:37:16	5
637361	99	35	33,2	cyclictest	708741	-21	kworker/u16:3+flush-8:0	19:47:17	5
637367	99	34	33,0	cyclictest	0	-21	swapper/7	22:49:50	7
637367	99	34	33,0	cyclictest	0	-21	swapper/7	21:47:40	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17