OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Wed Jan 07, 2026 12:43:32)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1880158	2	52	41,8	sleep6	0	-21	swapper/6	07:06:30	6
1880243	2	47	21,8	sleep5	0	-21	swapper/5	07:07:41	5
1880254	2	41	7,30	sleep7	0	-21	swapper/7	07:07:51	7
1880222	2	39	27,8	sleep4	0	-21	swapper/4	07:07:24	4
1880579	99	36	34,2	cyclictest	2030070	-21	kworker/u16:0+events_unbound	08:33:18	6
1880567	99	35	32,2	cyclictest	1971609	-21	kworker/u16:3+events_unbound	07:58:17	4
1880579	99	33	31,2	cyclictest	2020032	-21	kworker/u16:1+events_unbound	08:43:47	6
1880579	99	32	30,2	cyclictest	2020032	-21	kworker/u16:1+events_unbound	09:18:11	6
1880579	99	32	30,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	10:43:18	6
1880579	99	32	30,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	10:43:18	6
1880581	99	31	30,0	cyclictest	0	-21	swapper/7	10:53:18	7
1880579	99	31	29,2	cyclictest	2361381	-21	kworker/u16:1+flush-8:0	11:48:31	6
1880576	99	31	29,2	cyclictest	2325080	-21	kworker/u16:3+flush-8:0	10:58:16	5
1880581	99	30	29,0	cyclictest	0	-21	swapper/7	08:15:27	7
1880581	99	30	24,5	cyclictest	2388271	-21	latency_hist	11:28:16	7
1880579	99	30	27,2	cyclictest	1613916	-21	kworker/u16:3+flush-8:0	07:28:18	6
1880579	99	29	27,2	cyclictest	2500059	-21	kworker/u16:1+flush-8:0	12:28:39	6
1880579	99	29	27,2	cyclictest	2272085	-21	kworker/u16:0+flush-8:0	11:16:14	6
1880579	99	29	27,2	cyclictest	2020032	-21	kworker/u16:1+events_unbound	08:56:51	6
1880579	99	29	27,2	cyclictest	1951945	-21	kworker/u16:2+events_unbound	08:26:47	6
1880581	99	28	27,0	cyclictest	0	-21	swapper/7	07:35:31	7
1880581	99	28	27,0	cyclictest	0	-21	swapper/7	07:35:31	7
1880576	99	28	26,2	cyclictest	2325080	-21	kworker/u16:3+flush-8:0	11:03:16	5
1880576	99	28	25,2	cyclictest	2451964	-21	kworker/u16:3+flush-8:0	12:13:31	5
1880567	99	28	26,2	cyclictest	1951945	-21	kworker/u16:2+events_unbound	07:43:30	4
1880581	99	27	26,0	cyclictest	0	-21	swapper/7	07:08:19	7
1880579	99	27	25,2	cyclictest	2030070	-21	kworker/u16:0+events_unbound	09:39:23	6
1880579	99	27	25,2	cyclictest	2030070	-21	kworker/u16:0+events_unbound	08:51:27	6
1880579	99	27	24,2	cyclictest	2456523	-21	kworker/u16:4+events_unbound	12:18:28	6
1880579	99	27	24,2	cyclictest	2272085	-21	kworker/u16:0+events_unbound	10:28:17	6
1880579	99	27	24,2	cyclictest	1999831	-21	kworker/u16:6+flush-8:0	09:18:26	6
1880567	99	27	25,2	cyclictest	2361381	-21	kworker/u16:1+events_unbound	11:28:30	4
1880579	99	26	24,2	cyclictest	2475939	-21	kworker/u16:0+flush-8:0	12:33:43	6
1880579	99	26	24,2	cyclictest	2272085	-21	kworker/u16:0+events_unbound	11:10:10	6
1880579	99	26	24,2	cyclictest	1912945	-21	kworker/u16:1+events_unbound	07:50:32	6
1880579	99	26	24,2	cyclictest	1912945	-21	kworker/u16:1+events_unbound	07:45:31	6
1880579	99	26	23,2	cyclictest	2456523	-21	kworker/u16:4+events_unbound	12:23:17	6
1880576	99	26	24,2	cyclictest	2165471	-21	kworker/u16:1+flush-8:0	09:33:42	5
1880576	99	26	24,2	cyclictest	2030070	-21	kworker/u16:0+events_unbound	08:58:29	5
1880581	99	25	25,0	cyclictest	0	-21	swapper/7	11:41:22	7
1880581	99	25	24,0	cyclictest	0	-21	swapper/7	10:39:23	7
1880581	99	25	24,0	cyclictest	0	-21	swapper/7	10:23:34	7
1880579	99	25	23,2	cyclictest	2378843	-21	kworker/u16:2+flush-8:0	11:53:37	6
1880579	99	25	23,2	cyclictest	2378843	-21	kworker/u16:2+events_unbound	11:36:27	6
1880579	99	25	23,2	cyclictest	2378843	-21	kworker/u16:2+events_unbound	11:36:27	6
1880579	99	25	23,2	cyclictest	2234488	-21	kworker/u16:1+events_unbound	10:08:38	6
1880579	99	25	23,2	cyclictest	2176363	-21	kworker/u16:2+events_unbound	09:48:46	6
1880579	99	25	23,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	09:43:51	6
1880567	99	25	23,2	cyclictest	2020032	-21	kworker/u16:1+events_unbound	08:48:31	4
1880581	99	24	23,0	cyclictest	0	-21	swapper/7	10:37:22	7
1880579	99	24	22,2	cyclictest	2234488	-21	kworker/u16:1+flush-8:0	10:23:22	6
1880579	99	24	22,2	cyclictest	1999831	-21	kworker/u16:6+flush-8:0	09:33:16	6
1880576	99	24	23,1	cyclictest	2176363	-21	kworker/u16:2+flush-8:0	10:08:16	5
1880576	99	24	21,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	09:38:29	5
1880581	99	23	22,0	cyclictest	0	-21	swapper/7	10:49:27	7
1880581	99	23	22,0	cyclictest	0	-21	swapper/7	08:43:26	7
1880581	99	23	0,21	cyclictest	2482574	-21	grep	12:13:37	7
1880579	99	23	21,2	cyclictest	2451964	-21	kworker/u16:3+events_unbound	11:59:17	6
1880579	99	23	21,2	cyclictest	2378843	-21	kworker/u16:2+events_unbound	11:39:27	6
1880579	99	23	21,2	cyclictest	2113997	-21	kworker/u16:3+events_unbound	09:06:35	6
1880579	99	23	21,2	cyclictest	2113997	-21	kworker/u16:3+events_unbound	09:06:35	6
1880579	99	23	21,2	cyclictest	1912945	-21	kworker/u16:1+events_unbound	07:53:50	6
1880576	99	23	21,2	cyclictest	2030070	-21	kworker/u16:0+events_unbound	08:38:33	5
1880576	99	23	20,2	cyclictest	2176363	-21	kworker/u16:2+events_unbound	09:58:34	5
1880576	99	23	20,2	cyclictest	1999831	-21	kworker/u16:6+flush-8:0	08:18:39	5
1880576	99	23	20,2	cyclictest	1951945	-21	kworker/u16:2+flush-8:0	08:23:35	5
1880581	99	22	21,0	cyclictest	0	-21	swapper/7	10:14:54	7
1880581	99	22	21,0	cyclictest	0	-21	swapper/7	08:49:31	7
1880581	99	22	0,20	cyclictest	2514516	-21	cat	12:33:16	7
1880579	99	22	20,2	cyclictest	2378843	-21	kworker/u16:2+events_unbound	12:12:27	6
1880579	99	22	20,2	cyclictest	2320656	-21	kworker/u16:2+events_unbound	11:01:54	6
1880579	99	22	20,2	cyclictest	2234488	-21	kworker/u16:1+flush-8:0	10:53:34	6
1880579	99	22	20,2	cyclictest	2234488	-21	kworker/u16:1+events_unbound	10:16:45	6
1880579	99	22	20,2	cyclictest	2210049	-21	kworker/u16:1+events_unbound	10:01:28	6
1880579	99	22	20,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	09:58:07	6
1880576	99	22	20,2	cyclictest	2176363	-21	kworker/u16:2+flush-8:0	09:53:11	5
1880567	99	22	20,2	cyclictest	2068101	-21	kworker/u16:2+events_unbound	08:43:30	4
1880581	99	21	20,0	cyclictest	0	-21	swapper/7	09:11:34	7
1880581	99	21	20,0	cyclictest	0	-21	swapper/7	09:11:34	7
1880581	99	21	20,0	cyclictest	0	-21	swapper/7	08:37:26	7
1880581	99	21	19,1	cyclictest	1900890	-21	kthreadcore	07:13:38	7
1880579	99	21	19,2	cyclictest	2361381	-21	kworker/u16:1+events_unbound	11:47:22	6
1880579	99	21	19,2	cyclictest	2165471	-21	kworker/u16:1+events_unbound	09:38:03	6
1880579	99	21	19,2	cyclictest	2030070	-21	kworker/u16:0+events_unbound	09:23:45	6
1880576	99	21	19,2	cyclictest	2020032	-21	kworker/u16:1+events_unbound	09:18:37	5
1880576	99	21	19,2	cyclictest	1912945	-21	kworker/u16:1+events_unbound	07:28:43	5
1880576	99	21	18,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	11:13:29	5
1880581	99	20	20,0	cyclictest	0	-21	swapper/7	07:47:21	7
1880579	99	20	18,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	11:04:30	6
1880579	99	20	18,2	cyclictest	1981427	-21	kworker/u16:4+events_unbound	08:01:46	6
1880579	99	20	18,2	cyclictest	1890136	-21	kworker/u16:0+events_unbound	07:25:33	6
1880576	99	20	18,2	cyclictest	2432631	-21	kworker/u16:0+flush-8:0	11:48:47	5
1880581	99	19	18,0	cyclictest	0	-21	swapper/7	12:09:09	7
1880581	99	19	18,0	cyclictest	0	-21	swapper/7	10:07:22	7
1880581	99	19	18,0	cyclictest	0	-21	swapper/7	09:34:58	7
1880581	99	19	15,3	cyclictest	1267	-21	snmpd	11:20:05	7
1880579	99	19	17,2	cyclictest	2451964	-21	kworker/u16:3+flush-8:0	12:13:38	6
1880579	99	19	17,2	cyclictest	2176363	-21	kworker/u16:2+flush-8:0	10:08:16	6
1880579	99	19	17,2	cyclictest	1999831	-21	kworker/u16:6+events_unbound	08:29:51	6
1880576	99	19	17,2	cyclictest	1999831	-21	kworker/u16:6+flush-8:0	10:43:46	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17