OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sun Feb 01, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1758770	2	54	19,30	sleep7	0	-21	swapper/7	07:03:07	7
1758776	2	53	43,7	sleep4	0	-21	swapper/4	07:03:12	4
1758787	2	50	40,7	sleep6	0	-21	swapper/6	07:03:22	6
1758768	2	50	40,7	sleep5	0	-21	swapper/5	07:03:05	5
1759314	99	44	40,3	cyclictest	2017513	-21	kworker/u16:2+flush-8:0	09:16:34	5
1759322	99	43	0,41	cyclictest	2055347	-21	pool-gnome-soft	09:28:34	7
1759314	99	43	41,2	cyclictest	2258249	-21	kworker/u16:2+flush-8:0	11:36:33	5
1759314	99	43	41,2	cyclictest	2258249	-21	kworker/u16:2+flush-8:0	11:36:33	5
1759314	99	43	41,2	cyclictest	2258249	-21	kworker/u16:2+flush-8:0	11:17:03	5
1759314	99	41	39,2	cyclictest	2119027	-21	kworker/u16:3+flush-8:0	10:11:33	5
1759322	99	36	29,5	cyclictest	2254775	-21	latency_hist	10:51:33	7
1759314	99	36	34,2	cyclictest	2390746	-21	kworker/u16:0+events_unbound	12:16:52	5
1759314	99	36	34,2	cyclictest	2119027	-21	kworker/u16:3+flush-8:0	12:02:02	5
1759314	99	36	34,2	cyclictest	2032400	-21	kworker/u16:4+flush-8:0	09:36:29	5
1759314	99	36	34,2	cyclictest	2032400	-21	kworker/u16:4+flush-8:0	09:36:29	5
1759314	99	35	33,2	cyclictest	2476101	-21	kworker/u16:3+events_unbound	12:32:08	5
1759312	99	35	33,2	cyclictest	2055493	-21	kworker/u16:1+flush-8:0	09:46:34	4
1759322	99	34	27,6	cyclictest	2452456	-21	latency_hist	12:11:33	7
1759314	99	34	32,2	cyclictest	2489503	-21	kworker/u16:2+events_unbound	12:27:00	5
1759314	99	32	30,2	cyclictest	2390746	-21	kworker/u16:0+events_unbound	12:21:49	5
1759314	99	30	29,1	cyclictest	2105210	-21	kworker/u16:2+events_unbound	10:26:52	5
1759314	99	30	28,2	cyclictest	2241088	-21	kworker/u16:1+flush-8:0	10:46:51	5
1831153	2	28	0,1	chrt	1831152	-21	sshd-session	07:41:36	7
1759322	99	28	0,27	cyclictest	2032360	-21	latency_hist	09:21:34	7
1759314	99	28	26,2	cyclictest	2105210	-21	kworker/u16:2+events_unbound	09:57:37	5
1759314	99	28	26,2	cyclictest	2055493	-21	kworker/u16:1+events_unbound	09:36:52	5
1759314	99	28	26,2	cyclictest	2032400	-21	kworker/u16:4+flush-8:0	09:41:56	5
1759312	99	28	26,2	cyclictest	2241088	-21	kworker/u16:1+flush-8:0	11:42:42	4
2377716	2	27	0,1	chrt	2377717	-21	sh	11:40:25	7
1759317	99	27	25,2	cyclictest	1840464	-21	kworker/u16:0+events_unbound	09:06:47	6
1759314	99	27	25,2	cyclictest	2258249	-21	kworker/u16:2+events_unbound	12:01:28	5
1759314	99	26	24,2	cyclictest	2119027	-21	kworker/u16:3+events_unbound	11:27:04	5
1759314	99	26	24,2	cyclictest	2082095	-21	kworker/u16:0+flush-8:0	10:21:33	5
1759314	99	26	23,2	cyclictest	2119027	-21	kworker/u16:3+events_unbound	10:31:49	5
1759317	99	25	23,2	cyclictest	1783527	-21	kworker/u16:0+events_unbound	07:21:48	6
1759314	99	25	23,2	cyclictest	2390746	-21	kworker/u16:0+flush-8:0	12:06:51	5
1759314	99	25	23,2	cyclictest	2258249	-21	kworker/u16:2+events_unbound	11:11:28	5
1759314	99	25	23,2	cyclictest	1840464	-21	kworker/u16:0+flush-8:0	09:07:36	5
1759317	99	23	20,2	cyclictest	1730133	-21	kworker/u16:1+events_unbound	07:41:48	6
1759314	99	23	21,2	cyclictest	2119027	-21	kworker/u16:3+events_unbound	11:53:44	5
1759314	99	23	21,2	cyclictest	2119027	-21	kworker/u16:3+events_unbound	10:57:00	5
1759314	99	23	20,2	cyclictest	1730133	-21	kworker/u16:1+flush-8:0	08:26:54	5
1759312	99	23	20,2	cyclictest	2105210	-21	kworker/u16:2+flush-8:0	10:06:57	4
2342161	2	22	0,1	chrt	0	-21	swapper/6	11:26:45	6
2077210	2	22	0,1	chrt	2077211	-21	grep	09:36:59	7
1759314	99	22	20,2	cyclictest	2258249	-21	kworker/u16:2+events_unbound	11:46:58	5
1759322	99	21	0,20	cyclictest	2489462	-21	latency_hist	12:26:33	7
1759314	99	21	19,2	cyclictest	2119027	-21	kworker/u16:3+events_unbound	11:01:49	5
1759322	99	20	15,4	cyclictest	2464821	-21	latency_hist	12:16:33	7
1759322	99	20	15,4	cyclictest	2464821	-21	latency_hist	12:16:33	7
1759317	99	20	17,2	cyclictest	2032400	-21	kworker/u16:4+flush-8:0	09:46:44	6
1759314	99	20	18,2	cyclictest	2241088	-21	kworker/u16:1+flush-8:0	11:12:31	5
1759314	99	20	18,2	cyclictest	2119027	-21	kworker/u16:3+events_unbound	10:53:43	5
1759314	99	20	18,2	cyclictest	2119027	-21	kworker/u16:3+events_unbound	10:53:43	5
1759322	99	19	14,4	cyclictest	2316482	-21	latency_hist	11:16:34	7
1759322	99	19	0,17	cyclictest	0	-21	swapper/7	08:36:59	7
1759314	99	19	17,2	cyclictest	1730133	-21	kworker/u16:1+events_unbound	08:01:58	5
1759312	99	19	15,3	cyclictest	1869494	-21	kworker/u16:3+flush-8:0	08:37:00	4
1759317	99	18	16,2	cyclictest	2105210	-21	kworker/u16:2+flush-8:0	09:56:39	6
1759317	99	18	15,2	cyclictest	2055493	-21	kworker/u16:1+flush-8:0	09:31:54	6
1759317	99	18	15,2	cyclictest	2055493	-21	kworker/u16:1+flush-8:0	09:31:54	6
1759317	99	18	15,2	cyclictest	1046464	-21	kworker/u16:3+events_unbound	07:11:36	6
1759314	99	18	14,3	cyclictest	2119027	-21	kworker/u16:3+events_unbound	11:24:00	5
1759314	99	18	14,3	cyclictest	1955531	-21	kworker/u16:2+flush-8:0	08:54:29	5
1759312	99	18	15,3	cyclictest	1985982	-21	kworker/u16:3+flush-8:0	09:37:36	4
1759322	99	17	6,4	cyclictest	5944	-21	gmain	10:44:55	7
1759322	99	17	14,2	cyclictest	1267	-21	snmpd	12:21:09	7
1759322	99	17	11,5	cyclictest	1975914	-21	latency_hist	08:56:34	7
1759317	99	17	14,2	cyclictest	2082095	-21	kworker/u16:0+flush-8:0	10:36:34	6
1759314	99	17	15,2	cyclictest	1730133	-21	kworker/u16:1+events_unbound	08:11:50	5
1759312	99	17	14,2	cyclictest	2017513	-21	kworker/u16:2+events_unbound	09:26:49	4
1759322	99	16	9,6	cyclictest	0	-21	swapper/7	09:06:48	7
1759322	99	16	13,2	cyclictest	0	-21	swapper/7	09:56:34	7
1759317	99	16	14,2	cyclictest	1730133	-21	kworker/u16:1+events_unbound	07:36:49	6
1759317	99	16	13,2	cyclictest	2119027	-21	kworker/u16:3+flush-8:0	11:51:34	6
1759314	99	16	14,2	cyclictest	2055493	-21	kworker/u16:1+events_unbound	09:55:44	5
1759314	99	16	14,2	cyclictest	2032400	-21	kworker/u16:4+events_unbound	09:46:56	5
1759314	99	16	14,2	cyclictest	1046464	-21	kworker/u16:3+events_unbound	07:11:40	5
1759314	99	16	13,3	cyclictest	2390746	-21	kworker/u16:0+flush-8:0	12:12:02	5
1759314	99	16	13,3	cyclictest	2390746	-21	kworker/u16:0+flush-8:0	12:12:02	5
1759312	99	16	13,2	cyclictest	1840464	-21	kworker/u16:0+flush-8:0	08:46:52	4
1759322	99	15	8,6	cyclictest	0	-21	swapper/7	11:21:48	7
1759322	99	15	7,7	cyclictest	5944	-21	gmain	07:57:00	7
1759322	99	15	7,7	cyclictest	0	-21	swapper/7	11:41:50	7
1759322	99	15	7,7	cyclictest	0	-21	swapper/7	11:01:46	7
1759322	99	15	5,3	cyclictest	1995300	-21	diskmemload	11:47:14	7
1759322	99	15	10,4	cyclictest	2193041	-21	latency_hist	10:26:34	7
1759322	99	15	0,14	cyclictest	0	-21	swapper/7	08:46:59	7
1759317	99	15	13,2	cyclictest	2119027	-21	kworker/u16:3+flush-8:0	11:57:08	6
1759314	99	15	13,2	cyclictest	2258249	-21	kworker/u16:2+events_unbound	11:42:03	5
1759314	99	15	13,2	cyclictest	2241088	-21	kworker/u16:1+events_unbound	10:45:24	5
1759314	99	15	13,2	cyclictest	1985982	-21	kworker/u16:3+flush-8:0	09:29:05	5
1759314	99	15	13,2	cyclictest	1730133	-21	kworker/u16:1+flush-8:0	08:17:05	5
1759322	99	14	9,4	cyclictest	2416688	-21	cat	11:56:49	7
1759322	99	14	9,4	cyclictest	1267	-21	snmpd	07:06:46	7
1759322	99	14	5,8	cyclictest	2166246	-21	ssh	10:12:49	7
1759322	99	14	5,8	cyclictest	2166246	-21	ssh	10:12:49	7
1759322	99	14	5,7	cyclictest	0	-21	swapper/7	09:21:43	7
1759322	99	14	4,9	cyclictest	2300888	-21	ntpq	11:07:00	7
1759322	99	14	4,9	cyclictest	2276815	-21	unixbench_singl	10:57:07	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17