OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Sun Feb 01, 2026 12:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2245589	99	113	105,6	cyclictest	2345150	-21	kworker/u4:1+events_unbound	10:39:29	0
2245589	99	110	102,6	cyclictest	2345151	-21	kworker/u4:2+events_unbound	11:09:34	0
2245589	99	100	92,6	cyclictest	2192243	-21	kworker/u4:10+events_unbound	07:43:59	0
2245591	99	99	91,6	cyclictest	2309427	-21	kworker/u4:9+events_unbound	09:54:15	1
2245589	99	96	89,5	cyclictest	2375310	-21	kworker/u4:0+events_unbound	11:04:31	0
2245591	99	93	85,6	cyclictest	2296603	-21	kworker/u4:11+events_unbound	09:34:12	1
2245589	99	93	84,7	cyclictest	2340708	-21	kworker/u4:7+events_unbound	10:29:26	0
2245589	99	91	84,5	cyclictest	2264766	-21	kworker/u4:5+events_unbound	08:49:06	0
2245591	99	90	81,7	cyclictest	2392754	-21	kworker/u4:5+events_unbound	11:39:41	1
2245589	99	85	78,5	cyclictest	2245587	-21	cyclictest	11:40:09	0
2245589	99	85	78,5	cyclictest	2245587	-21	cyclictest	11:40:09	0
2245589	99	85	72,10	cyclictest	54	-21	kswapd0	10:30:09	0
2245591	99	81	73,6	cyclictest	2345151	-21	kworker/u4:2+events_unbound	11:14:35	1
2245589	99	78	63,11	cyclictest	2433571	-21	latency_hist	12:10:01	0
2245589	99	76	71,3	cyclictest	2266025	-21	kworker/u4:15+events_unbound	08:29:05	0
2245589	99	76	69,5	cyclictest	2192243	-21	kworker/u4:10+events_unbound	07:28:57	0
2245589	99	75	67,6	cyclictest	2323485	-21	kworker/u4:5+events_unbound	10:09:22	0
2245589	99	74	55,16	cyclictest	2449082	-21	kworker/u4:11+events_unbound	12:29:50	0
2245589	99	74	55,16	cyclictest	2449082	-21	kworker/u4:11+events_unbound	12:29:50	0
2245589	99	73	65,6	cyclictest	2256996	-21	kworker/u4:2+events_unbound	08:24:05	0
2245589	99	73	65,6	cyclictest	2256996	-21	kworker/u4:2+events_unbound	08:24:05	0
2245591	99	72	65,5	cyclictest	2246797	-21	kworker/u4:8+events_unbound	07:13:54	1
2245591	99	70	62,6	cyclictest	2223030	-21	kworker/u4:2+events_unbound	07:23:58	1
2245589	99	68	61,5	cyclictest	2266022	-21	kworker/u4:10+events_unbound	08:39:06	0
2245589	99	68	61,5	cyclictest	2266022	-21	kworker/u4:10+events_unbound	08:39:05	0
2245589	99	68	30,32	cyclictest	0	-21	swapper/0	09:55:27	0
2245589	99	67	60,5	cyclictest	2253118	-21	kworker/u4:7+events_unbound	08:19:04	0
2245589	99	67	59,6	cyclictest	2192243	-21	kworker/u4:10+events_unbound	08:09:02	0
2245591	99	66	60,4	cyclictest	2331728	-21	kworker/u4:15+events_unbound	10:14:23	1
2245589	99	66	56,7	cyclictest	2436025	-21	kworker/u4:5+xprtiod	12:15:11	0
2245589	99	64	6,54	cyclictest	0	-21	swapper/0	10:40:23	0
2245591	99	63	54,7	cyclictest	2352350	-21	systemd-tmpfile	10:35:23	1
2245591	99	63	54,6	cyclictest	2263485	-21	kworker/u4:4+events_unbound	08:59:07	1
2245589	99	59	52,5	cyclictest	2266023	-21	kworker/u4:12+events_unbound	09:04:08	0
2245591	99	58	52,4	cyclictest	2345155	-21	kworker/u4:6+events_unbound	10:49:31	1
2245591	99	57	48,6	cyclictest	2308386	-21	sshd	09:45:22	1
2245591	99	57	47,8	cyclictest	2441883	-21	systemd	12:19:48	1
2245589	99	57	47,7	cyclictest	2334746	-21	/usr/sbin/munin	10:15:24	0
2245589	99	57	38,14	cyclictest	2400072	-21	ps	11:30:36	0
2245591	99	56	49,5	cyclictest	2348952	-21	kworker/u4:9+events_unbound	10:35:00	1
2245591	99	56	49,5	cyclictest	2323482	-21	kworker/u4:1+events_unbound	10:04:21	1
2245591	99	56	48,6	cyclictest	2269899	-21	kworker/u4:18+events_unbound	09:24:10	1
2245589	99	56	48,6	cyclictest	2345155	-21	kworker/u4:6+events_unbound	10:56:59	0
2245591	99	55	48,5	cyclictest	2388338	-21	kworker/u4:4+events_unbound	12:34:51	1
2245589	99	55	36,16	cyclictest	0	-21	swapper/0	09:50:26	0
2245591	99	54	48,4	cyclictest	2336204	-21	kworker/u4:3+events_unbound	10:17:59	1
2245591	99	54	47,5	cyclictest	2414668	-21	kworker/u4:8+events_unbound	11:49:43	1
2245591	99	54	44,6	cyclictest	0	-21	swapper/1	11:55:19	1
2245589	99	54	47,5	cyclictest	2418431	-21	kworker/u4:18+events_unbound	11:52:01	0
2245589	99	54	47,5	cyclictest	2253118	-21	kworker/u4:7+events_unbound	08:01:01	0
2245589	99	53	46,5	cyclictest	2401508	-21	kworker/u4:15+events_unbound	11:48:00	0
2245589	99	53	43,8	cyclictest	2425222	-21	ssh	12:00:15	0
2245591	99	52	44,6	cyclictest	2264767	-21	kworker/u4:6+events_unbound	09:09:09	1
2245591	99	52	44,5	cyclictest	2387316	-21	timerwakeupswit	11:15:40	1
2245589	99	52	44,6	cyclictest	2392752	-21	kworker/u4:2+events_unbound	11:59:59	0
2245589	99	52	44,6	cyclictest	0	-21	swapper/0	11:15:28	0
2245589	99	52	3,26	cyclictest	2277447	-21	ssh	09:10:22	0
2245589	99	52	24,18	cyclictest	54	-21	kswapd0	12:10:11	0
2245591	99	51	45,4	cyclictest	2281660	-21	/usr/sbin/munin	09:15:23	1
2245591	99	51	39,10	cyclictest	2257031	-21	kworker/u4:2	07:55:01	1
2245591	99	51	21,14	cyclictest	2444101	-21	kworker/u4:10+events_unbound	12:39:54	1
2245589	99	51	43,6	cyclictest	2442341	-21	/usr/sbin/munin	12:20:12	0
2245591	99	50	44,4	cyclictest	2392752	-21	kworker/u4:2+events_unbound	11:40:03	1
2245591	99	50	44,4	cyclictest	2392752	-21	kworker/u4:2+events_unbound	11:40:02	1
2245591	99	50	44,4	cyclictest	2259542	-21	systemd	08:04:01	1
2245591	99	50	43,5	cyclictest	2375310	-21	kworker/u4:0+events_unbound	11:05:14	1
2245591	99	50	43,5	cyclictest	2255713	-21	dpkg	07:50:01	1
2245591	99	50	42,6	cyclictest	2292100	-21	kworker/u4:8+events_unbound	10:09:00	1
2245589	99	50	42,6	cyclictest	2192243	-21	kworker/u4:10+events_unbound	07:45:02	0
2245589	99	50	40,7	cyclictest	2308490	-21	ntpq	09:45:28	0
2245589	99	50	30,16	cyclictest	0	-21	swapper/0	11:15:01	0
2245591	99	49	42,5	cyclictest	2269133	-21	sshd	08:40:22	1
2245591	99	49	40,7	cyclictest	2443316	-21	ssh	12:20:38	1
2245591	99	49	40,7	cyclictest	2263919	-21	df_abs	08:20:15	1
2245591	99	49	40,7	cyclictest	2263919	-21	df_abs	08:20:15	1
2245589	99	49	8,22	cyclictest	2304191	-21	ssh	09:40:32	0
2245589	99	49	43,4	cyclictest	2283740	-21	kworker/u4:2+events_unbound	09:24:59	0
2245589	99	49	42,5	cyclictest	2345150	-21	kworker/u4:1+events_unbound	10:45:01	0
2245589	99	49	42,5	cyclictest	2282499	-21	sed	09:15:42	0
2245589	99	49	42,5	cyclictest	2249346	-21	kworker/u4:1+events_unbound	07:23:01	0
2245589	99	49	30,16	cyclictest	0	-21	swapper/0	10:55:01	0
2245591	99	48	43,3	cyclictest	2388338	-21	kworker/u4:4+events_unbound	12:15:00	1
2245591	99	48	42,4	cyclictest	2277901	-21	timerandwakeup	09:10:37	1
2245591	99	48	41,5	cyclictest	2394273	-21	systemd	11:24:35	1
2245591	99	48	41,5	cyclictest	2364815	-21	aten_r7power_po	10:50:17	1
2245591	99	48	41,5	cyclictest	2274404	-21	fschecks_time	09:00:20	1
2245591	99	48	37,6	cyclictest	2017898	-21	kworker/u4:9+events_unbound	08:14:02	1
2245591	99	48	37,6	cyclictest	2017898	-21	kworker/u4:9+events_unbound	08:14:02	1
2245589	99	48	40,5	cyclictest	2272536	-21	idleruntime-cro	08:55:00	0
2245589	99	48	39,7	cyclictest	2275471	-21	aten_r7power_en	09:05:21	0
2245589	99	48	38,7	cyclictest	2267315	-21	apt-get	08:35:01	0
2245591	99	47	39,5	cyclictest	2290847	-21	diskmemload	09:25:31	1
2245591	99	47	39,5	cyclictest	0	-21	swapper/1	11:30:13	1
2245591	99	47	28,6	cyclictest	2388338	-21	kworker/u4:4+events_unbound	12:05:00	1
2245591	99	47	27,14	cyclictest	0	-21	swapper/1	11:00:29	1
2245589	99	47	40,5	cyclictest	2269899	-21	kworker/u4:18+events_unbound	09:37:04	0
2245589	99	47	40,5	cyclictest	2253118	-21	kworker/u4:7+events_unbound	08:00:00	0
2245589	99	47	39,6	cyclictest	2266022	-21	kworker/u4:10+events_unbound	08:58:43	0
2245589	99	47	28,16	cyclictest	0	-21	swapper/0	09:25:23	0
2245591	99	46	39,4	cyclictest	0	-21	swapper/1	08:05:28	1
2245591	99	46	37,7	cyclictest	2245587	-21	cyclictest	08:52:26	1
2245591	99	46	37,6	cyclictest	2345151	-21	kworker/u4:2+events_unbound	10:40:23	1
2245591	99	46	36,7	cyclictest	2416400	-21	acpi	11:50:09	1
2245589	99	46	39,5	cyclictest	2407486	-21	munin-run	11:40:00	0
2245589	99	46	39,5	cyclictest	2338667	-21	aten_r7power_en	10:20:15	0
2245589	99	46	39,5	cyclictest	2294873	-21	fschecks_time	09:30:22	0
2245589	99	46	39,5	cyclictest	2246792	-21	kworker/u4:6+events_unbound	07:12:01	0
2245589	99	46	38,6	cyclictest	2330761	-21	mailstats	10:10:38	0
2245589	99	46	37,7	cyclictest	2394691	-21	latency_hist	11:25:01	0
2245589	99	46	27,6	cyclictest	2245587	-21	cyclictest	10:01:06	0
2245591	99	45	36,7	cyclictest	2270537	-21	/usr/sbin/munin	08:45:24	1
2245589	99	45	5,33	cyclictest	0	-21	swapper/0	07:50:21	0
2245589	99	45	37,6	cyclictest	2451910	-21	sh	12:30:37	0
2245589	99	45	37,6	cyclictest	2398944	-21	latency_hist	11:30:01	0
2245589	99	45	37,6	cyclictest	2251863	-21	kworker/u4:4+events_unbound	07:34:00	0
2245589	99	45	37,5	cyclictest	2247349	-21	gltestperf	07:15:20	0
2245589	99	45	36,7	cyclictest	2261150	-21	aten_r7power_en	08:10:17	0
2245589	99	45	36,7	cyclictest	2261150	-21	aten_r7power_en	08:10:16	0
2245591	99	44	38,4	cyclictest	2395076	-21	df_abs	11:25:17	1
2245591	99	44	37,5	cyclictest	2343538	-21	/usr/sbin/munin	10:25:24	1
2245591	99	44	37,5	cyclictest	2252323	-21	fschecks_count	07:35:18	1
2245591	99	44	34,8	cyclictest	2317071	-21	if_eth0	09:55:22	1
2245591	99	44	28,5	cyclictest	2345151	-21	kworker/u4:2+events_unbound	11:00:01	1
2245589	99	44	26,16	cyclictest	2455502	-21	fschecks_count	12:35:24	0
2245591	99	43	38,4	cyclictest	2256997	-21	kworker/u4:11+events_unbound	08:15:44	1
2245591	99	43	37,4	cyclictest	2336202	-21	kworker/u4:0+events_unbound	10:24:24	1
2245591	99	43	37,4	cyclictest	2258262	-21	systemd	07:59:00	1
2245591	99	43	35,6	cyclictest	2303529	-21	aten_r7power_vo	09:40:18	1
2245591	99	43	35,6	cyclictest	2264767	-21	kworker/u4:6-rpciod	08:30:17	1
2245591	99	43	17,12	cyclictest	17	1	rcu_preempt	09:35:24	1
2245589	99	43	34,7	cyclictest	2269131	-21	fschecks_count	08:40:23	0
2245591	99	42	35,5	cyclictest	2251862	-21	kworker/u4:2+events_unbound	07:40:42	1
2245591	99	42	35,4	cyclictest	2348952	-21	kworker/u4:9-rpciod	12:05:28	1
2245591	99	42	32,8	cyclictest	2268064	-21	kernelversion	08:35:26	1
2245591	99	42	32,8	cyclictest	2268064	-21	kernelversion	08:35:26	1
2245591	99	41	34,5	cyclictest	2251064	-21	fschecks_count	07:30:20	1
2245591	99	41	30,9	cyclictest	2447181	-21	kernelversion	12:25:22	1
2245591	99	41	30,9	cyclictest	2447181	-21	kernelversion	12:25:22	1
2245589	99	41	32,7	cyclictest	2252303	-21	fschecks_count	07:35:19	0
2245591	99	40	34,4	cyclictest	2247189	-21	grep	07:15:17	1
2245591	99	40	33,4	cyclictest	0	-21	swapper/1	08:25:34	1
2245591	99	38	30,6	cyclictest	0	-21	swapper/1	07:25:34	1
2245591	99	36	27,7	cyclictest	2245623	-21	latency_hist	07:10:01	1
2245589	99	27	21,4	cyclictest	247	50	irq/20-imx-lcdifv3-crtc.0	07:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17