OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Wed Jun 03, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2459598	99	104	95,7	cyclictest	2507819	-21	kworker/u4:7+events_unbound	21:32:31	1
2459598	99	100	91,6	cyclictest	2503268	-21	kworker/u4:2+events_unbound	22:02:34	1
2459598	99	92	83,7	cyclictest	2622123	-21	kworker/u4:0+events_unbound	00:18:03	1
2459598	99	92	83,6	cyclictest	2661171	-21	kworker/u4:2+events_unbound	00:38:08	1
2459598	99	92	74,7	cyclictest	2639759	-21	kworker/u4:11+events_unbound	00:02:59	1
2459598	99	89	81,6	cyclictest	2471741	-21	kworker/u4:12+events_unbound	20:57:24	1
2459598	99	89	79,7	cyclictest	2521448	-21	kworker/u4:9+events_unbound	21:52:34	1
2459598	99	88	79,6	cyclictest	2482056	-21	kworker/u4:5+events_unbound	21:17:28	1
2459597	99	81	21,57	cyclictest	256	50	irq/23-42890000.ethernet	21:35:12	0
2459597	99	81	21,57	cyclictest	256	50	irq/23-42890000.ethernet	21:35:11	0
2459598	99	80	72,5	cyclictest	2474287	-21	kworker/u4:4+events_unbound	20:20:01	1
2459597	99	76	67,6	cyclictest	2512374	-21	kworker/u4:0+xprtiod	21:55:11	0
2459597	99	72	33,36	cyclictest	2497507	-21	proc_pri	21:20:38	0
2459597	99	71	29,38	cyclictest	0	-21	swapper/0	19:50:23	0
2459597	99	71	28,40	cyclictest	0	-21	swapper/0	21:15:28	0
2459597	99	71	26,43	cyclictest	2581467	-21	ntpq	22:55:35	0
2459597	99	70	29,38	cyclictest	0	-21	swapper/0	21:50:32	0
2459597	99	69	60,7	cyclictest	2530494	-21	kworker/u4:4+events_unbound	22:27:40	0
2459597	99	69	57,9	cyclictest	53	-21	kswapd0	23:00:15	0
2459597	99	69	38,29	cyclictest	2593900	-21	aten_r7power_po	23:10:17	0
2459597	99	69	24,41	cyclictest	2458330	-21	kworker/u4:1-rpciod	20:30:01	0
2459598	99	68	60,6	cyclictest	2652350	-21	kworker/u4:9+events_unbound	00:25:01	1
2459597	99	68	5,15	cyclictest	2572491	-21	ssh	22:45:26	0
2459597	99	67	36,28	cyclictest	2576690	-21	gltestperf	22:50:20	0
2459597	99	67	35,30	cyclictest	2641880	-21	/usr/sbin/munin	00:05:22	0
2459597	99	67	32,31	cyclictest	0	-21	swapper/0	21:25:37	0
2459597	99	66	37,27	cyclictest	2568584	-21	timerwakeupswit	22:40:40	0
2459597	99	66	31,31	cyclictest	0	-21	swapper/0	20:55:37	0
2459597	99	66	30,34	cyclictest	0	-21	swapper/0	23:25:21	0
2459597	99	66	29,5	cyclictest	256	50	irq/23-42890000.ethernet	00:30:29	0
2459597	99	65	57,6	cyclictest	2626541	-21	kworker/u4:9+events_unbound	23:52:58	0
2459597	99	65	30,32	cyclictest	2480996	-21	aten2__	20:45:21	0
2459597	99	65	30,32	cyclictest	0	-21	swapper/0	23:20:40	0
2459597	99	65	29,33	cyclictest	0	-21	swapper/0	00:10:21	0
2459597	99	65	28,34	cyclictest	0	-21	swapper/0	20:05:19	0
2459598	99	64	57,5	cyclictest	2463863	-21	kworker/u4:12+events_unbound	19:35:00	1
2459597	99	64	57,5	cyclictest	2525980	-21	kworker/u4:10+events_unbound	22:12:37	0
2459597	99	64	47,13	cyclictest	2559205	-21	if_eth0	22:30:23	0
2459597	99	64	35,27	cyclictest	2478528	-21	sed	20:35:19	0
2459597	99	64	33,29	cyclictest	2487844	-21	df_abs	21:10:17	0
2459597	99	64	31,30	cyclictest	2545513	-21	aten2__	22:15:17	0
2459597	99	64	2,23	cyclictest	2550747	-21	ntp_states	22:20:37	0
2459597	99	63	55,6	cyclictest	2626541	-21	kworker/u4:9+events_unbound	23:57:59	0
2459597	99	63	32,28	cyclictest	0	-21	swapper/0	22:05:28	0
2459597	99	63	32,28	cyclictest	0	-21	swapper/0	22:05:28	0
2459597	99	63	29,32	cyclictest	2516933	-21	kworker/u4:5-rpciod	22:00:33	0
2459597	99	63	28,31	cyclictest	0	-21	swapper/0	00:20:28	0
2459598	99	62	50,6	cyclictest	2547696	-21	kworker/u4:1+events_unbound	22:35:00	1
2459597	99	62	30,29	cyclictest	0	-21	swapper/0	23:35:14	0
2459597	99	62	26,3	cyclictest	256	50	irq/23-42890000.ethernet	00:30:01	0
2459598	99	61	53,6	cyclictest	2591709	-21	kworker/u4:2+events_unbound	23:15:00	1
2459597	99	61	7,18	cyclictest	2506098	-21	fw_packets	21:30:35	0
2459597	99	61	3,24	cyclictest	2639586	-21	ssh	00:02:16	0
2459597	99	61	26,5	cyclictest	0	-21	swapper/0	22:35:16	0
2459597	99	61	26,32	cyclictest	2654433	-21	latency_hist	00:20:02	0
2459598	99	60	53,5	cyclictest	2644179	-21	kworker/u4:12+events_unbound	00:09:00	1
2459598	99	60	51,6	cyclictest	2498740	-21	kworker/u4:9+events_unbound	21:27:31	1
2459598	99	60	43,6	cyclictest	2460817	-21	kworker/u4:5+events_unbound	19:22:00	1
2459597	99	60	31,27	cyclictest	2667723	-21	ssh	00:35:17	0
2459597	99	60	27,29	cyclictest	0	-21	swapper/0	23:45:06	0
2459597	99	60	26,5	cyclictest	0	-21	swapper/0	21:40:28	0
2459597	99	60	25,7	cyclictest	2507818	-21	kworker/u4:6-xprtiod	21:45:37	0
2459597	99	59	29,27	cyclictest	0	-21	swapper/0	23:30:37	0
2459597	99	59	28,3	cyclictest	0	-21	swapper/0	20:45:02	0
2459597	99	59	26,4	cyclictest	0	-21	swapper/0	21:10:01	0
2459597	99	59	26,31	cyclictest	0	-21	swapper/0	23:46:06	0
2459597	99	59	25,5	cyclictest	0	-21	swapper/0	23:15:46	0
2459597	99	59	24,5	cyclictest	0	-21	swapper/0	23:05:38	0
2459597	99	59	24,4	cyclictest	0	-21	swapper/0	20:00:21	0
2459597	99	59	24,4	cyclictest	0	-21	swapper/0	20:00:21	0
2459598	99	58	39,6	cyclictest	2471741	-21	kworker/u4:12+events_unbound	20:50:00	1
2459597	99	58	46,8	cyclictest	2486005	-21	modprobe	21:05:01	0
2459597	99	58	22,6	cyclictest	0	-21	swapper/0	20:10:15	0
2459598	99	57	49,5	cyclictest	2543267	-21	kworker/u4:15+events_unbound	22:17:01	1
2459598	99	57	47,8	cyclictest	2628949	-21	fschecks_count	23:50:21	1
2459598	99	56	49,5	cyclictest	2450919	-21	kworker/u4:7+events_unbound	19:30:01	1
2459597	99	56	21,6	cyclictest	0	-21	swapper/0	20:35:02	0
2459597	99	56	2,10	cyclictest	2461959	-21	ntp_offset	19:20:29	0
2459598	99	55	39,5	cyclictest	2569408	-21	kworker/u4:7+events_unbound	22:45:17	1
2459598	99	54	46,6	cyclictest	2591709	-21	kworker/u4:2+events_unbound	23:07:47	1
2459598	99	54	44,6	cyclictest	2512375	-21	kworker/u4:1+events_unbound	21:45:02	1
2459598	99	54	43,8	cyclictest	2477764	-21	ps	20:30:37	1
2459597	99	54	46,6	cyclictest	2475597	-21	kworker/u4:13+events_unbound	20:22:14	0
2459598	99	53	5,41	cyclictest	2580639	-21	ssh	22:55:15	1
2459598	99	53	45,6	cyclictest	2525979	-21	kworker/u4:8+events_unbound	22:05:46	1
2459598	99	53	45,6	cyclictest	2525979	-21	kworker/u4:8+events_unbound	22:05:45	1
2459598	99	53	37,6	cyclictest	2447080	-21	kworker/u4:8+events_unbound	19:16:59	1
2459598	99	52	45,3	cyclictest	2571540	-21	ssh	22:45:00	1
2459598	99	52	44,6	cyclictest	2661171	-21	kworker/u4:2+events_unbound	00:28:06	1
2459598	99	52	44,6	cyclictest	2482066	-21	kworker/u4:7+events_unbound	21:13:59	1
2459598	99	51	43,6	cyclictest	2467900	-21	kworker/u4:10+events_unbound	20:07:12	1
2459598	99	51	43,5	cyclictest	2602966	-21	gltestperf	23:20:24	1
2459597	99	51	34,15	cyclictest	2461152	-21	ls	19:20:00	0
2459598	99	50	44,5	cyclictest	2608847	-21	kworker/u4:14+events_unbound	23:28:59	1
2459598	99	50	41,6	cyclictest	2543267	-21	kworker/u4:15+events_unbound	22:15:00	1
2459598	99	49	15,22	cyclictest	0	-21	swapper/1	23:35:35	1
2459597	99	49	41,6	cyclictest	2483312	-21	unixbench_multi	20:50:45	0
2459598	99	48	41,5	cyclictest	2633738	-21	ntp_offset	23:55:32	1
2459598	99	48	41,5	cyclictest	2625584	-21	/usr/sbin/munin	23:45:41	1
2459598	99	48	41,5	cyclictest	2466621	-21	kworker/u4:2+events_unbound	20:05:01	1
2459598	99	48	41,5	cyclictest	2466621	-21	kworker/u4:2+events_unbound	20:05:00	1
2459598	99	48	40,6	cyclictest	2482055	-21	kworker/u4:3+events_unbound	21:07:27	1
2459598	99	48	39,7	cyclictest	2515431	-21	/usr/sbin/munin	21:40:37	1
2459598	99	48	39,7	cyclictest	0	-21	swapper/1	21:55:38	1
2459598	99	48	36,9	cyclictest	53	-21	kswapd0	23:00:13	1
2459598	99	47	41,4	cyclictest	2555003	-21	ld	22:25:27	1
2459598	99	47	40,5	cyclictest	2564300	-21	unixbench_singl	22:35:41	1
2459598	99	46	38,5	cyclictest	2611268	-21	aten_r7power_cu	23:30:16	1
2459598	99	46	37,6	cyclictest	0	-21	swapper/1	00:30:34	1
2459598	99	46	36,7	cyclictest	2482481	-21	aten_r7power_vo	20:50:24	1
2459597	99	46	39,5	cyclictest	2458330	-21	kworker/u4:1+events_unbound	19:42:04	0
2459598	99	45	36,7	cyclictest	2644180	-21	kworker/u4:13-rpciod	00:10:41	1
2459598	99	45	36,7	cyclictest	2596200	-21	kworker/u4:3+events_unbound	23:17:49	1
2459598	99	45	35,7	cyclictest	0	-21	swapper/1	21:20:33	1
2459598	99	45	34,7	cyclictest	0	-21	swapper/1	23:45:06	1
2459598	99	44	37,5	cyclictest	2550023	-21	aten_r7power_po	22:20:18	1
2459598	99	44	36,6	cyclictest	2466583	-21	unixbench_singl	19:45:37	1
2459598	99	44	36,5	cyclictest	2479492	-21	latency_hist	20:40:01	1
2459598	99	44	31,11	cyclictest	2576391	-21	ssh	22:50:17	1
2459597	99	44	36,6	cyclictest	2467899	-21	kworker/u4:7+events_unbound	19:57:07	0
2459598	99	43	35,6	cyclictest	2510581	-21	kernelversion	21:35:22	1
2459598	99	43	35,6	cyclictest	2510581	-21	kernelversion	21:35:22	1
2459597	99	43	34,6	cyclictest	2460141	-21	gltestperf	19:10:19	0
2459597	99	43	33,5	cyclictest	2450919	-21	kworker/u4:7-rpciod	19:10:01	0
2459598	99	42	36,4	cyclictest	2467903	-21	systemd	19:52:06	1
2459598	99	42	27,6	cyclictest	2474287	-21	kworker/u4:4+events_unbound	20:27:17	1
2459598	99	41	33,5	cyclictest	2471741	-21	kworker/u4:12-rpciod	21:00:21	1
2459598	99	40	31,7	cyclictest	533	-21	rs:main		1
2459598	99	40	30,8	cyclictest	557	-21	cron	20:00:01	1
2459598	99	40	29,8	cyclictest	0	-21	swapper/1	20:10:34	1
2459598	99	40	27,10	cyclictest	0	-21	swapper/1	20:40:36	1
2459597	99	40	32,6	cyclictest	2473955	-21	sendmail_mailqu	20:15:36	0
2459597	99	40	31,7	cyclictest	2463155	-21	tail	19:30:16	0
2459597	99	40	31,6	cyclictest	2465680	-21	aten_r7power_vo	19:45:16	0
2459598	99	39	33,4	cyclictest	2475602	-21	systemd	20:22:15	1
2459598	99	39	27,10	cyclictest	0	-21	swapper/1	19:10:37	1
2459597	99	38	19,17	cyclictest	2450919	-21	kworker/u4:7-rpciod	19:30:01	0
2459598	99	37	27,6	cyclictest	0	-21	swapper/1	19:10:02	1
2459598	99	36	26,7	cyclictest	0	-21	swapper/1	19:40:16	1
2459597	99	35	28,5	cyclictest	0	-21	swapper/0	19:40:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17