OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sun Mar 01, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2529244	99	108	100,5	cyclictest	2618513	-21	kworker/u4:8+events_unbound	22:52:51	0
2529244	99	95	86,7	cyclictest	2575658	-21	kworker/u4:6+events_unbound	21:47:37	0
2529245	99	92	86,4	cyclictest	2567060	-21	kworker/u4:5+events_unbound	21:37:36	1
2529244	99	92	85,5	cyclictest	2575656	-21	kworker/u4:3+events_unbound	21:57:41	0
2529245	99	90	82,6	cyclictest	2562689	-21	kworker/u4:9+events_unbound	22:07:41	1
2529244	99	90	84,4	cyclictest	2678581	-21	kworker/u4:12+events_unbound	23:48:09	0
2529244	99	81	74,5	cyclictest	2665548	-21	kworker/u4:3+events_unbound	23:33:06	0
2529244	99	79	64,13	cyclictest	2720661	-21	kworker/u4:14+events_unbound	00:38:18	0
2529244	99	79	64,13	cyclictest	2720661	-21	kworker/u4:14+events_unbound	00:38:18	0
2529245	99	78	71,5	cyclictest	2579970	-21	kworker/u4:1+events_unbound	21:52:38	1
2529245	99	78	71,5	cyclictest	2571383	-21	kworker/u4:10+events_unbound	21:42:38	1
2529245	99	78	71,5	cyclictest	2571383	-21	kworker/u4:10+events_unbound	21:42:38	1
2529244	99	76	66,8	cyclictest	2682294	-21	kworker/u4:15+events_unbound	00:08:10	0
2529244	99	74	67,5	cyclictest	2609828	-21	kworker/u4:6+events_unbound	22:34:59	0
2529244	99	74	67,5	cyclictest	2609828	-21	kworker/u4:6+events_unbound	22:34:59	0
2529244	99	73	66,4	cyclictest	2537461	-21	kworker/u4:4+events_unbound	20:45:02	0
2529244	99	71	64,5	cyclictest	2686624	-21	kworker/u4:4+events_unbound	00:28:16	0
2529244	99	70	62,6	cyclictest	2584331	-21	kworker/u4:0+events_unbound	22:02:42	0
2529244	99	70	61,7	cyclictest	2536170	-21	kworker/u4:0+events_unbound	20:37:30	0
2529245	99	68	62,4	cyclictest	2652598	-21	kworker/u4:5+events_unbound	23:18:01	1
2529244	99	68	60,6	cyclictest	2669883	-21	kworker/u4:7+events_unbound	23:38:08	0
2529244	99	67	58,7	cyclictest	2626577	-21	kworker/u4:5+events_unbound	22:47:49	0
2529244	99	65	55,8	cyclictest	388	-21	dbus-daemon	22:42:47	0
2529245	99	62	53,7	cyclictest	2544902	-21	kworker/u4:2+events_unbound	21:15:01	1
2529245	99	61	54,5	cyclictest	2537460	-21	kworker/u4:3+events_unbound	20:32:31	1
2529244	99	60	50,7	cyclictest	2532839	-21	kworker/u4:6+events_unbound	19:57:25	0
2529245	99	57	49,6	cyclictest	2529383	-21	kworker/u4:5+events_unbound	19:12:19	1
2529245	99	57	47,8	cyclictest	54	-21	kswapd0	22:00:19	1
2529245	99	57	46,9	cyclictest	2655091	-21	fschecks_count	23:20:20	1
2529244	99	57	50,5	cyclictest	2523431	-21	kworker/u4:2+events_unbound	19:10:00	0
2529244	99	57	49,5	cyclictest	2622868	-21	kworker/u4:1+events_unbound	23:09:43	0
2529245	99	56	48,6	cyclictest	2530676	-21	kworker/u4:12+events_unbound	19:22:20	1
2529245	99	56	47,6	cyclictest	2530674	-21	kworker/u4:9+events_unbound	20:07:25	1
2529244	99	56	46,6	cyclictest	0	-21	swapper/0	22:55:25	0
2529245	99	55	49,4	cyclictest	2539139	-21	kworker/u4:1+events_unbound	21:00:00	1
2529245	99	55	47,6	cyclictest	2631525	-21	kworker/u4:4+events_unbound	23:10:01	1
2529245	99	55	47,6	cyclictest	2534122	-21	kworker/u4:12+events_unbound	20:02:26	1
2529245	99	55	47,6	cyclictest	2162590	-21	kworker/u4:11+events_unbound	19:27:22	1
2529244	99	55	43,9	cyclictest	2532059	-21	ps	19:30:39	0
2529245	99	54	46,6	cyclictest	2648249	-21	kworker/u4:13+events_unbound	23:12:59	1
2529245	99	54	45,6	cyclictest	2630370	-21	unixbench_singl	22:50:41	1
2529245	99	54	45,6	cyclictest	2539139	-21	kworker/u4:1+events_unbound	20:42:32	1
2529244	99	54	46,6	cyclictest	2539533	-21	kworker/u4:3+events_unbound	20:52:32	0
2529244	99	54	45,7	cyclictest	2654856	-21	aten_r7power_en	23:20:18	0
2529245	99	53	46,5	cyclictest	2722708	-21	idleruntime-cro	00:39:59	1
2529245	99	53	46,5	cyclictest	2722708	-21	idleruntime-cro	00:39:59	1
2529245	99	52	45,5	cyclictest	2620687	-21	aten_r7power_po	22:40:17	1
2529245	99	52	45,5	cyclictest	2612863	-21	ld	22:30:37	1
2529245	99	52	45,5	cyclictest	2612863	-21	ld	22:30:36	1
2529245	99	52	45,5	cyclictest	2553049	-21	unixbench_multi	21:20:38	1
2529245	99	52	43,5	cyclictest	2664525	-21	unixbench_multi	23:30:41	1
2529244	99	52	45,5	cyclictest	2640189	-21	kworker/u4:6+events_unbound	23:05:02	0
2529244	99	52	44,6	cyclictest	2553820	-21	kworker/u4:4+events_unbound	21:30:00	0
2529245	99	51	44,5	cyclictest	2616803	-21	/usr/sbin/munin	22:35:22	1
2529245	99	51	43,5	cyclictest	2693184	-21	aten2__	00:05:14	1
2529244	99	51	46,4	cyclictest	2575656	-21	kworker/u4:3+events_unbound	22:12:59	0
2529244	99	51	43,6	cyclictest	2584331	-21	kworker/u4:0+events_unbound	22:17:43	0
2529244	99	51	43,5	cyclictest	0	-21	swapper/0	21:40:14	0
2529244	99	51	43,5	cyclictest	0	-21	swapper/0	21:40:13	0
2529244	99	51	42,7	cyclictest	2558263	-21	kworker/u4:6+events_unbound	21:30:58	0
2529245	99	50	42,6	cyclictest	2573755	-21	fschecks_count	21:45:21	1
2529245	99	50	42,5	cyclictest	2633750	-21	fschecks_time	22:55:21	1
2529245	99	50	40,7	cyclictest	2661246	-21	kworker/u4:10-rpciod	00:00:20	1
2529244	99	50	44,4	cyclictest	2689094	-21	cpu	00:00:15	0
2529244	99	50	42,6	cyclictest	2616381	-21	cut	22:35:17	0
2529244	99	50	42,6	cyclictest	2539533	-21	kworker/u4:3+events_unbound	21:13:01	0
2529244	99	50	42,5	cyclictest	0	-21	swapper/0	00:15:27	0
2529244	99	50	41,7	cyclictest	2604259	-21	ldconfig	22:20:36	0
2529244	99	50	41,6	cyclictest	2537463	-21	kworker/u4:8-rpciod	21:15:20	0
2529244	99	50	41,6	cyclictest	2537463	-21	kworker/u4:8-rpciod	21:15:19	0
2529244	99	50	38,10	cyclictest	0	-21	swapper/0	23:10:37	0
2529245	99	49	41,5	cyclictest	2684439	-21	cat	23:55:01	1
2529245	99	49	39,6	cyclictest	2668031	-21	gltestperf	23:35:25	1
2529244	99	49	42,5	cyclictest	2678581	-21	kworker/u4:12+events_unbound	23:50:38	0
2529244	99	49	41,5	cyclictest	2591839	-21	/usr/sbin/munin	22:05:43	0
2529244	99	49	38,9	cyclictest	2608860	-21	sh	22:25:39	0
2529245	99	48	43,3	cyclictest	2618514	-21	kworker/u4:10+events_unbound	23:01:43	1
2529245	99	48	39,6	cyclictest	0	-21	swapper/1	21:55:24	1
2529245	99	48	38,7	cyclictest	2706525	-21	/usr/sbin/munin	00:20:22	1
2529245	99	48	2,36	cyclictest	2718440	-21	munin-run	00:35:01	1
2529244	99	48	41,5	cyclictest	2538346	-21	fschecks_count	20:30:18	0
2529244	99	48	40,6	cyclictest	2577846	-21	basename	21:50:17	0
2529244	99	48	38,7	cyclictest	2685032	-21	grep	23:55:21	0
2529244	99	48	34,11	cyclictest	2542861	-21	latency_hist	21:10:01	0
2529245	99	47	41,4	cyclictest	2703337	-21	kworker/u4:8+events_unbound	00:18:14	1
2529245	99	47	40,5	cyclictest	2594970	-21	aten_r7power_vo	22:10:17	1
2529245	99	47	38,6	cyclictest	0	-21	swapper/1	22:15:35	1
2529245	99	47	37,7	cyclictest	2676528	-21	gltestperf	23:45:20	1
2529245	99	47	37,6	cyclictest	0	-21	swapper/1	23:25:13	1
2529244	99	47	6,15	cyclictest	2529418	-21	modprobe	19:15:00	0
2529244	99	47	41,4	cyclictest	2708305	-21	kworker/u4:7+events_unbound	00:30:18	0
2529244	99	47	40,5	cyclictest	2530653	-21	kworker/u4:6+events_unbound	19:19:01	0
2529245	99	46	38,5	cyclictest	2536611	-21	fschecks_count	20:15:21	1
2529245	99	46	36,7	cyclictest	2711554	-21	unixbench_singl	00:25:40	1
2529245	99	46	36,7	cyclictest	2673038	-21	unixbench_multi	23:40:40	1
2529244	99	46	39,5	cyclictest	2662982	-21	latency_hist	23:30:00	0
2529244	99	46	37,7	cyclictest	2553820	-21	kworker/u4:4-xprtiod	21:25:00	0
2529244	99	46	29,15	cyclictest	2533069	-21	tr	19:45:13	0
2529245	99	45	38,5	cyclictest	2625291	-21	gltestperf	22:45:23	1
2529245	99	45	37,5	cyclictest	2556832	-21	ntp_kernel_err	21:25:25	1
2529245	99	45	36,6	cyclictest	2603570	-21	aten_r7power_en	22:20:18	1
2529244	99	45	39,4	cyclictest	2564888	-21	aten_r7power_cu	21:35:16	0
2529244	99	45	36,6	cyclictest	0	-21	swapper/0	20:00:22	0
2529244	99	45	34,9	cyclictest	2706499	-21	if_eth0	00:20:21	0
2529245	99	44	38,4	cyclictest	2697830	-21	sh	00:10:19	1
2529245	99	44	38,4	cyclictest	2684718	-21	aten_r7power_po	23:55:16	1
2529244	99	44	37,5	cyclictest	2669883	-21	kworker/u4:7-rpciod	00:10:23	0
2529245	99	43	36,4	cyclictest	2551620	-21	latency_hist	21:20:02	1
2529245	99	43	36,4	cyclictest	2551620	-21	latency_hist	21:20:02	1
2529245	99	43	34,7	cyclictest	2607770	-21	aten_r7power_cu	22:25:15	1
2529245	99	43	33,8	cyclictest	2529794	-21	df_abs	19:15:19	1
2529245	99	43	33,7	cyclictest	0	-21	swapper/1	20:22:27	1
2529245	99	43	31,9	cyclictest	2561666	-21	processes	21:30:56	1
2529244	99	43	36,5	cyclictest	2671992	-21	cpu	23:40:17	0
2529245	99	42	36,4	cyclictest	2532625	-21	systemd	19:37:21	1
2529245	99	42	31,8	cyclictest	2532492	-21	grep	19:35:00	1
2529244	99	42	36,4	cyclictest	2650586	-21	aten_r7power_vo	23:15:15	0
2529244	99	42	35,5	cyclictest	2536399	-21	aten2__	20:15:17	0
2529244	99	41	36,3	cyclictest	2531205	-21	kworker/u4:1	19:30:00	0
2529244	99	41	33,6	cyclictest	2540812	-21	kworker/u4:10+events_unbound	20:57:32	0
2529244	99	41	33,6	cyclictest	0	-21	swapper/0	20:45:42	0
2529245	99	40	33,5	cyclictest	2542730	-21	ssh	21:09:59	1
2529245	99	40	31,7	cyclictest	2534363	-21	latency_hist	19:55:00	1
2529245	99	40	29,7	cyclictest	0	-21	swapper/1	20:45:44	1
2529244	99	40	22,5	cyclictest	2539533	-21	kworker/u4:3+events_unbound	21:00:21	0
2529245	99	39	31,5	cyclictest	2537464	-21	kworker/u4:10-rpciod	20:30:02	1
2529245	99	39	30,7	cyclictest	0	-21	swapper/1	19:50:00	1
2529244	99	39	32,5	cyclictest	2532880	-21	munin-plugin-st	19:44:59	0
2529244	99	39	30,6	cyclictest	2535978	-21	kworker/u4:7+rpciod	20:15:02	0
2529244	99	39	28,8	cyclictest	2530902	-21	cron	19:25:01	0
2529244	99	38	30,6	cyclictest	2532839	-21	kworker/u4:6+events_unbound	20:22:30	0
2529245	99	37	32,3	cyclictest	2534494	-21	systemd	19:57:24	1
2529245	99	37	31,4	cyclictest	2541031	-21	munin-plugin-st	20:54:59	1
2529245	99	37	28,7	cyclictest	2541492	-21	aten_r7power_en	21:00:16	1
2529244	99	37	30,4	cyclictest	0	-21	swapper/0	19:40:00	0
2529245	99	36	8,19	cyclictest	2529243	-21	modprobe	19:10:01	1
2529245	99	36	30,4	cyclictest	0	-21	swapper/1	20:15:00	1
2529244	99	36	29,4	cyclictest	0	-21	swapper/0	20:30:01	0
2529244	99	35	28,4	cyclictest	0	-21	swapper/0	19:55:00	0
2529244	99	33	27,4	cyclictest	0	-21	swapper/0	20:10:01	0
2529245	99	31	25,4	cyclictest	2539375	-21	tr	20:40:00	1
2529245	99	31	23,6	cyclictest	0	-21	swapper/1	19:45:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17