OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Fri Jul 10, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2757090	99	118	96,7	cyclictest	2794757	-21	kworker/u4:5+events_unbound	21:47:16	1
2757090	99	104	93,8	cyclictest	2821286	-21	kworker/u4:11+events_unbound	22:12:21	1
2757089	99	103	96,5	cyclictest	2949009	-21	kworker/u4:9+events_unbound	00:12:45	0
2757089	99	101	92,6	cyclictest	2870567	-21	kworker/u4:4+events_unbound	22:47:25	0
2757089	99	100	90,7	cyclictest	2857262	-21	kworker/u4:11+events_unbound	22:42:24	0
2757089	99	96	89,5	cyclictest	2926931	-21	kworker/u4:15+events_unbound	23:47:40	0
2757090	99	95	88,5	cyclictest	2935805	-21	kworker/u4:3+events_unbound	23:57:44	1
2757089	99	94	87,5	cyclictest	2848329	-21	kworker/u4:17+events_unbound	22:17:21	0
2757090	99	93	76,5	cyclictest	2896539	-21	kworker/u4:8+events_unbound	23:12:33	1
2757089	99	92	84,6	cyclictest	2799337	-21	kworker/u4:7+events_unbound	21:32:12	0
2757090	99	90	81,7	cyclictest	2763436	-21	kworker/u4:15+events_unbound	21:12:09	1
2757090	99	89	81,6	cyclictest	2900998	-21	kworker/u4:2+events_unbound	23:27:35	1
2757090	99	88	70,6	cyclictest	2940209	-21	kworker/u4:0+events_unbound	00:07:45	1
2757089	99	86	78,6	cyclictest	2774991	-21	kworker/u4:12+events_unbound	20:17:01	0
2757090	99	84	68,6	cyclictest	2830967	-21	kworker/u4:15+events_unbound	22:07:19	1
2757090	99	84	65,6	cyclictest	2787869	-21	kworker/u4:4+events_unbound	21:27:12	1
2757090	99	82	69,5	cyclictest	2949006	-21	kworker/u4:3+events_unbound	00:22:47	1
2757089	99	82	75,5	cyclictest	2778836	-21	kworker/u4:2+events_unbound	20:32:03	0
2757090	99	81	64,7	cyclictest	2887698	-21	kworker/u4:3+events_unbound	23:37:38	1
2757089	99	80	72,6	cyclictest	2940211	-21	kworker/u4:6+events_unbound	00:02:45	0
2757089	99	80	72,6	cyclictest	2940211	-21	kworker/u4:6+events_unbound	00:02:44	0
2757090	99	79	71,6	cyclictest	2767268	-21	kworker/u4:16+events_unbound	21:17:09	1
2757089	99	78	73,3	cyclictest	2774991	-21	kworker/u4:12+events_unbound	20:37:04	0
2757089	99	78	70,6	cyclictest	2754587	-21	kworker/u4:1+events_unbound	19:21:54	0
2757089	99	77	70,5	cyclictest	2763436	-21	kworker/u4:15+events_unbound	20:22:02	0
2757090	99	76	68,6	cyclictest	2905437	-21	kworker/u4:4+events_unbound	23:42:39	1
2757089	99	76	69,5	cyclictest	2760885	-21	kworker/u4:11+events_unbound	19:56:58	0
2757089	99	76	64,6	cyclictest	2774991	-21	kworker/u4:12+events_unbound	20:27:01	0
2757089	99	75	68,5	cyclictest	2763436	-21	kworker/u4:15+events_unbound	21:07:10	0
2757089	99	75	67,6	cyclictest	2778846	-21	kworker/u4:4+events_unbound	20:57:06	0
2757089	99	74	66,6	cyclictest	2857262	-21	kworker/u4:11+events_unbound	22:37:26	0
2757090	99	73	52,8	cyclictest	2784042	-21	kworker/u4:18+events_unbound	21:22:10	1
2757089	99	73	65,6	cyclictest	2817414	-21	kworker/u4:8+events_unbound	21:57:18	0
2757089	99	73	65,6	cyclictest	2817414	-21	kworker/u4:8+events_unbound	21:57:17	0
2757090	99	71	64,5	cyclictest	2812846	-21	kworker/u4:1+events_unbound	21:42:15	1
2757090	99	71	64,5	cyclictest	2778849	-21	kworker/u4:10+events_unbound	20:47:04	1
2757089	99	70	50,8	cyclictest	2961685	-21	kworker/u4:14+events_unbound	00:35:02	0
2757089	99	69	62,5	cyclictest	2517655	-21	kworker/u4:2+events_unbound	19:26:55	0
2757090	99	68	62,5	cyclictest	2887699	-21	kworker/u4:5+events_unbound	23:02:28	1
2757089	99	67	59,6	cyclictest	2754587	-21	kworker/u4:1+events_unbound	19:41:57	0
2757090	99	66	57,6	cyclictest	2794757	-21	kworker/u4:5+events_unbound	21:52:16	1
2757089	99	66	58,6	cyclictest	2754588	-21	kworker/u4:3+events_unbound	19:16:55	0
2757090	99	64	55,6	cyclictest	2799337	-21	kworker/u4:7+events_unbound	22:05:00	1
2757090	99	64	48,6	cyclictest	2759599	-21	kworker/u4:9+events_unbound	19:40:01	1
2757090	99	64	48,6	cyclictest	2759599	-21	kworker/u4:9+events_unbound	19:40:00	1
2757089	99	64	56,6	cyclictest	2745851	-21	kworker/u4:0+events_unbound	19:36:56	0
2757089	99	64	56,6	cyclictest	2745851	-21	kworker/u4:0+events_unbound	19:36:56	0
2757090	99	62	55,5	cyclictest	2905438	-21	kworker/u4:5+events_unbound	23:22:34	1
2757090	99	62	55,5	cyclictest	2905438	-21	kworker/u4:5+events_unbound	23:22:33	1
2757090	99	62	54,5	cyclictest	2949009	-21	kworker/u4:9+events_unbound	00:30:01	1
2757089	99	62	54,6	cyclictest	2762165	-21	kworker/u4:13+events_unbound	19:31:56	0
2757090	99	61	46,6	cyclictest	2771105	-21	kworker/u4:1+events_unbound	20:42:05	1
2757089	99	60	55,4	cyclictest	2966123	-21	kworker/u4:15+events_unbound	00:32:48	0
2757090	99	58	41,5	cyclictest	2799337	-21	kworker/u4:7+events_unbound	22:55:00	1
2757089	99	58	50,6	cyclictest	2778849	-21	kworker/u4:10+events_unbound	20:50:04	0
2757090	99	56	45,8	cyclictest	2761912	-21	switchtime	19:25:37	1
2757090	99	56	42,6	cyclictest	2778848	-21	kworker/u4:9+events_unbound	21:02:08	1
2757089	99	56	32,22	cyclictest	2781801	-21	df_abs	20:45:15	0
2757090	99	54	45,7	cyclictest	2783786	-21	switchtime	20:50:41	1
2757089	99	54	47,5	cyclictest	2949006	-21	kworker/u4:3+events_unbound	00:20:02	0
2757089	99	54	46,6	cyclictest	2896539	-21	kworker/u4:8+events_unbound	23:15:02	0
2757089	99	54	37,5	cyclictest	2905436	-21	kworker/u4:0+events_unbound	23:44:45	0
2757090	99	53	48,4	cyclictest	2887698	-21	kworker/u4:3+events_unbound	23:05:02	1
2757090	99	53	47,4	cyclictest	2895889	-21	kworker/u4:6+events_unbound	23:50:04	1
2757090	99	53	46,5	cyclictest	2829603	-21	unixbench-2d	21:55:43	1
2757090	99	53	46,5	cyclictest	2829603	-21	unixbench-2d	21:55:43	1
2757090	99	53	39,5	cyclictest	2970546	-21	kworker/u4:2+events_unbound	00:40:02	1
2757089	99	53	48,4	cyclictest	2794754	-21	kworker/u4:0+events_unbound	21:40:02	0
2757089	99	53	33,5	cyclictest	2793058	-21	fschecks_count	21:15:22	0
2757089	99	53	30,5	cyclictest	2841400	-21	munin-plugin-st	22:10:00	0
2757089	99	53	29,20	cyclictest	0	-21	swapper/0	20:05:35	0
2757089	99	53	29,20	cyclictest	0	-21	swapper/0	20:05:34	0
2757090	99	52	45,5	cyclictest	2938262	-21	df_abs	00:00:22	1
2757090	99	52	45,5	cyclictest	2938262	-21	df_abs	00:00:21	1
2757090	99	52	40,9	cyclictest	2868404	-21	forks	22:40:20	1
2757090	99	52	2,41	cyclictest	2864436	-21	ssh	22:35:26	1
2757089	99	52	7,10	cyclictest	2788191	-21	apt-get	21:10:13	0
2757089	99	52	4,25	cyclictest	2833644	-21	ssh	22:00:33	0
2757089	99	52	37,5	cyclictest	2905438	-21	kworker/u4:5+events_unbound	23:24:27	0
2757089	99	52	37,5	cyclictest	2905438	-21	kworker/u4:5+events_unbound	23:24:26	0
2757090	99	51	43,6	cyclictest	2964119	-21	/usr/sbin/munin	00:30:16	1
2757090	99	51	43,6	cyclictest	2763427	-21	systemd	19:31:54	1
2757089	99	51	44,5	cyclictest	2891006	-21	diskmemload	23:05:43	0
2757089	99	51	40,8	cyclictest	2854693	-21	munin-run	22:25:01	0
2757089	99	51	30,6	cyclictest	2940211	-21	kworker/u4:6+events_unbound	00:07:08	0
2757090	99	50	43,5	cyclictest	2955129	-21	latency_hist	00:20:01	1
2757090	99	50	43,5	cyclictest	2799337	-21	kworker/u4:7+events_unbound	22:22:22	1
2757090	99	50	42,6	cyclictest	2767258	-21	kworker/u4:8+events_unbound	20:01:59	1
2757090	99	50	42,5	cyclictest	0	-21	swapper/1	22:32:22	1
2757090	99	50	37,10	cyclictest	2881600	-21	fschecks_time	22:55:23	1
2757090	99	50	27,20	cyclictest	27	1	ktimers/1	20:05:30	1
2757090	99	50	27,20	cyclictest	27	1	ktimers/1	20:05:29	1
2757089	99	50	6,16	cyclictest	2820364	-21	ntpq	21:45:35	0
2757089	99	50	43,5	cyclictest	2953452	-21	kworker/u4:4+events_unbound	00:29:46	0
2757089	99	50	41,7	cyclictest	2912239	-21	/usr/sbin/munin	23:30:20	0
2757089	99	50	41,5	cyclictest	2944605	-21	kworker/u4:1-rpciod	00:16:41	0
2757089	99	50	40,7	cyclictest	2860622	-21	unixbench-2d	22:30:43	0
2757089	99	50	40,6	cyclictest	0	-21	swapper/0	21:50:41	0
2757089	99	50	37,8	cyclictest	0	-21	swapper/0	23:55:13	0
2757090	99	49	42,5	cyclictest	2899774	-21	mailstats	23:15:43	1
2757090	99	49	42,5	cyclictest	2849516	-21	sshd	22:18:51	1
2757090	99	48	41,5	cyclictest	2806171	-21	aten_r7power_cu	21:30:14	1
2757090	99	48	41,5	cyclictest	2760130	-21	fschecks_time	19:20:19	1
2757090	99	48	39,6	cyclictest	0	-21	swapper/1	20:35:35	1
2757090	99	48	37,8	cyclictest	0	-21	swapper/1	21:37:13	1
2757090	99	48	37,7	cyclictest	0	-21	swapper/1	23:32:35	1
2757089	99	48	41,5	cyclictest	2916759	-21	/usr/sbin/munin	23:35:25	0
2757089	99	48	39,7	cyclictest	2886765	-21	timerwakeupswit	23:00:40	0
2757090	99	47	40,5	cyclictest	2947748	-21	threads	00:10:40	1
2757090	99	47	40,5	cyclictest	2778663	-21	timerwakeupswit	20:30:37	1
2757090	99	47	40,5	cyclictest	2772975	-21	cut	20:10:24	1
2757090	99	47	40,5	cyclictest	2754587	-21	kworker/u4:1+events_unbound	19:10:01	1
2757089	99	47	39,6	cyclictest	2797543	-21	fschecks_count	21:20:22	0
2757089	99	47	39,5	cyclictest	2855103	-21	aten2__	22:25:20	0
2757089	99	47	39,5	cyclictest	2815312	-21	/usr/sbin/munin	21:40:19	0
2757089	99	47	37,7	cyclictest	2770621	-21	sshd	20:00:29	0
2757089	99	47	36,6	cyclictest	2894667	-21	fschecks_count	23:10:18	0
2757090	99	46	40,4	cyclictest	2854924	-21	latency_hist	22:25:02	1
2757090	99	46	39,5	cyclictest	2873369	-21	ldconfig	22:45:37	1
2757090	99	46	36,8	cyclictest	2777651	-21	latency_hist	20:30:01	1
2757089	99	46	36,7	cyclictest	2842826	-21	/usr/sbin/munin	22:10:38	0
2757089	99	46	36,6	cyclictest	0	-21	swapper/0	19:50:20	0
2757089	99	46	36,6	cyclictest	0	-21	swapper/0	19:50:19	0
2757090	99	45	39,4	cyclictest	2768532	-21	systemd	19:51:56	1
2757090	99	45	39,4	cyclictest	2768532	-21	systemd	19:51:56	1
2757090	99	45	37,6	cyclictest	2758309	-21	kworker/u4:7+events_unbound	19:11:54	1
2757090	99	45	37,5	cyclictest	2784474	-21	fschecks_count	20:55:21	1
2757090	99	45	36,6	cyclictest	2745851	-21	kworker/u4:0+rpciod	19:45:22	1
2757090	99	45	35,8	cyclictest	2766099	-21	latency_hist	19:45:00	1
2757089	99	45	37,6	cyclictest	2745851	-21	kworker/u4:0-rpciod	19:15:01	0
2757089	99	45	36,7	cyclictest	2802480	-21	/usr/sbin/munin	21:25:34	0
2757089	99	45	34,9	cyclictest	2930437	-21	grep	23:50:41	0
2757090	99	44	34,7	cyclictest	2925284	-21	sh	23:45:25	1
2757090	99	44	34,7	cyclictest	2758566	-21	aten_r7power_cu	19:15:14	1
2757089	99	44	35,6	cyclictest	2785885	-21	gltestperf	21:00:20	0
2757090	99	43	31,4	cyclictest	2758309	-21	kworker/u4:7+events_unbound	20:20:01	1
2757089	99	43	37,4	cyclictest	2780120	-21	kworker/u4:13+events_unbound	20:43:46	0
2757089	99	43	12,23	cyclictest	2908116	-21	ssh	23:25:24	0
2757090	99	42	34,6	cyclictest	2787997	-21	latency_hist	21:10:01	1
2757089	99	42	33,6	cyclictest	2877273	-21	gltestperf	22:50:21	0
2757089	99	42	33,5	cyclictest	0	-21	swapper/0	22:55:29	0
2757090	99	41	32,6	cyclictest	2517655	-21	kworker/u4:2+rpciod	19:55:14	1
2757089	99	41	33,6	cyclictest	2766430	-21	fschecks_count	19:45:18	0
2757089	99	41	33,5	cyclictest	2773391	-21	find	20:10:40	0
2757090	99	40	32,5	cyclictest	2775933	-21	proc_pri	20:20:35	1
2757089	99	34	5,22	cyclictest	2757087	-21	cyclictest	19:09:59	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17