OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Wed Apr 29, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
858839	99	99	89,6	cyclictest	998860	-21	kworker/u4:8+events_unbound	11:23:28	0
858840	99	97	91,4	cyclictest	896647	-21	kworker/u4:6+events_unbound	09:18:06	1
858840	99	97	89,6	cyclictest	1051751	-21	kworker/u4:6+events_unbound	12:28:43	1
858840	99	97	89,6	cyclictest	1051751	-21	kworker/u4:6+events_unbound	12:28:43	1
858840	99	93	86,5	cyclictest	889816	-21	kworker/u4:12+events_unbound	09:08:02	1
858840	99	89	80,7	cyclictest	1016709	-21	kworker/u4:10+events_unbound	11:53:34	1
858840	99	88	80,6	cyclictest	884532	-21	kworker/u4:6+events_unbound	08:47:56	1
858839	99	87	68,6	cyclictest	923955	-21	kworker/u4:10+events_unbound	09:48:12	0
858840	99	86	78,6	cyclictest	889816	-21	kworker/u4:12+events_unbound	09:13:04	1
858840	99	85	69,5	cyclictest	861344	-21	kworker/u4:9+events_unbound	08:02:50	1
858840	99	85	69,5	cyclictest	861344	-21	kworker/u4:9+events_unbound	08:02:49	1
858840	99	84	76,6	cyclictest	1016710	-21	kworker/u4:11+events_unbound	11:38:31	1
858840	99	83	62,6	cyclictest	968299	-21	kworker/u4:0+events_unbound	11:08:25	1
858840	99	82	74,6	cyclictest	1029465	-21	kworker/u4:15+events_unbound	11:48:33	1
858839	99	80	39,29	cyclictest	979932	-21	ssh	10:50:31	0
858840	99	77	59,6	cyclictest	937685	-21	kworker/u4:12+events_unbound	10:08:14	1
858840	99	73	66,5	cyclictest	1047299	-21	kworker/u4:7+events_unbound	12:08:39	1
858840	99	73	64,6	cyclictest	0	-21	swapper/1	09:20:15	1
858840	99	72	66,4	cyclictest	878063	-21	kworker/u4:13+events_unbound	08:37:54	1
858840	99	72	65,5	cyclictest	878063	-21	kworker/u4:13+events_unbound	08:53:00	1
858840	99	72	64,6	cyclictest	884530	-21	kworker/u4:0+events_unbound	09:03:01	1
858839	99	69	61,6	cyclictest	928532	-21	kworker/u4:2+events_unbound	09:53:11	0
858839	99	69	26,33	cyclictest	884570	-21	apt-get	08:50:09	0
858840	99	67	59,6	cyclictest	954974	-21	kworker/u4:3+events_unbound	10:33:19	1
858839	99	67	53,5	cyclictest	865268	-21	kworker/u4:12+events_unbound	07:50:02	0
858840	99	66	59,5	cyclictest	860066	-21	kworker/u4:8+events_unbound	07:17:40	1
858840	99	65	58,5	cyclictest	860059	-21	kworker/u4:3+events_unbound	07:25:01	1
858840	99	65	57,6	cyclictest	860066	-21	kworker/u4:8+events_unbound	07:12:39	1
858839	99	65	58,5	cyclictest	959417	-21	kworker/u4:1+events_unbound	11:10:00	0
858839	99	64	57,5	cyclictest	910318	-21	kworker/u4:6+events_unbound	10:05:03	0
858840	99	63	56,5	cyclictest	954975	-21	kworker/u4:5+events_unbound	10:25:02	1
858839	99	63	55,6	cyclictest	968299	-21	kworker/u4:0+events_unbound	11:28:29	0
858840	99	62	50,7	cyclictest	53	-21	kswapd0	11:00:01	1
858839	99	62	42,16	cyclictest	256	50	irq/23-42890000.ethernet	08:35:10	0
858840	99	61	46,10	cyclictest	37	-21	kcompactd0	11:40:33	1
858840	99	60	44,4	cyclictest	914889	-21	kworker/u4:5+events_unbound	09:48:59	1
858840	99	60	42,6	cyclictest	1003342	-21	kworker/u4:4+events_unbound	11:22:48	1
858840	99	59	49,8	cyclictest	1036182	-21	/usr/sbin/munin	11:55:11	1
858839	99	59	52,5	cyclictest	1016709	-21	kworker/u4:10+events_unbound	12:38:45	0
858840	99	58	44,8	cyclictest	0	-21	swapper/1	10:25:34	1
858840	99	58	42,6	cyclictest	981699	-21	kworker/u4:12+events_unbound	11:00:42	1
858839	99	58	50,6	cyclictest	914889	-21	kworker/u4:5+events_unbound	09:38:08	0
858839	99	58	50,6	cyclictest	865268	-21	kworker/u4:12+events_unbound	08:22:54	0
858840	99	57	51,5	cyclictest	905762	-21	kworker/u4:2+events_unbound	09:30:01	1
858840	99	57	49,6	cyclictest	933621	-21	sshd	09:58:11	1
858839	99	57	49,6	cyclictest	871647	-21	kworker/u4:3+events_unbound	07:57:48	0
858839	99	57	43,6	cyclictest	878063	-21	kworker/u4:13+events_unbound	08:42:55	0
858839	99	57	41,12	cyclictest	1001423	-21	fschecks_count	11:15:20	0
858840	99	56	49,5	cyclictest	1051751	-21	kworker/u4:6+events_unbound	12:30:02	1
858840	99	56	48,6	cyclictest	968299	-21	kworker/u4:0+events_unbound	11:10:02	1
858840	99	56	43,10	cyclictest	37	-21	kcompactd0	10:40:33	1
858839	99	56	49,5	cyclictest	895349	-21	ntp_kernel_pll_	09:15:26	0
858839	99	56	32,20	cyclictest	887469	-21	apt-get	09:00:19	0
858840	99	55	47,6	cyclictest	1016709	-21	kworker/u4:10+events_unbound	12:38:59	1
858840	99	54	44,8	cyclictest	938133	-21	systemd	10:03:11	1
858839	99	54	46,5	cyclictest	1036836	-21	/usr/sbin/munin	11:55:24	0
858839	99	54	41,11	cyclictest	905765	-21	kworker/u4:7+events_unbound	09:28:58	0
858840	99	53	46,5	cyclictest	917855	-21	/usr/sbin/munin	09:40:26	1
858839	99	53	35,5	cyclictest	923955	-21	kworker/u4:10+events_unbound	09:58:13	0
858840	99	52	6,33	cyclictest	944850	-21	ssh	10:10:36	1
858840	99	52	41,9	cyclictest	1059075	-21	/usr/sbin/munin	12:20:37	1
858840	99	52	40,8	cyclictest	27	1	ktimers/1	09:50:27	1
858840	99	52	18,12	cyclictest	17	1	rcu_preempt	08:30:31	1
858839	99	52	35,15	cyclictest	996738	-21	basename	11:10:14	0
858839	99	52	31,19	cyclictest	1068184	-21	sed	12:30:39	0
858840	99	51	43,5	cyclictest	913188	-21	/usr/sbin/munin	09:35:20	1
858839	99	51	44,5	cyclictest	870376	-21	kworker/u4:2+events_unbound	08:17:53	0
858839	99	51	31,17	cyclictest	0	-21	swapper/0	09:40:23	0
858840	99	50	42,6	cyclictest	968299	-21	kworker/u4:0+events_unbound	11:30:43	1
858840	99	50	42,5	cyclictest	1054198	-21	gltestperf	12:15:24	1
858839	99	50	5,6	cyclictest	1063480	-21	ssh	12:25:38	0
858839	99	50	5,6	cyclictest	1063480	-21	ssh	12:25:38	0
858839	99	50	43,5	cyclictest	1061387	-21	sshd	12:23:42	0
858839	99	50	41,5	cyclictest	883713	-21	fschecks_count	08:45:19	0
858840	99	49	42,5	cyclictest	910318	-21	kworker/u4:6+events_unbound	09:34:00	1
858840	99	49	42,5	cyclictest	878063	-21	kworker/u4:13+events_unbound	08:25:03	1
858840	99	49	41,5	cyclictest	979867	-21	ntpq	10:50:29	1
858840	99	49	38,4	cyclictest	998860	-21	kworker/u4:8+events_unbound	11:18:19	1
858839	99	49	41,6	cyclictest	923955	-21	kworker/u4:10+events_unbound	10:00:05	0
858839	99	49	41,6	cyclictest	871646	-21	kworker/u4:1+events_unbound	08:27:54	0
858839	99	49	40,6	cyclictest	870376	-21	kworker/u4:2+events_unbound	08:32:54	0
858839	99	49	40,5	cyclictest	0	-21	swapper/0	11:39:59	0
858839	99	49	38,8	cyclictest	864000	-21	systemd	07:27:41	0
858839	99	49	33,14	cyclictest	972794	-21	kworker/u4:2+events_unbound	10:43:21	0
858840	99	48	6,30	cyclictest	949277	-21	ssh	10:15:34	1
858839	99	48	41,5	cyclictest	873469	-21	fschecks_time	08:05:20	0
858839	99	48	40,6	cyclictest	977808	-21	sd-accept	10:48:21	0
858839	99	48	37,9	cyclictest	957631	-21	fschecks_time	10:25:19	0
858839	99	48	37,8	cyclictest	1040875	-21	fschecks_count	12:00:18	0
858839	99	48	37,8	cyclictest	1040875	-21	fschecks_count	12:00:18	0
858840	99	47	40,5	cyclictest	1014081	-21	latency_hist	11:30:01	1
858839	99	47	41,4	cyclictest	1027771	-21	fschecks_count	11:45:19	0
858839	99	47	40,5	cyclictest	967170	-21	unixbench-2d	10:35:37	0
858839	99	47	39,6	cyclictest	988073	-21	/usr/sbin/munin	11:00:15	0
858839	99	47	39,5	cyclictest	0	-21	swapper/0	10:30:31	0
858839	99	47	33,10	cyclictest	1047944	-21	ssh	12:08:17	0
858839	99	47	30,8	cyclictest	0	-21	swapper/0	11:40:13	0
858840	99	46	37,7	cyclictest	976063	-21	unixbench_singl	10:45:39	1
858840	99	46	37,7	cyclictest	874041	-21	timerwakeupswit	08:05:38	1
858840	99	46	35,6	cyclictest	0	-21	swapper/1	10:35:10	1
858840	99	46	21,20	cyclictest	1049570	-21	df_abs	12:10:16	1
858839	99	46	9,11	cyclictest	0	-21	swapper/0	10:15:40	0
858839	99	46	38,6	cyclictest	1017364	-21	sd-accept	11:33:29	0
858839	99	46	36,7	cyclictest	0	-21	swapper/0	12:18:41	0
858839	99	46	36,5	cyclictest	0	-21	swapper/0	07:40:29	0
858839	99	46	24,16	cyclictest	908138	-21	apt-get	09:30:15	0
858840	99	45	36,7	cyclictest	863325	-21	gltestperf	07:25:23	1
858839	99	45	37,5	cyclictest	981697	-21	kworker/u4:4+events_unbound	10:55:02	0
858839	99	45	37,5	cyclictest	889086	-21	fschecks_time	09:05:22	0
858839	99	45	3,30	cyclictest	858838	-21	basename	07:10:00	0
858840	99	44	37,5	cyclictest	869437	-21	wget	07:50:16	1
858840	99	44	37,5	cyclictest	867893	-21	grep	07:45:01	1
858840	99	44	36,5	cyclictest	871646	-21	kworker/u4:1-rpciod	08:10:20	1
858840	99	44	16,12	cyclictest	17	1	rcu_preempt	08:15:30	1
858839	99	44	35,6	cyclictest	1049729	-21	fschecks_time	12:10:19	0
858839	99	44	34,7	cyclictest	862437	-21	mailstats	07:20:45	0
858839	99	44	31,7	cyclictest	0	-21	swapper/0	10:10:10	0
858840	99	43	33,7	cyclictest	877012	-21	aten2__	08:20:14	1
858839	99	43	34,7	cyclictest	890732	-21	kernelversion	09:10:22	0
858839	99	43	34,6	cyclictest	0	-21	swapper/0	11:50:15	0
858840	99	42	33,6	cyclictest	878064	-21	kworker/u4:14-rpciod	08:45:01	1
858840	99	42	32,7	cyclictest	0	-21	swapper/1	12:00:24	1
858840	99	42	32,7	cyclictest	0	-21	swapper/1	12:00:24	1
858839	99	42	35,5	cyclictest	899300	-21	aten_r7power_po	09:20:16	0
858839	99	42	34,5	cyclictest	861295	-21	unixbench_singl	07:15:38	0
858839	99	42	33,7	cyclictest	952983	-21	aten_r7power_vo	10:20:16	0
858840	99	41	34,5	cyclictest	887161	-21	systemd	08:58:00	1
858840	99	41	29,9	cyclictest	0	-21	swapper/1	07:45:15	1
858839	99	41	33,5	cyclictest	860060	-21	kworker/u4:4-nfsiod	07:30:26	0
858839	99	41	33,5	cyclictest	860060	-21	kworker/u4:4-nfsiod	07:30:25	0
858840	99	40	32,5	cyclictest	864389	-21	grep	07:30:14	1
858840	99	40	32,5	cyclictest	864389	-21	grep	07:30:14	1
858839	99	40	31,6	cyclictest	0	-21	swapper/0	07:15:01	0
858840	99	39	33,4	cyclictest	866553	-21	cron	07:40:01	1
858839	99	39	32,5	cyclictest	872233	-21	gltestperf	08:00:20	0
858839	99	39	32,5	cyclictest	872233	-21	gltestperf	08:00:19	0
858840	99	38	32,4	cyclictest	865268	-21	kworker/u4:12+events_unbound	07:55:01	1
858839	99	38	29,6	cyclictest	886842	-21	mailstats	08:55:36	0
858839	99	38	26,9	cyclictest	0	-21	swapper/0	07:35:16	0
858839	99	38	25,9	cyclictest	0	-21	swapper/0	07:50:24	0
858839	99	37	26,8	cyclictest	875240	-21	switchtime	08:10:38	0
858840	99	31	23,6	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17