OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Wed Jul 29, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
280464	99	115	100,6	cyclictest	415950	-21	kworker/u4:7+events_unbound	11:08:58	0
280464	99	106	90,8	cyclictest	397840	-21	kworker/u4:4+events_unbound	10:48:53	0
280464	99	104	98,4	cyclictest	380423	-21	kworker/u4:7+events_unbound	10:38:52	0
280464	99	104	90,6	cyclictest	411405	-21	kworker/u4:0+events_unbound	11:03:56	0
280464	99	97	90,5	cyclictest	428864	-21	kworker/u4:12+events_unbound	12:04:08	0
280464	99	96	88,6	cyclictest	314171	-21	kworker/u4:7+events_unbound	09:23:38	0
280464	99	94	87,5	cyclictest	281687	-21	kworker/u4:8+events_unbound	08:13:24	0
280464	99	91	83,6	cyclictest	388762	-21	kworker/u4:3+events_unbound	10:43:54	0
280464	99	89	82,5	cyclictest	327189	-21	kworker/u4:4+events_unbound	09:28:40	0
280464	99	85	77,6	cyclictest	302132	-21	kworker/u4:4+events_unbound	08:33:29	0
280464	99	80	71,7	cyclictest	357962	-21	kworker/u4:5+events_unbound	10:13:48	0
280464	99	79	73,4	cyclictest	297012	-21	kworker/u4:9+events_unbound	08:18:26	0
280464	99	79	72,5	cyclictest	455936	-21	kworker/u4:5+events_unbound	11:59:08	0
280464	99	79	55,18	cyclictest	53	-21	kswapd0	12:15:13	0
280466	99	78	34,4	cyclictest	0	-21	swapper/1	09:20:36	1
280464	99	77	68,5	cyclictest	340667	-21	kworker/u4:1+events_unbound	09:43:43	0
280464	99	77	67,6	cyclictest	371437	-21	kworker/u4:3+events_unbound	10:18:47	0
280466	99	76	52,22	cyclictest	53	-21	kswapd0	10:20:17	1
280466	99	76	42,32	cyclictest	468018	-21	timerandwakeup	12:05:38	1
280466	99	75	42,30	cyclictest	435638	-21	date	11:30:02	1
280464	99	75	69,5	cyclictest	307327	-21	kworker/u4:15+events_unbound	08:53:34	0
280466	99	74	25,13	cyclictest	415948	-21	kworker/u4:4-rpciod	11:10:29	1
280464	99	74	57,5	cyclictest	349618	-21	kworker/u4:6+events_unbound	10:05:02	0
280466	99	73	63,7	cyclictest	397841	-21	kworker/u4:8+events_unbound	10:58:56	1
280464	99	73	68,3	cyclictest	482360	-21	kworker/u4:15+events_unbound	12:24:10	0
280464	99	73	68,3	cyclictest	482360	-21	kworker/u4:15+events_unbound	12:24:10	0
280466	99	72	37,5	cyclictest	325393	-21	gltestperf	09:25:20	1
280466	99	72	35,5	cyclictest	311839	-21	/usr/sbin/munin	09:10:22	1
280464	99	72	65,5	cyclictest	295743	-21	kworker/u4:7+events_unbound	08:50:01	0
280466	99	70	34,6	cyclictest	346934	-21	latency_hist	09:50:01	1
280466	99	70	34,6	cyclictest	346934	-21	latency_hist	09:50:01	1
280464	99	70	62,6	cyclictest	309898	-21	kworker/u4:7+events_unbound	09:03:36	0
280464	99	70	62,6	cyclictest	309898	-21	kworker/u4:7+events_unbound	09:03:36	0
280466	99	69	61,6	cyclictest	336148	-21	kworker/u4:13+events_unbound	09:53:45	1
280466	99	69	61,6	cyclictest	314171	-21	kworker/u4:7+events_unbound	10:03:46	1
280466	99	68	36,5	cyclictest	0	-21	swapper/1	10:50:23	1
280464	99	67	26,26	cyclictest	0	-21	swapper/0	08:35:10	0
280464	99	66	7,44	cyclictest	311210	-21	diskmemload	10:20:12	0
280464	99	66	59,5	cyclictest	281688	-21	kworker/u4:9+events_unbound	07:38:17	0
280466	99	64	48,9	cyclictest	446913	-21	kworker/u4:7-rpciod	11:45:21	1
280466	99	63	7,46	cyclictest	365632	-21	ssh	10:10:33	1
280464	99	63	56,5	cyclictest	277869	-21	kworker/u4:3+events_unbound	08:58:37	0
280464	99	63	55,6	cyclictest	282959	-21	kworker/u4:13+events_unbound	07:53:18	0
280464	99	63	46,14	cyclictest	0	-21	swapper/0	09:30:16	0
280464	99	62	50,5	cyclictest	446917	-21	kworker/u4:11+events_unbound	11:50:04	0
280464	99	62	50,5	cyclictest	446917	-21	kworker/u4:11+events_unbound	11:50:04	0
280464	99	62	49,8	cyclictest	53	-21	kswapd0	10:55:12	0
280464	99	62	46,7	cyclictest	380422	-21	kworker/u4:6+events_unbound	10:50:03	0
280464	99	61	55,5	cyclictest	304789	-21	kworker/u4:12+events_unbound	08:43:33	0
280464	99	61	54,5	cyclictest	366946	-21	kworker/u4:2+events_unbound	10:33:50	0
280464	99	61	53,6	cyclictest	309894	-21	kworker/u4:2+events_unbound	09:08:36	0
280466	99	60	32,5	cyclictest	486880	-21	kworker/u4:1-rpciod	12:30:21	1
280464	99	60	52,6	cyclictest	424316	-21	kworker/u4:8+events_unbound	11:18:59	0
280466	99	58	45,11	cyclictest	316357	-21	fschecks_count	09:15:19	1
280464	99	58	44,7	cyclictest	415950	-21	kworker/u4:7+events_unbound	11:35:21	0
280466	99	57	51,4	cyclictest	291908	-21	kworker/u4:6+events_unbound	08:38:29	1
280466	99	57	45,8	cyclictest	37	-21	kcompactd0	07:10:32	1
280466	99	56	48,6	cyclictest	281689	-21	kworker/u4:10+events_unbound	07:23:15	1
280466	99	56	48,5	cyclictest	37	-21	kcompactd0	12:10:17	1
280464	99	56	46,7	cyclictest	420457	-21	kworker/u4:3+events_unbound	11:20:39	0
280464	99	56	38,11	cyclictest	265302	-21	kworker/u4:0-rpciod	07:10:33	0
280464	99	56	37,14	cyclictest	280462	-21	cyclictest	09:11:46	0
280464	99	56	35,18	cyclictest	0	-21	swapper/0	09:35:37	0
280464	99	55	43,6	cyclictest	265302	-21	kworker/u4:0+events_unbound	07:43:16	0
280466	99	54	49,4	cyclictest	380426	-21	kworker/u4:10+events_unbound	10:30:01	1
280464	99	54	48,4	cyclictest	345136	-21	kworker/u4:3+events_unbound	09:50:03	0
280464	99	54	47,4	cyclictest	351936	-21	/usr/sbin/munin	09:55:20	0
280466	99	53	44,7	cyclictest	294478	-21	systemd	08:03:21	1
280466	99	53	44,7	cyclictest	294478	-21	systemd	08:03:20	1
280466	99	53	44,6	cyclictest	327189	-21	kworker/u4:4-rpciod	09:30:38	1
280466	99	52	45,5	cyclictest	284266	-21	kworker/u4:15+events_unbound	08:28:28	1
280466	99	52	45,4	cyclictest	0	-21	swapper/1	12:20:17	1
280466	99	52	45,4	cyclictest	0	-21	swapper/1	12:20:17	1
280466	99	52	42,7	cyclictest	0	-21	swapper/1	11:00:44	1
280464	99	52	44,6	cyclictest	429505	-21	kworker/u4:13+events_unbound	11:25:45	0
280466	99	51	43,6	cyclictest	420457	-21	kworker/u4:3+events_unbound	11:15:03	1
280464	99	51	35,6	cyclictest	428864	-21	kworker/u4:12+events_unbound	11:41:55	0
280464	99	51	35,11	cyclictest	438021	-21	rm	11:32:02	0
280464	99	51	35,11	cyclictest	438021	-21	rm	11:32:01	0
280464	99	51	26,19	cyclictest	485056	-21	grep	12:25:21	0
280466	99	50	41,6	cyclictest	290637	-21	kworker/u4:1+events_unbound	08:08:22	1
280464	99	50	44,4	cyclictest	317369	-21	vmstat	09:15:40	0
280464	99	50	39,6	cyclictest	265302	-21	kworker/u4:0-rpciod	07:10:01	0
280466	99	49	41,6	cyclictest	463309	-21	ld	12:00:36	1
280464	99	49	43,4	cyclictest	291908	-21	kworker/u4:6+events_unbound	08:05:01	0
280464	99	49	43,4	cyclictest	291908	-21	kworker/u4:6+events_unbound	08:05:01	0
280464	99	49	42,5	cyclictest	343960	-21	/usr/sbin/munin	09:45:41	0
280464	99	49	42,5	cyclictest	343960	-21	/usr/sbin/munin	09:45:41	0
280464	99	49	39,8	cyclictest	256	50	irq/23-42890000.ethernet	12:35:14	0
280464	99	49	31,15	cyclictest	446913	-21	kworker/u4:7-rpciod	11:45:56	0
280466	99	48	41,5	cyclictest	459132	-21	grep	11:55:40	1
280466	99	48	41,5	cyclictest	386553	-21	munin-run	10:35:00	1
280466	99	48	40,6	cyclictest	476956	-21	unixbench-2d	12:15:42	1
280466	99	48	40,6	cyclictest	4127253	-21	kworker/u4:5+events_unbound	07:45:15	1
280466	99	48	40,5	cyclictest	355672	-21	grep	10:00:01	1
280466	99	48	39,7	cyclictest	338615	-21	/usr/sbin/munin	09:40:19	1
280466	99	48	37,8	cyclictest	310944	-21	threads	09:05:37	1
280466	99	48	36,9	cyclictest	37	-21	kcompactd0	12:35:29	1
280466	99	48	33,10	cyclictest	37	-21	kcompactd0	10:43:16	1
280464	99	48	38,7	cyclictest	378211	-21	/usr/sbin/munin	10:25:21	0
280464	99	48	30,16	cyclictest	490341	-21	unixbench_multi	12:30:43	0
280466	99	47	41,4	cyclictest	485899	-21	unixbench_multi	12:25:40	1
280466	99	47	39,5	cyclictest	414513	-21	proc_pri	11:05:36	1
280464	99	47	33,8	cyclictest	286826	-21	modprobe	07:35:00	0
280466	99	46	40,5	cyclictest	280462	-21	cyclictest	09:35:15	1
280466	99	46	40,4	cyclictest	387241	-21	tune2fs	10:35:20	1
280466	99	46	37,6	cyclictest	424963	-21	kworker/u4:10-rpciod	11:40:39	1
280464	99	46	39,5	cyclictest	293178	-21	kworker/u4:12+events_unbound	08:10:00	0
280464	99	46	37,6	cyclictest	471889	-21	gltestperf	12:10:22	0
280464	99	46	32,6	cyclictest	277869	-21	kworker/u4:3+events_unbound	08:25:36	0
280464	99	46	30,11	cyclictest	0	-21	swapper/0	10:00:28	0
280466	99	45	39,4	cyclictest	306094	-21	apt	08:50:01	1
280466	99	45	37,6	cyclictest	360614	-21	df_abs	10:05:18	1
280466	99	45	36,6	cyclictest	0	-21	swapper/1	11:20:28	1
280466	99	45	34,8	cyclictest	440964	-21	ntp_kernel_pll_	11:35:30	1
280466	99	45	34,7	cyclictest	0	-21	swapper/1	08:15:36	1
280466	99	44	38,4	cyclictest	396112	-21	fschecks_count	10:45:19	1
280466	99	44	37,5	cyclictest	454503	-21	sshd	11:50:38	1
280466	99	44	37,5	cyclictest	454503	-21	sshd	11:50:37	1
280466	99	44	37,5	cyclictest	280462	-21	cyclictest	07:43:16	1
280466	99	44	35,6	cyclictest	0	-21	swapper/1	11:30:20	1
280466	99	44	35,6	cyclictest	0	-21	swapper/1	11:30:20	1
280464	99	44	28,7	cyclictest	297012	-21	kworker/u4:9+events_unbound	08:20:53	0
280464	99	44	24,18	cyclictest	289598	-21	aten2__	07:45:15	0
280466	99	43	37,4	cyclictest	306854	-21	ntp_kernel_pll_	08:50:28	1
280466	99	43	35,5	cyclictest	285759	-21	aten2__	07:30:17	1
280466	99	43	32,7	cyclictest	37	-21	kcompactd0	08:40:38	1
280464	99	43	33,7	cyclictest	0	-21	swapper/0	12:05:22	0
280466	99	42	36,4	cyclictest	296210	-21	uniq	08:10:18	1
280466	99	42	33,6	cyclictest	4127253	-21	kworker/u4:5+events_unbound	07:18:14	1
280466	99	42	33,6	cyclictest	0	-21	swapper/1	10:15:35	1
280466	99	42	33,6	cyclictest	0	-21	swapper/1	07:10:01	1
280466	99	42	32,7	cyclictest	290638	-21	kworker/u4:2+events_unbound	08:20:27	1
280464	99	42	31,8	cyclictest	0	-21	swapper/0	08:00:01	0
280466	99	41	30,9	cyclictest	291798	-21	unixbench_multi	07:50:40	1
280464	99	41	35,4	cyclictest	418401	-21	fschecks_count	11:10:22	0
280466	99	40	33,4	cyclictest	0	-21	swapper/1	07:55:18	1
280466	99	40	31,7	cyclictest	301419	-21	gltestperf	08:30:20	1
280466	99	40	28,9	cyclictest	0	-21	swapper/1	07:25:23	1
280464	99	40	33,5	cyclictest	284760	-21	fschecks_time	07:25:21	0
280464	99	40	33,5	cyclictest	282204	-21	fschecks_time	07:15:20	0
280466	99	39	32,5	cyclictest	307815	-21	fschecks_count	08:55:17	1
280464	99	39	31,6	cyclictest	0	-21	swapper/0	07:20:17	0
280466	99	38	29,7	cyclictest	309613	-21	mailstats	09:00:41	1
280466	99	38	29,7	cyclictest	309613	-21	mailstats	09:00:40	1
280466	99	38	25,10	cyclictest	0	-21	swapper/1	07:35:21	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17