OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Aug 01, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
24188	99	104	95,7	cyclictest	48595	-21	kworker/u4:6+events_unbound	09:40:45	0
24188	99	102	95,5	cyclictest	62259	-21	kworker/u4:9+events_unbound	09:25:45	0
24188	99	100	79,6	cyclictest	156563	-21	kworker/u4:8+events_unbound	11:36:05	0
24188	99	96	87,6	cyclictest	12759	-21	kworker/u4:14+events_unbound	08:25:33	0
24191	99	91	77,11	cyclictest	27990	-21	kworker/u4:12+events_unbound	07:50:14	1
24188	99	91	84,5	cyclictest	84626	-21	kworker/u4:0+events_unbound	09:45:46	0
24188	99	91	72,7	cyclictest	124904	-21	kworker/u4:10+events_unbound	10:40:52	0
24188	99	89	82,5	cyclictest	48595	-21	kworker/u4:6+events_unbound	09:50:47	0
24188	99	88	80,6	cyclictest	107480	-21	kworker/u4:9+events_unbound	10:10:49	0
24188	99	81	57,21	cyclictest	53	-21	kswapd0	11:55:14	0
24188	99	80	73,5	cyclictest	160412	-21	kworker/u4:10+events_unbound	11:15:59	0
24188	99	78	68,7	cyclictest	133932	-21	kworker/u4:14+events_unbound	10:50:56	0
24188	99	77	69,6	cyclictest	218334	-21	kworker/u4:19+events_unbound	12:16:08	0
24188	99	77	57,12	cyclictest	38299	-21	modprobe	08:05:00	0
24188	99	76	65,8	cyclictest	34453	-21	kworker/u4:18+events_unbound	08:35:35	0
24188	99	76	3,68	cyclictest	53730	-21	apt-get	09:05:09	0
24191	99	75	40,32	cyclictest	61147	-21	unixbench-2d	09:15:42	1
24188	99	75	65,7	cyclictest	187416	-21	kworker/u4:9+events_unbound	11:51:04	0
24188	99	75	58,14	cyclictest	53	-21	kswapd0	09:55:09	0
24188	99	73	62,7	cyclictest	124902	-21	kworker/u4:6+events_unbound	10:35:50	0
24188	99	73	62,7	cyclictest	124902	-21	kworker/u4:6+events_unbound	10:35:50	0
24191	99	72	32,37	cyclictest	171728	-21	apt-get	11:20:12	1
24191	99	72	21,12	cyclictest	109312	-21	sed	10:10:02	1
24191	99	71	38,30	cyclictest	204028	-21	grep	11:55:51	1
24191	99	71	36,32	cyclictest	0	-21	swapper/1	10:25:29	1
24191	99	69	32,34	cyclictest	0	-21	swapper/1	11:25:17	1
24191	99	69	32,33	cyclictest	0	-21	swapper/1	12:20:37	1
24191	99	69	23,43	cyclictest	0	-21	swapper/1	09:10:39	1
24188	99	69	59,5	cyclictest	111999	-21	kworker/u4:12+events_unbound	10:15:48	0
24191	99	68	31,33	cyclictest	0	-21	swapper/1	09:55:31	1
24188	99	68	61,5	cyclictest	187412	-21	kworker/u4:0+events_unbound	11:46:06	0
24191	99	67	60,5	cyclictest	22910	-21	kworker/u4:0+events_unbound	07:15:03	1
24191	99	67	42,22	cyclictest	0	-21	swapper/1	08:10:27	1
24191	99	67	42,22	cyclictest	0	-21	swapper/1	08:10:26	1
24191	99	67	36,28	cyclictest	220925	-21	tune2fs	12:15:20	1
24188	99	67	60,5	cyclictest	22912	-21	kworker/u4:3+events_unbound	07:30:02	0
24191	99	66	30,31	cyclictest	0	-21	swapper/1	08:40:16	1
24191	99	66	28,35	cyclictest	141764	-21	timerandwakeup	10:45:39	1
24188	99	66	61,4	cyclictest	19	1	rcuc/0	11:10:58	0
24188	99	66	57,7	cyclictest	222847	-21	kworker/u4:0+events_unbound	12:31:11	0
24188	99	66	57,7	cyclictest	196429	-21	kworker/u4:2+events_unbound	12:36:10	0
24191	99	65	30,31	cyclictest	0	-21	swapper/1	09:20:28	1
24188	99	65	57,5	cyclictest	48595	-21	kworker/u4:6+events_unbound	09:10:41	0
24188	99	65	56,6	cyclictest	0	-21	swapper/0	07:35:07	0
24188	99	65	56,6	cyclictest	0	-21	swapper/0	07:35:07	0
24191	99	64	28,33	cyclictest	0	-21	swapper/1	11:00:26	1
24191	99	64	27,35	cyclictest	55090	-21	diskmemload	09:30:20	1
24191	99	63	32,29	cyclictest	211773	-21	/usr/sbin/munin	12:05:16	1
24191	99	63	31,30	cyclictest	158497	-21	aten_r7power_cu	11:05:16	1
24191	99	63	31,29	cyclictest	0	-21	swapper/1	09:40:27	1
24191	99	63	29,32	cyclictest	53702	-21	kworker/u4:5-xprtiod	10:20:42	1
24188	99	63	55,6	cyclictest	152034	-21	kworker/u4:0+events_unbound	11:21:02	0
24191	99	62	7,12	cyclictest	0	-21	swapper/1	09:45:28	1
24191	99	62	34,26	cyclictest	113654	-21	cron	10:15:01	1
24191	99	62	29,30	cyclictest	0	-21	swapper/1	11:50:25	1
24191	99	62	27,32	cyclictest	39319	-21	switchtime	08:05:41	1
24191	99	62	27,32	cyclictest	0	-21	swapper/1	11:30:30	1
24191	99	62	24,3	cyclictest	0	-21	swapper/1	11:45:39	1
24191	99	62	16,12	cyclictest	190533	-21	sed	11:40:41	1
24191	99	61	33,26	cyclictest	69221	-21	df_abs	09:25:19	1
24191	99	61	28,31	cyclictest	127821	-21	if_eth0	10:30:22	1
24191	99	61	27,31	cyclictest	51733	-21	gltestperf	08:55:22	1
24191	99	61	27,31	cyclictest	0	-21	swapper/1	10:50:24	1
24191	99	61	24,34	cyclictest	0	-21	swapper/1	07:25:21	1
24191	99	60	4,17	cyclictest	230107	-21	sh	12:25:25	1
24191	99	60	4,17	cyclictest	230107	-21	sh	12:25:25	1
24191	99	60	33,25	cyclictest	114479	-21	expr	10:15:20	1
24191	99	60	25,33	cyclictest	30382	-21	timerwakeupswit	07:30:42	1
24188	99	60	5,45	cyclictest	0	-21	swapper/0	08:30:06	0
24188	99	60	52,6	cyclictest	48595	-21	kworker/u4:6+events_unbound	09:40:02	0
24188	99	60	47,8	cyclictest	35737	-21	modprobe	07:55:00	0
24191	99	59	32,25	cyclictest	49863	-21	kworker/u4:7-xprtiod	09:35:16	1
24191	99	59	25,31	cyclictest	0	-21	swapper/1	08:50:19	1
24191	99	59	24,4	cyclictest	0	-21	swapper/1	10:55:19	1
24188	99	59	50,5	cyclictest	65551	-21	/usr/sbin/munin	09:20:40	0
24191	99	58	28,27	cyclictest	0	-21	swapper/1	10:40:29	1
24191	99	58	27,29	cyclictest	24119	-21	kworker/u4:2-rpciod	08:00:01	1
24191	99	58	27,29	cyclictest	0	-21	swapper/1	12:30:24	1
24191	99	58	27,28	cyclictest	0	-21	swapper/1	10:35:31	1
24191	99	58	27,28	cyclictest	0	-21	swapper/1	10:35:31	1
24191	99	58	20,6	cyclictest	0	-21	swapper/1	11:35:43	1
24188	99	58	50,6	cyclictest	71469	-21	kworker/u4:4+events_unbound	11:00:04	0
24188	99	58	36,17	cyclictest	151535	-21	ssh	10:56:43	0
24191	99	57	26,28	cyclictest	0	-21	swapper/1	07:10:37	1
24191	99	57	22,32	cyclictest	0	-21	swapper/1	12:35:18	1
24188	99	57	10,15	cyclictest	224976	-21	apt-get	12:20:16	0
24191	99	56	24,29	cyclictest	0	-21	swapper/1	12:10:45	1
24191	99	56	23,4	cyclictest	0	-21	swapper/1	10:00:26	1
24191	99	56	20,9	cyclictest	0	-21	swapper/1	08:45:39	1
24191	99	56	20,9	cyclictest	0	-21	swapper/1	07:40:19	1
24188	99	56	48,6	cyclictest	213803	-21	kworker/u4:15+events_unbound	12:11:09	0
24188	99	56	45,7	cyclictest	204769	-21	kworker/u4:10+events_unbound	12:05:01	0
24191	99	55	47,6	cyclictest	317	-21	systemd-journal	08:25:32	1
24191	99	55	31,21	cyclictest	0	-21	swapper/1	09:05:20	1
24191	99	55	25,27	cyclictest	0	-21	swapper/1	09:00:24	1
24191	99	55	21,5	cyclictest	164113	-21	/usr/sbin/munin	11:10:43	1
24191	99	55	19,6	cyclictest	0	-21	swapper/1	09:50:31	1
24191	99	55	17,35	cyclictest	53	-21	kswapd0	11:15:18	1
24191	99	54	24,28	cyclictest	0	-21	swapper/1	08:00:18	1
24191	99	54	23,27	cyclictest	0	-21	swapper/1	12:00:18	1
24191	99	54	20,4	cyclictest	0	-21	swapper/1	07:45:20	1
24191	99	53	24,5	cyclictest	31927	-21	sendmail	07:40:00	1
24191	99	53	24,5	cyclictest	31927	-21	sendmail	07:40:00	1
24191	99	53	22,5	cyclictest	45700	-21	sendmail_mailqu	08:30:40	1
24191	99	53	21,4	cyclictest	0	-21	swapper/1	08:35:36	1
24188	99	53	35,16	cyclictest	211895	-21	df_abs	12:05:18	0
24191	99	52	19,7	cyclictest	0	-21	swapper/1	08:15:15	1
24188	99	52	35,13	cyclictest	34469	-21	kworker/u4:13	07:50:00	0
24191	99	51	16,8	cyclictest	0	-21	swapper/1	08:20:20	1
24188	99	51	43,6	cyclictest	35724	-21	kworker/u4:20+events_unbound	08:20:00	0
24188	99	51	42,5	cyclictest	229580	-21	/usr/sbin/munin	12:25:18	0
24188	99	51	42,5	cyclictest	229580	-21	/usr/sbin/munin	12:25:18	0
24188	99	51	41,6	cyclictest	131480	-21	latency_hist	10:35:01	0
24188	99	50	43,5	cyclictest	105843	-21	ntp_offset	10:05:31	0
24188	99	50	39,7	cyclictest	193201	-21	ssh	11:44:28	0
24188	99	50	20,21	cyclictest	256	50	irq/23-42890000.ethernet	09:15:13	0
24188	99	49	42,5	cyclictest	533	-21	rs:main		0
24188	99	49	42,5	cyclictest	123175	-21	fschecks_count	10:25:22	0
24188	99	49	35,11	cyclictest	25144	-21	switchtime	07:10:38	0
24188	99	48	40,6	cyclictest	22912	-21	kworker/u4:3+events_unbound	07:20:03	0
24188	99	48	40,6	cyclictest	177438	-21	unixbench_singl	11:25:40	0
24188	99	48	40,5	cyclictest	32458	-21	fschecks_time	07:40:23	0
24188	99	48	29,17	cyclictest	173916	-21	kworker/u4:1+events_unbound	11:30:36	0
24188	99	47	5,32	cyclictest	143689	-21	ssh	10:48:19	0
24188	99	47	39,6	cyclictest	118566	-21	/usr/sbin/munin	10:20:19	0
24188	99	47	38,6	cyclictest	101233	-21	/usr/sbin/munin	10:00:24	0
24188	99	46	5,27	cyclictest	159247	-21	ssh	11:05:33	0
24188	99	46	40,4	cyclictest	53729	-21	idleruntime-cro	09:05:00	0
24188	99	46	38,6	cyclictest	24186	-21	cyclictest	09:30:28	0
24191	99	45	36,7	cyclictest	24222	-21	latency_hist	07:10:01	1
24188	99	44	36,6	cyclictest	36379	-21	sshd	07:55:19	0
24188	99	44	30,9	cyclictest	49877	-21	modprobe	08:50:00	0
24188	99	44	22,16	cyclictest	24186	-21	cyclictest	07:10:00	0
24188	99	44	19,8	cyclictest	0	-21	swapper/0	08:40:42	0
24188	99	43	35,6	cyclictest	26753	-21	idleruntime-cro	07:20:00	0
24188	99	42	33,7	cyclictest	28487	-21	fschecks_time	07:25:20	0
24188	99	42	24,7	cyclictest	31886	-21	kworker/u4:15+events_unbound	08:52:47	0
24188	99	42	24,15	cyclictest	0	-21	swapper/0	08:55:37	0
24191	99	41	33,5	cyclictest	27004	-21	aten_r7power_en	07:20:15	1
24188	99	41	34,3	cyclictest	0	-21	swapper/0	08:10:27	0
24188	99	41	34,3	cyclictest	0	-21	swapper/0	08:10:26	0
24188	99	40	32,5	cyclictest	35724	-21	kworker/u4:20-rpciod	08:20:19	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17