OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Thu Jan 01, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1117991	99	117	109,6	cyclictest	1167820	-21	kworker/u4:5+events_unbound	10:16:00	0
1117991	99	113	93,8	cyclictest	1201537	-21	kworker/u4:4+events_unbound	10:21:01	0
1117991	99	108	98,8	cyclictest	1154953	-21	kworker/u4:6+events_unbound	10:10:59	0
1117991	99	103	95,6	cyclictest	1214279	-21	kworker/u4:6+events_unbound	10:41:06	0
1117991	99	102	95,5	cyclictest	1301366	-21	kworker/u4:4+events_unbound	12:31:24	0
1117991	99	91	84,5	cyclictest	1289383	-21	kworker/u4:11+events_unbound	12:06:18	0
1117993	99	88	76,7	cyclictest	1121756	-21	kworker/u4:1+events_unbound	07:50:28	1
1117993	99	84	74,6	cyclictest	1136997	-21	kworker/u4:4+events_unbound	08:30:37	1
1117991	99	83	76,5	cyclictest	1167818	-21	kworker/u4:2+events_unbound	09:50:54	0
1117993	99	80	71,7	cyclictest	1222764	-21	kworker/u4:0+events_unbound	10:56:08	1
1117991	99	80	72,6	cyclictest	1239141	-21	kworker/u4:2+events_unbound	11:01:07	0
1117991	99	79	72,5	cyclictest	1247662	-21	kworker/u4:7+events_unbound	11:16:10	0
1117991	99	76	67,7	cyclictest	1264084	-21	kworker/u4:15+events_unbound	11:30:12	0
1117993	99	75	67,6	cyclictest	1214282	-21	kworker/u4:9+events_unbound	10:40:12	1
1117993	99	75	64,8	cyclictest	1119207	-21	kworker/u4:7+events_unbound	07:15:12	1
1117991	99	74	67,5	cyclictest	1289383	-21	kworker/u4:11+events_unbound	12:00:00	0
1117991	99	73	65,6	cyclictest	1172105	-21	kworker/u4:10+events_unbound	09:45:53	0
1117991	99	71	64,5	cyclictest	1167818	-21	kworker/u4:2+events_unbound	10:00:57	0
1117991	99	70	63,5	cyclictest	1239142	-21	kworker/u4:3+events_unbound	11:26:12	0
1117991	99	69	61,6	cyclictest	1134362	-21	kworker/u4:15+events_unbound	09:10:00	0
1117993	99	68	3,61	cyclictest	1283627	-21	ssh	11:50:28	1
1117991	99	68	60,6	cyclictest	1167820	-21	kworker/u4:5+events_unbound	10:05:58	0
1117991	99	67	59,6	cyclictest	1289382	-21	kworker/u4:2+events_unbound	12:26:22	0
1117993	99	66	58,6	cyclictest	1264082	-21	kworker/u4:13+events_unbound	11:41:13	1
1117991	99	64	6,56	cyclictest	0	-21	swapper/0	12:15:25	0
1117991	99	64	56,6	cyclictest	1247661	-21	kworker/u4:6+events_unbound	11:36:14	0
1117993	99	62	52,7	cyclictest	1167820	-21	kworker/u4:5+events_unbound	09:40:54	1
1117993	99	62	30,23	cyclictest	1239144	-21	kworker/u4:8-xprtiod	11:35:21	1
1117991	99	62	55,4	cyclictest	1239146	-21	kworker/u4:9+events_unbound	11:00:00	0
1117991	99	62	54,6	cyclictest	1145808	-21	kworker/u4:19+events_unbound	09:15:49	0
1117991	99	62	51,8	cyclictest	0	-21	swapper/0	09:35:31	0
1117991	99	61	53,6	cyclictest	1154951	-21	kworker/u4:4+events_unbound	09:30:03	0
1117991	99	61	2,56	cyclictest	1117944	-21	cron	07:10:00	0
1117993	99	60	53,5	cyclictest	1285188	-21	kworker/u4:10+events_unbound	12:01:17	1
1117991	99	60	53,5	cyclictest	1128063	-21	kworker/u4:8+events_unbound	08:15:34	0
1117991	99	60	52,6	cyclictest	1186705	-21	apt-get	09:55:12	0
1117993	99	59	51,5	cyclictest	1135718	-21	kworker/u4:0+events_unbound	08:20:35	1
1117991	99	59	51,6	cyclictest	1289381	-21	kworker/u4:0+events_unbound	12:00:23	0
1117991	99	59	51,6	cyclictest	1264082	-21	kworker/u4:13+events_unbound	11:47:01	0
1117993	99	58	52,4	cyclictest	1208743	-21	ssh	10:20:41	1
1117991	99	58	49,7	cyclictest	1239143	-21	kworker/u4:4+events_unbound	11:05:13	0
1117993	99	57	46,9	cyclictest	1159278	-21	kworker/u4:9+events_unbound	09:45:10	1
1117991	99	57	46,8	cyclictest	1222766	-21	kworker/u4:2-rpciod	10:45:18	0
1117993	99	56	47,7	cyclictest	54	-21	kswapd0	10:35:14	1
1117993	99	56	47,7	cyclictest	0	-21	swapper/1	09:30:13	1
1117991	99	56	49,5	cyclictest	1144553	-21	kworker/u4:18+events_unbound	09:00:48	0
1117991	99	56	42,10	cyclictest	1286784	-21	ssh	11:55:00	0
1117991	99	56	38,16	cyclictest	1217681	-21	diskmemload	10:31:02	0
1117993	99	55	47,5	cyclictest	1182688	-21	/usr/sbin/munin	09:50:17	1
1117991	99	55	4,42	cyclictest	314	-21	systemd-journal	08:45:32	0
1117993	99	54	47,5	cyclictest	1117989	-21	cyclictest	12:15:15	1
1117993	99	54	2,45	cyclictest	1267291	-21	ssh	11:30:41	1
1117991	99	54	47,5	cyclictest	1159278	-21	kworker/u4:9+events_unbound	09:25:51	0
1117991	99	54	46,6	cyclictest	1128059	-21	kworker/u4:3+events_unbound	08:10:32	0
1117991	99	54	45,7	cyclictest	1318095	-21	kworker/u4:11+events_unbound	12:35:44	0
1117991	99	54	35,17	cyclictest	1233138	-21	df_abs	10:50:22	0
1117993	99	53	46,5	cyclictest	1136996	-21	kworker/u4:2+events_unbound	08:50:43	1
1117993	99	53	44,7	cyclictest	1107960	-21	kworker/u4:15+events_unbound	07:20:13	1
1117991	99	53	46,5	cyclictest	1220969	-21	ntp_kernel_err	10:35:23	0
1117991	99	53	44,7	cyclictest	1258964	-21	/usr/sbin/munin	11:20:37	0
1117991	99	53	33,17	cyclictest	1128097	-21	idleruntime-cro	07:50:00	0
1117993	99	52	44,5	cyclictest	1250494	-21	gcc	11:10:35	1
1117993	99	52	41,8	cyclictest	54	-21	kswapd0	10:10:00	1
1117991	99	52	32,17	cyclictest	0	-21	swapper/0	09:20:37	0
1117991	99	52	31,18	cyclictest	0	-21	swapper/0	09:10:29	0
1117991	99	52	31,18	cyclictest	0	-21	swapper/0	09:10:29	0
1117993	99	51	43,6	cyclictest	1128065	-21	kworker/u4:10+events_unbound	08:40:40	1
1117993	99	51	43,5	cyclictest	1128060	-21	kworker/u4:4+events_unbound	08:00:01	1
1117993	99	51	42,7	cyclictest	1153005	-21	aten_r7power_en	09:15:14	1
1117991	99	51	45,4	cyclictest	1214279	-21	kworker/u4:6+events_unbound	10:30:01	0
1117991	99	51	42,6	cyclictest	1119725	-21	fschecks_time	07:15:18	0
1117991	99	51	41,6	cyclictest	1137882	-21	sshd	08:25:36	0
1117993	99	50	43,5	cyclictest	1243410	-21	kworker/u4:12+events_unbound	11:06:08	1
1117991	99	50	40,8	cyclictest	1308195	-21	gltestperf	12:20:21	0
1117993	99	49	43,4	cyclictest	1266104	-21	apt-get	11:30:00	1
1117993	99	49	42,5	cyclictest	54	-21	kswapd0	10:00:13	1
1117993	99	49	41,6	cyclictest	1217568	-21	systemd-tmpfile	10:30:52	1
1117991	99	49	34,13	cyclictest	0	-21	swapper/0	11:10:41	0
1117991	99	49	32,13	cyclictest	1275386	-21	ntp_kernel_err	11:40:27	0
1117993	99	48	40,5	cyclictest	0	-21	swapper/1	08:25:35	1
1117993	99	48	38,6	cyclictest	0	-21	swapper/1	11:45:39	1
1117991	99	48	39,6	cyclictest	1143733	-21	sort	08:50:19	0
1117991	99	48	39,6	cyclictest	0	-21	swapper/0	08:00:30	0
1117991	99	48	38,7	cyclictest	1119208	-21	kworker/u4:8-rpciod	07:35:21	0
1117991	99	48	32,10	cyclictest	0	-21	swapper/0	08:25:00	0
1117993	99	47	41,4	cyclictest	1118138	-21	systemd	07:10:11	1
1117993	99	47	39,6	cyclictest	1301368	-21	kworker/u4:7+events_unbound	12:21:21	1
1117993	99	47	37,7	cyclictest	1186709	-21	dpkg	09:55:11	1
1117993	99	47	19,23	cyclictest	0	-21	swapper/1	10:50:30	1
1117991	99	47	26,19	cyclictest	1144987	-21	fschecks_count	08:55:18	0
1117993	99	46	37,7	cyclictest	1201534	-21	kworker/u4:1+events_unbound	10:25:01	1
1117991	99	46	37,6	cyclictest	1139401	-21	unixbench_multi	08:30:39	0
1117991	99	46	17,9	cyclictest	1121588	-21	sed	07:20:38	0
1117993	99	45	37,6	cyclictest	1199937	-21	interrupts	10:10:22	1
1117993	99	45	37,5	cyclictest	1259130	-21	timerwakeupswit	11:20:38	1
1117993	99	45	37,5	cyclictest	0	-21	swapper/1	10:15:13	1
1117993	99	45	34,9	cyclictest	1170365	-21	if_eth0	09:35:22	1
1117991	99	45	38,5	cyclictest	1299622	-21	aten_r7power_en	12:10:19	0
1117991	99	45	38,5	cyclictest	1299622	-21	aten_r7power_en	12:10:18	0
1117991	99	45	37,6	cyclictest	1107960	-21	kworker/u4:15+events_unbound	07:25:44	0
1117991	99	45	35,7	cyclictest	1139817	-21	aten_r7power_vo	08:35:17	0
1117993	99	44	38,4	cyclictest	1319987	-21	latency_hist	12:35:02	1
1117993	99	44	37,5	cyclictest	1312137	-21	df_abs	12:25:17	1
1117993	99	44	35,7	cyclictest	1254836	-21	switchtime	11:15:38	1
1117993	99	44	35,7	cyclictest	1161546	-21	aten_r7power_po	09:25:16	1
1117993	99	44	35,7	cyclictest	1126027	-21	fschecks_count	07:40:18	1
1117993	99	44	35,7	cyclictest	1122314	-21	gltestperf	07:25:21	1
1117993	99	44	35,6	cyclictest	0	-21	swapper/1	09:20:33	1
1117991	99	44	36,6	cyclictest	1174958	-21	/usr/sbin/munin	09:40:35	0
1117991	99	44	24,11	cyclictest	1118998	-21	sed	07:10:35	0
1117993	99	43	37,4	cyclictest	1321187	-21	switchtime	12:35:40	1
1117993	99	43	36,5	cyclictest	1229875	-21	ssh	10:45:40	1
1117993	99	43	35,6	cyclictest	1124488	-21	aten2__	07:35:15	1
1117993	99	43	34,7	cyclictest	1136996	-21	kworker/u4:2+events_unbound	09:05:50	1
1117993	99	43	34,7	cyclictest	1128065	-21	kworker/u4:10+events_unbound	08:00:31	1
1117993	99	43	34,6	cyclictest	0	-21	swapper/1	12:05:32	1
1117993	99	43	33,7	cyclictest	1149707	-21	switchtime	09:10:36	1
1117993	99	43	33,7	cyclictest	1149707	-21	switchtime	09:10:36	1
1117993	99	43	32,9	cyclictest	1290971	-21	grep	12:00:00	1
1117991	99	43	36,5	cyclictest	1126141	-21	gltestperf	07:40:19	0
1117991	99	43	35,6	cyclictest	1132130	-21	aten_r7power_en	08:05:14	0
1117991	99	43	34,6	cyclictest	1141932	-21	unixbench_multi	08:40:36	0
1117993	99	42	35,5	cyclictest	1146427	-21	cut	09:00:21	1
1117993	99	42	35,5	cyclictest	1140842	-21	latency_hist	08:40:01	1
1117993	99	42	34,5	cyclictest	0	-21	swapper/1	08:15:01	1
1117993	99	42	33,7	cyclictest	1242337	-21	timerandwakeup	11:00:40	1
1117993	99	42	33,7	cyclictest	1115539	-21	kworker/u4:0-rpciod	07:30:33	1
1117993	99	42	33,6	cyclictest	0	-21	swapper/1	08:55:16	1
1117991	99	42	34,6	cyclictest	1129567	-21	aten_r7power_cu	07:55:13	0
1117991	99	42	31,7	cyclictest	1115539	-21	kworker/u4:0-rpciod	07:30:40	0
1117993	99	41	34,5	cyclictest	1134930	-21	fschecks_count	08:15:24	1
1117993	99	41	33,5	cyclictest	1299887	-21	fschecks_time	12:10:22	1
1117993	99	41	33,5	cyclictest	1299887	-21	fschecks_time	12:10:22	1
1117993	99	41	32,6	cyclictest	0	-21	swapper/1	08:05:31	1
1117993	99	41	31,7	cyclictest	0	-21	swapper/1	08:45:38	1
1117993	99	40	33,5	cyclictest	1125520	-21	kworker/u4:13+events_unbound	07:45:28	1
1117991	99	40	31,7	cyclictest	1121756	-21	kworker/u4:1-rpciod	07:50:16	0
1117993	99	38	30,6	cyclictest	1118025	-21	latency_hist	07:10:00	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17