OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Fri Aug 21, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1134020	99	99	93,4	cyclictest	1132744	-21	kworker/u4:7+events_unbound	08:04:14	1
1134020	99	96	89,5	cyclictest	1185614	-21	kworker/u4:1+events_unbound	09:34:22	1
1134020	99	96	89,5	cyclictest	1150665	-21	kworker/u4:20+events_unbound	08:34:17	1
1134020	99	94	79,7	cyclictest	1261862	-21	kworker/u4:3+events_unbound	11:04:36	1
1134020	99	93	86,5	cyclictest	1130304	-21	kworker/u4:1+events_unbound	07:34:08	1
1134020	99	90	83,5	cyclictest	1185616	-21	kworker/u4:3+events_unbound	09:39:23	1
1134020	99	89	82,5	cyclictest	1141628	-21	kworker/u4:14+events_unbound	08:09:15	1
1134020	99	89	82,5	cyclictest	1137818	-21	kworker/u4:10+events_unbound	08:24:17	1
1134020	99	88	75,5	cyclictest	1137818	-21	kworker/u4:10+events_unbound	08:14:16	1
1134020	99	86	79,5	cyclictest	1163548	-21	kworker/u4:15+events_unbound	09:09:20	1
1134020	99	86	79,5	cyclictest	1131510	-21	kworker/u4:3+events_unbound	07:14:02	1
1134020	99	77	70,5	cyclictest	1154515	-21	kworker/u4:6+events_unbound	08:39:18	1
1134020	99	77	69,6	cyclictest	1132744	-21	kworker/u4:7+events_unbound	07:19:05	1
1134020	99	72	65,5	cyclictest	1140357	-21	kworker/u4:3+events_unbound	07:54:13	1
1134020	99	67	58,6	cyclictest	27	1	ktimers/1	10:56:53	1
1134020	99	66	10,53	cyclictest	1255966	-21	ssh	10:50:27	1
1134020	99	61	2,39	cyclictest	37	-21	kcompactd0	11:40:14	1
1134019	99	61	49,8	cyclictest	37	-21	kcompactd0	11:54:59	0
1134019	99	61	20,33	cyclictest	1134018	-21	idleruntime-cro	07:10:00	0
1134020	99	60	45,6	cyclictest	1216977	-21	kworker/u4:5+events_unbound	10:17:44	1
1134019	99	60	40,17	cyclictest	53	-21	kswapd0	10:45:09	0
1134019	99	60	38,7	cyclictest	1219720	-21	gltestperf	10:10:19	0
1134019	99	58	50,6	cyclictest	0	-21	swapper/0	10:55:41	0
1134019	99	58	45,9	cyclictest	1215760	-21	uname	10:05:38	0
1134020	99	57	45,8	cyclictest	1340112	-21	fschecks_count	12:25:18	1
1134019	99	57	15,26	cyclictest	1280169	-21	ssh	11:17:51	0
1134019	99	56	44,7	cyclictest	1306331	-21	kworker/u4:5-rpciod	11:48:25	0
1134019	99	56	42,8	cyclictest	1290466	-21	ssh	11:30:02	0
1134019	99	56	37,16	cyclictest	1259372	-21	ssh	10:55:00	0
1134020	99	55	48,5	cyclictest	1140357	-21	kworker/u4:3+events_unbound	07:55:04	1
1134020	99	55	48,5	cyclictest	1140357	-21	kworker/u4:3+events_unbound	07:55:04	1
1134020	99	55	47,5	cyclictest	1313147	-21	aten_r7power_po	11:55:19	1
1134019	99	55	7,22	cyclictest	1165491	-21	grep	09:10:18	0
1134019	99	55	47,5	cyclictest	0	-21	swapper/0	11:00:34	0
1134019	99	55	46,5	cyclictest	1261861	-21	kworker/u4:2+xprtiod	11:10:07	0
1134019	99	55	44,8	cyclictest	317	-21	systemd-journal	10:34:31	0
1134019	99	55	43,6	cyclictest	0	-21	swapper/0	09:45:36	0
1134020	99	54	48,5	cyclictest	1137818	-21	kworker/u4:10+events_unbound	08:15:03	1
1134020	99	54	44,7	cyclictest	0	-21	swapper/1	10:20:18	1
1134020	99	54	40,10	cyclictest	0	-21	swapper/1	11:15:38	1
1134020	99	54	36,15	cyclictest	27	1	ktimers/1	08:41:43	1
1134019	99	54	23,27	cyclictest	1211072	-21	ntpq	10:00:29	0
1134020	99	53	46,5	cyclictest	1251369	-21	fschecks_time	10:45:29	1
1134020	99	53	46,5	cyclictest	1137818	-21	kworker/u4:10+events_unbound	08:45:04	1
1134020	99	53	45,5	cyclictest	1166283	-21	/usr/sbin/munin	09:10:36	1
1134020	99	53	44,7	cyclictest	1331010	-21	aten_r7power_vo	12:15:16	1
1134020	99	53	44,7	cyclictest	1331010	-21	aten_r7power_vo	12:15:16	1
1134020	99	53	43,7	cyclictest	0	-21	swapper/1	12:39:45	1
1134020	99	53	40,10	cyclictest	1201802	-21	if_eth0	09:50:21	1
1134019	99	53	43,6	cyclictest	0	-21	swapper/0	10:35:35	0
1134019	99	53	41,8	cyclictest	37	-21	kcompactd0	10:41:37	0
1134019	99	53	13,14	cyclictest	1208576	-21	ssh	09:57:54	0
1134019	99	53	13,14	cyclictest	1208576	-21	ssh	09:57:54	0
1134020	99	52	46,4	cyclictest	1123940	-21	kworker/u4:17+events_unbound	07:25:03	1
1134019	99	52	9,20	cyclictest	1223992	-21	grep	10:15:16	0
1134019	99	52	6,21	cyclictest	1269551	-21	awk	11:05:36	0
1134019	99	52	19,11	cyclictest	1282536	-21	ssh	11:20:24	0
1134019	99	52	15,11	cyclictest	1194228	-21	ssh	09:41:37	0
1134019	99	52	14,13	cyclictest	1185273	-21	ssh	09:31:40	0
1134019	99	52	13,13	cyclictest	1188625	-21	ntpq	09:35:34	0
1134019	99	52	10,16	cyclictest	1154716	-21	apt-get	08:30:11	0
1134020	99	51	46,4	cyclictest	1136510	-21	kworker/u4:11+events_unbound	07:35:47	1
1134020	99	51	44,5	cyclictest	1214085	-21	sh	10:04:25	1
1134020	99	51	44,5	cyclictest	0	-21	swapper/1	09:40:16	1
1134020	99	51	40,7	cyclictest	0	-21	swapper/1	12:30:22	1
1134019	99	51	8,21	cyclictest	1153304	-21	ls	08:25:00	0
1134019	99	51	38,10	cyclictest	1310858	-21	kworker/u4:4-rpciod	12:10:38	0
1134019	99	51	28,20	cyclictest	1229126	-21	ssh	10:20:31	0
1134019	99	51	22,25	cyclictest	1345122	-21	ntpq	12:30:34	0
1134019	99	51	18,10	cyclictest	0	-21	swapper/0	12:20:30	0
1134019	99	51	14,10	cyclictest	1235332	-21	ssh	10:27:29	0
1134019	99	51	13,11	cyclictest	1319639	-21	ssh	12:01:56	0
1134019	99	51	12,15	cyclictest	1332983	-21	ssh	12:16:55	0
1134019	99	51	12,15	cyclictest	1332983	-21	ssh	12:16:55	0
1134019	99	51	12,15	cyclictest	1136037	-21	ntpq	07:15:30	0
1134019	99	51	11,24	cyclictest	1299337	-21	munin-plugin-st	11:40:00	0
1134019	99	51	11,19	cyclictest	1349658	-21	/usr/sbin/munin	12:35:37	0
1134019	99	51	11,14	cyclictest	1202776	-21	ssh	09:50:56	0
1134019	99	51	10,21	cyclictest	1325023	-21	ssh	12:08:23	0
1134020	99	50	44,4	cyclictest	1144281	-21	kworker/u4:18+events_unbound	07:47:46	1
1134020	99	50	40,7	cyclictest	0	-21	swapper/1	10:44:32	1
1134020	99	50	39,8	cyclictest	1330323	-21	sshd	12:14:41	1
1134019	99	50	40,8	cyclictest	1148133	-21	systemd	08:04:12	0
1134019	99	50	38,9	cyclictest	1291070	-21	fschecks_count	11:30:18	0
1134019	99	50	27,20	cyclictest	1144776	-21	fschecks_time	07:50:18	0
1134019	99	50	12,13	cyclictest	1176049	-21	ssh	09:21:22	0
1134020	99	49	42,5	cyclictest	1179025	-21	df_abs	09:25:18	1
1134020	99	49	41,5	cyclictest	0	-21	swapper/1	12:00:32	1
1134019	99	49	30,12	cyclictest	1148913	-21	ntpq	08:05:27	0
1134019	99	49	27,18	cyclictest	1146332	-21	ntpq	07:55:28	0
1134019	99	49	27,18	cyclictest	1146332	-21	ntpq	07:55:27	0
1134019	99	49	23,9	cyclictest	1151462	-21	ntpq	08:15:28	0
1134019	99	49	16,11	cyclictest	1161529	-21	perl	08:55:21	0
1134019	99	49	12,21	cyclictest	1340464	-21	ntpq	12:25:24	0
1134019	99	49	11,15	cyclictest	1173702	-21	ssh	09:19:42	0
1134019	99	49	10,14	cyclictest	1164311	-21	ntpq	09:05:25	0
1134020	99	48	42,4	cyclictest	1154512	-21	kworker/u4:3+events_unbound	08:55:03	1
1134020	99	48	40,5	cyclictest	1237686	-21	fschecks_time	10:30:19	1
1134020	99	48	39,6	cyclictest	0	-21	swapper/1	12:05:14	1
1134019	99	48	9,15	cyclictest	1144322	-21	munin-run	07:50:01	0
1134019	99	48	37,8	cyclictest	1140846	-21	fschecks_count	07:35:21	0
1134019	99	48	19,10	cyclictest	1142963	-21	apt-get	07:45:00	0
1134019	99	48	12,14	cyclictest	1139825	-21	ntpq	07:30:23	0
1134019	99	48	11,13	cyclictest	1134680	-21	/usr/sbin/munin	07:10:22	0
1134019	99	48	11,11	cyclictest	1137357	-21	ntpq	07:20:29	0
1134019	99	48	11,10	cyclictest	1160484	-21	ntpq	08:50:27	0
1134019	99	48	10,11	cyclictest	1158031	-21	ntpq	08:40:38	0
1134020	99	47	40,5	cyclictest	1171002	-21	unixbench_singl	09:15:41	1
1134020	99	47	38,7	cyclictest	1279916	-21	kworker/u4:10+rpciod	11:20:37	1
1134020	99	47	36,8	cyclictest	1220581	-21	unixbench_singl	10:10:40	1
1134019	99	47	38,7	cyclictest	1153682	-21	fschecks_count	08:25:17	0
1134019	99	47	38,6	cyclictest	1299925	-21	/usr/sbin/munin	11:40:18	0
1134019	99	47	28,13	cyclictest	1163049	-21	ntpq	09:00:25	0
1134019	99	47	26,17	cyclictest	1313749	-21	ntpq	11:55:31	0
1134019	99	47	14,10	cyclictest	1138647	-21	ntpq	07:25:29	0
1134019	99	47	11,18	cyclictest	1156529	-21	ld	08:35:24	0
1134019	99	47	10,14	cyclictest	1179194	-21	perl	09:25:21	0
1134020	99	46	40,4	cyclictest	1137040	-21	fschecks_time	07:20:20	1
1134020	99	46	39,5	cyclictest	1136510	-21	kworker/u4:11+events_unbound	07:40:03	1
1134020	99	46	38,5	cyclictest	1308771	-21	sed	11:50:19	1
1134020	99	46	37,6	cyclictest	1242323	-21	gltestperf	10:35:20	1
1134019	99	46	22,22	cyclictest	1150696	-21	cron	08:15:00	0
1134019	99	46	10,10	cyclictest	1159753	-21	munin-run	08:50:00	0
1134020	99	45	39,4	cyclictest	27	1	ktimers/1	10:06:55	1
1134020	99	45	39,4	cyclictest	1291070	-21	cut	11:30:18	1
1134020	99	45	37,5	cyclictest	1163569	-21	kworker/u4:15	09:05:00	1
1134020	99	45	36,7	cyclictest	1304357	-21	df_abs	11:45:20	1
1134020	99	45	36,7	cyclictest	1270247	-21	ssh	11:06:12	1
1134020	99	45	33,5	cyclictest	1297292	-21	kworker/u4:13+events_unbound	11:39:16	1
1134020	99	44	38,4	cyclictest	1175556	-21	unixbench_singl	09:20:40	1
1134020	99	44	37,5	cyclictest	1234000	-21	unixbench-2d	10:25:40	1
1134020	99	43	36,5	cyclictest	1181027	-21	kworker/u4:0+events_unbound	09:46:26	1
1134020	99	43	36,5	cyclictest	1137818	-21	kworker/u4:10+events_unbound	08:25:02	1
1134020	99	43	34,7	cyclictest	1206189	-21	gltestperf	09:55:18	1
1134020	99	43	34,7	cyclictest	1206189	-21	gltestperf	09:55:18	1
1134020	99	43	32,8	cyclictest	1279916	-21	kworker/u4:10+rpciod	11:25:32	1
1134020	99	43	32,8	cyclictest	0	-21	swapper/1	11:10:36	1
1134020	99	42	32,8	cyclictest	1335679	-21	fschecks_count	12:20:19	1
1134020	99	41	33,5	cyclictest	1160807	-21	timerwakeupswit	08:50:38	1
1134020	99	37	28,7	cyclictest	1134104	-21	latency_hist	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17