OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sat Jan 10, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1166574	99	126	118,5	cyclictest	1358262	-21	kworker/u4:1+events_unbound	12:20:58	1
1166574	99	114	94,6	cyclictest	1199419	-21	kworker/u4:11+events_unbound	09:15:23	1
1166574	99	108	100,6	cyclictest	1170411	-21	kworker/u4:8+events_unbound	07:39:59	1
1166574	99	96	88,6	cyclictest	1251781	-21	kworker/u4:2+events_unbound	10:15:28	1
1166574	99	92	84,6	cyclictest	1229671	-21	kworker/u4:8+events_unbound	09:50:25	1
1166573	99	92	84,6	cyclictest	1316080	-21	kworker/u4:1+events_unbound	12:05:56	0
1166574	99	91	83,5	cyclictest	1189320	-21	kworker/u4:16+events_unbound	09:00:14	1
1166573	99	90	72,16	cyclictest	1174179	-21	kworker/u4:2+events_unbound	09:40:24	0
1166574	99	89	81,6	cyclictest	1298764	-21	kworker/u4:13+events_unbound	11:20:47	1
1166574	99	88	81,5	cyclictest	1281921	-21	kworker/u4:14+events_unbound	10:55:42	1
1166573	99	84	41,39	cyclictest	0	-21	swapper/0	07:50:34	0
1166574	99	83	74,6	cyclictest	1203840	-21	kworker/u4:15+events_unbound	09:20:24	1
1166574	99	82	76,4	cyclictest	1324687	-21	kworker/u4:8+events_unbound	11:40:52	1
1166573	99	82	73,7	cyclictest	1345494	-21	kworker/u4:4+events_unbound	12:36:02	0
1166573	99	82	73,7	cyclictest	1345494	-21	kworker/u4:4+events_unbound	12:36:02	0
1166573	99	81	74,5	cyclictest	1155652	-21	kworker/u4:11+events_unbound	08:45:18	0
1166574	99	80	72,6	cyclictest	1170414	-21	kworker/u4:12+events_unbound	07:55:04	1
1166574	99	78	71,5	cyclictest	1188064	-21	kworker/u4:14+events_unbound	08:35:14	1
1166573	99	76	45,28	cyclictest	1166569	-21	cyclictest	09:05:21	0
1166573	99	76	23,50	cyclictest	1183034	-21	cron	08:15:00	0
1166573	99	75	2,28	cyclictest	1272193	-21	/usr/sbin/munin	10:35:39	0
1166574	99	73	61,9	cyclictest	1166498	-21	kworker/u4:7+events_unbound	07:14:49	1
1166574	99	72	61,8	cyclictest	1316080	-21	kworker/u4:1+events_unbound	11:30:00	1
1166573	99	72	61,9	cyclictest	1155653	-21	kworker/u4:15+events_unbound	07:29:51	0
1166573	99	72	35,34	cyclictest	1189638	-21	aten_r7power_po	08:40:19	0
1166574	99	71	65,4	cyclictest	1174179	-21	kworker/u4:2+events_unbound	08:20:01	1
1166573	99	71	63,6	cyclictest	1268730	-21	kworker/u4:12+events_unbound	10:31:48	0
1166573	99	71	35,27	cyclictest	255	50	irq/23-42890000.ethernet	07:15:12	0
1166574	99	70	60,7	cyclictest	1155652	-21	kworker/u4:11+events_unbound	07:10:01	1
1166574	99	70	60,7	cyclictest	1155652	-21	kworker/u4:11+events_unbound	07:10:01	1
1166573	99	70	35,33	cyclictest	1188588	-21	fschecks_time	08:35:19	0
1166573	99	70	33,34	cyclictest	1210669	-21	/usr/sbin/munin	09:25:18	0
1166573	99	70	33,34	cyclictest	1210669	-21	/usr/sbin/munin	09:25:18	0
1166573	99	70	31,5	cyclictest	0	-21	swapper/0	11:00:29	0
1166573	99	70	23,43	cyclictest	0	-21	swapper/0	10:05:02	0
1166573	99	69	4,36	cyclictest	0	-21	swapper/0	11:25:17	0
1166573	99	69	39,28	cyclictest	1236460	-21	aten2__	09:55:14	0
1166573	99	69	36,4	cyclictest	1332881	-21	sshd	11:46:46	0
1166573	99	69	31,5	cyclictest	1232308	-21	/usr/sbin/munin	09:50:16	0
1166573	99	68	37,27	cyclictest	1238532	-21	kworker/u4:10-rpciod	10:25:33	0
1166573	99	68	32,5	cyclictest	0	-21	swapper/0	09:45:33	0
1166573	99	67	31,5	cyclictest	0	-21	swapper/0	11:10:34	0
1166573	99	67	30,6	cyclictest	0	-21	swapper/0	07:55:34	0
1166573	99	66	57,7	cyclictest	1358264	-21	kworker/u4:6+events_unbound	12:25:58	0
1166573	99	66	34,30	cyclictest	1284141	-21	aten_r7power_en	10:50:16	0
1166573	99	66	28,4	cyclictest	0	-21	swapper/0	11:40:12	0
1166573	99	65	36,20	cyclictest	0	-21	swapper/0	09:00:10	0
1166573	99	65	29,6	cyclictest	0	-21	swapper/0	12:00:18	0
1166573	99	64	29,7	cyclictest	1170374	-21	unixbench_singl	07:20:37	0
1166574	99	63	56,5	cyclictest	1333327	-21	kworker/u4:11+events_unbound	12:10:57	1
1166573	99	63	51,9	cyclictest	388	-21	dbus-daemon	11:55:52	0
1166573	99	63	34,4	cyclictest	1310012	-21	fschecks_count	11:20:19	0
1166574	99	62	55,5	cyclictest	1290712	-21	kworker/u4:1+events_unbound	11:05:44	1
1166573	99	62	29,5	cyclictest	0	-21	swapper/0	11:15:30	0
1166573	99	61	41,10	cyclictest	17	1	rcu_preempt	09:30:22	0
1166573	99	60	28,6	cyclictest	0	-21	swapper/0	07:45:01	0
1166574	99	58	50,6	cyclictest	1170414	-21	kworker/u4:12+events_unbound	08:20:06	1
1166574	99	58	43,6	cyclictest	1345494	-21	kworker/u4:4+events_unbound	12:35:35	1
1166574	99	58	43,6	cyclictest	1345494	-21	kworker/u4:4+events_unbound	12:35:34	1
1166574	99	57	49,6	cyclictest	1176754	-21	idleruntime-cro	07:50:00	1
1166573	99	57	52,3	cyclictest	1131308	-21	kworker/u4:5+events_unbound	08:25:12	0
1166573	99	57	50,5	cyclictest	1345494	-21	kworker/u4:4+events_unbound	12:31:00	0
1166574	99	56	49,5	cyclictest	1170411	-21	kworker/u4:8+events_unbound	07:34:56	1
1166574	99	55	45,8	cyclictest	1238532	-21	kworker/u4:10+events_unbound	10:10:01	1
1166574	99	55	43,7	cyclictest	1223600	-21	sed	09:40:15	1
1166573	99	55	37,16	cyclictest	1185592	-21	munin-plugin-st	08:25:01	0
1166574	99	54	46,6	cyclictest	1256208	-21	kworker/u4:9+events_unbound	10:20:21	1
1166574	99	54	45,6	cyclictest	1281084	-21	sshd	10:45:45	1
1166574	99	53	47,4	cyclictest	1332704	-21	kworker/u4:9+events_unbound	12:16:00	1
1166574	99	53	46,5	cyclictest	1337549	-21	kworker/u4:14+events_unbound	12:10:01	1
1166574	99	53	44,6	cyclictest	1319723	-21	kworker/u4:3+events_unbound	12:00:58	1
1166574	99	53	42,8	cyclictest	1264998	-21	kworker/u4:4+events_unbound	10:55:01	1
1166574	99	53	34,13	cyclictest	1292753	-21	apt-get	11:00:18	1
1166573	99	53	42,9	cyclictest	1319139	-21	processes	11:30:40	0
1166574	99	52	7,41	cyclictest	1365176	-21	ssh	12:25:29	1
1166574	99	52	44,5	cyclictest	1184278	-21	kworker/u4:4+events_unbound	09:25:43	1
1166574	99	52	44,5	cyclictest	1184278	-21	kworker/u4:4+events_unbound	09:25:42	1
1166574	99	52	43,7	cyclictest	314	-21	systemd-journal	11:55:53	1
1166573	99	52	45,5	cyclictest	1355771	-21	idleruntime-cro	12:15:01	0
1166573	99	51	45,4	cyclictest	0	-21	swapper/0	10:43:17	0
1166573	99	51	43,6	cyclictest	1254322	-21	sh	10:15:21	0
1166573	99	51	37,11	cyclictest	1335663	-21	if_eth0	11:50:23	0
1166574	99	50	43,5	cyclictest	1295077	-21	kworker/u4:3+events_unbound	11:17:00	1
1166574	99	50	42,6	cyclictest	1170411	-21	kworker/u4:8+events_unbound	07:24:52	1
1166574	99	50	41,7	cyclictest	1198288	-21	sendmail_mailqu	09:10:38	1
1166573	99	50	44,4	cyclictest	1197730	-21	tune2fs	09:10:22	0
1166574	99	49	41,6	cyclictest	1276605	-21	/usr/sbin/munin	10:40:39	1
1166574	99	49	41,5	cyclictest	1260630	-21	kworker/u4:0-xprtiod	10:25:31	1
1166574	99	49	41,5	cyclictest	1169131	-21	kworker/u4:6-rpciod	09:35:35	1
1166574	99	49	37,10	cyclictest	1190644	-21	idleruntime-cro	08:45:01	1
1166574	99	49	36,6	cyclictest	1295078	-21	kworker/u4:9+events_unbound	11:11:01	1
1166573	99	49	42,5	cyclictest	1245147	-21	aten2__	10:05:14	0
1166574	99	48	42,4	cyclictest	1324687	-21	kworker/u4:8+events_unbound	11:51:01	1
1166574	99	48	41,5	cyclictest	1331440	-21	uname	11:45:19	1
1166574	99	48	41,5	cyclictest	1247367	-21	kworker/u4:7+events_unbound	10:12:58	1
1166573	99	48	5,34	cyclictest	1323149	-21	ssh	11:35:29	0
1166573	99	48	41,5	cyclictest	1202138	-21	/usr/sbin/munin	09:15:23	0
1166573	99	48	29,16	cyclictest	1262193	-21	sh	10:25:00	0
1166574	99	47	40,5	cyclictest	1273135	-21	kworker/u4:0+events_unbound	10:40:00	1
1166574	99	47	39,5	cyclictest	0	-21	swapper/1	09:30:22	1
1166574	99	47	38,6	cyclictest	1228645	-21	ssh	09:45:36	1
1166574	99	47	38,6	cyclictest	1169131	-21	kworker/u4:6-rpciod	09:05:20	1
1166574	99	47	33,6	cyclictest	1170414	-21	kworker/u4:12+events_unbound	08:30:13	1
1166573	99	47	40,5	cyclictest	1289119	-21	ldconfig	10:55:29	0
1166573	99	47	38,7	cyclictest	1356297	-21	df_abs	12:15:16	0
1166573	99	47	36,8	cyclictest	1283759	-21	rm	10:50:00	0
1166574	99	46	39,4	cyclictest	0	-21	swapper/1	10:30:34	1
1166574	99	46	38,5	cyclictest	0	-21	swapper/1	08:05:32	1
1166574	99	46	37,6	cyclictest	0	-21	swapper/1	08:50:18	1
1166574	99	46	35,7	cyclictest	1184277	-21	kworker/u4:1-nfsiod	08:55:28	1
1166573	99	46	38,6	cyclictest	1249503	-21	aten2__	10:10:15	0
1166573	99	46	38,5	cyclictest	1194430	-21	sendmail	09:00:00	0
1166573	99	46	28,16	cyclictest	0	-21	swapper/0	12:20:27	0
1166573	99	46	27,17	cyclictest	0	-21	swapper/0	11:05:22	0
1166574	99	45	35,6	cyclictest	0	-21	swapper/1	11:35:32	1
1166574	99	45	34,6	cyclictest	0	-21	swapper/1	09:55:55	1
1166573	99	45	39,4	cyclictest	1219322	-21	fschecks_count	09:35:19	0
1166573	99	45	37,5	cyclictest	0	-21	swapper/0	09:20:10	0
1166574	99	44	36,6	cyclictest	1131308	-21	kworker/u4:5+events_unbound	08:25:18	1
1166574	99	44	35,6	cyclictest	1372511	-21	modprobe	12:35:00	1
1166573	99	44	37,5	cyclictest	1192316	-21	fschecks_count	08:50:18	0
1166573	99	44	36,6	cyclictest	1183245	-21	aten_r7power_cu	08:15:14	0
1166574	99	43	36,5	cyclictest	1170412	-21	kworker/u4:9+events_unbound	07:50:25	1
1166574	99	43	34,7	cyclictest	1318529	-21	fschecks_count	11:30:22	1
1166573	99	43	35,6	cyclictest	1173197	-21	aten_r7power_en	07:35:14	0
1166574	99	42	36,4	cyclictest	1179427	-21	systemd	08:00:02	1
1166574	99	42	35,5	cyclictest	1155654	-21	kworker/u4:16-rpciod	07:15:12	1
1166574	99	42	34,5	cyclictest	0	-21	swapper/1	07:25:37	1
1166573	99	42	35,5	cyclictest	1180556	-21	latency_hist	08:05:01	0
1166573	99	42	34,6	cyclictest	1166840	-21	aten_r7power_vo	07:10:16	0
1166573	99	42	34,4	cyclictest	0	-21	swapper/0	07:45:29	0
1166574	99	41	33,6	cyclictest	1131308	-21	kworker/u4:5+events_unbound	07:40:02	1
1166574	99	41	33,5	cyclictest	0	-21	swapper/1	08:10:24	1
1166574	99	41	31,6	cyclictest	0	-21	swapper/1	10:00:15	1
1166573	99	41	33,6	cyclictest	1181045	-21	fschecks_time	08:05:18	0
1166573	99	41	33,6	cyclictest	1171916	-21	aten_r7power_cu	07:30:16	0
1166574	99	39	30,5	cyclictest	0	-21	swapper/1	08:45:33	1
1166573	99	39	31,6	cyclictest	0	-21	swapper/0	08:30:37	0
1166573	99	33	25,6	cyclictest	0	-21	swapper/0	07:10:01	0
1166573	99	33	25,6	cyclictest	0	-21	swapper/0	07:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17