OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Sun Jan 04, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1113289	99	104	94,7	cyclictest	1134876	-21	kworker/u4:3+events_unbound	08:55:09	1
1113289	99	104	94,7	cyclictest	1134876	-21	kworker/u4:3+events_unbound	08:55:09	1
1113287	99	93	53,33	cyclictest	54	-21	kswapd0	10:20:13	0
1113287	99	92	87,3	cyclictest	1126035	-21	kworker/u4:12+events_unbound	08:00:00	0
1113287	99	92	87,3	cyclictest	1126035	-21	kworker/u4:12+events_unbound	07:59:59	0
1113289	99	88	80,6	cyclictest	1239396	-21	kworker/u4:10+events_unbound	11:10:37	1
1113289	99	82	73,7	cyclictest	1281234	-21	kworker/u4:6+events_unbound	12:15:51	1
1113289	99	77	65,8	cyclictest	1247971	-21	kworker/u4:8+events_unbound	11:20:41	1
1113289	99	76	68,6	cyclictest	1256521	-21	kworker/u4:2+events_unbound	11:30:43	1
1113289	99	76	68,6	cyclictest	1180600	-21	kworker/u4:9+events_unbound	09:55:25	1
1113289	99	76	65,8	cyclictest	1137412	-21	kworker/u4:7+events_unbound	09:10:12	1
1113287	99	76	65,8	cyclictest	1127314	-21	kworker/u4:13+events_unbound	08:05:00	0
1113289	99	75	66,6	cyclictest	1103445	-21	kworker/u4:17+events_unbound	08:10:01	1
1113287	99	74	65,7	cyclictest	1159124	-21	kworker/u4:5+events_unbound	10:00:24	0
1113289	99	72	64,5	cyclictest	1205710	-21	kworker/u4:11+events_unbound	11:05:38	1
1113289	99	71	60,7	cyclictest	1209995	-21	kworker/u4:7+events_unbound	10:35:29	1
1113287	99	69	61,6	cyclictest	1103445	-21	kworker/u4:17+events_unbound	07:40:00	0
1113289	99	67	58,6	cyclictest	1114579	-21	kworker/u4:2+events_unbound	07:14:50	1
1113287	99	67	42,17	cyclictest	54	-21	kswapd0	09:35:10	0
1113289	99	66	56,7	cyclictest	1136132	-21	kworker/u4:5+events_unbound	09:20:16	1
1113287	99	66	53,7	cyclictest	1310532	-21	kworker/u4:3+xprtiod	12:30:07	0
1113287	99	66	42,13	cyclictest	255	50	irq/23-42890000.ethernet	07:09:59	0
1113289	99	65	59,4	cyclictest	1114578	-21	kworker/u4:1+events_unbound	08:20:01	1
1113289	99	64	56,6	cyclictest	1134876	-21	kworker/u4:3+events_unbound	09:05:12	1
1113287	99	64	48,11	cyclictest	1113285	-21	cyclictest	11:49:59	0
1113289	99	63	55,6	cyclictest	1252227	-21	kworker/u4:10+events_unbound	11:20:01	1
1113289	99	63	55,6	cyclictest	1117133	-21	kworker/u4:8+events_unbound	08:35:05	1
1113289	99	62	44,5	cyclictest	1310533	-21	kworker/u4:4+events_unbound	12:28:01	1
1113287	99	62	29,23	cyclictest	255	50	irq/23-42890000.ethernet	11:50:10	0
1113289	99	61	53,6	cyclictest	1103445	-21	kworker/u4:17+events_unbound	07:39:56	1
1113289	99	61	39,8	cyclictest	1256521	-21	kworker/u4:2+events_unbound	11:30:00	1
1113287	99	61	27,18	cyclictest	0	-21	swapper/0	11:10:18	0
1113289	99	58	51,5	cyclictest	1139929	-21	kworker/u4:10+events_unbound	09:00:08	1
1113289	99	57	50,5	cyclictest	1134876	-21	kworker/u4:3+events_unbound	08:55:01	1
1113289	99	57	49,5	cyclictest	0	-21	swapper/1	10:20:42	1
1113287	99	57	49,5	cyclictest	1120895	-21	kworker/u4:0+events_unbound	07:44:56	0
1113289	99	56	9,44	cyclictest	1143842	-21	diskmemload	10:55:25	1
1113289	99	56	48,6	cyclictest	1103445	-21	kworker/u4:17+events_unbound	08:45:06	1
1113287	99	56	48,6	cyclictest	54	-21	kswapd0	07:10:11	0
1113287	99	56	45,8	cyclictest	1205708	-21	kworker/u4:1+events_unbound	10:40:33	0
1113287	99	56	36,10	cyclictest	1283552	-21	fschecks_count	11:55:21	0
1113287	99	55	45,7	cyclictest	1208385	-21	ld	10:25:25	0
1113287	99	55	29,8	cyclictest	1149255	-21	ntpq	09:15:35	0
1113289	99	54	46,6	cyclictest	1115838	-21	kworker/u4:6+events_unbound	08:30:04	1
1113289	99	54	46,5	cyclictest	1210000	-21	kworker/u4:16+events_unbound	10:30:29	1
1113289	99	54	40,7	cyclictest	1165154	-21	apt-get	09:35:07	1
1113287	99	54	47,5	cyclictest	1254061	-21	/usr/sbin/munin	11:20:11	0
1113287	99	54	44,7	cyclictest	1268510	-21	kworker/u4:1+events_unbound	12:10:48	0
1113287	99	54	26,8	cyclictest	0	-21	swapper/0	11:25:33	0
1113287	99	53	46,5	cyclictest	1157017	-21	sshd	09:25:16	0
1113289	99	52	44,6	cyclictest	1229507	-21	/usr/sbin/munin	10:50:30	1
1113289	99	52	44,6	cyclictest	1208083	-21	fschecks_time	10:25:19	1
1113289	99	52	40,8	cyclictest	54	-21	kswapd0	12:10:33	1
1113287	99	52	18,18	cyclictest	0	-21	swapper/0	12:00:39	0
1113287	99	52	17,23	cyclictest	0	-21	swapper/0	10:45:27	0
1113287	99	52	1,26	cyclictest	1271062	-21	cut	11:40:20	0
1113289	99	51	44,5	cyclictest	1317020	-21	/usr/sbin/munin	12:35:20	1
1113287	99	51	43,6	cyclictest	54	-21	kswapd0	11:20:01	0
1113287	99	51	42,6	cyclictest	1235095	-21	kworker/u4:2+events_unbound	11:00:37	0
1113287	99	51	39,9	cyclictest	1300155	-21	cut	12:15:22	0
1113287	99	51	37,9	cyclictest	1198937	-21	modprobe	10:15:00	0
1113289	99	50	7,35	cyclictest	1200216	-21	ssh	10:15:38	1
1113289	99	50	42,6	cyclictest	1267623	-21	timerandwakeup	11:35:40	1
1113289	99	50	40,7	cyclictest	1131290	-21	systemd	08:20:03	1
1113289	99	50	39,8	cyclictest	1237378	-21	aten_r7power_po	11:00:18	1
1113287	99	50	43,5	cyclictest	1241996	-21	/usr/sbin/munin	11:05:21	0
1113287	99	50	43,5	cyclictest	1199619	-21	/usr/sbin/munin	10:15:21	0
1113287	99	50	40,8	cyclictest	1262801	-21	gltestperf	11:30:21	0
1113287	99	50	40,8	cyclictest	1178169	-21	aten2__	09:50:16	0
1113287	99	50	40,7	cyclictest	1229126	-21	/usr/sbin/munin	10:50:20	0
1113287	99	50	20,11	cyclictest	1161365	-21	aten2__	09:30:26	0
1113289	99	49	40,6	cyclictest	0	-21	swapper/1	12:20:29	1
1113289	99	49	39,6	cyclictest	1281235	-21	kworker/u4:7-rpciod	12:00:27	1
1113287	99	49	28,18	cyclictest	0	-21	swapper/0	08:20:00	0
1113287	99	49	16,20	cyclictest	0	-21	swapper/0	11:35:30	0
1113289	99	48	41,5	cyclictest	1279613	-21	cut	11:50:27	1
1113289	99	48	41,5	cyclictest	1221102	-21	ldconfig	10:40:29	1
1113287	99	48	42,4	cyclictest	1213236	-21	unixbench_singl	10:30:40	0
1113287	99	48	39,6	cyclictest	1167626	-21	kworker/u4:4+events_unbound	09:40:22	0
1113287	99	48	31,14	cyclictest	0	-21	swapper/0	09:21:57	0
1113289	99	47	40,5	cyclictest	1276146	-21	ssh	11:45:44	1
1113289	99	47	40,5	cyclictest	1170155	-21	gltestperf	09:40:22	1
1113289	99	47	38,6	cyclictest	1192059	-21	unixbench_multi	10:05:38	1
1113287	99	47	39,5	cyclictest	1304726	-21	if_eth0	12:20:21	0
1113287	99	47	30,13	cyclictest	1191363	-21	if_eth0	10:05:22	0
1113287	99	47	24,21	cyclictest	0	-21	swapper/0	10:55:24	0
1113287	99	47	23,14	cyclictest	255	50	irq/23-42890000.ethernet	07:50:12	0
1113287	99	47	16,19	cyclictest	0	-21	swapper/0	09:45:19	0
1113287	99	47	15,12	cyclictest	0	-21	swapper/0	08:35:01	0
1113289	99	46	39,5	cyclictest	1157659	-21	ntp_kernel_err	09:25:30	1
1113289	99	46	39,5	cyclictest	1113285	-21	cyclictest	11:40:15	1
1113289	99	46	38,6	cyclictest	1113285	-21	cyclictest	09:15:31	1
1113289	99	46	38,5	cyclictest	1187673	-21	sed	10:00:39	1
1113289	99	46	36,7	cyclictest	0	-21	swapper/1	10:45:31	1
1113287	99	46	38,6	cyclictest	1126035	-21	kworker/u4:12+events_unbound	08:25:03	0
1113287	99	46	38,5	cyclictest	1216456	-21	tune2fs	10:35:20	0
1113289	99	45	38,5	cyclictest	1129054	-21	fschecks_count	08:10:19	1
1113289	99	45	38,5	cyclictest	1129054	-21	fschecks_count	08:10:18	1
1113289	99	45	37,5	cyclictest	0	-21	swapper/1	09:50:30	1
1113289	99	45	35,7	cyclictest	1102192	-21	kworker/u4:14+events_unbound	07:25:01	1
1113289	99	45	35,7	cyclictest	0	-21	swapper/1	09:45:26	1
1113289	99	45	34,5	cyclictest	1289798	-21	kworker/u4:4+events_unbound	12:05:50	1
1113289	99	45	33,8	cyclictest	0	-21	swapper/1	09:30:39	1
1113287	99	45	39,4	cyclictest	1145039	-21	ps	09:10:35	0
1113287	99	45	38,4	cyclictest	0	-21	swapper/0	08:10:01	0
1113287	99	45	37,6	cyclictest	1118301	-21	unixbench_multi	07:25:35	0
1113287	99	45	37,5	cyclictest	1140475	-21	fschecks_count	08:55:24	0
1113287	99	45	37,5	cyclictest	1140475	-21	fschecks_count	08:55:23	0
1113287	99	45	35,8	cyclictest	1318431	-21	ssh	12:36:30	0
1113287	99	45	31,11	cyclictest	0	-21	swapper/0	08:50:35	0
1113287	99	45	1,22	cyclictest	0	-21	swapper/0	08:45:21	0
1113289	99	44	37,5	cyclictest	1283882	-21	ldconfig	11:55:28	1
1113289	99	44	36,6	cyclictest	1114811	-21	aten2__	07:15:16	1
1113289	99	44	36,5	cyclictest	1310533	-21	kworker/u4:4-rpciod	12:30:21	1
1113287	99	44	36,6	cyclictest	1122465	-21	aten_r7power_po	07:45:17	0
1113287	99	44	35,7	cyclictest	1291746	-21	aten_r7power_po	12:05:17	0
1113287	99	44	34,7	cyclictest	1141569	-21	aten_r7power_en	09:00:17	0
1113287	99	44	33,7	cyclictest	1135194	-21	aten_r7power_vo	08:35:16	0
1113287	99	44	25,16	cyclictest	0	-21	swapper/0	12:30:35	0
1113289	99	43	35,6	cyclictest	1195113	-21	/usr/sbin/munin	10:10:16	1
1113289	99	43	33,6	cyclictest	0	-21	swapper/1	07:30:32	1
1113287	99	43	35,6	cyclictest	1136460	-21	aten_r7power_po	08:40:14	0
1113287	99	43	32,8	cyclictest	0	-21	swapper/0	09:55:35	0
1113287	99	42	34,6	cyclictest	1142767	-21	aten2__	09:05:17	0
1113287	99	42	34,6	cyclictest	1118629	-21	aten_r7power_cu	07:30:14	0
1113289	99	41	33,6	cyclictest	1125031	-21	aten_r7power_cu	07:55:24	1
1113289	99	41	33,6	cyclictest	1125031	-21	aten_r7power_cu	07:55:23	1
1113289	99	41	32,7	cyclictest	1121944	-21	switchtime	07:40:36	1
1113289	99	41	31,8	cyclictest	1113415	-21	latency_hist	07:10:01	1
1113289	99	41	30,9	cyclictest	1115838	-21	kworker/u4:6+events_unbound	08:45:01	1
1113287	99	41	35,4	cyclictest	1115884	-21	sh	07:20:00	0
1113287	99	41	33,5	cyclictest	0	-21	swapper/0	08:10:16	0
1113287	99	41	33,5	cyclictest	0	-21	swapper/0	08:10:15	0
1113289	99	40	33,5	cyclictest	1117355	-21	aten2__	07:25:15	1
1113289	99	40	30,7	cyclictest	0	-21	swapper/1	07:49:59	1
1113289	99	39	33,4	cyclictest	1127351	-21	munin-run	08:05:00	1
1113289	99	39	33,4	cyclictest	1123748	-21	cut	07:50:26	1
1113287	99	39	30,6	cyclictest	0	-21	swapper/0	08:20:29	0
1113287	99	38	31,5	cyclictest	1116363	-21	fschecks_count	07:20:21	0
1113289	99	36	24,9	cyclictest	1117133	-21	kworker/u4:8-rpciod	08:25:20	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17