OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Tue Sep 22, 2026 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1152474	99	114	104,7	cyclictest	1199267	-21	kworker/u4:9+events_unbound	21:37:26	1
1152474	99	103	95,5	cyclictest	1225684	-21	kworker/u4:8+events_unbound	22:12:35	1
1152472	99	101	73,20	cyclictest	53	-21	kswapd0	23:45:14	0
1152474	99	98	91,5	cyclictest	1318882	-21	kworker/u4:1+events_unbound	23:52:51	1
1152474	99	96	85,5	cyclictest	1199267	-21	kworker/u4:9+events_unbound	21:42:26	1
1152472	99	93	68,16	cyclictest	53	-21	kswapd0	22:20:10	0
1152472	99	93	68,16	cyclictest	53	-21	kswapd0	22:20:10	0
1152474	99	87	78,5	cyclictest	1336995	-21	kworker/u4:4+events_unbound	00:02:54	1
1152474	99	86	78,5	cyclictest	1183270	-21	kworker/u4:1+events_unbound	22:02:33	1
1152474	99	83	76,5	cyclictest	1216662	-21	kworker/u4:5+events_unbound	21:52:30	1
1152474	99	82	75,5	cyclictest	1332428	-21	kworker/u4:2+events_unbound	23:57:52	1
1152472	99	76	3,31	cyclictest	1214611	-21	apt-get	21:45:10	0
1152474	99	75	66,7	cyclictest	1252725	-21	kworker/u4:9+events_unbound	23:17:48	1
1152474	99	72	66,4	cyclictest	1346029	-21	kworker/u4:0+events_unbound	00:17:56	1
1152472	99	72	62,7	cyclictest	1268073	-21	sh	22:45:13	0
1152472	99	72	60,6	cyclictest	0	-21	swapper/0	00:02:17	0
1152472	99	71	3,64	cyclictest	1197175	-21	ssh	21:25:10	0
1152472	99	70	36,31	cyclictest	1161314	-21	cat	19:40:36	0
1152474	99	69	61,6	cyclictest	1208300	-21	kworker/u4:4+events_unbound	22:07:35	1
1152472	99	69	62,5	cyclictest	1361217	-21	cron	00:30:01	0
1152472	99	69	40,27	cyclictest	1282389	-21	switchtime	23:00:36	0
1152472	99	69	39,28	cyclictest	1331084	-21	tr	23:55:38	0
1152472	99	69	19,47	cyclictest	1228741	-21	gltestperf	22:00:22	0
1152474	99	68	60,6	cyclictest	1203772	-21	kworker/u4:11+events_unbound	21:32:24	1
1152472	99	68	4,12	cyclictest	1152452	-21	munin-run	19:10:01	0
1152472	99	68	4,12	cyclictest	1152452	-21	munin-run	19:10:00	0
1152472	99	67	51,9	cyclictest	1338906	-21	apt-get	00:05:09	0
1152472	99	67	27,36	cyclictest	256	50	irq/23-42890000.ethernet	21:35:12	0
1152474	99	66	59,5	cyclictest	1158988	-21	kworker/u4:8+events_unbound	19:32:06	1
1152472	99	66	6,17	cyclictest	1277891	-21	ssh	22:55:45	0
1152472	99	66	35,29	cyclictest	1183766	-21	ssh	21:10:17	0
1152472	99	66	29,34	cyclictest	0	-21	swapper/0	20:30:29	0
1152472	99	66	18,18	cyclictest	1202630	-21	ps	21:30:46	0
1152474	99	65	57,6	cyclictest	1165380	-21	kworker/u4:8+events_unbound	21:07:18	1
1152472	99	65	4,19	cyclictest	1260100	-21	ssh	22:35:33	0
1152472	99	65	31,31	cyclictest	0	-21	swapper/0	22:25:32	0
1152472	99	65	30,32	cyclictest	256	50	irq/23-42890000.ethernet	21:25:02	0
1152472	99	65	30,32	cyclictest	256	50	irq/23-42890000.ethernet	21:25:01	0
1152472	99	65	30,32	cyclictest	0	-21	swapper/0	22:40:28	0
1152472	99	65	2,16	cyclictest	1232652	-21	apt-get	22:05:11	0
1152474	99	64	57,5	cyclictest	1165381	-21	kworker/u4:9+events_unbound	20:17:13	1
1152472	99	64	4,15	cyclictest	1343887	-21	grep	00:10:25	0
1152472	99	64	3,16	cyclictest	1347922	-21	apt-get	00:15:17	0
1152472	99	64	28,32	cyclictest	0	-21	swapper/0	22:30:33	0
1152472	99	64	25,36	cyclictest	0	-21	swapper/0	00:35:12	0
1152472	99	64	13,3	cyclictest	256	50	irq/23-42890000.ethernet	21:45:00	0
1152472	99	63	3,8	cyclictest	1242269	-21	ntpq	22:15:32	0
1152472	99	63	30,30	cyclictest	1163292	-21	fschecks_count	19:50:17	0
1152472	99	63	30,30	cyclictest	0	-21	swapper/0	21:15:38	0
1152472	99	63	22,38	cyclictest	1361774	-21	cpu	00:30:20	0
1152472	99	63	22,38	cyclictest	1361774	-21	cpu	00:30:19	0
1152472	99	62	3,9	cyclictest	1224734	-21	ssh	21:55:38	0
1152472	99	62	36,23	cyclictest	0	-21	swapper/0	22:52:41	0
1152472	99	62	22,37	cyclictest	256	50	irq/23-42890000.ethernet	23:15:19	0
1152472	99	61	5,12	cyclictest	1304388	-21	ntpq	23:25:40	0
1152472	99	61	34,23	cyclictest	1326769	-21	timerandwakeup	23:50:43	0
1152472	99	61	30,28	cyclictest	0	-21	swapper/0	19:55:34	0
1152472	99	61	30,27	cyclictest	1139681	-21	kworker/u4:0-rpciod	19:15:23	0
1152472	99	61	28,30	cyclictest	0	-21	swapper/0	21:05:26	0
1152472	99	61	27,31	cyclictest	0	-21	swapper/0	23:40:29	0
1152472	99	61	26,31	cyclictest	0	-21	swapper/0	22:10:26	0
1152472	99	61	2,16	cyclictest	1167447	-21	ntpq	20:05:28	0
1152472	99	61	2,14	cyclictest	1158583	-21	ntpq	19:30:41	0
1152474	99	60	54,4	cyclictest	1323369	-21	kworker/u4:2+events_unbound	23:47:53	1
1152474	99	60	54,4	cyclictest	1301572	-21	kworker/u4:6+events_unbound	23:30:04	1
1152472	99	60	2,13	cyclictest	1181467	-21	ntpq	21:00:26	0
1152472	99	60	1,13	cyclictest	1290999	-21	ssh	23:10:31	0
1152472	99	60	1,13	cyclictest	1175130	-21	ntpq	20:35:29	0
1152474	99	59	52,6	cyclictest	1183270	-21	kworker/u4:1+events_unbound	21:47:27	1
1152472	99	59	28,28	cyclictest	0	-21	swapper/0	23:30:19	0
1152472	99	59	25,31	cyclictest	1179745	-21	aten_r7power_vo	20:55:16	0
1152472	99	59	2,17	cyclictest	1353330	-21	ssh	00:20:32	0
1152474	99	58	51,5	cyclictest	1183270	-21	kworker/u4:1+events_unbound	21:17:21	1
1152474	99	58	50,6	cyclictest	1243708	-21	kworker/u4:4+events_unbound	22:20:17	1
1152474	99	58	50,6	cyclictest	1243708	-21	kworker/u4:4+events_unbound	22:20:17	1
1152474	99	58	1,45	cyclictest	1317516	-21	ssh	23:40:30	1
1152472	99	58	9,44	cyclictest	1162851	-21	modprobe	19:50:00	0
1152472	99	58	4,18	cyclictest	1299923	-21	ntpq	23:20:34	0
1152472	99	58	3,14	cyclictest	1286652	-21	ntpq	23:05:35	0
1152472	99	58	26,29	cyclictest	0	-21	swapper/0	20:25:00	0
1152472	99	58	15,14	cyclictest	1168334	-21	sed	20:10:16	0
1152474	99	57	50,5	cyclictest	1301573	-21	kworker/u4:8+events_unbound	23:30:01	1
1152472	99	57	9,44	cyclictest	624	-21	munin-node	19:25:36	0
1152472	99	57	2,16	cyclictest	1155931	-21	ntpq	19:20:35	0
1152472	99	57	2,13	cyclictest	1176451	-21	ntpq	20:40:30	0
1152472	99	57	1,17	cyclictest	1153227	-21	ntpq	19:10:30	0
1152472	99	57	1,15	cyclictest	1169993	-21	sshd	20:15:29	0
1152472	99	57	1,14	cyclictest	1159855	-21	ntpq	19:35:35	0
1152474	99	56	48,6	cyclictest	317	-21	systemd-journal	22:41:44	1
1152474	99	56	47,7	cyclictest	1266231	-21	kworker/u4:11+events_unbound	22:47:41	1
1152474	99	56	45,7	cyclictest	1286920	-21	xargs	23:05:41	1
1152472	99	56	23,29	cyclictest	0	-21	swapper/0	23:35:18	0
1152472	99	56	22,31	cyclictest	0	-21	swapper/0	20:25:21	0
1152472	99	55	23,30	cyclictest	1219591	-21	df_abs	21:50:16	0
1152472	99	55	2,14	cyclictest	1166189	-21	ntpq	20:00:31	0
1152472	99	55	20,31	cyclictest	0	-21	swapper/0	20:45:16	0
1152474	99	53	8,30	cyclictest	1336997	-21	kworker/u4:7+rpciod	00:05:22	1
1152474	99	53	45,6	cyclictest	1297097	-21	kworker/u4:7+events_unbound	23:22:49	1
1152474	99	53	40,5	cyclictest	1160273	-21	kworker/u4:14+events_unbound	19:42:09	1
1152474	99	52	38,4	cyclictest	1167951	-21	kworker/u4:15+events_unbound	20:55:02	1
1152472	99	52	2,15	cyclictest	1178911	-21	ntpq	20:50:25	0
1152474	99	51	40,8	cyclictest	1154699	-21	switchtime	19:15:36	1
1152474	99	49	43,4	cyclictest	1156359	-21	kworker/u4:13+events_unbound	19:25:13	1
1152474	99	49	42,5	cyclictest	1165380	-21	kworker/u4:8+events_unbound	21:22:23	1
1152474	99	49	42,5	cyclictest	1165380	-21	kworker/u4:8+events_unbound	21:22:22	1
1152474	99	49	41,5	cyclictest	1352878	-21	fschecks_time	00:20:21	1
1152474	99	49	40,6	cyclictest	1245607	-21	ssh	22:19:59	1
1152474	99	49	38,8	cyclictest	0	-21	swapper/1	19:40:01	1
1152474	99	49	37,9	cyclictest	1156183	-21	timerwakeupswit	19:20:42	1
1152474	99	48	42,5	cyclictest	1252726	-21	kworker/u4:10+events_unbound	22:37:38	1
1152474	99	48	41,5	cyclictest	1197423	-21	cpu	21:25:26	1
1152474	99	48	41,5	cyclictest	1183873	-21	df_abs	21:10:19	1
1152474	99	48	41,5	cyclictest	1152471	-21	cyclictest	22:30:19	1
1152474	99	48	39,6	cyclictest	1366687	-21	awk	00:35:23	1
1152474	99	48	37,7	cyclictest	0	-21	swapper/1	23:35:39	1
1152474	99	48	34,5	cyclictest	1174335	-21	kworker/u4:2+events_unbound	20:37:17	1
1152474	99	47	41,5	cyclictest	1248219	-21	kworker/u4:6+events_unbound	22:28:45	1
1152474	99	47	36,7	cyclictest	1173955	-21	ps	20:30:36	1
1152474	99	47	27,6	cyclictest	1270741	-21	kworker/u4:4+events_unbound	23:12:15	1
1152474	99	46	39,5	cyclictest	1224612	-21	sh	21:55:32	1
1152474	99	46	33,4	cyclictest	1354569	-21	kworker/u4:8+events_unbound	00:25:38	1
1152474	99	45	37,6	cyclictest	1167950	-21	kworker/u4:14+events_unbound	20:10:01	1
1152474	99	45	36,5	cyclictest	1270741	-21	kworker/u4:4-rpciod	22:50:16	1
1152474	99	44	37,5	cyclictest	1161952	-21	sed	19:45:16	1
1152474	99	44	36,5	cyclictest	0	-21	swapper/1	00:30:39	1
1152474	99	44	36,5	cyclictest	0	-21	swapper/1	00:30:39	1
1152474	99	44	35,7	cyclictest	1282361	-21	mailstats	23:00:36	1
1152474	99	44	35,7	cyclictest	1163238	-21	df_abs	19:50:16	1
1152474	99	43	7,20	cyclictest	0	-21	swapper/1	22:55:10	1
1152474	99	43	36,5	cyclictest	1165885	-21	fschecks_count	20:00:22	1
1152474	99	43	35,5	cyclictest	1167938	-21	kworker/u4:11-rpciod	20:30:01	1
1152474	99	43	34,7	cyclictest	1181265	-21	fschecks_time	21:00:20	1
1152474	99	43	33,7	cyclictest	1166677	-21	kworker/u4:0+events_unbound	20:40:14	1
1152474	99	42	34,5	cyclictest	1332428	-21	kworker/u4:2+events_unbound	00:11:36	1
1152474	99	42	33,7	cyclictest	1165558	-21	latency_hist	20:00:01	1
1152474	99	42	33,7	cyclictest	1152731	-21	aten_r7power_po	19:10:17	1
1152474	99	41	32,7	cyclictest	1167950	-21	kworker/u4:14+events_unbound	20:10:29	1
1152474	99	41	31,7	cyclictest	1171614	-21	timerwakeupswit	20:20:39	1
1152474	99	41	2,8	cyclictest	17	1	rcu_preempt	20:45:33	1
1152474	99	39	32,5	cyclictest	1179868	-21	fschecks_count	20:55:20	1
1152474	99	34	25,6	cyclictest	0	-21	swapper/1	19:10:02	1
1152474	99	34	25,6	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17