OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackeslot3s.osadl.org (updated Mon Apr 20, 2026 00:45:29)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1148643	99	94	84,7	cyclictest	1148651	-21	latency_hist	19:10:01	0
1148643	99	91	20,41	cyclictest	1168191	-21	ssh	21:40:53	0
1148643	99	85	23,57	cyclictest	1186228	-21	ssh	22:23:23	0
1148647	99	83	1,54	cyclictest	1216752	-21	ssh	23:34:57	1
1148647	99	82	18,35	cyclictest	1224598	-21	rm	23:52:57	1
1148647	99	80	2,42	cyclictest	1172308	-21	ssh	21:50:31	1
1148647	99	80	2,42	cyclictest	1149139	-21	systemd-run	19:20:01	1
1148647	99	80	2,42	cyclictest	1149139	-21	systemd-run	19:20:01	1
1148643	99	80	22,37	cyclictest	1241114	-21	ssh	00:31:17	0
1148643	99	80	1,61	cyclictest	1192564	-21	ssh	22:38:06	0
1148647	99	79	2,43	cyclictest	1175930	-21	ssh	21:59:31	1
1148643	99	78	10,58	cyclictest	168	50	irq/134-8000000	23:16:28	0
1148647	99	77	2,39	cyclictest	1235314	-21	sh	00:18:04	1
1148647	99	77	2,39	cyclictest	1235314	-21	sh	00:18:04	1
1148647	99	77	1,44	cyclictest	1179507	-21	sh	22:07:33	1
1148643	99	77	29,33	cyclictest	1159587	-21	ssh	21:20:52	0
1148643	99	77	17,51	cyclictest	168	50	irq/134-8000000	00:06:39	0
1148643	99	77	17,51	cyclictest	168	50	irq/134-8000000	00:06:39	0
1148643	99	77	1,2	cyclictest	0	-21	swapper/0	19:15:02	0
1148643	99	77	1,2	cyclictest	0	-21	swapper/0	19:15:02	0
1148647	99	76	1,44	cyclictest	1201422	-21	sh	22:58:54	1
1148643	99	76	6,55	cyclictest	1227472	-40	mandb	00:00:05	0
1148643	99	76	30,41	cyclictest	1216150	-21	ssh	23:33:20	0
1148647	99	75	11,36	cyclictest	1192356	-21	sh	22:37:26	1
1148643	99	75	14,39	cyclictest	168	50	irq/134-8000000	23:00:20	0
1148643	99	74	1,55	cyclictest	1173647	-21	ssh	21:54:04	0
1148643	99	74	10,7	cyclictest	168	50	irq/134-8000000	20:21:59	0
1148643	99	73	1,14	cyclictest	1179688	-21	ssh	22:08:11	0
1148647	99	72	2,64	cyclictest	1207120	-21	sshd	23:12:03	1
1148647	99	72	2,39	cyclictest	364	-21	snmpd	23:27:11	1
1148643	99	72	29,26	cyclictest	1194024	-21	ssh	22:41:10	0
1148643	99	72	19,48	cyclictest	168	50	irq/134-8000000	22:15:23	0
1148647	99	71	2,36	cyclictest	1187352	-21	ssh	22:25:40	1
1148647	99	71	1,54	cyclictest	0	-21	swapper/1	19:30:02	1
1148643	99	71	19,48	cyclictest	168	50	irq/134-8000000	22:29:12	0
1148643	99	71	18,48	cyclictest	168	50	irq/134-8000000	23:13:05	0
1148647	99	70	24,41	cyclictest	1166863	-21	rm	21:38:07	1
1148647	99	70	1,65	cyclictest	1229275	-21	ssh	00:03:57	1
1148643	99	70	8,57	cyclictest	168	50	irq/134-8000000	00:18:20	0
1148643	99	70	8,57	cyclictest	168	50	irq/134-8000000	00:18:19	0
1148643	99	70	29,23	cyclictest	1170993	-21	ssh	21:47:44	0
1148643	99	70	2,10	cyclictest	1223251	-21	unin-run	23:50:01	0
1148643	99	70	16,49	cyclictest	168	50	irq/134-8000000	22:51:20	0
1148643	99	70	16,49	cyclictest	168	50	irq/134-8000000	22:51:20	0
1148643	99	70	14,51	cyclictest	168	50	irq/134-8000000	21:59:26	0
1148647	99	69	28,36	cyclictest	1178296	-21	latency_hist	22:05:03	1
1148647	99	69	1,64	cyclictest	1171657	-21	ssh	21:49:31	1
1148647	99	69	1,37	cyclictest	1197936	-21	ssh	22:50:13	1
1148647	99	69	1,37	cyclictest	1197936	-21	ssh	22:50:13	1
1148643	99	69	29,23	cyclictest	1233037	-21	ssh	00:12:43	0
1148643	99	69	25,39	cyclictest	1197811	-21	latency_hist	22:50:02	0
1148643	99	69	23,28	cyclictest	1242817	-21	ssh	00:35:04	0
1148647	99	68	25,38	cyclictest	23	-21	ksoftirqd/1	23:24:01	1
1148643	99	68	3,6	cyclictest	1227485	-21	cron	00:00:00	0
1148643	99	68	3,6	cyclictest	1227485	-21	cron	00:00:00	0
1148643	99	68	15,35	cyclictest	168	50	irq/134-8000000	21:17:06	0
1148647	99	67	2,4	cyclictest	13	1	rcu_preempt	21:25:03	1
1148647	99	67	1,63	cyclictest	1221805	-21	ssh	23:46:16	1
1148647	99	67	1,62	cyclictest	1237005	-21	ssh	00:21:46	1
1148647	99	67	1,62	cyclictest	1226137	-21	ssh	23:56:29	1
1148647	99	67	1,62	cyclictest	1226137	-21	ssh	23:56:28	1
1148647	99	67	1,61	cyclictest	1230280	-21	ssh	00:05:59	1
1148647	99	67	1,61	cyclictest	1230280	-21	ssh	00:05:59	1
1148647	99	67	1,39	cyclictest	1155674	-21	ssh	21:11:53	1
1148647	99	67	1,39	cyclictest	1155674	-21	ssh	21:11:53	1
1148647	99	66	16,45	cyclictest	1180107	-1	kworker/u9:1	22:13:59	1
1148647	99	66	1,61	cyclictest	1189670	-21	ssh	22:31:06	1
1148647	99	66	1,61	cyclictest	1189670	-21	ssh	22:31:06	1
1148647	99	66	1,61	cyclictest	1182933	-21	ssh	22:15:31	1
1148647	99	66	1,61	cyclictest	1169136	-21	ssh	21:43:24	1
1148647	99	66	1,61	cyclictest	1154782	-21	sshd	21:05:03	1
1148643	99	66	8,6	cyclictest	168	50	irq/134-8000000	21:34:29	0
1148643	99	66	25,12	cyclictest	1218335	-21	ssh	23:38:30	0
1148643	99	66	1,61	cyclictest	0	-21	swapper/0	00:25:44	0
1148643	99	66	1,61	cyclictest	0	-21	swapper/0	00:25:43	0
1148647	99	65	2,59	cyclictest	1233588	-21	ssh	00:14:08	1
1148647	99	65	1,60	cyclictest	1204377	-21	ssh	23:05:22	1
1148647	99	65	1,60	cyclictest	1164718	-21	ssh	21:33:06	1
1148647	99	65	1,60	cyclictest	1160836	-21	ssh	21:24:02	1
1148643	99	65	32,29	cyclictest	169	50	irq/224-8000000	23:10:01	0
1148643	99	65	29,32	cyclictest	1180826	-21	ssh	22:10:31	0
1148647	99	64	2,58	cyclictest	1202374	-21	ssh	23:00:45	1
1148647	99	64	1,59	cyclictest	1243837	-21	ssh	00:37:49	1
1148647	99	64	1,59	cyclictest	1241912	-21	ssh	00:33:20	1
1148647	99	64	1,59	cyclictest	1238681	-21	ssh	00:25:29	1
1148647	99	64	1,59	cyclictest	1238681	-21	ssh	00:25:29	1
1148647	99	64	1,59	cyclictest	1208960	-21	ssh	23:16:14	1
1148647	99	64	1,59	cyclictest	1196532	-21	ssh	22:47:16	1
1148647	99	64	1,59	cyclictest	1194024	-21	ssh	22:41:10	1
1148647	99	64	1,59	cyclictest	1186354	-21	ssh	22:23:41	1
1148647	99	64	1,59	cyclictest	1158533	-21	ssh	21:18:50	1
1148647	99	64	1,56	cyclictest	0	-21	swapper/1	21:00:02	1
1148643	99	64	23,35	cyclictest	3467602	-21	systemd-journal	22:05:01	0
1148643	99	64	19,41	cyclictest	1211019	-21	ssh	23:21:06	0
1148647	99	63	1,58	cyclictest	1219442	-21	ssh	23:40:41	1
1148647	99	63	1,58	cyclictest	1217225	-21	ssh	23:35:32	1
1148643	99	63	1,58	cyclictest	0	-21	swapper/0	00:23:38	0
1148657	99	62	35,19	cyclictest	275	-21	dbus-daemon	23:59:59	3
1148657	99	62	35,19	cyclictest	275	-21	dbus-daemon	23:59:59	3
1148643	99	62	25,33	cyclictest	1202054	-21	date	23:00:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2021-09-01 - 00:33