OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Tue Aug 18, 2026 12:44:07)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1305678	99	102	42,37	cyclictest	256	50	irq/23-42890000.ethernet	07:10:01	0
1305679	99	100	84,13	cyclictest	1339224	-21	kworker/u4:2+events_unbound	10:15:13	1
1305678	99	92	82,7	cyclictest	1392983	-21	kworker/u4:7+events_unbound	10:14:20	0
1305679	99	91	82,7	cyclictest	1456094	-21	kworker/u4:1+events_unbound	11:39:37	1
1305679	99	90	82,5	cyclictest	1343850	-21	kworker/u4:4+events_unbound	10:09:18	1
1305679	99	82	66,5	cyclictest	1392982	-21	kworker/u4:5+events_unbound	10:14:21	1
1305678	99	81	39,11	cyclictest	1355534	-21	if_eth0	09:30:34	0
1305678	99	79	71,6	cyclictest	1478054	-21	kworker/u4:4+events_unbound	12:09:39	0
1305678	99	79	44,5	cyclictest	1506553	-21	ssh	12:19:39	0
1305679	99	78	70,6	cyclictest	1375327	-21	kworker/u4:7+events_unbound	09:54:19	1
1305678	99	78	43,5	cyclictest	1400965	-21	sendmail_mailqu	10:20:38	0
1305678	99	78	39,34	cyclictest	0	-21	swapper/0	12:31:41	0
1305678	99	78	36,9	cyclictest	1512730	-21	timerandwakeup	12:25:41	0
1305679	99	77	69,6	cyclictest	1319701	-21	kworker/u4:5+events_unbound	08:24:04	1
1305679	99	76	68,6	cyclictest	1320973	-21	kworker/u4:13+events_unbound	08:19:03	1
1305679	99	75	61,5	cyclictest	1411229	-21	kworker/u4:7+events_unbound	10:34:24	1
1305679	99	74	67,5	cyclictest	1294071	-21	kworker/u4:13+events_unbound	07:13:54	1
1305678	99	72	37,6	cyclictest	1329177	-21	/usr/sbin/munin	08:40:19	0
1305679	99	70	64,4	cyclictest	1442588	-21	kworker/u4:5+events_unbound	11:09:28	1
1305678	99	69	60,7	cyclictest	1465141	-21	kworker/u4:6+events_unbound	11:44:36	0
1305678	99	69	60,7	cyclictest	1415793	-21	kworker/u4:9+events_unbound	10:39:24	0
1305679	99	67	54,9	cyclictest	1445576	-21	sh	11:10:24	1
1305678	99	65	56,7	cyclictest	1294071	-21	kworker/u4:13+events_unbound	07:28:56	0
1305678	99	65	55,7	cyclictest	1429556	-21	kworker/u4:11+events_unbound	11:19:33	0
1305678	99	64	46,5	cyclictest	1352389	-21	kworker/u4:14+events_unbound	09:29:16	0
1305678	99	64	45,15	cyclictest	53	-21	kswapd0	11:45:11	0
1305678	99	63	52,8	cyclictest	53	-21	kswapd0	10:30:01	0
1305679	99	62	47,10	cyclictest	0	-21	swapper/1	11:50:38	1
1305678	99	62	53,6	cyclictest	1424945	-21	kworker/u4:4+events_unbound	10:49:26	0
1305678	99	61	54,5	cyclictest	1339229	-21	kworker/u4:10+events_unbound	09:19:14	0
1305678	99	61	50,8	cyclictest	53	-21	kswapd0	10:45:01	0
1305678	99	61	49,5	cyclictest	1442584	-21	kworker/u4:0+events_unbound	11:14:29	0
1305679	99	60	52,6	cyclictest	1465142	-21	kworker/u4:7+events_unbound	11:50:02	1
1305679	99	60	51,6	cyclictest	1339230	-21	kworker/u4:11+events_unbound	09:30:00	1
1305678	99	60	51,7	cyclictest	1343850	-21	kworker/u4:4+events_unbound	09:59:19	0
1305679	99	59	44,10	cyclictest	0	-21	swapper/1	07:40:24	1
1305678	99	59	44,10	cyclictest	0	-21	swapper/0	11:05:42	0
1305679	99	58	50,5	cyclictest	1496092	-21	kworker/u4:3+events_unbound	12:20:17	1
1305679	99	58	48,7	cyclictest	1350143	-21	latency_hist	09:25:01	1
1305678	99	58	50,5	cyclictest	1368965	-21	kernelversion	09:45:22	0
1305679	99	57	50,5	cyclictest	1313288	-21	kworker/u4:0+events_unbound	07:59:01	1
1305679	99	57	49,5	cyclictest	1465142	-21	kworker/u4:7+events_unbound	11:35:00	1
1305679	99	57	48,7	cyclictest	1442587	-21	kworker/u4:4+events_unbound	11:24:34	1
1305679	99	57	47,7	cyclictest	1313290	-21	kworker/u4:3+events_unbound	07:55:00	1
1305679	99	57	46,7	cyclictest	0	-21	swapper/1	09:45:27	1
1305678	99	57	51,4	cyclictest	1518016	-21	kworker/u4:3+events_unbound	12:39:43	0
1305678	99	57	47,7	cyclictest	1429552	-21	kworker/u4:5+events_unbound	10:59:28	0
1305678	99	57	47,7	cyclictest	1429552	-21	kworker/u4:5+events_unbound	10:59:28	0
1305678	99	57	47,6	cyclictest	0	-21	swapper/0	12:00:29	0
1305679	99	56	45,8	cyclictest	1308727	-21	fschecks_time	07:20:18	1
1305679	99	56	29,16	cyclictest	1462378	-21	modprobe	11:30:01	1
1305678	99	56	48,6	cyclictest	1496093	-21	kworker/u4:8+events_unbound	12:24:42	0
1305679	99	55	48,5	cyclictest	1413511	-21	aten2__	10:35:17	1
1305679	99	55	48,5	cyclictest	1319699	-21	kworker/u4:3+events_unbound	08:15:01	1
1305679	99	55	47,6	cyclictest	1520474	-21	/usr/sbin/munin	12:35:15	1
1305679	99	55	46,6	cyclictest	1422470	-21	apt-get	10:45:15	1
1305678	99	55	48,5	cyclictest	1356954	-21	kworker/u4:6+events_unbound	10:05:01	0
1305678	99	55	46,7	cyclictest	317	-21	systemd-journal	10:54:25	0
1305678	99	55	46,6	cyclictest	1323611	-21	kworker/u4:7+events_unbound	08:29:05	0
1305679	99	54	46,5	cyclictest	1377527	-21	diskmemload	09:55:17	1
1305679	99	54	44,6	cyclictest	1442584	-21	kworker/u4:0+events_unbound	11:15:04	1
1305679	99	53	45,6	cyclictest	1343848	-21	kworker/u4:0+events_unbound	09:39:16	1
1305679	99	53	42,8	cyclictest	601	-21	sendmail-mta	09:30:13	1
1305679	99	52	40,6	cyclictest	0	-21	swapper/1	09:00:36	1
1305679	99	51	37,9	cyclictest	0	-21	swapper/1	09:10:12	1
1305678	99	51	29,19	cyclictest	0	-21	swapper/0	07:15:19	0
1305679	99	50	43,5	cyclictest	1361525	-21	kworker/u4:17+events_unbound	09:40:15	1
1305679	99	50	38,8	cyclictest	1327074	-21	ps	08:30:36	1
1305679	99	50	36,11	cyclictest	1341391	-21	basename	09:15:19	1
1305679	99	50	33,13	cyclictest	0	-21	swapper/1	12:25:31	1
1305678	99	50	32,15	cyclictest	1305676	-21	cyclictest	11:00:35	0
1305678	99	50	2,36	cyclictest	1364592	-21	sh	09:40:27	0
1305679	99	49	42,5	cyclictest	1304402	-21	kworker/u4:4+events_unbound	07:33:56	1
1305679	99	49	41,5	cyclictest	1323611	-21	kworker/u4:7+events_unbound	08:30:00	1
1305679	99	49	36,9	cyclictest	0	-21	swapper/1	10:20:26	1
1305678	99	49	41,5	cyclictest	1324152	-21	fschecks_time	08:20:24	0
1305678	99	49	40,5	cyclictest	1480981	-21	rm	11:50:22	0
1305679	99	48	41,5	cyclictest	1320973	-21	kworker/u4:13+events_unbound	09:05:45	1
1305679	99	48	40,6	cyclictest	1324908	-21	kworker/u4:11+events_unbound	08:59:09	1
1305679	99	48	40,5	cyclictest	1436475	-21	gltestperf	11:00:21	1
1305678	99	48	39,6	cyclictest	0	-21	swapper/0	11:30:28	0
1305678	99	48	39,5	cyclictest	0	-21	swapper/0	10:30:15	0
1305678	99	48	38,6	cyclictest	0	-21	swapper/0	11:25:37	0
1305679	99	47	41,4	cyclictest	1305676	-21	cyclictest	10:54:25	1
1305679	99	47	37,8	cyclictest	1331388	-21	latency_hist	08:50:01	1
1305679	99	47	37,7	cyclictest	1498743	-21	/usr/sbin/munin	12:10:22	1
1305679	99	47	35,8	cyclictest	1386119	-21	modprobe	10:05:00	1
1305678	99	47	39,6	cyclictest	1387765	-21	unixbench_singl	10:05:41	0
1305678	99	47	39,6	cyclictest	1373320	-21	gltestperf	09:50:18	0
1305678	99	47	38,6	cyclictest	1306089	-21	fschecks_count	07:10:18	0
1305678	99	47	29,16	cyclictest	0	-21	swapper/0	09:20:27	0
1305679	99	46	39,5	cyclictest	1503755	-21	switchtime	12:15:41	1
1305679	99	46	38,5	cyclictest	1516345	-21	fschecks_time	12:30:20	1
1305678	99	46	38,6	cyclictest	1322244	-21	kworker/u4:6+events_unbound	09:09:11	0
1305678	99	46	38,5	cyclictest	1330476	-21	fschecks_count	08:45:19	0
1305678	99	46	37,7	cyclictest	1323695	-21	latency_hist	08:20:01	0
1305678	99	46	34,10	cyclictest	1498554	-21	ssh	12:10:20	0
1305679	99	45	38,5	cyclictest	1490503	-21	threads	12:00:43	1
1305679	99	45	38,5	cyclictest	1471716	-21	aten_r7power_po	11:40:16	1
1305679	99	45	37,6	cyclictest	1321081	-21	latency_hist	08:10:01	1
1305679	99	45	34,7	cyclictest	1424947	-21	kworker/u4:9-rpciod	10:55:28	1
1305679	99	45	34,7	cyclictest	1424947	-21	kworker/u4:9-rpciod	10:55:28	1
1305679	99	45	31,5	cyclictest	1320973	-21	kworker/u4:13+events_unbound	08:39:07	1
1305679	99	45	17,22	cyclictest	0	-21	swapper/1	11:55:26	1
1305678	99	45	38,5	cyclictest	1399182	-21	sshd	10:19:19	0
1305678	99	45	38,5	cyclictest	1334899	-21	timerandwakeup	09:00:36	0
1305678	99	45	26,16	cyclictest	1465141	-21	kworker/u4:6-rpciod	11:35:39	0
1305678	99	45	18,6	cyclictest	1363705	-21	ls	09:40:01	0
1305679	99	44	35,6	cyclictest	1402076	-21	kworker/u4:12-rpciod	10:25:18	1
1305679	99	44	35,6	cyclictest	1323611	-21	kworker/u4:7-rpciod	08:55:01	1
1305679	99	44	31,7	cyclictest	0	-21	swapper/1	08:00:36	1
1305679	99	44	26,13	cyclictest	1494135	-21	fschecks_count	12:05:21	1
1305678	99	44	35,7	cyclictest	1336842	-21	aten_r7power_en	09:10:17	0
1305678	99	44	34,8	cyclictest	1320978	-21	systemd	08:09:01	0
1305679	99	43	7,24	cyclictest	1420714	-21	ssh	10:42:48	1
1305678	99	43	35,5	cyclictest	1331795	-21	fschecks_time	08:50:21	0
1305678	99	43	33,8	cyclictest	1454433	-21	netstat	11:20:26	0
1305678	99	43	33,8	cyclictest	1316061	-21	aten2__	07:50:15	0
1305678	99	43	32,8	cyclictest	1485085	-21	aten_r7power_vo	11:55:16	0
1305679	99	42	35,5	cyclictest	1310521	-21	awk	07:25:38	1
1305679	99	42	29,9	cyclictest	0	-21	swapper/1	08:40:20	1
1305678	99	42	34,6	cyclictest	1318727	-21	aten_r7power_po	08:00:16	0
1305678	99	42	34,5	cyclictest	1322375	-21	latency_hist	08:15:02	0
1305679	99	41	32,7	cyclictest	1315939	-21	latency_hist	07:50:01	1
1305679	99	41	32,7	cyclictest	1313061	-21	threads	07:35:37	1
1305679	99	41	27,12	cyclictest	0	-21	swapper/1	07:15:20	1
1305678	99	41	32,7	cyclictest	1308539	-21	aten_r7power_vo	07:20:15	0
1305678	99	41	26,13	cyclictest	1319701	-21	kworker/u4:5-rpciod	08:40:00	0
1305678	99	40	34,4	cyclictest	1313289	-21	kworker/u4:2+events_unbound	07:45:01	0
1305678	99	40	32,6	cyclictest	1326411	-21	aten_r7power_cu	08:30:15	0
1305678	99	40	32,5	cyclictest	1333114	-21	kthreadd	08:55:22	0
1305678	99	40	30,6	cyclictest	0	-21	swapper/0	07:55:21	0
1305678	99	39	30,6	cyclictest	0	-21	swapper/0	07:50:01	0
1305678	99	38	31,5	cyclictest	1311346	-21	gltestperf	07:30:21	0
1305678	99	37	29,5	cyclictest	1310747	-21	kworker/u4:11+events_unbound	07:38:57	0
1305679	99	36	30,4	cyclictest	1294071	-21	kworker/u4:13-rpciod	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17