OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Mon Aug 31, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1457932	99	105	97,6	cyclictest	1603078	-21	kworker/u4:7+events_unbound	23:27:09	0
1457932	99	103	83,10	cyclictest	1511691	-21	rm	21:35:08	0
1457932	99	102	94,5	cyclictest	1647747	-21	kworker/u4:15+events_unbound	00:23:41	0
1457933	99	96	74,16	cyclictest	1511412	-21	apt-get	21:35:09	1
1457932	99	93	86,5	cyclictest	1634159	-21	kworker/u4:5+events_unbound	00:03:08	0
1457932	99	90	74,13	cyclictest	53	-21	kswapd0	21:30:16	0
1457932	99	88	60,21	cyclictest	53	-21	kswapd0	00:10:07	0
1457932	99	86	79,5	cyclictest	1572144	-21	kworker/u4:5+events_unbound	22:47:00	0
1457932	99	86	64,8	cyclictest	1558523	-21	kworker/u4:4+events_unbound	22:36:55	0
1457932	99	84	4,39	cyclictest	1561597	-21	ssh	22:30:36	0
1457932	99	77	52,15	cyclictest	1538512	-21	ssh	22:05:11	0
1457932	99	76	67,6	cyclictest	1518403	-21	kworker/u4:2+events_unbound	21:46:47	0
1457932	99	75	56,16	cyclictest	1481052	-21	kworker/u4:2+events_unbound	21:00:00	0
1457932	99	75	52,17	cyclictest	0	-21	swapper/0	20:25:07	0
1457932	99	75	52,17	cyclictest	0	-21	swapper/0	20:25:07	0
1457932	99	73	66,5	cyclictest	1598535	-21	kworker/u4:5+events_unbound	23:12:05	0
1457932	99	73	66,5	cyclictest	1598535	-21	kworker/u4:5+events_unbound	23:12:05	0
1457932	99	72	51,17	cyclictest	1532007	-21	kworker/u4:14+events_unbound	22:00:02	0
1457932	99	66	60,4	cyclictest	1567581	-21	kworker/u4:1+events_unbound	22:41:58	0
1457932	99	66	48,5	cyclictest	1598535	-21	kworker/u4:5+events_unbound	23:22:06	0
1457932	99	66	48,5	cyclictest	1598535	-21	kworker/u4:5+events_unbound	23:22:06	0
1457932	99	65	54,8	cyclictest	1589536	-21	kworker/u4:10+events_unbound	23:02:03	0
1457933	99	64	55,5	cyclictest	1469389	-21	kworker/u4:3+events_unbound	20:40:02	1
1457932	99	64	38,18	cyclictest	1469392	-21	kworker/u4:10+xprtiod	20:40:12	0
1457933	99	63	51,9	cyclictest	53	-21	kswapd0	00:10:00	1
1457932	99	63	55,6	cyclictest	1465552	-21	kworker/u4:16+events_unbound	21:21:42	0
1457932	99	61	57,3	cyclictest	1567580	-21	kworker/u4:0+events_unbound	23:07:04	0
1457932	99	61	53,5	cyclictest	1487538	-21	kworker/u4:4+events_unbound	21:11:38	0
1457932	99	60	53,5	cyclictest	1461740	-21	kworker/u4:2+events_unbound	19:26:20	0
1457932	99	60	52,6	cyclictest	1598534	-21	kworker/u4:3+events_unbound	23:17:07	0
1457932	99	60	52,6	cyclictest	1465550	-21	kworker/u4:14+events_unbound	19:56:25	0
1457932	99	59	6,42	cyclictest	1457930	-21	cyclictest	19:10:00	0
1457932	99	58	51,5	cyclictest	1532008	-21	kworker/u4:15+events_unbound	22:16:52	0
1457933	99	57	47,7	cyclictest	1541054	-21	kworker/u4:3+events_unbound	22:21:54	1
1457933	99	57	42,9	cyclictest	0	-21	swapper/1	22:40:32	1
1457932	99	57	49,6	cyclictest	1442756	-21	kworker/u4:3+events_unbound	19:11:16	0
1457933	99	56	45,8	cyclictest	1651227	-21	users	00:10:44	1
1457933	99	56	43,9	cyclictest	0	-21	swapper/1	21:30:42	1
1457933	99	56	14,14	cyclictest	1520658	-21	apt-get	21:45:13	1
1457932	99	56	48,6	cyclictest	1481040	-21	kworker/u4:1+events_unbound	21:06:36	0
1457932	99	55	47,6	cyclictest	1527453	-21	kworker/u4:9+events_unbound	22:00:26	0
1457932	99	55	22,25	cyclictest	256	50	irq/23-42890000.ethernet	20:30:10	0
1457932	99	53	43,6	cyclictest	15	1	ktimers/0	00:31:44	0
1457932	99	53	33,6	cyclictest	0	-21	swapper/0	22:50:29	0
1457933	99	52	44,5	cyclictest	1619021	-21	fschecks_time	23:35:22	1
1457933	99	51	39,9	cyclictest	1602050	-21	unixbench_multi	23:15:40	1
1457932	99	51	45,4	cyclictest	1073	-21	snmpd	23:42:11	0
1457932	99	51	33,16	cyclictest	1672362	-21	df_abs	00:35:16	0
1457933	99	50	43,5	cyclictest	1488800	-21	systemd	21:06:36	1
1457933	99	50	42,4	cyclictest	0	-21	swapper/1	22:45:34	1
1457932	99	50	36,9	cyclictest	1496462	-21	ssh	21:17:51	0
1457932	99	50	36,9	cyclictest	1496462	-21	ssh	21:17:51	0
1457933	99	49	43,5	cyclictest	1463009	-21	kworker/u4:13+events_unbound	19:37:24	1
1457933	99	49	42,5	cyclictest	1457930	-21	cyclictest	20:55:28	1
1457933	99	49	41,6	cyclictest	53	-21	kswapd0	22:30:01	1
1457933	99	49	36,10	cyclictest	1460158	-21	switchtime	19:15:37	1
1457933	99	49	34,11	cyclictest	37	-21	kcompactd0	22:02:12	1
1457933	99	49	19,18	cyclictest	0	-21	swapper/1	23:50:38	1
1457933	99	48	41,5	cyclictest	1543920	-21	sendmail_mailqu	22:10:40	1
1457933	99	48	40,6	cyclictest	53	-21	kswapd0	23:00:19	1
1457933	99	48	40,6	cyclictest	1474489	-21	systemd	20:11:27	1
1457932	99	48	41,5	cyclictest	1576638	-21	kworker/u4:8+events_unbound	23:00:02	0
1457932	99	48	40,6	cyclictest	15	1	ktimers/0	21:50:19	0
1457932	99	48	40,6	cyclictest	1465552	-21	kworker/u4:16+events_unbound	19:41:23	0
1457932	99	48	34,10	cyclictest	37	-21	kcompactd0	23:36:26	0
1457932	99	48	30,5	cyclictest	1435585	-21	kworker/u4:10+events_unbound	19:16:17	0
1457932	99	48	29,17	cyclictest	0	-21	swapper/0	22:20:43	0
1457933	99	47	40,5	cyclictest	1597537	-21	/usr/sbin/munin	23:10:39	1
1457933	99	47	40,5	cyclictest	1597537	-21	/usr/sbin/munin	23:10:39	1
1457933	99	47	40,5	cyclictest	1547400	-21	aten_r7power_cu	22:15:15	1
1457933	99	47	40,4	cyclictest	0	-21	swapper/1	20:41:33	1
1457933	99	47	39,5	cyclictest	0	-21	swapper/1	22:05:37	1
1457933	99	47	17,7	cyclictest	0	-21	swapper/1	00:00:40	1
1457933	99	47	11,22	cyclictest	1610533	-21	ssh	23:25:34	1
1457932	99	47	27,18	cyclictest	0	-21	swapper/0	23:50:32	0
1457933	99	46	40,4	cyclictest	1461730	-21	systemd	19:21:16	1
1457933	99	46	40,4	cyclictest	1461730	-21	systemd	19:21:16	1
1457933	99	46	39,5	cyclictest	1475431	-21	sendmail_mailqu	20:15:38	1
1457933	99	46	39,5	cyclictest	1475431	-21	sendmail_mailqu	20:15:38	1
1457933	99	46	36,7	cyclictest	0	-21	swapper/1	00:30:30	1
1457933	99	46	33,8	cyclictest	0	-21	swapper/1	00:25:28	1
1457933	99	46	32,11	cyclictest	1605603	-21	fschecks_count	23:20:20	1
1457933	99	46	32,11	cyclictest	1605603	-21	fschecks_count	23:20:20	1
1457932	99	46	37,7	cyclictest	1476097	-21	aten_r7power_po	20:20:18	0
1457932	99	46	27,16	cyclictest	1457868	-21	kworker/u4:6-xprtiod	20:05:01	0
1457933	99	45	6,14	cyclictest	1625721	-21	ssh	23:42:39	1
1457933	99	45	38,5	cyclictest	1587269	-21	latency_hist	23:00:02	1
1457933	99	45	37,5	cyclictest	1490106	-21	proc_pri	21:10:37	1
1457933	99	45	34,8	cyclictest	1472085	-21	latency_hist	20:05:01	1
1457933	99	45	31,8	cyclictest	0	-21	swapper/1	21:21:12	1
1457932	99	45	39,4	cyclictest	1654739	-21	fw_packets	00:15:23	0
1457932	99	45	37,5	cyclictest	0	-21	swapper/0	21:40:30	0
1457932	99	45	36,6	cyclictest	0	-21	swapper/0	22:25:35	0
1457932	99	45	35,7	cyclictest	1474747	-21	aten_r7power_cu	20:15:16	0
1457932	99	45	35,7	cyclictest	1474747	-21	aten_r7power_cu	20:15:16	0
1457932	99	45	27,15	cyclictest	0	-21	swapper/0	23:30:33	0
1457932	99	45	26,6	cyclictest	1487568	-21	idleruntime-cro	21:05:00	0
1457933	99	44	37,5	cyclictest	1638150	-21	sshd	23:56:15	1
1457933	99	44	37,5	cyclictest	1638150	-21	sshd	23:56:15	1
1457933	99	44	36,6	cyclictest	1638670	-21	kworker/u4:6-rpciod	00:15:22	1
1457933	99	44	35,7	cyclictest	1516305	-21	aten_r7power_en	21:40:16	1
1457933	99	44	35,6	cyclictest	0	-21	swapper/1	22:31:54	1
1457933	99	44	32,9	cyclictest	0	-21	swapper/1	22:50:25	1
1457932	99	44	35,6	cyclictest	1543050	-21	aten_r7power_po	22:10:18	0
1457932	99	44	34,8	cyclictest	1463267	-21	aten_r7power_en	19:30:16	0
1457932	99	44	34,7	cyclictest	1467438	-21	gltestperf	19:45:19	0
1457932	99	44	32,7	cyclictest	0	-21	swapper/0	23:48:37	0
1457933	99	43	5,11	cyclictest	1463742	-21	ntpq	19:30:23	1
1457933	99	43	37,4	cyclictest	1566455	-21	timerwakeupswit	22:35:48	1
1457933	99	43	36,5	cyclictest	1526079	-21	proc_pri	21:50:38	1
1457933	99	43	35,6	cyclictest	1628306	-21	ntp_kernel_pll_	23:45:30	1
1457933	99	43	34,7	cyclictest	1660033	-21	sh	00:20:41	1
1457933	99	43	32,8	cyclictest	1467124	-21	aten_r7power_en	19:45:15	1
1457932	99	43	6,32	cyclictest	1503588	-21	ntpq	21:25:35	0
1457932	99	43	36,5	cyclictest	1483735	-21	munin-plugin-st	20:50:00	0
1457932	99	43	36,5	cyclictest	1464499	-21	grep	19:35:15	0
1457933	99	42	36,4	cyclictest	1495658	-21	systemd	21:16:38	1
1457933	99	42	36,4	cyclictest	1495658	-21	systemd	21:16:38	1
1457933	99	42	36,4	cyclictest	0	-21	swapper/1	00:36:24	1
1457933	99	42	35,5	cyclictest	0	-21	swapper/1	19:55:15	1
1457933	99	42	33,6	cyclictest	1469392	-21	kworker/u4:10-xprtiod	21:00:38	1
1457933	99	42	33,6	cyclictest	1469389	-21	kworker/u4:3+rpciod	20:22:17	1
1457933	99	42	12,6	cyclictest	27	1	ktimers/1	23:30:36	1
1457932	99	42	36,4	cyclictest	1457930	-21	cyclictest	20:05:15	0
1457932	99	42	32,6	cyclictest	1643215	-21	kworker/u4:9-rpciod	00:05:27	0
1457933	99	41	35,4	cyclictest	1466843	-21	systemd	19:41:22	1
1457933	99	41	32,6	cyclictest	0	-21	swapper/1	21:25:19	1
1457933	99	41	31,6	cyclictest	0	-21	swapper/1	21:55:33	1
1457933	99	41	30,8	cyclictest	1442756	-21	kworker/u4:3-rpciod	19:10:35	1
1457933	99	41	29,9	cyclictest	0	-21	swapper/1	20:05:27	1
1457933	99	41	29,9	cyclictest	0	-21	swapper/1	19:25:20	1
1457933	99	41	10,7	cyclictest	27	1	ktimers/1	23:05:21	1
1457932	99	41	34,5	cyclictest	1485000	-21	apt	20:55:00	0
1457932	99	41	33,5	cyclictest	1480373	-21	gltestperf	20:35:19	0
1457932	99	41	32,7	cyclictest	1468374	-21	aten_r7power_en	19:50:14	0
1457932	99	41	2,28	cyclictest	1488842	-21	diskmemload	23:55:30	0
1457932	99	41	2,28	cyclictest	1488842	-21	diskmemload	23:55:30	0
1457933	99	40	32,4	cyclictest	0	-21	swapper/1	20:50:22	1
1457933	99	40	31,7	cyclictest	1479772	-21	systemd	20:31:31	1
1457933	99	40	31,6	cyclictest	0	-21	swapper/1	20:45:17	1
1457932	99	40	28,10	cyclictest	1663189	-21	acpi	00:25:11	0
1457933	99	39	29,8	cyclictest	1477838	-21	kernelversion	20:25:25	1
1457933	99	39	29,8	cyclictest	1477838	-21	kernelversion	20:25:25	1
1457932	99	39	32,5	cyclictest	1457930	-21	cyclictest	19:20:38	0
1457932	99	39	32,5	cyclictest	1457930	-21	cyclictest	19:20:38	0
1457932	99	39	30,6	cyclictest	0	-21	swapper/0	20:15:01	0
1457933	99	37	28,7	cyclictest	1469266	-21	unixbench-2d	19:50:36	1
1457933	99	27	17,7	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17