OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Wed Sep 16, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1660173	99	134	113,9	cyclictest	1769475	-21	kworker/u4:12+events_unbound	22:41:42	0
1660173	99	103	95,6	cyclictest	1729642	-21	kworker/u4:2+events_unbound	22:16:36	0
1660173	99	103	89,7	cyclictest	0	-21	swapper/0	19:09:59	0
1660173	99	99	91,6	cyclictest	1795812	-21	kworker/u4:11+events_unbound	23:16:45	0
1660173	99	94	84,8	cyclictest	1826648	-21	kworker/u4:4+events_unbound	00:16:58	0
1660173	99	89	80,7	cyclictest	1795812	-21	kworker/u4:11+events_unbound	23:41:52	0
1660173	99	86	78,6	cyclictest	1861947	-21	kworker/u4:14+events_unbound	00:31:59	0
1660173	99	86	78,6	cyclictest	1729642	-21	kworker/u4:2+events_unbound	22:51:42	0
1660174	99	85	74,8	cyclictest	1795812	-21	kworker/u4:11+events_unbound	23:36:48	1
1660173	99	85	78,5	cyclictest	1795147	-21	kworker/u4:8+events_unbound	23:11:45	0
1660174	99	83	75,6	cyclictest	1679392	-21	kworker/u4:21+events_unbound	21:31:31	1
1660173	99	78	70,6	cyclictest	1795814	-21	kworker/u4:13+events_unbound	23:31:49	0
1660173	99	78	70,6	cyclictest	1795148	-21	kworker/u4:9+events_unbound	23:21:47	0
1660173	99	77	70,5	cyclictest	1724494	-21	kworker/u4:10+events_unbound	22:36:41	0
1660174	99	76	70,4	cyclictest	1786790	-21	kworker/u4:4+events_unbound	23:01:42	1
1660173	99	76	68,6	cyclictest	1795814	-21	kworker/u4:13+events_unbound	23:26:48	0
1660174	99	75	68,5	cyclictest	1724494	-21	kworker/u4:10+events_unbound	22:01:33	1
1660174	99	75	68,5	cyclictest	1724494	-21	kworker/u4:10+events_unbound	22:01:33	1
1660174	99	75	66,6	cyclictest	1711619	-21	kworker/u4:6+events_unbound	21:41:33	1
1660173	99	75	67,6	cyclictest	1826648	-21	kworker/u4:4+events_unbound	00:01:54	0
1660173	99	75	58,6	cyclictest	1830473	-21	kworker/u4:7+events_unbound	23:51:54	0
1660173	99	75	58,6	cyclictest	1830473	-21	kworker/u4:7+events_unbound	23:51:54	0
1660174	99	72	64,6	cyclictest	1791315	-21	kworker/u4:7+events_unbound	23:06:43	1
1660173	99	69	61,6	cyclictest	1751504	-21	kworker/u4:4+events_unbound	22:21:38	0
1660173	99	68	52,6	cyclictest	1691049	-21	kworker/u4:5+events_unbound	21:35:01	0
1660173	99	67	59,6	cyclictest	1332443	-21	kworker/u4:2+events_unbound	19:51:20	0
1660173	99	65	57,6	cyclictest	1629354	-21	kworker/u4:1+events_unbound	20:31:23	0
1660173	99	64	56,6	cyclictest	1679392	-21	kworker/u4:21+events_unbound	20:41:25	0
1660173	99	64	56,6	cyclictest	1629354	-21	kworker/u4:1+events_unbound	19:26:18	0
1660173	99	64	54,7	cyclictest	1647667	-21	kworker/u4:9+events_unbound	19:56:22	0
1660174	99	63	56,5	cyclictest	1683200	-21	kworker/u4:8+events_unbound	21:11:28	1
1660174	99	63	55,6	cyclictest	1662772	-21	kworker/u4:10+events_unbound	20:46:26	1
1660173	99	63	55,6	cyclictest	1835646	-21	kworker/u4:6+events_unbound	00:11:56	0
1660174	99	62	54,6	cyclictest	1826648	-21	kworker/u4:4+events_unbound	00:10:01	1
1660174	99	62	53,7	cyclictest	1691052	-21	kworker/u4:11+events_unbound	21:26:29	1
1660173	99	62	54,6	cyclictest	1759855	-21	kworker/u4:3+events_unbound	22:46:41	0
1660173	99	62	54,6	cyclictest	1759855	-21	kworker/u4:3+events_unbound	22:46:41	0
1660173	99	62	49,8	cyclictest	1723348	-21	ssh	21:45:26	0
1660174	99	61	54,5	cyclictest	1835643	-21	kworker/u4:0+events_unbound	23:56:53	1
1660174	99	61	54,5	cyclictest	1835643	-21	kworker/u4:0+events_unbound	23:56:52	1
1660173	99	61	54,5	cyclictest	1629356	-21	kworker/u4:7+events_unbound	19:16:15	0
1660174	99	60	53,5	cyclictest	1689782	-21	kworker/u4:0+events_unbound	21:25:00	1
1660174	99	60	53,5	cyclictest	1689782	-21	kworker/u4:0+events_unbound	21:25:00	1
1660174	99	59	49,7	cyclictest	1667865	-21	systemd	19:36:18	1
1660174	99	59	49,7	cyclictest	0	-21	swapper/1	23:40:12	1
1660173	99	59	51,6	cyclictest	1795812	-21	kworker/u4:11+events_unbound	23:36:51	0
1660173	99	59	48,9	cyclictest	53	-21	kswapd0	21:40:09	0
1660173	99	58	51,5	cyclictest	1795814	-21	kworker/u4:13+events_unbound	23:10:02	0
1660173	99	57	49,6	cyclictest	1664065	-21	kworker/u4:13+events_unbound	20:06:22	0
1660173	99	57	49,6	cyclictest	1657672	-21	kworker/u4:0+events_unbound	19:41:19	0
1660173	99	57	48,7	cyclictest	1689783	-21	kworker/u4:3+events_unbound	21:20:04	0
1660173	99	57	48,7	cyclictest	1689783	-21	kworker/u4:3+events_unbound	21:20:04	0
1660173	99	57	38,7	cyclictest	1687121	-21	kworker/u4:0+events_unbound	20:53:45	0
1660173	99	56	45,6	cyclictest	1692592	-21	timerwakeupswit	21:10:39	0
1660174	99	55	47,5	cyclictest	1839474	-21	kworker/u4:9+events_unbound	00:25:15	1
1660173	99	55	48,5	cyclictest	1729644	-21	kworker/u4:7+events_unbound	21:55:01	0
1660173	99	55	48,5	cyclictest	1663883	-21	timerwakeupswit	19:20:37	0
1660173	99	55	47,6	cyclictest	1830473	-21	kworker/u4:7+events_unbound	23:55:02	0
1660173	99	55	47,6	cyclictest	1830473	-21	kworker/u4:7+events_unbound	23:55:01	0
1660173	99	55	28,4	cyclictest	1679392	-21	kworker/u4:21+events_unbound	20:50:01	0
1660173	99	54	46,6	cyclictest	1332443	-21	kworker/u4:2+events_unbound	20:36:24	0
1660173	99	54	35,17	cyclictest	1678124	-21	sh	20:20:01	0
1660174	99	53	36,8	cyclictest	1795812	-21	kworker/u4:11+events_unbound	23:20:02	1
1660173	99	53	45,5	cyclictest	1674273	-21	kworker/u4:19+events_unbound	20:25:01	0
1660173	99	53	43,7	cyclictest	1829665	-21	ntpq	23:45:37	0
1660173	99	53	42,8	cyclictest	1733362	-21	sd-accept	21:56:32	0
1660173	99	53	41,10	cyclictest	1729642	-21	kworker/u4:2-rpciod	22:00:29	0
1660173	99	53	41,10	cyclictest	1729642	-21	kworker/u4:2-rpciod	22:00:29	0
1660174	99	52	44,6	cyclictest	1683199	-21	kworker/u4:7+events_unbound	20:56:26	1
1660174	99	52	43,6	cyclictest	1629354	-21	kworker/u4:1+events_unbound	20:21:24	1
1660174	99	52	42,6	cyclictest	0	-21	swapper/1	22:40:18	1
1660174	99	52	39,10	cyclictest	0	-21	swapper/1	22:45:13	1
1660174	99	52	39,10	cyclictest	0	-21	swapper/1	22:45:13	1
1660173	99	52	43,6	cyclictest	1864928	-21	ntpq	00:25:29	0
1660173	99	52	41,7	cyclictest	1762966	-21	sed	22:30:21	0
1660174	99	51	41,7	cyclictest	1749257	-21	aten_r7power_cu	22:15:16	1
1660173	99	51	44,5	cyclictest	1689782	-21	kworker/u4:0+events_unbound	21:17:02	0
1660173	99	51	41,6	cyclictest	1758445	-21	cut	22:25:19	0
1660173	99	51	40,8	cyclictest	1784992	-21	fschecks_time	22:55:24	0
1660173	99	51	38,10	cyclictest	1748964	-21	latency_hist	22:15:01	0
1660174	99	50	41,7	cyclictest	1731721	-21	df_abs	21:55:17	1
1660173	99	50	43,5	cyclictest	1831144	-21	kworker/u4:12+events_unbound	00:36:08	0
1660173	99	50	41,7	cyclictest	1717882	-21	cron	21:40:01	0
1660173	99	50	41,6	cyclictest	1676915	-21	latency_hist	20:15:02	0
1660173	99	50	40,5	cyclictest	0	-21	swapper/0	23:00:34	0
1660173	99	50	39,7	cyclictest	1704980	-21	basename	21:25:17	0
1660174	99	49	42,5	cyclictest	1861947	-21	kworker/u4:14+events_unbound	00:35:17	1
1660174	99	49	42,5	cyclictest	1780312	-21	wget	22:50:15	1
1660174	99	49	42,5	cyclictest	1669677	-21	fschecks_time	19:45:20	1
1660174	99	49	42,5	cyclictest	1661058	-21	sshd	19:10:35	1
1660174	99	49	41,6	cyclictest	1758651	-21	/usr/sbin/munin	22:25:22	1
1660174	99	49	41,6	cyclictest	1647668	-21	kworker/u4:11+events_unbound	19:10:01	1
1660173	99	49	41,6	cyclictest	1835644	-21	kworker/u4:2+events_unbound	00:05:01	0
1660173	99	49	41,6	cyclictest	1687123	-21	kworker/u4:2+xprtiod	21:00:11	0
1660174	99	48	41,5	cyclictest	1869036	-21	tail	00:30:24	1
1660174	99	48	41,4	cyclictest	1660172	-21	cyclictest	21:50:17	1
1660174	99	48	40,6	cyclictest	1809330	-21	kworker/u4:3+events_unbound	23:46:53	1
1660174	99	48	40,6	cyclictest	1722770	-21	/usr/sbin/munin	21:45:15	1
1660174	99	48	39,6	cyclictest	1851727	-21	ntpq	00:10:31	1
1660174	99	48	38,6	cyclictest	1803234	-21	/usr/sbin/munin	23:15:38	1
1660174	99	48	32,13	cyclictest	0	-21	swapper/1	23:25:36	1
1660173	99	48	42,4	cyclictest	1719996	-21	kworker/u4:3+events_unbound	22:05:04	0
1660173	99	48	38,8	cyclictest	1690110	-21	aten_r7power_vo	21:05:16	0
1660173	99	48	36,10	cyclictest	1831144	-21	kworker/u4:12-rpciod	00:20:16	0
1660174	99	47	6,38	cyclictest	1740357	-21	ssh	22:05:14	1
1660174	99	47	39,6	cyclictest	1679392	-21	kworker/u4:21+events_unbound	21:36:32	1
1660174	99	47	39,6	cyclictest	1674273	-21	kworker/u4:19+events_unbound	20:51:27	1
1660174	99	47	38,5	cyclictest	0	-21	swapper/1	23:10:22	1
1660174	99	47	37,7	cyclictest	0	-21	swapper/1	22:30:30	1
1660174	99	47	23,13	cyclictest	1808669	-21	kworker/u4:2+events_unbound	23:34:57	1
1660173	99	47	4,31	cyclictest	1670455	-21	modprobe	19:50:00	0
1660173	99	47	38,5	cyclictest	256	50	irq/23-42890000.ethernet	19:10:05	0
1660174	99	46	39,5	cyclictest	1724494	-21	kworker/u4:10+events_unbound	22:11:36	1
1660174	99	46	39,5	cyclictest	1681929	-21	kworker/u4:4+events_unbound	20:45:01	1
1660174	99	46	39,5	cyclictest	0	-21	swapper/1	00:20:15	1
1660174	99	46	38,6	cyclictest	1788758	-21	latency_hist	23:00:02	1
1660174	99	46	37,6	cyclictest	0	-21	swapper/1	00:15:35	1
1660174	99	45	38,5	cyclictest	1675975	-21	fschecks_count	20:10:21	1
1660174	99	45	37,6	cyclictest	1661817	-21	aten_r7power_vo	19:15:18	1
1660174	99	45	36,7	cyclictest	1696356	-21	gltestperf	21:15:21	1
1660173	99	45	35,7	cyclictest	1688434	-21	apt	20:59:59	0
1660173	99	45	35,7	cyclictest	1679927	-21	fschecks_time	20:25:21	0
1660174	99	44	6,31	cyclictest	1843063	-21	ssh	00:00:39	1
1660174	99	44	37,5	cyclictest	1767970	-21	sendmail_mailqu	22:35:48	1
1660174	99	44	36,6	cyclictest	1754120	-21	gltestperf	22:20:19	1
1660174	99	44	35,6	cyclictest	0	-21	swapper/1	19:30:01	1
1660174	99	44	34,8	cyclictest	1689770	-21	systemd	21:01:26	1
1660173	99	44	34,8	cyclictest	1667092	-21	fschecks_time	19:35:19	0
1660173	99	44	32,7	cyclictest	0	-21	swapper/0	20:05:00	0
1660174	99	43	36,5	cyclictest	1665338	-21	kworker/u4:18-rpciod	19:30:17	1
1660174	99	43	36,5	cyclictest	1629356	-21	kworker/u4:7+rpciod	19:20:20	1
1660174	99	43	35,5	cyclictest	1833800	-21	kernelversion	23:50:22	1
1660174	99	43	35,5	cyclictest	1833800	-21	kernelversion	23:50:21	1
1660174	99	43	33,7	cyclictest	1670438	-21	kworker/u4:6+rpciod	19:50:20	1
1660174	99	42	34,5	cyclictest	1664065	-21	kworker/u4:13-xprtiod	20:40:01	1
1660174	99	42	11,24	cyclictest	0	-21	swapper/1	20:25:32	1
1660173	99	42	35,5	cyclictest	1665816	-21	fschecks_count	19:30:19	0
1660174	99	41	33,6	cyclictest	1674658	-21	sed	20:05:18	1
1660174	99	41	33,5	cyclictest	0	-21	swapper/1	20:15:25	1
1660174	99	40	30,8	cyclictest	1680880	-21	aten2__	20:30:16	1
1660174	99	40	28,9	cyclictest	0	-21	swapper/1	19:55:22	1
1660174	99	40	23,5	cyclictest	17	1	rcu_preempt	21:05:16	1
1660174	99	39	31,6	cyclictest	1668990	-21	timerwakeupswit	19:40:39	1
1660174	99	38	22,6	cyclictest	17	1	rcu_preempt	20:04:59	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17