OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Mar 09, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1712103	99	109	101,6	cyclictest	1848101	-21	kworker/u4:13+events_unbound	11:45:57	0
1712103	99	96	67,19	cyclictest	54	-21	kswapd0	11:25:10	0
1712104	99	86	77,7	cyclictest	1721019	-21	kworker/u4:6+events_unbound	08:10:22	1
1712104	99	81	73,5	cyclictest	1856832	-21	kworker/u4:1+events_unbound	12:05:59	1
1712104	99	73	61,9	cyclictest	1895292	-21	kworker/u4:5+events_unbound	12:36:03	1
1712104	99	70	39,29	cyclictest	410	-21	systemd-logind	10:41:02	1
1712104	99	69	60,6	cyclictest	1881793	-21	sh	11:50:56	1
1712104	99	69	60,6	cyclictest	1848101	-21	kworker/u4:13+events_unbound	11:15:01	1
1712104	99	69	40,26	cyclictest	1745450	-21	kworker/u4:7-rpciod	09:15:35	1
1712104	99	68	62,4	cyclictest	1852454	-21	kworker/u4:0+events_unbound	11:20:53	1
1712104	99	68	29,36	cyclictest	1812373	-21	if_eth0	10:30:21	1
1712104	99	67	61,4	cyclictest	1742830	-21	kworker/u4:15+events_unbound	09:20:35	1
1712104	99	67	53,10	cyclictest	1713338	-21	kworker/u4:7+events_unbound	08:50:28	1
1712104	99	67	4,55	cyclictest	1863456	-21	df_inode	11:30:18	1
1712104	99	67	2,16	cyclictest	1807566	-21	apt-get	10:25:11	1
1712104	99	66	37,27	cyclictest	1799246	-21	cpu	10:15:20	1
1712104	99	66	37,27	cyclictest	1799246	-21	cpu	10:15:20	1
1712104	99	66	36,27	cyclictest	1766014	-21	unixbench-2d	09:35:39	1
1712104	99	65	54,8	cyclictest	1721017	-21	kworker/u4:1+events_unbound	07:55:16	1
1712104	99	65	33,29	cyclictest	1905629	-21	sh	12:20:00	1
1712104	99	65	33,29	cyclictest	1905629	-21	sh	12:20:00	1
1712104	99	64	53,8	cyclictest	37	-21	kcompactd0	10:05:19	1
1712104	99	64	52,9	cyclictest	1721017	-21	kworker/u4:1+events_unbound	08:15:21	1
1712104	99	64	31,30	cyclictest	1825801	-21	timerandwakeup	10:45:40	1
1712104	99	63	48,11	cyclictest	1716178	-21	aten_r7power_en	07:25:15	1
1712104	99	63	3,14	cyclictest	1876313	-21	ssh	11:45:19	1
1712104	99	63	31,29	cyclictest	1905618	-21	kworker/u4:4-rpciod	12:30:17	1
1712104	99	63	31,29	cyclictest	1769113	-21	acpi	09:40:11	1
1712104	99	63	28,31	cyclictest	0	-21	swapper/1	12:25:00	1
1712104	99	63	23,31	cyclictest	0	-21	swapper/1	07:25:00	1
1712104	99	63	2,16	cyclictest	1760867	-21	ssh	09:30:20	1
1712103	99	63	56,5	cyclictest	1721017	-21	kworker/u4:1+events_unbound	08:30:03	0
1712104	99	62	3,11	cyclictest	1859904	-21	ps	11:25:41	1
1712104	99	62	30,28	cyclictest	37	-21	kcompactd0	09:11:44	1
1712104	99	62	1,16	cyclictest	1898064	-21	ssh	12:10:27	1
1712103	99	62	41,18	cyclictest	1765139	-21	cut	09:35:19	0
1712104	99	61	50,8	cyclictest	1712246	-21	systemd	07:10:06	1
1712104	99	61	28,30	cyclictest	0	-21	swapper/1	11:55:37	1
1712104	99	61	26,32	cyclictest	1833484	-21	df_abs	10:55:17	1
1712104	99	61	25,33	cyclictest	0	-21	swapper/1	11:15:31	1
1712104	99	61	1,4	cyclictest	1816794	-21	ssh	10:35:26	1
1712103	99	61	53,6	cyclictest	0	-21	swapper/0	10:00:12	0
1712104	99	60	50,7	cyclictest	1712101	-21	cyclictest	10:23:19	1
1712104	99	60	2,11	cyclictest	1773137	-21	apt-get	09:45:04	1
1712104	99	60	1,16	cyclictest	1782800	-21	ssh	09:55:33	1
1712104	99	59	9,46	cyclictest	1068	-21	snmpd	08:33:16	1
1712104	99	59	47,9	cyclictest	1731329	-21	kworker/u4:19+events_unbound	08:25:24	1
1712104	99	59	29,26	cyclictest	0	-21	swapper/1	10:50:32	1
1712104	99	59	2,8	cyclictest	1872542	-21	ntpq	11:40:31	1
1712104	99	59	2,50	cyclictest	1756183	-21	ssh	09:25:14	1
1712104	99	59	1,8	cyclictest	1841789	-21	ssh	11:05:10	1
1712103	99	59	51,6	cyclictest	1712101	-21	cyclictest	11:32:16	0
1712103	99	59	49,8	cyclictest	1805297	-21	kworker/u4:12+events_unbound	10:25:44	0
1712104	99	58	5,48	cyclictest	1838315	-21	ssh	11:00:31	1
1712104	99	58	5,48	cyclictest	1838315	-21	ssh	11:00:30	1
1712104	99	58	33,23	cyclictest	1888993	-21	ssh	12:00:17	1
1712104	99	58	25,28	cyclictest	0	-21	swapper/1	09:10:01	1
1712103	99	58	32,20	cyclictest	0	-21	swapper/0	09:35:01	0
1712104	99	57	6,47	cyclictest	0	-21	swapper/1	12:25:33	1
1712104	99	57	6,45	cyclictest	1868309	-21	ld	11:35:32	1
1712104	99	57	4,10	cyclictest	1777675	-21	ssh	09:50:12	1
1712104	99	57	2,15	cyclictest	1068	-21	snmpd	07:30:32	1
1712104	99	56	8,37	cyclictest	1727410	-21	modprobe	08:10:00	1
1712104	99	56	3,7	cyclictest	1714152	-21	ntpq	07:15:28	1
1712104	99	56	26,27	cyclictest	1794690	-21	sshd	10:10:07	1
1712104	99	56	25,28	cyclictest	0	-21	swapper/1	10:00:25	1
1712104	99	56	25,28	cyclictest	0	-21	swapper/1	07:35:16	1
1712104	99	56	2,13	cyclictest	1739732	-21	ntpq	08:55:26	1
1712103	99	56	6,47	cyclictest	1872599	-21	ssh	11:40:34	0
1712103	99	56	48,6	cyclictest	1740254	-21	kworker/u4:1+events_unbound	08:57:59	0
1712103	99	56	48,5	cyclictest	1755858	-21	cron	09:25:00	0
1712103	99	55	48,4	cyclictest	0	-21	swapper/0	12:10:28	0
1712103	99	55	47,6	cyclictest	1801561	-21	kworker/u4:3+events_unbound	10:35:45	0
1712104	99	54	2,17	cyclictest	1721793	-21	ntpq	07:45:25	1
1712104	99	54	1,15	cyclictest	1734674	-21	sshd	08:35:28	1
1712104	99	54	10,41	cyclictest	1068	-21	snmpd	07:41:37	1
1712103	99	54	47,5	cyclictest	1749850	-21	kworker/u4:3+events_unbound	09:18:00	0
1712103	99	54	45,7	cyclictest	1833575	-21	fschecks_count	10:55:20	0
1712104	99	53	43,8	cyclictest	1709610	-21	kworker/u4:2+events_unbound	08:20:23	1
1712104	99	53	2,6	cyclictest	1723153	-21	ntpq	07:50:34	1
1712103	99	53	48,4	cyclictest	1721017	-21	kworker/u4:1+events_unbound	08:02:59	0
1712103	99	53	46,5	cyclictest	1695778	-21	kworker/u4:12+events_unbound	07:42:45	0
1712103	99	53	46,5	cyclictest	1682558	-21	kworker/u4:0+events_unbound	07:30:01	0
1712103	99	53	45,6	cyclictest	1762421	-21	kworker/u4:13+events_unbound	09:59:44	0
1712104	99	52	4,4	cyclictest	0	-21	swapper/1	08:40:12	1
1712104	99	52	2,7	cyclictest	1737251	-21	ntpq	08:45:28	1
1712104	99	52	1,12	cyclictest	1725603	-21	ntpq	08:00:25	1
1712103	99	52	45,5	cyclictest	1880321	-21	/usr/sbin/munin	11:50:14	0
1712103	99	52	45,5	cyclictest	1721017	-21	kworker/u4:1+events_unbound	08:41:43	0
1712103	99	52	38,11	cyclictest	1799400	-21	fschecks_count	10:15:23	0
1712103	99	52	38,11	cyclictest	1799400	-21	fschecks_count	10:15:22	0
1712104	99	51	2,5	cyclictest	1741023	-21	ntpq	09:00:25	1
1712103	99	51	45,4	cyclictest	1797223	-21	kworker/u4:11+events_unbound	10:15:00	0
1712103	99	51	43,6	cyclictest	1915437	-21	ps	12:30:35	0
1712103	99	51	43,6	cyclictest	1723877	-21	aten_r7power_vo	07:55:14	0
1712103	99	51	42,6	cyclictest	1826994	-21	kworker/u4:9+events_unbound	11:15:53	0
1712103	99	50	44,5	cyclictest	1861180	-21	kworker/u4:3+events_unbound	12:08:50	0
1712103	99	50	43,5	cyclictest	1911231	-21	cat	12:25:38	0
1712103	99	50	43,5	cyclictest	1737710	-21	kworker/u4:12+events_unbound	08:50:02	0
1712103	99	50	43,5	cyclictest	1721017	-21	kworker/u4:1+events_unbound	08:10:03	0
1712103	99	50	43,5	cyclictest	1712101	-21	cyclictest	07:45:27	0
1712103	99	50	42,6	cyclictest	1790529	-21	aten2__	10:05:15	0
1712103	99	50	42,6	cyclictest	1745450	-21	kworker/u4:7+events_unbound	09:27:34	0
1712103	99	50	29,18	cyclictest	0	-21	swapper/0	08:25:20	0
1712103	99	49	42,5	cyclictest	1842114	-21	fschecks_count	11:05:19	0
1712103	99	49	39,7	cyclictest	1824777	-21	aten_r7power_en	10:45:16	0
1712103	99	49	38,5	cyclictest	1737710	-21	kworker/u4:12+events_unbound	09:03:33	0
1712103	99	49	16,8	cyclictest	0	-21	swapper/0	11:35:16	0
1712104	99	48	1,14	cyclictest	1712218	-21	latency_hist	07:10:07	1
1712103	99	48	41,5	cyclictest	1804460	-21	timerwakeupswit	10:20:40	0
1712103	99	48	41,5	cyclictest	1735141	-21	kworker/u4:0+events_unbound	08:38:01	0
1712103	99	48	41,5	cyclictest	1695779	-21	kworker/u4:13+events_unbound	07:26:00	0
1712103	99	48	38,7	cyclictest	0	-21	swapper/0	12:15:39	0
1712103	99	48	38,7	cyclictest	0	-21	swapper/0	12:15:38	0
1712103	99	48	38,7	cyclictest	0	-21	swapper/0	09:40:26	0
1712103	99	48	36,6	cyclictest	0	-21	swapper/0	07:40:01	0
1712103	99	47	39,6	cyclictest	1855040	-21	fschecks_time	11:20:19	0
1712103	99	47	36,9	cyclictest	1833068	-21	latency_hist	10:55:01	0
1712103	99	47	33,12	cyclictest	1821332	-21	proc_pri	10:40:38	0
1712103	99	46	39,5	cyclictest	1721017	-21	kworker/u4:1+events_unbound	08:20:04	0
1712103	99	46	34,10	cyclictest	1884877	-21	fschecks_count	11:55:19	0
1712103	99	46	26,6	cyclictest	0	-21	swapper/0	09:50:34	0
1712103	99	45	38,5	cyclictest	1718451	-21	kworker/u4:3+events_unbound	07:51:59	0
1712103	99	45	37,6	cyclictest	1743425	-21	df_abs	09:10:19	0
1712103	99	45	37,6	cyclictest	1714853	-21	aten2__	07:20:15	0
1712103	99	45	37,6	cyclictest	1710842	-21	kworker/u4:3+events_unbound	07:10:59	0
1712103	99	45	36,7	cyclictest	1729216	-21	fschecks_count	08:15:23	0
1712103	99	44	36,6	cyclictest	1741803	-21	aten_r7power_cu	09:05:15	0
1712103	99	44	3,34	cyclictest	1839476	-21	ssh	11:01:41	0
1712103	99	44	3,34	cyclictest	1839476	-21	ssh	11:01:41	0
1712103	99	44	32,9	cyclictest	0	-21	swapper/0	09:45:05	0
1712103	99	43	36,5	cyclictest	1723558	-21	kworker/u4:10+events_unbound	08:06:08	0
1712103	99	43	36,5	cyclictest	1695779	-21	kworker/u4:13+events_unbound	07:15:59	0
1712103	99	42	35,5	cyclictest	1918839	-21	aten_r7power_cu	12:35:17	0
1712103	99	42	34,6	cyclictest	1846434	-21	fschecks_count	11:10:21	0
1712103	99	42	33,6	cyclictest	1736960	-21	fschecks_time	08:45:18	0
1712103	99	42	32,8	cyclictest	1889009	-21	aten_r7power_po	12:00:16	0
1712103	99	42	32,7	cyclictest	1906870	-21	/usr/sbin/munin	12:20:39	0
1712103	99	42	32,7	cyclictest	0	-21	swapper/0	10:30:19	0
1712103	99	27	14,10	cyclictest	1712212	-21	sed	07:10:06	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17