OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Wed Jan 14, 2026 00:44:12)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1852244	99	110	102,6	cyclictest	1893451	-21	kworker/u4:14+events_unbound	21:46:33	1
1852243	99	98	90,6	cyclictest	1864913	-21	kworker/u4:8+events_unbound	21:11:27	0
1852244	99	95	88,5	cyclictest	2003188	-21	kworker/u4:11+events_unbound	23:56:49	1
1852244	99	95	87,6	cyclictest	1990935	-21	kworker/u4:8+events_unbound	23:26:44	1
1852244	99	89	83,4	cyclictest	1885307	-21	kworker/u4:0+events_unbound	21:31:29	1
1852244	99	87	64,7	cyclictest	1863656	-21	kworker/u4:5+events_unbound	20:01:15	1
1852244	99	85	77,6	cyclictest	1982358	-21	kworker/u4:2+events_unbound	23:11:43	1
1852244	99	83	66,6	cyclictest	1872509	-21	kworker/u4:3+events_unbound	20:30:01	1
1852243	99	83	74,7	cyclictest	1940096	-21	kworker/u4:16+events_unbound	22:21:36	0
1852244	99	82	73,6	cyclictest	1885310	-21	kworker/u4:6+events_unbound	21:21:29	1
1852243	99	82	74,6	cyclictest	2024667	-21	kworker/u4:17+events_unbound	00:21:50	0
1852243	99	81	70,9	cyclictest	2028992	-21	kworker/u4:3+events_unbound	00:26:52	0
1852244	99	79	71,6	cyclictest	1948697	-21	kworker/u4:1+events_unbound	22:56:40	1
1852244	99	75	66,7	cyclictest	1853452	-21	kworker/u4:6+events_unbound	19:55:01	1
1852244	99	75	62,5	cyclictest	2020417	-21	kworker/u4:13+events_unbound	23:55:00	1
1852243	99	75	5,21	cyclictest	1968479	-21	ssh	22:50:29	0
1852244	99	73	66,5	cyclictest	1986658	-21	kworker/u4:6+events_unbound	23:16:44	1
1852243	99	73	62,7	cyclictest	2005649	-21	ssh	23:35:11	0
1852244	99	70	62,6	cyclictest	1862402	-21	kworker/u4:4+events_unbound	20:10:02	1
1852244	99	68	60,6	cyclictest	1866194	-21	kworker/u4:15+events_unbound	20:21:18	1
1852244	99	68	54,4	cyclictest	1864913	-21	kworker/u4:8+events_unbound	21:26:31	1
1852243	99	68	60,6	cyclictest	1957266	-21	kworker/u4:11+events_unbound	22:41:38	0
1852243	99	68	27,33	cyclictest	0	-21	swapper/0	19:10:00	0
1852244	99	67	58,6	cyclictest	2032649	-21	kworker/u4:7+events_unbound	00:36:54	1
1852243	99	67	59,6	cyclictest	1872509	-21	kworker/u4:3+events_unbound	20:31:20	0
1852244	99	66	59,5	cyclictest	2028994	-21	kworker/u4:6+events_unbound	00:12:12	1
1852243	99	65	57,6	cyclictest	2032649	-21	kworker/u4:7+events_unbound	00:31:53	0
1852244	99	64	57,5	cyclictest	1858607	-21	kworker/u4:19+events_unbound	19:36:15	1
1852243	99	64	49,12	cyclictest	0	-21	swapper/0	22:05:14	0
1852244	99	63	55,5	cyclictest	1915041	-21	kworker/u4:4+events_unbound	21:51:33	1
1852244	99	63	54,6	cyclictest	1856093	-21	kworker/u4:13+events_unbound	20:56:25	1
1852243	99	63	54,7	cyclictest	1856093	-21	kworker/u4:13+events_unbound	19:30:01	0
1852244	99	62	54,6	cyclictest	2016110	-21	kworker/u4:8+events_unbound	23:46:48	1
1852244	99	62	54,6	cyclictest	2016110	-21	kworker/u4:8+events_unbound	23:46:47	1
1852243	99	62	55,5	cyclictest	1923593	-21	kworker/u4:14+events_unbound	22:01:34	0
1852243	99	61	53,6	cyclictest	1876298	-21	kworker/u4:1+events_unbound	20:51:25	0
1852244	99	59	53,4	cyclictest	1910721	-21	kworker/u4:3+events_unbound	22:15:00	1
1852244	99	59	52,5	cyclictest	1940096	-21	kworker/u4:16+events_unbound	22:25:02	1
1852244	99	59	51,6	cyclictest	1850985	-21	kworker/u4:2+events_unbound	19:21:14	1
1852243	99	59	53,4	cyclictest	2027835	-21	switchtime	00:00:37	0
1852243	99	59	50,6	cyclictest	2012435	-21	kworker/u4:4+events_unbound	00:16:51	0
1852243	99	59	27,24	cyclictest	0	-21	swapper/0	23:20:10	0
1852243	99	59	27,24	cyclictest	0	-21	swapper/0	23:20:10	0
1852243	99	58	50,6	cyclictest	1990693	-21	sd-accept	23:16:43	0
1852244	99	57	46,8	cyclictest	314	-21	systemd-journal	23:06:41	1
1852244	99	57	46,8	cyclictest	314	-21	systemd-journal	23:06:40	1
1852243	99	57	50,5	cyclictest	1936429	-21	kworker/u4:15+events_unbound	22:16:35	0
1852243	99	57	49,6	cyclictest	1965393	-21	sshd	22:46:39	0
1852244	99	56	46,6	cyclictest	1884230	-21	unixbench_singl	21:10:43	1
1852243	99	56	47,7	cyclictest	1859863	-21	kworker/u4:20+events_unbound	19:41:16	0
1852244	99	55	48,5	cyclictest	1882607	-21	kworker/u4:10+events_unbound	21:43:42	1
1852244	99	55	47,6	cyclictest	1622868	-21	kworker/u4:3+events_unbound	19:26:14	1
1852244	99	54	38,13	cyclictest	0	-21	swapper/1	22:30:29	1
1852243	99	54	47,5	cyclictest	2016112	-21	kworker/u4:10+events_unbound	23:57:59	0
1852244	99	53	46,5	cyclictest	1923590	-21	kworker/u4:9+events_unbound	22:01:36	1
1852244	99	53	45,5	cyclictest	1974415	-21	kworker/u4:2+events_unbound	23:01:41	1
1852244	99	53	44,6	cyclictest	1877257	-21	mailstats	20:45:34	1
1852244	99	53	43,7	cyclictest	1864119	-21	fschecks_count	19:55:20	1
1852244	99	53	36,13	cyclictest	37	-21	kcompactd0	00:15:27	1
1852243	99	53	46,5	cyclictest	2008102	-21	kworker/u4:7+events_unbound	23:45:01	0
1852243	99	53	46,5	cyclictest	1915042	-21	kworker/u4:5+events_unbound	22:11:35	0
1852244	99	52	45,5	cyclictest	2008102	-21	kworker/u4:7+events_unbound	23:40:00	1
1852244	99	52	43,6	cyclictest	0	-21	swapper/1	00:25:11	1
1852244	99	52	38,9	cyclictest	0	-21	swapper/1	00:00:34	1
1852244	99	52	37,11	cyclictest	0	-21	swapper/1	22:20:13	1
1852243	99	52	39,9	cyclictest	1891466	-21	apt-get	21:20:11	0
1852243	99	52	2,9	cyclictest	1984412	-21	apt-config	23:10:02	0
1852244	99	51	44,5	cyclictest	2028993	-21	kworker/u4:5+events_unbound	00:32:59	1
1852244	99	51	42,6	cyclictest	1852735	-21	fschecks_time	19:10:14	1
1852244	99	50	41,6	cyclictest	1930933	-21	unixbench_multi	22:05:40	1
1852244	99	50	40,8	cyclictest	1990936	-21	kworker/u4:9+events_unbound	23:20:12	1
1852244	99	50	40,8	cyclictest	1990936	-21	kworker/u4:9+events_unbound	23:20:12	1
1852244	99	50	40,7	cyclictest	1882707	-21	cat	21:10:01	1
1852244	99	50	40,7	cyclictest	1882707	-21	cat	21:10:01	1
1852243	99	50	42,6	cyclictest	2028993	-21	kworker/u4:5+events_unbound	00:06:49	0
1852243	99	50	42,5	cyclictest	1854847	-21	sendmail	19:20:00	0
1852244	99	49	42,5	cyclictest	1957266	-21	kworker/u4:11+events_unbound	22:38:59	1
1852244	99	49	41,6	cyclictest	1904667	-21	fschecks_time	21:35:18	1
1852244	99	49	39,8	cyclictest	1963543	-21	aten2__	22:45:15	1
1852243	99	49	43,4	cyclictest	1908796	-21	/usr/sbin/munin	21:40:16	0
1852243	99	49	36,10	cyclictest	1995253	-21	kworker/u4:12+rpciod	23:30:11	0
1852244	99	48	39,6	cyclictest	1967942	-21	cpu	22:50:19	1
1852244	99	48	37,7	cyclictest	1867834	-21	df_abs	20:10:17	1
1852243	99	48	39,7	cyclictest	1917120	-21	aten_r7power_cu	21:50:15	0
1852244	99	47	40,5	cyclictest	1862453	-21	grep	19:50:01	1
1852244	99	47	39,5	cyclictest	1910719	-21	kworker/u4:1-nfsiod	21:55:02	1
1852243	99	47	41,4	cyclictest	1956984	-21	sshd	22:36:42	0
1852243	99	47	39,6	cyclictest	2018456	-21	aten_r7power_en	23:50:16	0
1852243	99	47	38,7	cyclictest	0	-21	swapper/0	21:30:32	0
1852243	99	47	32,13	cyclictest	1952971	-21	kworker/u4:9-rpciod	22:35:02	0
1852244	99	46	37,6	cyclictest	1875061	-21	basename	20:40:01	1
1852244	99	46	36,7	cyclictest	2011063	-21	timerandwakeup	23:40:42	1
1852244	99	46	26,11	cyclictest	2044423	-21	ssh	00:20:31	1
1852243	99	46	39,5	cyclictest	1972505	-21	kernelversion	22:55:23	0
1852243	99	46	39,4	cyclictest	1904442	-21	aten_r7power_vo	21:35:16	0
1852243	99	46	37,7	cyclictest	1863869	-21	aten2__	19:55:17	0
1852243	99	46	37,6	cyclictest	1852239	-21	cyclictest	00:38:51	0
1852243	99	46	36,8	cyclictest	1852239	-21	cyclictest	20:57:19	0
1852243	99	46	33,6	cyclictest	1961581	-21	kworker/u4:14+events_unbound	23:05:03	0
1852243	99	46	33,6	cyclictest	1961581	-21	kworker/u4:14+events_unbound	23:05:03	0
1852243	99	46	31,13	cyclictest	1850985	-21	kworker/u4:2-nfsiod	19:50:01	0
1852244	99	45	38,5	cyclictest	2003189	-21	kworker/u4:13+events_unbound	23:34:00	1
1852244	99	45	38,5	cyclictest	1960250	-21	sendmail_mailqu	22:40:37	1
1852244	99	45	38,5	cyclictest	1940096	-21	kworker/u4:16+events_unbound	22:18:44	1
1852244	99	45	36,7	cyclictest	1891371	-21	latency_hist	21:20:01	1
1852244	99	45	35,7	cyclictest	1858625	-21	kworker/u4:3	19:35:01	1
1852244	99	45	31,10	cyclictest	0	-21	swapper/1	20:40:21	1
1852243	99	45	37,6	cyclictest	1868706	-21	kworker/u4:0+events_unbound	20:41:22	0
1852243	99	45	37,6	cyclictest	1865260	-21	aten_r7power_vo	20:00:16	0
1852243	99	45	35,7	cyclictest	1871573	-21	aten_r7power_vo	20:25:22	0
1852243	99	45	26,16	cyclictest	0	-21	swapper/0	21:45:17	0
1852244	99	44	35,7	cyclictest	1880394	-21	aten_r7power_po	21:00:16	1
1852244	99	44	35,5	cyclictest	2031528	-21	/usr/sbin/munin	00:05:19	1
1852243	99	44	37,5	cyclictest	1999512	-21	kworker/u4:3+events_unbound	23:30:01	0
1852243	99	44	37,5	cyclictest	1891348	-21	latency_hist	21:20:01	0
1852243	99	44	36,6	cyclictest	1881836	-21	fschecks_time	21:05:21	0
1852243	99	44	36,6	cyclictest	1881836	-21	fschecks_time	21:05:20	0
1852243	99	44	36,6	cyclictest	1880295	-21	aten2__	21:00:15	0
1852243	99	44	36,5	cyclictest	1921259	-21	acpi	21:55:14	0
1852244	99	43	36,5	cyclictest	1869193	-21	grep	20:15:20	1
1852244	99	43	33,7	cyclictest	1877939	-21	df	20:50:16	1
1852243	99	43	36,4	cyclictest	2012435	-21	kworker/u4:4+events_unbound	23:45:32	0
1852243	99	43	36,4	cyclictest	2012435	-21	kworker/u4:4+events_unbound	23:45:32	0
1852243	99	43	35,6	cyclictest	1862920	-21	fschecks_time	19:50:19	0
1852243	99	43	35,6	cyclictest	1852527	-21	aten_r7power_vo	19:10:13	0
1852243	99	43	34,7	cyclictest	1855930	-21	timerwakeupswit	19:20:36	0
1852243	99	43	34,6	cyclictest	1868919	-21	aten2__	20:15:17	0
1852244	99	42	36,4	cyclictest	1856093	-21	kworker/u4:13-xprtiod	19:40:15	1
1852244	99	42	32,7	cyclictest	1464786	-21	kworker/u4:9-rpciod	19:15:24	1
1852243	99	42	36,4	cyclictest	1896249	-21	gltestperf	21:25:19	0
1852243	99	42	35,5	cyclictest	1976697	-21	/usr/sbin/munin	23:00:24	0
1852243	99	42	34,6	cyclictest	2028992	-21	kworker/u4:3+rpciod	00:10:40	0
1852243	99	42	34,6	cyclictest	1866488	-21	aten_r7power_po	20:05:14	0
1852243	99	42	34,5	cyclictest	0	-21	swapper/0	22:25:17	0
1852244	99	40	31,6	cyclictest	0	-21	swapper/1	20:30:20	1
1852243	99	40	31,6	cyclictest	0	-21	swapper/0	20:35:20	0
1852243	99	39	32,5	cyclictest	1870457	-21	fschecks_count	20:20:18	0
1852243	99	39	30,6	cyclictest	0	-21	swapper/0	19:40:01	0
1852243	99	39	28,9	cyclictest	1876671	-21	cpu	20:45:16	0
1852243	99	38	30,6	cyclictest	1857586	-21	aten_r7power_cu	19:30:16	0
1852243	99	36	29,5	cyclictest	0	-21	swapper/0	20:10:35	0
1852244	99	34	25,7	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17