OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Thu Jan 08, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1892280	99	103	84,16	cyclictest	54	-21	kswapd0	21:10:18	0
1892280	99	97	87,7	cyclictest	1889807	-21	kworker/u4:1+events_unbound	19:11:02	0
1892280	99	90	82,5	cyclictest	2037612	-21	kworker/u4:0+events_unbound	23:26:51	0
1892280	99	86	78,6	cyclictest	1950578	-21	kworker/u4:12+events_unbound	21:51:33	0
1892280	99	81	73,6	cyclictest	2000092	-21	kworker/u4:6+events_unbound	22:46:45	0
1892280	99	81	73,6	cyclictest	2000092	-21	kworker/u4:6+events_unbound	22:46:44	0
1892280	99	80	72,6	cyclictest	2025506	-21	kworker/u4:8+events_unbound	23:16:50	0
1892283	99	79	56,18	cyclictest	1981617	-21	sh	22:20:16	1
1892280	99	77	69,6	cyclictest	1962679	-21	kworker/u4:14+events_unbound	22:16:40	0
1892280	99	77	68,6	cyclictest	2087238	-21	kworker/u4:3+events_unbound	00:38:58	0
1892283	99	73	64,6	cyclictest	2083103	-21	kworker/u4:4+events_unbound	00:30:00	1
1892280	99	73	63,8	cyclictest	1975399	-21	kworker/u4:2+events_unbound	22:25:12	0
1892280	99	71	62,7	cyclictest	1992285	-21	kworker/u4:3+events_unbound	22:41:42	0
1892283	99	70	65,3	cyclictest	1879802	-21	kworker/u4:8+events_unbound	19:26:05	1
1892280	99	67	58,6	cyclictest	0	-21	swapper/0	21:45:30	0
1892280	99	66	57,5	cyclictest	2046035	-21	kworker/u4:11+events_unbound	23:40:17	0
1892280	99	65	58,5	cyclictest	2087237	-21	kworker/u4:2+events_unbound	00:30:12	0
1892283	99	64	47,4	cyclictest	1924999	-21	kworker/u4:1+events_unbound	21:16:27	1
1892283	99	62	52,8	cyclictest	1913886	-21	systemd	20:31:20	1
1892280	99	62	54,6	cyclictest	1995866	-21	kworker/u4:5+events_unbound	22:36:42	0
1892280	99	61	52,7	cyclictest	2041838	-21	kworker/u4:5+events_unbound	23:31:52	0
1892283	99	60	53,5	cyclictest	1933502	-21	kworker/u4:9+events_unbound	22:06:37	1
1892280	99	60	53,5	cyclictest	1933501	-21	kworker/u4:0+events_unbound	21:26:29	0
1892280	99	59	50,7	cyclictest	1995866	-21	kworker/u4:5+events_unbound	23:09:00	0
1892283	99	58	50,6	cyclictest	1916429	-21	kworker/u4:8+events_unbound	20:56:25	1
1892280	99	58	50,6	cyclictest	1946290	-21	kworker/u4:0+events_unbound	21:45:02	0
1892280	99	58	50,6	cyclictest	1946290	-21	kworker/u4:0+events_unbound	21:45:02	0
1892280	99	58	50,5	cyclictest	1879802	-21	kworker/u4:8+events_unbound	19:20:00	0
1892280	99	58	36,8	cyclictest	2046030	-21	kworker/u4:6+events_unbound	23:50:00	0
1892283	99	57	49,6	cyclictest	1924999	-21	kworker/u4:1+events_unbound	22:01:36	1
1892283	99	57	47,8	cyclictest	2081362	-21	df_abs	00:20:17	1
1892280	99	57	37,18	cyclictest	54	-21	kswapd0	22:30:07	0
1892283	99	56	48,6	cyclictest	1916427	-21	kworker/u4:2+events_unbound	21:06:27	1
1892280	99	56	35,18	cyclictest	2065858	-21	diskmemload	00:00:39	0
1892283	99	55	48,5	cyclictest	1946290	-21	kworker/u4:0+events_unbound	21:56:35	1
1892283	99	55	47,6	cyclictest	2054478	-21	kworker/u4:5+events_unbound	23:52:46	1
1892283	99	55	47,6	cyclictest	2044883	-21	/usr/sbin/munin	23:35:36	1
1892283	99	55	47,5	cyclictest	2046035	-21	kworker/u4:11+events_unbound	23:40:37	1
1892283	99	55	47,5	cyclictest	1908823	-21	kworker/u4:3+events_unbound	21:25:00	1
1892283	99	55	46,7	cyclictest	1899971	-21	systemd	19:36:06	1
1892280	99	55	48,5	cyclictest	1916427	-21	kworker/u4:2+events_unbound	21:21:28	0
1892280	99	55	47,6	cyclictest	2046035	-21	kworker/u4:11+events_unbound	00:20:16	0
1892280	99	55	47,6	cyclictest	1933502	-21	kworker/u4:9+events_unbound	22:21:40	0
1892280	99	55	47,5	cyclictest	1973219	-21	apt-get	22:10:11	0
1892280	99	55	47,5	cyclictest	1973219	-21	apt-get	22:10:11	0
1892280	99	55	46,6	cyclictest	1907562	-21	kworker/u4:12+events_unbound	20:11:19	0
1892280	99	55	44,8	cyclictest	1897852	-21	df	19:30:16	0
1892283	99	53	45,6	cyclictest	2073827	-21	/usr/sbin/munin	00:10:35	1
1892283	99	53	45,6	cyclictest	1971159	-21	kworker/u4:1+events_unbound	22:11:39	1
1892283	99	53	45,6	cyclictest	1971159	-21	kworker/u4:1+events_unbound	22:11:38	1
1892283	99	53	45,6	cyclictest	1893578	-21	kworker/u4:5+events_unbound	19:21:05	1
1892280	99	53	5,31	cyclictest	1944725	-21	ssh	21:35:29	0
1892280	99	53	45,6	cyclictest	2054478	-21	kworker/u4:5+events_unbound	23:53:58	0
1892280	99	53	42,8	cyclictest	2045098	-21	/usr/sbin/munin	23:35:39	0
1892280	99	53	42,6	cyclictest	0	-21	swapper/0	22:05:14	0
1892280	99	53	41,8	cyclictest	54	-21	kswapd0	23:55:10	0
1892283	99	52	47,3	cyclictest	1912633	-21	kworker/u4:5+events_unbound	20:51:26	1
1892283	99	52	42,7	cyclictest	2004312	-21	kworker/u4:3+rpciod	23:00:39	1
1892280	99	52	45,5	cyclictest	54	-21	kswapd0	00:15:11	0
1892280	99	52	43,6	cyclictest	2073592	-21	ntp_kernel_pll_	00:10:26	0
1892283	99	51	42,6	cyclictest	2012801	-21	kworker/u4:1+rpciod	23:10:24	1
1892283	99	51	34,13	cyclictest	0	-21	swapper/1	22:25:21	1
1892280	99	51	45,4	cyclictest	2021279	-21	kworker/u4:0+events_unbound	23:10:43	0
1892283	99	50	45,3	cyclictest	1908820	-21	kworker/u4:0+events_unbound	20:46:22	1
1892283	99	50	43,5	cyclictest	1991143	-21	unixbench_multi	22:30:42	1
1892283	99	50	40,8	cyclictest	2011535	-21	/usr/sbin/munin	22:55:33	1
1892280	99	50	42,5	cyclictest	2010896	-21	df_abs	22:55:15	0
1892280	99	50	34,7	cyclictest	1918958	-21	kworker/u4:8	20:55:00	0
1892280	99	50	34,11	cyclictest	37	-21	kcompactd0	00:25:32	0
1892280	99	50	32,4	cyclictest	0	-21	swapper/0	22:00:02	0
1892280	99	50	29,18	cyclictest	0	-21	swapper/0	22:50:37	0
1892283	99	49	43,4	cyclictest	0	-21	swapper/1	19:45:27	1
1892283	99	49	42,5	cyclictest	2065041	-21	fschecks_count	00:00:20	1
1892283	99	49	40,5	cyclictest	0	-21	swapper/1	21:45:14	1
1892283	99	49	38,8	cyclictest	1906711	-21	df_abs	20:05:16	1
1892283	99	49	36,9	cyclictest	2002300	-21	/usr/sbin/munin	22:45:11	1
1892283	99	49	36,9	cyclictest	2002300	-21	/usr/sbin/munin	22:45:11	1
1892280	99	49	40,6	cyclictest	1912450	-21	cat	20:25:35	0
1892283	99	48	43,3	cyclictest	1905021	-21	kworker/u4:2+events_unbound	20:05:01	1
1892283	99	48	42,4	cyclictest	2036569	-21	proc_pri	23:25:36	1
1892283	99	48	40,6	cyclictest	1913893	-21	kworker/u4:13+events_unbound	20:36:23	1
1892283	99	48	38,7	cyclictest	1975399	-21	kworker/u4:2+events_unbound	22:15:24	1
1892283	99	48	37,8	cyclictest	2090483	-21	unixbench-2d	00:30:42	1
1892283	99	48	2,39	cyclictest	1068	-21	snmpd	22:36:36	1
1892280	99	48	40,6	cyclictest	2071220	-21	kworker/u4:8+events_unbound	00:09:47	0
1892280	99	48	40,5	cyclictest	2015888	-21	/usr/sbin/munin	23:00:39	0
1892280	99	48	27,18	cyclictest	1907604	-21	idleruntime-cro	20:10:00	0
1892283	99	47	41,4	cyclictest	0	-21	swapper/1	21:11:25	1
1892283	99	47	38,7	cyclictest	2028476	-21	unixbench-2d	23:15:39	1
1892280	99	47	40,5	cyclictest	1895177	-21	aten2__	19:20:19	0
1892280	99	47	36,8	cyclictest	1927318	-21	aten_r7power_en	21:15:18	0
1892280	99	47	34,9	cyclictest	1892253	-21	apt-get	19:10:01	0
1892283	99	46	39,5	cyclictest	1956908	-21	fschecks_count	21:50:18	1
1892283	99	46	37,7	cyclictest	2006613	-21	aten_r7power_po	22:50:17	1
1892283	99	46	37,7	cyclictest	1903990	-21	aten2__	19:55:16	1
1892283	99	46	36,8	cyclictest	1892861	-21	fschecks_time	19:10:23	1
1892280	99	46	39,5	cyclictest	1904359	-21	gltestperf	19:55:21	0
1892280	99	46	35,9	cyclictest	1915374	-21	aten2__	20:40:13	0
1892280	99	46	35,8	cyclictest	1901559	-21	aten_r7power_po	19:45:14	0
1892280	99	46	27,17	cyclictest	1920246	-21	sendmail	21:00:00	0
1892283	99	45	36,7	cyclictest	0	-21	swapper/1	23:55:45	1
1892283	99	45	35,8	cyclictest	2035449	-21	latency_hist	23:25:01	1
1892283	99	45	35,7	cyclictest	0	-21	swapper/1	00:15:28	1
1892283	99	45	35,6	cyclictest	1916429	-21	kworker/u4:8+rpciod	20:45:02	1
1892280	99	45	34,9	cyclictest	1913928	-21	munin-run	20:35:00	0
1892280	99	45	34,8	cyclictest	0	-21	swapper/0	23:20:33	0
1892283	99	44	38,4	cyclictest	1999188	-21	switchtime	22:40:39	1
1892283	99	44	38,4	cyclictest	1943687	-21	idleruntime-cro	21:35:00	1
1892283	99	44	37,5	cyclictest	2019394	-21	fschecks_time	23:05:20	1
1892283	99	44	37,5	cyclictest	1935907	-21	fschecks_count	21:25:18	1
1892283	99	44	36,6	cyclictest	1910035	-21	unixbench_singl	20:15:35	1
1892283	99	44	34,7	cyclictest	0	-21	swapper/1	21:40:31	1
1892283	99	44	34,7	cyclictest	0	-21	swapper/1	21:40:30	1
1892283	99	44	33,8	cyclictest	0	-21	swapper/1	21:35:28	1
1892280	99	44	37,5	cyclictest	1902788	-21	aten_r7power_en	19:50:16	0
1892280	99	44	37,5	cyclictest	1899678	-21	cat	19:35:35	0
1892280	99	44	36,5	cyclictest	1915186	-21	munin-plugin-st	20:40:00	0
1892280	99	44	35,7	cyclictest	1940139	-21	fschecks_count	21:30:23	0
1892280	99	44	35,6	cyclictest	1910607	-21	fschecks_time	20:20:17	0
1892280	99	44	34,7	cyclictest	0	-21	swapper/0	21:00:35	0
1892283	99	43	35,6	cyclictest	1881062	-21	kworker/u4:18+rpciod	19:50:16	1
1892283	99	43	34,6	cyclictest	1879804	-21	kworker/u4:12+rpciod	19:15:20	1
1892283	99	43	33,8	cyclictest	1910603	-21	fschecks_count	20:20:17	1
1892280	99	43	34,7	cyclictest	1909781	-21	mailstats	20:15:33	0
1892280	99	43	33,8	cyclictest	1900322	-21	aten_r7power_vo	19:40:14	0
1892280	99	43	33,8	cyclictest	1897147	-21	mailstats	19:25:34	0
1892283	99	42	35,5	cyclictest	2069883	-21	timerandwakeup	00:05:37	1
1892283	99	42	33,7	cyclictest	2052647	-21	fschecks_time	23:45:19	1
1892280	99	42	33,6	cyclictest	1905362	-21	aten_r7power_vo	20:00:17	0
1892280	99	42	21,18	cyclictest	0	-21	swapper/0	21:10:00	0
1892283	99	41	32,7	cyclictest	0	-21	swapper/1	00:35:18	1
1892280	99	41	35,4	cyclictest	1908820	-21	kworker/u4:0-rpciod	20:45:20	0
1892280	99	41	30,6	cyclictest	0	-21	swapper/0	22:00:28	0
1892283	99	40	33,5	cyclictest	2040778	-21	sendmail_mailqu	23:30:36	1
1892283	99	40	33,5	cyclictest	1900388	-21	sed	19:40:14	1
1892283	99	40	29,7	cyclictest	0	-21	swapper/1	20:10:33	1
1892283	99	39	29,7	cyclictest	0	-21	swapper/1	20:25:27	1
1892283	99	38	26,9	cyclictest	0	-21	swapper/1	19:30:36	1
1892283	99	37	27,7	cyclictest	0	-21	swapper/1	21:00:38	1
1892283	99	33	25,6	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17