OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Mon Aug 31, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2127973	99	111	103,5	cyclictest	2278307	-21	kworker/u4:9+events_unbound	12:00:59	0
2127973	99	107	100,5	cyclictest	2273754	-21	kworker/u4:5+events_unbound	11:25:55	0
2127973	99	105	98,5	cyclictest	2282826	-21	kworker/u4:1+events_unbound	11:50:59	0
2127973	99	105	97,5	cyclictest	1921529	-21	kworker/u4:6+events_unbound	08:35:34	0
2127973	99	104	96,6	cyclictest	2273754	-21	kworker/u4:5+events_unbound	11:45:58	0
2127973	99	98	91,5	cyclictest	2318389	-21	kworker/u4:1+events_unbound	12:31:02	0
2127975	99	96	86,8	cyclictest	2127909	-21	kworker/u4:1+events_unbound	08:25:32	1
2127975	99	96	86,8	cyclictest	2127909	-21	kworker/u4:1+events_unbound	08:25:31	1
2127973	99	96	75,14	cyclictest	53	-21	kswapd0	10:05:12	0
2127973	99	92	84,6	cyclictest	2287346	-21	kworker/u4:4+events_unbound	11:56:00	0
2127975	99	91	78,10	cyclictest	53	-21	kswapd0	10:05:11	1
2127973	99	88	80,6	cyclictest	2238120	-21	kworker/u4:4+events_unbound	10:50:52	0
2127973	99	86	77,7	cyclictest	2340396	-21	kworker/u4:5+events_unbound	12:36:03	0
2127973	99	76	68,6	cyclictest	2278305	-21	kworker/u4:7+events_unbound	12:06:01	0
2127975	99	75	62,9	cyclictest	0	-21	swapper/1	12:00:36	1
2127973	99	73	66,5	cyclictest	2197872	-21	kworker/u4:5+events_unbound	09:55:45	0
2127973	99	73	65,6	cyclictest	2184064	-21	kworker/u4:2+events_unbound	09:40:42	0
2127973	99	72	56,10	cyclictest	53	-21	kswapd0	12:15:08	0
2127973	99	71	63,6	cyclictest	2202485	-21	kworker/u4:2+events_unbound	10:35:51	0
2127973	99	71	58,6	cyclictest	2264698	-21	kworker/u4:7+events_unbound	11:10:53	0
2127973	99	70	6,9	cyclictest	2127974	-21	idleruntime-cro	07:10:00	0
2127975	99	68	4,49	cyclictest	2178154	-21	ssh	09:30:28	1
2127975	99	66	28,14	cyclictest	2240987	-21	ld	10:40:28	1
2127973	99	66	51,5	cyclictest	2153832	-21	kworker/u4:5+events_unbound	08:50:01	0
2127975	99	65	27,14	cyclictest	2136534	-21	ld	07:40:30	1
2127975	99	65	26,15	cyclictest	2185390	-21	ssh	09:38:53	1
2127975	99	65	26,14	cyclictest	2206028	-21	sh	10:00:44	1
2127975	99	65	26,13	cyclictest	2251307	-21	ssh	10:51:52	1
2127975	99	64	53,8	cyclictest	2152083	-21	sshd	08:40:32	1
2127975	99	63	27,12	cyclictest	2340160	-21	ssh	12:31:29	1
2127975	99	63	27,12	cyclictest	2237242	-21	ssh	10:35:46	1
2127975	99	63	26,11	cyclictest	2166736	-21	ssh	09:18:07	1
2127975	99	63	25,14	cyclictest	2287424	-21	ssh	11:32:34	1
2127975	99	62	27,11	cyclictest	2273812	-21	ssh	11:17:11	1
2127975	99	62	26,13	cyclictest	2342687	-21	/usr/sbin/munin	12:35:39	1
2127975	99	62	26,13	cyclictest	2282649	-21	ssh	11:27:05	1
2127975	99	62	26,13	cyclictest	2266586	-21	ssh	11:09:47	1
2127975	99	62	26,12	cyclictest	2331410	-21	ssh	12:21:41	1
2127975	99	62	26,12	cyclictest	2193412	-21	ssh	09:47:17	1
2127975	99	62	26,11	cyclictest	2267586	-21	irqstats	11:10:21	1
2127975	99	62	26,10	cyclictest	2306059	-21	ssh	11:53:52	1
2127975	99	62	25,14	cyclictest	2189835	-21	ssh	09:43:44	1
2127975	99	62	25,13	cyclictest	2291047	-21	ssh	11:36:18	1
2127975	99	62	24,14	cyclictest	2225861	-21	ssh	10:23:50	1
2127975	99	62	24,13	cyclictest	2296100	-21	ssh	11:42:12	1
2127973	99	62	54,6	cyclictest	2127908	-21	kworker/u4:0+events_unbound	07:20:04	0
2127975	99	61	57,3	cyclictest	2130486	-21	kworker/u4:10+events_unbound	08:00:24	1
2127975	99	61	27,11	cyclictest	2324452	-21	ssh	12:14:48	1
2127975	99	61	26,11	cyclictest	2262037	-21	ssh	11:04:39	1
2127975	99	61	26,11	cyclictest	2216280	-21	ssh	10:12:49	1
2127975	99	61	25,13	cyclictest	2256962	-21	ssh	10:58:44	1
2127975	99	61	25,13	cyclictest	2198627	-21	ssh	09:53:19	1
2127975	99	60	27,11	cyclictest	2229866	-21	ssh	10:28:10	1
2127975	99	60	25,11	cyclictest	2276807	-21	ntpq	11:20:32	1
2127975	99	60	24,12	cyclictest	2326812	-21	ssh	12:16:31	1
2127975	99	60	24,12	cyclictest	2217959	-21	/usr/sbin/munin	10:15:23	1
2127975	99	60	24,11	cyclictest	2302043	-21	ssh	11:49:30	1
2127975	99	59	31,9	cyclictest	0	-21	swapper/1	12:25:40	1
2127975	99	59	26,12	cyclictest	2318770	-21	ssh	12:07:52	1
2127975	99	59	26,12	cyclictest	2235333	-21	ssh	10:34:42	1
2127975	99	59	24,13	cyclictest	2175038	-21	ssh	09:26:57	1
2127975	99	59	24,12	cyclictest	2308730	-21	ssh	11:56:06	1
2127973	99	59	49,6	cyclictest	2329464	-21	aten_r7power_cu	12:20:16	0
2127975	99	58	25,9	cyclictest	2162316	-21	ssh	09:13:13	1
2127975	99	58	25,7	cyclictest	2143374	-21	apt-get	08:10:13	1
2127975	99	58	25,7	cyclictest	2143374	-21	apt-get	08:10:13	1
2127975	99	58	24,11	cyclictest	2202250	-21	ssh	09:56:56	1
2127975	99	58	24,11	cyclictest	0	-21	swapper/1	08:05:24	1
2127975	99	57	31,12	cyclictest	0	-21	swapper/1	08:45:33	1
2127973	99	57	49,6	cyclictest	2140783	-21	kworker/u4:16+events_unbound	10:23:47	0
2127975	99	56	38,13	cyclictest	2138433	-21	apt-get	07:50:17	1
2127973	99	56	51,4	cyclictest	2157665	-21	kworker/u4:1+events_unbound	09:10:38	0
2127973	99	56	49,5	cyclictest	2155104	-21	kworker/u4:10+events_unbound	09:35:04	0
2127973	99	56	38,16	cyclictest	2164621	-21	gcc	09:15:33	0
2127975	99	55	26,8	cyclictest	2157297	-21	ps	09:00:36	1
2127975	99	55	25,11	cyclictest	2154672	-21	ntpq	08:50:32	1
2127975	99	55	23,9	cyclictest	2170232	-21	ssh	09:21:30	1
2127975	99	54	22,10	cyclictest	2246837	-21	ssh	10:46:50	1
2127975	99	54	21,12	cyclictest	2128750	-21	collect2	07:10:30	1
2127973	99	54	46,6	cyclictest	2133137	-21	kworker/u4:11+events_unbound	07:35:08	0
2127973	99	54	40,6	cyclictest	2202485	-21	kworker/u4:2+events_unbound	10:30:02	0
2127973	99	54	39,6	cyclictest	2202488	-21	kworker/u4:7+events_unbound	10:15:03	0
2127973	99	53	5,36	cyclictest	0	-21	swapper/0	07:25:11	0
2127973	99	53	44,6	cyclictest	2228324	-21	sshd	10:25:47	0
2127975	99	52	43,7	cyclictest	2147368	-21	kworker/u4:14+events_unbound	08:30:32	1
2127973	99	52	46,4	cyclictest	15	1	ktimers/0	11:16:59	0
2127973	99	52	45,5	cyclictest	0	-21	swapper/0	09:45:14	0
2127973	99	52	44,6	cyclictest	2175523	-21	kworker/u4:11+events_unbound	09:31:45	0
2127973	99	52	39,5	cyclictest	2287346	-21	kworker/u4:4+events_unbound	11:40:57	0
2127973	99	52	33,7	cyclictest	2260163	-21	kworker/u4:5+events_unbound	11:08:35	0
2127975	99	51	40,8	cyclictest	2147418	-21	grep	08:25:01	1
2127975	99	51	22,5	cyclictest	1073	-21	snmpd	09:07:56	1
2127973	99	51	43,6	cyclictest	2287344	-21	kworker/u4:2+events_unbound	11:35:04	0
2127973	99	51	34,15	cyclictest	2157700	-21	grep	09:05:00	0
2127975	99	50	41,6	cyclictest	2150758	-21	sshd	08:35:32	1
2127975	99	50	23,7	cyclictest	2130709	-21	apt-get	07:20:14	1
2127975	99	50	21,5	cyclictest	2138012	-21	find	07:45:38	1
2127973	99	50	41,7	cyclictest	400	-21	systemd-logind	11:00:52	0
2127973	99	50	41,6	cyclictest	2285355	-21	gltestperf	11:30:21	0
2127973	99	50	30,17	cyclictest	2202488	-21	kworker/u4:7+rpciod	10:00:35	0
2127975	99	49	23,7	cyclictest	2129404	-21	apt-get	07:15:13	1
2127975	99	49	23,7	cyclictest	2129404	-21	apt-get	07:15:13	1
2127975	99	49	22,7	cyclictest	2134604	-21	apt-get	07:35:14	1
2127973	99	49	42,5	cyclictest	2318390	-21	kworker/u4:3+events_unbound	12:10:03	0
2127973	99	49	41,6	cyclictest	2158938	-21	kworker/u4:5+events_unbound	09:20:03	0
2127973	99	49	40,6	cyclictest	2128458	-21	fschecks_time	07:10:18	0
2127973	99	49	30,16	cyclictest	256	50	irq/23-42890000.ethernet	08:15:11	0
2127975	99	48	37,7	cyclictest	0	-21	swapper/1	07:10:01	1
2127975	99	48	35,10	cyclictest	2131808	-21	apt-get	07:25:12	1
2127975	99	48	32,11	cyclictest	0	-21	swapper/1	07:55:12	1
2127973	99	48	42,3	cyclictest	2238121	-21	kworker/u4:7-xprtiod	10:45:11	0
2127973	99	48	40,5	cyclictest	2174006	-21	timerwakeupswit	09:25:37	0
2127973	99	48	37,7	cyclictest	2146614	-21	fschecks_time	08:20:20	0
2127975	99	47	21,4	cyclictest	2133335	-21	apt-get	07:30:13	1
2127973	99	47	37,6	cyclictest	2214669	-21	mailstats	10:10:43	0
2127973	99	47	35,7	cyclictest	2256254	-21	kworker/u4:3-rpciod	10:59:24	0
2127973	99	46	37,6	cyclictest	0	-21	swapper/0	10:40:32	0
2127973	99	46	29,15	cyclictest	0	-21	swapper/0	11:20:13	0
2127975	99	45	35,8	cyclictest	2155943	-21	ntpq	08:55:32	1
2127975	99	45	35,7	cyclictest	2145383	-21	gltestperf	08:15:28	1
2127973	99	45	38,5	cyclictest	2130528	-21	grep	07:20:02	0
2127973	99	45	38,5	cyclictest	2130528	-21	grep	07:20:01	0
2127973	99	45	37,5	cyclictest	2158773	-21	timerwakeupswit	09:05:42	0
2127973	99	45	3,35	cyclictest	0	-21	swapper/0	08:10:12	0
2127973	99	45	3,35	cyclictest	0	-21	swapper/0	08:10:11	0
2127973	99	45	33,4	cyclictest	0	-21	swapper/0	09:50:19	0
2127973	99	45	2,30	cyclictest	2334658	-21	ssh	12:25:31	0
2127973	99	44	37,5	cyclictest	2155591	-21	fschecks_time	08:55:19	0
2127973	99	44	36,6	cyclictest	2147587	-21	aten2__	08:25:16	0
2127973	99	44	36,6	cyclictest	2147587	-21	aten2__	08:25:15	0
2127973	99	44	36,5	cyclictest	256	50	irq/23-42890000.ethernet	07:45:00	0
2127973	99	44	36,5	cyclictest	0	-21	swapper/0	08:30:31	0
2127973	99	43	36,4	cyclictest	0	-21	swapper/0	08:40:32	0
2127973	99	41	31,6	cyclictest	0	-21	swapper/0	07:55:20	0
2127973	99	40	34,4	cyclictest	2138065	-21	timerwakeupswit	07:45:39	0
2127973	99	40	33,5	cyclictest	2143055	-21	cat	08:05:40	0
2127973	99	40	31,7	cyclictest	2141062	-21	aten_r7power_en	08:00:17	0
2127973	99	39	30,7	cyclictest	2139149	-21	processes	07:50:37	0
2127973	99	39	30,6	cyclictest	0	-21	swapper/0	07:30:26	0
2127973	99	38	29,6	cyclictest	0	-21	swapper/0	08:50:20	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17