OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sun Aug 16, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2185006	99	108	98,7	cyclictest	2187494	-21	kworker/u4:11+events_unbound	19:16:47	0
2185006	99	95	86,7	cyclictest	2312261	-21	kworker/u4:15+events_unbound	23:02:16	0
2185007	99	88	34,31	cyclictest	2351608	-21	timerandwakeup	23:40:40	1
2185007	99	86	78,6	cyclictest	2235742	-21	kworker/u4:9+events_unbound	21:42:04	1
2185006	99	85	74,8	cyclictest	2339150	-21	kworker/u4:0+events_unbound	23:42:17	0
2185006	99	80	71,7	cyclictest	2325323	-21	kworker/u4:7+events_unbound	23:22:14	0
2185006	99	79	71,5	cyclictest	2384539	-21	kworker/u4:8+events_unbound	00:17:22	0
2185007	99	78	41,34	cyclictest	2392605	-21	unixbench_singl	00:25:44	1
2185007	99	78	41,34	cyclictest	2392605	-21	unixbench_singl	00:25:44	1
2185006	99	76	66,6	cyclictest	2253761	-21	kworker/u4:1-rpciod	22:00:12	0
2185007	99	73	24,28	cyclictest	0	-21	swapper/1	00:35:19	1
2185006	99	72	1,67	cyclictest	0	-21	swapper/0	22:55:30	0
2185007	99	70	35,31	cyclictest	2197880	-21	latency_hist	20:00:01	1
2185006	99	70	63,5	cyclictest	2388494	-21	kworker/u4:10+events_unbound	00:32:22	0
2185006	99	70	61,5	cyclictest	2245591	-21	sshd	21:43:03	0
2185006	99	69	56,9	cyclictest	53	-21	kswapd0	00:25:10	0
2185006	99	69	56,9	cyclictest	53	-21	kswapd0	00:25:09	0
2185007	99	67	36,28	cyclictest	2235043	-21	timerwakeupswit	21:30:39	1
2185007	99	67	34,29	cyclictest	0	-21	swapper/1	21:15:25	1
2185007	99	67	34,29	cyclictest	0	-21	swapper/1	21:15:24	1
2185007	99	66	29,33	cyclictest	2372877	-21	latency_hist	00:05:01	1
2185007	99	66	24,39	cyclictest	2247175	-21	ssh	21:45:15	1
2185006	99	66	58,6	cyclictest	2325323	-21	kworker/u4:7+events_unbound	23:27:16	0
2185006	99	65	56,6	cyclictest	2267342	-21	kworker/u4:0+events_unbound	22:12:08	0
2185006	99	65	46,14	cyclictest	2343740	-21	kworker/u4:5+events_unbound	23:55:15	0
2185007	99	64	31,30	cyclictest	0	-21	swapper/1	21:20:38	1
2185007	99	64	29,32	cyclictest	2265160	-21	cpu	22:05:21	1
2185007	99	63	33,26	cyclictest	2253765	-21	kworker/u4:6-rpciod	22:10:20	1
2185007	99	63	3,16	cyclictest	2291823	-21	ssh	22:35:15	1
2185007	99	62	3,15	cyclictest	2364962	-21	ps	23:55:37	1
2185007	99	62	31,29	cyclictest	0	-21	swapper/1	22:25:33	1
2185007	99	62	31,28	cyclictest	2279412	-21	mailstats	22:20:41	1
2185007	99	62	29,29	cyclictest	0	-21	swapper/1	00:05:45	1
2185007	99	62	2,12	cyclictest	2205599	-21	apt-get	20:30:13	1
2185007	99	62	2,11	cyclictest	2378606	-21	sh	00:10:40	1
2185007	99	61	3,16	cyclictest	2396727	-21	ps	00:30:39	1
2185007	99	61	3,13	cyclictest	2359492	-21	apt-get	23:50:13	1
2185007	99	61	29,29	cyclictest	2216076	-21	aten2__	21:10:16	1
2185007	99	61	29,29	cyclictest	0	-21	swapper/1	00:20:24	1
2185007	99	61	28,30	cyclictest	2355420	-21	gltestperf	23:45:21	1
2185007	99	61	28,30	cyclictest	0	-21	swapper/1	23:20:33	1
2185007	99	61	28,29	cyclictest	0	-21	swapper/1	20:25:29	1
2185007	99	61	27,30	cyclictest	0	-21	swapper/1	22:50:20	1
2185007	99	61	25,32	cyclictest	0	-21	swapper/1	22:00:44	1
2185007	99	61	2,19	cyclictest	2346612	-21	ssh	23:35:27	1
2185007	99	61	18,38	cyclictest	2252311	-21	awk	21:50:27	1
2185007	99	61	10,47	cyclictest	2309727	-21	/usr/sbin/munin	22:55:39	1
2185006	99	61	53,5	cyclictest	2361481	-21	kworker/u4:12+events_unbound	23:52:16	0
2185006	99	61	52,6	cyclictest	2240237	-21	kworker/u4:12+events_unbound	21:37:03	0
2185007	99	60	4,8	cyclictest	2187003	-21	ntpq	19:15:28	1
2185007	99	60	27,30	cyclictest	0	-21	swapper/1	23:10:23	1
2185007	99	60	27,30	cyclictest	0	-21	swapper/1	23:00:26	1
2185007	99	60	2,14	cyclictest	2195943	-21	ntpq	19:50:27	1
2185006	99	60	5,14	cyclictest	2220550	-21	ssh	21:15:11	0
2185006	99	60	5,14	cyclictest	2220550	-21	ssh	21:15:11	0
2185007	99	59	3,7	cyclictest	2274662	-21	ssh	22:15:35	1
2185007	99	59	3,16	cyclictest	2342287	-21	ssh	23:30:37	1
2185007	99	59	27,29	cyclictest	0	-21	swapper/1	22:40:36	1
2185007	99	59	26,30	cyclictest	0	-21	swapper/1	23:05:21	1
2185006	99	59	51,5	cyclictest	2258286	-21	kworker/u4:7+events_unbound	22:17:09	0
2185007	99	58	4,8	cyclictest	2337589	-21	ssh	23:25:27	1
2185007	99	58	33,22	cyclictest	2189415	-21	gltestperf	19:25:20	1
2185007	99	58	3,12	cyclictest	2206958	-21	apt-get	20:35:22	1
2185007	99	58	26,29	cyclictest	0	-21	swapper/1	00:17:21	1
2185007	99	58	23,32	cyclictest	2208634	-21	gltestperf	20:40:18	1
2185006	99	58	3,44	cyclictest	2206706	-21	apt-get	20:35:10	0
2185007	99	57	27,27	cyclictest	0	-21	swapper/1	20:05:19	1
2185007	99	57	25,29	cyclictest	0	-21	swapper/1	19:30:39	1
2185007	99	57	23,31	cyclictest	2204152	-21	modprobe	20:25:01	1
2185007	99	57	22,31	cyclictest	0	-21	swapper/1	22:30:43	1
2185007	99	57	20,33	cyclictest	0	-21	swapper/1	23:15:29	1
2185007	99	57	19,35	cyclictest	2202630	-21	sed	20:15:38	1
2185007	99	56	4,8	cyclictest	2230312	-21	ntp_states	21:25:35	1
2185007	99	56	2,18	cyclictest	2192079	-21	ntpq	19:35:24	1
2185007	99	56	16,37	cyclictest	2256738	-21	ssh	21:55:27	1
2185006	99	56	49,5	cyclictest	2280334	-21	kworker/u4:3+events_unbound	22:29:45	0
2185006	99	56	49,5	cyclictest	2218305	-21	kworker/u4:14+events_unbound	21:27:04	0
2185006	99	56	49,5	cyclictest	2193905	-21	kworker/u4:6+events_unbound	20:01:54	0
2185007	99	55	23,29	cyclictest	0	-21	swapper/1	20:45:22	1
2185007	99	54	2,16	cyclictest	2185741	-21	ntpq	19:10:29	1
2185007	99	54	2,16	cyclictest	2185741	-21	ntpq	19:10:28	1
2185007	99	54	2,13	cyclictest	2188308	-21	ntpq	19:20:26	1
2185007	99	54	1,13	cyclictest	2239201	-21	ntpq	21:35:38	1
2185006	99	54	43,8	cyclictest	2345573	-21	cron	23:34:59	0
2185007	99	53	26,24	cyclictest	0	-21	swapper/1	20:50:36	1
2185007	99	53	23,27	cyclictest	0	-21	swapper/1	20:10:18	1
2185007	99	53	2,13	cyclictest	2303968	-21	ssh	22:48:30	1
2185007	99	53	12,6	cyclictest	27	1	ktimers/1	20:00:13	1
2185006	99	53	42,9	cyclictest	2214817	-21	df_abs	21:05:16	0
2185007	99	52	23,26	cyclictest	0	-21	swapper/1	21:00:37	1
2185007	99	52	22,27	cyclictest	0	-21	swapper/1	20:55:33	1
2185006	99	52	45,5	cyclictest	2234150	-21	/usr/sbin/munin	21:30:19	0
2185007	99	51	19,27	cyclictest	0	-21	swapper/1	19:10:01	1
2185006	99	51	43,5	cyclictest	2206844	-21	latency_hist	20:35:03	0
2185006	99	51	43,5	cyclictest	0	-21	swapper/0	23:45:13	0
2185007	99	50	8,38	cyclictest	2215743	-21	munin-run	21:10:01	1
2185006	99	50	42,5	cyclictest	2377952	-21	fschecks_count	00:10:21	0
2185006	99	50	41,6	cyclictest	0	-21	swapper/0	21:20:15	0
2185006	99	50	40,7	cyclictest	2377389	-21	latency_hist	00:10:00	0
2185006	99	50	39,8	cyclictest	2258287	-21	kworker/u4:9+events_unbound	22:07:08	0
2185006	99	50	36,10	cyclictest	2300851	-21	basename	22:45:17	0
2185006	99	50	2,35	cyclictest	2252243	-21	ssh	21:50:24	0
2185006	99	50	12,18	cyclictest	2387660	-21	ssh	00:20:38	0
2185007	99	49	21,25	cyclictest	0	-21	swapper/1	19:45:25	1
2185007	99	49	21,25	cyclictest	0	-21	swapper/1	19:45:25	1
2185006	99	49	41,6	cyclictest	2209815	-21	fschecks_time	20:45:22	0
2185007	99	48	2,12	cyclictest	2193056	-21	df_inode	19:40:19	1
2185006	99	48	41,5	cyclictest	2312261	-21	kworker/u4:15+events_unbound	23:17:15	0
2185006	99	48	40,6	cyclictest	2226747	-21	kworker/u4:4+events_unbound	21:45:02	0
2185006	99	48	39,5	cyclictest	2322960	-21	munin-run	23:10:00	0
2185006	99	47	39,4	cyclictest	2211104	-21	fschecks_time	20:50:17	0
2185006	99	47	34,8	cyclictest	0	-21	swapper/0	22:30:31	0
2185006	99	47	29,16	cyclictest	2171364	-21	kworker/u4:12+rpciod	21:02:01	0
2185006	99	46	40,4	cyclictest	2256887	-21	ldconfig	21:55:35	0
2185006	99	46	2,21	cyclictest	2282503	-21	ssh	22:25:00	0
2185006	99	45	38,5	cyclictest	2191339	-21	kworker/u4:17+events_unbound	19:35:04	0
2185006	99	45	37,6	cyclictest	2201799	-21	aten_r7power_cu	20:15:17	0
2185006	99	45	37,5	cyclictest	2196890	-21	sort	19:55:19	0
2185006	99	45	34,7	cyclictest	0	-21	swapper/0	23:35:18	0
2185006	99	45	24,6	cyclictest	2289445	-21	kworker/u4:14-rpciod	22:35:17	0
2185006	99	44	37,5	cyclictest	2400552	-21	ssh	00:35:19	0
2185006	99	44	37,5	cyclictest	2300604	-21	latency_hist	22:45:02	0
2185006	99	44	34,7	cyclictest	0	-21	swapper/0	20:40:14	0
2185006	99	43	35,6	cyclictest	2217039	-21	sendmail_mailqu	21:10:37	0
2185006	99	43	35,6	cyclictest	2195409	-21	aten2__	19:50:15	0
2185006	99	43	35,5	cyclictest	2212298	-21	fschecks_count	20:55:17	0
2185006	99	42	35,4	cyclictest	0	-21	swapper/0	20:20:22	0
2185006	99	42	34,5	cyclictest	0	-21	swapper/0	20:25:28	0
2185006	99	41	33,5	cyclictest	2194808	-21	grep	19:45:36	0
2185006	99	41	33,5	cyclictest	2194808	-21	grep	19:45:35	0
2185006	99	41	33,5	cyclictest	2185005	-21	cyclictest	00:00:36	0
2185006	99	41	32,6	cyclictest	0	-21	swapper/0	19:26:42	0
2185006	99	41	32,5	cyclictest	0	-21	swapper/0	22:50:32	0
2185006	99	41	31,8	cyclictest	2188551	-21	switchtime	19:20:37	0
2185006	99	41	25,10	cyclictest	2193933	-21	modprobe	19:45:00	0
2185006	99	40	32,5	cyclictest	0	-21	swapper/0	23:10:17	0
2185006	99	40	31,6	cyclictest	0	-21	swapper/0	19:30:20	0
2185006	99	40	30,7	cyclictest	0	-21	swapper/0	20:15:01	0
2185006	99	40	18,18	cyclictest	0	-21	swapper/0	20:10:00	0
2185006	99	38	31,5	cyclictest	2183725	-21	kworker/u4:1+rpciod	19:10:01	0
2185006	99	38	30,5	cyclictest	0	-21	swapper/0	19:10:34	0
2185006	99	38	30,5	cyclictest	0	-21	swapper/0	19:10:33	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17