OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Fri May 02, 2025 00:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
59198	99	79	32,17	cyclictest	54	-21	kswapd0	00:35:08	0
59198	99	70	56,7	cyclictest	54	-21	kswapd0	22:00:12	0
59198	99	63	52,9	cyclictest	54	-21	kswapd0	00:20:21	0
59200	99	62	52,7	cyclictest	0	-21	swapper/1	00:05:30	1
59198	99	62	49,6	cyclictest	49335	-21	kworker/u4:6+events_unbound	19:50:00	0
59198	99	61	36,20	cyclictest	54	-21	kswapd0	22:10:11	0
59200	99	60	52,6	cyclictest	59195	-21	cyclictest	22:25:10	1
59200	99	60	52,6	cyclictest	59195	-21	cyclictest	22:25:09	1
59200	99	60	52,5	cyclictest	0	-21	swapper/1	21:20:35	1
59200	99	60	52,5	cyclictest	0	-21	swapper/1	21:20:35	1
59198	99	60	50,6	cyclictest	89605	-21	diskmemload	21:30:40	0
59200	99	59	46,6	cyclictest	175168	-21	kworker/u4:4+events_unbound	23:02:59	1
59198	99	59	43,6	cyclictest	127634	-21	kworker/u4:6+events_unbound	21:58:59	0
59200	99	57	48,7	cyclictest	61177	-21	ntpq	19:15:29	1
59200	99	56	38,13	cyclictest	54	-21	kswapd0	22:00:09	1
59198	99	56	43,4	cyclictest	139624	-21	kworker/u4:1+events_unbound	22:31:10	0
59198	99	55	47,6	cyclictest	190002	-21	/usr/sbin/munin	23:15:44	0
59198	99	55	47,5	cyclictest	75667	-21	kworker/u4:3+events_unbound	20:55:00	0
59200	99	54	45,6	cyclictest	0	-21	swapper/1	23:35:35	1
59200	99	54	42,9	cyclictest	54	-21	kswapd0	00:35:10	1
59198	99	54	46,5	cyclictest	0	-21	swapper/0	23:35:39	0
59198	99	54	23,17	cyclictest	17	1	rcu_preempt	23:48:32	0
59200	99	53	48,3	cyclictest	27	1	ktimers/1	21:26:59	1
59198	99	53	46,5	cyclictest	237047	-21	kworker/u4:12+events_unbound	00:29:59	0
59198	99	53	38,6	cyclictest	171208	-21	kworker/u4:1+events_unbound	22:53:11	0
59200	99	52	44,6	cyclictest	242602	-21	gltestperf	00:25:21	1
59200	99	52	42,7	cyclictest	0	-21	swapper/1	22:35:14	1
59198	99	52	46,4	cyclictest	182494	-21	kworker/u4:9+events_unbound	23:07:10	0
59198	99	52	45,5	cyclictest	107942	-21	kworker/u4:12+events_unbound	21:43:59	0
59198	99	52	44,6	cyclictest	121527	-21	latency_hist	21:50:00	0
59200	99	51	18,18	cyclictest	0	-21	swapper/1	22:15:34	1
59198	99	51	42,7	cyclictest	161852	-21	/usr/sbin/munin	22:40:22	0
59198	99	51	40,5	cyclictest	74411	-21	kworker/u4:0+events_unbound	20:58:59	0
59200	99	50	38,8	cyclictest	67145	-21	sed	19:40:24	1
59200	99	50	17,18	cyclictest	0	-21	swapper/1	23:15:29	1
59200	99	50	16,21	cyclictest	0	-21	swapper/1	22:45:01	1
59198	99	50	43,5	cyclictest	49335	-21	kworker/u4:6+events_unbound	21:10:58	0
59198	99	50	43,5	cyclictest	49335	-21	kworker/u4:6+events_unbound	19:35:59	0
59198	99	50	42,5	cyclictest	68014	-21	kworker/u4:9+events_unbound	20:02:59	0
59198	99	50	31,17	cyclictest	184935	-21	aten_r7power_vo	23:10:18	0
59198	99	50	31,17	cyclictest	184935	-21	aten_r7power_vo	23:10:18	0
59200	99	49	41,6	cyclictest	66504	-21	threads	19:35:36	1
59200	99	49	41,6	cyclictest	212571	-21	gltestperf	23:45:26	1
59200	99	49	39,7	cyclictest	0	-21	swapper/1	00:15:14	1
59200	99	49	39,7	cyclictest	0	-21	swapper/1	00:15:14	1
59200	99	49	37,7	cyclictest	208323	-21	aten2__	23:40:17	1
59200	99	49	35,6	cyclictest	65475	-21	kworker/u4:5+events_unbound	20:14:59	1
59198	99	49	5,14	cyclictest	15	1	ktimers/0	00:35:01	0
59198	99	49	42,5	cyclictest	78218	-21	kworker/u4:13+events_unbound	21:00:02	0
59198	99	49	42,5	cyclictest	179092	-21	kworker/u4:6+events_unbound	23:04:10	0
59200	99	48	43,3	cyclictest	139623	-21	kworker/u4:0+events_unbound	22:15:01	1
59200	99	48	41,5	cyclictest	232048	-21	/usr/sbin/munin	00:10:25	1
59200	99	48	41,5	cyclictest	224849	-21	unixbench-2d	00:00:40	1
59200	99	48	40,6	cyclictest	95165	-21	unixbench_singl	21:15:41	1
59200	99	48	40,5	cyclictest	126850	-21	timerwakeupswit	21:55:41	1
59200	99	48	38,7	cyclictest	196623	-21	aten_r7power_po	23:25:17	1
59200	99	48	37,8	cyclictest	133674	-21	ssh	22:05:15	1
59200	99	48	32,12	cyclictest	0	-21	swapper/1	23:10:30	1
59200	99	48	32,12	cyclictest	0	-21	swapper/1	23:10:30	1
59198	99	48	41,5	cyclictest	78218	-21	kworker/u4:13+events_unbound	20:28:59	0
59198	99	48	39,6	cyclictest	208760	-21	sh	23:40:21	0
59198	99	48	38,7	cyclictest	146490	-21	processes	22:20:44	0
59198	99	48	36,8	cyclictest	220510	-21	ntp_kernel_pll_	23:55:28	0
59198	99	48	33,6	cyclictest	107943	-21	kworker/u4:13+events_unbound	21:54:37	0
59198	99	48	27,5	cyclictest	107937	-21	kworker/u4:6+events_unbound	21:36:22	0
59200	99	47	39,6	cyclictest	50619	-21	kworker/u4:1+events_unbound	19:31:00	1
59200	99	47	39,5	cyclictest	170501	-21	unixbench_singl	22:50:43	1
59200	99	47	39,5	cyclictest	149182	-21	sh	22:25:00	1
59200	99	47	14,17	cyclictest	0	-21	swapper/1	23:50:34	1
59198	99	47	9,35	cyclictest	15	1	ktimers/0	00:05:34	0
59198	99	47	41,4	cyclictest	127636	-21	kworker/u4:9+events_unbound	22:06:00	0
59198	99	47	40,5	cyclictest	155714	-21	kworker/u4:0+events_unbound	22:48:58	0
59198	99	47	39,5	cyclictest	98313	-21	grep	21:20:26	0
59198	99	47	39,5	cyclictest	98313	-21	grep	21:20:26	0
59198	99	47	38,6	cyclictest	225327	-21	ssh	00:01:22	0
59198	99	47	36,8	cyclictest	231613	-21	cpu	00:10:18	0
59198	99	47	33,4	cyclictest	202324	-21	kworker/u4:6+events_unbound	23:34:00	0
59198	99	47	27,18	cyclictest	0	-21	swapper/0	22:55:31	0
59200	99	46	39,5	cyclictest	83490	-21	aten2__	20:45:20	1
59200	99	46	39,5	cyclictest	83490	-21	aten2__	20:45:20	1
59200	99	46	39,5	cyclictest	78219	-21	kworker/u4:15+events_unbound	20:54:00	1
59200	99	46	39,5	cyclictest	60213	-21	timerandwakeup	19:10:39	1
59200	99	46	39,5	cyclictest	229809	-21	kworker/u4:11+events_unbound	00:23:09	1
59200	99	46	39,5	cyclictest	181079	-21	aten_r7power_vo	23:05:19	1
59200	99	46	39,5	cyclictest	113994	-21	aten_r7power_po	21:40:20	1
59200	99	46	37,6	cyclictest	89593	-21	modprobe	21:10:00	1
59200	99	46	36,8	cyclictest	121784	-21	/usr/sbin/munin	21:50:24	1
59200	99	46	36,6	cyclictest	220116	-21	fschecks_count	23:55:20	1
59200	99	46	15,16	cyclictest	27	1	ktimers/1	23:22:24	1
59198	99	46	40,4	cyclictest	196810	-21	fschecks_count	23:25:20	0
59198	99	46	39,5	cyclictest	142214	-21	diskmemload	22:15:27	0
59198	99	46	38,6	cyclictest	54	-21	kswapd0	00:15:20	0
59198	99	46	38,6	cyclictest	54	-21	kswapd0	00:15:20	0
59198	99	46	38,5	cyclictest	103169	-21	who	21:25:44	0
59198	99	46	37,7	cyclictest	67303	-21	gltestperf	19:40:27	0
59198	99	46	24,19	cyclictest	0	-21	swapper/0	19:10:37	0
59200	99	45	37,5	cyclictest	93742	-21	ls	21:15:01	1
59200	99	45	36,6	cyclictest	45482	-21	kworker/u4:10-rpciod	20:20:01	1
59198	99	45	38,5	cyclictest	71874	-21	kworker/u4:2-xprtiod	20:00:01	0
59198	99	45	37,6	cyclictest	149879	-21	grep	22:25:25	0
59198	99	45	37,6	cyclictest	149879	-21	grep	22:25:25	0
59198	99	45	36,7	cyclictest	69854	-21	gltestperf	19:50:22	0
59198	99	45	36,7	cyclictest	216146	-21	aten_r7power_po	23:50:22	0
59198	99	45	35,5	cyclictest	62961	-21	kworker/u4:4+events_unbound	19:24:38	0
59198	99	45	33,6	cyclictest	50619	-21	kworker/u4:1+events_unbound	19:30:58	0
59200	99	44	37,5	cyclictest	76924	-21	kworker/u4:11+events_unbound	20:40:11	1
59200	99	44	37,5	cyclictest	106162	-21	fschecks_count	21:30:25	1
59200	99	44	36,5	cyclictest	78219	-21	kworker/u4:15-nfsiod	20:35:01	1
59200	99	44	36,5	cyclictest	245633	-21	sed	00:30:18	1
59200	99	44	36,5	cyclictest	121572	-21	latency_hist	21:50:01	1
59200	99	44	36,5	cyclictest	0	-21	swapper/1	21:00:01	1
59200	99	44	35,7	cyclictest	200511	-21	aten2__	23:30:18	1
59200	99	44	35,6	cyclictest	174051	-21	ssh	22:55:41	1
59200	99	44	34,8	cyclictest	157202	-21	latency_hist	22:35:01	1
59200	99	44	34,7	cyclictest	0	-21	swapper/1	20:20:39	1
59200	99	44	32,10	cyclictest	45482	-21	kworker/u4:10-rpciod	19:45:25	1
59200	99	44	14,17	cyclictest	27	1	ktimers/1	21:00:29	1
59198	99	44	38,4	cyclictest	193455	-21	ssh	23:20:34	0
59198	99	44	37,5	cyclictest	82027	-21	munin-plugin-st	20:40:02	0
59198	99	44	37,5	cyclictest	59195	-21	cyclictest	21:15:19	0
59198	99	44	36,6	cyclictest	49335	-21	kworker/u4:6+events_unbound	21:07:59	0
59198	99	44	35,7	cyclictest	73712	-21	gltestperf	20:05:23	0
59198	99	44	34,6	cyclictest	83283	-21	kworker/u4:9	20:45:00	0
59198	99	44	32,8	cyclictest	0	-21	swapper/0	19:25:34	0
59200	99	43	36,5	cyclictest	73542	-21	sed	20:05:20	1
59200	99	43	28,5	cyclictest	45482	-21	kworker/u4:10+events_unbound	19:52:06	1
59198	99	43	36,5	cyclictest	75376	-21	cat	20:10:40	0
59198	99	43	34,7	cyclictest	76885	-21	unixbench_singl	20:15:44	0
59198	99	43	34,7	cyclictest	157526	-21	aten_r7power_vo	22:35:19	0
59198	99	43	33,8	cyclictest	77266	-21	aten_r7power_po	20:20:20	0
59198	99	43	14,5	cyclictest	17	1	rcu_preempt	19:15:32	0
59200	99	42	36,4	cyclictest	63644	-21	kernelversion	19:25:22	1
59200	99	42	36,4	cyclictest	103899	-21	kworker/u4:2-nfsiod	21:35:26	1
59200	99	42	33,7	cyclictest	62863	-21	unixbench_multi	19:20:39	1
59200	99	42	17,14	cyclictest	27	1	ktimers/1	22:49:35	1
59198	99	42	35,5	cyclictest	78218	-21	kworker/u4:13+events_unbound	20:33:58	0
59200	99	41	32,6	cyclictest	70870	-21	aten_r7power_en	19:55:23	1
59200	99	41	31,7	cyclictest	0	-21	swapper/1	20:25:24	1
59198	99	41	33,5	cyclictest	84566	-21	idleruntime-cro	20:50:00	0
59198	99	41	33,5	cyclictest	84566	-21	idleruntime-cro	20:50:00	0
59200	99	40	33,5	cyclictest	73187	-21	sh	20:05:00	1
59200	99	39	28,9	cyclictest	0	-21	swapper/1	20:35:16	1
59198	99	38	7,19	cyclictest	59195	-21	cyclictest	19:10:00	0
59200	99	36	29,5	cyclictest	59263	-21	cat	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17