OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #5, slot #3

x86 Intel Xeon i3-1578L v5 @2000 MHz, Linux 4.19.246-rt110 (Profile)

Latency plot of system in rack #5, slot #3

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack5slot3.osadl.org (updated Sun Jun 26, 2022 00:49:57)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
23290	99	37	34,2	cyclictest	1343	-21	cc1	00:12:12	6
23285	99	32	23,8	cyclictest	25065	-21	make	00:10:33	1
23289	99	30	26,2	cyclictest	0	-21	swapper/5	22:19:41	5
23289	99	30	21,6	cyclictest	556	-21	make	00:08:35	5
23289	99	30	21,6	cyclictest	556	-21	make	00:08:34	5
23284	99	29	3,19	cyclictest	14960	-21	cc1	00:09:52	0
23284	99	29	3,19	cyclictest	14960	-21	cc1	00:09:51	0
23288	99	28	24,3	cyclictest	2760	-21	make	00:27:11	4
23287	99	28	10,18	cyclictest	0	-21	swapper/3	00:07:48	3
23287	99	28	10,18	cyclictest	0	-21	swapper/3	00:07:47	3
23287	99	28	0,23	cyclictest	25834	-21	cc1	00:25:29	3
23285	99	28	0,27	cyclictest	12200	-21	cc1	00:34:17	1
23285	99	28	0,10	cyclictest	30094	-21	cc1	00:26:13	1
23285	99	27	1,25	cyclictest	20941	-21	cc1	00:20:10	1
23285	99	27	0,9	cyclictest	0	-21	swapper/1	00:16:06	1
23285	99	27	0,26	cyclictest	30296	-21	cc1	00:07:46	1
23285	99	27	0,26	cyclictest	30296	-21	cc1	00:07:46	1
23287	99	26	4,18	cyclictest	12	1	rcu_preempt	00:16:07	3
23285	99	26	24,2	cyclictest	0	-21	swapper/1	22:20:27	1
23284	99	26	18,7	cyclictest	15796	-21	cc1	00:24:11	0
23284	99	26	1,2	cyclictest	14092	-21	cc1	00:14:06	0
23291	99	24	18,5	cyclictest	7761	-21	as	00:28:04	7
23289	99	24	0,3	cyclictest	31902	-21	cc1	00:32:15	5
23287	99	24	0,21	cyclictest	4356	-21	objtool	00:22:27	3
23291	99	23	11,8	cyclictest	32266	-21	cc1	00:16:37	7
23290	99	23	23,0	cyclictest	0	-21	swapper/6	00:36:03	6
23290	99	23	1,20	cyclictest	11210	-21	cc1	00:28:47	6
23289	99	23	1,20	cyclictest	8826	-21	cc1	00:18:10	5
23289	99	23	0,19	cyclictest	18346	-21	cc1	00:10:13	5
23285	99	23	11,10	cyclictest	12	1	rcu_preempt	22:57:13	1
23284	99	23	16,6	cyclictest	30735	-21	make	00:32:10	0
23284	99	23	0,1	cyclictest	0	-21	swapper/0	00:36:10	0
23291	99	22	1,2	cyclictest	18809	-21	cc1	00:34:52	7
23290	99	22	3,18	cyclictest	20749	-21	cc1	00:15:01	6
23289	99	22	1,19	cyclictest	27005	-21	cc1	00:25:39	5
23289	99	22	0,21	cyclictest	24981	-21	objtool	00:20:28	5
23289	99	22	0,20	cyclictest	31378	-21	cc1	00:35:49	5
23288	99	22	19,2	cyclictest	10663	-21	kworker/u16:4	00:30:16	4
23288	99	22	0,15	cyclictest	6833	-21	ssh	00:13:06	4
23287	99	22	1,3	cyclictest	21344	-21	cc1	00:35:04	3
23287	99	22	1,19	cyclictest	18748	-21	cc1	00:30:12	3
23286	99	22	18,3	cyclictest	3370	-21	as	00:32:50	2
23286	99	22	1,3	cyclictest	15264	-21	cc1	00:24:03	2
23286	99	22	0,3	cyclictest	9915	-21	cc1	00:18:22	2
23286	99	22	0,2	cyclictest	26684	-21	cc1	00:25:37	2
23285	99	22	10,9	cyclictest	12	1	rcu_preempt	21:16:03	1
23285	99	22	10,8	cyclictest	12	1	rcu_preempt	23:20:33	1
23285	99	22	10,10	cyclictest	12	1	rcu_preempt	21:25:25	1
23285	99	22	10,10	cyclictest	12	1	rcu_preempt	21:23:06	1
23284	99	22	16,5	cyclictest	29534	-21	cc1	00:26:08	0
23284	99	22	0,20	cyclictest	17644	-21	cc1	00:19:40	0
23291	99	21	17,3	cyclictest	28534	-21	cc1	00:35:32	7
23291	99	21	1,19	cyclictest	4824	-21	cc1	00:08:51	7
23291	99	21	1,19	cyclictest	4824	-21	cc1	00:08:50	7
23291	99	21	0,3	cyclictest	3388	-21	cc1	00:22:19	7
23291	99	21	0,3	cyclictest	17240	-21	cc1	00:10:05	7
23290	99	21	17,3	cyclictest	22671	-21	cc1	00:20:16	6
23290	99	21	0,19	cyclictest	18045	-21	cc1	00:34:49	6
23287	99	21	0,20	cyclictest	20509	-21	cc1	00:10:20	3
23286	99	21	16,4	cyclictest	28837	-21	cc1	00:11:29	2
23286	99	21	0,3	cyclictest	31231	-21	sh	00:35:48	2
23285	99	21	16,5	cyclictest	12	1	rcu_preempt	22:35:24	1
23285	99	21	11,7	cyclictest	12	1	rcu_preempt	23:41:40	1
23285	99	21	11,7	cyclictest	12	1	rcu_preempt	22:41:06	1
23285	99	21	11,7	cyclictest	12	1	rcu_preempt	19:40:15	1
23285	99	21	10,9	cyclictest	12	1	rcu_preempt	23:50:21	1
23285	99	21	10,8	cyclictest	25295	-21	ssh	22:10:55	1
23285	99	21	10,8	cyclictest	12	1	rcu_preempt	23:55:17	1
23285	99	21	10,8	cyclictest	12	1	rcu_preempt	22:31:48	1
23285	99	21	10,8	cyclictest	12	1	rcu_preempt	00:01:18	1
23285	99	21	10,6	cyclictest	12	1	rcu_preempt	22:49:23	1
23285	99	21	0,19	cyclictest	24125	-21	make	00:35:17	1
23290	99	20	17,2	cyclictest	30419	-21	cc1	00:07:46	6
23290	99	20	17,2	cyclictest	30419	-21	cc1	00:07:46	6
23288	99	20	1,2	cyclictest	30478	-21	cc1	00:07:46	4
23288	99	20	1,2	cyclictest	30478	-21	cc1	00:07:46	4
23288	99	20	1,2	cyclictest	22416	-21	cc1	00:20:16	4
23288	99	20	0,19	cyclictest	25570	-21	cc1	00:15:25	4
23288	99	20	0,19	cyclictest	0	-21	swapper/4	00:35:06	4
23286	99	20	17,2	cyclictest	0	-21	swapper/2	00:07:40	2
23286	99	20	17,2	cyclictest	0	-21	swapper/2	00:07:39	2
23285	99	20	15,3	cyclictest	12	1	rcu_preempt	21:10:18	1
23285	99	20	12,6	cyclictest	12	1	rcu_preempt	21:32:30	1
23285	99	20	12,6	cyclictest	12	1	rcu_preempt	20:00:16	1
23285	99	20	11,6	cyclictest	13	1	rcu_sched	19:25:12	1
23285	99	20	11,6	cyclictest	12	1	rcu_preempt	23:30:22	1
23285	99	20	11,6	cyclictest	12	1	rcu_preempt	22:17:00	1
23285	99	20	11,6	cyclictest	12	1	rcu_preempt	21:45:10	1
23285	99	20	11,6	cyclictest	12	1	rcu_preempt	21:39:47	1
23285	99	20	10,8	cyclictest	12	1	rcu_preempt	23:25:13	1
23285	99	20	10,8	cyclictest	12	1	rcu_preempt	21:55:22	1
23285	99	20	10,7	cyclictest	12	1	rcu_preempt	22:00:16	1
23285	99	20	10,7	cyclictest	12	1	rcu_preempt	22:00:16	1
23285	99	20	10,7	cyclictest	12	1	rcu_preempt	21:41:52	1
23285	99	20	10,6	cyclictest	12	1	rcu_preempt	22:53:23	1
23285	99	20	10,6	cyclictest	12	1	rcu_preempt	22:09:11	1
23288	99	19	17,2	cyclictest	0	-21	swapper/4	23:49:54	4
23288	99	19	17,1	cyclictest	668	-21	nscd	20:23:27	4
23288	99	19	16,3	cyclictest	762	-21	gmain	22:32:23	4
23287	99	19	0,18	cyclictest	30648	-21	dump-pmu-power	23:15:00	3
23287	99	19	0,1	cyclictest	31501	-21	turbostat	19:25:01	3
23286	99	19	17,2	cyclictest	0	-21	swapper/2	22:09:44	2
23285	99	19	12,5	cyclictest	12	1	rcu_preempt	20:50:20	1
23285	99	19	11,6	cyclictest	12	1	rcu_preempt	23:36:09	1
23285	99	19	11,6	cyclictest	12	1	rcu_preempt	23:15:12	1
23285	99	19	11,6	cyclictest	12	1	rcu_preempt	22:25:16	1
23285	99	19	11,6	cyclictest	12	1	rcu_preempt	20:45:14	1
23285	99	19	11,6	cyclictest	12	1	rcu_preempt	20:40:15	1
23285	99	19	11,6	cyclictest	12	1	rcu_preempt	19:55:12	1
23285	99	19	11,6	cyclictest	12	1	rcu_preempt	19:50:13	1
23285	99	19	10,8	cyclictest	0	-21	swapper/1	21:00:11	1
23285	99	19	10,7	cyclictest	12	1	rcu_preempt	23:45:06	1
23285	99	19	10,7	cyclictest	12	1	rcu_preempt	20:35:15	1
23285	99	19	10,7	cyclictest	12	1	rcu_preempt	19:35:16	1
23285	99	19	10,7	cyclictest	12	1	rcu_preempt	19:30:10	1
23285	99	19	10,6	cyclictest	13	1	rcu_sched	20:20:16	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	23:10:11	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	23:05:13	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	23:00:13	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	21:05:11	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	20:55:16	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	20:30:14	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	20:25:19	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	20:05:12	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	19:45:21	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	19:15:11	1
23285	99	19	10,6	cyclictest	12	1	rcu_preempt	19:10:12	1
23285	99	19	10,6	cyclictest	0	-21	swapper/1	21:50:10	1
23291	99	18	15,0	cyclictest	29909	-21	apt-get	22:15:01	7
23290	99	18	16,1	cyclictest	6806	-21	ls	19:40:00	6
23289	99	18	18,0	cyclictest	719	50	irq/125-eth0	23:16:11	5
23289	99	18	16,1	cyclictest	17222	-21	uptime	23:45:22	5
23287	99	18	13,2	cyclictest	1690	-21	sendmail-mta	22:43:03	3
23285	99	18	10,6	cyclictest	12	1	rcu_preempt	20:15:11	1
23285	99	18	10,6	cyclictest	12	1	rcu_preempt	20:10:12	1
23285	99	18	10,6	cyclictest	12	1	rcu_preempt	19:20:11	1
23284	99	18	10,7	cyclictest	668	-21	nscd	21:19:57	0
23284	99	18	10,7	cyclictest	29603	-21	bash	23:53:19	0
23284	99	18	10,7	cyclictest	11459	-21	ssh	21:23:34	0
23284	99	18	10,7	cyclictest	0	-21	swapper/0	23:40:22	0
23284	99	18	10,7	cyclictest	0	-21	swapper/0	22:36:45	0
23290	99	17	10,1	cyclictest	24201	-21	sh	22:50:14	6
23288	99	17	16,0	cyclictest	32572	-21	ls	22:55:16	4
23288	99	17	13,3	cyclictest	668	-21	nscd	23:00:28	4
23288	99	17	10,6	cyclictest	0	-21	swapper/4	22:28:39	4
23288	99	17	0,1	cyclictest	0	-21	swapper/4	21:40:00	4
23284	99	17	11,5	cyclictest	23282	-21	cyclictest	23:31:06	0
23284	99	17	10,6	cyclictest	7601	-21	ssh	23:55:54	0
23284	99	17	10,6	cyclictest	663	-21	ptp4l	23:05:07	0
23284	99	17	10,6	cyclictest	5917	-21	sh	23:39:43	0
23284	99	17	10,6	cyclictest	4143	-21	ssh	23:18:03	0
23284	99	17	10,6	cyclictest	32138	-21	sed	21:55:20	0
23284	99	17	10,6	cyclictest	29908	-21	latency_hist	22:15:02	0
23284	99	17	10,6	cyclictest	24037	-21	grep	21:50:20	0
23284	99	17	10,6	cyclictest	2193	-21	ssh	22:56:18	0
23284	99	17	10,6	cyclictest	21732	-21	sh	22:09:59	0
23284	99	17	10,6	cyclictest	21001	-21	diskmemload	23:24:45	0
23284	99	17	10,6	cyclictest	21001	-21	diskmemload	23:12:17	0
23284	99	17	10,6	cyclictest	21001	-21	diskmemload	22:30:56	0
23284	99	17	10,6	cyclictest	21001	-21	diskmemload	21:36:22	0
23284	99	17	10,6	cyclictest	19701	-21	nscd	22:00:44	0
23284	99	17	10,6	cyclictest	19701	-21	nscd	22:00:44	0
23284	99	17	10,6	cyclictest	17784	-21	sh	23:25:53	0
23284	99	17	10,6	cyclictest	16984	-21	rm	23:45:21	0
23284	99	17	10,6	cyclictest	16706	-21	ssh	22:45:20	0
23284	99	17	10,6	cyclictest	0	-21	swapper/0	22:40:13	0
23284	99	17	10,6	cyclictest	0	-21	swapper/0	21:45:10	0
23291	99	16	15,1	cyclictest	899	-21	nscd	23:15:23	7
23291	99	16	15,1	cyclictest	663	-21	ptp4l	23:49:26	7
23291	99	16	10,4	cyclictest	0	-21	swapper/7	23:32:34	7
23290	99	16	15,1	cyclictest	28457	-21	patch	23:52:39	6
23290	99	16	14,1	cyclictest	29638	-21	sh	21:55:01	6
23290	99	16	10,5	cyclictest	0	-21	swapper/6	22:30:04	6
23290	99	16	10,5	cyclictest	0	-21	swapper/6	22:18:57	6
23289	99	16	16,0	cyclictest	719	50	irq/125-eth0	21:13:42	5
23289	99	16	14,1	cyclictest	19689	-21	dump-pmu-power	20:05:00	5
23289	99	16	10,0	cyclictest	0	-21	swapper/5	22:50:22	5
23288	99	16	14,1	cyclictest	0	-21	swapper/4	22:00:00	4
23288	99	16	10,3	cyclictest	0	-21	swapper/4	23:40:43	4
23286	99	16	15,1	cyclictest	21047	-21	ssh	22:29:07	2
23286	99	16	15,1	cyclictest	13036	-21	ssh	23:23:49	2
23286	99	16	10,6	cyclictest	0	-21	swapper/2	23:11:23	2
23284	99	16	14,1	cyclictest	15842	-21	munin-plugin-st	21:00:00	0
23284	99	16	11,4	cyclictest	668	-21	nscd	20:35:14	0
23284	99	16	10,5	cyclictest	9824	-21	ssh	23:00:50	0
23284	99	16	10,5	cyclictest	668	-21	nscd	22:50:23	0
23284	99	16	10,5	cyclictest	663	-21	ptp4l	20:41:33	0
23284	99	16	10,5	cyclictest	3576	-21	ssh	22:18:00	0
23284	99	16	10,5	cyclictest	28729	-21	ls	19:15:20	0
23284	99	16	10,5	cyclictest	17120	-21	ssh	22:25:36	0
23284	99	16	10,5	cyclictest	16776	-21	rm	00:01:39	0
23284	99	16	10,5	cyclictest	16492	-21	cstates	21:00:11	0
23284	99	16	10,5	cyclictest	0	-21	swapper/0	22:23:09	0
23284	99	16	10,5	cyclictest	0	-21	swapper/0	21:41:01	0
23284	99	16	10,5	cyclictest	0	-21	swapper/0	21:32:52	0
23284	99	16	10,5	cyclictest	0	-21	swapper/0	21:10:19	0
23284	99	16	10,3	cyclictest	17202	-21	perf	20:00:00	0
23291	99	15	15,0	cyclictest	11104	-21	nscd	21:25:49	7
23291	99	15	14,1	cyclictest	918	-21	ssh	21:36:15	7
23291	99	15	14,1	cyclictest	11219	-21	ssh	23:42:14	7
23290	99	15	15,0	cyclictest	10692	-1	kworker/u17:1	21:45:39	6
23290	99	15	10,5	cyclictest	0	-21	swapper/6	23:22:09	6
23290	99	15	10,5	cyclictest	0	-21	swapper/6	23:09:03	6
23290	99	15	10,5	cyclictest	0	-21	swapper/6	22:41:21	6
23290	99	15	10,5	cyclictest	0	-21	swapper/6	22:14:05	6
23290	99	15	10,5	cyclictest	0	-21	swapper/6	22:05:14	6
23290	99	15	10,5	cyclictest	0	-21	swapper/6	21:44:42	6
23290	99	15	10,5	cyclictest	0	-21	swapper/6	21:23:03	6
23290	99	15	10,4	cyclictest	0	-21	swapper/6	22:48:51	6
23290	99	15	10,1	cyclictest	0	-21	swapper/6	22:35:11	6
23289	99	15	13,2	cyclictest	719	50	irq/125-eth0	23:12:25	5
23289	99	15	13,1	cyclictest	20993	-21	sh	21:10:00	5
23289	99	15	10,5	cyclictest	0	-21	swapper/5	23:30:16	5
23289	99	15	10,3	cyclictest	0	-21	swapper/5	21:39:19	5
23289	99	15	10,0	cyclictest	0	-21	swapper/5	23:26:06	5
23289	99	15	0,14	cyclictest	0	-21	swapper/5	22:20:20	5
23288	99	15	14,1	cyclictest	28755	-21	ssh	21:14:36	4
23288	99	15	14,1	cyclictest	0	-21	swapper/4	19:20:00	4
23288	99	15	13,0	cyclictest	165	50	irq/126-ahci[00	23:51:12	4
23288	99	15	10,5	cyclictest	0	-21	swapper/4	23:36:02	4
23288	99	15	10,0	cyclictest	0	-21	swapper/4	22:53:10	4
23288	99	15	10,0	cyclictest	0	-21	swapper/4	22:41:38	4
23288	99	15	10,0	cyclictest	0	-21	swapper/4	22:15:20	4
23288	99	15	10,0	cyclictest	0	-21	swapper/4	21:40:11	4
23287	99	15	10,5	cyclictest	0	-21	swapper/3	21:23:09	3
23287	99	15	10,4	cyclictest	0	-21	swapper/3	23:45:24	3
23286	99	15	15,0	cyclictest	2864	-21	rm	23:16:55	2
23286	99	15	15,0	cyclictest	25474	-21	kworker/u16:3	23:07:00	2
23286	99	15	15,0	cyclictest	12451	-21	strings	20:50:17	2
23286	99	15	14,1	cyclictest	29183	-21	ssh	23:33:48	2
23286	99	15	14,1	cyclictest	27356	-21	ssh	21:53:00	2
23286	99	15	14,1	cyclictest	21001	-21	diskmemload	22:45:57	2
23286	99	15	10,5	cyclictest	0	-21	swapper/2	23:36:05	2
23286	99	15	10,5	cyclictest	0	-21	swapper/2	21:58:09	2
23286	99	15	10,3	cyclictest	0	-21	swapper/2	21:11:52	2
23286	99	15	10,0	cyclictest	0	-21	swapper/2	23:40:56	2
23286	99	15	10,0	cyclictest	0	-21	swapper/2	21:41:12	2
23286	99	15	0,14	cyclictest	0	-21	swapper/2	22:20:14	2
23284	99	15	11,4	cyclictest	23282	-21	cyclictest	20:16:42	0
23284	99	15	10,4	cyclictest	663	-21	ptp4l	19:51:11	0
23284	99	15	10,4	cyclictest	6418	-21	ls	19:35:19	0
23284	99	15	10,4	cyclictest	32528	-21	ls	20:25:20	0
23284	99	15	10,4	cyclictest	19014	-21	ssh	21:28:01	0
23284	99	15	10,4	cyclictest	18617	-21	kernelversion	20:00:15	0
23284	99	15	10,4	cyclictest	0	-21	swapper/0	20:10:13	0
23291	99	14	9,4	cyclictest	700	-21	gdbus	20:35:19	7
23291	99	14	13,1	cyclictest	762	-21	gmain	22:59:15	7
23291	99	14	10,4	cyclictest	0	-21	swapper/7	23:26:22	7
23291	99	14	10,4	cyclictest	0	-21	swapper/7	23:12:21	7
23291	99	14	10,3	cyclictest	0	-21	swapper/7	23:23:40	7
23291	99	14	10,0	cyclictest	0	-21	swapper/7	23:38:06	7
23291	99	14	10,0	cyclictest	0	-21	swapper/7	23:09:49	7
23291	99	14	10,0	cyclictest	0	-21	swapper/7	22:37:34	7
23291	99	14	10,0	cyclictest	0	-21	swapper/7	22:30:20	7
23291	99	14	10,0	cyclictest	0	-21	swapper/7	00:00:24	7
23290	99	14	14,0	cyclictest	0	-21	swapper/6	23:46:43	6
23290	99	14	14,0	cyclictest	0	-21	swapper/6	23:27:54	6
23290	99	14	14,0	cyclictest	0	-21	swapper/6	21:58:26	6
23290	99	14	14,0	cyclictest	0	-21	swapper/6	21:35:15	6
23290	99	14	10,4	cyclictest	0	-21	swapper/6	23:12:33	6
23290	99	14	10,4	cyclictest	0	-21	swapper/6	22:22:45	6
23290	99	14	10,4	cyclictest	0	-21	swapper/6	22:02:04	6
23290	99	14	10,4	cyclictest	0	-21	swapper/6	22:02:04	6
23290	99	14	10,4	cyclictest	0	-21	swapper/6	00:01:18	6
23290	99	14	10,3	cyclictest	0	-21	swapper/6	22:56:41	6
23290	99	14	10,1	cyclictest	632	-21	latency	19:25:16	6
23290	99	14	10,0	cyclictest	0	-21	swapper/6	23:35:55	6
23290	99	14	10,0	cyclictest	0	-21	swapper/6	23:16:47	6
23289	99	14	14,0	cyclictest	7181	-21	ls	20:40:18	5
23289	99	14	14,0	cyclictest	0	-21	swapper/5	21:24:54	5
23289	99	14	14,0	cyclictest	0	-21	swapper/5	21:18:30	5
23289	99	14	13,1	cyclictest	719	50	irq/125-eth0	22:45:10	5
23289	99	14	13,0	cyclictest	719	50	irq/125-eth0	23:00:24	5
23289	99	14	12,1	cyclictest	25642	-21	munin-node	20:38:29	5
23289	99	14	12,1	cyclictest	14529	-21	cstates	22:05:11	5
23289	99	14	12,1	cyclictest	12042	-21	kworker/5:2	00:00:17	5
23289	99	14	12,0	cyclictest	719	50	irq/125-eth0	23:22:10	5
23289	99	14	10,4	cyclictest	0	-21	swapper/5	23:52:22	5
23289	99	14	10,4	cyclictest	0	-21	swapper/5	19:45:20	5
23289	99	14	10,4	cyclictest	0	-21	swapper/5	19:10:11	5
23289	99	14	10,1	cyclictest	719	50	irq/125-eth0	23:08:19	5
23289	99	14	10,0	cyclictest	0	-21	swapper/5	23:56:23	5
23289	99	14	10,0	cyclictest	0	-21	swapper/5	23:38:09	5
23289	99	14	10,0	cyclictest	0	-21	swapper/5	22:36:42	5
23289	99	14	10,0	cyclictest	0	-21	swapper/5	21:53:26	5
23289	99	14	10,0	cyclictest	0	-21	swapper/5	21:47:38	5
23289	99	14	10,0	cyclictest	0	-21	swapper/5	20:45:16	5
23288	99	14	14,0	cyclictest	0	-21	swapper/4	23:56:37	4
23288	99	14	14,0	cyclictest	0	-21	swapper/4	22:04:17	4
23288	99	14	14,0	cyclictest	0	-21	swapper/4	22:04:17	4
23288	99	14	14,0	cyclictest	0	-21	swapper/4	21:51:06	4
23288	99	14	14,0	cyclictest	0	-21	swapper/4	21:24:29	4
23288	99	14	13,1	cyclictest	29951	-21	ssh	23:14:23	4
23288	99	14	11,1	cyclictest	678	-21	nscd	21:16:11	4
23288	99	14	10,4	cyclictest	0	-21	swapper/4	00:01:31	4
23288	99	14	10,2	cyclictest	0	-21	swapper/4	21:25:13	4
23288	99	14	10,0	cyclictest	0	-21	swapper/4	23:20:10	4
23288	99	14	10,0	cyclictest	0	-21	swapper/4	23:15:58	4
23288	99	14	10,0	cyclictest	0	-21	swapper/4	22:23:05	4
23288	99	14	10,0	cyclictest	0	-21	swapper/4	22:10:29	4
23288	99	14	10,0	cyclictest	0	-21	swapper/4	21:47:06	4
23287	99	14	14,0	cyclictest	0	-21	swapper/3	23:51:20	3
23287	99	14	14,0	cyclictest	0	-21	swapper/3	23:42:47	3
23287	99	14	14,0	cyclictest	0	-21	swapper/3	23:32:52	3
23287	99	14	14,0	cyclictest	0	-21	swapper/3	23:18:08	3
23287	99	14	14,0	cyclictest	0	-21	swapper/3	21:42:43	3
23287	99	14	13,0	cyclictest	26987	-21	kworker/u16:1	22:54:50	3
23287	99	14	10,4	cyclictest	0	-21	swapper/3	23:35:35	3
23287	99	14	10,4	cyclictest	0	-21	swapper/3	22:19:47	3
23287	99	14	10,4	cyclictest	0	-21	swapper/3	21:59:06	3
23287	99	14	10,4	cyclictest	0	-21	swapper/3	00:03:33	3
23287	99	14	10,0	cyclictest	0	-21	swapper/3	22:35:19	3
23287	99	14	10,0	cyclictest	0	-21	swapper/3	22:33:02	3
23287	99	14	10,0	cyclictest	0	-21	swapper/3	20:45:11	3
23286	99	14	14,0	cyclictest	0	-21	swapper/2	22:41:04	2
23286	99	14	14,0	cyclictest	0	-21	swapper/2	20:25:20	2
23286	99	14	13,1	cyclictest	25642	-21	munin-node	22:01:18	2
23286	99	14	13,1	cyclictest	25642	-21	munin-node	22:01:18	2
23286	99	14	13,1	cyclictest	10692	-1	kworker/u17:1	21:46:35	2
23286	99	14	12,1	cyclictest	21001	-21	diskmemload	22:38:09	2
23286	99	14	10,4	cyclictest	0	-21	swapper/2	23:52:58	2
23286	99	14	10,4	cyclictest	0	-21	swapper/2	23:26:01	2
23286	99	14	10,4	cyclictest	0	-21	swapper/2	22:58:56	2
23286	99	14	10,4	cyclictest	0	-21	swapper/2	21:38:16	2
23286	99	14	10,4	cyclictest	0	-21	swapper/2	21:17:40	2
23286	99	14	10,0	cyclictest	0	-21	swapper/2	22:32:12	2
23286	99	14	10,0	cyclictest	0	-21	swapper/2	00:04:58	2
23284	99	14	11,3	cyclictest	0	-21	swapper/0	20:20:06	0
23284	99	14	10,3	cyclictest	0	-21	swapper/0	21:05:53	0
23284	99	14	10,3	cyclictest	0	-21	swapper/0	20:05:19	0
23284	99	14	10,3	cyclictest	0	-21	swapper/0	19:42:36	0
23291	99	13	13,0	cyclictest	31890	-21	ls	21:15:21	7
23291	99	13	12,1	cyclictest	17337	-21	ssh	21:46:19	7
23291	99	13	12,1	cyclictest	0	-21	swapper/7	22:50:56	7
23291	99	13	11,1	cyclictest	7466	-21	ssh	23:55:47	7
23291	99	13	11,1	cyclictest	677	-21	nscd	21:20:33	7
23291	99	13	11,1	cyclictest	25765	-21	ssh	21:31:47	7
23291	99	13	10,3	cyclictest	0	-21	swapper/7	21:10:39	7
23291	99	13	10,3	cyclictest	0	-21	swapper/7	20:55:00	7
23291	99	13	10,2	cyclictest	6805	-21	cat	19:40:00	7
23291	99	13	10,2	cyclictest	0	-21	swapper/7	20:20:10	7
23291	99	13	10,0	cyclictest	0	-21	swapper/7	23:52:12	7
23291	99	13	10,0	cyclictest	0	-21	swapper/7	22:47:18	7
23291	99	13	10,0	cyclictest	0	-21	swapper/7	22:10:33	7
23291	99	13	10,0	cyclictest	0	-21	swapper/7	19:10:22	7
23290	99	13	12,1	cyclictest	22371	-1	kworker/u17:2	23:30:18	6
23290	99	13	11,1	cyclictest	8138	-21	ssh	23:56:24	6
23290	99	13	11,1	cyclictest	21001	-21	diskmemload	21:31:40	6
23290	99	13	10,3	cyclictest	0	-21	swapper/6	23:40:18	6
23290	99	13	10,3	cyclictest	0	-21	swapper/6	22:25:09	6
23290	99	13	10,3	cyclictest	0	-21	swapper/6	21:26:57	6
23290	99	13	10,3	cyclictest	0	-21	swapper/6	19:45:22	6
23290	99	13	10,3	cyclictest	0	-21	swapper/6	19:20:19	6
23290	99	13	10,2	cyclictest	0	-21	swapper/6	20:40:00	6
23290	99	13	10,0	cyclictest	0	-21	swapper/6	19:30:18	6
23290	99	13	10,0	cyclictest	0	-21	swapper/6	19:15:01	6
23289	99	13	13,0	cyclictest	0	-21	swapper/5	22:55:24	5
23289	99	13	13,0	cyclictest	0	-21	swapper/5	22:42:02	5
23289	99	13	13,0	cyclictest	0	-21	swapper/5	22:27:20	5
23289	99	13	11,1	cyclictest	29962	-21	timerwakeupswit	20:20:21	5
23289	99	13	10,3	cyclictest	0	-21	swapper/5	21:59:18	5
23289	99	13	10,3	cyclictest	0	-21	swapper/5	21:30:15	5
23289	99	13	10,2	cyclictest	304	-21	systemd-journal	20:00:01	5
23289	99	13	10,0	cyclictest	0	-21	swapper/5	23:40:22	5
23289	99	13	10,0	cyclictest	0	-21	swapper/5	22:31:37	5
23289	99	13	10,0	cyclictest	0	-21	swapper/5	22:14:59	5
23289	99	13	10,0	cyclictest	0	-21	swapper/5	22:00:22	5
23289	99	13	10,0	cyclictest	0	-21	swapper/5	22:00:22	5
23289	99	13	10,0	cyclictest	0	-21	swapper/5	20:52:12	5
23289	99	13	10,0	cyclictest	0	-21	swapper/5	19:30:11	5
23288	99	13	13,0	cyclictest	562	-21	ssh	22:35:20	4
23288	99	13	13,0	cyclictest	22261	-21	apt-get	20:10:01	4
23288	99	13	12,1	cyclictest	1560	-21	lldpd	22:48:19	4
23288	99	13	12,0	cyclictest	21001	-21	diskmemload	22:05:28	4
23288	99	13	11,1	cyclictest	18189	-21	timerwakeupswit	21:00:20	4
23288	99	13	11,1	cyclictest	1560	-21	lldpd	20:28:24	4
23288	99	13	10,0	cyclictest	0	-21	swapper/4	23:30:18	4
23288	99	13	10,0	cyclictest	0	-21	swapper/4	23:25:15	4
23288	99	13	10,0	cyclictest	0	-21	swapper/4	23:05:15	4
23288	99	13	10,0	cyclictest	0	-21	swapper/4	21:32:08	4
23288	99	13	10,0	cyclictest	0	-21	swapper/4	20:50:15	4
23288	99	13	10,0	cyclictest	0	-21	swapper/4	20:30:22	4
23287	99	13	13,0	cyclictest	0	-21	swapper/3	21:50:15	3
23287	99	13	12,1	cyclictest	672	-21	nscd	20:11:05	3
23287	99	13	12,1	cyclictest	26375	-21	nscd	23:27:39	3
23287	99	13	11,1	cyclictest	7345	-21	expr	23:20:11	3
23287	99	13	11,1	cyclictest	22525	-21	apt-config	20:10:01	3
23287	99	13	10,3	cyclictest	0	-21	swapper/3	22:25:17	3
23287	99	13	10,3	cyclictest	0	-21	swapper/3	22:10:16	3
23287	99	13	10,3	cyclictest	0	-21	swapper/3	22:07:10	3
23287	99	13	10,3	cyclictest	0	-21	swapper/3	21:35:21	3
23287	99	13	10,3	cyclictest	0	-21	swapper/3	21:15:13	3
23287	99	13	10,3	cyclictest	0	-21	swapper/3	19:45:17	3
23287	99	13	10,3	cyclictest	0	-21	swapper/3	19:31:09	3
23287	99	13	10,0	cyclictest	0	-21	swapper/3	23:59:37	3
23287	99	13	10,0	cyclictest	0	-21	swapper/3	23:00:02	3
23287	99	13	10,0	cyclictest	0	-21	swapper/3	22:46:48	3
23287	99	13	10,0	cyclictest	0	-21	swapper/3	20:52:07	3
23286	99	13	13,0	cyclictest	7292	-21	ls	20:40:19	2
23286	99	13	13,0	cyclictest	529	-21	ls	22:15:26	2
23286	99	13	12,1	cyclictest	25642	-21	munin-node	20:45:33	2
23286	99	13	10,3	cyclictest	1046	-21	kworker/u16:0	21:20:35	2
23286	99	13	10,3	cyclictest	0	-21	swapper/2	23:56:28	2
23286	99	13	10,3	cyclictest	0	-21	swapper/2	22:12:53	2
23286	99	13	10,3	cyclictest	0	-21	swapper/2	21:33:17	2
23286	99	13	10,3	cyclictest	0	-21	swapper/2	21:28:21	2
23286	99	13	10,0	cyclictest	0	-21	swapper/2	23:45:13	2
23286	99	13	10,0	cyclictest	0	-21	swapper/2	19:30:10	2
23284	99	13	10,3	cyclictest	0	-21	swapper/0	20:32:45	0
23284	99	13	10,3	cyclictest	0	-21	swapper/0	19:25:13	0
23284	99	13	10,3	cyclictest	0	-21	swapper/0	19:12:13	0
23284	99	13	10,2	cyclictest	663	-21	ptp4l	19:49:38	0
23284	99	13	10,2	cyclictest	3277	-21	ls	19:30:14	0
23291	99	12	12,0	cyclictest	9007	-21	ls	19:40:20	7
23291	99	12	11,1	cyclictest	29290	-21	apt-get	19:20:10	7
23291	99	12	11,1	cyclictest	26626	-21	pmu-power	19:15:02	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	23:00:13	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	22:05:49	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	22:00:02	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	22:00:01	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	20:59:14	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	20:45:11	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	20:25:18	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	20:10:14	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	19:31:01	7
23291	99	12	11,1	cyclictest	23282	-21	cyclictest	19:25:18	7
23291	99	12	11,1	cyclictest	21001	-21	diskmemload	21:55:04	7
23291	99	12	11,1	cyclictest	15509	-21	df_abs	19:55:12	7
23291	99	12	11,1	cyclictest	13418	-21	if_err_eth0	19:50:15	7
23291	99	12	11,1	cyclictest	1046	-21	kworker/u16:0	21:40:01	7
23291	99	12	10,2	cyclictest	0	-21	swapper/7	22:40:12	7
23291	99	12	10,1	cyclictest	6814	-21	fschecks_time	20:40:16	7
23291	99	12	10,1	cyclictest	6313	-21	ssh	22:20:05	7
23291	99	12	10,1	cyclictest	27582	-21	/usr/sbin/munin	20:15:22	7
23291	99	12	10,1	cyclictest	27113	-21	avahi-daemon	21:00:46	7
23291	99	12	10,1	cyclictest	24357	-21	unixbench_singl	21:50:21	7
23291	99	12	10,1	cyclictest	20341	-21	cstates	20:05:13	7
23291	99	12	10,1	cyclictest	1690	-21	sendmail-mta	20:32:02	7
23291	99	12	10,1	cyclictest	14386	-21	ssh	22:25:03	7
23291	99	12	10,0	cyclictest	0	-21	swapper/7	20:00:12	7
23291	99	12	10,0	cyclictest	0	-21	swapper/7	19:45:21	7
23290	99	12	12,0	cyclictest	0	-21	swapper/6	19:11:10	6
23290	99	12	11,1	cyclictest	8075	-21	fschecks_time	19:40:12	6
23290	99	12	11,1	cyclictest	23282	-21	cyclictest	20:25:13	6
23290	99	12	11,1	cyclictest	23282	-21	cyclictest	20:21:03	6
23290	99	12	11,1	cyclictest	23282	-21	cyclictest	20:00:16	6
23290	99	12	11,1	cyclictest	23282	-21	cyclictest	19:50:46	6
23290	99	12	11,1	cyclictest	16605	-21	python	19:55:20	6
23290	99	12	11,1	cyclictest	16508	-21	cstates	21:00:10	6
23290	99	12	11,1	cyclictest	0	-21	swapper/6	21:15:02	6
23290	99	12	10,2	cyclictest	0	-21	swapper/6	23:00:01	6
23290	99	12	10,2	cyclictest	0	-21	swapper/6	20:50:53	6
23290	99	12	10,2	cyclictest	0	-21	swapper/6	20:40:17	6
23290	99	12	10,2	cyclictest	0	-21	swapper/6	20:11:13	6
23290	99	12	10,1	cyclictest	8488	-21	/usr/sbin/munin	20:45:15	6
23290	99	12	10,1	cyclictest	663	-21	ptp4l	20:33:30	6
23290	99	12	10,1	cyclictest	21335	-21	missed_timers	20:05:17	6
23290	99	12	10,1	cyclictest	19580	-21	fschecks_count	21:05:13	6
23290	99	12	10,1	cyclictest	1690	-21	sendmail-mta	20:16:33	6
23290	99	12	10,0	cyclictest	0	-21	swapper/6	21:10:11	6
23290	99	12	10,0	cyclictest	0	-21	swapper/6	20:55:14	6
23289	99	12	11,1	cyclictest	719	50	irq/125-eth0	21:25:04	5
23289	99	12	11,1	cyclictest	719	50	irq/125-eth0	20:12:01	5
23289	99	12	11,1	cyclictest	719	50	irq/125-eth0	19:50:12	5
23289	99	12	11,1	cyclictest	32633	-21	fschecks_count	19:25:13	5
23289	99	12	11,1	cyclictest	23282	-21	cyclictest	19:21:52	5
23289	99	12	10,2	cyclictest	0	-21	swapper/5	21:40:16	5
23289	99	12	10,2	cyclictest	0	-21	swapper/5	21:00:15	5
23289	99	12	10,2	cyclictest	0	-21	swapper/5	20:05:16	5
23289	99	12	10,2	cyclictest	0	-21	swapper/5	19:40:10	5
23289	99	12	10,1	cyclictest	5172	-21	cstates	19:35:12	5
23289	99	12	10,1	cyclictest	349	-21	perf	20:30:01	5
23289	99	12	10,1	cyclictest	26953	-21	pmu-power	20:15:18	5
23289	99	12	10,1	cyclictest	26740	-21	cpuspeed_turbos	19:15:11	5
23289	99	12	10,0	cyclictest	0	-21	swapper/5	20:55:11	5
23289	99	12	10,0	cyclictest	0	-21	swapper/5	20:30:15	5
23288	99	12	11,1	cyclictest	7379	-21	cpuspeed_turbos	19:40:10	4
23288	99	12	11,1	cyclictest	3947	-21	timerandwakeup	19:30:20	4
23288	99	12	11,1	cyclictest	32385	-21	cstates	19:25:11	4
23288	99	12	11,1	cyclictest	23282	-21	cyclictest	20:00:59	4
23288	99	12	11,1	cyclictest	23282	-21	cyclictest	19:21:52	4
23288	99	12	11,1	cyclictest	1690	-21	sendmail-mta	19:35:47	4
23288	99	12	11,1	cyclictest	12627	-21	cstates	19:50:11	4
23288	99	12	11,1	cyclictest	10088	-21	cstates	19:45:12	4
23288	99	12	10,2	cyclictest	0	-21	swapper/4	20:15:21	4
23288	99	12	10,2	cyclictest	0	-21	swapper/4	19:10:12	4
23288	99	12	10,1	cyclictest	663	-21	ptp4l	20:48:47	4
23288	99	12	10,1	cyclictest	16208	-21	missed_timers	19:55:16	4
23288	99	12	10,1	cyclictest	14727	-21	if_eth0	20:55:16	4
23288	99	12	10,0	cyclictest	0	-21	swapper/4	20:41:44	4
23288	99	12	10,0	cyclictest	0	-21	swapper/4	20:35:18	4
23287	99	12	12,0	cyclictest	0	-21	swapper/3	21:10:02	3
23287	99	12	11,1	cyclictest	31989	-21	strings	20:25:16	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	22:56:03	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	22:00:16	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	22:00:16	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	21:30:02	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	21:00:22	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	20:57:16	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	20:42:30	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	20:35:47	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	19:50:08	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	19:40:14	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	19:27:07	3
23287	99	12	11,1	cyclictest	23282	-21	cyclictest	19:11:47	3
23287	99	12	11,1	cyclictest	16181	-21	missed_timers	19:55:16	3
23287	99	12	11,1	cyclictest	14929	-21	sh	23:05:04	3
23287	99	12	10,2	cyclictest	0	-21	swapper/3	21:25:19	3
23287	99	12	10,2	cyclictest	0	-21	swapper/3	19:15:21	3
23287	99	12	10,1	cyclictest	676	-21	nscd	21:45:01	3
23287	99	12	10,1	cyclictest	5653	-21	if_enp3s0	19:35:13	3
23287	99	12	10,1	cyclictest	29036	-21	idleruntime	20:20:14	3
23287	99	12	10,1	cyclictest	26681	-21	ls	20:15:15	3
23287	99	12	10,1	cyclictest	19907	-21	if_eth0	21:05:16	3
23287	99	12	0,11	cyclictest	0	-21	swapper/3	22:20:16	3
23286	99	12	12,0	cyclictest	24245	-21	strings	20:10:16	2
23286	99	12	11,1	cyclictest	3780	-21	cstates	20:35:12	2
23286	99	12	11,1	cyclictest	23282	-21	cyclictest	23:00:14	2
23286	99	12	11,1	cyclictest	23282	-21	cyclictest	19:42:25	2
23286	99	12	11,1	cyclictest	16220	-21	/usr/sbin/munin	21:00:11	2
23286	99	12	11,1	cyclictest	1552	-21	snmpd	19:23:38	2
23286	99	12	11,1	cyclictest	1087	-21	cstates	20:30:11	2
23286	99	12	10,2	cyclictest	0	-21	swapper/2	20:05:17	2
23286	99	12	10,2	cyclictest	0	-21	swapper/2	19:53:18	2
23286	99	12	10,2	cyclictest	0	-21	swapper/2	19:35:12	2
23286	99	12	10,2	cyclictest	0	-21	swapper/2	19:25:11	2
23286	99	12	10,1	cyclictest	663	-21	ptp4l	20:00:04	2
23286	99	12	10,1	cyclictest	28159	-21	cpuspeed_turbos	20:20:12	2
23286	99	12	10,1	cyclictest	26648	-21	cstates	19:15:01	2
23286	99	12	10,1	cyclictest	24894	-21	processes	19:10:18	2
23286	99	12	10,1	cyclictest	24265	-21	idleruntime	22:50:15	2
23286	99	12	10,1	cyclictest	16604	-21	/usr/sbin/munin	19:55:20	2
23286	99	12	10,1	cyclictest	14047	-21	cstates	20:55:12	2
23286	99	12	10,1	cyclictest	10037	-21	cstates	19:45:12	2
23286	99	12	10,1	cyclictest	0	-21	swapper/2	21:05:14	2
23284	99	12	10,1	cyclictest	30328	-21	idleruntime	19:20:13	0
23284	99	12	10,1	cyclictest	11497	-21	cstates	20:50:11	0
23284	99	12	10,1	cyclictest	0	-21	swapper/0	20:45:11	0
23291	99	11	10,1	cyclictest	0	-21	swapper/7	21:05:01	7
23288	99	11	10,1	cyclictest	0	-21	swapper/4	21:05:01	4
23288	99	11	10,1	cyclictest	0	-21	swapper/4	20:05:07	4
23287	99	11	11,0	cyclictest	23282	-21	cyclictest	20:00:04	3
23287	99	11	10,1	cyclictest	23282	-21	cyclictest	20:30:02	3
23286	99	11	10,1	cyclictest	25466	-21	cpu	20:15:12	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17