OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Sun Mar 29, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4065467	99	104	83,6	cyclictest	4166443	-21	kworker/u4:2+events_unbound	22:28:05	0
4065467	99	98	90,5	cyclictest	4175486	-21	kworker/u4:9+events_unbound	22:58:10	0
4065467	99	94	73,13	cyclictest	4170952	-21	kworker/u4:8-xprtiod	22:40:11	0
4065467	99	93	77,6	cyclictest	47635	-21	kworker/u4:2+events_unbound	23:58:20	0
4065467	99	92	84,5	cyclictest	4166441	-21	kworker/u4:0+events_unbound	22:38:08	0
4065467	99	87	80,5	cyclictest	4116712	-21	kworker/u4:2+events_unbound	21:32:51	0
4065467	99	87	69,5	cyclictest	56574	-21	kworker/u4:1+events_unbound	00:03:19	0
4065467	99	86	79,5	cyclictest	4121301	-21	kworker/u4:3+events_unbound	21:42:56	0
4065467	99	85	77,6	cyclictest	69380	-21	kworker/u4:9+events_unbound	00:18:24	0
4065467	99	82	67,5	cyclictest	4087140	-21	kworker/u4:7+events_unbound	20:47:42	0
4065467	99	82	66,6	cyclictest	4180019	-21	kworker/u4:7+events_unbound	23:38:18	0
4065467	99	81	74,5	cyclictest	4180015	-21	kworker/u4:1+events_unbound	23:03:12	0
4065467	99	76	69,5	cyclictest	16249	-21	kworker/u4:9+events_unbound	23:23:14	0
4065468	99	70	62,6	cyclictest	4064191	-21	kworker/u4:10+events_unbound	19:15:01	1
4065468	99	70	61,5	cyclictest	4083292	-21	kworker/u4:12+events_unbound	21:05:01	1
4065467	99	70	61,7	cyclictest	4082023	-21	kworker/u4:2+events_unbound	20:15:02	0
4065467	99	70	61,7	cyclictest	4082023	-21	kworker/u4:2+events_unbound	20:15:01	0
4065467	99	69	61,6	cyclictest	4085873	-21	kworker/u4:3+events_unbound	20:37:40	0
4065467	99	68	61,5	cyclictest	4121300	-21	kworker/u4:1+events_unbound	21:37:55	0
4065468	99	67	59,6	cyclictest	4083292	-21	kworker/u4:12+events_unbound	20:20:00	1
4065468	99	67	59,6	cyclictest	4083292	-21	kworker/u4:12+events_unbound	20:20:00	1
4065468	99	66	61,3	cyclictest	43191	-21	kworker/u4:13+events_unbound	23:48:18	1
4065467	99	65	59,5	cyclictest	4139720	-21	kworker/u4:8+events_unbound	22:00:00	0
4065467	99	65	59,5	cyclictest	4139720	-21	kworker/u4:8+events_unbound	22:00:00	0
4065468	99	64	6,41	cyclictest	4147029	-21	ssh	22:05:29	1
4065468	99	64	25,12	cyclictest	4136729	-21	ssh	21:54:44	1
4065467	99	64	56,6	cyclictest	82838	-21	kworker/u4:5+events_unbound	00:33:26	0
4065467	99	63	57,4	cyclictest	4091064	-21	kworker/u4:10+events_unbound	21:25:02	0
4065468	99	62	20,18	cyclictest	32928	-21	ntpq	23:35:25	1
4065467	99	62	55,5	cyclictest	4089794	-21	kworker/u4:9+events_unbound	20:42:41	0
4065467	99	62	55,5	cyclictest	4060543	-21	kworker/u4:0+events_unbound	19:17:30	0
4065467	99	62	54,6	cyclictest	4071808	-21	kworker/u4:11+events_unbound	20:05:00	0
4065467	99	61	57,2	cyclictest	4067971	-21	kworker/u4:16+events_unbound	19:30:01	0
4065468	99	60	49,8	cyclictest	4164869	-21	diskmemload	22:25:26	1
4065467	99	60	53,5	cyclictest	4083307	-21	kworker/u4:14+events_unbound	20:27:40	0
4065467	99	60	51,7	cyclictest	378	-21	dbus-daemon	21:17:47	0
4065467	99	60	47,5	cyclictest	25935	-21	kworker/u4:6+events_unbound	23:28:15	0
4065468	99	59	21,13	cyclictest	25727	-21	ssh	23:27:07	1
4065467	99	59	53,5	cyclictest	4078181	-21	kworker/u4:1+events_unbound	20:57:43	0
4065467	99	59	52,5	cyclictest	4085874	-21	kworker/u4:4+events_unbound	20:32:40	0
4065468	99	58	49,5	cyclictest	0	-21	swapper/1	21:55:17	1
4065468	99	58	49,5	cyclictest	0	-21	swapper/1	21:55:17	1
4065468	99	58	20,12	cyclictest	69925	-21	ssh	00:17:20	1
4065468	99	57	48,7	cyclictest	85510	-21	fschecks_count	00:35:22	1
4065468	99	57	22,11	cyclictest	4121604	-21	ssh	21:37:24	1
4065468	99	57	18,13	cyclictest	83996	-21	ssh	00:33:40	1
4065468	99	56	38,14	cyclictest	0	-21	swapper/1	23:10:11	1
4065468	99	56	18,12	cyclictest	19915	-21	ntpq	23:20:35	1
4065468	99	56	17,14	cyclictest	7571	-21	ssh	23:06:24	1
4065468	99	55	43,10	cyclictest	4088975	-21	fschecks_count	20:40:19	1
4065468	99	55	38,10	cyclictest	56575	-21	kworker/u4:5-rpciod	00:26:07	1
4065468	99	55	22,10	cyclictest	4188877	-21	ssh	22:52:25	1
4065468	99	55	22,10	cyclictest	4188877	-21	ssh	22:52:25	1
4065468	99	55	16,11	cyclictest	52445	-21	ssh	23:57:37	1
4065467	99	55	32,7	cyclictest	4187731	-21	/usr/sbin/munin	22:50:39	0
4065467	99	55	32,7	cyclictest	4187731	-21	/usr/sbin/munin	22:50:39	0
4065468	99	54	16,14	cyclictest	4098150	-21	ssh	21:11:07	1
4065468	99	54	15,14	cyclictest	4184285	-21	ssh	22:47:11	1
4065467	99	54	47,5	cyclictest	41765	-21	ntp_kernel_pll_	23:45:26	0
4065467	99	54	47,5	cyclictest	4094898	-21	kworker/u4:2+events_unbound	21:07:46	0
4065467	99	54	45,6	cyclictest	37	-21	kcompactd0	21:45:14	0
4065468	99	53	40,9	cyclictest	32081	-21	wc	23:35:02	1
4065468	99	53	17,15	cyclictest	4157936	-21	ssh	22:17:43	1
4065467	99	53	45,6	cyclictest	45794	-21	cut	23:50:19	0
4065467	99	53	45,6	cyclictest	4180022	-21	kworker/u4:15+events_unbound	23:05:59	0
4065467	99	53	40,12	cyclictest	4091064	-21	kworker/u4:10+events_unbound	21:25:59	0
4065467	99	53	32,19	cyclictest	4076103	-21	fschecks_count	19:50:19	0
4065468	99	52	18,14	cyclictest	4178349	-21	ldconfig	22:40:34	1
4065468	99	52	15,14	cyclictest	4171050	-21	ssh	22:32:22	1
4065468	99	52	14,15	cyclictest	4108434	-21	ssh	21:22:57	1
4065468	99	52	14,14	cyclictest	65181	-21	ssh	00:11:48	1
4065468	99	52	13,14	cyclictest	61094	-21	ssh	00:07:20	1
4065468	99	52	13,14	cyclictest	61094	-21	ssh	00:07:19	1
4065468	99	52	13,14	cyclictest	39152	-21	ssh	23:42:30	1
4065468	99	52	12,14	cyclictest	71891	-21	ssh	00:20:08	1
4065467	99	52	46,4	cyclictest	82840	-21	kworker/u4:9+events_unbound	00:36:59	0
4065467	99	52	46,4	cyclictest	4083292	-21	kworker/u4:12+events_unbound	20:17:39	0
4065467	99	52	46,4	cyclictest	4083292	-21	kworker/u4:12+events_unbound	20:17:39	0
4065467	99	52	33,6	cyclictest	4148251	-21	kworker/u4:9+events_unbound	22:24:20	0
4065467	99	52	3,34	cyclictest	4182752	-21	ssh	22:45:29	0
4065468	99	51	15,10	cyclictest	4127287	-21	ssh	21:44:08	1
4065468	99	51	13,12	cyclictest	4192292	-21	ssh	22:55:50	1
4065467	99	51	44,5	cyclictest	4060543	-21	kworker/u4:0+events_unbound	20:07:37	0
4065467	99	51	44,5	cyclictest	12418	-21	kworker/u4:4+events_unbound	23:13:14	0
4065467	99	51	43,6	cyclictest	15001	-21	fschecks_time	23:15:19	0
4065467	99	51	43,5	cyclictest	4169535	-21	/usr/sbin/munin	22:30:36	0
4065467	99	51	34,14	cyclictest	4065465	-21	cyclictest	00:20:20	0
4065468	99	50	43,5	cyclictest	45744	-21	/usr/sbin/munin	23:50:17	1
4065468	99	50	42,5	cyclictest	0	-21	swapper/1	23:15:36	1
4065468	99	50	15,10	cyclictest	4174643	-21	ssh	22:36:02	1
4065468	99	50	15,10	cyclictest	4162436	-21	ssh	22:22:46	1
4065468	99	50	13,14	cyclictest	4093143	-21	ld	20:55:30	1
4065468	99	50	13,13	cyclictest	4117460	-21	ssh	21:32:57	1
4065468	99	50	11,14	cyclictest	4152319	-21	ssh	22:11:00	1
4065468	99	50	11,14	cyclictest	4130511	-21	ssh	21:47:10	1
4065467	99	50	38,9	cyclictest	60066	-21	vmstat	00:05:43	0
4065467	99	50	38,9	cyclictest	60066	-21	vmstat	00:05:42	0
4065467	99	50	34,7	cyclictest	0	-21	swapper/0	22:15:10	0
4065468	99	49	29,16	cyclictest	2276	-21	ps	23:00:37	1
4065468	99	49	15,10	cyclictest	4113769	-21	ssh	21:29:14	1
4065468	99	49	14,14	cyclictest	56753	-21	ssh	00:02:25	1
4065468	99	49	14,11	cyclictest	0	-21	swapper/1	21:15:37	1
4065467	99	49	41,6	cyclictest	4060543	-21	kworker/u4:0+events_unbound	19:32:33	0
4065467	99	49	40,6	cyclictest	0	-21	swapper/0	22:05:36	0
4065467	99	48	41,5	cyclictest	4144334	-21	kworker/u4:2+events_unbound	22:11:01	0
4065467	99	48	41,5	cyclictest	4096168	-21	kworker/u4:8+events_unbound	21:14:59	0
4065467	99	48	41,4	cyclictest	0	-21	swapper/0	23:40:11	0
4065468	99	47	36,8	cyclictest	4079617	-21	latency_hist	20:05:01	1
4065468	99	47	18,4	cyclictest	4091262	-21	apt-get	20:50:13	1
4065468	99	47	15,7	cyclictest	4071391	-21	ntpq	19:30:34	1
4065468	99	47	11,14	cyclictest	4141776	-21	ssh	22:00:15	1
4065467	99	47	38,7	cyclictest	63375	-21	df_abs	00:10:17	0
4065467	99	47	34,9	cyclictest	256	50	irq/23-42890000.ethernet	00:25:29	0
4065468	99	46	39,5	cyclictest	4076081	-21	fschecks_count	19:50:19	1
4065467	99	46	38,5	cyclictest	4071806	-21	kworker/u4:5+events_unbound	20:25:01	0
4065468	99	45	39,4	cyclictest	4084604	-21	systemd	20:22:38	1
4065468	99	45	37,6	cyclictest	4081690	-21	sendmail_mailqu	20:10:36	1
4065468	99	45	37,6	cyclictest	4081690	-21	sendmail_mailqu	20:10:36	1
4065468	99	45	31,11	cyclictest	4080340	-21	ntpq	20:05:34	1
4065468	99	45	11,10	cyclictest	0	-21	swapper/1	19:35:41	1
4065467	99	45	36,7	cyclictest	4066060	-21	/usr/sbin/munin	19:10:19	0
4065467	99	45	35,5	cyclictest	0	-21	swapper/0	21:51:08	0
4065467	99	45	27,16	cyclictest	0	-21	swapper/0	22:00:33	0
4065468	99	44	37,5	cyclictest	4088559	-21	idleruntime-cro	20:40:01	1
4065468	99	44	35,7	cyclictest	4086078	-21	aten2__	20:30:14	1
4065468	99	44	13,5	cyclictest	4084800	-21	apt-get	20:25:11	1
4065468	99	44	12,10	cyclictest	4068837	-21	ntpq	19:20:30	1
4065468	99	44	10,13	cyclictest	4077700	-21	ntpq	19:55:29	1
4065467	99	44	31,10	cyclictest	0	-21	swapper/0	23:35:00	0
4065468	99	43	33,6	cyclictest	0	-21	swapper/1	19:25:39	1
4065467	99	43	36,5	cyclictest	4092289	-21	unixbench_singl	20:50:38	0
4065468	99	42	17,20	cyclictest	27	1	ktimers/1	19:40:25	1
4065468	99	42	14,3	cyclictest	4075227	-21	ntpq	19:45:35	1
4065467	99	42	35,5	cyclictest	4072296	-21	fschecks_time	19:35:18	0
4065467	99	42	33,6	cyclictest	4077510	-21	gltestperf	19:55:21	0
4065467	99	41	34,5	cyclictest	4068486	-21	fschecks_time	19:20:18	0
4065467	99	40	32,5	cyclictest	4055485	-21	kworker/u4:6-rpciod	19:40:37	0
4065468	99	39	25,10	cyclictest	4095700	-21	ntpq	21:05:30	1
4065468	99	39	24,12	cyclictest	4066870	-21	/usr/sbin/munin	19:15:40	1
4065467	99	39	31,6	cyclictest	4094819	-21	unixbench_multi	21:00:37	0
4065468	99	38	23,10	cyclictest	4090591	-21	ntpq	20:45:28	1
4065467	99	38	30,6	cyclictest	4074836	-21	fschecks_count	19:45:19	0
4065468	99	31	21,7	cyclictest	4065495	-21	latency_hist	19:10:01	1
4065467	99	31	21,8	cyclictest	4065397	-21	kworker/u4:11-rpciod	19:10:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17