OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Sat May 02, 2026 00:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
27406	99	94	85,7	cyclictest	126585	-21	kworker/u4:11+events_unbound	22:42:10	0
27406	99	90	45,9	cyclictest	89177	-21	modprobe	21:45:00	0
27407	99	80	36,15	cyclictest	39053	-21	apt-get	19:55:15	1
27406	99	79	56,19	cyclictest	47815	-21	kworker/u4:5+events_unbound	20:39:59	0
27406	99	77	66,8	cyclictest	69666	-21	kworker/u4:6+events_unbound	22:22:09	0
27406	99	75	56,14	cyclictest	0	-21	swapper/0	22:25:22	0
27406	99	75	36,9	cyclictest	94234	-21	fschecks_count	21:50:18	0
27406	99	71	55,12	cyclictest	40119	-21	systemd	19:56:49	0
27407	99	70	32,12	cyclictest	110081	-21	ssh	22:08:08	1
27407	99	69	46,17	cyclictest	57041	-21	apt-get	21:05:11	1
27407	99	69	29,16	cyclictest	106331	-21	ssh	22:04:10	1
27406	99	69	59,7	cyclictest	40128	-21	kworker/u4:17+events_unbound	20:00:27	0
27406	99	69	54,13	cyclictest	53	-21	kswapd0	22:05:12	0
27407	99	68	32,11	cyclictest	71454	-21	ssh	21:25:01	1
27407	99	68	29,12	cyclictest	223577	-21	ssh	00:18:18	1
27407	99	67	30,12	cyclictest	191741	-21	ssh	23:41:12	1
27407	99	67	26,15	cyclictest	166031	-21	ssh	23:12:04	1
27407	99	66	57,7	cyclictest	50356	-21	kworker/u4:20+events_unbound	21:17:01	1
27407	99	66	28,15	cyclictest	203094	-21	ssh	23:55:10	1
27407	99	66	28,14	cyclictest	126533	-21	ssh	22:26:37	1
27407	99	66	27,15	cyclictest	241020	-21	ssh	00:38:18	1
27407	99	66	27,14	cyclictest	230964	-21	ssh	00:26:11	1
27407	99	66	26,15	cyclictest	226789	-21	ssh	00:21:29	1
27407	99	65	29,11	cyclictest	121908	-21	ssh	22:21:10	1
27407	99	65	27,16	cyclictest	142768	-21	ntpq	22:45:27	1
27407	99	65	27,15	cyclictest	60514	-21	ssh	21:11:48	1
27407	99	65	26,15	cyclictest	154192	-21	ssh	22:59:06	1
27407	99	65	26,14	cyclictest	97384	-21	ssh	21:54:01	1
27407	99	65	26,14	cyclictest	213979	-21	ssh	00:06:57	1
27407	99	65	26,14	cyclictest	170433	-21	ssh	23:17:08	1
27407	99	65	26,11	cyclictest	179737	-21	ssh	23:27:59	1
27407	99	65	25,14	cyclictest	200466	-21	ssh	23:51:15	1
27407	99	65	25,11	cyclictest	236093	-21	ssh	00:32:26	1
27407	99	65	24,15	cyclictest	73894	-21	ssh	21:26:53	1
27407	99	65	24,14	cyclictest	141019	-21	ssh	22:43:54	1
27406	99	65	54,8	cyclictest	218431	-21	kworker/u4:6+events_unbound	00:30:15	0
27407	99	64	31,6	cyclictest	111549	-21	apt-get	22:10:15	1
27407	99	64	27,12	cyclictest	156978	-21	ssh	23:01:32	1
27407	99	64	27,10	cyclictest	188329	-21	ssh	23:37:45	1
27407	99	64	26,14	cyclictest	79869	-21	ssh	21:34:20	1
27407	99	64	26,12	cyclictest	218157	-21	ssh	00:11:39	1
27407	99	64	26,11	cyclictest	134858	-21	ssh	22:36:01	1
27407	99	64	26,10	cyclictest	118333	-21	ssh	22:17:25	1
27407	99	64	25,15	cyclictest	211477	-21	ssh	00:04:54	1
27407	99	64	25,14	cyclictest	175203	-21	ssh	23:22:44	1
27407	99	64	25,13	cyclictest	84086	-21	ssh	21:39:00	1
27407	99	64	25,12	cyclictest	88266	-21	ssh	21:43:35	1
27407	99	63	26,14	cyclictest	184758	-21	ssh	23:34:02	1
27407	99	63	24,14	cyclictest	148832	-21	ssh	22:52:28	1
27407	99	62	26,10	cyclictest	161147	-21	ssh	23:06:14	1
27407	99	62	26,10	cyclictest	161147	-21	ssh	23:06:14	1
27407	99	62	24,14	cyclictest	130814	-21	ssh	22:31:29	1
27407	99	61	27,11	cyclictest	198419	-21	ssh	23:49:56	1
27407	99	61	25,11	cyclictest	90224	-21	ntpq	21:45:28	1
27406	99	61	50,8	cyclictest	53	-21	kswapd0	22:05:01	0
27407	99	60	27,8	cyclictest	51207	-21	ntpq	20:40:33	1
27406	99	60	44,12	cyclictest	233019	-21	diskmemload	00:29:28	0
27406	99	60	37,21	cyclictest	116314	-21	fschecks_time	22:15:21	0
27407	99	59	39,16	cyclictest	48565	-21	ntpq	20:30:24	1
27406	99	59	51,6	cyclictest	31213	-21	kworker/u4:11+events_unbound	20:16:50	0
27406	99	59	44,9	cyclictest	35043	-21	kworker/u4:15	19:40:00	0
27407	99	58	38,16	cyclictest	46047	-21	ntpq	20:20:25	1
27407	99	58	37,17	cyclictest	38436	-21	ntpq	19:50:33	1
27407	99	58	28,8	cyclictest	32068	-21	ntpq	19:25:33	1
27407	99	58	23,10	cyclictest	100963	-21	ssh	21:57:41	1
27406	99	58	7,44	cyclictest	1066	-21	snmpd	20:55:33	0
27406	99	58	49,6	cyclictest	174676	-21	kworker/u4:0+events_unbound	23:22:15	0
27406	99	57	50,5	cyclictest	69666	-21	kworker/u4:6+events_unbound	22:37:10	0
27406	99	57	43,4	cyclictest	222864	-21	kworker/u4:10+events_unbound	00:20:00	0
27406	99	57	25,24	cyclictest	0	-21	swapper/0	19:45:01	0
27407	99	56	42,10	cyclictest	56317	-21	ntpq	21:00:24	1
27407	99	56	34,15	cyclictest	27556	-21	apt-get	19:10:15	1
27407	99	56	23,10	cyclictest	30724	-21	ntpq	19:20:23	1
27407	99	56	22,10	cyclictest	37089	-21	ntpq	19:45:36	1
27406	99	56	51,3	cyclictest	33752	-21	kworker/u4:13+events_unbound	19:46:48	0
27407	99	55	39,12	cyclictest	53203	-21	apt-get	20:50:21	1
27407	99	55	39,10	cyclictest	33272	-21	ntpq	19:30:27	1
27406	99	55	46,7	cyclictest	236158	-21	kworker/u4:2+events_unbound	00:35:15	0
27407	99	54	37,10	cyclictest	0	-21	swapper/1	19:43:46	1
27407	99	54	36,13	cyclictest	40932	-21	ntpq	20:00:28	1
27406	99	54	46,6	cyclictest	69666	-21	kworker/u4:6+events_unbound	21:56:59	0
27406	99	54	4,16	cyclictest	90207	-21	ssh	21:45:27	0
27406	99	54	41,10	cyclictest	42691	-21	systemd	20:06:49	0
27406	99	54	36,13	cyclictest	53	-21	kswapd0	23:05:09	0
27406	99	54	36,13	cyclictest	53	-21	kswapd0	23:05:08	0
27407	99	53	41,8	cyclictest	37	-21	kcompactd0	19:35:33	1
27407	99	53	22,9	cyclictest	49752	-21	irqstats	20:35:20	1
27406	99	53	45,6	cyclictest	28632	-21	kworker/u4:1+events_unbound	20:21:53	0
27406	99	53	45,6	cyclictest	186235	-21	/usr/sbin/munin	23:35:21	0
27406	99	53	39,9	cyclictest	0	-21	swapper/0	21:27:44	0
27406	99	53	3,39	cyclictest	147248	-21	ssh	22:50:34	0
27407	99	52	39,9	cyclictest	41607	-21	/usr/sbin/munin	20:05:41	1
27407	99	52	19,12	cyclictest	54457	-21	/usr/sbin/munin	20:55:18	1
27406	99	52	45,5	cyclictest	53	-21	kswapd0	23:05:01	0
27406	99	52	43,6	cyclictest	68336	-21	cat	21:20:35	0
27406	99	52	43,6	cyclictest	143216	-21	grep	22:45:38	0
27406	99	52	39,9	cyclictest	51655	-21	kworker/u4:21+xprtiod	20:50:08	0
27407	99	51	34,13	cyclictest	44766	-21	ntpq	20:15:27	1
27406	99	51	43,6	cyclictest	54281	-21	kworker/u4:2+events_unbound	21:19:59	0
27407	99	50	41,4	cyclictest	43464	-21	ntpq	20:10:26	1
27407	99	50	37,9	cyclictest	52462	-21	ntpq	20:45:30	1
27406	99	50	44,5	cyclictest	33752	-21	kworker/u4:13+events_unbound	20:31:53	0
27406	99	50	43,5	cyclictest	199409	-21	/usr/sbin/munin	23:50:22	0
27407	99	49	38,7	cyclictest	46729	-21	/usr/sbin/munin	20:25:11	1
27406	99	49	42,5	cyclictest	84772	-21	tr	21:40:00	0
27406	99	49	42,5	cyclictest	177369	-21	gltestperf	23:25:20	0
27406	99	49	41,6	cyclictest	0	-21	swapper/0	00:10:13	0
27406	99	49	29,18	cyclictest	167872	-21	sh	23:15:00	0
27406	99	49	2,37	cyclictest	76600	-21	perl	21:30:20	0
27406	99	48	41,5	cyclictest	31248	-21	munin-plugin-st	19:25:00	0
27406	99	48	40,6	cyclictest	0	-21	swapper/0	22:10:13	0
27407	99	47	32,10	cyclictest	28827	-21	apt-get	19:15:11	1
27406	99	47	6,16	cyclictest	208416	-21	ntp_states	00:00:39	0
27406	99	47	39,6	cyclictest	191079	-21	mailstats	23:40:39	0
27406	99	47	39,6	cyclictest	168485	-21	fschecks_count	23:15:20	0
27406	99	47	35,7	cyclictest	0	-21	swapper/0	21:05:00	0
27406	99	46	39,5	cyclictest	28632	-21	kworker/u4:1+events_unbound	19:31:44	0
27406	99	46	39,5	cyclictest	151947	-21	grep	22:55:40	0
27406	99	46	37,7	cyclictest	46784	-21	aten_r7power_cu	20:25:15	0
27406	99	46	32,9	cyclictest	0	-21	swapper/0	00:20:31	0
27406	99	46	31,8	cyclictest	0	-21	swapper/0	21:10:28	0
27406	99	46	26,5	cyclictest	200693	-21	kworker/u4:14+events_unbound	00:05:22	0
27406	99	45	38,5	cyclictest	182294	-21	/usr/sbin/munin	23:30:38	0
27406	99	45	36,6	cyclictest	133047	-21	kworker/u4:5	22:35:01	0
27406	99	45	32,9	cyclictest	28632	-21	kworker/u4:1-xprtiod	20:10:30	0
27406	99	44	34,8	cyclictest	194506	-21	aten_r7power_cu	23:45:16	0
27406	99	44	33,8	cyclictest	18754	-21	kworker/u4:10-rpciod	19:10:29	0
27406	99	43	36,5	cyclictest	203504	-21	fschecks_time	23:55:20	0
27406	99	43	35,6	cyclictest	51932	-21	aten_r7power_en	20:45:17	0
27406	99	43	34,7	cyclictest	31424	-21	aten2__	19:25:14	0
27407	99	42	32,8	cyclictest	27448	-21	sed	19:10:01	1
27406	99	42	34,5	cyclictest	0	-21	swapper/0	19:50:37	0
27406	99	42	33,6	cyclictest	50845	-21	fschecks_count	20:40:23	0
27406	99	41	4,27	cyclictest	29335	-21	memory	19:15:21	0
27406	99	39	32,5	cyclictest	57304	-21	fschecks_count	21:05:17	0
27406	99	33	5,23	cyclictest	27404	-21	cyclictest	19:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17