OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Thu Nov 20, 2025 00:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4156639	99	137	121,5	cyclictest	53356	-21	kworker/u4:8+events_unbound	23:01:23	1
4156639	99	132	125,5	cyclictest	4172471	-21	kworker/u4:12+events_unbound	21:16:07	1
4156639	99	131	115,7	cyclictest	6820	-21	kworker/u4:11+events_unbound	21:51:13	1
4156639	99	121	114,5	cyclictest	88073	-21	kworker/u4:3+events_unbound	23:21:27	1
4156639	99	118	110,6	cyclictest	41544	-21	kworker/u4:0+events_unbound	22:36:22	1
4156639	99	118	109,6	cyclictest	4178908	-21	kworker/u4:8+events_unbound	21:31:10	1
4156639	99	118	109,6	cyclictest	4178908	-21	kworker/u4:8+events_unbound	21:31:09	1
4156639	99	115	107,6	cyclictest	4169874	-21	kworker/u4:15+events_unbound	21:01:04	1
4156639	99	113	94,8	cyclictest	4178907	-21	kworker/u4:6+events_unbound	21:21:09	1
4156639	99	109	102,5	cyclictest	138927	-21	kworker/u4:7+events_unbound	00:33:52	1
4156639	99	106	98,5	cyclictest	76791	-21	kworker/u4:5+events_unbound	23:11:25	1
4156637	99	104	97,5	cyclictest	18558	-21	kworker/u4:9+events_unbound	22:21:20	0
4156637	99	104	97,5	cyclictest	18558	-21	kworker/u4:9+events_unbound	22:21:20	0
4156637	99	103	95,5	cyclictest	0	-21	swapper/0	23:40:24	0
4156639	99	100	93,5	cyclictest	4162147	-21	kworker/u4:13+events_unbound	21:26:08	1
4156637	99	100	91,6	cyclictest	112407	-21	kworker/u4:6+events_unbound	23:58:37	0
4156639	99	98	90,6	cyclictest	112407	-21	kworker/u4:6+events_unbound	00:13:28	1
4156637	99	98	89,6	cyclictest	4160834	-21	kworker/u4:12+events_unbound	20:05:59	0
4156639	99	97	89,6	cyclictest	4169874	-21	kworker/u4:15+events_unbound	20:56:06	1
4156639	99	97	89,6	cyclictest	4169874	-21	kworker/u4:15+events_unbound	20:56:05	1
4156637	99	97	89,6	cyclictest	4173752	-21	kworker/u4:14+events_unbound	21:06:06	0
4156637	99	96	43,5	cyclictest	0	-21	swapper/0	23:35:24	0
4156639	99	95	87,6	cyclictest	60658	-21	kworker/u4:9+events_unbound	22:51:28	1
4156639	99	95	87,6	cyclictest	60658	-21	kworker/u4:9+events_unbound	22:51:27	1
4156637	99	94	68,13	cyclictest	0	-21	swapper/0	23:20:08	0
4156637	99	89	82,5	cyclictest	80712	-21	kworker/u4:15+events_unbound	23:16:31	0
4156637	99	89	80,6	cyclictest	4157202	-21	kworker/u4:5+events_unbound	19:45:56	0
4156639	99	88	80,6	cyclictest	4141340	-21	kworker/u4:4+events_unbound	19:25:55	1
4156637	99	88	80,6	cyclictest	128659	-21	kworker/u4:8+events_unbound	00:33:27	0
4156639	99	87	79,6	cyclictest	132284	-21	kworker/u4:3+events_unbound	00:18:49	1
4156637	99	86	78,6	cyclictest	72750	-21	kworker/u4:7+events_unbound	23:06:30	0
4156639	99	85	77,6	cyclictest	4157203	-21	kworker/u4:7+events_unbound	19:30:56	1
4156639	99	82	74,6	cyclictest	4157588	-21	kworker/u4:8+events_unbound	19:40:57	1
4156639	99	82	74,6	cyclictest	41548	-21	kworker/u4:7+events_unbound	22:31:21	1
4156637	99	82	73,7	cyclictest	4162147	-21	kworker/u4:13+events_unbound	20:51:03	0
4156637	99	81	73,6	cyclictest	53356	-21	kworker/u4:8+events_unbound	23:01:28	0
4156639	99	80	73,5	cyclictest	88640	-21	kworker/u4:6+events_unbound	23:26:27	1
4156637	99	80	71,7	cyclictest	4169874	-21	kworker/u4:15+events_unbound	20:41:04	0
4156639	99	79	71,6	cyclictest	4141342	-21	kworker/u4:6+events_unbound	19:20:51	1
4156637	99	79	64,11	cyclictest	53	-21	kswapd0	21:20:12	0
4156639	99	78	71,5	cyclictest	41548	-21	kworker/u4:7+events_unbound	22:46:22	1
4156639	99	78	70,6	cyclictest	4157588	-21	kworker/u4:8+events_unbound	20:11:00	1
4156637	99	78	69,6	cyclictest	4157396	-21	kworker/u4:3+events_unbound	19:55:57	0
4156637	99	77	69,6	cyclictest	4147814	-21	kworker/u4:19+events_unbound	19:10:53	0
4156637	99	77	56,8	cyclictest	4141340	-21	kworker/u4:4+events_unbound	19:25:51	0
4156639	99	76	69,5	cyclictest	4168588	-21	kworker/u4:12+events_unbound	20:31:02	1
4156639	99	75	66,7	cyclictest	4152898	-21	kworker/u4:0+events_unbound	20:26:00	1
4156639	99	75	66,6	cyclictest	4172471	-21	kworker/u4:12+events_unbound	20:46:03	1
4156637	99	75	68,5	cyclictest	4173752	-21	kworker/u4:14+events_unbound	21:00:01	0
4156637	99	75	68,5	cyclictest	4173752	-21	kworker/u4:14+events_unbound	21:00:01	0
4156637	99	75	67,6	cyclictest	41548	-21	kworker/u4:7+events_unbound	22:46:26	0
4156639	99	74	66,6	cyclictest	4178908	-21	kworker/u4:8+events_unbound	21:11:08	1
4156639	99	74	66,6	cyclictest	4155357	-21	kworker/u4:1+events_unbound	19:15:52	1
4156637	99	74	57,6	cyclictest	112407	-21	kworker/u4:6+events_unbound	00:28:51	0
4156639	99	73	66,5	cyclictest	4159565	-21	kworker/u4:7+events_unbound	20:00:59	1
4156639	99	73	64,6	cyclictest	18558	-21	kworker/u4:9+events_unbound	22:00:00	1
4156637	99	73	63,8	cyclictest	4171160	-21	kworker/u4:5+events_unbound	20:46:05	0
4156639	99	72	64,6	cyclictest	4141340	-21	kworker/u4:4+events_unbound	20:15:58	1
4156637	99	72	62,7	cyclictest	4157202	-21	kworker/u4:5+events_unbound	20:00:58	0
4156639	99	71	65,4	cyclictest	80712	-21	kworker/u4:15+events_unbound	23:17:02	1
4156639	99	71	63,6	cyclictest	92566	-21	kworker/u4:0+events_unbound	23:45:00	1
4156639	99	71	56,6	cyclictest	41545	-21	kworker/u4:1+events_unbound	22:25:02	1
4156639	99	68	61,5	cyclictest	26433	-21	kworker/u4:3+events_unbound	22:15:01	1
4156637	99	67	58,6	cyclictest	134327	-21	sshd	00:20:27	0
4156637	99	66	57,6	cyclictest	4162147	-21	kworker/u4:13+events_unbound	20:16:01	0
4156637	99	65	58,5	cyclictest	88640	-21	kworker/u4:6+events_unbound	23:26:30	0
4156639	99	64	56,6	cyclictest	4173752	-21	kworker/u4:14+events_unbound	21:10:01	1
4156639	99	64	56,6	cyclictest	112403	-21	kworker/u4:2+events_unbound	00:28:19	1
4156639	99	63	57,4	cyclictest	26433	-21	kworker/u4:3+events_unbound	22:20:03	1
4156639	99	63	57,4	cyclictest	26433	-21	kworker/u4:3+events_unbound	22:20:02	1
4156639	99	63	55,6	cyclictest	4157202	-21	kworker/u4:5+events_unbound	19:45:57	1
4156639	99	62	49,7	cyclictest	0	-21	swapper/1	22:00:38	1
4156639	99	62	44,12	cyclictest	0	-21	swapper/1	00:35:12	1
4156639	99	61	53,6	cyclictest	4155357	-21	kworker/u4:1+events_unbound	19:56:00	1
4156639	99	61	50,8	cyclictest	108298	-21	kworker/u4:8-rpciod	23:50:44	1
4156639	99	61	4,41	cyclictest	4162896	-21	sshd	20:05:28	1
4156637	99	61	52,7	cyclictest	26433	-21	kworker/u4:3+events_unbound	22:11:17	0
4156639	99	60	53,5	cyclictest	4175035	-21	kworker/u4:18+events_unbound	21:41:09	1
4156639	99	60	52,6	cyclictest	4157588	-21	kworker/u4:8+events_unbound	20:51:06	1
4156637	99	60	53,5	cyclictest	92568	-21	kworker/u4:3+events_unbound	23:31:31	0
4156637	99	60	51,7	cyclictest	45481	-21	kworker/u4:11+events_unbound	22:31:20	0
4156639	99	59	51,6	cyclictest	4157588	-21	kworker/u4:8+events_unbound	20:21:02	1
4156637	99	59	51,6	cyclictest	4157998	-21	kworker/u4:6+events_unbound	19:50:59	0
4156637	99	59	49,7	cyclictest	4192947	-21	kworker/u4:0+events_unbound	21:36:10	0
4156637	99	59	2,8	cyclictest	13297	-21	ssh	21:45:31	0
4156637	99	58	50,6	cyclictest	4175035	-21	kworker/u4:18+events_unbound	21:01:05	0
4156639	99	57	50,5	cyclictest	4157202	-21	kworker/u4:5+events_unbound	19:35:57	1
4156637	99	57	48,7	cyclictest	12395	-21	latency_hist	21:45:02	0
4156637	99	56	46,7	cyclictest	128659	-21	kworker/u4:8+events_unbound	00:18:13	0
4156637	99	55	48,5	cyclictest	79469	-21	sh	23:10:34	0
4156637	99	54	44,7	cyclictest	106373	-21	aten2__	23:45:21	0
4156639	99	52	46,5	cyclictest	4178907	-21	kworker/u4:6+events_unbound	21:45:03	1
4156637	99	52	43,7	cyclictest	17934	-21	sshd	21:51:11	0
4156639	99	51	42,7	cyclictest	120510	-21	kworker/u4:15+events_unbound	00:03:05	1
4156639	99	51	38,9	cyclictest	0	-21	swapper/1	23:45:32	1
4156639	99	49	38,8	cyclictest	55969	-21	ps	22:40:43	1
4156639	99	49	38,8	cyclictest	4141340	-21	kworker/u4:4-rpciod	19:15:01	1
4156637	99	49	42,5	cyclictest	52707	-21	ssh	22:36:08	0
4156639	99	48	38,7	cyclictest	0	-21	swapper/1	23:35:25	1
4156639	99	48	36,8	cyclictest	37	-21	kcompactd0	00:09:44	1
4156639	99	48	36,7	cyclictest	0	-21	swapper/1	21:35:26	1
4156637	99	48	40,5	cyclictest	4633	-21	cat	21:35:02	0
4156637	99	48	40,5	cyclictest	4633	-21	cat	21:35:02	0
4156637	99	48	38,7	cyclictest	63279	-21	gltestperf	22:50:22	0
4156637	99	48	38,7	cyclictest	63279	-21	gltestperf	22:50:22	0
4156639	99	47	36,9	cyclictest	75104	-21	fschecks_count	23:05:19	1
4156639	99	47	28,6	cyclictest	6819	-21	kworker/u4:10+events_unbound	22:07:14	1
4156637	99	47	40,5	cyclictest	4191534	-21	gltestperf	21:25:26	0
4156637	99	47	40,5	cyclictest	4167000	-21	cat	20:20:39	0
4156637	99	47	30,14	cyclictest	0	-21	swapper/0	22:40:37	0
4156637	99	47	28,5	cyclictest	45481	-21	kworker/u4:11+events_unbound	22:30:00	0
4156637	99	47	26,18	cyclictest	0	-21	swapper/0	20:30:24	0
4156639	99	46	37,6	cyclictest	0	-21	swapper/1	20:35:29	1
4156637	99	46	41,4	cyclictest	53	-21	kswapd0	22:05:19	0
4156637	99	46	36,7	cyclictest	4180305	-21	threads	21:10:40	0
4156639	99	45	37,5	cyclictest	4171641	-21	fschecks_count	20:40:19	1
4156639	99	45	36,7	cyclictest	133788	-21	aten_r7power_vo	00:20:15	1
4156639	99	45	27,6	cyclictest	112407	-21	kworker/u4:6+events_unbound	23:59:10	1
4156637	99	45	39,4	cyclictest	4183424	-21	cpu	21:15:16	0
4156637	99	45	39,4	cyclictest	0	-21	swapper/0	23:50:14	0
4156637	99	45	37,5	cyclictest	4163946	-21	fschecks_time	20:10:21	0
4156637	99	45	33,9	cyclictest	0	-21	swapper/0	22:15:30	0
4156637	99	45	2,26	cyclictest	146968	-21	ssh	00:38:39	0
4156639	99	44	36,6	cyclictest	67860	-21	switchtime	22:55:41	1
4156639	99	44	36,6	cyclictest	67860	-21	switchtime	22:55:41	1
4156639	99	44	33,7	cyclictest	0	-21	swapper/1	23:30:41	1
4156639	99	44	31,9	cyclictest	37	-21	kcompactd0	22:19:43	1
4156637	99	44	39,3	cyclictest	257	50	irq/23-42890000.ethernet	00:10:34	0
4156637	99	44	35,6	cyclictest	4158073	-21	latency_hist	19:45:01	0
4156637	99	44	10,27	cyclictest	24974	-21	ssh	22:00:38	0
4156637	99	43	34,7	cyclictest	20333	-21	aten_r7power_po	21:55:19	0
4156637	99	42	35,5	cyclictest	4170097	-21	aten2__	20:35:15	0
4156637	99	42	34,6	cyclictest	4168441	-21	unixbench-2d	20:25:38	0
4156637	99	42	34,5	cyclictest	0	-21	swapper/0	22:55:43	0
4156637	99	42	34,5	cyclictest	0	-21	swapper/0	22:55:42	0
4156637	99	42	30,8	cyclictest	0	-21	swapper/0	00:09:44	0
4156637	99	42	20,20	cyclictest	0	-21	swapper/0	19:25:01	0
4156637	99	41	34,5	cyclictest	4157016	-21	latency_hist	19:19:59	0
4156637	99	41	34,5	cyclictest	112407	-21	kworker/u4:6-rpciod	00:00:31	0
4156639	99	38	29,6	cyclictest	4159233	-21	find	19:53:27	1
4156637	99	38	29,7	cyclictest	4157843	-21	grep	19:40:00	0
4156637	99	36	28,6	cyclictest	4156691	-21	latency_hist	19:10:02	0
4156639	99	34	9,16	cyclictest	4156638	-21	kworker/u4:19	19:10:00	1
4156637	99	33	25,6	cyclictest	4157203	-21	kworker/u4:7+events_unbound	19:30:54	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17