OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Fri Sep 11, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4146544	99	112	103,7	cyclictest	132685	-21	kworker/u4:6+events_unbound	12:19:36	0
4146544	99	104	96,6	cyclictest	57445	-21	kworker/u4:2+events_unbound	10:54:22	0
4146544	99	100	83,7	cyclictest	4165687	-21	kworker/u4:18+events_unbound	08:53:52	0
4146544	99	93	85,6	cyclictest	137211	-21	kworker/u4:3+events_unbound	12:34:39	0
4146544	99	88	80,6	cyclictest	101827	-21	kworker/u4:8+events_unbound	11:24:28	0
4146544	99	84	76,6	cyclictest	4188610	-21	kworker/u4:11+events_unbound	09:23:59	0
4146544	99	79	72,5	cyclictest	137210	-21	kworker/u4:2+events_unbound	12:04:33	0
4146544	99	79	68,7	cyclictest	0	-21	swapper/0	11:15:28	0
4146544	99	79	68,7	cyclictest	0	-21	swapper/0	11:15:27	0
4146544	99	76	68,6	cyclictest	4163103	-21	kworker/u4:8+events_unbound	08:18:48	0
4146544	99	76	68,5	cyclictest	8331	-21	kworker/u4:5+events_unbound	09:44:06	0
4146545	99	74	66,6	cyclictest	92824	-21	kworker/u4:6+events_unbound	11:34:27	1
4146544	99	73	66,5	cyclictest	141698	-21	kworker/u4:12+events_unbound	12:09:35	0
4146544	99	72	64,6	cyclictest	4159263	-21	kworker/u4:11+events_unbound	08:58:54	0
4146545	99	71	62,6	cyclictest	141698	-21	kworker/u4:12+events_unbound	12:14:37	1
4146544	99	71	64,5	cyclictest	4163102	-21	kworker/u4:4+events_unbound	08:33:49	0
4146544	99	71	62,5	cyclictest	92826	-21	kworker/u4:8+events_unbound	11:14:25	0
4146545	99	70	60,8	cyclictest	4164389	-21	kworker/u4:17+events_unbound	08:48:54	1
4146544	99	70	54,9	cyclictest	101828	-21	kworker/u4:9-events_unbound	11:47:30	0
4146544	99	68	62,5	cyclictest	4193787	-21	kworker/u4:13+events_unbound	09:30:02	0
4146544	99	68	61,5	cyclictest	4168221	-21	kworker/u4:12+events_unbound	09:03:54	0
4146544	99	66	57,6	cyclictest	15	1	ktimers/0	09:12:21	0
4146545	99	65	57,6	cyclictest	132685	-21	kworker/u4:6+events_unbound	11:59:33	1
4146545	99	65	53,8	cyclictest	129200	-21	ssh	11:53:28	1
4146544	99	65	57,6	cyclictest	4159262	-21	kworker/u4:6+events_unbound	07:58:48	0
4146544	99	65	45,14	cyclictest	17502	-21	kworker/u4:3+events_unbound	10:07:46	0
4146544	99	64	52,4	cyclictest	25953	-21	kworker/u4:7+events_unbound	10:20:00	0
4146544	99	64	44,17	cyclictest	46734	-21	fschecks_count	10:20:19	0
4146545	99	63	55,5	cyclictest	83811	-21	kworker/u4:8+events_unbound	11:05:02	1
4146544	99	63	57,5	cyclictest	4164388	-21	kworker/u4:16+events_unbound	08:43:53	0
4146545	99	62	55,5	cyclictest	83809	-21	kworker/u4:6+events_unbound	11:05:01	1
4146544	99	62	54,6	cyclictest	4137778	-21	kworker/u4:3+events_unbound	07:43:42	0
4146544	99	62	46,7	cyclictest	48500	-21	kworker/u4:1+events_unbound	10:25:04	0
4146545	99	60	53,4	cyclictest	0	-21	swapper/1	11:25:29	1
4146545	99	60	42,6	cyclictest	4157991	-21	kworker/u4:9+events_unbound	07:55:00	1
4146544	99	60	53,5	cyclictest	4159259	-21	kworker/u4:2+events_unbound	08:03:48	0
4146544	99	60	51,7	cyclictest	166047	-21	aten_r7power_en	12:35:16	0
4146545	99	59	50,6	cyclictest	0	-21	swapper/1	09:45:36	1
4146545	99	57	49,6	cyclictest	17500	-21	kworker/u4:1+events_unbound	09:54:06	1
4146545	99	57	48,6	cyclictest	4159259	-21	kworker/u4:2+events_unbound	08:08:47	1
4146545	99	57	45,9	cyclictest	4188610	-21	kworker/u4:11+events_unbound	09:35:13	1
4146544	99	57	49,6	cyclictest	4146472	-21	kworker/u4:5+events_unbound	07:13:33	0
4146545	99	56	49,4	cyclictest	0	-21	swapper/1	09:30:41	1
4146545	99	56	48,6	cyclictest	4152881	-21	kworker/u4:16+events_unbound	07:38:40	1
4146545	99	56	46,5	cyclictest	0	-21	swapper/1	11:40:12	1
4146544	99	56	49,5	cyclictest	4156718	-21	kworker/u4:6+events_unbound	07:48:45	0
4146544	99	56	47,6	cyclictest	4162033	-21	/usr/sbin/munin	08:10:16	0
4146544	99	55	47,6	cyclictest	113126	-21	fschecks_count	11:35:21	0
4146544	99	55	36,7	cyclictest	17500	-21	kworker/u4:1+events_unbound	09:54:42	0
4146545	99	54	42,6	cyclictest	0	-21	swapper/1	11:35:13	1
4146545	99	54	3,41	cyclictest	73740	-21	ssh	10:50:32	1
4146544	99	53	43,8	cyclictest	57446	-21	kworker/u4:3-rpciod	11:00:40	0
4146544	99	53	38,6	cyclictest	106321	-21	kworker/u4:3+events_unbound	11:30:05	0
4146544	99	53	35,16	cyclictest	25471	-21	sed	09:55:44	0
4146545	99	52	46,5	cyclictest	4146470	-21	kworker/u4:2+events_unbound	07:25:02	1
4146545	99	52	44,6	cyclictest	4160570	-21	systemd	08:03:48	1
4146545	99	52	44,6	cyclictest	4152880	-21	kworker/u4:15+events_unbound	07:33:39	1
4146544	99	52	43,7	cyclictest	22085	-21	kworker/u4:6+events_unbound	10:00:02	0
4146544	99	52	40,8	cyclictest	130209	-21	apt	11:55:01	0
4146544	99	52	38,10	cyclictest	53	-21	kswapd0	11:55:10	0
4146544	99	52	34,5	cyclictest	57446	-21	kworker/u4:3+events_unbound	10:36:23	0
4146545	99	51	45,4	cyclictest	10811	-21	cut	09:40:16	1
4146545	99	51	43,6	cyclictest	4159263	-21	kworker/u4:11+events_unbound	09:00:22	1
4146544	99	51	7,15	cyclictest	8170	-21	ssh	09:36:40	0
4146544	99	51	44,5	cyclictest	12906	-21	kworker/u4:8+events_unbound	09:45:03	0
4146544	99	51	41,7	cyclictest	86168	-21	/usr/sbin/munin	11:05:11	0
4146544	99	51	41,4	cyclictest	141698	-21	kworker/u4:12+events_unbound	12:10:03	0
4146544	99	51	27,10	cyclictest	117256	-21	ssh	11:40:15	0
4146545	99	50	43,5	cyclictest	4147436	-21	sendmail_mailqu	07:10:37	1
4146545	99	50	42,6	cyclictest	4149049	-21	systemd	07:18:35	1
4146545	99	50	42,6	cyclictest	100229	-21	diskmemload	11:20:27	1
4146545	99	50	40,7	cyclictest	146144	-21	kworker/u4:4+events_unbound	12:32:45	1
4146545	99	50	39,9	cyclictest	57446	-21	kworker/u4:3-rpciod	10:35:41	1
4146544	99	50	43,6	cyclictest	39485	-21	kworker/u4:15+events_unbound	10:13:45	0
4146544	99	50	43,5	cyclictest	57445	-21	kworker/u4:2+events_unbound	10:47:45	0
4146544	99	50	28,19	cyclictest	0	-21	swapper/0	08:20:36	0
4146545	99	49	43,4	cyclictest	83812	-21	kworker/u4:10-rpciod	11:15:15	1
4146545	99	49	43,4	cyclictest	83812	-21	kworker/u4:10-rpciod	11:15:14	1
4146545	99	49	41,6	cyclictest	4165687	-21	kworker/u4:18+events_unbound	08:23:49	1
4146545	99	49	40,6	cyclictest	4182211	-21	aten_r7power_cu	09:15:17	1
4146544	99	49	39,6	cyclictest	155087	-21	kworker/u4:0-rpciod	12:25:27	0
4146544	99	49	33,11	cyclictest	4146541	-21	cyclictest	08:48:52	0
4146545	99	48	41,5	cyclictest	43995	-21	kworker/u4:5+events_unbound	10:20:02	1
4146545	99	48	39,7	cyclictest	4177293	-21	sh	09:10:00	1
4146545	99	48	39,7	cyclictest	4177293	-21	sh	09:10:00	1
4146544	99	48	22,21	cyclictest	4169519	-21	modprobe	08:40:00	0
4146545	99	47	40,4	cyclictest	92824	-21	kworker/u4:6+events_unbound	11:15:02	1
4146545	99	47	39,5	cyclictest	4167179	-21	aten2__	08:30:16	1
4146545	99	47	39,5	cyclictest	4164434	-21	munin-plugin-st	08:20:00	1
4146544	99	47	37,8	cyclictest	4151828	-21	aten2__	07:30:16	0
4146544	99	47	36,8	cyclictest	77803	-21	gltestperf	10:55:21	0
4146544	99	47	35,6	cyclictest	15	1	ktimers/0	09:25:27	0
4146544	99	47	35,5	cyclictest	61941	-21	kworker/u4:8+events_unbound	10:43:46	0
4146544	99	47	27,17	cyclictest	0	-21	swapper/0	09:10:02	0
4146544	99	47	27,17	cyclictest	0	-21	swapper/0	09:10:01	0
4146544	99	47	15,26	cyclictest	15	1	ktimers/0	07:15:36	0
4146545	99	46	40,4	cyclictest	4181910	-21	latency_hist	09:15:01	1
4146545	99	46	40,4	cyclictest	161186	-21	idleruntime-cro	12:30:01	1
4146545	99	46	39,5	cyclictest	29173	-21	/usr/sbin/munin	10:00:20	1
4146545	99	46	39,5	cyclictest	139720	-21	df_abs	12:05:23	1
4146545	99	46	37,6	cyclictest	0	-21	swapper/1	12:35:12	1
4146545	99	46	36,7	cyclictest	4169320	-21	timerwakeupswit	08:35:36	1
4146545	99	46	36,7	cyclictest	4155930	-21	fschecks_count	07:45:18	1
4146545	99	46	28,15	cyclictest	0	-21	swapper/1	10:15:35	1
4146544	99	46	35,8	cyclictest	55754	-21	if_eth0	10:30:23	0
4146545	99	45	38,5	cyclictest	53003	-21	kworker/u4:9+events_unbound	10:29:17	1
4146545	99	45	37,6	cyclictest	39485	-21	kworker/u4:15+events_unbound	10:14:14	1
4146545	99	45	36,6	cyclictest	0	-21	swapper/1	12:15:15	1
4146545	99	45	36,5	cyclictest	0	-21	swapper/1	10:35:01	1
4146545	99	45	35,7	cyclictest	78392	-21	ssh	10:55:39	1
4146545	99	45	28,7	cyclictest	0	-21	swapper/1	12:00:38	1
4146544	99	45	38,5	cyclictest	4152880	-21	kworker/u4:15+events_unbound	07:35:43	0
4146544	99	45	36,7	cyclictest	4161107	-21	fschecks_time	08:05:20	0
4146545	99	44	38,4	cyclictest	69310	-21	ldconfig	10:45:31	1
4146545	99	44	36,5	cyclictest	53	-21	kswapd0	09:55:10	1
4146545	99	44	36,5	cyclictest	4193787	-21	kworker/u4:13-rpciod	09:30:02	1
4146544	99	44	35,7	cyclictest	4149666	-21	gltestperf	07:20:20	0
4146544	99	44	23,5	cyclictest	0	-21	swapper/0	11:25:38	0
4146545	99	43	36,5	cyclictest	122611	-21	sendmail_mailqu	11:45:35	1
4146545	99	43	35,5	cyclictest	4169847	-21	aten_r7power_vo	08:40:17	1
4146545	99	43	34,7	cyclictest	0	-21	swapper/1	10:40:38	1
4146545	99	43	34,6	cyclictest	0	-21	swapper/1	12:25:03	1
4146544	99	43	36,5	cyclictest	156686	-21	idleruntime-cro	12:25:01	0
4146544	99	43	35,6	cyclictest	4150833	-21	fschecks_time	07:25:19	0
4146545	99	42	35,4	cyclictest	33513	-21	gltestperf	10:05:19	1
4146545	99	42	34,6	cyclictest	4190855	-21	munin-run	09:24:59	1
4146545	99	41	33,6	cyclictest	4172552	-21	fschecks_time	08:50:17	1
4146545	99	41	33,6	cyclictest	4166172	-21	fschecks_count	08:25:18	1
4146545	99	41	32,7	cyclictest	4174757	-21	latency_hist	09:00:01	1
4146544	99	41	32,6	cyclictest	0	-21	swapper/0	09:15:37	0
4146544	99	41	32,6	cyclictest	0	-21	swapper/0	07:50:15	0
4146545	99	40	31,7	cyclictest	4158269	-21	aten_r7power_en	07:55:17	1
4146545	99	40	26,9	cyclictest	0	-21	swapper/1	07:25:25	1
4146545	99	39	27,8	cyclictest	0	-21	swapper/1	07:40:30	1
4146544	99	39	3,31	cyclictest	4166991	-21	munin-run	08:30:01	0
4146545	99	38	27,8	cyclictest	0	-21	swapper/1	08:10:23	1
4146544	99	32	4,21	cyclictest	4146594	-21	date	07:10:01	0
4146545	99	30	23,5	cyclictest	0	-21	swapper/1	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17