OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Mon Mar 02, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
393242	99	127	119,6	cyclictest	488640	-21	kworker/u4:4+events_unbound	10:41:00	0
393243	99	116	100,8	cyclictest	518996	-21	kworker/u4:12+events_unbound	11:01:02	1
393242	99	112	102,7	cyclictest	518996	-21	kworker/u4:12+events_unbound	11:01:04	0
393243	99	111	102,6	cyclictest	377969	-21	kworker/u4:14+events_unbound	07:25:22	1
393243	99	109	96,6	cyclictest	575452	-21	kworker/u4:13+events_unbound	12:11:11	1
393243	99	103	95,6	cyclictest	497493	-21	kworker/u4:10+events_unbound	11:16:05	1
393242	99	101	88,6	cyclictest	484160	-21	kworker/u4:9+events_unbound	10:20:56	0
393242	99	101	88,6	cyclictest	484160	-21	kworker/u4:9+events_unbound	10:20:55	0
393242	99	100	92,6	cyclictest	506423	-21	kworker/u4:3+events_unbound	10:51:02	0
393242	99	97	88,7	cyclictest	394464	-21	kworker/u4:4+events_unbound	08:45:43	0
393242	99	97	84,5	cyclictest	398312	-21	kworker/u4:7+events_unbound	07:40:25	0
393243	99	96	88,6	cyclictest	394464	-21	kworker/u4:4+events_unbound	07:20:22	1
393243	99	95	86,7	cyclictest	536566	-21	kworker/u4:6+events_unbound	11:26:05	1
393242	99	95	83,5	cyclictest	523420	-21	kworker/u4:13+events_unbound	11:06:03	0
393242	99	94	85,7	cyclictest	527800	-21	kworker/u4:0+events_unbound	11:11:04	0
393242	99	92	84,6	cyclictest	566687	-21	kworker/u4:8+events_unbound	12:01:09	0
393243	99	88	81,5	cyclictest	413903	-21	kworker/u4:6+events_unbound	09:20:48	1
393242	99	86	78,6	cyclictest	536564	-21	kworker/u4:5+events_unbound	11:21:06	0
393242	99	86	77,7	cyclictest	475235	-21	kworker/u4:4+events_unbound	10:15:55	0
393243	99	85	76,7	cyclictest	448966	-21	kworker/u4:0+events_unbound	09:45:51	1
393243	99	84	71,5	cyclictest	497493	-21	kworker/u4:10+events_unbound	10:46:01	1
393242	99	84	76,6	cyclictest	411323	-21	kworker/u4:0+events_unbound	09:25:49	0
393242	99	84	68,7	cyclictest	411323	-21	kworker/u4:0+events_unbound	08:30:00	0
393242	99	83	75,6	cyclictest	596668	-21	kworker/u4:14+events_unbound	12:36:16	0
393242	99	83	74,7	cyclictest	444485	-21	kworker/u4:7+events_unbound	09:35:51	0
393242	99	82	73,7	cyclictest	427140	-21	kworker/u4:17+events_unbound	09:15:47	0
393243	99	79	63,6	cyclictest	488641	-21	kworker/u4:5+events_unbound	10:25:57	1
393242	99	79	70,7	cyclictest	562313	-21	kworker/u4:6+events_unbound	12:06:10	0
393243	99	78	71,5	cyclictest	457970	-21	kworker/u4:2+events_unbound	09:55:53	1
393242	99	78	64,6	cyclictest	536567	-21	kworker/u4:7+events_unbound	11:31:06	0
393242	99	77	55,9	cyclictest	408701	-21	kworker/u4:13+events_unbound	08:35:02	0
393243	99	76	67,7	cyclictest	402325	-21	kworker/u4:13+events_unbound	07:45:01	1
393242	99	76	69,5	cyclictest	484160	-21	kworker/u4:9+events_unbound	10:39:33	0
393242	99	75	67,6	cyclictest	440011	-21	kworker/u4:4+events_unbound	09:30:50	0
393243	99	73	65,6	cyclictest	470756	-21	kworker/u4:11+events_unbound	10:10:54	1
393242	99	70	57,6	cyclictest	394466	-21	kworker/u4:9+events_unbound	07:40:00	0
393243	99	69	62,5	cyclictest	407431	-21	kworker/u4:3+events_unbound	08:16:59	1
393242	99	69	62,5	cyclictest	575450	-21	kworker/u4:11+events_unbound	12:16:12	0
393242	99	69	62,5	cyclictest	413907	-21	kworker/u4:14+events_unbound	09:00:46	0
393243	99	68	50,9	cyclictest	545341	-21	kworker/u4:9+events_unbound	11:35:00	1
393243	99	66	59,5	cyclictest	484160	-21	kworker/u4:9+events_unbound	10:34:44	1
393242	99	64	57,6	cyclictest	566688	-21	kworker/u4:10+events_unbound	12:00:00	0
393243	99	63	55,6	cyclictest	411323	-21	kworker/u4:0+events_unbound	08:50:45	1
393243	99	63	46,6	cyclictest	497491	-21	kworker/u4:6+events_unbound	10:42:24	1
393242	99	62	55,5	cyclictest	453481	-21	kworker/u4:1+events_unbound	09:45:01	0
393243	99	61	41,7	cyclictest	527800	-21	kworker/u4:0+events_unbound	11:09:01	1
393242	99	61	53,6	cyclictest	575452	-21	kworker/u4:13+events_unbound	12:21:15	0
393242	99	61	44,7	cyclictest	484158	-21	kworker/u4:7+events_unbound	10:26:59	0
393243	99	60	52,6	cyclictest	562313	-21	kworker/u4:6+events_unbound	11:54:59	1
393243	99	60	52,6	cyclictest	562312	-21	kworker/u4:4+events_unbound	11:56:08	1
393242	99	59	50,7	cyclictest	413904	-21	kworker/u4:7+events_unbound	09:10:48	0
393242	99	59	50,7	cyclictest	413904	-21	kworker/u4:7+events_unbound	09:10:48	0
393242	99	59	47,6	cyclictest	518996	-21	kworker/u4:12+events_unbound	11:19:43	0
393242	99	59	42,6	cyclictest	562315	-21	kworker/u4:9+events_unbound	11:50:19	0
393243	99	58	52,4	cyclictest	448972	-21	kworker/u4:14+events_unbound	10:05:03	1
393243	99	58	42,7	cyclictest	571059	-21	kworker/u4:3+events_unbound	12:03:00	1
393243	99	58	41,5	cyclictest	484160	-21	kworker/u4:9+events_unbound	10:17:59	1
393242	99	58	49,7	cyclictest	514586	-21	kworker/u4:1+events_unbound	10:56:01	0
393243	99	57	49,6	cyclictest	394470	-21	kworker/u4:10+events_unbound	08:05:02	1
393243	99	56	48,6	cyclictest	530717	-21	sshd	11:10:32	1
393243	99	56	47,6	cyclictest	541005	-21	kworker/u4:3+events_unbound	11:46:08	1
393242	99	56	48,5	cyclictest	594938	-21	df	12:25:16	0
393242	99	56	34,20	cyclictest	410514	-21	fschecks_count	08:15:23	0
393243	99	55	49,4	cyclictest	506423	-21	kworker/u4:3+events_unbound	10:56:09	1
393243	99	55	47,6	cyclictest	538638	-21	aten_r7power_en	11:20:16	1
393243	99	55	47,6	cyclictest	448972	-21	kworker/u4:14+events_unbound	10:05:00	1
393243	99	55	46,6	cyclictest	0	-21	swapper/1	10:20:26	1
393243	99	55	46,6	cyclictest	0	-21	swapper/1	10:20:26	1
393243	99	55	45,8	cyclictest	457971	-21	kworker/u4:3+events_unbound	09:50:36	1
393243	99	55	41,6	cyclictest	394470	-21	kworker/u4:10+events_unbound	08:35:42	1
393242	99	55	33,20	cyclictest	406592	-21	fschecks_count	08:00:19	0
393243	99	54	47,5	cyclictest	571058	-21	kworker/u4:1+events_unbound	12:07:43	1
393243	99	54	45,7	cyclictest	314	-21	systemd-journal	09:10:46	1
393243	99	54	45,7	cyclictest	314	-21	systemd-journal	09:10:46	1
393242	99	54	49,4	cyclictest	394470	-21	kworker/u4:10+events_unbound	07:55:27	0
393242	99	54	41,7	cyclictest	457970	-21	kworker/u4:2+events_unbound	10:05:53	0
393242	99	54	40,7	cyclictest	255	50	irq/23-42890000.ethernet	11:40:12	0
393243	99	53	47,4	cyclictest	422096	-21	fschecks_count	09:00:19	1
393243	99	53	44,6	cyclictest	0	-21	swapper/1	11:35:40	1
393242	99	53	46,5	cyclictest	466906	-21	kworker/u4:7+events_unbound	09:58:59	0
393242	99	53	45,6	cyclictest	566686	-21	kworker/u4:2+events_unbound	12:30:04	0
393242	99	53	45,6	cyclictest	541004	-21	kworker/u4:2+events_unbound	11:27:00	0
393242	99	53	45,6	cyclictest	484160	-21	kworker/u4:9+events_unbound	10:32:59	0
393243	99	52	44,6	cyclictest	417687	-21	unixbench-2d	08:40:43	1
393243	99	52	44,6	cyclictest	409590	-21	proc_pri	08:10:35	1
393242	99	52	45,5	cyclictest	457970	-21	kworker/u4:2+events_unbound	09:50:52	0
393242	99	52	45,4	cyclictest	0	-21	swapper/0	10:00:13	0
393243	99	51	44,5	cyclictest	562313	-21	kworker/u4:6+events_unbound	12:27:43	1
393243	99	51	44,5	cyclictest	337521	-21	kworker/u4:8+events_unbound	07:35:13	1
393242	99	51	43,6	cyclictest	409591	-21	sd-accept	08:10:34	0
393242	99	51	43,5	cyclictest	423439	-21	fschecks_time	09:05:18	0
393243	99	50	43,5	cyclictest	599770	-21	ntpq	12:30:32	1
393243	99	50	42,5	cyclictest	587112	-21	ls	12:15:39	1
393243	99	50	42,5	cyclictest	0	-21	swapper/1	07:10:20	1
393243	99	50	41,6	cyclictest	447513	-21	sshd	09:35:33	1
393242	99	50	42,6	cyclictest	417830	-21	kworker/u4:8+events_unbound	08:55:46	0
393242	99	50	39,7	cyclictest	0	-21	swapper/0	09:20:36	0
393242	99	50	28,20	cyclictest	415691	-21	fschecks_time	08:35:18	0
393243	99	49	31,4	cyclictest	453481	-21	kworker/u4:1+events_unbound	09:42:33	1
393242	99	49	40,7	cyclictest	407749	-21	aten_r7power_vo	08:05:16	0
393242	99	49	40,7	cyclictest	377969	-21	kworker/u4:14+events_unbound	07:50:26	0
393242	99	49	31,5	cyclictest	444487	-21	kworker/u4:9+events_unbound	09:46:43	0
393243	99	48	42,4	cyclictest	512599	-21	tr	10:50:15	1
393243	99	48	41,5	cyclictest	429516	-21	gltestperf	09:15:22	1
393243	99	48	40,6	cyclictest	412644	-21	modprobe	08:25:00	1
393242	99	48	41,5	cyclictest	477844	-21	/usr/sbin/munin	10:10:18	0
393242	99	48	40,6	cyclictest	541005	-21	kworker/u4:3+events_unbound	11:46:00	0
393242	99	48	40,5	cyclictest	393274	-21	latency_hist	07:10:01	0
393242	99	48	39,5	cyclictest	582070	-21	fschecks_count	12:10:22	0
393242	99	48	36,5	cyclictest	384504	-21	kworker/u4:6+events_unbound	07:10:20	0
393243	99	47	39,6	cyclictest	393173	-21	kworker/u4:3+events_unbound	07:20:02	1
393243	99	47	38,7	cyclictest	555946	-21	aten_r7power_en	11:40:16	1
393243	99	47	25,13	cyclictest	27	1	ktimers/1	09:26:51	1
393242	99	47	40,5	cyclictest	419500	-21	df_abs	08:50:17	0
393242	99	47	29,15	cyclictest	0	-21	swapper/0	11:35:28	0
393243	99	46	38,5	cyclictest	0	-21	swapper/1	10:35:14	1
393243	99	46	37,6	cyclictest	0	-21	swapper/1	09:30:17	1
393243	99	46	27,10	cyclictest	406129	-21	kworker/u4:7+events_unbound	08:00:12	1
393242	99	46	38,6	cyclictest	402641	-21	aten_r7power_vo	07:45:16	0
393242	99	46	37,6	cyclictest	398646	-21	aten_r7power_vo	07:30:16	0
393242	99	46	36,8	cyclictest	417502	-21	mailstats	08:40:41	0
393243	99	45	39,4	cyclictest	0	-21	swapper/1	07:55:27	1
393243	99	45	33,10	cyclictest	594471	-21	latency_hist	12:25:01	1
393243	99	45	23,8	cyclictest	394470	-21	kworker/u4:10+events_unbound	07:52:03	1
393242	99	45	36,7	cyclictest	395636	-21	unixbench_multi	07:15:38	0
393243	99	44	7,18	cyclictest	424237	-21	diskmemload	12:35:27	1
393243	99	44	37,5	cyclictest	399253	-21	sendmail_mailqu	07:30:36	1
393242	99	44	37,5	cyclictest	398312	-21	kworker/u4:7+events_unbound	07:29:44	0
393242	99	44	36,5	cyclictest	396914	-21	unixbench-2d	07:20:37	0
393242	99	43	34,6	cyclictest	0	-21	swapper/0	10:45:16	0
393243	99	41	34,5	cyclictest	0	-21	swapper/1	07:45:25	1
393242	99	41	34,5	cyclictest	0	-21	swapper/0	08:20:24	0
393243	99	40	28,6	cyclictest	0	-21	swapper/1	09:10:02	1
393243	99	39	32,5	cyclictest	414154	-21	aten_r7power_cu	08:30:16	1
393243	99	39	32,5	cyclictest	0	-21	swapper/1	08:25:26	1
393243	99	39	31,6	cyclictest	419068	-21	head	08:45:42	1
393243	99	37	27,8	cyclictest	0	-21	swapper/1	08:55:31	1
393243	99	31	25,4	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17