OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Sun Jul 05, 2026 00:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4151296	99	96	89,5	cyclictest	4174490	-21	kworker/u4:9+events_unbound	20:37:15	0
4151297	99	91	84,5	cyclictest	101710	-21	kworker/u4:1+events_unbound	23:32:57	1
4151297	99	91	84,5	cyclictest	101710	-21	kworker/u4:1+events_unbound	23:32:57	1
4151296	99	91	84,5	cyclictest	4175789	-21	kworker/u4:3+events_unbound	20:47:18	0
4151296	99	91	83,6	cyclictest	4171948	-21	kworker/u4:4+events_unbound	20:27:13	0
4151296	99	88	81,5	cyclictest	4174491	-21	kworker/u4:11+events_unbound	20:42:15	0
4151296	99	88	70,11	cyclictest	74203	-21	sh	22:45:54	0
4151297	99	87	78,7	cyclictest	127798	-21	kworker/u4:1+events_unbound	23:48:01	1
4151297	99	86	68,7	cyclictest	79487	-21	kworker/u4:6+events_unbound	22:57:48	1
4151296	99	85	55,27	cyclictest	4151292	-21	cyclictest	20:05:11	0
4151297	99	84	76,5	cyclictest	35871	-21	kworker/u4:5+events_unbound	22:30:17	1
4151297	99	83	78,3	cyclictest	4150016	-21	kworker/u4:4+events_unbound	19:27:01	1
4151297	99	83	62,6	cyclictest	4193700	-21	kworker/u4:0+events_unbound	23:05:00	1
4151297	99	82	75,5	cyclictest	101715	-21	kworker/u4:7+events_unbound	23:42:58	1
4151296	99	82	46,31	cyclictest	53	-21	kswapd0	22:30:13	0
4151297	99	81	74,5	cyclictest	8694	-21	kworker/u4:5+events_unbound	21:32:29	1
4151297	99	78	64,5	cyclictest	53251	-21	kworker/u4:8+events_unbound	22:47:47	1
4151296	99	77	72,4	cyclictest	4175793	-21	kworker/u4:7+events_unbound	20:57:21	0
4151297	99	76	67,6	cyclictest	3918784	-21	kworker/u4:9+events_unbound	20:00:01	1
4151297	99	75	67,6	cyclictest	13198	-21	kworker/u4:2+events_unbound	22:10:02	1
4151296	99	74	60,11	cyclictest	127802	-21	kworker/u4:5+events_unbound	23:58:03	0
4151297	99	73	55,5	cyclictest	79486	-21	kworker/u4:4+events_unbound	22:55:00	1
4151296	99	70	63,5	cyclictest	3918784	-21	kworker/u4:9+events_unbound	19:16:59	0
4151296	99	69	61,6	cyclictest	4150016	-21	kworker/u4:4+events_unbound	19:26:59	0
4151296	99	69	60,7	cyclictest	4193700	-21	kworker/u4:0+events_unbound	21:57:36	0
4151297	99	68	59,6	cyclictest	4175791	-21	kworker/u4:5+events_unbound	20:45:01	1
4151297	99	67	60,5	cyclictest	101715	-21	kworker/u4:7+events_unbound	00:28:09	1
4151297	99	67	60,5	cyclictest	101715	-21	kworker/u4:7+events_unbound	00:28:09	1
4151297	99	67	59,6	cyclictest	13198	-21	kworker/u4:2+events_unbound	22:07:38	1
4151297	99	67	47,6	cyclictest	4180901	-21	kworker/u4:17+events_unbound	21:22:27	1
4151297	99	66	59,5	cyclictest	101712	-21	kworker/u4:3+events_unbound	23:37:58	1
4151297	99	65	58,5	cyclictest	13198	-21	kworker/u4:2+events_unbound	22:02:37	1
4151297	99	64	50,6	cyclictest	4169282	-21	kworker/u4:10+events_unbound	20:20:00	1
4151297	99	62	3,48	cyclictest	51757	-21	ssh	22:20:30	1
4151296	99	62	54,6	cyclictest	4177062	-21	kworker/u4:12+events_unbound	21:00:02	0
4151296	99	62	54,6	cyclictest	38519	-21	ntpq	22:05:33	0
4151296	99	62	31,23	cyclictest	53	-21	kswapd0	23:05:11	0
4151297	99	60	51,7	cyclictest	71221	-21	kworker/u4:12+events_unbound	22:42:44	1
4151296	99	60	52,6	cyclictest	4155087	-21	kworker/u4:12+events_unbound	19:30:02	0
4151297	99	59	51,6	cyclictest	13198	-21	kworker/u4:2+events_unbound	22:20:01	1
4151296	99	59	52,5	cyclictest	4148784	-21	kworker/u4:3+events_unbound	19:10:03	0
4151297	99	58	51,5	cyclictest	4180901	-21	kworker/u4:17+events_unbound	21:52:35	1
4151297	99	58	50,6	cyclictest	4169282	-21	kworker/u4:10+events_unbound	20:22:13	1
4151296	99	58	51,5	cyclictest	4151222	-21	kworker/u4:8+events_unbound	19:50:03	0
4151297	99	56	49,5	cyclictest	4148784	-21	kworker/u4:3+events_unbound	19:40:02	1
4151297	99	56	47,7	cyclictest	4177064	-21	systemd	20:47:16	1
4151296	99	56	40,11	cyclictest	59589	-21	modprobe	22:30:00	0
4151297	99	55	49,4	cyclictest	0	-21	swapper/1	21:25:35	1
4151296	99	55	47,6	cyclictest	125725	-21	/usr/sbin/munin	23:45:23	0
4151297	99	54	39,5	cyclictest	61642	-21	kworker/u4:11+events_unbound	22:37:46	1
4151297	99	53	46,5	cyclictest	4174158	-21	sendmail_mailqu	20:35:34	1
4151297	99	53	44,7	cyclictest	145647	-21	kworker/u4:16+events_unbound	00:33:10	1
4151297	99	52	44,6	cyclictest	4193700	-21	kworker/u4:0+events_unbound	23:07:50	1
4151297	99	52	44,5	cyclictest	156377	-21	/usr/sbin/munin	00:20:16	1
4151296	99	52	44,6	cyclictest	42496	-21	fschecks_time	22:10:19	0
4151297	99	51	44,5	cyclictest	155940	-21	cron	00:20:00	1
4151297	99	51	42,7	cyclictest	4155089	-21	kworker/u4:14+events_unbound	19:21:58	1
4151296	99	51	43,6	cyclictest	77723	-21	/usr/sbin/munin	22:50:17	0
4151296	99	51	36,9	cyclictest	0	-21	swapper/0	23:31:08	0
4151296	99	51	36,9	cyclictest	0	-21	swapper/0	23:31:08	0
4151296	99	51	3,38	cyclictest	51690	-21	ssh	22:20:26	0
4151297	99	50	36,11	cyclictest	0	-21	swapper/1	00:35:12	1
4151296	99	50	42,5	cyclictest	0	-21	swapper/0	21:10:27	0
4151296	99	50	41,6	cyclictest	256	50	irq/23-42890000.ethernet	22:40:28	0
4151296	99	50	36,10	cyclictest	37	-21	kcompactd0	00:24:58	0
4151296	99	50	32,16	cyclictest	161863	-21	unixbench-2d	00:25:40	0
4151296	99	50	32,16	cyclictest	161863	-21	unixbench-2d	00:25:40	0
4151296	99	50	31,16	cyclictest	101714	-21	kworker/u4:5-rpciod	23:25:40	0
4151297	99	49	43,4	cyclictest	101712	-21	kworker/u4:3+events_unbound	23:28:00	1
4151297	99	49	42,5	cyclictest	4183558	-21	mailstats	21:10:38	1
4151297	99	48	42,4	cyclictest	4162822	-21	kworker/u4:11+events_unbound	19:55:00	1
4151297	99	48	40,6	cyclictest	4156990	-21	fschecks_time	19:30:21	1
4151296	99	48	44,3	cyclictest	79487	-21	kworker/u4:6+events_unbound	23:12:51	0
4151296	99	48	42,3	cyclictest	0	-21	swapper/0	22:00:39	0
4151296	99	48	38,8	cyclictest	87159	-21	processes	23:00:38	0
4151296	99	48	38,7	cyclictest	4164400	-21	aten_r7power_en	20:00:15	0
4151296	99	48	29,16	cyclictest	0	-21	swapper/0	00:30:35	0
4151296	99	48	25,9	cyclictest	83437	-21	ssh	22:56:09	0
4151296	99	48	14,20	cyclictest	0	-21	swapper/0	23:50:30	0
4151297	99	47	40,5	cyclictest	4180961	-21	grep	21:05:01	1
4151297	99	47	40,5	cyclictest	4151292	-21	cyclictest	21:42:29	1
4151297	99	47	40,5	cyclictest	144103	-21	proc_pri	00:05:38	1
4151297	99	47	39,6	cyclictest	4148784	-21	kworker/u4:3+events_unbound	19:20:00	1
4151297	99	47	38,6	cyclictest	4180901	-21	kworker/u4:17+events_unbound	21:55:44	1
4151297	99	47	37,7	cyclictest	4166879	-21	latency_hist	20:10:01	1
4151296	99	47	41,5	cyclictest	4180901	-21	kworker/u4:17+events_unbound	21:42:45	0
4151296	99	47	40,5	cyclictest	64779	-21	cut	22:35:22	0
4151296	99	47	40,5	cyclictest	4155087	-21	kworker/u4:12+events_unbound	20:14:00	0
4151296	99	47	39,6	cyclictest	4151292	-21	cyclictest	20:20:23	0
4151296	99	47	39,6	cyclictest	122492	-21	/usr/sbin/munin	23:40:40	0
4151296	99	47	38,6	cyclictest	103516	-21	latency_hist	23:20:02	0
4151296	99	47	29,15	cyclictest	0	-21	swapper/0	00:05:25	0
4151297	99	46	39,5	cyclictest	131171	-21	timerwakeupswit	23:50:38	1
4151297	99	46	39,5	cyclictest	103701	-21	acpi	23:20:10	1
4151297	99	46	38,6	cyclictest	55652	-21	df_abs	22:25:17	1
4151297	99	46	35,9	cyclictest	4182189	-21	cron	21:10:00	1
4151297	99	46	35,7	cyclictest	0	-21	swapper/1	21:45:13	1
4151296	99	46	37,7	cyclictest	152357	-21	gltestperf	00:15:23	0
4151296	99	46	37,6	cyclictest	0	-21	swapper/0	21:25:15	0
4151296	99	46	36,8	cyclictest	4191628	-21	aten_r7power_vo	21:20:16	0
4151296	99	46	33,11	cyclictest	0	-21	swapper/0	21:35:11	0
4151296	99	46	28,5	cyclictest	4188010	-21	mailstats	21:15:39	0
4151297	99	45	38,5	cyclictest	147604	-21	aten_r7power_cu	00:10:15	1
4151297	99	45	38,5	cyclictest	147604	-21	aten_r7power_cu	00:10:14	1
4151297	99	45	35,7	cyclictest	0	-21	swapper/1	21:35:32	1
4151297	99	45	30,4	cyclictest	4171948	-21	kworker/u4:4+events_unbound	20:30:01	1
4151296	99	45	38,6	cyclictest	4171946	-21	kworker/u4:1+events_unbound	20:33:47	0
4151296	99	45	38,6	cyclictest	4155087	-21	kworker/u4:12+events_unbound	19:42:59	0
4151296	99	45	38,5	cyclictest	170687	-21	unixbench_multi	00:35:40	0
4151296	99	45	38,4	cyclictest	0	-21	swapper/0	22:17:11	0
4151296	99	45	1,33	cyclictest	7194	-21	ssh	21:30:28	0
4151297	99	44	37,5	cyclictest	4164632	-21	fschecks_time	20:00:19	1
4151297	99	44	35,7	cyclictest	4187065	-21	aten_r7power_en	21:15:17	1
4151297	99	44	34,7	cyclictest	0	-21	swapper/1	23:15:37	1
4151296	99	44	38,5	cyclictest	4157715	-21	kworker/u4:6+events_unbound	19:39:00	0
4151296	99	44	38,4	cyclictest	116988	-21	cut	23:35:18	0
4151296	99	44	37,5	cyclictest	4155089	-21	kworker/u4:14+events_unbound	19:23:02	0
4151296	99	44	37,5	cyclictest	138971	-21	aten_r7power_vo	00:00:19	0
4151296	99	44	37,5	cyclictest	104122	-21	diskmemload	23:20:21	0
4151296	99	44	36,6	cyclictest	22296	-21	kworker/u4:11+events_unbound	21:47:33	0
4151296	99	44	34,6	cyclictest	0	-21	swapper/0	21:50:22	0
4151297	99	43	37,4	cyclictest	95746	-21	ld	23:10:29	1
4151297	99	43	35,6	cyclictest	4159453	-21	fschecks_count	19:40:21	1
4151297	99	43	34,7	cyclictest	134514	-21	aten_r7power_vo	23:55:16	1
4151296	99	43	37,5	cyclictest	4177061	-21	kworker/u4:10+events_unbound	20:50:46	0
4151296	99	43	34,5	cyclictest	0	-21	swapper/0	20:15:39	0
4151297	99	42	35,5	cyclictest	4165389	-21	kworker/u4:3+events_unbound	20:12:11	1
4151297	99	42	33,7	cyclictest	4178106	-21	threads	20:50:37	1
4151297	99	42	33,7	cyclictest	4172234	-21	aten_r7power_en	20:30:18	1
4151296	99	42	36,5	cyclictest	4175788	-21	kworker/u4:1+events_unbound	21:06:58	0
4151296	99	42	33,6	cyclictest	0	-21	swapper/0	00:10:33	0
4151296	99	42	33,6	cyclictest	0	-21	swapper/0	00:10:33	0
4151296	99	42	33,5	cyclictest	4163284	-21	fschecks_count	19:55:20	0
4151297	99	41	34,5	cyclictest	139202	-21	fschecks_time	00:00:22	1
4151297	99	40	32,6	cyclictest	4179453	-21	timerwakeupswit	20:55:38	1
4151297	99	40	32,5	cyclictest	4137532	-21	kworker/u4:16-rpciod	19:10:18	1
4151297	99	39	33,4	cyclictest	4161219	-21	sendmail_mailqu	19:45:36	1
4151297	99	39	32,4	cyclictest	4151327	-21	cat	19:10:00	1
4151296	99	38	30,4	cyclictest	4151222	-21	kworker/u4:8-rpciod	19:50:01	0
4151296	99	34	25,6	cyclictest	0	-21	swapper/0	19:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17