OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Sun Sep 20, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3354404	99	182	166,12	cyclictest	53	-21	kswapd0	11:55:07	0
3354404	99	118	102,11	cyclictest	3516969	-21	kworker/u4:11+events_unbound	11:40:04	0
3354405	99	101	93,6	cyclictest	3341723	-21	kworker/u4:6+events_unbound	07:14:11	1
3354405	99	94	76,5	cyclictest	3490459	-21	kworker/u4:2+events_unbound	11:50:07	1
3354405	99	85	79,4	cyclictest	3504042	-21	kworker/u4:7+events_unbound	11:30:04	1
3354405	99	84	76,6	cyclictest	3539709	-21	kworker/u4:3+events_unbound	12:15:12	1
3354405	99	84	76,6	cyclictest	3539709	-21	kworker/u4:3+events_unbound	12:15:12	1
3354405	99	84	76,6	cyclictest	3410206	-21	kworker/u4:7+events_unbound	09:39:38	1
3354405	99	82	75,5	cyclictest	3428375	-21	kworker/u4:16+events_unbound	09:59:47	1
3354405	99	78	71,5	cyclictest	3154698	-21	kworker/u4:0+events_unbound	07:29:15	1
3354405	99	77	68,7	cyclictest	53	-21	kswapd0	12:20:12	1
3354405	99	76	67,6	cyclictest	3376160	-21	kworker/u4:18+events_unbound	09:14:35	1
3354405	99	76	56,8	cyclictest	3371044	-21	kworker/u4:10+events_unbound	08:14:22	1
3354404	99	76	66,7	cyclictest	3499489	-21	kworker/u4:0+events_unbound	11:30:02	0
3354404	99	75	54,19	cyclictest	53	-21	kswapd0	09:45:11	0
3354405	99	73	55,11	cyclictest	3383848	-21	modprobe	09:05:00	1
3354405	99	69	61,6	cyclictest	3428370	-21	kworker/u4:6+events_unbound	10:14:48	1
3354404	99	69	62,5	cyclictest	3494973	-21	kworker/u4:3+events_unbound	11:14:59	0
3354405	99	67	55,9	cyclictest	37	-21	kcompactd0	12:26:25	1
3354405	99	66	51,7	cyclictest	3360831	-21	kworker/u4:5+events_unbound	08:04:20	1
3354405	99	65	58,5	cyclictest	3428371	-21	kworker/u4:9+events_unbound	10:04:47	1
3354405	99	64	53,8	cyclictest	378	-21	dbus-daemon	10:39:53	1
3354404	99	64	54,7	cyclictest	3515076	-21	aten2__	11:35:15	0
3354405	99	63	54,7	cyclictest	3371044	-21	kworker/u4:10+events_unbound	08:44:30	1
3354404	99	63	56,5	cyclictest	3401106	-21	kworker/u4:10+events_unbound	09:29:39	0
3354404	99	63	55,6	cyclictest	3539710	-21	kworker/u4:4+events_unbound	12:20:13	0
3354405	99	62	51,8	cyclictest	53	-21	kswapd0	11:20:14	1
3354405	99	62	51,8	cyclictest	53	-21	kswapd0	11:20:14	1
3354404	99	62	49,6	cyclictest	3570805	-21	kworker/u4:0+events_unbound	12:40:01	0
3354404	99	60	52,6	cyclictest	3473067	-21	kworker/u4:10+events_unbound	10:49:56	0
3354404	99	59	46,10	cyclictest	0	-21	swapper/0	08:00:40	0
3354405	99	58	42,6	cyclictest	3526083	-21	kworker/u4:0+events_unbound	11:50:01	1
3354405	99	57	49,6	cyclictest	3371043	-21	kworker/u4:8+events_unbound	08:29:29	1
3354405	99	56	48,6	cyclictest	3467872	-21	kworker/u4:6+events_unbound	11:04:57	1
3354405	99	56	48,6	cyclictest	3428375	-21	kworker/u4:16+events_unbound	10:09:49	1
3354405	99	56	44,8	cyclictest	3418625	-21	kworker/u4:10-rpciod	09:46:51	1
3354404	99	56	48,6	cyclictest	3376160	-21	kworker/u4:18+events_unbound	09:09:34	0
3354405	99	55	47,6	cyclictest	3476933	-21	kworker/u4:13+events_unbound	10:55:46	1
3354405	99	55	47,6	cyclictest	3369773	-21	kworker/u4:7+events_unbound	08:39:29	1
3354405	99	55	46,7	cyclictest	3341723	-21	kworker/u4:6+events_unbound	07:20:01	1
3354404	99	55	47,6	cyclictest	3369773	-21	kworker/u4:7+events_unbound	08:59:33	0
3354404	99	55	46,6	cyclictest	3539710	-21	kworker/u4:4+events_unbound	12:05:10	0
3354404	99	55	46,6	cyclictest	3539710	-21	kworker/u4:4+events_unbound	12:05:10	0
3354404	99	55	31,17	cyclictest	53	-21	kswapd0	10:05:08	0
3354404	99	55	18,27	cyclictest	3532709	-21	ssh	11:55:01	0
3354405	99	54	47,5	cyclictest	3384767	-21	sendmail_mailqu	09:05:38	1
3354404	99	54	46,6	cyclictest	3428375	-21	kworker/u4:16+events_unbound	10:00:03	0
3354405	99	53	45,6	cyclictest	3369773	-21	kworker/u4:7+events_unbound	08:24:26	1
3354405	99	53	43,7	cyclictest	3473067	-21	kworker/u4:10+events_unbound	10:50:34	1
3354405	99	53	41,9	cyclictest	0	-21	swapper/1	09:40:13	1
3354404	99	53	45,6	cyclictest	3372325	-21	kworker/u4:13+events_unbound	08:54:32	0
3354404	99	53	44,6	cyclictest	0	-21	swapper/0	12:15:31	0
3354404	99	53	44,6	cyclictest	0	-21	swapper/0	12:15:31	0
3354404	99	53	43,7	cyclictest	378	-21	dbus-daemon	09:04:33	0
3354404	99	53	42,6	cyclictest	0	-21	swapper/0	11:05:34	0
3354404	99	53	42,6	cyclictest	0	-21	swapper/0	11:05:34	0
3354404	99	52	47,3	cyclictest	3369770	-21	kworker/u4:2+events_unbound	08:14:24	0
3354404	99	52	46,4	cyclictest	3564168	-21	acpi	12:30:14	0
3354404	99	52	45,5	cyclictest	3546789	-21	gltestperf	12:10:23	0
3354404	99	52	43,7	cyclictest	3430137	-21	ssh	10:00:01	0
3354405	99	51	44,5	cyclictest	3367206	-21	kworker/u4:1+events_unbound	08:09:21	1
3354405	99	51	40,8	cyclictest	3492835	-21	aten2__	11:10:18	1
3354405	99	51	40,7	cyclictest	3390836	-21	ntp_states	09:15:33	1
3354404	99	51	44,5	cyclictest	3498492	-21	unixbench_multi	11:15:40	0
3354404	99	51	43,6	cyclictest	3372324	-21	kworker/u4:12+events_unbound	08:34:30	0
3354405	99	50	43,5	cyclictest	3497903	-21	ntpq	11:15:26	1
3354405	99	50	43,5	cyclictest	3372324	-21	kworker/u4:12+events_unbound	08:19:25	1
3354405	99	50	42,5	cyclictest	3499493	-21	kworker/u4:8+events_unbound	11:35:02	1
3354405	99	50	2,40	cyclictest	3404442	-21	ssh	09:30:35	1
3354404	99	50	43,5	cyclictest	3458816	-21	kworker/u4:9+events_unbound	10:31:10	0
3354404	99	50	42,6	cyclictest	3358204	-21	kworker/u4:11+events_unbound	09:34:39	0
3354404	99	50	42,5	cyclictest	15	1	ktimers/0	09:36:50	0
3354404	99	50	40,8	cyclictest	3374146	-21	fschecks_time	08:25:20	0
3354404	99	50	37,5	cyclictest	3423832	-21	kworker/u4:15+events_unbound	09:54:44	0
3354405	99	49	42,5	cyclictest	3421962	-21	gltestperf	09:50:25	1
3354405	99	49	42,5	cyclictest	3356904	-21	kworker/u4:1+events_unbound	07:34:16	1
3354405	99	49	41,6	cyclictest	3539709	-21	kworker/u4:3+events_unbound	12:03:23	1
3354405	99	49	41,6	cyclictest	3452686	-21	munin-node	10:25:12	1
3354405	99	49	41,6	cyclictest	3369773	-21	kworker/u4:7+events_unbound	08:55:01	1
3354405	99	49	39,7	cyclictest	3448002	-21	latency_hist	10:20:01	1
3354405	99	49	31,12	cyclictest	0	-21	swapper/1	11:40:24	1
3354404	99	49	40,7	cyclictest	3154698	-21	kworker/u4:0+events_unbound	07:24:14	0
3354404	99	49	40,6	cyclictest	3454952	-21	kworker/u4:7+events_unbound	10:30:01	0
3354404	99	49	39,8	cyclictest	3362099	-21	kworker/u4:6+rpciod	09:10:16	0
3354404	99	49	29,18	cyclictest	3462861	-21	ssh	10:35:41	0
3354405	99	48	4,31	cyclictest	3379521	-21	ntpq	08:45:28	1
3354405	99	48	37,9	cyclictest	3362609	-21	fschecks_count	07:40:18	1
3354405	99	48	35,8	cyclictest	0	-21	swapper/1	10:30:38	1
3354404	99	48	41,5	cyclictest	3358690	-21	fschecks_count	07:25:19	0
3354404	99	48	41,5	cyclictest	3354402	-21	cyclictest	12:25:40	0
3354404	99	48	40,6	cyclictest	3517634	-21	kworker/u4:12+events_unbound	11:45:06	0
3354404	99	48	35,9	cyclictest	0	-21	swapper/0	10:23:16	0
3354404	99	48	33,10	cyclictest	0	-21	swapper/0	09:16:21	0
3354405	99	47	39,6	cyclictest	3360831	-21	kworker/u4:5+events_unbound	07:54:18	1
3354405	99	47	39,6	cyclictest	3360831	-21	kworker/u4:5+events_unbound	07:54:18	1
3354405	99	47	36,7	cyclictest	0	-21	swapper/1	11:05:32	1
3354405	99	47	36,7	cyclictest	0	-21	swapper/1	11:05:32	1
3354405	99	47	35,9	cyclictest	3399661	-21	gltestperf	09:25:26	1
3354405	99	47	35,9	cyclictest	0	-21	swapper/1	12:05:29	1
3354405	99	47	35,9	cyclictest	0	-21	swapper/1	12:05:29	1
3354404	99	47	40,5	cyclictest	3413544	-21	mailstats	09:40:38	0
3354404	99	47	40,5	cyclictest	3360862	-21	sh	07:35:00	0
3354404	99	47	33,12	cyclictest	3484906	-21	processes	11:00:38	0
3354405	99	46	39,5	cyclictest	3442009	-21	kworker/u4:10+events_unbound	10:24:24	1
3354405	99	46	38,5	cyclictest	3530611	-21	kworker/u4:6-rpciod	11:55:30	1
3354405	99	46	38,5	cyclictest	3364467	-21	timerandwakeup	07:45:37	1
3354405	99	46	37,6	cyclictest	3357475	-21	fschecks_time	07:20:20	1
3354405	99	46	36,7	cyclictest	3381652	-21	df_abs	08:55:17	1
3354405	99	46	33,10	cyclictest	3565446	-21	grep	12:30:45	1
3354404	99	46	39,5	cyclictest	3395318	-21	ld	09:20:29	0
3354404	99	46	38,5	cyclictest	3439984	-21	/usr/sbin/munin	10:10:27	0
3354404	99	46	37,7	cyclictest	3466165	-21	aten_r7power_cu	10:40:16	0
3354405	99	45	38,5	cyclictest	3569298	-21	ntp_kernel_err	12:35:26	1
3354405	99	45	38,5	cyclictest	3499490	-21	kworker/u4:1+events_unbound	11:26:44	1
3354405	99	45	38,5	cyclictest	3362099	-21	kworker/u4:6+events_unbound	07:39:17	1
3354405	99	45	38,5	cyclictest	3362099	-21	kworker/u4:6+events_unbound	07:39:17	1
3354405	99	45	38,5	cyclictest	3353129	-21	kworker/u4:9+events_unbound	07:10:01	1
3354405	99	45	37,6	cyclictest	3547639	-21	unixbench_singl	12:10:43	1
3354405	99	45	36,7	cyclictest	3398829	-21	apt-config	09:25:01	1
3354404	99	45	35,8	cyclictest	3502671	-21	sendmail_mailqu	11:20:38	0
3354404	99	45	35,8	cyclictest	3502671	-21	sendmail_mailqu	11:20:37	0
3354404	99	45	26,16	cyclictest	0	-21	swapper/0	11:25:37	0
3354404	99	44	38,4	cyclictest	3479563	-21	aten_r7power_en	10:55:17	0
3354404	99	44	30,4	cyclictest	3353129	-21	kworker/u4:9+events_unbound	08:50:02	0
3354405	99	43	37,4	cyclictest	3367215	-21	systemd	07:59:19	1
3354405	99	43	35,6	cyclictest	0	-21	swapper/1	10:40:38	1
3354404	99	43	37,4	cyclictest	3356118	-21	fschecks_time	07:15:21	0
3354404	99	43	35,6	cyclictest	3476931	-21	kworker/u4:11+rpciod	10:54:55	0
3354404	99	43	33,6	cyclictest	256	50	irq/23-42890000.ethernet	12:00:31	0
3354404	99	42	36,4	cyclictest	3362680	-21	gltestperf	07:40:19	0
3354404	99	42	35,5	cyclictest	3361270	-21	fschecks_count	07:35:20	0
3354404	99	42	35,5	cyclictest	3361270	-21	fschecks_count	07:35:20	0
3354404	99	42	34,6	cyclictest	3443837	-21	aten2__	10:15:17	0
3354404	99	42	34,6	cyclictest	3355431	-21	timerandwakeup	07:10:38	0
3354404	99	42	33,7	cyclictest	3372743	-21	df_abs	08:20:16	0
3354404	99	42	33,7	cyclictest	3364333	-21	sendmail_mailqu	07:45:36	0
3354405	99	41	33,5	cyclictest	3470538	-21	apt-get	10:45:14	1
3354404	99	41	33,6	cyclictest	3366205	-21	aten_r7power_en	07:55:16	0
3354404	99	41	32,6	cyclictest	3376412	-21	aten_r7power_cu	08:35:16	0
3354404	99	40	32,6	cyclictest	0	-21	swapper/0	08:15:36	0
3354404	99	40	32,5	cyclictest	0	-21	swapper/0	07:50:19	0
3354404	99	40	32,5	cyclictest	0	-21	swapper/0	07:50:19	0
3354404	99	40	31,6	cyclictest	3368786	-21	aten_r7power_po	08:05:17	0
3354405	99	39	26,9	cyclictest	0	-21	swapper/1	08:30:26	1
3354404	99	38	31,5	cyclictest	3377945	-21	grep	08:40:21	0
3354404	99	22	17,3	cyclictest	256	50	irq/23-42890000.ethernet	07:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17