OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Fri Apr 03, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3211368	99	96	87,6	cyclictest	3408166	-21	kworker/u4:3+events_unbound	12:25:15	1
3211368	99	86	49,32	cyclictest	3242326	-21	diskmemload	09:15:12	1
3211366	99	84	9,70	cyclictest	3208854	-21	kworker/u4:7+rpciod	07:10:00	0
3211368	99	82	50,30	cyclictest	3407269	-21	unixbench_multi	12:20:40	1
3211366	99	82	33,29	cyclictest	0	-21	swapper/0	08:15:01	0
3211368	99	81	73,5	cyclictest	3416880	-21	kworker/u4:9+events_unbound	12:35:15	1
3211366	99	79	32,33	cyclictest	3406161	-21	aten_r7power_po	12:20:16	0
3211366	99	77	29,30	cyclictest	0	-21	swapper/0	11:50:35	0
3211366	99	76	28,30	cyclictest	3325572	-21	cat	10:45:38	0
3211366	99	76	28,27	cyclictest	0	-21	swapper/0	09:30:16	0
3211366	99	76	23,30	cyclictest	0	-21	swapper/0	12:15:34	0
3211366	99	75	42,30	cyclictest	3394458	-21	sh	12:05:41	0
3211366	99	75	27,30	cyclictest	0	-21	swapper/0	12:35:21	0
3211366	99	74	19,34	cyclictest	3226032	-21	fschecks_count	08:05:18	0
3211366	99	73	29,41	cyclictest	3240265	-21	fschecks_time	09:00:20	0
3211366	99	73	22,29	cyclictest	0	-21	swapper/0	11:10:24	0
3211366	99	73	22,29	cyclictest	0	-21	swapper/0	11:10:23	0
3211368	99	72	63,6	cyclictest	3215257	-21	kworker/u4:9+events_unbound	09:04:42	1
3211368	99	72	35,8	cyclictest	3212584	-21	kworker/u4:4-rpciod	07:20:36	1
3211366	99	72	28,29	cyclictest	3211364	-21	cyclictest	07:50:30	0
3211368	99	69	60,7	cyclictest	3330984	-21	kworker/u4:7+events_unbound	11:04:59	1
3211366	99	69	34,32	cyclictest	3255772	-21	sh	09:25:15	0
3211366	99	67	59,6	cyclictest	3301048	-21	kworker/u4:9+events_unbound	10:24:51	0
3211366	99	67	35,30	cyclictest	3252455	-21	switchtime	09:20:36	0
3211366	99	67	35,29	cyclictest	3218931	-21	unixbench-2d	07:35:36	0
3211366	99	67	35,28	cyclictest	3212585	-21	kworker/u4:8-rpciod	07:30:17	0
3211366	99	67	34,30	cyclictest	3367480	-21	aten_r7power_cu	11:35:16	0
3211366	99	66	36,28	cyclictest	3414694	-21	aten2__	12:30:21	0
3211366	99	66	28,35	cyclictest	3228107	-21	kworker/u4:4+rpciod	08:20:16	0
3211368	99	65	55,7	cyclictest	3301046	-21	kworker/u4:5+events_unbound	10:39:52	1
3211366	99	65	5,24	cyclictest	3242326	-21	diskmemload	10:00:11	0
3211366	99	65	3,6	cyclictest	3295150	-21	ntpq	10:10:25	0
3211366	99	65	35,27	cyclictest	3268932	-21	df_abs	09:40:16	0
3211366	99	65	34,29	cyclictest	3264438	-21	aten_r7power_cu	09:35:15	0
3211368	99	64	47,9	cyclictest	0	-21	swapper/1	09:45:23	1
3211366	99	64	35,27	cyclictest	3376927	-21	ps	11:45:35	0
3211366	99	64	35,27	cyclictest	3236175	-21	aten_r7power_po	08:45:15	0
3211366	99	64	3,16	cyclictest	3221207	-21	ntpq	07:45:29	0
3211366	99	64	2,17	cyclictest	3212103	-21	ntpq	07:10:28	0
3211366	99	64	2,16	cyclictest	3272982	-21	apt-get	09:45:12	0
3211366	99	64	20,40	cyclictest	3357143	-21	kworker/u4:0+rpciod	11:40:29	0
3211366	99	64	1,13	cyclictest	3384509	-21	apt-get	11:55:11	0
3211368	99	63	55,5	cyclictest	3378226	-21	kworker/u4:2+events_unbound	12:19:59	1
3211366	99	63	33,27	cyclictest	3308479	-21	diskmemload	10:25:38	0
3211366	99	63	33,27	cyclictest	3308479	-21	diskmemload	10:25:37	0
3211366	99	63	28,29	cyclictest	0	-21	swapper/0	08:15:03	0
3211366	99	63	23,37	cyclictest	256	50	irq/23-42890000.ethernet	12:00:39	0
3211366	99	63	23,37	cyclictest	256	50	irq/23-42890000.ethernet	12:00:38	0
3211366	99	62	3,13	cyclictest	3358887	-21	apt-get	11:25:11	0
3211366	99	62	28,32	cyclictest	3290302	-21	aten_r7power_cu	10:05:17	0
3211366	99	62	28,32	cyclictest	0	-21	swapper/0	10:35:35	0
3211366	99	62	25,35	cyclictest	483	-21	weston-desktop-	11:21:59	0
3211366	99	62	2,13	cyclictest	3315667	-21	apt	10:35:00	0
3211366	99	61	2,13	cyclictest	3350702	-21	ssh	11:15:18	0
3211366	99	60	52,6	cyclictest	3365193	-21	kworker/u4:12+events_unbound	11:35:00	0
3211366	99	60	33,24	cyclictest	3243828	-21	unixbench-2d	09:10:39	0
3211366	99	60	33,24	cyclictest	3243828	-21	unixbench-2d	09:10:38	0
3211366	99	60	30,28	cyclictest	3320461	-21	cpu	10:40:15	0
3211366	99	60	2,11	cyclictest	3410003	-21	apt-get	12:25:05	0
3211366	99	60	2,10	cyclictest	3237368	-21	apt-get	08:50:11	0
3211368	99	59	50,7	cyclictest	398	-21	systemd-logind	11:19:58	1
3211366	99	59	4,5	cyclictest	3223756	-21	ntpq	07:55:25	0
3211366	99	59	3,16	cyclictest	3328811	-21	apt-get	10:50:15	0
3211366	99	59	27,29	cyclictest	0	-21	swapper/0	10:55:37	0
3211366	99	59	27,28	cyclictest	0	-21	swapper/0	08:30:21	0
3211366	99	59	2,6	cyclictest	3277851	-21	irqstats	09:50:22	0
3211366	99	59	2,11	cyclictest	3248360	-21	ssh	09:15:44	0
3211366	99	59	1,8	cyclictest	3214815	-21	ntpq	07:20:31	0
3211366	99	59	1,6	cyclictest	3298786	-21	ssh	10:15:11	0
3211366	99	59	1,6	cyclictest	3298786	-21	ssh	10:15:10	0
3211366	99	58	6,18	cyclictest	3398066	-21	ssh	12:10:24	0
3211366	99	58	51,5	cyclictest	3344052	-21	kworker/u4:2+events_unbound	11:10:01	0
3211366	99	58	3,10	cyclictest	3231618	-21	ntpq	08:25:30	0
3211366	99	58	2,9	cyclictest	3281575	-21	apt-get	09:55:11	0
3211366	99	58	2,13	cyclictest	3225105	-21	ntpq	08:00:27	0
3211366	99	58	1,16	cyclictest	3234105	-21	ntpq	08:35:26	0
3211368	99	57	48,7	cyclictest	3257912	-21	kworker/u4:7+events_unbound	09:44:47	1
3211368	99	57	47,8	cyclictest	3311255	-21	systemd	10:29:50	1
3211368	99	57	47,8	cyclictest	3311255	-21	systemd	10:29:49	1
3211368	99	57	44,9	cyclictest	3359705	-21	ssh	11:25:33	1
3211366	99	57	3,6	cyclictest	3213479	-21	ntpq	07:15:38	0
3211366	99	57	2,14	cyclictest	3235457	-21	ntpq	08:40:30	0
3211366	99	57	1,6	cyclictest	3337728	-21	diskstats	11:00:19	0
3211366	99	56	3,7	cyclictest	3239306	-21	ntpq	08:55:32	0
3211366	99	56	2,7	cyclictest	3215458	-21	apt-get	07:25:11	0
3211368	99	55	47,5	cyclictest	3238442	-21	kworker/u4:8+events_unbound	09:00:01	1
3211368	99	55	40,9	cyclictest	3415283	-21	ssh	12:30:28	1
3211366	99	55	4,5	cyclictest	3241215	-21	apt-get	09:05:11	0
3211366	99	55	28,25	cyclictest	3219563	-21	grep	07:40:20	0
3211368	99	54	45,6	cyclictest	3261009	-21	sendmail_mailqu	09:30:37	1
3211368	99	53	44,6	cyclictest	3355264	-21	ntp_kernel_err	11:20:24	1
3211368	99	52	44,6	cyclictest	3314147	-21	kworker/u4:2+events_unbound	10:34:51	1
3211368	99	52	40,7	cyclictest	3367143	-21	idleruntime-cro	11:35:00	1
3211368	99	52	39,9	cyclictest	0	-21	swapper/1	11:55:34	1
3211368	99	51	44,5	cyclictest	3376011	-21	aten2__	11:45:14	1
3211368	99	51	43,6	cyclictest	3265072	-21	ntpq	09:35:28	1
3211368	99	51	43,5	cyclictest	3220035	-21	sendmail_mailqu	07:40:35	1
3211368	99	51	42,6	cyclictest	3341711	-21	dpkg	11:05:10	1
3211368	99	51	41,7	cyclictest	3337141	-21	sh	11:00:00	1
3211368	99	51	41,7	cyclictest	3317872	-21	kworker/u4:4-rpciod	10:45:22	1
3211368	99	51	41,7	cyclictest	3253521	-21	kworker/u4:6+events_unbound	09:24:45	1
3211368	99	51	41,7	cyclictest	3228106	-21	kworker/u4:3+events_unbound	08:29:36	1
3211368	99	51	39,7	cyclictest	3391320	-21	kworker/u4:12-rpciod	12:06:58	1
3211368	99	51	38,11	cyclictest	3228251	-21	apt-key	08:15:01	1
3211368	99	50	43,5	cyclictest	3368573	-21	timerwakeupswit	11:35:38	1
3211368	99	49	6,12	cyclictest	17	1	rcu_preempt	11:10:33	1
3211368	99	49	6,12	cyclictest	17	1	rcu_preempt	11:10:32	1
3211368	99	49	41,6	cyclictest	3215257	-21	kworker/u4:9+events_unbound	08:09:34	1
3211368	99	49	40,7	cyclictest	3298369	-21	systemd	10:14:48	1
3211368	99	49	40,7	cyclictest	3213190	-21	fschecks_time	07:15:28	1
3211368	99	48	38,7	cyclictest	3304136	-21	sendmail_mailqu	10:20:41	1
3211368	99	48	38,6	cyclictest	3321494	-21	unixbench_multi	10:40:39	1
3211368	99	48	37,8	cyclictest	3299296	-21	gltestperf	10:15:20	1
3211368	99	48	37,8	cyclictest	3299296	-21	gltestperf	10:15:19	1
3211368	99	47	40,5	cyclictest	3384375	-21	latency_hist	11:55:01	1
3211368	99	47	40,5	cyclictest	3234587	-21	kworker/u4:0+events_unbound	08:39:38	1
3211368	99	47	40,5	cyclictest	1053	-21	sshd	09:09:43	1
3211368	99	47	38,6	cyclictest	3256025	-21	fschecks_count	09:25:17	1
3211368	99	47	37,7	cyclictest	3220368	-21	kworker/u4:6-rpciod	08:00:00	1
3211368	99	46	39,5	cyclictest	3220895	-21	sort	07:45:24	1
3211368	99	46	38,5	cyclictest	3243204	-21	kernelversion	09:10:21	1
3211368	99	46	38,5	cyclictest	3243204	-21	kernelversion	09:10:21	1
3211368	99	46	36,8	cyclictest	0	-21	swapper/1	09:55:17	1
3211368	99	46	36,7	cyclictest	3382578	-21	kworker/u4:11-rpciod	12:00:26	1
3211368	99	46	36,7	cyclictest	3382578	-21	kworker/u4:11-rpciod	12:00:26	1
3211368	99	45	5,30	cyclictest	3290889	-21	ssh	10:05:27	1
3211368	99	45	37,6	cyclictest	3215257	-21	kworker/u4:9+events_unbound	07:54:31	1
3211368	99	45	36,5	cyclictest	3401513	-21	ls	12:15:01	1
3211368	99	45	34,7	cyclictest	0	-21	swapper/1	10:00:31	1
3211368	99	45	33,8	cyclictest	0	-21	swapper/1	07:10:29	1
3211368	99	44	34,6	cyclictest	3369550	-21	kworker/u4:18-rpciod	11:40:25	1
3211368	99	44	33,7	cyclictest	0	-21	swapper/1	10:50:30	1
3211368	99	43	35,6	cyclictest	3215257	-21	kworker/u4:9+events_unbound	08:04:32	1
3211368	99	43	35,5	cyclictest	3208851	-21	kworker/u4:1-rpciod	07:25:34	1
3211368	99	43	34,5	cyclictest	0	-21	swapper/1	09:50:22	1
3211368	99	43	32,6	cyclictest	3228106	-21	kworker/u4:3-rpciod	08:30:15	1
3211368	99	42	32,8	cyclictest	3230888	-21	latency_hist	08:25:07	1
3211368	99	42	30,9	cyclictest	0	-21	swapper/1	08:40:20	1
3211368	99	41	30,8	cyclictest	0	-21	swapper/1	07:40:00	1
3211368	99	39	33,4	cyclictest	3229539	-21	sendmail	08:20:00	1
3211368	99	39	28,9	cyclictest	0	-21	swapper/1	08:50:38	1
3211368	99	39	25,10	cyclictest	0	-21	swapper/1	08:45:14	1
3211368	99	37	31,4	cyclictest	3216757	-21	aten2__	07:30:14	1
3211368	99	31	21,6	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17