OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sun Jul 19, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3462811	99	104	90,11	cyclictest	53	-21	kswapd0	11:00:32	0
3462812	99	103	93,7	cyclictest	3536810	-21	kworker/u4:0+events_unbound	10:40:28	1
3462811	99	99	16,12	cyclictest	3462810	-21	modprobe	07:09:59	0
3462812	99	95	87,6	cyclictest	3558636	-21	kworker/u4:1+events_unbound	10:35:27	1
3462811	99	86	65,18	cyclictest	3518740	-21	kworker/u4:7+events_unbound	09:40:20	0
3462811	99	84	46,34	cyclictest	3498043	-21	cron	09:15:00	0
3462811	99	84	37,5	cyclictest	3551707	-21	idleruntime-cro	10:15:01	0
3462811	99	79	47,29	cyclictest	3605466	-21	fschecks_count	11:15:19	0
3462812	99	78	70,6	cyclictest	3607520	-21	kworker/u4:3+events_unbound	11:30:39	1
3462811	99	76	44,29	cyclictest	3543147	-21	dpkg	10:05:12	0
3462811	99	76	39,34	cyclictest	3508346	-21	/usr/sbin/munin	09:25:37	0
3462811	99	76	36,37	cyclictest	0	-21	swapper/0	10:50:17	0
3462812	99	75	66,6	cyclictest	3464037	-21	kworker/u4:9+events_unbound	08:00:01	1
3462811	99	74	64,7	cyclictest	53	-21	kswapd0	11:05:33	0
3462811	99	74	36,5	cyclictest	0	-21	swapper/0	11:30:34	0
3462811	99	74	36,34	cyclictest	0	-21	swapper/0	11:45:31	0
3462812	99	73	64,7	cyclictest	3567631	-21	kworker/u4:13+events_unbound	10:50:31	1
3462812	99	72	63,7	cyclictest	3594010	-21	kworker/u4:9+events_unbound	11:15:36	1
3462812	99	72	61,8	cyclictest	3518740	-21	kworker/u4:7+events_unbound	10:15:25	1
3462812	99	71	53,6	cyclictest	3496437	-21	kworker/u4:1+events_unbound	09:25:16	1
3462811	99	71	39,29	cyclictest	3482484	-21	gltestperf	08:25:22	0
3462811	99	71	35,6	cyclictest	3479225	-21	unixbench-2d	08:10:38	0
3462811	99	71	34,34	cyclictest	0	-21	swapper/0	09:20:27	0
3462811	99	71	33,34	cyclictest	3517463	-21	processes	09:35:41	0
3462811	99	71	31,6	cyclictest	0	-21	swapper/0	10:15:24	0
3462811	99	71	30,8	cyclictest	3485891	-21	sed	08:40:02	0
3462811	99	70	35,5	cyclictest	3610906	-21	grep	11:20:40	0
3462811	99	69	33,6	cyclictest	0	-21	swapper/0	10:45:38	0
3462811	99	67	60,5	cyclictest	3642945	-21	kworker/u4:4+events_unbound	12:35:52	0
3462811	99	67	31,6	cyclictest	0	-21	swapper/0	08:00:29	0
3462812	99	66	59,5	cyclictest	3496437	-21	kworker/u4:1+events_unbound	09:20:14	1
3462811	99	66	37,4	cyclictest	3663895	-21	threads	12:20:42	0
3462811	99	65	35,10	cyclictest	53	-21	kswapd0	10:25:10	0
3462811	99	63	30,7	cyclictest	0	-21	swapper/0	09:51:46	0
3462811	99	63	30,29	cyclictest	0	-21	swapper/0	10:35:31	0
3462811	99	63	29,8	cyclictest	3468583	-21	kernelversion	07:30:23	0
3462811	99	61	53,5	cyclictest	3518739	-21	kworker/u4:4+events_unbound	09:55:21	0
3462812	99	60	51,6	cyclictest	3638428	-21	kworker/u4:7+events_unbound	12:00:46	1
3462812	99	59	51,5	cyclictest	0	-21	swapper/1	07:15:31	1
3462811	99	59	50,7	cyclictest	3464034	-21	kworker/u4:5+events_unbound	09:15:13	0
3462812	99	58	51,5	cyclictest	3544494	-21	/usr/sbin/munin	10:05:40	1
3462811	99	58	51,5	cyclictest	3474256	-21	kworker/u4:1+events_unbound	08:30:04	0
3462812	99	57	51,4	cyclictest	3607523	-21	kworker/u4:6+events_unbound	11:30:01	1
3462812	99	57	51,4	cyclictest	3532320	-21	kworker/u4:15+events_unbound	09:55:00	1
3462812	99	57	49,6	cyclictest	3594010	-21	kworker/u4:9+events_unbound	11:20:36	1
3462812	99	57	36,13	cyclictest	3488413	-21	kworker/u4:15	08:50:01	1
3462811	99	56	52,2	cyclictest	19	50	rcuc/0	08:00:01	0
3462811	99	56	46,7	cyclictest	0	-21	swapper/0	11:35:34	0
3462812	99	55	40,12	cyclictest	3644778	-21	munin-run	12:00:01	1
3462812	99	53	46,4	cyclictest	0	-21	swapper/1	07:54:58	1
3462812	99	53	46,4	cyclictest	0	-21	swapper/1	07:54:57	1
3462812	99	53	37,11	cyclictest	0	-21	swapper/1	10:10:36	1
3462811	99	53	44,6	cyclictest	3450340	-21	kworker/u4:14+events_unbound	08:45:07	0
3462812	99	52	41,7	cyclictest	3478113	-21	modprobe	08:10:00	1
3462811	99	52	45,5	cyclictest	3484476	-21	kworker/u4:9+events_unbound	08:50:09	0
3462811	99	52	42,8	cyclictest	3657705	-21	sshd	12:14:30	0
3462811	99	52	41,9	cyclictest	3601847	-21	timerwakeupswit	11:10:38	0
3462812	99	51	44,5	cyclictest	3667862	-21	ld	12:25:27	1
3462812	99	51	44,5	cyclictest	3529590	-21	idleruntime-cro	09:50:01	1
3462812	99	51	41,7	cyclictest	3623840	-21	diskmemload	11:35:36	1
3462812	99	51	38,9	cyclictest	53	-21	kswapd0	12:30:16	1
3462811	99	51	45,4	cyclictest	3539104	-21	fschecks_time	10:00:19	0
3462811	99	51	35,13	cyclictest	53	-21	kswapd0	10:55:13	0
3462811	99	50	30,18	cyclictest	0	-21	swapper/0	07:20:19	0
3462811	99	49	41,6	cyclictest	3645993	-21	/usr/sbin/munin	12:00:36	0
3462811	99	49	40,6	cyclictest	3672812	-21	unixbench-2d	12:30:40	0
3462811	99	49	37,8	cyclictest	0	-21	swapper/0	10:40:38	0
3462812	99	48	42,4	cyclictest	0	-21	swapper/1	11:05:33	1
3462812	99	48	42,4	cyclictest	0	-21	swapper/1	10:20:24	1
3462812	99	48	41,5	cyclictest	3565781	-21	/usr/sbin/munin	10:30:23	1
3462812	99	48	38,7	cyclictest	3534660	-21	fschecks_count	09:55:20	1
3462812	99	48	37,8	cyclictest	3627370	-21	wget	11:40:15	1
3462811	99	48	39,7	cyclictest	3667667	-21	gltestperf	12:25:22	0
3462811	99	48	38,8	cyclictest	3640983	-21	/usr/sbin/munin	11:55:20	0
3462812	99	47	41,4	cyclictest	3496437	-21	kworker/u4:1-rpciod	09:35:17	1
3462812	99	47	41,4	cyclictest	3494841	-21	sendmail_mailqu	09:10:38	1
3462812	99	47	40,5	cyclictest	3472854	-21	unixbench-2d	07:45:40	1
3462812	99	47	39,6	cyclictest	317	-21	systemd-journal	11:01:45	1
3462812	99	47	39,6	cyclictest	0	-21	swapper/1	12:20:27	1
3462812	99	47	39,5	cyclictest	3541328	-21	kworker/u4:9+events_unbound	10:03:46	1
3462812	99	47	39,5	cyclictest	3467908	-21	modprobe	07:29:59	1
3462812	99	47	37,8	cyclictest	3660830	-21	sshd	12:17:30	1
3462811	99	47	41,3	cyclictest	0	-21	swapper/0	10:30:39	0
3462811	99	47	40,5	cyclictest	3481258	-21	gltestperf	08:20:20	0
3462811	99	47	39,6	cyclictest	53	-21	kswapd0	11:50:06	0
3462811	99	47	37,8	cyclictest	3479750	-21	df_abs	08:15:15	0
3462812	99	46	39,5	cyclictest	3633083	-21	unixbench_singl	11:45:42	1
3462812	99	46	39,5	cyclictest	3513205	-21	unixbench_multi	09:30:42	1
3462812	99	46	39,5	cyclictest	3484507	-21	munin-plugin-st	08:35:00	1
3462812	99	46	34,9	cyclictest	3470467	-21	munin-plugin-st	07:40:00	1
3462811	99	46	39,5	cyclictest	3614561	-21	/usr/sbin/munin	11:25:22	0
3462811	99	46	37,6	cyclictest	3662424	-21	kworker/u4:1	12:19:59	0
3462811	99	46	37,6	cyclictest	3448977	-21	kworker/u4:8+events_unbound	07:39:56	0
3462811	99	46	36,8	cyclictest	3473244	-21	aten_r7power_en	07:50:17	0
3462811	99	46	36,8	cyclictest	3473244	-21	aten_r7power_en	07:50:16	0
3462811	99	46	27,16	cyclictest	0	-21	swapper/0	12:05:29	0
3462811	99	46	27,16	cyclictest	0	-21	swapper/0	12:05:28	0
3462812	99	45	39,4	cyclictest	0	-21	swapper/1	10:55:25	1
3462812	99	45	38,5	cyclictest	3636641	-21	cut	11:50:24	1
3462812	99	45	38,5	cyclictest	3502565	-21	sendmail	09:20:00	1
3462812	99	45	38,5	cyclictest	3493584	-21	latency_hist	09:10:00	1
3462812	99	45	38,5	cyclictest	3486054	-21	apt-get	08:40:15	1
3462812	99	45	38,5	cyclictest	3484790	-21	aten_r7power_vo	08:35:17	1
3462812	99	45	37,6	cyclictest	3521957	-21	sendmail_mailqu	09:40:37	1
3462812	99	45	37,5	cyclictest	0	-21	swapper/1	07:14:50	1
3462812	99	45	36,6	cyclictest	3576623	-21	kworker/u4:7+events_unbound	10:45:30	1
3462812	99	45	35,7	cyclictest	3465303	-21	kworker/u4:10+events_unbound	08:55:11	1
3462812	99	45	31,11	cyclictest	3560985	-21	basename	10:25:21	1
3462811	99	45	37,6	cyclictest	3556594	-21	aten_r7power_po	10:20:18	0
3462811	99	45	36,7	cyclictest	3628278	-21	proc_pri	11:40:38	0
3462811	99	45	2,32	cyclictest	3526394	-21	ntpq	09:45:40	0
3462812	99	44	37,5	cyclictest	3476881	-21	ls	08:05:01	1
3462811	99	44	37,5	cyclictest	3470893	-21	fschecks_count	07:40:20	0
3462811	99	44	37,5	cyclictest	3228129	-21	kworker/u4:4+events_unbound	07:49:58	0
3462811	99	44	36,6	cyclictest	3512269	-21	ssh	09:30:20	0
3462811	99	44	35,6	cyclictest	0	-21	swapper/0	09:10:01	0
3462812	99	43	36,5	cyclictest	3677090	-21	timerandwakeup	12:35:38	1
3462812	99	43	36,5	cyclictest	3654504	-21	kernelversion	12:10:23	1
3462812	99	43	35,6	cyclictest	3465598	-21	aten_r7power_cu	07:20:16	1
3462812	99	43	34,5	cyclictest	3478091	-21	kworker/u4:3-rpciod	09:05:02	1
3462812	99	43	33,7	cyclictest	3650082	-21	kernelversion	12:05:21	1
3462812	99	43	33,7	cyclictest	3650082	-21	kernelversion	12:05:21	1
3462812	99	43	33,7	cyclictest	3601114	-21	tail	11:10:18	1
3462811	99	43	36,5	cyclictest	3486248	-21	grep	08:40:23	0
3462811	99	43	24,17	cyclictest	3465303	-21	kworker/u4:10-rpciod	08:55:22	0
3462812	99	42	34,6	cyclictest	0	-21	swapper/1	08:15:02	1
3462811	99	42	35,5	cyclictest	3478105	-21	cron	08:10:01	0
3462811	99	42	35,5	cyclictest	3463282	-21	grep	07:10:20	0
3462811	99	42	33,7	cyclictest	3464621	-21	gltestperf	07:15:20	0
3462812	99	41	33,6	cyclictest	3468888	-21	switchtime	07:30:41	1
3462812	99	40	32,6	cyclictest	3482622	-21	kernelversion	08:25:23	1
3462812	99	40	32,5	cyclictest	0	-21	swapper/1	08:50:07	1
3462811	99	40	30,8	cyclictest	3491591	-21	sed	09:00:20	0
3462812	99	39	32,5	cyclictest	3479825	-21	fschecks_count	08:15:18	1
3462812	99	39	32,4	cyclictest	0	-21	swapper/1	07:40:24	1
3462811	99	39	30,6	cyclictest	0	-21	swapper/0	07:25:17	0
3462812	99	38	31,5	cyclictest	0	-21	swapper/1	08:20:01	1
3462812	99	35	25,8	cyclictest	3462869	-21	latency_hist	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17