OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Thu May 14, 2026 12:44:09)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
12726	99	86	74,8	cyclictest	10215	-21	kworker/u4:5+events_unbound	08:25:34	1
12726	99	81	70,6	cyclictest	134409	-21	kworker/u4:6+events_unbound	11:06:04	1
12726	99	76	67,6	cyclictest	221815	-21	kworker/u4:7+events_unbound	12:36:20	1
12725	99	76	68,6	cyclictest	37223	-21	kworker/u4:18+events_unbound	08:45:36	0
12726	99	72	53,8	cyclictest	30718	-21	kworker/u4:0-rpciod	08:30:45	1
12726	99	71	56,9	cyclictest	0	-21	swapper/1	09:30:11	1
12726	99	65	57,6	cyclictest	112784	-21	kworker/u4:1+events_unbound	11:01:02	1
12725	99	64	55,6	cyclictest	224003	-21	rm	12:35:16	0
12726	99	61	49,7	cyclictest	32045	-21	modprobe	08:25:01	1
12726	99	61	21,30	cyclictest	0	-21	swapper/1	10:30:31	1
12725	99	61	26,10	cyclictest	194130	-21	ntpq	12:00:26	0
12726	99	60	53,5	cyclictest	167355	-21	/usr/sbin/munin	11:30:15	1
12725	99	60	52,6	cyclictest	99425	-21	kworker/u4:12+events_unbound	10:15:56	0
12725	99	60	22,13	cyclictest	211568	-21	ntpq	12:20:25	0
12725	99	59	49,8	cyclictest	38491	-21	kworker/u4:0+events_unbound	08:50:38	0
12725	99	59	47,8	cyclictest	37	-21	kcompactd0	10:38:28	0
12725	99	59	18,16	cyclictest	39966	-21	apt-get	08:55:13	0
12726	99	58	51,5	cyclictest	42429	-21	kworker/u4:6+events_unbound	09:10:00	1
12725	99	58	49,7	cyclictest	4191496	-21	kworker/u4:2+events_unbound	08:40:36	0
12726	99	57	50,5	cyclictest	19150	-21	kworker/u4:12+events_unbound	08:05:21	1
12725	99	57	50,5	cyclictest	42426	-21	kworker/u4:2+events_unbound	09:05:00	0
12725	99	57	49,6	cyclictest	59698	-21	kworker/u4:8-rpciod	09:30:18	0
12725	99	57	16,14	cyclictest	202895	-21	ntpq	12:10:27	0
12725	99	55	40,12	cyclictest	57585	-21	aten_r7power_en	09:25:18	0
12725	99	55	20,7	cyclictest	12880	-21	apt-get	07:10:11	0
12726	99	54	46,6	cyclictest	173738	-21	kworker/u4:6+events_unbound	12:11:15	1
12726	99	54	41,10	cyclictest	0	-21	swapper/1	09:45:12	1
12726	99	54	41,10	cyclictest	0	-21	swapper/1	09:45:12	1
12726	99	54	3,41	cyclictest	44838	-21	ssh	09:10:33	1
12725	99	54	46,6	cyclictest	154213	-21	aten_r7power_cu	11:15:15	0
12725	99	53	36,13	cyclictest	0	-21	swapper/0	11:50:13	0
12725	99	53	32,5	cyclictest	66959	-21	memory	09:35:21	0
12725	99	53	32,5	cyclictest	66959	-21	memory	09:35:21	0
12726	99	52	44,6	cyclictest	162962	-21	aten_r7power_cu	11:25:16	1
12726	99	52	43,5	cyclictest	0	-21	swapper/1	12:25:27	1
12726	99	52	42,8	cyclictest	212614	-21	systemd	12:21:17	1
12726	99	52	41,8	cyclictest	97528	-21	tune2fs	10:10:19	1
12725	99	52	45,5	cyclictest	116110	-21	rm	10:30:41	0
12725	99	52	32,18	cyclictest	64201	-21	kworker/u4:1-rpciod	09:55:40	0
12726	99	51	47,3	cyclictest	134409	-21	kworker/u4:6+events_unbound	11:11:05	1
12726	99	51	44,5	cyclictest	40880	-21	timerwakeupswit	08:55:38	1
12726	99	51	42,7	cyclictest	39876	-21	latency_hist	08:55:00	1
12726	99	51	38,10	cyclictest	175768	-21	gpgv	11:40:01	1
12726	99	51	37,11	cyclictest	0	-21	swapper/1	09:15:26	1
12726	99	51	2,41	cyclictest	70859	-21	acpi	09:40:13	1
12725	99	51	44,5	cyclictest	216519	-21	unixbench_multi	12:25:40	0
12725	99	51	30,19	cyclictest	171776	-21	aten_r7power_vo	11:35:16	0
12725	99	51	11,16	cyclictest	142411	-21	ssh	11:00:44	0
12726	99	50	43,5	cyclictest	154433	-21	fschecks_count	11:15:17	1
12726	99	50	30,6	cyclictest	134406	-21	kworker/u4:3+events_unbound	10:53:44	1
12725	99	50	9,10	cyclictest	207313	-21	ntpq	12:15:31	0
12725	99	50	9,10	cyclictest	207313	-21	ntpq	12:15:31	0
12725	99	50	43,5	cyclictest	132839	-21	/usr/sbin/munin	10:50:21	0
12725	99	50	10,17	cyclictest	92534	-21	latency_hist	10:05:02	0
12725	99	50	10,15	cyclictest	130699	-21	ssh	10:47:58	0
12726	99	49	42,5	cyclictest	53834	-21	ssh	09:20:32	1
12726	99	49	41,5	cyclictest	0	-21	swapper/1	12:00:41	1
12726	99	49	40,5	cyclictest	111304	-21	/usr/sbin/munin	10:25:37	1
12726	99	49	39,8	cyclictest	25346	-21	timerwakeupswit	07:55:37	1
12726	99	49	39,7	cyclictest	103872	-21	kworker/u4:2-rpciod	10:20:35	1
12726	99	49	38,8	cyclictest	93224	-21	gltestperf	10:05:18	1
12726	99	49	37,10	cyclictest	120258	-21	switchtime	10:35:42	1
12725	99	49	42,5	cyclictest	168113	-21	ssh	11:30:33	0
12725	99	49	41,6	cyclictest	15265	-21	apt	07:20:01	0
12725	99	49	40,6	cyclictest	0	-21	swapper/0	10:40:24	0
12725	99	49	31,13	cyclictest	110385	-21	apt-get	10:25:12	0
12725	99	49	29,18	cyclictest	24717	-21	fschecks_count	07:55:17	0
12725	99	49	16,10	cyclictest	163214	-21	grep	11:25:19	0
12725	99	49	10,19	cyclictest	35551	-21	grep	08:35:35	0
12726	99	48	41,5	cyclictest	85300	-21	unixbench_multi	09:55:41	1
12726	99	48	38,8	cyclictest	176201	-21	aten_r7power_en	11:40:20	1
12726	99	48	38,7	cyclictest	58416	-21	ps	09:25:40	1
12726	99	48	37,6	cyclictest	0	-21	swapper/1	11:55:02	1
12725	99	48	9,14	cyclictest	106795	-21	ntpq	10:20:32	0
12725	99	48	43,3	cyclictest	86040	-21	kworker/u4:11+events_unbound	10:05:54	0
12725	99	48	34,5	cyclictest	0	-21	swapper/0	09:40:13	0
12725	99	48	2,6	cyclictest	28126	-21	apt-get	08:10:09	0
12725	99	48	26,18	cyclictest	146145	-21	ssh	11:05:28	0
12726	99	47	35,8	cyclictest	36848	-21	ps	08:40:35	1
12725	99	47	40,5	cyclictest	158959	-21	gltestperf	11:20:19	0
12725	99	47	40,4	cyclictest	0	-21	swapper/0	08:00:37	0
12725	99	47	39,6	cyclictest	180668	-21	df_abs	11:45:19	0
12725	99	47	37,7	cyclictest	44361	-21	cat	09:10:21	0
12725	99	47	2,22	cyclictest	97197	-21	rm	10:10:11	0
12725	99	47	16,11	cyclictest	49000	-21	gltestperf	09:15:19	0
12725	99	47	15,21	cyclictest	31706	-21	cat	08:20:37	0
12725	99	47	13,22	cyclictest	0	-21	swapper/0	10:55:31	0
12726	99	46	39,5	cyclictest	187042	-21	kworker/u4:0+events_unbound	12:06:16	1
12726	99	46	36,6	cyclictest	0	-21	swapper/1	11:45:18	1
12726	99	46	35,9	cyclictest	26822	-21	kworker/u4:3+events_unbound	08:15:27	1
12725	99	46	5,13	cyclictest	152419	-21	ssh	11:12:43	0
12725	99	46	39,4	cyclictest	0	-21	swapper/0	07:35:25	0
12725	99	46	36,8	cyclictest	57234	-21	latency_hist	09:25:01	0
12725	99	46	27,16	cyclictest	0	-21	swapper/0	07:55:00	0
12725	99	46	13,10	cyclictest	17611	-21	wc	07:25:40	0
12725	99	46	11,13	cyclictest	22750	-21	cat	07:45:35	0
12726	99	45	38,5	cyclictest	80865	-21	unixbench_multi	09:50:38	1
12726	99	45	38,5	cyclictest	219701	-21	aten_r7power_po	12:30:14	1
12726	99	45	38,5	cyclictest	21750	-21	munin-run	07:45:00	1
12726	99	45	38,5	cyclictest	185983	-21	unixbench_multi	11:50:40	1
12726	99	45	37,6	cyclictest	129087	-21	timerwakeupswit	10:45:39	1
12726	99	45	36,7	cyclictest	67560	-21	timerwakeupswit	09:35:41	1
12726	99	45	36,7	cyclictest	67560	-21	timerwakeupswit	09:35:40	1
12726	99	45	35,6	cyclictest	43734	-21	diskmemload	10:40:28	1
12726	99	45	34,8	cyclictest	0	-21	swapper/1	08:00:18	1
12725	99	45	38,5	cyclictest	79931	-21	fschecks_count	09:50:17	0
12725	99	45	38,5	cyclictest	75588	-21	fschecks_count	09:45:20	0
12725	99	45	38,5	cyclictest	75588	-21	fschecks_count	09:45:20	0
12725	99	45	38,5	cyclictest	197873	-21	/usr/sbin/munin	12:05:15	0
12726	99	44	37,5	cyclictest	159141	-21	/usr/sbin/munin	11:20:22	1
12726	99	44	35,7	cyclictest	19665	-21	fschecks_time	07:35:18	1
12726	99	44	35,7	cyclictest	16684	-21	apt-key	07:25:02	1
12726	99	44	34,7	cyclictest	18190	-21	aten_r7power_po	07:30:14	1
12725	99	44	9,13	cyclictest	189470	-21	fschecks_time	11:55:21	0
12725	99	44	6,20	cyclictest	43557	-21	grep	09:05:37	0
12725	99	44	36,6	cyclictest	33900	-21	fschecks_time	08:30:24	0
12725	99	44	28,13	cyclictest	219561	-21	apt-get	12:30:10	0
12725	99	44	24,17	cyclictest	0	-21	swapper/0	11:40:31	0
12725	99	44	24,17	cyclictest	0	-21	swapper/0	08:20:00	0
12726	99	43	37,4	cyclictest	0	-21	swapper/1	12:15:15	1
12726	99	43	37,4	cyclictest	0	-21	swapper/1	12:15:14	1
12726	99	43	32,9	cyclictest	13961	-21	cron	07:15:01	1
12725	99	43	36,5	cyclictest	33001	-21	cat	08:25:37	0
12725	99	43	14,25	cyclictest	16621	-21	latency_hist	07:25:01	0
12726	99	42	33,7	cyclictest	23992	-21	switchtime	07:50:35	1
12726	99	42	33,7	cyclictest	15257	-21	cron	07:20:00	1
12726	99	42	33,7	cyclictest	137108	-21	gltestperf	10:55:21	1
12725	99	42	25,14	cyclictest	18082	-21	apt-get	07:30:11	0
12725	99	42	23,12	cyclictest	20650	-21	apt-get	07:40:11	0
12726	99	41	33,6	cyclictest	34653	-21	kworker/u4:14+events_unbound	08:35:35	1
12726	99	41	33,6	cyclictest	22720	-21	switchtime	07:45:34	1
12726	99	41	32,6	cyclictest	0	-21	swapper/1	10:15:30	1
12726	99	41	30,8	cyclictest	0	-21	swapper/1	08:10:10	1
12726	99	41	29,9	cyclictest	0	-21	swapper/1	10:00:36	1
12726	99	40	32,5	cyclictest	0	-21	swapper/1	08:45:34	1
12725	99	40	34,4	cyclictest	27311	-21	fschecks_time	08:05:19	0
12726	99	39	30,7	cyclictest	41542	-21	df_abs	09:00:22	1
12726	99	38	27,8	cyclictest	0	-21	swapper/1	07:25:42	1
12725	99	38	29,5	cyclictest	4194108	-21	kworker/u4:16-xprtiod	07:10:01	0
12726	99	35	26,7	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17