OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System (updated Thu Mar 26, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
597332	99	117	110,5	cyclictest	710441	-21	kworker/u4:12+events_unbound	11:01:00	0
597333	99	102	95,5	cyclictest	675168	-21	kworker/u4:22+events_unbound	10:05:52	1
597333	99	101	94,5	cyclictest	798066	-21	kworker/u4:8+events_unbound	12:36:12	1
597332	99	101	93,6	cyclictest	701463	-21	kworker/u4:1+events_unbound	10:35:54	0
597332	99	100	84,13	cyclictest	53	-21	kswapd0	10:20:11	0
597333	99	97	90,5	cyclictest	768040	-21	kworker/u4:8+events_unbound	11:51:08	1
597333	99	94	87,5	cyclictest	599836	-21	kworker/u4:7+events_unbound	09:30:46	1
597333	99	88	64,16	cyclictest	53	-21	kswapd0	09:35:11	1
597333	99	87	80,5	cyclictest	613889	-21	kworker/u4:13+events_unbound	08:40:42	1
597333	99	87	80,5	cyclictest	613889	-21	kworker/u4:13+events_unbound	08:40:41	1
597333	99	86	79,5	cyclictest	625555	-21	kworker/u4:18+events_unbound	09:45:50	1
597333	99	86	79,5	cyclictest	612618	-21	kworker/u4:12+events_unbound	08:15:38	1
597333	99	86	79,5	cyclictest	612615	-21	kworker/u4:5+events_unbound	08:50:45	1
597332	99	86	4,25	cyclictest	810313	-21	ssh	12:35:29	0
597333	99	85	78,5	cyclictest	639815	-21	kworker/u4:1+events_unbound	10:00:51	1
597332	99	84	75,6	cyclictest	608776	-21	kworker/u4:1+events_unbound	08:00:31	0
597332	99	83	73,8	cyclictest	710440	-21	kworker/u4:11+events_unbound	10:50:57	0
597332	99	82	70,9	cyclictest	53	-21	kswapd0	09:35:12	0
597332	99	81	7,28	cyclictest	646897	-21	/usr/sbin/munin	09:30:23	0
597332	99	81	5,17	cyclictest	792530	-21	ssh	12:15:24	0
597332	99	79	67,10	cyclictest	53	-21	kswapd0	12:00:09	0
597333	99	78	64,5	cyclictest	612615	-21	kworker/u4:5+events_unbound	08:35:41	1
597332	99	75	38,34	cyclictest	660367	-21	ntp_kernel_pll_	09:45:29	0
597332	99	74	30,40	cyclictest	0	-21	swapper/0	10:05:35	0
597332	99	73	1,15	cyclictest	804830	-21	apt-get	12:30:11	0
597332	99	72	6,16	cyclictest	664079	-21	cut	09:50:16	0
597332	99	72	25,6	cyclictest	756932	-21	fschecks_count	11:35:18	0
597332	99	72	19,49	cyclictest	0	-21	swapper/0	10:30:27	0
597332	99	71	21,7	cyclictest	0	-21	swapper/0	10:00:36	0
597332	99	70	35,32	cyclictest	739112	-21	aten_r7power_cu	11:15:16	0
597332	99	70	2,18	cyclictest	620370	-21	cron	08:40:01	0
597332	99	69	1,33	cyclictest	0	-21	swapper/0	12:10:17	0
597332	99	68	6,27	cyclictest	638723	-21	grep	09:20:40	0
597332	99	68	4,22	cyclictest	773857	-21	ssh	11:54:55	0
597332	99	68	31,33	cyclictest	798716	-21	kworker/u4:11+rpciod	12:25:27	0
597332	99	68	30,34	cyclictest	0	-21	swapper/0	09:40:27	0
597332	99	67	31,5	cyclictest	710440	-21	kworker/u4:11-rpciod	10:45:17	0
597332	99	67	30,32	cyclictest	0	-21	swapper/0	09:55:31	0
597332	99	67	27,5	cyclictest	0	-21	swapper/0	11:45:26	0
597332	99	67	27,36	cyclictest	0	-21	swapper/0	08:45:01	0
597332	99	67	27,36	cyclictest	0	-21	swapper/0	08:45:00	0
597332	99	67	22,12	cyclictest	613722	-21	sed	08:10:35	0
597332	99	66	34,30	cyclictest	695072	-21	aten_r7power_en	10:25:15	0
597332	99	66	34,30	cyclictest	614374	-21	fschecks_time	08:15:19	0
597332	99	66	34,29	cyclictest	633407	-21	grep	09:15:24	0
597332	99	66	31,31	cyclictest	0	-21	swapper/0	12:20:28	0
597332	99	66	31,31	cyclictest	0	-21	swapper/0	12:20:27	0
597332	99	66	28,5	cyclictest	0	-21	swapper/0	08:30:20	0
597333	99	65	58,5	cyclictest	620359	-21	kworker/u4:16+events_unbound	08:55:43	1
597333	99	65	52,6	cyclictest	701465	-21	kworker/u4:3+events_unbound	10:41:09	1
597332	99	65	28,6	cyclictest	0	-21	swapper/0	10:55:23	0
597332	99	65	28,35	cyclictest	602634	-21	aten_r7power_cu	07:30:15	0
597332	99	65	26,7	cyclictest	730789	-21	gltestperf	11:05:26	0
597332	99	64	5,18	cyclictest	1066	-21	snmpd	10:11:16	0
597332	99	64	29,5	cyclictest	774257	-21	aten2__	11:55:15	0
597332	99	64	28,5	cyclictest	0	-21	swapper/0	12:05:19	0
597332	99	64	28,5	cyclictest	0	-21	swapper/0	07:15:00	0
597332	99	64	28,4	cyclictest	625797	-21	aten2__	09:00:14	0
597332	99	64	28,4	cyclictest	625797	-21	aten2__	09:00:13	0
597332	99	64	26,6	cyclictest	750076	-21	kworker/u4:1-rpciod	11:40:10	0
597332	99	63	31,29	cyclictest	0	-21	swapper/0	11:20:36	0
597332	99	63	31,20	cyclictest	256	50	irq/23-42890000.ethernet	08:45:11	0
597332	99	63	28,6	cyclictest	0	-21	swapper/0	11:30:16	0
597332	99	63	28,5	cyclictest	0	-21	swapper/0	07:55:19	0
597332	99	63	28,5	cyclictest	0	-21	swapper/0	07:55:18	0
597333	99	62	51,9	cyclictest	603670	-21	kworker/u4:9+events_unbound	07:55:27	1
597333	99	62	51,9	cyclictest	603670	-21	kworker/u4:9+events_unbound	07:55:27	1
597332	99	62	4,22	cyclictest	606256	-21	modprobe	07:44:59	0
597332	99	62	30,29	cyclictest	0	-21	swapper/0	11:25:19	0
597332	99	62	27,7	cyclictest	615495	-21	aten2__	08:20:20	0
597332	99	62	25,7	cyclictest	0	-21	swapper/0	07:35:16	0
597333	99	61	52,7	cyclictest	687205	-21	/usr/sbin/munin	10:15:38	1
597333	99	61	46,6	cyclictest	768041	-21	kworker/u4:13+events_unbound	12:16:59	1
597332	99	61	24,5	cyclictest	0	-21	swapper/0	08:30:01	0
597333	99	59	52,5	cyclictest	603668	-21	kworker/u4:3+events_unbound	07:50:02	1
597333	99	59	41,7	cyclictest	701465	-21	kworker/u4:3+events_unbound	10:33:59	1
597333	99	58	51,5	cyclictest	778655	-21	ssh	12:00:06	1
597332	99	58	24,7	cyclictest	606555	-21	aten_r7power_vo	07:45:16	0
597332	99	57	26,8	cyclictest	734735	-21	sh	11:10:15	0
597333	99	56	47,7	cyclictest	758222	-21	sshd	11:36:04	1
597333	99	55	48,5	cyclictest	594825	-21	kworker/u4:4+events_unbound	07:17:00	1
597333	99	55	41,9	cyclictest	710440	-21	kworker/u4:11-rpciod	11:00:19	1
597333	99	54	47,5	cyclictest	744086	-21	/usr/sbin/munin	11:20:23	1
597333	99	53	46,5	cyclictest	798715	-21	kworker/u4:10+events_unbound	12:27:42	1
597333	99	53	41,9	cyclictest	0	-21	swapper/1	10:35:11	1
597333	99	52	46,5	cyclictest	714923	-21	kworker/u4:7+events_unbound	11:14:58	1
597333	99	52	43,6	cyclictest	694794	-21	date	10:25:02	1
597332	99	52	40,9	cyclictest	642550	-21	awk	09:25:23	0
597333	99	51	45,5	cyclictest	601132	-21	kworker/u4:12+events_unbound	07:38:01	1
597333	99	51	44,5	cyclictest	599838	-21	kworker/u4:11+events_unbound	07:45:02	1
597333	99	51	44,5	cyclictest	599836	-21	kworker/u4:7+events_unbound	08:25:04	1
597333	99	51	43,6	cyclictest	739011	-21	/usr/sbin/munin	11:15:11	1
597333	99	51	39,5	cyclictest	710441	-21	kworker/u4:12+events_unbound	10:45:02	1
597333	99	50	44,4	cyclictest	585913	-21	kworker/u4:6+events_unbound	07:10:02	1
597333	99	50	42,5	cyclictest	685899	-21	ssh	10:15:01	1
597332	99	50	27,21	cyclictest	607964	-21	fschecks_count	07:50:19	0
597333	99	49	43,4	cyclictest	0	-21	swapper/1	09:25:35	1
597333	99	49	42,5	cyclictest	630766	-21	kworker/u4:8+events_unbound	09:17:02	1
597333	99	49	41,6	cyclictest	669462	-21	grep	09:55:38	1
597333	99	49	39,7	cyclictest	668253	-21	latency_hist	09:55:00	1
597332	99	49	40,6	cyclictest	708962	-21	ld	10:40:28	0
597333	99	48	42,5	cyclictest	623015	-21	kworker/u4:17+events_unbound	09:00:59	1
597333	99	48	42,5	cyclictest	623015	-21	kworker/u4:17+events_unbound	09:00:59	1
597333	99	48	40,5	cyclictest	606294	-21	grep	07:45:01	1
597333	99	48	40,5	cyclictest	0	-21	swapper/1	12:05:36	1
597332	99	48	40,6	cyclictest	623523	-21	fschecks_time	08:50:18	0
597332	99	47	38,6	cyclictest	679679	-21	kworker/u4:4-rpciod	10:15:27	0
597332	99	47	35,10	cyclictest	629701	-21	timerwakeupswit	09:10:38	0
597332	99	47	27,17	cyclictest	0	-21	swapper/0	07:30:00	0
597333	99	46	8,22	cyclictest	629275	-21	ssh	09:10:27	1
597333	99	46	41,4	cyclictest	794197	-21	kworker/u4:7+events_unbound	12:22:41	1
597333	99	46	41,4	cyclictest	794197	-21	kworker/u4:7+events_unbound	12:22:41	1
597333	99	46	39,6	cyclictest	741135	-21	kworker/u4:2+events_unbound	11:25:02	1
597333	99	46	39,5	cyclictest	613671	-21	timerandwakeup	08:10:36	1
597333	99	46	36,8	cyclictest	371	-21	systemd-timesyn	07:20:31	1
597333	99	46	35,9	cyclictest	602419	-21	kworker/u4:7	07:30:00	1
597333	99	46	32,6	cyclictest	599836	-21	kworker/u4:7+events_unbound	07:30:43	1
597333	99	46	24,15	cyclictest	0	-21	swapper/1	10:25:23	1
597333	99	46	1,37	cyclictest	806084	-21	ntpq	12:30:41	1
597332	99	46	5,37	cyclictest	0	-21	swapper/0	09:05:10	0
597333	99	45	39,5	cyclictest	603668	-21	kworker/u4:3+events_unbound	08:24:41	1
597333	99	45	38,5	cyclictest	774197	-21	apt-get	11:55:11	1
597333	99	45	38,5	cyclictest	717709	-21	ld	10:50:25	1
597333	99	45	37,6	cyclictest	730991	-21	ntp_kernel_err	11:05:32	1
597333	99	45	37,5	cyclictest	788660	-21	unixbench-2d	12:10:39	1
597333	99	45	36,7	cyclictest	762335	-21	unixbench_singl	11:40:39	1
597333	99	45	36,6	cyclictest	0	-21	swapper/1	08:05:31	1
597333	99	45	35,7	cyclictest	0	-21	swapper/1	09:20:37	1
597332	99	45	37,5	cyclictest	625215	-21	sendmail_mailqu	08:55:35	0
597333	99	44	35,7	cyclictest	627159	-21	aten2__	09:05:19	1
597333	99	44	34,6	cyclictest	741135	-21	kworker/u4:2-rpciod	11:30:32	1
597333	99	43	37,4	cyclictest	0	-21	swapper/1	08:45:42	1
597333	99	43	36,5	cyclictest	608776	-21	kworker/u4:1+events_unbound	08:34:01	1
597333	99	43	35,5	cyclictest	0	-21	swapper/1	09:40:29	1
597333	99	42	35,5	cyclictest	0	-21	swapper/1	11:45:14	1
597333	99	42	30,10	cyclictest	0	-21	swapper/1	08:00:28	1
597332	99	42	35,5	cyclictest	611854	-21	fschecks_time	08:05:18	0
597332	99	42	35,5	cyclictest	600353	-21	fschecks_count	07:20:18	0
597332	99	42	33,7	cyclictest	598799	-21	aten_r7power_cu	07:15:16	0
597332	99	40	12,20	cyclictest	597308	-21	munin-run	07:10:01	0
597333	99	39	31,6	cyclictest	0	-21	swapper/1	10:55:34	1
597333	99	37	29,6	cyclictest	597414	-21	latency_hist	07:10:02	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17