OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Thu Jul 02, 2026 12:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
650969	99	105	97,6	cyclictest	706631	-21	kworker/u4:3+events_unbound	09:45:38	0
650970	99	93	86,5	cyclictest	642417	-21	kworker/u4:10+events_unbound	07:20:02	1
650970	99	76	69,5	cyclictest	639785	-21	kworker/u4:5+events_unbound	07:35:01	1
650969	99	74	43,26	cyclictest	53	-21	kswapd0	12:10:10	0
650969	99	74	43,26	cyclictest	53	-21	kswapd0	12:10:10	0
650969	99	73	67,4	cyclictest	653462	-21	kworker/u4:9+events_unbound	07:55:16	0
650970	99	71	57,6	cyclictest	680404	-21	kworker/u4:11+events_unbound	09:05:01	1
650969	99	70	61,6	cyclictest	833836	-21	kworker/u4:6+events_unbound	12:06:04	0
650970	99	67	60,5	cyclictest	647263	-21	kworker/u4:0+events_unbound	07:15:04	1
650969	99	64	48,13	cyclictest	53	-21	kswapd0	11:10:09	0
650970	99	62	49,6	cyclictest	674001	-21	kworker/u4:2+events_unbound	08:40:04	1
650969	99	61	53,5	cyclictest	732803	-21	kworker/u4:11+events_unbound	10:20:00	0
650970	99	60	46,6	cyclictest	639785	-21	kworker/u4:5+events_unbound	08:00:02	1
650969	99	60	51,6	cyclictest	668347	-21	ntpq	08:15:24	0
650969	99	59	50,6	cyclictest	855468	-21	kworker/u4:5+events_unbound	12:36:12	0
650969	99	59	50,6	cyclictest	697574	-21	kworker/u4:4+events_unbound	09:30:37	0
650969	99	58	47,8	cyclictest	771486	-21	cat	10:50:46	0
650969	99	58	19,23	cyclictest	0	-21	swapper/0	11:40:00	0
650970	99	57	50,5	cyclictest	732802	-21	kworker/u4:10+events_unbound	11:20:02	1
650970	99	57	48,7	cyclictest	727580	-21	timerwakeupswit	10:00:50	1
650970	99	57	47,7	cyclictest	801889	-21	sendmail_mailqu	11:25:36	1
650969	99	57	47,7	cyclictest	759697	-21	kworker/u4:9+events_unbound	11:30:58	0
650970	99	56	49,5	cyclictest	829389	-21	kworker/u4:9+events_unbound	12:00:02	1
650970	99	56	49,5	cyclictest	829389	-21	kworker/u4:9+events_unbound	12:00:02	1
650969	99	56	42,10	cyclictest	726747	-21	sh	10:00:30	0
650970	99	55	48,4	cyclictest	0	-21	swapper/1	10:25:23	1
650970	99	55	46,7	cyclictest	0	-21	swapper/1	10:10:36	1
650970	99	55	41,6	cyclictest	667616	-21	kworker/u4:5+events_unbound	08:17:02	1
650969	99	55	44,8	cyclictest	675300	-21	kworker/u4:8+events_unbound	09:05:32	0
650969	99	54	36,16	cyclictest	682963	-21	ssh	09:10:37	0
650970	99	53	46,5	cyclictest	679108	-21	kworker/u4:10+events_unbound	09:13:00	1
650969	99	53	45,6	cyclictest	780203	-21	timerwakeupswit	11:00:38	0
650969	99	53	45,5	cyclictest	844820	-21	cut	12:15:17	0
650969	99	53	45,5	cyclictest	844820	-21	cut	12:15:17	0
650969	99	53	25,14	cyclictest	14	-21	ksoftirqd/0	09:50:34	0
650969	99	53	19,21	cyclictest	0	-21	swapper/0	10:40:22	0
650969	99	53	19,19	cyclictest	0	-21	swapper/0	11:40:29	0
650970	99	52	45,5	cyclictest	855464	-21	kworker/u4:0+events_unbound	12:31:59	1
650970	99	52	45,5	cyclictest	695072	-21	munin-plugin-st	09:25:01	1
650969	99	52	22,26	cyclictest	690884	-21	ssh	09:20:10	0
650970	99	51	43,6	cyclictest	807279	-21	kworker/u4:12+events_unbound	11:41:01	1
650970	99	51	41,8	cyclictest	787776	-21	latency_hist	11:10:07	1
650970	99	51	41,8	cyclictest	787776	-21	latency_hist	11:10:06	1
650970	99	51	40,8	cyclictest	676569	-21	kworker/u4:9+events_unbound	08:50:32	1
650970	99	51	38,6	cyclictest	759696	-21	kworker/u4:8+events_unbound	11:46:46	1
650969	99	51	8,9	cyclictest	832238	-21	ntp_states	12:00:36	0
650969	99	51	8,9	cyclictest	832238	-21	ntp_states	12:00:36	0
650969	99	51	43,6	cyclictest	801845	-21	proc_pri	11:25:35	0
650969	99	51	43,5	cyclictest	858432	-21	ntpq	12:30:28	0
650969	99	51	35,14	cyclictest	674002	-21	kworker/u4:3+events_unbound	08:55:32	0
650969	99	51	33,11	cyclictest	761251	-21	ssh	10:40:01	0
650970	99	50	44,4	cyclictest	0	-21	swapper/1	10:30:44	1
650970	99	50	42,5	cyclictest	761951	-21	fschecks_time	10:40:22	1
650970	99	50	40,8	cyclictest	827969	-21	/usr/sbin/munin	11:55:37	1
650970	99	50	40,8	cyclictest	771448	-21	timerandwakeup	10:50:46	1
650970	99	50	40,8	cyclictest	0	-21	swapper/1	09:30:35	1
650970	99	50	39,8	cyclictest	0	-21	swapper/1	08:45:28	1
650970	99	50	37,6	cyclictest	647263	-21	kworker/u4:0+events_unbound	07:15:07	1
650969	99	50	6,16	cyclictest	681711	-21	diskmemload	11:20:28	0
650969	99	50	41,6	cyclictest	769699	-21	sshd	10:49:35	0
650969	99	50	40,6	cyclictest	759697	-21	kworker/u4:9-rpciod	11:15:32	0
650970	99	49	42,5	cyclictest	824972	-21	kworker/u4:2+events_unbound	11:53:59	1
650970	99	49	42,5	cyclictest	639785	-21	kworker/u4:5+events_unbound	07:53:46	1
650970	99	49	42,5	cyclictest	0	-21	swapper/1	11:20:30	1
650970	99	49	40,7	cyclictest	718745	-21	timerwakeupswit	09:50:38	1
650970	99	49	40,7	cyclictest	667616	-21	kworker/u4:5+rpciod	09:55:20	1
650970	99	49	38,8	cyclictest	0	-21	swapper/1	09:35:36	1
650969	99	49	42,5	cyclictest	256	50	irq/23-42890000.ethernet	10:05:39	0
650969	99	49	40,7	cyclictest	783700	-21	df_abs	11:05:17	0
650969	99	49	37,7	cyclictest	650902	-21	kworker/u4:1+events_unbound	07:40:02	0
650969	99	49	30,16	cyclictest	0	-21	swapper/0	10:10:17	0
650969	99	49	25,21	cyclictest	0	-21	swapper/0	09:40:28	0
650970	99	48	41,5	cyclictest	854456	-21	unixbench-2d	12:25:40	1
650970	99	48	41,5	cyclictest	844949	-21	/usr/sbin/munin	12:15:18	1
650970	99	48	41,5	cyclictest	844949	-21	/usr/sbin/munin	12:15:18	1
650970	99	48	40,6	cyclictest	0	-21	swapper/1	09:15:34	1
650970	99	48	38,7	cyclictest	651081	-21	latency_hist	07:10:01	1
650969	99	48	40,6	cyclictest	0	-21	swapper/0	10:25:28	0
650969	99	48	37,8	cyclictest	665294	-21	aten2__	08:05:14	0
650969	99	48	37,6	cyclictest	256	50	irq/23-42890000.ethernet	10:58:23	0
650969	99	48	36,7	cyclictest	0	-21	swapper/0	11:49:41	0
650969	99	48	27,18	cyclictest	0	-21	swapper/0	09:40:00	0
650969	99	48	2,35	cyclictest	696099	-21	ssh	09:25:29	0
650969	99	48	16,17	cyclictest	0	-21	swapper/0	11:10:38	0
650969	99	48	11,4	cyclictest	15	1	ktimers/0	12:20:15	0
650970	99	47	40,5	cyclictest	731063	-21	fschecks_count	10:05:26	1
650970	99	47	39,5	cyclictest	0	-21	swapper/1	12:35:17	1
650970	99	47	37,8	cyclictest	758444	-21	unixbench_multi	10:35:42	1
650970	99	47	37,7	cyclictest	853070	-21	latency_hist	12:25:01	1
650970	99	47	37,7	cyclictest	0	-21	swapper/1	11:30:58	1
650969	99	47	7,10	cyclictest	672764	-21	munin-run	08:35:00	0
650969	99	47	40,5	cyclictest	722252	-21	fschecks_count	09:55:20	0
650969	99	47	38,6	cyclictest	660590	-21	gltestperf	07:45:19	0
650969	99	47	36,8	cyclictest	752832	-21	sh	10:30:15	0
650970	99	46	39,5	cyclictest	840068	-21	acpi	12:10:12	1
650970	99	46	39,5	cyclictest	840068	-21	acpi	12:10:12	1
650970	99	46	39,5	cyclictest	780267	-21	unixbench_multi	11:00:38	1
650970	99	46	38,5	cyclictest	695545	-21	aten_r7power_vo	09:25:17	1
650970	99	46	37,7	cyclictest	659746	-21	timerandwakeup	07:40:42	1
650970	99	46	36,8	cyclictest	744005	-21	aten_r7power_cu	10:20:15	1
650970	99	46	36,7	cyclictest	0	-21	swapper/1	10:15:41	1
650969	99	46	6,20	cyclictest	823314	-21	ntpq	11:50:25	0
650969	99	46	39,5	cyclictest	827969	-21	/usr/sbin/munin	11:55:37	0
650969	99	46	19,8	cyclictest	677868	-21	latency_hist	08:55:00	0
650969	99	46	11,7	cyclictest	853909	-21	ntpq	12:25:26	0
650970	99	45	38,5	cyclictest	709927	-21	timerwakeupswit	09:40:39	1
650970	99	45	38,5	cyclictest	667615	-21	kworker/u4:4+events_unbound	08:28:59	1
650970	99	45	38,5	cyclictest	667615	-21	kworker/u4:4+events_unbound	08:28:59	1
650970	99	45	38,5	cyclictest	663776	-21	kworker/u4:14+events_unbound	08:07:00	1
650970	99	45	38,5	cyclictest	661270	-21	idleruntime-cro	07:50:00	1
650970	99	45	38,5	cyclictest	630453	-21	kworker/u4:19+events_unbound	07:26:46	1
650970	99	45	38,5	cyclictest	630453	-21	kworker/u4:19+events_unbound	07:26:46	1
650970	99	45	37,6	cyclictest	775079	-21	gltestperf	10:55:23	1
650970	99	45	37,5	cyclictest	787574	-21	apt-get	11:10:15	1
650970	99	45	37,5	cyclictest	766309	-21	gltestperf	10:45:21	1
650970	99	45	36,7	cyclictest	713224	-21	apt-get	09:45:14	1
650970	99	45	2,33	cyclictest	835412	-21	apt-get	12:05:10	1
650969	99	45	38,5	cyclictest	655371	-21	tail	07:25:21	0
650969	99	45	38,5	cyclictest	655371	-21	tail	07:25:21	0
650969	99	45	37,5	cyclictest	652236	-21	sshd	07:15:01	0
650969	99	45	36,6	cyclictest	686921	-21	tail	09:15:21	0
650969	99	45	36,6	cyclictest	679615	-21	fschecks_count	09:00:19	0
650969	99	45	35,7	cyclictest	661722	-21	fschecks_count	07:50:18	0
650969	99	45	33,9	cyclictest	657334	-21	sh	07:35:00	0
650969	99	45	10,11	cyclictest	652971	-21	ntpq	07:15:27	0
650970	99	44	36,6	cyclictest	656218	-21	systemd	07:30:02	1
650970	99	44	25,6	cyclictest	639785	-21	kworker/u4:5+events_unbound	07:55:10	1
650969	99	44	7,11	cyclictest	674732	-21	memory	08:40:22	0
650969	99	44	35,6	cyclictest	0	-21	swapper/0	08:35:27	0
650969	99	44	34,6	cyclictest	0	-21	swapper/0	07:40:40	0
650969	99	44	33,9	cyclictest	654013	-21	fschecks_time	07:20:20	0
650969	99	44	33,8	cyclictest	664920	-21	timerwakeupswit	08:00:45	0
650969	99	44	32,9	cyclictest	0	-21	swapper/0	08:20:25	0
650970	99	43	37,4	cyclictest	678677	-21	ntpq	08:55:31	1
650970	99	43	35,6	cyclictest	670194	-21	kworker/u4:12-rpciod	08:30:16	1
650970	99	43	34,6	cyclictest	674001	-21	kworker/u4:2+events_unbound	08:40:00	1
650969	99	43	6,14	cyclictest	676082	-21	ntpq	08:45:27	0
650969	99	43	34,6	cyclictest	744297	-21	fschecks_time	10:20:19	0
650969	99	43	10,5	cyclictest	667099	-21	ntpq	08:10:23	0
650970	99	42	34,6	cyclictest	669200	-21	aten_r7power_en	08:20:15	1
650970	99	42	32,8	cyclictest	809757	-21	aten_r7power_vo	11:35:17	1
650970	99	42	32,7	cyclictest	0	-21	swapper/1	08:10:23	1
650969	99	42	4,14	cyclictest	670609	-21	df_inode	08:25:18	0
650969	99	42	4,14	cyclictest	670609	-21	df_inode	08:25:18	0
650970	99	40	31,7	cyclictest	679338	-21	aten2__	09:00:16	1
650969	99	38	6,9	cyclictest	650941	-21	munin-run	07:10:00	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17