OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 792 highest latencies:

System rack7slot2.osadl.org (updated Fri Dec 05, 2025 12:44:05)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3285059	99	159	145,11	cyclictest	53	-21	kswapd0	12:20:15	1
3285059	99	101	91,7	cyclictest	53	-21	kswapd0	11:20:08	1
3285059	99	99	85,11	cyclictest	3411698	-21	kworker/u4:21+events_unbound	12:00:12	1
3285059	99	90	85,3	cyclictest	3314622	-21	kworker/u4:4+events_unbound	09:34:54	1
3285059	99	86	82,3	cyclictest	3370573	-21	kworker/u4:10+events_unbound	11:00:07	1
3285059	99	85	75,7	cyclictest	3414804	-21	kworker/u4:0+events_unbound	12:35:19	1
3285057	99	81	76,3	cyclictest	3298430	-21	kworker/u4:1+events_unbound	09:24:51	0
3285059	99	80	74,4	cyclictest	3377525	-21	kworker/u4:8+events_unbound	11:19:15	1
3285057	99	80	70,6	cyclictest	3367498	-21	kworker/u4:3+events_unbound	11:30:10	0
3285057	99	80	69,8	cyclictest	3322037	-21	kworker/u4:9+events_unbound	10:29:08	0
3285057	99	78	67,7	cyclictest	3288094	-21	kworker/u4:3+events_unbound	07:29:33	0
3285059	99	76	67,6	cyclictest	3367498	-21	kworker/u4:3+events_unbound	10:55:04	1
3285057	99	76	67,7	cyclictest	3414804	-21	kworker/u4:0+events_unbound	12:24:23	0
3285059	99	75	70,3	cyclictest	3296655	-21	kworker/u4:13+events_unbound	09:09:50	1
3285059	99	73	64,6	cyclictest	3363981	-21	kworker/u4:5+events_unbound	10:44:10	1
3285059	99	72	55,10	cyclictest	3297179	-21	modprobe	08:55:00	1
3285057	99	72	64,6	cyclictest	3332579	-21	kworker/u4:1+events_unbound	09:59:04	0
3285059	99	70	60,8	cyclictest	3339730	-21	kworker/u4:11+events_unbound	10:35:01	1
3285059	99	69	60,6	cyclictest	3436915	-21	kworker/u4:2+events_unbound	12:30:17	1
3285057	99	68	60,6	cyclictest	3367501	-21	kworker/u4:8+events_unbound	10:55:00	0
3285059	99	67	61,4	cyclictest	3407966	-21	kworker/u4:4+events_unbound	11:54:18	1
3285059	99	67	43,20	cyclictest	3352248	-21	ssh	10:25:28	1
3285059	99	66	57,6	cyclictest	3396709	-21	kworker/u4:5+events_unbound	11:45:11	1
3285059	99	66	56,6	cyclictest	3291493	-21	kworker/u4:2+events_unbound	08:08:45	1
3285057	99	66	57,7	cyclictest	3436915	-21	kworker/u4:2+events_unbound	12:29:23	0
3285059	99	63	56,5	cyclictest	3380447	-21	kworker/u4:1+events_unbound	11:09:13	1
3285059	99	62	57,3	cyclictest	3298432	-21	kworker/u4:6+events_unbound	09:03:53	1
3285059	99	62	51,7	cyclictest	3285056	-21	cyclictest	12:13:08	1
3285057	99	62	53,7	cyclictest	3298430	-21	kworker/u4:1+events_unbound	09:19:50	0
3285057	99	62	52,8	cyclictest	53	-21	kswapd0	11:50:12	0
3285057	99	62	41,12	cyclictest	3297180	-21	kworker/u4:2	08:54:59	0
3285057	99	61	55,4	cyclictest	3325662	-21	kworker/u4:13+events_unbound	09:54:04	0
3285059	99	60	52,6	cyclictest	3322037	-21	kworker/u4:9+events_unbound	10:09:57	1
3285059	99	60	52,6	cyclictest	3284617	-21	kworker/u4:4+events_unbound	07:20:02	1
3285059	99	60	50,7	cyclictest	3291494	-21	kworker/u4:6+events_unbound	08:49:45	1
3285057	99	60	45,12	cyclictest	3377521	-21	kworker/u4:0-rpciod	11:26:45	0
3285057	99	60	39,12	cyclictest	3366370	-21	ssh	10:45:33	0
3285057	99	60	38,17	cyclictest	3362007	-21	apt-get	10:40:10	0
3285057	99	60	31,10	cyclictest	3427361	-21	ntpq	12:15:28	0
3285057	99	59	50,7	cyclictest	398	-21	systemd-logind	09:14:49	0
3285059	99	58	37,8	cyclictest	3396707	-21	kworker/u4:0+events_unbound	11:40:00	1
3285059	99	58	36,18	cyclictest	3369873	-21	ssh	10:50:37	1
3285057	99	58	49,6	cyclictest	3402177	-21	sshd	11:40:10	0
3285057	99	58	40,13	cyclictest	3334187	-21	ssh	10:00:15	0
3285057	99	58	38,15	cyclictest	3398470	-21	apt-get	11:35:10	0
3285057	99	58	38,13	cyclictest	3416257	-21	apt-get	12:00:13	0
3285057	99	58	32,9	cyclictest	3324346	-21	ntpq	09:45:26	0
3285059	99	57	52,3	cyclictest	3318325	-21	kworker/u4:6+events_unbound	09:44:55	1
3285059	99	57	34,18	cyclictest	3348886	-21	ssh	10:20:28	1
3285057	99	57	41,9	cyclictest	3388967	-21	ntpq	11:20:33	0
3285057	99	57	31,11	cyclictest	3347964	-21	ssh	10:20:01	0
3285059	99	56	51,3	cyclictest	3296657	-21	kworker/u4:15+events_unbound	08:43:48	1
3285059	99	56	39,11	cyclictest	3366367	-21	ntp_states	10:45:34	1
3285059	99	56	36,13	cyclictest	3345362	-21	ntpq	10:15:30	1
3285059	99	56	33,19	cyclictest	3402888	-21	sh	11:40:27	1
3285057	99	56	47,6	cyclictest	3286287	-21	kworker/u4:11+events_unbound	07:33:37	0
3285057	99	56	40,11	cyclictest	3298013	-21	ntpq	08:55:34	0
3285057	99	56	39,11	cyclictest	3379526	-21	ssh	11:05:35	0
3285057	99	56	38,16	cyclictest	3422972	-21	aten_r7power_cu	12:10:16	0
3285057	99	56	37,15	cyclictest	3439264	-21	ntpq	12:30:35	0
3285057	99	56	35,15	cyclictest	3442292	-21	ssh	12:35:13	0
3285059	99	55	41,7	cyclictest	3299958	-21	ssh	09:10:30	1
3285057	99	55	46,6	cyclictest	3284617	-21	kworker/u4:4+events_unbound	07:24:31	0
3285059	99	54	48,4	cyclictest	3289804	-21	kworker/u4:4+events_unbound	08:04:38	1
3285059	99	54	39,12	cyclictest	3316377	-21	ssh	09:35:11	1
3285059	99	54	31,19	cyclictest	3427449	-21	ssh	12:15:32	1
3285057	99	54	47,5	cyclictest	3296866	-21	systemd	08:48:50	0
3285057	99	54	42,7	cyclictest	0	-21	swapper/0	11:55:42	0
3285057	99	54	38,11	cyclictest	3341034	-21	apt-get	10:10:12	0
3285057	99	54	36,14	cyclictest	3384857	-21	apt-get	11:15:12	0
3285057	99	54	36,12	cyclictest	3296273	-21	ps	08:40:35	0
3285057	99	54	30,10	cyclictest	3338331	-21	ntpq	10:05:27	0
3285057	99	54	20,31	cyclictest	0	-21	swapper/0	11:45:27	0
3285059	99	53	36,12	cyclictest	3306633	-21	ssh	09:20:24	1
3285059	99	53	31,16	cyclictest	3293241	-21	modprobe	08:15:00	1
3285057	99	53	40,9	cyclictest	3419537	-21	apt-get	12:05:20	0
3285057	99	53	40,9	cyclictest	3294463	-21	ntpq	08:25:28	0
3285057	99	53	40,10	cyclictest	3288733	-21	apt-get	07:40:11	0
3285057	99	53	38,12	cyclictest	3312709	-21	apt-get	09:30:14	0
3285057	99	53	38,12	cyclictest	3292708	-21	ntpq	08:10:26	0
3285057	99	53	38,11	cyclictest	3290985	-21	ntpq	07:55:24	0
3285057	99	53	37,12	cyclictest	3309524	-21	apt-get	09:25:13	0
3285057	99	53	35,13	cyclictest	3285912	-21	ps	07:10:36	0
3285057	99	53	28,9	cyclictest	3373100	-21	ntpq	10:55:46	0
3285059	99	52	38,12	cyclictest	3334173	-21	apt-get	10:00:16	1
3285059	99	52	36,12	cyclictest	3341809	-21	ntpq	10:10:33	1
3285059	99	52	33,15	cyclictest	3303449	-21	ssh	09:15:30	1
3285059	99	52	32,14	cyclictest	3289438	-21	grep	07:40:33	1
3285059	99	52	29,17	cyclictest	3330415	-21	modprobe	09:55:00	1
3285057	99	52	33,15	cyclictest	3320842	-21	ntpq	09:40:34	0
3285057	99	52	32,16	cyclictest	3355863	-21	ssh	10:30:32	0
3285057	99	52	25,23	cyclictest	3319914	-21	base64	09:40:01	0
3285059	99	51	36,11	cyclictest	3435521	-21	ssh	12:25:40	1
3285059	99	51	33,12	cyclictest	3420370	-21	ssh	12:05:40	1
3285059	99	51	33,11	cyclictest	3310243	-21	ssh	09:25:30	1
3285059	99	51	27,17	cyclictest	3359337	-21	ssh	10:35:31	1
3285057	99	51	44,5	cyclictest	3291777	-21	idleruntime-cro	08:05:00	0
3285057	99	51	40,7	cyclictest	3298430	-21	kworker/u4:1+events_unbound	09:08:53	0
3285057	99	51	34,12	cyclictest	3348888	-21	ntpq	10:20:29	0
3285059	99	50	45,3	cyclictest	3286286	-21	kworker/u4:10+events_unbound	07:38:38	1
3285059	99	50	40,7	cyclictest	0	-21	swapper/1	11:10:31	1
3285059	99	50	30,16	cyclictest	1060	-21	snmpd	11:55:41	1
3285057	99	50	40,8	cyclictest	3376576	-21	switchtime	11:00:38	0
3285057	99	50	36,11	cyclictest	3359419	-21	ntpq	10:35:36	0
3285057	99	50	35,12	cyclictest	3382203	-21	ntpq	11:10:22	0
3285057	99	50	26,8	cyclictest	3295387	-21	apt	08:40:00	0
3285057	99	50	23,24	cyclictest	3286586	-21	cat	07:20:02	0
3285059	99	49	31,13	cyclictest	3326963	-21	ssh	09:50:01	1
3285059	99	48	40,6	cyclictest	3298575	-21	latency_hist	09:00:01	1
3285059	99	48	31,14	cyclictest	3392189	-21	ssh	11:25:33	1
3285059	99	48	31,13	cyclictest	3395606	-21	ssh	11:30:29	1
3285059	99	48	31,11	cyclictest	3286320	-21	modprobe	07:15:00	1
3285059	99	48	26,15	cyclictest	3290618	-21	df_abs	07:55:14	1
3285059	99	47	40,4	cyclictest	0	-21	swapper/1	09:55:15	1
3285059	99	47	32,10	cyclictest	37	-21	kcompactd0	08:15:12	1
3285057	99	47	23,19	cyclictest	3285175	-21	latency_hist	07:10:01	0
3285057	99	47	22,20	cyclictest	3298702	-21	latency_hist	09:05:01	0
3285057	99	47	20,22	cyclictest	3293406	-21	sshd	08:15:29	0
3285059	99	46	41,3	cyclictest	3286278	-21	kworker/u4:1+events_unbound	07:34:35	1
3285059	99	46	25,15	cyclictest	3288232	-21	latency_hist	07:30:00	1
3285059	99	45	36,7	cyclictest	3286828	-21	systemd	07:24:32	1
3285059	99	45	31,10	cyclictest	3293860	-21	apt-get	08:25:11	1
3285059	99	45	28,13	cyclictest	3295181	-21	apt	08:35:01	1
3285059	99	45	26,15	cyclictest	3293702	-21	basename	08:25:00	1
3285057	99	45	27,15	cyclictest	0	-21	swapper/0	07:40:01	0
3285057	99	45	20,21	cyclictest	3293710	-21	modprobe	08:24:59	0
3285059	99	44	31,7	cyclictest	37	-21	kcompactd0	07:50:02	1
3285059	99	44	28,10	cyclictest	37	-21	kcompactd0	08:38:41	1
3285057	99	44	26,13	cyclictest	3291999	-21	latency_hist	08:10:00	0
3285059	99	43	36,5	cyclictest	3278607	-21	kworker/u4:2+events_unbound	07:10:01	1
3285057	99	43	28,12	cyclictest	3295263	-21	latency_hist	08:35:02	0
3285057	99	43	27,11	cyclictest	3290086	-21	latency_hist	07:50:01	0
3285057	99	42	30,8	cyclictest	3290204	-21	sshd	07:50:29	0
3285059	99	41	30,8	cyclictest	1060	-21	snmpd	07:47:43	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17