OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Tue Dec 02, 2025 12:44:05)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3606582	99	130	122,6	cyclictest	3646417	-21	kworker/u4:10+events_unbound	09:40:41	1
3606582	99	127	113,7	cyclictest	3622014	-21	kworker/u4:13+events_unbound	08:35:30	1
3606582	99	125	115,8	cyclictest	3607816	-21	kworker/u4:6+events_unbound	07:45:21	1
3606582	99	125	114,8	cyclictest	3609114	-21	kworker/u4:7+events_unbound	07:20:14	1
3606582	99	124	116,6	cyclictest	3612986	-21	kworker/u4:12+events_unbound	08:20:28	1
3606582	99	122	114,6	cyclictest	3611706	-21	kworker/u4:11+events_unbound	08:55:36	1
3606582	99	121	113,5	cyclictest	3714951	-21	kworker/u4:8+events_unbound	11:06:02	1
3606580	99	121	113,5	cyclictest	3629738	-21	kworker/u4:1+events_unbound	09:10:37	0
3606582	99	119	111,6	cyclictest	3659254	-21	kworker/u4:16+events_unbound	09:45:43	1
3606582	99	119	111,5	cyclictest	3632334	-21	kworker/u4:15+events_unbound	09:30:41	1
3606582	99	117	106,7	cyclictest	3612986	-21	kworker/u4:12+events_unbound	08:10:25	1
3606580	99	114	104,8	cyclictest	3607815	-21	kworker/u4:5+events_unbound	07:50:22	0
3606582	99	113	106,5	cyclictest	3756264	-21	kworker/u4:14+events_unbound	12:26:17	1
3606582	99	111	102,7	cyclictest	3778001	-21	kworker/u4:1+events_unbound	12:36:17	1
3606582	99	108	94,6	cyclictest	3632334	-21	kworker/u4:15+events_unbound	09:25:39	1
3606582	99	108	100,6	cyclictest	3724966	-21	kworker/u4:13+events_unbound	11:21:03	1
3606580	99	107	99,5	cyclictest	3697013	-21	kworker/u4:6+events_unbound	10:50:58	0
3606580	99	104	96,6	cyclictest	3611704	-21	kworker/u4:3+events_unbound	08:05:25	0
3606582	99	102	95,5	cyclictest	3632334	-21	kworker/u4:15+events_unbound	10:05:49	1
3606582	99	100	94,5	cyclictest	3631050	-21	kworker/u4:8+events_unbound	08:45:33	1
3606582	99	100	93,5	cyclictest	3683086	-21	kworker/u4:11+events_unbound	10:25:54	1
3606582	99	100	92,6	cyclictest	3656001	-21	kworker/u4:9+events_unbound	09:55:45	1
3606582	99	97	87,8	cyclictest	3607815	-21	kworker/u4:5+events_unbound	07:15:14	1
3606582	99	97	87,7	cyclictest	3662213	-21	kworker/u4:18+events_unbound	10:30:54	1
3606580	99	95	88,5	cyclictest	3669463	-21	kworker/u4:0+events_unbound	10:15:50	0
3606582	99	94	85,6	cyclictest	3625892	-21	kworker/u4:0+events_unbound	09:05:38	1
3606580	99	92	85,5	cyclictest	3745675	-21	kworker/u4:4+events_unbound	11:56:12	0
3606582	99	91	83,5	cyclictest	3656001	-21	kworker/u4:9+events_unbound	10:35:54	1
3606580	99	90	81,6	cyclictest	3628457	-21	kworker/u4:17+events_unbound	08:35:32	0
3606582	99	88	80,6	cyclictest	3732068	-21	kworker/u4:6+events_unbound	11:36:08	1
3606582	99	88	78,7	cyclictest	3662213	-21	kworker/u4:18+events_unbound	10:10:50	1
3606580	99	88	79,7	cyclictest	3620731	-21	kworker/u4:2+events_unbound	08:30:29	0
3606580	99	86	77,7	cyclictest	3629742	-21	kworker/u4:5+events_unbound	08:40:32	0
3606580	99	84	74,7	cyclictest	3732063	-21	kworker/u4:0+events_unbound	11:31:06	0
3606582	99	83	70,9	cyclictest	53	-21	kswapd0	12:31:18	1
3606582	99	81	73,6	cyclictest	3625892	-21	kworker/u4:0+events_unbound	08:50:33	1
3606582	99	81	72,6	cyclictest	3749755	-21	kworker/u4:3+events_unbound	12:06:14	1
3606582	99	80	59,9	cyclictest	3656001	-21	kworker/u4:9+events_unbound	10:45:02	1
3606582	99	78	70,6	cyclictest	3746147	-21	kworker/u4:7+events_unbound	11:51:09	1
3606582	99	77	69,6	cyclictest	3659254	-21	kworker/u4:16+events_unbound	10:00:47	1
3606582	99	74	63,9	cyclictest	3632333	-21	kworker/u4:14+events_unbound	09:15:39	1
3606580	99	74	67,5	cyclictest	3728511	-21	kworker/u4:8+events_unbound	11:26:07	0
3606580	99	74	45,21	cyclictest	257	50	irq/23-42890000.ethernet	07:10:00	0
3606582	99	73	65,6	cyclictest	3612986	-21	kworker/u4:12+events_unbound	09:35:43	1
3606580	99	73	65,6	cyclictest	3739028	-21	kworker/u4:0+events_unbound	11:46:10	0
3606580	99	73	65,6	cyclictest	3632333	-21	kworker/u4:14+events_unbound	09:15:38	0
3606582	99	72	62,7	cyclictest	3753302	-21	kworker/u4:13+events_unbound	12:01:14	1
3606580	99	71	63,6	cyclictest	3609114	-21	kworker/u4:7+events_unbound	07:30:18	0
3606582	99	70	55,5	cyclictest	3732063	-21	kworker/u4:0+events_unbound	11:31:09	1
3606580	99	70	51,8	cyclictest	3656000	-21	kworker/u4:5+events_unbound	09:40:43	0
3606580	99	67	59,6	cyclictest	3629741	-21	kworker/u4:4+events_unbound	08:45:35	0
3606582	99	66	52,6	cyclictest	3714949	-21	kworker/u4:0+events_unbound	11:11:02	1
3606580	99	66	58,5	cyclictest	3629741	-21	kworker/u4:4+events_unbound	09:00:35	0
3606580	99	65	56,6	cyclictest	3632334	-21	kworker/u4:15+events_unbound	09:20:39	0
3606582	99	64	58,4	cyclictest	3680197	-21	kworker/u4:5+events_unbound	10:20:01	1
3606580	99	62	54,5	cyclictest	3778000	-21	kworker/u4:0+events_unbound	12:35:00	0
3606582	99	61	46,5	cyclictest	3700695	-21	kworker/u4:7+events_unbound	11:01:01	1
3606582	99	59	52,5	cyclictest	3689967	-21	kworker/u4:15+events_unbound	11:20:02	1
3606580	99	58	51,5	cyclictest	3620730	-21	kworker/u4:1+events_unbound	08:15:28	0
3606582	99	57	51,4	cyclictest	3749758	-21	kworker/u4:10+events_unbound	12:17:37	1
3606582	99	57	48,6	cyclictest	3620731	-21	kworker/u4:2+events_unbound	08:30:31	1
3606582	99	57	45,9	cyclictest	3615201	-21	ps	07:40:35	1
3606580	99	57	50,5	cyclictest	3649042	-21	sshd	09:25:39	0
3606580	99	57	50,5	cyclictest	3605299	-21	kworker/u4:1+events_unbound	07:30:00	0
3606580	99	57	42,12	cyclictest	3685310	-21	if_err_eth0	10:20:22	0
3606580	99	57	33,22	cyclictest	3625129	-21	fschecks_time	08:20:18	0
3606582	99	56	46,8	cyclictest	3372553	-21	kworker/u4:0+events_unbound	07:25:17	1
3606580	99	56	46,7	cyclictest	3656001	-21	kworker/u4:9+events_unbound	10:35:56	0
3606582	99	54	38,5	cyclictest	3629741	-21	kworker/u4:4+events_unbound	09:00:02	1
3606580	99	54	47,5	cyclictest	3783254	-21	ssh	12:40:00	0
3606580	99	54	46,6	cyclictest	3714952	-21	kworker/u4:10+events_unbound	11:16:04	0
3606580	99	54	46,6	cyclictest	3700696	-21	kworker/u4:8+events_unbound	10:45:56	0
3606582	99	53	46,5	cyclictest	3638680	-21	sshd	09:10:35	1
3606582	99	53	45,6	cyclictest	3609114	-21	kworker/u4:7+events_unbound	07:40:00	1
3606582	99	53	40,11	cyclictest	3741395	-21	ntp_kernel_pll_	11:40:29	1
3606582	99	52	45,5	cyclictest	3697013	-21	kworker/u4:6+events_unbound	10:50:14	1
3606582	99	52	40,10	cyclictest	3621399	-21	sshd	08:05:24	1
3606582	99	52	34,4	cyclictest	3683085	-21	kworker/u4:10+events_unbound	10:25:01	1
3606580	99	52	45,5	cyclictest	3610306	-21	/usr/sbin/munin	07:20:39	0
3606580	99	52	43,7	cyclictest	3631050	-21	kworker/u4:8+events_unbound	08:50:35	0
3606580	99	52	41,9	cyclictest	3606578	-21	cyclictest	07:35:18	0
3606580	99	51	44,5	cyclictest	3756265	-21	kworker/u4:15+events_unbound	12:16:14	0
3606582	99	50	42,6	cyclictest	3751705	-21	/usr/sbin/munin	11:55:23	1
3606580	99	50	44,4	cyclictest	3672345	-21	sshd	10:00:46	0
3606580	99	50	42,6	cyclictest	3738337	-21	unixbench_multi	11:35:41	0
3606580	99	50	42,5	cyclictest	0	-21	swapper/0	08:10:25	0
3606582	99	48	41,5	cyclictest	3762672	-21	systemd	12:11:12	1
3606582	99	48	40,5	cyclictest	3702611	-21	fschecks_time	10:45:20	1
3606582	99	48	40,5	cyclictest	3619464	-21	cut	08:00:00	1
3606582	99	48	37,8	cyclictest	3745303	-21	unixbench_singl	11:45:41	1
3606582	99	48	37,8	cyclictest	0	-21	swapper/1	12:20:14	1
3606582	99	48	37,7	cyclictest	0	-21	swapper/1	08:15:27	1
3606580	99	48	41,5	cyclictest	3668743	-21	systemd	09:55:44	0
3606580	99	48	41,5	cyclictest	3606578	-21	cyclictest	12:00:32	0
3606580	99	48	41,5	cyclictest	0	-21	swapper/0	09:45:42	0
3606580	99	48	39,7	cyclictest	3692210	-21	kernelversion	10:30:24	0
3606580	99	48	39,7	cyclictest	3372555	-21	kworker/u4:4+events_unbound	08:25:29	0
3606580	99	48	39,6	cyclictest	3637627	-21	diskmemload	09:10:01	0
3606580	99	48	38,8	cyclictest	3689594	-21	sshd	10:25:52	0
3606580	99	47	40,5	cyclictest	3699967	-21	diskmemload	10:40:40	0
3606580	99	47	39,6	cyclictest	3709615	-21	gltestperf	10:55:23	0
3606580	99	47	39,6	cyclictest	3607815	-21	kworker/u4:5+events_unbound	07:40:19	0
3606580	99	47	37,7	cyclictest	3620590	-21	unixbench-2d	08:00:38	0
3606580	99	47	36,9	cyclictest	3761561	-21	fschecks_count	12:10:22	0
3606580	99	47	36,8	cyclictest	3619284	-21	unixbench-2d	07:55:45	0
3606580	99	46	39,5	cyclictest	3748047	-21	fschecks_time	11:50:21	0
3606580	99	46	39,5	cyclictest	3674949	-21	gltestperf	10:05:22	0
3606580	99	46	36,7	cyclictest	0	-21	swapper/0	08:55:34	0
3606582	99	45	38,4	cyclictest	3664056	-21	df_abs	09:50:19	1
3606582	99	45	36,7	cyclictest	3618293	-21	latency_hist	07:55:01	1
3606582	99	45	36,6	cyclictest	3709415	-21	df_inode	10:55:20	1
3606582	99	45	35,7	cyclictest	3730771	-21	/usr/sbin/munin	11:25:20	1
3606582	99	45	28,13	cyclictest	0	-21	swapper/1	07:10:23	1
3606580	99	45	38,5	cyclictest	3720537	-21	ntp_kernel_pll_	11:10:31	0
3606580	99	45	38,5	cyclictest	3716898	-21	gltestperf	11:05:26	0
3606580	99	45	36,6	cyclictest	0	-21	swapper/0	07:15:13	0
3606580	99	45	35,8	cyclictest	3679178	-21	timerwakeupswit	10:10:40	0
3606580	99	45	33,10	cyclictest	3759137	-21	unixbench_multi	12:05:44	0
3606582	99	44	30,11	cyclictest	3620888	-21	sort	08:05:02	1
3606580	99	44	37,5	cyclictest	3768575	-21	fschecks_count	12:20:21	0
3606580	99	44	37,5	cyclictest	3651388	-21	basename	09:30:36	0
3606580	99	44	37,4	cyclictest	0	-21	swapper/0	11:20:26	0
3606580	99	44	34,8	cyclictest	3713728	-21	/usr/sbin/munin	11:00:40	0
3606580	99	44	34,8	cyclictest	3664897	-21	timerwakeupswit	09:50:39	0
3606580	99	44	33,8	cyclictest	3607839	-21	kworker/u4:3	07:15:00	0
3606582	99	43	34,7	cyclictest	3622012	-21	kworker/u4:7+events_unbound	09:21:37	1
3606582	99	43	29,11	cyclictest	0	-21	swapper/1	08:40:19	1
3606580	99	43	31,9	cyclictest	0	-21	swapper/0	11:40:40	0
3606580	99	42	36,4	cyclictest	257	50	irq/23-42890000.ethernet	12:25:29	0
3606582	99	41	30,7	cyclictest	0	-21	swapper/1	08:30:01	1
3606582	99	40	29,8	cyclictest	0	-21	swapper/1	07:10:00	1
3606580	99	40	32,5	cyclictest	0	-21	swapper/0	09:35:34	0
3606580	99	39	33,4	cyclictest	3616091	-21	tune2fs	07:45:20	0
3606582	99	38	29,6	cyclictest	0	-21	swapper/1	07:30:41	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17