OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the 376 highest latencies:

System rack7slot2.osadl.org (updated Sun May 10, 2026 12:44:10)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3004003	99	105	84,18	cyclictest	3064564	-21	kworker/u4:8+events_unbound	09:50:07	0
3004003	99	96	85,7	cyclictest	0	-21	swapper/0	12:35:25	0
3004003	99	81	65,13	cyclictest	3104103	-21	kworker/u4:2+events_unbound	10:45:18	0
3004003	99	80	70,7	cyclictest	3134560	-21	kworker/u4:2+events_unbound	11:10:28	0
3004005	99	75	41,31	cyclictest	3193493	-21	diskmemload	12:10:24	1
3004005	99	75	26,36	cyclictest	0	-21	swapper/1	10:10:32	1
3004003	99	75	68,5	cyclictest	3006595	-21	kworker/u4:12+events_unbound	07:45:01	0
3004003	99	74	2,67	cyclictest	0	-21	swapper/0	10:00:33	0
3004005	99	73	66,5	cyclictest	2991208	-21	kworker/u4:10+events_unbound	08:00:01	1
3004005	99	73	27,27	cyclictest	0	-21	swapper/1	09:10:35	1
3004003	99	73	52,18	cyclictest	53	-21	kswapd0	11:00:10	0
3004003	99	73	49,7	cyclictest	3139001	-21	kworker/u4:6+events_unbound	11:30:30	0
3004005	99	70	38,29	cyclictest	3030374	-21	aten_r7power_vo	08:50:19	1
3004005	99	69	44,22	cyclictest	3207066	-21	unixbench_multi	12:25:41	1
3004005	99	69	20,27	cyclictest	0	-21	swapper/1	09:19:19	1
3004005	99	69	20,27	cyclictest	0	-21	swapper/1	09:19:18	1
3004003	99	69	28,36	cyclictest	256	50	irq/23-42890000.ethernet	08:40:11	0
3004005	99	68	36,29	cyclictest	0	-21	swapper/1	11:30:30	1
3004005	99	68	19,34	cyclictest	3180542	-21	load	11:55:23	1
3004003	99	68	60,6	cyclictest	3064563	-21	kworker/u4:7+events_unbound	09:45:06	0
3004005	99	67	49,12	cyclictest	0	-21	swapper/1	10:35:32	1
3004005	99	67	42,22	cyclictest	3102978	-21	timerandwakeup	10:25:39	1
3004003	99	67	59,6	cyclictest	3190940	-21	kworker/u4:9+events_unbound	12:20:44	0
3004003	99	67	30,30	cyclictest	256	50	irq/23-42890000.ethernet	11:05:07	0
3004005	99	66	57,7	cyclictest	3095151	-21	kworker/u4:8+events_unbound	10:20:14	1
3004005	99	66	35,28	cyclictest	3084311	-21	systemd	10:05:10	1
3004005	99	66	35,28	cyclictest	3084311	-21	systemd	10:05:10	1
3004005	99	66	10,32	cyclictest	3049810	-21	ntpq	09:25:35	1
3004003	99	65	55,7	cyclictest	3031305	-21	kworker/u4:0+events_unbound	09:05:01	0
3004003	99	65	52,10	cyclictest	3104103	-21	kworker/u4:2+events_unbound	10:30:15	0
3004003	99	65	47,12	cyclictest	3180269	-21	ssh	11:55:20	0
3004005	99	64	48,12	cyclictest	53	-21	kswapd0	09:50:11	1
3004005	99	64	32,30	cyclictest	3184342	-21	aten_r7power_en	12:00:14	1
3004005	99	64	32,30	cyclictest	3184342	-21	aten_r7power_en	12:00:13	1
3004005	99	64	2,58	cyclictest	3197137	-21	apt-get	12:15:13	1
3004005	99	64	1,59	cyclictest	3162693	-21	apt-get	11:35:12	1
3004005	99	64	1,39	cyclictest	3148310	-21	ssh	11:18:09	1
3004003	99	64	56,6	cyclictest	3203479	-21	kworker/u4:6+events_unbound	12:25:45	0
3004005	99	63	2,36	cyclictest	3127118	-21	ssh	10:53:56	1
3004005	99	63	2,36	cyclictest	3127118	-21	ssh	10:53:56	1
3004005	99	62	42,18	cyclictest	3067887	-21	timerandwakeup	09:45:38	1
3004005	99	62	3,54	cyclictest	3189202	-21	ntpq	12:05:25	1
3004003	99	62	3,52	cyclictest	0	-21	swapper/0	11:35:12	0
3004005	99	61	40,12	cyclictest	0	-21	swapper/1	07:15:10	1
3004005	99	61	32,25	cyclictest	0	-21	swapper/1	09:35:31	1
3004005	99	61	29,29	cyclictest	0	-21	swapper/1	10:40:26	1
3004003	99	61	14,32	cyclictest	3062131	-21	date	09:40:02	0
3004005	99	60	3,53	cyclictest	3045175	-21	ssh	09:20:27	1
3004005	99	60	27,30	cyclictest	3132645	-21	aten_r7power_cu	11:00:27	1
3004005	99	60	1,56	cyclictest	3149762	-21	ssh	11:20:10	1
3004003	99	60	53,5	cyclictest	3186609	-21	kworker/u4:3+events_unbound	12:05:38	0
3004003	99	60	39,10	cyclictest	256	50	irq/23-42890000.ethernet	07:15:10	0
3004003	99	60	28,21	cyclictest	256	50	irq/23-42890000.ethernet	08:15:11	0
3004005	99	59	48,8	cyclictest	3173463	-21	kworker/u4:4+events_unbound	11:50:36	1
3004005	99	59	3,51	cyclictest	3145197	-21	ssh	11:15:01	1
3004005	99	59	31,25	cyclictest	0	-21	swapper/1	12:20:31	1
3004005	99	59	2,45	cyclictest	3107068	-21	ssh	10:30:32	1
3004005	99	59	1,54	cyclictest	3171330	-21	apt-get	11:45:12	1
3004005	99	59	1,54	cyclictest	3017766	-21	ntpq	08:00:25	1
3004005	99	59	1,35	cyclictest	3169464	-21	ssh	11:42:27	1
3004005	99	58	4,50	cyclictest	3024267	-21	ntpq	08:25:27	1
3004005	99	58	3,50	cyclictest	3215299	-21	ssh	12:35:34	1
3004005	99	58	3,50	cyclictest	3076492	-21	ssh	09:55:36	1
3004005	99	58	2,51	cyclictest	3034627	-21	ntpq	09:05:24	1
3004003	99	58	38,17	cyclictest	3147760	-21	kworker/u4:1+rpciod	11:25:29	0
3004003	99	58	38,17	cyclictest	3147760	-21	kworker/u4:1+rpciod	11:25:29	0
3004005	99	57	5,47	cyclictest	3154781	-21	ntpq	11:25:25	1
3004005	99	57	5,47	cyclictest	3154781	-21	ntpq	11:25:25	1
3004005	99	57	4,49	cyclictest	3019128	-21	ntpq	08:05:33	1
3004005	99	57	3,50	cyclictest	3119685	-21	cat	10:45:19	1
3004005	99	57	33,22	cyclictest	3129304	-21	timerwakeupswit	10:55:42	1
3004005	99	57	28,26	cyclictest	0	-21	swapper/1	07:10:11	1
3004005	99	57	2,51	cyclictest	3029447	-21	ntpq	08:45:26	1
3004005	99	57	2,50	cyclictest	3007507	-21	ntpq	07:20:33	1
3004005	99	57	1,52	cyclictest	3008758	-21	ntpq	07:25:27	1
3004005	99	56	49,5	cyclictest	0	-21	swapper/1	08:30:35	1
3004005	99	56	2,50	cyclictest	3097258	-21	sed	10:20:01	1
3004005	99	56	2,47	cyclictest	3013371	-21	apt-get	07:45:12	1
3004005	99	56	18,35	cyclictest	3050954	-21	kworker/u4:9+rpciod	09:30:30	1
3004003	99	56	3,49	cyclictest	0	-21	swapper/0	07:30:07	0
3004003	99	56	1,17	cyclictest	3029987	-21	apt-get	08:50:08	0
3004005	99	55	31,21	cyclictest	0	-21	swapper/1	12:30:32	1
3004005	99	55	26,26	cyclictest	0	-21	swapper/1	11:05:44	1
3004005	99	55	2,50	cyclictest	3011451	-21	ntpq	07:35:33	1
3004005	99	55	2,48	cyclictest	3028315	-21	ps	08:40:40	1
3004005	99	55	1,13	cyclictest	3082365	-21	ssh	10:02:19	1
3004003	99	55	50,3	cyclictest	3009259	-21	sshd	07:29:34	0
3004003	99	55	44,8	cyclictest	3000200	-21	kworker/u4:1-rpciod	08:55:40	0
3004003	99	55	38,14	cyclictest	3020866	-21	idleruntime-cro	08:15:01	0
3004005	99	54	3,47	cyclictest	3023008	-21	sed	08:20:27	1
3004005	99	54	2,49	cyclictest	3065241	-21	ssh	09:43:07	1
3004005	99	54	2,48	cyclictest	3012682	-21	ntpq	07:40:26	1
3004003	99	54	6,12	cyclictest	3035462	-21	apt-get	09:10:12	0
3004003	99	54	46,5	cyclictest	3089314	-21	/usr/sbin/munin	10:10:23	0
3004003	99	54	43,9	cyclictest	3150546	-21	systemd	11:20:28	0
3004005	99	53	3,46	cyclictest	3020393	-21	ntpq	08:10:34	1
3004005	99	53	2,48	cyclictest	3033405	-21	ntpq	09:00:30	1
3004005	99	53	2,46	cyclictest	3031731	-21	df_inode	08:55:19	1
3004003	99	53	45,6	cyclictest	3125716	-21	kworker/u4:13+events_unbound	10:55:20	0
3004003	99	53	44,7	cyclictest	3186609	-21	kworker/u4:3+events_unbound	12:10:39	0
3004005	99	52	2,47	cyclictest	3021739	-21	ntpq	08:15:35	1
3004003	99	52	41,8	cyclictest	3029092	-21	df_abs	08:45:16	0
3004003	99	52	36,14	cyclictest	53	-21	kswapd0	10:45:01	0
3004005	99	51	2,45	cyclictest	3015374	-21	ps	07:50:38	1
3004005	99	51	1,44	cyclictest	3026809	-21	ntpq	08:35:27	1
3004003	99	51	41,7	cyclictest	3004477	-21	fschecks_time	07:10:19	0
3004003	99	51	40,8	cyclictest	3034930	-21	timerandwakeup	09:05:38	0
3004005	99	50	1,46	cyclictest	3010082	-21	ntpq	07:30:28	1
3004003	99	50	43,5	cyclictest	3167951	-21	/usr/sbin/munin	11:40:37	0
3004003	99	50	22,25	cyclictest	0	-21	swapper/0	09:40:37	0
3004003	99	49	40,7	cyclictest	3146544	-21	xargs	11:15:38	0
3004003	99	49	39,7	cyclictest	3111143	-21	gltestperf	10:35:22	0
3004003	99	49	29,13	cyclictest	256	50	irq/23-42890000.ethernet	07:20:10	0
3004003	99	49	28,19	cyclictest	3201289	-21	latency_hist	12:20:01	0
3004003	99	49	2,41	cyclictest	53	-21	kswapd0	10:50:11	0
3004003	99	49	2,41	cyclictest	53	-21	kswapd0	10:50:11	0
3004003	99	48	41,5	cyclictest	3176856	-21	grep	11:50:42	0
3004003	99	48	40,6	cyclictest	3101617	-21	latency_hist	10:25:01	0
3004003	99	47	40,5	cyclictest	3171918	-21	kernelversion	11:45:21	0
3004003	99	47	40,5	cyclictest	3101844	-21	ssh	10:25:12	0
3004003	99	47	39,5	cyclictest	3044568	-21	/usr/sbin/munin	09:20:16	0
3004003	99	47	37,7	cyclictest	3041105	-21	timerandwakeup	09:15:39	0
3004003	99	47	37,7	cyclictest	3041105	-21	timerandwakeup	09:15:38	0
3004003	99	47	27,17	cyclictest	0	-21	swapper/0	09:30:38	0
3004003	99	46	40,4	cyclictest	3093314	-21	df_abs	10:15:17	0
3004003	99	46	38,6	cyclictest	3026031	-21	kworker/u4:11+events_unbound	08:35:00	0
3004003	99	46	3,33	cyclictest	3027321	-21	modprobe	08:40:00	0
3004003	99	45	38,5	cyclictest	3004002	-21	cyclictest	09:55:19	0
3004003	99	45	34,8	cyclictest	3085655	-21	unixbench_singl	10:05:40	0
3004003	99	45	34,8	cyclictest	3085655	-21	unixbench_singl	10:05:39	0
3004003	99	44	35,7	cyclictest	3014658	-21	aten2__	07:50:18	0
3004003	99	43	36,5	cyclictest	3185012	-21	ldconfig	12:00:27	0
3004003	99	43	36,5	cyclictest	3185012	-21	ldconfig	12:00:26	0
3004003	99	43	36,5	cyclictest	3004002	-21	cyclictest	09:25:30	0
3004003	99	43	35,5	cyclictest	3210089	-21	sh	12:30:11	0
3004003	99	43	31,9	cyclictest	3018734	-21	fschecks_count	08:05:20	0
3004005	99	42	2,35	cyclictest	3004083	-21	latency_hist	07:10:02	1
3004003	99	42	34,5	cyclictest	0	-21	swapper/0	07:45:20	0
3004003	99	42	33,6	cyclictest	3024136	-21	sshd	08:25:21	0
3004003	99	41	31,7	cyclictest	3017568	-21	gltestperf	08:00:18	0
3004003	99	40	32,6	cyclictest	3022450	-21	aten_r7power_cu	08:20:16	0
3004003	99	39	30,6	cyclictest	3016402	-21	kernelversion	07:55:21	0
3004003	99	38	30,6	cyclictest	3010831	-21	aten2__	07:35:17	0
3004003	99	38	30,4	cyclictest	0	-21	swapper/0	07:10:01	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17