OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of all highest latencies:

System rack7slot2.osadl.org (updated Fri Jan 23, 2026 12:44:05)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2377999	99	133	111,12	cyclictest	2471804	-21	apt-get	10:25:23	1
2377998	99	116	109,5	cyclictest	2490182	-21	kworker/u4:11+events_unbound	11:45:00	0
2377998	99	116	109,5	cyclictest	2490182	-21	kworker/u4:11+events_unbound	11:45:00	0
2377998	99	114	106,6	cyclictest	2499408	-21	kworker/u4:2+events_unbound	12:00:03	0
2377999	99	113	93,6	cyclictest	2436866	-21	kworker/u4:1+events_unbound	09:44:41	1
2377998	99	113	99,7	cyclictest	2470804	-21	kworker/u4:6+events_unbound	10:24:46	0
2377998	99	109	98,5	cyclictest	2481163	-21	kworker/u4:5+events_unbound	11:19:56	0
2377999	99	102	85,5	cyclictest	2432546	-21	kworker/u4:16+events_unbound	09:49:40	1
2377999	99	100	92,6	cyclictest	2428180	-21	kworker/u4:11+events_unbound	09:34:39	1
2377999	99	97	91,4	cyclictest	2466471	-21	kworker/u4:8+events_unbound	10:19:44	1
2377999	99	97	91,4	cyclictest	2466471	-21	kworker/u4:8+events_unbound	10:19:44	1
2377998	99	97	85,5	cyclictest	2476890	-21	kworker/u4:1+events_unbound	10:59:55	0
2377999	99	95	78,5	cyclictest	2428179	-21	kworker/u4:10+events_unbound	09:54:41	1
2377998	99	95	88,5	cyclictest	2462143	-21	kworker/u4:1+events_unbound	10:14:44	0
2377998	99	91	84,5	cyclictest	2385608	-21	kworker/u4:3+events_unbound	08:54:32	0
2377998	99	89	82,5	cyclictest	2388152	-21	kworker/u4:12+events_unbound	07:59:23	0
2377998	99	89	78,5	cyclictest	2478779	-21	kworker/u4:2+events_unbound	11:25:00	0
2377998	99	88	81,5	cyclictest	2511038	-21	kworker/u4:8+events_unbound	12:31:22	0
2377998	99	86	78,6	cyclictest	2462147	-21	kworker/u4:5+events_unbound	10:29:51	0
2377998	99	84	76,6	cyclictest	2385611	-21	kworker/u4:6+events_unbound	08:19:27	0
2377998	99	82	75,5	cyclictest	2394453	-21	kworker/u4:5+events_unbound	08:29:28	0
2377998	99	81	74,5	cyclictest	2399509	-21	kworker/u4:10+events_unbound	08:44:31	0
2377998	99	81	73,6	cyclictest	2470803	-21	kworker/u4:4+events_unbound	11:04:56	0
2377998	99	80	73,5	cyclictest	2355300	-21	kworker/u4:13+events_unbound	08:14:25	0
2377998	99	77	69,6	cyclictest	2381752	-21	kworker/u4:4+events_unbound	07:29:19	0
2377998	99	75	68,5	cyclictest	2381754	-21	kworker/u4:6+events_unbound	07:24:19	0
2377999	99	74	62,5	cyclictest	2466470	-21	kworker/u4:7+events_unbound	10:39:50	1
2377998	99	74	66,6	cyclictest	2395709	-21	kworker/u4:14+events_unbound	08:39:29	0
2377999	99	70	49,7	cyclictest	2511038	-21	kworker/u4:8+events_unbound	12:35:01	1
2377998	99	70	63,5	cyclictest	2355300	-21	kworker/u4:13+events_unbound	07:34:21	0
2377999	99	68	59,6	cyclictest	2388152	-21	kworker/u4:12+events_unbound	08:05:00	1
2377998	99	68	60,6	cyclictest	2511038	-21	kworker/u4:8+events_unbound	12:36:22	0
2377998	99	68	55,8	cyclictest	54	-21	kswapd0	09:15:19	0
2377998	99	68	55,8	cyclictest	54	-21	kswapd0	09:15:19	0
2377999	99	67	46,8	cyclictest	2506343	-21	kworker/u4:0+events_unbound	12:15:12	1
2377999	99	66	60,4	cyclictest	2501737	-21	kworker/u4:5+events_unbound	12:10:05	1
2377999	99	66	60,4	cyclictest	2501737	-21	kworker/u4:5+events_unbound	12:10:05	1
2377999	99	65	58,5	cyclictest	2457839	-21	kworker/u4:11+events_unbound	10:09:44	1
2377999	99	65	58,5	cyclictest	2457839	-21	kworker/u4:11+events_unbound	10:09:44	1
2377999	99	65	50,5	cyclictest	2407089	-21	kworker/u4:2+events_unbound	09:09:37	1
2377998	99	65	55,7	cyclictest	1	-21	systemd	11:39:58	0
2377999	99	64	58,4	cyclictest	2385611	-21	kworker/u4:6+events_unbound	08:25:01	1
2377999	99	63	55,6	cyclictest	2362650	-21	kworker/u4:15+events_unbound	07:20:01	1
2377999	99	63	46,6	cyclictest	2476890	-21	kworker/u4:1+events_unbound	11:19:44	1
2377999	99	62	53,7	cyclictest	410	-21	systemd-logind	11:14:57	1
2377999	99	62	52,8	cyclictest	2413103	-21	apt-get	09:15:22	1
2377999	99	62	52,8	cyclictest	2413103	-21	apt-get	09:15:22	1
2377999	99	62	42,6	cyclictest	2381751	-21	kworker/u4:2+events_unbound	07:35:03	1
2377999	99	61	6,42	cyclictest	2493462	-21	ssh	11:45:13	1
2377999	99	60	52,5	cyclictest	2385608	-21	kworker/u4:3+events_unbound	07:50:01	1
2377998	99	60	51,4	cyclictest	0	-21	swapper/0	10:46:23	0
2377998	99	60	40,18	cyclictest	0	-21	swapper/0	09:50:21	0
2377999	99	58	46,4	cyclictest	2402046	-21	kworker/u4:20+events_unbound	08:45:01	1
2377998	99	58	50,6	cyclictest	2470803	-21	kworker/u4:4+events_unbound	11:25:02	0
2377998	99	58	50,6	cyclictest	2385606	-21	kworker/u4:0+events_unbound	08:20:02	0
2377998	99	58	45,10	cyclictest	54	-21	kswapd0	12:15:09	0
2377998	99	57	45,10	cyclictest	2498010	-21	/usr/sbin/munin	11:55:12	0
2377998	99	57	32,22	cyclictest	255	50	irq/23-42890000.ethernet	07:35:12	0
2377998	99	56	49,5	cyclictest	2475307	-21	kworker/u4:9+events_unbound	10:51:44	0
2377998	99	55	48,5	cyclictest	2436868	-21	kworker/u4:7+events_unbound	09:57:43	0
2377999	99	54	46,6	cyclictest	2410667	-21	kworker/u4:3+events_unbound	09:25:00	1
2377999	99	54	45,7	cyclictest	2490916	-21	systemd	11:39:59	1
2377998	99	54	47,5	cyclictest	2470800	-21	kworker/u4:0+events_unbound	10:39:59	0
2377998	99	54	47,5	cyclictest	2385608	-21	kworker/u4:3+events_unbound	09:05:03	0
2377999	99	53	47,4	cyclictest	2385612	-21	kworker/u4:7+events_unbound	08:55:01	1
2377999	99	53	46,5	cyclictest	2511036	-21	kworker/u4:3+events_unbound	12:28:25	1
2377999	99	53	45,5	cyclictest	2430460	-21	df_abs	09:35:17	1
2377998	99	53	46,5	cyclictest	2492509	-21	kworker/u4:14+events_unbound	11:48:01	0
2377999	99	52	45,5	cyclictest	2475075	-21	kworker/u4:8+events_unbound	10:42:58	1
2377999	99	52	44,6	cyclictest	2462145	-21	kworker/u4:3+events_unbound	10:20:02	1
2377998	99	52	44,6	cyclictest	2410671	-21	kworker/u4:7+events_unbound	09:11:59	0
2377999	99	51	38,10	cyclictest	2421762	-21	aten_r7power_vo	09:25:16	1
2377998	99	51	44,5	cyclictest	2462145	-21	kworker/u4:3+events_unbound	10:31:43	0
2377999	99	50	43,5	cyclictest	2470803	-21	kworker/u4:4+events_unbound	11:32:59	1
2377999	99	50	41,6	cyclictest	2385606	-21	kworker/u4:0+events_unbound	07:54:22	1
2377998	99	50	44,5	cyclictest	2476894	-21	kworker/u4:7+events_unbound	11:15:01	0
2377998	99	50	43,5	cyclictest	2470803	-21	kworker/u4:4+events_unbound	11:09:43	0
2377998	99	50	42,6	cyclictest	2436866	-21	kworker/u4:1+events_unbound	09:44:59	0
2377998	99	50	41,6	cyclictest	2378415	-21	fschecks_count	07:10:19	0
2377998	99	50	39,8	cyclictest	2505268	-21	fschecks_time	12:10:21	0
2377998	99	50	39,8	cyclictest	2505268	-21	fschecks_time	12:10:20	0
2377999	99	49	42,5	cyclictest	2496486	-21	proc_pri	11:50:33	1
2377999	99	49	42,5	cyclictest	2409282	-21	/usr/sbin/munin	09:10:21	1
2377999	99	49	39,7	cyclictest	2502399	-21	sh	12:05:00	1
2377998	99	49	43,5	cyclictest	2501734	-21	kworker/u4:0+events_unbound	12:05:02	0
2377998	99	49	43,5	cyclictest	2501734	-21	kworker/u4:0+events_unbound	12:05:02	0
2377998	99	49	42,5	cyclictest	2465259	-21	/usr/sbin/munin	10:15:35	0
2377998	99	49	42,5	cyclictest	2465259	-21	/usr/sbin/munin	10:15:35	0
2377998	99	49	42,5	cyclictest	2399509	-21	kworker/u4:10+events_unbound	08:34:59	0
2377998	99	49	42,5	cyclictest	2355300	-21	kworker/u4:13+events_unbound	07:44:00	0
2377998	99	49	37,5	cyclictest	2355300	-21	kworker/u4:13+events_unbound	07:18:43	0
2377999	99	48	41,5	cyclictest	2484706	-21	head	11:25:19	1
2377999	99	48	40,6	cyclictest	378	-21	systemd-timesyn	07:25:42	1
2377999	99	48	39,6	cyclictest	2499411	-21	kworker/u4:6+events_unbound	12:00:02	1
2377999	99	48	39,6	cyclictest	2381183	-21	kernelversion	07:20:20	1
2377999	99	48	35,10	cyclictest	2451304	-21	sendmail	10:00:00	1
2377998	99	48	40,6	cyclictest	2385611	-21	kworker/u4:6+events_unbound	08:55:43	0
2377998	99	48	36,8	cyclictest	2426255	-21	ssh	09:30:18	0
2377998	99	48	24,20	cyclictest	0	-21	swapper/0	10:00:39	0
2377998	99	48	14,10	cyclictest	17	1	rcu_preempt	09:35:04	0
2377999	99	47	40,5	cyclictest	2462147	-21	kworker/u4:5+events_unbound	10:13:42	1
2377998	99	47	40,5	cyclictest	2501737	-21	kworker/u4:5+events_unbound	12:28:47	0
2377998	99	47	40,5	cyclictest	2442742	-21	idleruntime-cro	09:50:00	0
2377998	99	47	40,5	cyclictest	2418363	-21	switchtime	09:20:40	0
2377998	99	47	40,5	cyclictest	2391942	-21	kworker/u4:10+events_unbound	08:05:43	0
2377999	99	46	40,4	cyclictest	2406418	-21	gltestperf	09:00:19	1
2377999	99	46	39,5	cyclictest	2362650	-21	kworker/u4:15+events_unbound	07:35:04	1
2377999	99	46	37,6	cyclictest	2154125	-21	kworker/u4:7+rpciod	07:10:02	1
2377999	99	46	31,5	cyclictest	2475307	-21	kworker/u4:9+events_unbound	10:55:02	1
2377998	99	46	41,4	cyclictest	2381751	-21	kworker/u4:2+events_unbound	07:51:43	0
2377998	99	46	39,5	cyclictest	2508707	-21	kworker/u4:6+events_unbound	12:21:00	0
2377998	99	46	38,6	cyclictest	2415678	-21	kworker/u4:4+events_unbound	10:05:48	0
2377998	99	46	38,6	cyclictest	2415678	-21	kworker/u4:4+events_unbound	10:05:48	0
2377998	99	46	37,7	cyclictest	2486680	-21	aten_r7power_en	11:30:15	0
2377998	99	46	36,7	cyclictest	2387420	-21	fschecks_time	07:45:19	0
2377998	99	46	2,34	cyclictest	2422243	-21	ntpq	09:25:24	0
2377999	99	45	36,7	cyclictest	2511847	-21	df_abs	12:39:19	1
2377998	99	45	39,4	cyclictest	0	-21	swapper/0	10:44:52	0
2377998	99	45	36,7	cyclictest	2495804	-21	aten_r7power_en	11:50:15	0
2377998	99	45	36,7	cyclictest	2390969	-21	aten_r7power_en	08:00:16	0
2377999	99	44	37,5	cyclictest	2502815	-21	sed	12:05:15	1
2377999	99	44	37,5	cyclictest	2502815	-21	sed	12:05:15	1
2377999	99	44	36,5	cyclictest	2379248	-21	idleruntime-cro	07:15:00	1
2377999	99	43	36,5	cyclictest	2398742	-21	fschecks_count	08:30:18	1
2377999	99	43	34,7	cyclictest	2484073	-21	systemd	11:24:58	1
2377999	99	42	35,4	cyclictest	0	-21	swapper/1	10:34:40	1
2377999	99	42	34,5	cyclictest	2392536	-21	gltestperf	08:05:20	1
2377999	99	42	29,8	cyclictest	0	-21	swapper/1	08:35:34	1
2377999	99	41	34,4	cyclictest	0	-21	swapper/1	10:00:36	1
2377999	99	41	33,6	cyclictest	2477336	-21	latency_hist	11:05:02	1
2377999	99	41	31,6	cyclictest	0	-21	swapper/1	07:55:23	1
2377999	99	41	30,9	cyclictest	0	-21	swapper/1	08:10:16	1
2377998	99	41	34,5	cyclictest	2402732	-21	kernelversion	08:45:20	0
2377998	99	41	33,6	cyclictest	2406965	-21	unixbench-2d	09:00:36	0
2377999	99	40	34,4	cyclictest	2385607	-21	kworker/u4:1+events_unbound	07:45:01	1
2377999	99	40	27,6	cyclictest	2470803	-21	kworker/u4:4+events_unbound	11:09:55	1
2377999	99	39	33,4	cyclictest	2490182	-21	kworker/u4:11+events_unbound	11:40:21	1
2377999	99	39	33,4	cyclictest	2490182	-21	kworker/u4:11+events_unbound	11:40:21	1
2377999	99	39	33,4	cyclictest	2475869	-21	aten_r7power_cu	10:55:15	1
2377999	99	38	29,6	cyclictest	2475502	-21	latency_hist	10:50:03	1
2377999	99	38	29,6	cyclictest	0	-21	swapper/1	08:25:36	1
2377999	99	38	28,7	cyclictest	2355300	-21	kworker/u4:13+rpciod	08:15:16	1
2377999	99	38	27,9	cyclictest	0	-21	swapper/1	08:45:14	1
2377999	99	37	25,9	cyclictest	0	-21	swapper/1	08:55:33	1
2377998	99	34	8,4	cyclictest	15	1	ktimers/0	07:10:01	0
2377999	99	33	24,6	cyclictest	0	-21	swapper/1	12:30:00	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17