OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Thu Jul 16, 2026 12:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3459227	99	119	98,7	cyclictest	3551707	-21	kworker/u4:0+events_unbound	10:20:53	1
3459226	99	104	10,15	cyclictest	3459199	-21	munin-run	07:10:00	0
3459227	99	103	95,6	cyclictest	3501589	-21	kworker/u4:3+events_unbound	09:35:46	1
3459226	99	103	94,6	cyclictest	3596986	-21	kworker/u4:4+events_unbound	11:21:10	0
3459227	99	94	86,6	cyclictest	3478535	-21	kworker/u4:1+events_unbound	09:10:44	1
3459226	99	94	86,5	cyclictest	3618994	-21	kworker/u4:12+events_unbound	11:36:16	0
3459227	99	88	80,6	cyclictest	3461735	-21	kworker/u4:10+events_unbound	08:20:36	1
3459227	99	87	49,30	cyclictest	0	-21	swapper/1	10:45:33	1
3459227	99	83	76,5	cyclictest	3482346	-21	kworker/u4:9+events_unbound	08:40:40	1
3459227	99	83	75,5	cyclictest	3461735	-21	kworker/u4:10+events_unbound	07:20:10	1
3459226	99	81	39,13	cyclictest	3653626	-21	ntpq	12:10:35	0
3459227	99	79	69,7	cyclictest	3570182	-21	kworker/u4:0+events_unbound	11:01:04	1
3459226	99	75	66,6	cyclictest	3465656	-21	kworker/u4:2+events_unbound	07:40:12	0
3459226	99	72	61,8	cyclictest	3659238	-21	kworker/u4:9+events_unbound	12:21:24	0
3459227	99	71	65,5	cyclictest	3556347	-21	kworker/u4:8+events_unbound	10:50:15	1
3459226	99	71	58,9	cyclictest	0	-21	swapper/0	10:25:13	0
3459226	99	69	35,5	cyclictest	3463029	-21	kworker/u4:13-rpciod	07:50:02	0
3459226	99	66	58,6	cyclictest	3655375	-21	kworker/u4:2+events_unbound	12:16:26	0
3459227	99	65	55,7	cyclictest	3672441	-21	sshd	12:31:26	1
3459226	99	64	56,5	cyclictest	3466931	-21	kworker/u4:11+events_unbound	08:05:00	0
3459226	99	64	55,6	cyclictest	3490105	-21	kworker/u4:9+events_unbound	09:15:44	0
3459226	99	64	50,12	cyclictest	3564101	-21	sendmail_mailst	10:30:38	0
3459226	99	64	1,49	cyclictest	3617602	-21	sh	11:30:24	0
3459226	99	63	54,5	cyclictest	0	-21	swapper/0	12:05:30	0
3459227	99	62	53,7	cyclictest	378	-21	dbus-daemon	10:40:59	1
3459227	99	62	45,7	cyclictest	3615134	-21	kworker/u4:4+events_unbound	12:29:46	1
3459226	99	61	54,4	cyclictest	0	-21	swapper/0	09:35:20	0
3459226	99	61	52,6	cyclictest	3556344	-21	kworker/u4:5+events_unbound	10:35:59	0
3459226	99	61	49,9	cyclictest	53	-21	kswapd0	09:30:12	0
3459226	99	60	54,5	cyclictest	3473420	-21	kworker/u4:17+events_unbound	08:15:01	0
3459226	99	60	54,5	cyclictest	3473420	-21	kworker/u4:17+events_unbound	08:15:00	0
3459227	99	59	49,6	cyclictest	0	-21	swapper/1	11:25:12	1
3459227	99	59	48,8	cyclictest	3479807	-21	kworker/u4:6+events_unbound	08:55:41	1
3459227	99	59	43,12	cyclictest	3621471	-21	aten_r7power_cu	11:35:15	1
3459226	99	58	51,5	cyclictest	3479807	-21	kworker/u4:6+events_unbound	08:45:15	0
3459226	99	58	49,7	cyclictest	3520041	-21	kworker/u4:7+events_unbound	09:55:49	0
3459227	99	57	50,5	cyclictest	3488803	-21	unixbench_singl	09:00:41	1
3459227	99	56	49,5	cyclictest	3585794	-21	/usr/sbin/munin	10:55:16	1
3459226	99	56	47,6	cyclictest	53	-21	kswapd0	11:00:33	0
3459227	99	55	39,12	cyclictest	0	-21	swapper/1	09:40:13	1
3459226	99	55	47,6	cyclictest	3478536	-21	kworker/u4:2+events_unbound	08:50:42	0
3459226	99	55	33,20	cyclictest	3675174	-21	aten_r7power_en	12:35:17	0
3459227	99	54	42,9	cyclictest	3617991	-21	mailstats	11:30:37	1
3459226	99	54	47,5	cyclictest	3615134	-21	kworker/u4:4+events_unbound	11:56:19	0
3459226	99	54	45,7	cyclictest	378	-21	dbus-daemon	12:01:21	0
3459226	99	54	44,6	cyclictest	0	-21	swapper/0	10:15:27	0
3459227	99	53	47,5	cyclictest	3650822	-21	kworker/u4:1+events_unbound	12:20:04	1
3459226	99	53	45,6	cyclictest	3668343	-21	kworker/u4:2+events_unbound	12:31:27	0
3459226	99	53	44,6	cyclictest	3478538	-21	kworker/u4:5+events_unbound	08:45:02	0
3459227	99	52	44,6	cyclictest	3463035	-21	kworker/u4:15+events_unbound	08:19:45	1
3459226	99	52	44,6	cyclictest	3486271	-21	kworker/u4:14+events_unbound	09:05:43	0
3459227	99	51	44,5	cyclictest	3632619	-21	kworker/u4:5+events_unbound	12:01:21	1
3459227	99	51	4,34	cyclictest	3463297	-21	/usr/sbin/munin	07:25:10	1
3459227	99	51	40,9	cyclictest	3472923	-21	sshd	08:00:28	1
3459227	99	51	40,6	cyclictest	0	-21	swapper/1	12:10:37	1
3459226	99	51	44,5	cyclictest	3581739	-21	fschecks_time	10:50:25	0
3459226	99	51	43,6	cyclictest	3479807	-21	kworker/u4:6+events_unbound	08:30:37	0
3459226	99	51	43,5	cyclictest	3463065	-21	munin-plugin-st	07:25:00	0
3459226	99	51	30,6	cyclictest	378	-21	dbus-daemon	11:41:15	0
3459227	99	50	44,4	cyclictest	3540779	-21	perl	10:05:20	1
3459227	99	50	42,6	cyclictest	3563256	-21	aten_r7power_vo	10:30:16	1
3459227	99	50	37,11	cyclictest	3568743	-21	switchtime	10:35:40	1
3459226	99	50	5,40	cyclictest	0	-21	swapper/0	07:25:09	0
3459226	99	50	16,26	cyclictest	256	50	irq/23-42890000.ethernet	11:50:13	0
3459227	99	49	43,4	cyclictest	3490140	-21	diskmemload	10:00:35	1
3459227	99	49	42,5	cyclictest	3535602	-21	latency_hist	10:00:01	1
3459227	99	49	35,6	cyclictest	3501591	-21	kworker/u4:9+events_unbound	09:50:55	1
3459227	99	49	34,6	cyclictest	3628075	-21	kworker/u4:2+events_unbound	11:46:35	1
3459227	99	49	27,18	cyclictest	27	1	ktimers/1	11:50:41	1
3459226	99	49	42,5	cyclictest	3630806	-21	gltestperf	11:45:19	0
3459226	99	49	41,5	cyclictest	3577148	-21	gltestperf	10:45:20	0
3459226	99	49	40,7	cyclictest	3554192	-21	aten_r7power_vo	10:20:17	0
3459226	99	49	39,7	cyclictest	3482146	-21	timerandwakeup	08:35:37	0
3459226	99	49	35,11	cyclictest	0	-21	swapper/0	09:10:25	0
3459226	99	49	30,6	cyclictest	3501591	-21	kworker/u4:9+events_unbound	09:50:49	0
3459227	99	48	42,4	cyclictest	3447922	-21	kworker/u4:8+events_unbound	07:55:44	1
3459227	99	48	42,4	cyclictest	3447922	-21	kworker/u4:8+events_unbound	07:55:43	1
3459227	99	48	41,5	cyclictest	3596983	-21	kworker/u4:0+events_unbound	11:09:45	1
3459227	99	48	41,5	cyclictest	3457957	-21	kworker/u4:11+events_unbound	07:15:02	1
3459227	99	48	39,6	cyclictest	3628077	-21	kworker/u4:7-rpciod	11:45:02	1
3459227	99	48	33,5	cyclictest	3479807	-21	kworker/u4:6+events_unbound	08:53:45	1
3459226	99	48	41,5	cyclictest	3450489	-21	kworker/u4:9+events_unbound	07:10:07	0
3459226	99	48	37,9	cyclictest	378	-21	dbus-daemon	10:40:58	0
3459227	99	47	40,5	cyclictest	3488834	-21	kworker/u4:2+events_unbound	09:30:04	1
3459227	99	47	40,5	cyclictest	3459222	-21	cyclictest	11:56:19	1
3459227	99	47	39,5	cyclictest	3603256	-21	diskmemload	11:15:01	1
3459227	99	47	37,7	cyclictest	3499627	-21	aten_r7power_cu	09:20:17	1
3459227	99	47	36,7	cyclictest	0	-21	swapper/1	10:25:30	1
3459227	99	47	32,6	cyclictest	3596986	-21	kworker/u4:4+events_unbound	11:21:04	1
3459227	99	47	31,6	cyclictest	3677408	-21	kworker/u4:0+events_unbound	12:39:32	1
3459226	99	47	39,5	cyclictest	3499801	-21	diskmemload	09:20:19	0
3459226	99	47	37,7	cyclictest	3471439	-21	gltestperf	07:55:26	0
3459226	99	47	37,7	cyclictest	3471439	-21	gltestperf	07:55:25	0
3459226	99	47	32,9	cyclictest	256	50	irq/23-42890000.ethernet	07:50:20	0
3459226	99	47	30,14	cyclictest	3586666	-21	grep	10:55:36	0
3459227	99	46	39,5	cyclictest	3504992	-21	uname	09:25:38	1
3459227	99	46	39,5	cyclictest	3479808	-21	kworker/u4:7+events_unbound	08:30:07	1
3459227	99	46	38,6	cyclictest	3472123	-21	kworker/u4:12+events_unbound	08:25:37	1
3459226	99	46	39,5	cyclictest	3607748	-21	sendmail	11:20:01	0
3459226	99	46	39,5	cyclictest	3540216	-21	sed	10:05:03	0
3459226	99	46	39,5	cyclictest	3487577	-21	munin-plugin-st	09:00:01	0
3459226	99	46	37,7	cyclictest	3518708	-21	/usr/sbin/munin	09:40:40	0
3459226	99	46	26,9	cyclictest	3616769	-21	latency_hist	11:30:01	0
3459227	99	45	6,29	cyclictest	3657195	-21	ssh	12:15:11	1
3459227	99	45	37,6	cyclictest	3550303	-21	ld	10:15:32	1
3459227	99	45	37,5	cyclictest	3648759	-21	gltestperf	12:05:22	1
3459227	99	45	11,23	cyclictest	0	-21	swapper/1	07:50:10	1
3459226	99	45	37,6	cyclictest	3595883	-21	/usr/sbin/munin	11:05:39	0
3459226	99	45	34,8	cyclictest	3501588	-21	kworker/u4:1-rpciod	09:25:19	0
3459226	99	45	34,7	cyclictest	256	50	irq/23-42890000.ethernet	10:12:26	0
3459226	99	45	28,14	cyclictest	0	-21	swapper/0	09:45:21	0
3459226	99	45	28,14	cyclictest	0	-21	swapper/0	09:45:20	0
3459226	99	45	27,16	cyclictest	3477265	-21	sh	08:19:59	0
3459227	99	44	37,5	cyclictest	3469359	-21	unixbench-2d	07:45:37	1
3459227	99	44	34,7	cyclictest	0	-21	swapper/1	09:20:01	1
3459227	99	44	26,6	cyclictest	3515394	-21	kworker/u4:0+events_unbound	09:46:26	1
3459227	99	44	26,6	cyclictest	3515394	-21	kworker/u4:0+events_unbound	09:46:25	1
3459226	99	44	37,5	cyclictest	3466203	-21	fschecks_time	07:35:18	0
3459226	99	44	36,6	cyclictest	3666299	-21	ssh	12:25:15	0
3459226	99	44	35,6	cyclictest	0	-21	swapper/0	11:10:23	0
3459226	99	44	34,7	cyclictest	3541358	-21	sendmail_mailqu	10:05:38	0
3459226	99	44	28,12	cyclictest	3479831	-21	cron	08:30:01	0
3459227	99	43	36,5	cyclictest	3604223	-21	ntp_kernel_err	11:15:24	1
3459227	99	43	35,5	cyclictest	3459673	-21	fschecks_time	07:10:19	1
3459226	99	43	32,9	cyclictest	531	-21	in:imuxsock	08:20:35	0
3459227	99	42	36,4	cyclictest	3450487	-21	kworker/u4:1-rpciod	07:45:01	1
3459227	99	42	34,6	cyclictest	3489523	-21	kernelversion	09:05:21	1
3459227	99	42	34,5	cyclictest	3481324	-21	aten_r7power_cu	08:35:15	1
3459227	99	42	33,6	cyclictest	3466051	-21	sed	07:35:17	1
3459227	99	42	25,7	cyclictest	3538533	-21	kworker/u4:6+events_unbound	10:11:03	1
3459226	99	42	21,18	cyclictest	3461759	-21	cron	07:20:01	0
3459227	99	41	34,5	cyclictest	3459222	-21	cyclictest	08:45:33	1
3459227	99	41	32,6	cyclictest	3466931	-21	kworker/u4:11-rpciod	08:05:40	1
3459227	99	40	34,4	cyclictest	3461735	-21	kworker/u4:10+events_unbound	07:30:10	1
3459227	99	39	18,11	cyclictest	17	1	rcu_preempt	08:10:29	1
3459227	99	39	18,11	cyclictest	17	1	rcu_preempt	08:10:28	1
3459226	99	39	32,5	cyclictest	3465441	-21	timerandwakeup	07:30:36	0
3459226	99	39	28,7	cyclictest	0	-21	swapper/0	09:05:00	0
3459226	99	38	30,5	cyclictest	0	-21	swapper/0	08:05:17	0
3459227	99	33	24,6	cyclictest	0	-21	swapper/1	07:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17