OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Fri Dec 12, 2025 00:44:08)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3325088	99	103	93,7	cyclictest	3346959	-21	kworker/u4:15+events_unbound	20:52:45	0
3325089	99	99	91,6	cyclictest	3392629	-21	kworker/u4:1+events_unbound	21:58:04	1
3325089	99	98	89,6	cyclictest	3418805	-21	kworker/u4:6+events_unbound	22:43:07	1
3325088	99	94	89,3	cyclictest	3356246	-21	kworker/u4:1+events_unbound	21:17:48	0
3325089	99	93	84,6	cyclictest	3353572	-21	kworker/u4:24+events_unbound	21:02:47	1
3325089	99	91	86,3	cyclictest	3513523	-21	kworker/u4:4+events_unbound	00:38:37	1
3325089	99	91	86,3	cyclictest	3513523	-21	kworker/u4:4+events_unbound	00:38:37	1
3325088	99	90	84,3	cyclictest	3388816	-21	kworker/u4:10+events_unbound	21:53:03	0
3325088	99	89	79,8	cyclictest	3499188	-21	kworker/u4:12+events_unbound	00:23:34	0
3325088	99	87	81,4	cyclictest	3464929	-21	kworker/u4:5+events_unbound	23:33:22	0
3325089	99	85	76,7	cyclictest	3330195	-21	kworker/u4:5+events_unbound	19:37:36	1
3325089	99	85	75,7	cyclictest	3345674	-21	kworker/u4:12+events_unbound	20:27:49	1
3325089	99	85	75,7	cyclictest	3344389	-21	kworker/u4:0+events_unbound	20:22:44	1
3325089	99	85	75,7	cyclictest	3344389	-21	kworker/u4:0+events_unbound	20:22:43	1
3325088	99	85	76,7	cyclictest	3374135	-21	kworker/u4:3+events_unbound	21:47:55	0
3325089	99	83	77,3	cyclictest	3330195	-21	kworker/u4:5+events_unbound	19:52:38	1
3325089	99	83	75,6	cyclictest	3353570	-21	kworker/u4:22+events_unbound	21:12:48	1
3325088	99	83	73,7	cyclictest	3396485	-21	kworker/u4:6+events_unbound	22:08:03	0
3325089	99	81	71,7	cyclictest	3326312	-21	kworker/u4:11+events_unbound	19:57:39	1
3325089	99	80	71,7	cyclictest	3362586	-21	kworker/u4:0+events_unbound	21:17:56	1
3325089	99	78	69,6	cyclictest	3480067	-21	kworker/u4:6+events_unbound	23:53:22	1
3325089	99	77	69,6	cyclictest	3374135	-21	kworker/u4:3+events_unbound	22:03:03	1
3325088	99	77	67,7	cyclictest	3484606	-21	kworker/u4:3+events_unbound	23:58:26	0
3325089	99	76	65,8	cyclictest	3502782	-21	kworker/u4:3+events_unbound	00:28:36	1
3325089	99	76	65,8	cyclictest	3484606	-21	kworker/u4:3+events_unbound	23:58:23	1
3325088	99	75	40,31	cyclictest	3471838	-21	unixbench_singl	23:40:40	0
3325088	99	75	34,5	cyclictest	3414966	-21	kworker/u4:3-rpciod	22:35:17	0
3325089	99	74	65,7	cyclictest	3495647	-21	kworker/u4:3+events_unbound	00:13:28	1
3325088	99	74	39,31	cyclictest	3410694	-21	unixbench_singl	22:20:42	0
3325088	99	72	37,32	cyclictest	3479168	-21	/usr/sbin/munin	23:50:37	0
3325088	99	72	36,33	cyclictest	3380528	-21	sed	21:40:45	0
3325088	99	72	32,36	cyclictest	0	-21	swapper/0	22:45:33	0
3325089	99	71	61,7	cyclictest	3345668	-21	kworker/u4:8+events_unbound	21:07:53	1
3325088	99	71	63,6	cyclictest	3499185	-21	kworker/u4:9+events_unbound	00:18:30	0
3325088	99	71	61,8	cyclictest	379	-21	dbus-daemon	22:53:12	0
3325088	99	71	40,28	cyclictest	3373022	-21	unixbench-2d	21:30:43	0
3325088	99	71	31,6	cyclictest	53	-21	kswapd0	23:20:22	0
3325089	99	70	61,6	cyclictest	3323790	-21	kworker/u4:2+events_unbound	19:47:39	1
3325088	99	70	61,6	cyclictest	3353571	-21	kworker/u4:23+events_unbound	21:27:51	0
3325088	99	69	61,6	cyclictest	3346959	-21	kworker/u4:15+events_unbound	20:32:43	0
3325088	99	69	33,33	cyclictest	3414356	-21	unixbench_multi	22:25:41	0
3325088	99	68	57,8	cyclictest	3426485	-21	kworker/u4:2+events_unbound	22:43:11	0
3325088	99	68	35,30	cyclictest	3391002	-21	uniq	21:55:24	0
3325088	99	68	35,30	cyclictest	1056	-21	lldpd	20:03:13	0
3325088	99	68	35,30	cyclictest	1056	-21	lldpd	20:03:13	0
3325088	99	68	33,5	cyclictest	3434460	-21	kworker/u4:2-rpciod	23:10:21	0
3325088	99	68	33,5	cyclictest	3344389	-21	kworker/u4:0-rpciod	20:45:01	0
3325088	99	68	31,34	cyclictest	0	-21	swapper/0	19:25:37	0
3325088	99	68	29,6	cyclictest	0	-21	swapper/0	19:45:37	0
3325088	99	67	58,6	cyclictest	3345668	-21	kworker/u4:8+events_unbound	21:07:47	0
3325088	99	67	31,4	cyclictest	0	-21	swapper/0	23:45:26	0
3325088	99	67	29,6	cyclictest	0	-21	swapper/0	23:35:40	0
3325088	99	67	29,5	cyclictest	0	-21	swapper/0	23:17:16	0
3325089	99	66	57,6	cyclictest	3396488	-21	kworker/u4:9+events_unbound	22:38:11	1
3325089	99	66	57,6	cyclictest	3326312	-21	kworker/u4:11+events_unbound	20:02:47	1
3325089	99	66	57,6	cyclictest	3326312	-21	kworker/u4:11+events_unbound	20:02:47	1
3325088	99	66	58,6	cyclictest	3345673	-21	kworker/u4:9+events_unbound	20:27:41	0
3325088	99	66	31,5	cyclictest	0	-21	swapper/0	22:30:29	0
3325088	99	66	31,5	cyclictest	0	-21	swapper/0	22:30:29	0
3325088	99	65	32,5	cyclictest	3440283	-21	df_abs	23:00:22	0
3325088	99	65	31,5	cyclictest	3365275	-21	mailstats	21:20:42	0
3325088	99	65	30,8	cyclictest	3490504	-21	fschecks_time	00:05:21	0
3325088	99	65	29,6	cyclictest	0	-21	swapper/0	20:35:27	0
3325088	99	65	28,7	cyclictest	0	-21	swapper/0	22:55:42	0
3325089	99	64	56,6	cyclictest	3461058	-21	kworker/u4:7+events_unbound	23:28:18	1
3325088	99	64	55,7	cyclictest	3502782	-21	kworker/u4:3+events_unbound	00:38:40	0
3325088	99	64	55,7	cyclictest	3502782	-21	kworker/u4:3+events_unbound	00:38:39	0
3325088	99	64	31,4	cyclictest	3337042	-21	df_abs	19:55:17	0
3325088	99	64	27,6	cyclictest	0	-21	swapper/0	00:30:43	0
3325089	99	63	53,7	cyclictest	3323792	-21	kworker/u4:6+events_unbound	19:42:46	1
3325088	99	63	30,30	cyclictest	0	-21	swapper/0	21:40:01	0
3325088	99	63	30,30	cyclictest	0	-21	swapper/0	21:40:01	0
3325088	99	63	27,6	cyclictest	0	-21	swapper/0	19:35:37	0
3325089	99	62	53,7	cyclictest	3464928	-21	kworker/u4:4+events_unbound	23:33:21	1
3325088	99	62	27,6	cyclictest	0	-21	swapper/0	19:10:21	0
3325088	99	62	27,5	cyclictest	0	-21	swapper/0	21:15:01	0
3325089	99	61	54,5	cyclictest	3396488	-21	kworker/u4:9+events_unbound	22:48:08	1
3325089	99	61	54,5	cyclictest	3326311	-21	kworker/u4:9+events_unbound	19:22:34	1
3325088	99	61	53,6	cyclictest	3326312	-21	kworker/u4:11+events_unbound	19:17:32	0
3325088	99	61	51,7	cyclictest	3334073	-21	kworker/u4:19+events_unbound	20:07:40	0
3325089	99	60	50,6	cyclictest	3414966	-21	kworker/u4:3+events_unbound	22:33:10	1
3325089	99	60	50,6	cyclictest	3414966	-21	kworker/u4:3+events_unbound	22:33:10	1
3325088	99	60	26,6	cyclictest	0	-21	swapper/0	20:15:39	0
3325088	99	60	25,6	cyclictest	0	-21	swapper/0	21:05:01	0
3325089	99	57	48,6	cyclictest	3323790	-21	kworker/u4:2+events_unbound	20:17:48	1
3325089	99	56	48,6	cyclictest	3388817	-21	kworker/u4:12+events_unbound	21:52:57	1
3325089	99	56	48,5	cyclictest	3345668	-21	kworker/u4:8+events_unbound	20:37:50	1
3325089	99	56	46,7	cyclictest	3453207	-21	kworker/u4:12+events_unbound	23:23:19	1
3325089	99	55	48,5	cyclictest	3374135	-21	kworker/u4:3+events_unbound	21:43:02	1
3325089	99	55	45,7	cyclictest	3339223	-21	kworker/u4:3+events_unbound	20:07:47	1
3325089	99	54	46,5	cyclictest	0	-21	swapper/1	21:20:16	1
3325088	99	54	46,6	cyclictest	3400293	-21	kworker/u4:0+events_unbound	22:13:07	0
3325088	99	54	46,6	cyclictest	3346959	-21	kworker/u4:15+events_unbound	20:47:52	0
3325088	99	54	28,4	cyclictest	3397966	-21	latency_hist	22:05:01	0
3325089	99	53	46,5	cyclictest	3472737	-21	kworker/u4:8+events_unbound	00:05:00	1
3325089	99	53	44,6	cyclictest	0	-21	swapper/1	22:50:16	1
3325089	99	53	42,8	cyclictest	3325937	-21	ps	19:10:46	1
3325089	99	53	38,12	cyclictest	0	-21	swapper/1	21:30:16	1
3325089	99	52	46,4	cyclictest	3501311	-21	fschecks_time	00:20:23	1
3325089	99	52	43,7	cyclictest	3341790	-21	kworker/u4:10+events_unbound	20:12:49	1
3325088	99	52	45,5	cyclictest	3507057	-21	sshd	00:28:33	0
3325088	99	52	43,7	cyclictest	3331482	-21	kworker/u4:14+events_unbound	19:52:46	0
3325089	99	51	42,7	cyclictest	3411894	-21	sshd	22:23:04	1
3325089	99	51	41,6	cyclictest	0	-21	swapper/1	22:55:44	1
3325089	99	50	41,7	cyclictest	3474933	-21	/usr/sbin/munin	23:45:23	1
3325088	99	50	43,5	cyclictest	3459393	-21	basename	23:25:22	0
3325088	99	50	43,5	cyclictest	3444095	-21	/usr/sbin/munin	23:05:21	0
3325089	99	49	43,4	cyclictest	3441018	-21	mailstats	23:00:42	1
3325089	99	49	38,9	cyclictest	3413308	-21	aten_r7power_po	22:25:17	1
3325088	99	49	42,5	cyclictest	3331153	-21	sendmail_mailqu	19:30:35	0
3325088	99	49	40,7	cyclictest	3494803	-21	sendmail_mailqu	00:10:41	0
3325089	99	48	40,5	cyclictest	3468788	-21	kthreadd	23:37:12	1
3325089	99	48	40,5	cyclictest	0	-21	swapper/1	20:52:44	1
3325089	99	48	35,10	cyclictest	3356296	-21	diskmemload	23:06:25	1
3325088	99	48	29,17	cyclictest	3328135	-21	fschecks_time	19:20:21	0
3325088	99	48	28,17	cyclictest	0	-21	swapper/0	22:15:20	0
3325089	99	47	37,7	cyclictest	0	-21	swapper/1	22:15:36	1
3325089	99	47	35,9	cyclictest	0	-21	swapper/1	23:40:13	1
3325088	99	47	37,7	cyclictest	3352501	-21	aten2__	20:55:16	0
3325088	99	47	35,10	cyclictest	3486669	-21	tail	00:00:23	0
3325088	99	47	27,18	cyclictest	3341042	-21	fschecks_time	20:10:20	0
3325089	99	46	39,5	cyclictest	3329976	-21	timerandwakeup	19:25:36	1
3325089	99	46	38,5	cyclictest	3404390	-21	kthreadd	22:13:03	1
3325089	99	46	37,5	cyclictest	0	-21	swapper/1	00:05:35	1
3325089	99	46	34,9	cyclictest	37	-21	kcompactd0	22:05:40	1
3325089	99	45	38,5	cyclictest	0	-21	swapper/1	23:15:35	1
3325089	99	44	36,6	cyclictest	0	-21	swapper/1	21:25:35	1
3325089	99	44	36,5	cyclictest	0	-21	swapper/1	00:30:22	1
3325089	99	44	35,7	cyclictest	3447626	-21	aten_r7power_en	23:10:18	1
3325089	99	44	35,7	cyclictest	3346500	-21	collect2	20:30:32	1
3325089	99	44	35,7	cyclictest	3327614	-21	systemd	19:17:32	1
3325089	99	44	33,9	cyclictest	3331509	-21	cron	19:35:01	1
3325088	99	44	36,5	cyclictest	3343641	-21	fschecks_time	20:20:21	0
3325088	99	44	36,5	cyclictest	3343641	-21	fschecks_time	20:20:21	0
3325088	99	44	35,6	cyclictest	3333288	-21	fschecks_count	19:40:20	0
3325089	99	42	35,5	cyclictest	0	-21	swapper/1	00:15:27	1
3325089	99	42	34,5	cyclictest	0	-21	swapper/1	21:35:17	1
3325089	99	42	34,5	cyclictest	0	-21	swapper/1	21:35:16	1
3325089	99	42	33,7	cyclictest	3383517	-21	fschecks_time	21:45:21	1
3325089	99	41	33,5	cyclictest	3352838	-21	fschecks_time	20:55:20	1
3325089	99	41	30,8	cyclictest	3346955	-21	kworker/u4:3-rpciod	20:50:00	1
3325089	99	39	30,6	cyclictest	3348592	-21	aten2__	20:40:15	1
3325088	99	39	24,11	cyclictest	257	50	irq/23-42890000.ethernet	19:10:00	0
3325089	99	34	27,4	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17