OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #7, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system

Characteristics of the highest latencies:

System rack7slot2.osadl.org (updated Wed Jun 10, 2026 00:44:11)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3355792	99	105	98,5	cyclictest	3406892	-21	kworker/u4:4+events_unbound	21:52:01	1
3355792	99	105	96,7	cyclictest	3498722	-21	kworker/u4:3+events_unbound	23:32:11	1
3355791	99	103	97,4	cyclictest	3541891	-21	kworker/u4:12+events_unbound	00:12:15	0
3355792	99	102	94,6	cyclictest	3481153	-21	kworker/u4:2+events_unbound	22:57:09	1
3355792	99	101	94,5	cyclictest	3424835	-21	kworker/u4:6+events_unbound	22:32:05	1
3355792	99	98	90,6	cyclictest	3369982	-21	kworker/u4:4+events_unbound	20:21:53	1
3355792	99	96	89,5	cyclictest	3381559	-21	kworker/u4:13+events_unbound	21:06:59	1
3355792	99	96	88,6	cyclictest	3406895	-21	kworker/u4:8+events_unbound	21:42:01	1
3355792	99	90	81,7	cyclictest	3378994	-21	kworker/u4:7+events_unbound	22:22:04	1
3355792	99	86	78,6	cyclictest	3353286	-21	kworker/u4:5+events_unbound	19:31:49	1
3355791	99	86	33,39	cyclictest	0	-21	swapper/0	21:30:36	0
3355791	99	84	65,17	cyclictest	3372510	-21	kworker/u4:0+events_unbound	20:25:00	0
3355792	99	83	75,6	cyclictest	3353286	-21	kworker/u4:5+events_unbound	19:11:47	1
3355792	99	81	74,5	cyclictest	3459986	-21	kworker/u4:10+events_unbound	22:52:07	1
3355792	99	81	74,5	cyclictest	3459986	-21	kworker/u4:10+events_unbound	22:52:06	1
3355792	99	80	72,6	cyclictest	3362221	-21	kworker/u4:9+events_unbound	20:01:52	1
3355792	99	79	72,5	cyclictest	3363490	-21	kworker/u4:12+events_unbound	19:51:50	1
3355791	99	79	69,7	cyclictest	3385391	-21	kworker/u4:10+events_unbound	21:11:59	0
3355791	99	79	69,7	cyclictest	3385391	-21	kworker/u4:10+events_unbound	21:11:58	0
3355791	99	79	28,36	cyclictest	0	-21	swapper/0	19:50:02	0
3355791	99	79	25,40	cyclictest	0	-21	swapper/0	20:45:01	0
3355791	99	78	3,45	cyclictest	3422301	-21	apt-get	21:50:11	0
3355791	99	77	46,5	cyclictest	3543453	-21	awk	00:10:01	0
3355792	99	76	69,5	cyclictest	3455578	-21	kworker/u4:3+events_unbound	22:37:04	1
3355792	99	76	69,5	cyclictest	3377724	-21	kworker/u4:6+events_unbound	20:36:54	1
3355791	99	76	30,21	cyclictest	0	-21	swapper/0	21:20:30	0
3355791	99	76	30,21	cyclictest	0	-21	swapper/0	21:20:30	0
3355791	99	75	1,71	cyclictest	3444356	-21	apt-get	22:15:11	0
3355792	99	74	67,5	cyclictest	3385388	-21	kworker/u4:3+events_unbound	21:01:57	1
3355791	99	74	2,50	cyclictest	3466936	-21	/usr/sbin/munin	22:40:29	0
3355792	99	73	66,5	cyclictest	3341928	-21	kworker/u4:13+events_unbound	19:41:49	1
3355791	99	73	25,28	cyclictest	0	-21	swapper/0	00:20:18	0
3355791	99	73	2,49	cyclictest	3457296	-21	ssh	22:30:01	0
3355791	99	73	2,49	cyclictest	3395556	-21	apt	21:19:59	0
3355791	99	73	2,42	cyclictest	3360408	-21	ntpq	19:25:27	0
3355791	99	71	38,31	cyclictest	317	-21	systemd-journal	21:36:59	0
3355791	99	71	2,43	cyclictest	3459827	-21	ssh	22:32:11	0
3355792	99	70	63,5	cyclictest	3372511	-21	kworker/u4:1+events_unbound	20:17:01	1
3355792	99	70	63,5	cyclictest	3369970	-21	kworker/u4:3+events_unbound	20:06:52	1
3355791	99	70	27,27	cyclictest	0	-21	swapper/0	00:30:01	0
3355791	99	70	2,63	cyclictest	3531101	-21	ssh	23:55:19	0
3355791	99	70	2,48	cyclictest	3548740	-21	ssh	00:15:29	0
3355792	99	69	62,5	cyclictest	3366056	-21	kworker/u4:16+events_unbound	20:31:54	1
3355791	99	69	22,29	cyclictest	0	-21	swapper/0	23:38:34	0
3355791	99	69	22,28	cyclictest	0	-21	swapper/0	22:00:32	0
3355791	99	68	3,61	cyclictest	3518589	-21	ntpq	23:40:26	0
3355791	99	68	32,30	cyclictest	3372979	-21	fschecks_count	20:15:17	0
3355791	99	67	50,15	cyclictest	3415840	-21	kworker/u4:13+events_unbound	21:45:01	0
3355791	99	67	25,20	cyclictest	0	-21	swapper/0	22:05:49	0
3355791	99	67	23,26	cyclictest	3475665	-21	gcc	22:50:35	0
3355791	99	67	23,26	cyclictest	3475665	-21	gcc	22:50:35	0
3355791	99	67	17,28	cyclictest	0	-21	swapper/0	22:37:27	0
3355791	99	67	1,61	cyclictest	3361141	-21	apt-get	19:30:11	0
3355791	99	67	14,31	cyclictest	3527226	-21	ntpq	23:50:28	0
3355791	99	67	13,34	cyclictest	3535965	-21	ssh	00:00:34	0
3355792	99	66	59,5	cyclictest	3415844	-21	kworker/u4:15+events_unbound	22:00:02	1
3355791	99	66	17,30	cyclictest	3359113	-21	ntpq	19:20:29	0
3355791	99	66	16,28	cyclictest	0	-21	swapper/0	23:30:22	0
3355791	99	65	35,28	cyclictest	3427062	-21	fschecks_count	21:55:20	0
3355792	99	64	55,7	cyclictest	3459986	-21	kworker/u4:10+events_unbound	23:17:10	1
3355791	99	64	33,28	cyclictest	3507507	-21	kworker/u4:7-xprtiod	23:45:21	0
3355791	99	64	33,27	cyclictest	0	-21	swapper/0	22:10:33	0
3355791	99	64	2,57	cyclictest	3484135	-21	ssh	23:00:27	0
3355791	99	64	2,54	cyclictest	3385591	-21	apt-get	21:05:13	0
3355791	99	64	14,28	cyclictest	3499552	-21	ssh	23:18:42	0
3355791	99	64	14,28	cyclictest	0	-21	swapper/0	00:30:23	0
3355791	99	64	1,11	cyclictest	3506543	-21	ssh	23:26:02	0
3355791	99	63	55,6	cyclictest	3459986	-21	kworker/u4:10+events_unbound	22:59:59	0
3355791	99	63	3,53	cyclictest	3355939	-21	apt-get	19:10:10	0
3355791	99	63	2,57	cyclictest	3400954	-21	ntpq	21:25:25	0
3355791	99	63	2,36	cyclictest	3382393	-21	ntpq	20:50:31	0
3355791	99	62	2,55	cyclictest	3492741	-21	ssh	23:10:27	0
3355791	99	62	16,26	cyclictest	3565990	-21	gcc	00:35:30	0
3355791	99	61	3,52	cyclictest	3383023	-21	apt-get	20:55:11	0
3355791	99	61	3,52	cyclictest	3378518	-21	ntpq	20:35:29	0
3355791	99	61	29,28	cyclictest	0	-21	swapper/0	22:45:41	0
3355791	99	61	29,28	cyclictest	0	-21	swapper/0	22:45:40	0
3355791	99	61	2,44	cyclictest	3501408	-21	ntpq	23:20:29	0
3355791	99	61	1,55	cyclictest	3417990	-21	basename	21:45:15	0
3355792	99	60	52,6	cyclictest	3366056	-21	kworker/u4:16+events_unbound	20:56:58	1
3355791	99	60	27,27	cyclictest	0	-21	swapper/0	22:20:24	0
3355791	99	60	1,56	cyclictest	3366844	-21	ntpq	19:50:28	0
3355791	99	60	1,54	cyclictest	3488424	-21	ssh	23:05:26	0
3355791	99	60	1,4	cyclictest	3363025	-21	ntpq	19:35:30	0
3355792	99	59	45,6	cyclictest	3546264	-21	kworker/u4:1+events_unbound	00:16:01	1
3355791	99	59	2,6	cyclictest	3369514	-21	/usr/sbin/munin	20:00:39	0
3355791	99	59	2,52	cyclictest	3377183	-21	ntpq	20:30:25	0
3355791	99	59	2,52	cyclictest	3375990	-21	ntpq	20:25:36	0
3355791	99	59	2,52	cyclictest	3357210	-21	apt-get	19:15:11	0
3355791	99	58	4,49	cyclictest	3370803	-21	ntpq	20:05:31	0
3355791	99	58	3,51	cyclictest	3371987	-21	ntpq	20:10:24	0
3355791	99	58	3,41	cyclictest	3368183	-21	ntpq	19:55:33	0
3355791	99	57	2,48	cyclictest	3380480	-21	apt-get	20:45:11	0
3355792	99	56	49,5	cyclictest	0	-21	swapper/1	23:05:15	1
3355792	99	56	45,9	cyclictest	3567543	-21	sd-accept	00:37:17	1
3355791	99	56	2,49	cyclictest	3364296	-21	ntpq	19:40:28	0
3355792	99	55	48,5	cyclictest	3498722	-21	kworker/u4:3+events_unbound	23:50:02	1
3355791	99	55	2,48	cyclictest	3384931	-21	ntpq	21:00:30	0
3355792	99	54	47,5	cyclictest	3378994	-21	kworker/u4:7+events_unbound	21:26:00	1
3355792	99	54	46,6	cyclictest	3437654	-21	kworker/u4:11-xprtiod	22:10:00	1
3355792	99	53	45,6	cyclictest	3353286	-21	kworker/u4:5+events_unbound	19:35:03	1
3355792	99	52	45,5	cyclictest	3507506	-21	kworker/u4:1+events_unbound	23:28:00	1
3355792	99	52	45,4	cyclictest	3445094	-21	ssh	22:15:27	1
3355792	99	52	44,6	cyclictest	3340630	-21	kworker/u4:4+events_unbound	19:26:58	1
3355792	99	52	43,7	cyclictest	3358278	-21	kworker/u4:9+events_unbound	19:16:46	1
3355792	99	51	44,5	cyclictest	3498722	-21	kworker/u4:3+events_unbound	00:01:44	1
3355792	99	51	41,8	cyclictest	3545043	-21	unixbench_singl	00:10:40	1
3355791	99	50	2,42	cyclictest	3355849	-21	latency_hist	19:10:02	0
3355792	99	49	42,5	cyclictest	3424835	-21	kworker/u4:6+events_unbound	22:46:00	1
3355792	99	49	42,5	cyclictest	3424835	-21	kworker/u4:6+events_unbound	22:46:00	1
3355792	99	48	42,4	cyclictest	3561232	-21	fschecks_count	00:30:20	1
3355792	99	48	42,4	cyclictest	3493251	-21	unixbench-2d	23:10:41	1
3355792	99	48	41,5	cyclictest	3484357	-21	ps	23:00:35	1
3355792	99	48	41,4	cyclictest	0	-21	swapper/1	21:36:58	1
3355792	99	48	40,6	cyclictest	3543583	-21	latency_hist	00:10:02	1
3355792	99	48	40,5	cyclictest	3530782	-21	munin-node	23:55:13	1
3355792	99	47	40,5	cyclictest	3507507	-21	kworker/u4:7+events_unbound	23:43:45	1
3355792	99	47	40,5	cyclictest	3440032	-21	aten_r7power_cu	22:10:15	1
3355792	99	47	40,5	cyclictest	3419163	-21	unixbench_multi	21:45:40	1
3355792	99	47	40,5	cyclictest	3357019	-21	kworker/u4:8+events_unbound	20:10:03	1
3355792	99	47	39,6	cyclictest	3500805	-21	aten_r7power_en	23:20:17	1
3355792	99	47	39,5	cyclictest	3457288	-21	apt-get	22:29:59	1
3355792	99	46	40,4	cyclictest	3522575	-21	fschecks_time	23:45:20	1
3355792	99	46	40,4	cyclictest	3507508	-21	kworker/u4:10+events_unbound	23:38:59	1
3355792	99	46	39,5	cyclictest	3369970	-21	kworker/u4:3+events_unbound	20:46:00	1
3355792	99	46	37,7	cyclictest	3406026	-21	unixbench-2d	21:30:50	1
3355792	99	45	7,35	cyclictest	3552362	-21	ssh	00:20:13	1
3355792	99	45	36,7	cyclictest	3395961	-21	aten_r7power_en	21:20:15	1
3355792	99	45	36,7	cyclictest	3395961	-21	aten_r7power_en	21:20:15	1
3355792	99	45	32,7	cyclictest	3384102	-21	kworker/u4:1+events_unbound	21:16:57	1
3355792	99	44	37,5	cyclictest	3557391	-21	ldconfig	00:25:30	1
3355792	99	44	37,5	cyclictest	3466410	-21	basename	22:40:18	1
3355792	99	44	37,5	cyclictest	3359260	-21	sendmail_mailqu	19:20:36	1
3355792	99	44	35,6	cyclictest	3377714	-21	kworker/u4:2-rpciod	21:10:15	1
3355792	99	44	35,6	cyclictest	3377714	-21	kworker/u4:2-rpciod	21:10:15	1
3355792	99	43	36,5	cyclictest	3431890	-21	ld	22:00:27	1
3355792	99	42	35,5	cyclictest	3381945	-21	df_abs	20:50:17	1
3355792	99	41	30,9	cyclictest	3368640	-21	sendmail	20:00:00	1
3355792	99	41	25,6	cyclictest	17	1	rcu_preempt	20:25:31	1
3355792	99	39	9,17	cyclictest	624	-21	munin-node	19:45:23	1
3355792	99	38	27,8	cyclictest	0	-21	swapper/1	20:40:36	1
3355792	99	34	26,6	cyclictest	0	-21	swapper/1	19:10:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17