OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Tue Sep 01, 2026 00:46:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1109199	2	1280	1242,24	sleep0	1108454	-21	kworker/0:1+events@ dbs_work_handler	19:05:27	0
1110324	99	134	98,28	cyclictest	1128283	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:17:15	0
1110324	99	115	65,30	cyclictest	1257382	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:12:37	0
1110324	99	115	65,30	cyclictest	1257382	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:12:36	0
1110338	99	106	90,8	cyclictest	1082271	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:17:09	3
1110324	99	106	2,43	cyclictest	1343945	-21	acpi	23:35:11	0
1110324	99	106	2,41	cyclictest	1270815	-21	kworker/u12:1+rpciod@ rpc_async_schedule	23:05:33	0
1110342	99	103	96,3	cyclictest	0	-21	swapper/4	21:17:21	4
1110342	99	102	90,7	cyclictest	1162019	-21	diskmemload-4	22:52:33	4
1110342	99	96	89,3	cyclictest	0	-21	swapper/4	00:02:41	4
1110333	99	96	82,7	cyclictest	1384856	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:12:44	2
1110324	99	96	34,42	cyclictest	1128283	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:08:45	0
1110342	99	95	85,6	cyclictest	1309012	-21	ssh	23:07:35	4
1110324	99	95	2,38	cyclictest	1191217	-21	unixbench_singl	21:35:42	0
1385756	2	94	0,5	sleep4	0	-21	swapper/4	00:08:28	4
1110348	99	94	88,3	cyclictest	0	-21	swapper/5	20:17:15	5
1110324	99	93	36,24	cyclictest	673	50	irq/527-eth0-Tx	00:25:33	0
1110324	99	93	2,39	cyclictest	0	-21	swapper/0	23:02:48	0
1254790	2	92	0,6	sleep4	1254787	-21	ssh	22:25:27	4
1110333	99	92	79,6	cyclictest	1384856	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:27:48	2
1110333	99	92	79,6	cyclictest	1257382	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:47:40	2
1110324	99	92	1,57	cyclictest	1158431	-1	kworker/0:1H+kblockd@ blk_mq_run_work_fn	23:50:01	0
1110324	99	92	1,34	cyclictest	0	-21	swapper/0	00:30:07	0
1110333	99	91	77,7	cyclictest	1128283	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:12:14	2
1110324	99	91	30,14	cyclictest	675	50	irq/529-eth0-Tx	22:30:02	0
1110324	99	91	2,44	cyclictest	1266995	-21	aten2_r3power_p	22:35:18	0
1110324	99	91	24,15	cyclictest	1222737	-21	ntpq	22:00:31	0
1110324	99	91	18,24	cyclictest	1142195	-21	kworker/u12:2+rpciod@ rpc_async_schedule	20:35:15	0
1110324	99	89	5,36	cyclictest	1235092	-21	/usr/sbin/munin	22:10:22	0
1110324	99	89	5,36	cyclictest	1235092	-21	/usr/sbin/munin	22:10:22	0
1110324	99	88	2,5	cyclictest	1210228	-21	/usr/sbin/munin	21:50:43	0
1110324	99	88	2,44	cyclictest	0	-21	swapper/0	00:25:02	0
1110324	99	88	17,46	cyclictest	0	-21	swapper/0	23:15:31	0
1110324	99	88	17,46	cyclictest	0	-21	swapper/0	23:15:30	0
1110324	99	87	33,13	cyclictest	676	50	irq/530-eth0-Tx	22:30:14	0
1110324	99	87	31,13	cyclictest	675	50	irq/529-eth0-Tx	23:40:44	0
1110324	99	87	26,13	cyclictest	675	50	irq/529-eth0-Tx	22:45:21	0
1110342	99	86	72,8	cyclictest	1229448	-21	ssh	22:05:43	4
1110324	99	86	1,43	cyclictest	0	-21	swapper/0	22:55:44	0
1110342	99	85	78,3	cyclictest	0	-21	swapper/4	20:37:16	4
1110338	99	85	71,7	cyclictest	1257382	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:02:35	3
1110324	99	85	47,28	cyclictest	1176477	-21	/usr/sbin/munin	21:25:45	0
1110324	99	85	47,28	cyclictest	1176477	-21	/usr/sbin/munin	21:25:45	0
1110324	99	85	29,33	cyclictest	0	-21	swapper/0	21:55:47	0
1110324	99	85	1,3	cyclictest	0	-21	swapper/0	19:40:01	0
1110324	99	84	34,20	cyclictest	1158431	-1	kworker/0:1H-events_highpri	21:20:34	0
1110324	99	84	34,20	cyclictest	1158431	-1	kworker/0:1H-events_highpri	21:20:34	0
1110324	99	84	1,44	cyclictest	0	-21	swapper/0	22:41:24	0
1110324	99	84	1,3	cyclictest	0	-21	swapper/0	22:50:34	0
1110324	99	83	2,4	cyclictest	1358737	-21	kworker/u12:3+flush-0:51@ wb_workfn	23:58:17	0
1110324	99	83	2,4	cyclictest	1358737	-21	kworker/u12:3+flush-0:51@ wb_workfn	23:58:16	0
1110342	99	82	72,6	cyclictest	1270298	-21	ssh	22:37:32	4
1110324	99	82	7,13	cyclictest	673	50	irq/527-eth0-Tx	00:14:22	0
1110324	99	82	32,12	cyclictest	676	50	irq/530-eth0-Tx	21:45:19	0
1110324	99	82	26,12	cyclictest	673	50	irq/527-eth0-Tx	23:20:37	0
1110324	99	82	25,15	cyclictest	675	50	irq/529-eth0-Tx	22:15:20	0
1110324	99	82	25,15	cyclictest	675	50	irq/529-eth0-Tx	22:15:20	0
1110324	99	82	21,12	cyclictest	68	-21	kcompactd0	00:17:04	0
1132653	2	81	0,4	sleep2	0	-21	swapper/2	20:05:01	2
1110324	99	81	29,13	cyclictest	673	50	irq/527-eth0-Tx	21:10:22	0
1110324	99	81	27,40	cyclictest	1386070	-21	chrt	00:08:48	0
1110324	99	81	24,16	cyclictest	1164658	-21	ssh	21:15:35	0
1110324	99	80	6,34	cyclictest	0	-21	swapper/0	20:45:17	0
1110324	99	80	1,68	cyclictest	0	-21	swapper/0	00:37:17	0
1110333	99	79	65,7	cyclictest	1192701	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:02:24	2
1110324	99	79	24,24	cyclictest	1358737	-21	kworker/u12:3+rpciod@ rpc_async_schedule	00:00:23	0
1110324	99	78	28,14	cyclictest	675	50	irq/529-eth0-Tx	21:40:37	0
1110333	99	76	62,7	cyclictest	1192701	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:52:22	2
1110333	99	76	61,8	cyclictest	1199537	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:07:24	2
1110324	99	76	45,12	cyclictest	0	-21	swapper/0	19:19:05	0
1110342	99	75	68,3	cyclictest	0	-21	swapper/4	19:47:45	4
1110342	99	75	67,4	cyclictest	0	-21	swapper/4	22:20:23	4
1110324	99	75	4,30	cyclictest	0	-21	swapper/0	20:58:17	0
1110342	99	74	68,2	cyclictest	0	-21	swapper/4	23:22:37	4
1110324	99	74	9,38	cyclictest	676	50	irq/530-eth0-Tx	23:32:29	0
1110342	99	72	66,2	cyclictest	0	-21	swapper/4	22:45:26	4
1110324	99	72	7,28	cyclictest	676	50	irq/530-eth0-Tx	19:58:07	0
1110324	99	72	7,28	cyclictest	676	50	irq/530-eth0-Tx	19:58:07	0
1292411	2	71	0,3	chrt	0	-21	swapper/4	22:55:03	4
1110324	99	71	2,4	cyclictest	0	-21	swapper/0	22:20:41	0
1406738	2	70	0,5	chrt	1406713	-21	ssh	00:25:01	4
1110342	99	70	64,3	cyclictest	0	-21	swapper/4	20:10:45	4
1110324	99	70	3,32	cyclictest	0	-21	swapper/0	19:47:03	0
1110324	99	70	31,20	cyclictest	0	-21	swapper/0	21:03:21	0
1110324	99	70	29,12	cyclictest	0	-21	swapper/0	23:50:25	0
1110324	99	70	29,12	cyclictest	0	-21	swapper/0	23:50:24	0
1110342	99	69	62,3	cyclictest	0	-21	swapper/4	23:42:38	4
1110342	99	69	62,3	cyclictest	0	-21	swapper/4	21:08:45	4
1110342	99	69	58,5	cyclictest	0	-21	swapper/4	21:20:26	4
1110342	99	69	58,5	cyclictest	0	-21	swapper/4	21:20:26	4
1110324	99	69	6,21	cyclictest	0	-21	swapper/0	21:33:57	0
1110324	99	69	6,21	cyclictest	0	-21	swapper/0	21:33:57	0
1110324	99	69	2,50	cyclictest	13	-21	ksoftirqd/0	20:00:44	0
1110324	99	69	21,13	cyclictest	674	50	irq/528-eth0-Tx	23:25:31	0
1110324	99	69	1,54	cyclictest	0	-21	swapper/0	20:22:14	0
1110324	99	69	1,4	cyclictest	1146898	-21	apt-get	20:40:18	0
1110342	99	68	57,6	cyclictest	1162019	-21	diskmemload-4	23:46:45	4
1110338	99	68	54,7	cyclictest	1358737	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:56:47	3
1110338	99	68	54,7	cyclictest	1358737	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:56:46	3
1110324	99	68	2,41	cyclictest	1199537	-21	kworker/u12:0+rpciod@ rpc_async_schedule	22:10:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17