OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Apr 29, 2026 00:46:40)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3935148	2	3111	3101,5	sleep5	0	-21	swapper/5	19:07:23	5
3933712	2	2431	2400,17	sleep0	3933634	-21	kworker/0:3+events@ dbs_work_handler	19:05:16	0
3934001	2	1695	1674,9	sleep3	3929152	-21	kworker/3:1+events@ dbs_work_handler	19:05:20	3
3935501	99	123	13,97	cyclictest	4133076	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:25:27	0
3935501	99	119	17,66	cyclictest	3960083	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:20:22	0
3935501	99	99	32,38	cyclictest	691	50	irq/529-eth0-Tx	22:10:21	0
3935501	99	96	3,72	cyclictest	4097935	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:51:37	0
3935501	99	96	3,72	cyclictest	4097935	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:51:37	0
3935501	99	95	70,16	cyclictest	689	50	irq/527-eth0-Tx	21:44:56	0
3935524	99	94	87,3	cyclictest	0	-21	swapper/5	20:41:08	5
3935501	99	94	67,18	cyclictest	689	50	irq/527-eth0-Tx	20:50:20	0
3935501	99	94	67,18	cyclictest	689	50	irq/527-eth0-Tx	20:50:20	0
3935515	99	91	67,7	cyclictest	4110772	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:10:34	3
3935510	99	91	76,8	cyclictest	3986215	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:35:16	2
3935501	99	91	77,7	cyclictest	11929	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:29:35	0
3935501	99	91	65,14	cyclictest	689	50	irq/527-eth0-Tx	23:50:33	0
3935524	99	90	84,2	cyclictest	0	-21	swapper/5	23:51:44	5
3935501	99	90	37,37	cyclictest	691	50	irq/529-eth0-Tx	23:40:39	0
3935501	99	90	37,37	cyclictest	691	50	irq/529-eth0-Tx	23:40:39	0
3935501	99	89	60,19	cyclictest	689	50	irq/527-eth0-Tx	21:18:11	0
3935501	99	89	60,19	cyclictest	689	50	irq/527-eth0-Tx	21:18:10	0
3935501	99	89	22,26	cyclictest	0	-21	swapper/0	22:30:31	0
3935501	99	88	1,52	cyclictest	0	-21	swapper/0	23:45:12	0
3935501	99	88	1,52	cyclictest	0	-21	swapper/0	23:45:12	0
3935501	99	87	62,16	cyclictest	690	50	irq/528-eth0-Tx	23:05:13	0
3935501	99	87	1,69	cyclictest	0	-21	swapper/0	00:10:39	0
3935505	99	86	71,7	cyclictest	4149963	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:25:41	1
3935501	99	86	27,7	cyclictest	4030611	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:00:39	0
3935501	99	86	27,7	cyclictest	4030611	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:00:38	0
3935501	99	86	1,67	cyclictest	4105241	-21	ssh	22:50:02	0
3935510	99	85	70,8	cyclictest	4139449	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:20:48	2
3935501	99	85	59,4	cyclictest	0	-21	swapper/0	19:25:12	0
3935501	99	85	3,66	cyclictest	4075088	-21	cpu	22:25:18	0
3935501	99	85	22,4	cyclictest	0	-21	swapper/0	21:47:23	0
3935510	99	84	57,7	cyclictest	4182556	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:55:46	2
3935501	99	84	63,10	cyclictest	0	-21	swapper/0	20:41:08	0
3935501	99	83	59,13	cyclictest	689	50	irq/527-eth0-Tx	20:15:01	0
3935501	99	83	58,13	cyclictest	690	50	irq/528-eth0-Tx	23:37:15	0
3935501	99	83	41,4	cyclictest	3983901	-21	diskmemload	21:30:47	0
3935501	99	83	1,53	cyclictest	0	-21	swapper/0	22:41:40	0
3935501	99	83	1,53	cyclictest	0	-21	swapper/0	22:41:40	0
3935510	99	82	69,6	cyclictest	4110772	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:15:23	2
3935505	99	82	69,7	cyclictest	4097935	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:53:54	1
3935505	99	82	69,7	cyclictest	4097935	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:53:54	1
3935501	99	82	59,14	cyclictest	691	50	irq/529-eth0-Tx	20:15:14	0
3935501	99	82	4,66	cyclictest	690	50	irq/528-eth0-Tx	23:55:14	0
3935501	99	82	26,35	cyclictest	4155980	-21	ssh	23:30:32	0
3935501	99	82	10,46	cyclictest	0	-21	swapper/0	00:15:37	0
3935520	99	81	75,3	cyclictest	0	-21	swapper/4	22:05:22	4
3935520	99	81	74,3	cyclictest	0	-21	swapper/4	23:25:44	4
3935515	99	81	69,6	cyclictest	3956057	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	20:06:12	3
3935501	99	81	31,36	cyclictest	691	50	irq/529-eth0-Tx	22:45:21	0
3935515	99	80	66,7	cyclictest	4077753	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:01:49	3
3935510	99	80	66,7	cyclictest	4030611	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:05:34	2
3935501	99	80	2,44	cyclictest	4037583	-21	latency_hist	21:55:02	0
3935501	99	80	2,44	cyclictest	4037583	-21	latency_hist	21:55:01	0
3935520	99	79	66,6	cyclictest	3987268	-21	diskmemload-4	23:41:42	4
3935520	99	79	66,6	cyclictest	3987268	-21	diskmemload-4	23:41:42	4
3935515	99	79	67,6	cyclictest	4084876	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:41:37	3
3935515	99	79	67,6	cyclictest	4084876	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:41:37	3
3935515	99	79	66,6	cyclictest	4030611	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:15:00	3
3935501	99	79	59,4	cyclictest	689	50	irq/527-eth0-Tx	20:55:40	0
3935501	99	79	25,39	cyclictest	4077753	-21	kworker/u12:2+rpciod@ rpc_async_schedule	22:55:30	0
3935524	99	78	72,3	cyclictest	0	-21	swapper/5	00:30:47	5
3935524	99	78	72,3	cyclictest	0	-21	swapper/5	00:30:47	5
3935520	99	78	63,9	cyclictest	3987268	-21	diskmemload-4	23:36:43	4
3935515	99	78	66,6	cyclictest	4005762	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:38:23	3
3935510	99	78	65,7	cyclictest	4005762	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:52:14	2
3935510	99	78	65,7	cyclictest	4005762	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:52:13	2
3935510	99	78	48,8	cyclictest	3949352	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:49:00	2
3935510	99	78	48,8	cyclictest	3949352	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:48:59	2
3935501	99	78	65,7	cyclictest	4037837	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:20:40	0
3935501	99	78	63,7	cyclictest	3965486	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:27:20	0
3935501	99	78	51,13	cyclictest	0	-21	swapper/0	21:00:28	0
3935501	99	78	1,5	cyclictest	4142067	-21	awk	23:20:01	0
3935520	99	77	66,6	cyclictest	4127884	-21	ssh	23:08:05	4
3935515	99	77	64,7	cyclictest	4063377	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:28:18	3
3935515	99	77	64,7	cyclictest	11929	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:23:57	3
3935515	99	77	63,8	cyclictest	4182556	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:09:02	3
3935510	99	77	64,6	cyclictest	4157630	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	23:39:53	2
3935501	99	77	59,4	cyclictest	690	50	irq/528-eth0-Tx	00:39:29	0
3935501	99	77	59,4	cyclictest	690	50	irq/528-eth0-Tx	00:39:29	0
3935501	99	77	57,12	cyclictest	691	50	irq/529-eth0-Tx	20:30:12	0
3935501	99	77	50,19	cyclictest	689	50	irq/527-eth0-Tx	22:19:39	0
3935501	99	77	48,3	cyclictest	0	-21	swapper/0	21:21:57	0
3935501	99	77	19,43	cyclictest	0	-21	swapper/0	19:40:01	0
3935501	99	77	13,29	cyclictest	0	-21	swapper/0	22:00:00	0
3935501	99	77	13,29	cyclictest	0	-21	swapper/0	22:00:00	0
3935524	99	76	70,3	cyclictest	0	-21	swapper/5	22:38:07	5
3935520	99	76	69,3	cyclictest	0	-21	swapper/4	21:11:25	4
3935520	99	76	69,3	cyclictest	0	-21	swapper/4	21:11:24	4
3935520	99	76	65,6	cyclictest	23262	-21	ssh	00:20:15	4
3935515	99	76	63,7	cyclictest	4139449	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:27:58	3
3935515	99	76	62,7	cyclictest	3986215	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:13:38	3
3935515	99	76	62,7	cyclictest	3986215	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:13:37	3
3935505	99	76	62,7	cyclictest	4005762	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:42:56	1
3935501	99	76	4,44	cyclictest	0	-21	swapper/0	23:10:30	0
3935501	99	76	1,51	cyclictest	0	-21	swapper/0	00:05:37	0
3935515	99	75	63,6	cyclictest	4182556	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:17:31	3
3935510	99	75	64,8	cyclictest	210	-21	kswapd0	21:50:01	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17