OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Tue Sep 16, 2025 12:46:31)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1543421	2	2491	2466,15	sleep4	0	-21	swapper/4	07:05:23	4
1543679	2	2356	2339,8	sleep3	1523248	-21	kworker/3:2+events@ dbs_work_handler	07:05:29	3
1544768	99	157	97,38	cyclictest	1714733	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:36:15	0
1544768	99	143	109,27	cyclictest	1703136	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:06:12	0
1544768	99	138	82,25	cyclictest	1588261	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:15:42	0
1544776	99	135	121,7	cyclictest	1755174	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:56:16	2
1544776	99	135	121,7	cyclictest	1755174	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:56:16	2
1544768	99	135	70,45	cyclictest	1547186	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:05:35	0
1544768	99	134	95,19	cyclictest	1647616	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:40:59	0
1544776	99	133	121,6	cyclictest	1647616	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:30:57	2
1544776	99	131	117,7	cyclictest	1597641	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:45:47	2
1544780	99	127	113,7	cyclictest	1689900	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:51:01	3
1544780	99	126	112,7	cyclictest	1714733	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:16:26	3
1544780	99	125	111,7	cyclictest	1576407	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:30:32	3
1544780	99	124	111,7	cyclictest	1666304	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:25:56	3
1544768	99	114	87,19	cyclictest	1639587	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:20:52	0
1544768	99	114	87,19	cyclictest	1639587	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:20:52	0
1544768	99	113	85,20	cyclictest	1538938	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:20:16	0
1544768	99	113	85,20	cyclictest	1538938	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:20:15	0
1544780	99	112	98,7	cyclictest	1789477	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:36:29	3
1544780	99	109	95,8	cyclictest	1558914	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:45:33	3
1544768	99	109	83,19	cyclictest	1714733	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:26:15	0
1544768	99	109	82,18	cyclictest	1577588	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:50:39	0
1544768	99	109	1,104	cyclictest	0	-21	swapper/0	07:10:14	0
1544780	99	106	93,7	cyclictest	1639587	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:00:50	3
1544768	99	106	1,95	cyclictest	0	-21	swapper/0	12:16:23	0
1544768	99	103	36,43	cyclictest	0	-21	swapper/0	09:40:39	0
1544768	99	102	75,19	cyclictest	1789477	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:36:23	0
1544768	99	101	75,19	cyclictest	1562945	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:00:25	0
1544768	99	101	75,19	cyclictest	1562945	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:00:25	0
1544788	99	100	95,2	cyclictest	0	-21	swapper/5	11:06:12	5
1544768	99	99	73,19	cyclictest	1639587	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:15:53	0
1544768	99	99	64,24	cyclictest	642	50	irq/527-eth0-Tx	11:50:43	0
1544768	99	99	2,59	cyclictest	0	-21	swapper/0	09:30:29	0
1544768	99	99	1,93	cyclictest	0	-21	swapper/0	08:55:41	0
1544768	99	97	1,79	cyclictest	0	-21	swapper/0	07:55:38	0
1544768	99	94	68,19	cyclictest	1558914	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:45:22	0
1544768	99	93	2,5	cyclictest	1592969	-21	ssh	09:10:15	0
1544768	99	93	1,52	cyclictest	13	-21	ksoftirqd/0	12:01:47	0
1544768	99	93	1,52	cyclictest	13	-21	ksoftirqd/0	12:01:46	0
1544774	99	92	78,7	cyclictest	1577588	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:35:33	1
1544768	99	92	2,7	cyclictest	1676467	-21	df_abs	10:35:20	0
1544774	99	91	63,12	cyclictest	1703136	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:06:16	1
1544768	99	91	43,23	cyclictest	0	-21	swapper/0	08:30:34	0
1544785	99	90	83,3	cyclictest	0	-21	swapper/4	10:15:52	4
1544774	99	90	75,8	cyclictest	1703136	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:11:14	1
1544768	99	90	1,72	cyclictest	0	-21	swapper/0	09:00:39	0
1544768	99	90	1,72	cyclictest	0	-21	swapper/0	09:00:38	0
1544774	99	89	73,8	cyclictest	1639587	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:00:47	1
1544768	99	89	1,74	cyclictest	0	-21	swapper/0	09:25:21	0
1544788	99	88	83,2	cyclictest	0	-21	swapper/5	11:36:15	5
1544774	99	88	73,8	cyclictest	1547186	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	07:35:19	1
1544774	99	87	71,8	cyclictest	1789477	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:31:22	1
1544774	99	87	71,8	cyclictest	1789477	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:31:22	1
1544768	99	87	53,18	cyclictest	1588261	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:20:12	0
1544768	99	87	1,3	cyclictest	0	-21	swapper/0	12:05:37	0
1620301	2	86	0,5	sleep0	0	-21	swapper/0	09:40:00	0
1544788	99	86	80,3	cyclictest	0	-21	swapper/5	10:40:59	5
1544768	99	86	54,21	cyclictest	644	50	irq/529-eth0-Tx	07:25:11	0
1544774	99	85	71,7	cyclictest	1767012	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:06:19	1
1544774	99	85	70,8	cyclictest	1570420	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:20:30	1
1544768	99	85	53,12	cyclictest	0	-21	swapper/0	07:30:30	0
1544768	99	85	43,22	cyclictest	0	-21	swapper/0	11:04:25	0
1544776	99	84	73,4	cyclictest	1608898	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:30:45	2
1544776	99	84	70,7	cyclictest	1564403	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:10:34	2
1544768	99	84	49,23	cyclictest	642	50	irq/527-eth0-Tx	09:55:35	0
1544785	99	83	76,3	cyclictest	0	-21	swapper/4	09:40:01	4
1544768	99	83	52,18	cyclictest	642	50	irq/527-eth0-Tx	09:05:58	0
1544768	99	83	1,69	cyclictest	0	-21	swapper/0	12:33:50	0
1544768	99	83	1,69	cyclictest	0	-21	swapper/0	12:33:49	0
1544776	99	82	68,7	cyclictest	1672688	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:16:16	2
1544768	99	81	8,38	cyclictest	642	50	irq/527-eth0-Tx	12:14:27	0
1544768	99	81	48,26	cyclictest	1634733	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:00:03	0
1544768	99	81	34,23	cyclictest	0	-21	swapper/0	12:26:14	0
1544768	99	81	34,23	cyclictest	0	-21	swapper/0	12:26:13	0
1544768	99	81	2,5	cyclictest	1547794	-21	ntpq	07:15:54	0
1544768	99	81	2,53	cyclictest	1687456	-21	ssh	10:45:34	0
1544768	99	81	25,12	cyclictest	0	-21	swapper/0	11:20:53	0
1544768	99	80	58,12	cyclictest	0	-21	swapper/0	08:45:31	0
1544768	99	80	58,12	cyclictest	0	-21	swapper/0	08:45:31	0
1544768	99	80	1,60	cyclictest	0	-21	swapper/0	12:24:55	0
1544768	99	80	1,60	cyclictest	0	-21	swapper/0	12:24:55	0
1544785	99	79	70,5	cyclictest	0	-21	swapper/4	10:54:52	4
1544785	99	79	69,5	cyclictest	1665007	-21	ssh	10:25:01	4
1544785	99	79	69,5	cyclictest	1665007	-21	ssh	10:25:01	4
1544785	99	79	67,7	cyclictest	1607343	-21	ssh	09:25:32	4
1544785	99	79	66,8	cyclictest	1733786	-21	ssh	11:30:44	4
1544768	99	79	1,58	cyclictest	14	-21	rcu_preempt	10:33:29	0
1544788	99	77	72,2	cyclictest	0	-21	swapper/5	10:20:52	5
1544788	99	77	72,2	cyclictest	0	-21	swapper/5	10:20:52	5
1544774	99	77	63,7	cyclictest	1558914	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:55:25	1
1544768	99	77	54,15	cyclictest	1576407	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:41:58	0
1544776	99	76	61,7	cyclictest	1564403	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:15:35	2
1544774	99	76	62,7	cyclictest	1789477	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:26:29	1
1544774	99	76	62,7	cyclictest	1789477	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:26:28	1
1544768	99	76	39,24	cyclictest	0	-21	swapper/0	11:41:11	0
1544768	99	76	39,23	cyclictest	644	50	irq/529-eth0-Tx	10:29:11	0
1544768	99	76	16,34	cyclictest	14	-21	rcu_preempt	10:50:34	0
1544788	99	75	70,2	cyclictest	0	-21	swapper/5	07:20:16	5
1544788	99	75	70,2	cyclictest	0	-21	swapper/5	07:20:15	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17