OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat Feb 14, 2026 12:46:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1795955	2	1474	1451,14	sleep1	1792597	-21	kworker/1:0+events@ dbs_work_handler	07:05:36	1
1796946	99	134	63,60	cyclictest	1826182	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:30:13	0
1796946	99	127	93,14	cyclictest	1898892	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:59:34	0
1796969	99	123	116,3	cyclictest	0	-21	swapper/5	11:46:07	5
1796969	99	123	116,3	cyclictest	0	-21	swapper/5	11:46:07	5
1796959	99	120	106,7	cyclictest	2080764	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:26:13	3
1796959	99	117	103,7	cyclictest	1888142	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:50:50	3
1796950	99	117	103,7	cyclictest	2016250	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:31:01	1
1796946	99	117	1,3	cyclictest	0	-21	swapper/0	07:10:12	0
1796959	99	116	103,6	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:36:04	3
1796946	99	114	61,34	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:42:08	0
1926593	2	113	0,5	sleep1	1888142	-21	kworker/u12:1+rpciod@ rpc_async_schedule	10:16:00	1
1796959	99	110	94,7	cyclictest	1796584	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:10:09	3
1796959	99	109	95,7	cyclictest	1943141	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:35:53	3
1796969	99	108	102,3	cyclictest	0	-21	swapper/5	12:11:11	5
1796950	99	108	94,7	cyclictest	1922541	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:47:35	1
1796946	99	108	77,21	cyclictest	689	50	irq/527-eth0-Tx	09:45:19	0
1796946	99	108	77,21	cyclictest	689	50	irq/527-eth0-Tx	09:45:18	0
1796946	99	108	64,21	cyclictest	1838954	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:12:31	0
1796946	99	108	31,15	cyclictest	1828242	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:45:42	0
1796955	99	107	93,7	cyclictest	1913607	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:10:50	2
1796959	99	106	90,8	cyclictest	2092883	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:36:16	3
1796946	99	106	70,25	cyclictest	690	50	irq/528-eth0-Tx	10:20:58	0
1796946	99	106	65,25	cyclictest	1943705	-21	cut	10:30:22	0
1796946	99	106	59,28	cyclictest	1968830	-21	ntpq	10:50:37	0
1796946	99	106	54,30	cyclictest	1826182	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:53:01	0
1796950	99	105	62,15	cyclictest	2056559	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:07:49	1
1796969	99	104	97,3	cyclictest	0	-21	swapper/5	09:45:49	5
1796969	99	104	97,3	cyclictest	0	-21	swapper/5	09:45:48	5
1796946	99	104	66,24	cyclictest	0	-21	swapper/0	11:29:41	0
1796969	99	103	97,3	cyclictest	0	-21	swapper/5	07:55:19	5
1796959	99	103	88,7	cyclictest	1981111	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:11:34	3
1796959	99	103	88,7	cyclictest	1981111	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:11:34	3
1796955	99	102	88,7	cyclictest	1828242	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:30:33	2
1796950	99	102	28,21	cyclictest	1828242	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:45:41	1
1796969	99	99	92,3	cyclictest	0	-21	swapper/5	11:10:58	5
1796969	99	99	92,3	cyclictest	0	-21	swapper/5	11:10:57	5
1796946	99	99	62,15	cyclictest	1826182	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:58:04	0
1796964	99	98	80,13	cyclictest	1992059	-21	sh	11:10:14	4
1796964	99	98	80,13	cyclictest	1992059	-21	sh	11:10:14	4
1796959	99	98	83,8	cyclictest	1995325	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:27:35	3
1796946	99	98	67,21	cyclictest	0	-21	swapper/0	12:36:07	0
1796946	99	98	56,35	cyclictest	2074527	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:21:20	0
1796946	99	98	2,79	cyclictest	0	-21	swapper/0	12:15:31	0
1796969	99	97	91,3	cyclictest	0	-21	swapper/5	10:49:34	5
1796969	99	97	90,3	cyclictest	0	-21	swapper/5	09:55:50	5
1796946	99	97	66,17	cyclictest	0	-21	swapper/0	09:50:10	0
1796946	99	97	65,22	cyclictest	689	50	irq/527-eth0-Tx	11:35:33	0
1796946	99	97	55,25	cyclictest	0	-21	swapper/0	11:05:53	0
1796946	99	97	55,25	cyclictest	0	-21	swapper/0	11:05:53	0
1796969	99	96	90,3	cyclictest	0	-21	swapper/5	08:10:25	5
1796955	99	96	82,7	cyclictest	1810788	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:52:26	2
1796946	99	96	57,36	cyclictest	2036948	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:06:12	0
1796946	99	96	1,83	cyclictest	0	-21	swapper/0	09:15:37	0
1796955	99	95	81,7	cyclictest	1838954	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:35:49	2
1796955	99	95	81,7	cyclictest	1838954	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:35:48	2
1796946	99	95	58,21	cyclictest	0	-21	swapper/0	08:05:40	0
1796959	99	94	80,7	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:07:34	3
1796946	99	94	73,14	cyclictest	1828242	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	08:41:20	0
1796946	99	94	68,12	cyclictest	0	-21	swapper/0	10:47:39	0
1796946	99	94	62,24	cyclictest	690	50	irq/528-eth0-Tx	07:30:34	0
1796946	99	94	62,24	cyclictest	690	50	irq/528-eth0-Tx	07:30:34	0
1796946	99	94	59,22	cyclictest	691	50	irq/529-eth0-Tx	10:25:33	0
1796946	99	94	59,22	cyclictest	691	50	irq/529-eth0-Tx	10:25:33	0
1796946	99	94	56,23	cyclictest	0	-21	swapper/0	07:48:19	0
1796946	99	94	56,23	cyclictest	0	-21	swapper/0	07:48:18	0
1796946	99	94	56,14	cyclictest	0	-21	swapper/0	10:55:33	0
1796950	99	93	80,7	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:51:01	1
1796950	99	93	80,7	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:51:01	1
1796946	99	93	71,15	cyclictest	1838954	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:01:46	0
1796946	99	93	62,22	cyclictest	0	-21	swapper/0	08:15:01	0
1796946	99	93	50,26	cyclictest	689	50	irq/527-eth0-Tx	11:50:27	0
1796946	99	93	50,26	cyclictest	689	50	irq/527-eth0-Tx	11:50:27	0
1796969	99	92	86,3	cyclictest	0	-21	swapper/5	09:15:35	5
1796946	99	92	70,15	cyclictest	1995325	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:20:58	0
1796946	99	92	69,16	cyclictest	1973693	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:02:18	0
1796946	99	92	59,14	cyclictest	1815014	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:01:34	0
1796946	99	92	52,22	cyclictest	0	-21	swapper/0	11:40:29	0
1796946	99	92	1,63	cyclictest	2056732	-21	ssh	12:02:51	0
1796959	99	91	71,8	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:12:56	3
1796950	99	91	78,7	cyclictest	1987782	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:12:33	1
1796950	99	91	78,7	cyclictest	1987782	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:12:33	1
1796946	99	91	70,14	cyclictest	1858422	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:27:36	0
1796946	99	91	57,24	cyclictest	689	50	irq/527-eth0-Tx	12:00:01	0
1796946	99	91	49,29	cyclictest	0	-21	swapper/0	10:17:49	0
1796959	99	90	76,7	cyclictest	1796584	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:20:11	3
1796955	99	90	76,7	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:15:44	2
1796955	99	90	76,7	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:15:44	2
1796950	99	90	82,5	cyclictest	210	-21	kswapd0	09:25:25	1
1796946	99	90	60,23	cyclictest	1808723	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:36:19	0
1796959	99	89	75,7	cyclictest	1877613	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:36:44	3
1796959	99	89	75,7	cyclictest	1877613	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:36:43	3
1796955	99	89	75,7	cyclictest	1888142	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:05:15	2
1796955	99	89	59,6	cyclictest	1953418	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:55:32	2
1796950	99	89	77,6	cyclictest	1922541	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:50:55	1
1796946	99	89	67,14	cyclictest	1995325	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:31:36	0
1796946	99	89	57,20	cyclictest	0	-21	swapper/0	12:10:51	0
1796946	99	89	1,67	cyclictest	0	-21	swapper/0	11:14:21	0
1796946	99	89	1,67	cyclictest	0	-21	swapper/0	11:14:20	0
1796959	99	88	45,14	cyclictest	1898892	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:25:25	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17