OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Feb 04, 2026 00:46:30)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1683173	99	168	91,64	cyclictest	1942287	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:01:49	0
1683173	99	149	56,71	cyclictest	1762908	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:40:33	0
1683173	99	140	54,41	cyclictest	1720656	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:44:46	0
1683173	99	140	54,41	cyclictest	1720656	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:44:46	0
1683173	99	138	103,27	cyclictest	1892211	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:41:42	0
1683173	99	131	92,20	cyclictest	1900500	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:36:41	0
1683173	99	128	49,58	cyclictest	1754312	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:05:50	0
1683173	99	121	83,19	cyclictest	1727371	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:21:20	0
1683173	99	116	47,47	cyclictest	1711334	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:33:34	0
1683178	99	113	101,6	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:30:55	1
1683173	99	113	58,35	cyclictest	1736981	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:38:36	0
1693258	2	109	0,3	sleep2	0	-21	swapper/2	19:35:00	2
1683173	99	109	40,46	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:13:18	0
1683194	99	108	95,7	cyclictest	1735053	-21	diskmemload-4	23:25:25	4
1683173	99	108	81,19	cyclictest	1952438	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:14:03	0
1683178	99	107	94,7	cyclictest	1892211	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:26:40	1
1683173	99	106	43,39	cyclictest	1892211	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:20:43	0
1683173	99	104	40,54	cyclictest	1717900	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:45:16	0
1683178	99	103	90,7	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:56:34	1
1683178	99	103	90,7	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:56:33	1
1683173	99	103	76,20	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:10:31	0
1683199	99	102	97,2	cyclictest	0	-21	swapper/5	23:41:42	5
1683173	99	102	77,18	cyclictest	1934906	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:55:59	0
1683178	99	101	88,6	cyclictest	1892211	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:21:39	1
1683178	99	101	87,7	cyclictest	1825565	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:36:33	1
1683178	99	100	88,6	cyclictest	1916470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:38:33	1
1683178	99	100	86,7	cyclictest	1754312	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:16:30	1
1683173	99	99	43,48	cyclictest	1916470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:50:45	0
1683173	99	98	72,19	cyclictest	1711334	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:20:38	0
1683173	99	98	72,19	cyclictest	1711334	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:20:38	0
1683173	99	98	70,20	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:55:18	0
1683173	99	98	70,20	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:55:17	0
1683178	99	97	83,7	cyclictest	1736981	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:36:22	1
1683173	99	97	75,19	cyclictest	1762908	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:53:35	0
1683173	99	97	75,19	cyclictest	1762908	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:53:34	0
1683178	99	96	82,7	cyclictest	1892211	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:05:34	1
1683173	99	96	70,18	cyclictest	1754312	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:01:36	0
1683173	99	96	48,40	cyclictest	1909085	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:31:53	0
1683173	99	96	47,42	cyclictest	1695230	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:00:03	0
1683173	99	96	36,41	cyclictest	1727371	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:05:18	0
1683178	99	95	81,7	cyclictest	1732180	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:31:22	1
1683173	99	95	67,20	cyclictest	1909085	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:45:35	0
1683173	99	95	67,20	cyclictest	1909085	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:45:34	0
1683173	99	94	69,18	cyclictest	1762908	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:00:53	0
1683173	99	94	68,19	cyclictest	1825565	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:40:24	0
1683173	99	94	68,19	cyclictest	1727371	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:02:20	0
1683173	99	93	61,22	cyclictest	689	50	irq/527-eth0-Tx	00:30:25	0
1683173	99	93	55,23	cyclictest	690	50	irq/528-eth0-Tx	21:00:01	0
1683199	99	92	85,3	cyclictest	0	-21	swapper/5	00:01:49	5
1683173	99	92	17,53	cyclictest	0	-21	swapper/0	00:28:40	0
1683199	99	91	86,2	cyclictest	0	-21	swapper/5	23:36:41	5
1683183	99	91	76,8	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:04:48	2
1683178	99	91	76,7	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:45:43	1
1683178	99	91	65,9	cyclictest	1762908	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:50:01	1
1683178	99	91	62,7	cyclictest	1942287	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:59:23	1
1683173	99	91	67,20	cyclictest	1960488	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:18:01	0
1683173	99	91	67,20	cyclictest	1960488	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:18:01	0
1683183	99	90	55,19	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:30:21	2
1683178	99	90	76,7	cyclictest	1754312	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:51:26	1
1683178	99	90	76,7	cyclictest	1754312	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:51:26	1
1683173	99	90	70,16	cyclictest	210	-21	kswapd0	23:15:16	0
1683173	99	90	64,19	cyclictest	1825565	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:14:19	0
1683173	99	90	63,20	cyclictest	1727371	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:28:33	0
1683173	99	90	62,21	cyclictest	1973131	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:35:34	0
1683173	99	90	53,25	cyclictest	0	-21	swapper/0	21:55:19	0
1683173	99	90	53,25	cyclictest	0	-21	swapper/0	21:55:18	0
1741259	2	89	0,4	sleep3	0	-21	swapper/3	21:18:56	3
1741259	2	89	0,4	sleep3	0	-21	swapper/3	21:18:56	3
1683178	99	89	77,6	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:14:35	1
1683178	99	89	75,7	cyclictest	1879039	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:08:35	1
1683173	99	89	49,37	cyclictest	1762908	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:28:33	0
1683173	99	89	40,15	cyclictest	1720656	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:54:18	0
1683194	99	88	73,9	cyclictest	1888321	-21	sh	23:15:28	4
1683188	99	88	74,7	cyclictest	1825565	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:51:35	3
1683178	99	88	73,8	cyclictest	1727371	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:10:15	1
1683178	99	88	73,8	cyclictest	1727371	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:10:14	1
1683173	99	88	62,19	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:35:15	0
1683173	99	88	61,20	cyclictest	1892211	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:05:10	0
1683173	99	88	61,20	cyclictest	1732180	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:11:13	0
1683173	99	88	61,20	cyclictest	1732180	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:11:12	0
1683173	99	88	39,14	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:33:45	0
1683173	99	88	22,25	cyclictest	13	-21	ksoftirqd/0	23:29:07	0
1683183	99	87	72,7	cyclictest	1815637	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:21:29	2
1683178	99	87	75,6	cyclictest	1762908	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:14:35	1
1683178	99	87	73,7	cyclictest	1815637	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:25:18	1
1683178	99	87	73,7	cyclictest	1684855	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:20:52	1
1683173	99	87	60,19	cyclictest	1732180	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:30:12	0
1683188	99	86	72,7	cyclictest	1973131	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:36:56	3
1683178	99	86	74,6	cyclictest	1916470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:47:24	1
1683178	99	86	74,6	cyclictest	1916470	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:47:23	1
1683178	99	86	73,7	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:02:35	1
1683173	99	86	63,20	cyclictest	1754312	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:10:53	0
1683173	99	86	62,21	cyclictest	1832084	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:52:47	0
1683173	99	86	2,47	cyclictest	1808056	-1	kworker/u13:2+xprtiod@ xs_stream_data_receive_workfn	22:25:02	0
1683178	99	85	73,6	cyclictest	1934906	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:00:38	1
1683178	99	85	71,7	cyclictest	1892211	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:44:10	1
1683178	99	85	64,8	cyclictest	1900500	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:31:01	1
1683173	99	85	59,19	cyclictest	1675249	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:28:14	0
1683173	99	84	59,18	cyclictest	1695230	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:51:04	0
1683199	99	83	77,3	cyclictest	0	-21	swapper/5	21:21:20	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17