OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Fri May 29, 2026 12:46:40)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1857128	2	3143	3125,10	sleep1	1854189	-21	kworker/1:0+events@ dbs_work_handler	07:08:49	1
1857128	2	3143	3125,10	sleep1	1854189	-21	kworker/1:0+events@ dbs_work_handler	07:08:49	1
1857386	99	138	91,40	cyclictest	2081091	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:44:35	0
1857398	99	134	121,7	cyclictest	1885423	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:59:38	3
1857398	99	134	121,7	cyclictest	1885423	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:59:38	3
1857386	99	130	69,7	cyclictest	2090715	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:00:16	0
1857386	99	129	36,49	cyclictest	1856350	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:10:47	0
1857404	99	126	117,5	cyclictest	1977944	-21	ssh	10:14:51	4
2086134	2	117	0,4	sleep1	0	-21	swapper/1	11:36:44	1
1857398	99	115	101,7	cyclictest	1994714	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:00:04	3
1857390	99	112	99,6	cyclictest	1934884	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:59:51	1
1857390	99	112	99,6	cyclictest	1934884	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:59:51	1
1857398	99	110	98,6	cyclictest	1871334	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:39:33	3
1857390	99	110	98,6	cyclictest	1871334	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:04:28	1
1857390	99	110	98,6	cyclictest	1871334	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:04:27	1
1857404	99	106	100,3	cyclictest	0	-21	swapper/4	11:40:12	4
1857386	99	106	72,6	cyclictest	2056677	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:26:34	0
1857386	99	106	72,6	cyclictest	2056677	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:26:34	0
1857390	99	102	90,6	cyclictest	1885423	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:53:35	1
1857398	99	101	88,7	cyclictest	1859228	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:14:18	3
1857386	99	101	72,8	cyclictest	2090715	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:55:21	0
1857404	99	100	94,2	cyclictest	0	-21	swapper/4	08:41:34	4
1857404	99	100	94,2	cyclictest	0	-21	swapper/4	08:41:33	4
1857404	99	100	94,2	cyclictest	0	-21	swapper/4	07:54:26	4
1857398	99	100	86,7	cyclictest	2127413	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:23:34	3
1857398	99	100	86,7	cyclictest	1890849	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:19:42	3
1857390	99	100	87,6	cyclictest	1934884	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:13:34	1
1857386	99	99	64,7	cyclictest	1984650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:31:35	0
1857408	99	98	92,3	cyclictest	0	-21	swapper/5	11:16:14	5
1857404	99	98	92,3	cyclictest	0	-21	swapper/4	12:39:11	4
1857398	99	96	83,7	cyclictest	2127413	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:25:22	3
1857398	99	95	81,7	cyclictest	2031442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:27:45	3
1857398	99	95	81,7	cyclictest	2031442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:27:45	3
1857398	99	94	82,6	cyclictest	1976837	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:19:53	3
1857404	99	93	87,3	cyclictest	0	-21	swapper/4	12:31:03	4
1857404	99	93	86,3	cyclictest	0	-21	swapper/4	09:09:41	4
1857398	99	93	79,7	cyclictest	1994714	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:38:35	3
1857398	99	93	79,7	cyclictest	1994714	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:38:35	3
1857398	99	93	63,7	cyclictest	2031442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:19:44	3
1857404	99	92	84,4	cyclictest	0	-21	swapper/4	08:00:31	4
1857404	99	92	84,4	cyclictest	0	-21	swapper/4	08:00:30	4
1857398	99	92	61,7	cyclictest	2001535	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:53:16	3
1857390	99	92	78,7	cyclictest	1856350	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:17:35	1
1857404	99	91	85,2	cyclictest	0	-21	swapper/4	12:04:45	4
1857398	99	91	78,7	cyclictest	1915184	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:31:35	3
1857398	99	91	78,7	cyclictest	1915184	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:31:35	3
1857390	99	91	79,6	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:30:06	1
1857390	99	91	79,6	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:30:06	1
1857404	99	90	81,5	cyclictest	2014688	-21	ssh	10:42:03	4
1857398	99	90	76,7	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:55:04	3
1857398	99	90	76,7	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:55:03	3
1857404	99	89	77,7	cyclictest	1897251	-21	ssh	09:14:05	4
1857395	99	89	77,6	cyclictest	1984650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:39:58	2
1857395	99	89	77,6	cyclictest	1984650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:39:58	2
1857404	99	88	82,3	cyclictest	0	-21	swapper/4	11:16:14	4
1857398	99	88	74,7	cyclictest	1871334	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:29:33	3
1857390	99	88	76,6	cyclictest	2127413	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:38:37	1
1857398	99	87	74,7	cyclictest	1871334	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:23:35	3
1857390	99	87	75,6	cyclictest	1890849	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:29:15	1
1857390	99	87	75,6	cyclictest	1890849	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:29:15	1
1857390	99	87	75,6	cyclictest	1862580	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:39:35	1
1857390	99	87	73,7	cyclictest	1859228	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:41:01	1
1857390	99	87	73,7	cyclictest	1859228	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:41:00	1
1857398	99	86	72,7	cyclictest	2134607	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:17:53	3
1857398	99	86	72,7	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:25:23	3
1857398	99	86	72,7	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:25:22	3
1857395	99	86	72,7	cyclictest	2031442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:00:39	2
1857390	99	86	72,7	cyclictest	2031442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:57:28	1
1857404	99	85	80,2	cyclictest	0	-21	swapper/4	08:38:35	4
1857404	99	85	79,3	cyclictest	0	-21	swapper/4	09:22:11	4
1857404	99	85	79,2	cyclictest	0	-21	swapper/4	08:24:32	4
1857404	99	85	75,6	cyclictest	1980583	-21	ssh	10:15:53	4
1857398	99	85	72,7	cyclictest	1968120	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:13:14	3
1857398	99	85	72,6	cyclictest	2081091	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:35:19	3
1857398	99	85	72,6	cyclictest	1890849	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:05:51	3
1857395	99	85	64,8	cyclictest	1915184	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:29:17	2
1857395	99	85	64,8	cyclictest	1915184	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:29:17	2
1857390	99	85	74,5	cyclictest	1862580	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:51:39	1
1857390	99	85	73,6	cyclictest	1862580	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:08:34	1
1857390	99	85	71,7	cyclictest	1984650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:35:49	1
1857390	99	85	71,7	cyclictest	1984650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:35:49	1
1857398	99	84	71,7	cyclictest	2105936	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:55:51	3
1857386	99	84	33,5	cyclictest	690	50	irq/528-eth0-Tx	11:15:22	0
1857404	99	83	74,5	cyclictest	2131458	-21	ssh	12:11:35	4
1857404	99	83	73,6	cyclictest	1927555	-21	ssh	09:36:33	4
1857404	99	83	73,6	cyclictest	1927555	-21	ssh	09:36:33	4
1857398	99	83	71,6	cyclictest	2090715	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:52:36	3
1857398	99	83	70,7	cyclictest	1984650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:27:34	3
1857398	99	83	70,7	cyclictest	1888024	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:00:15	3
1857390	99	83	71,6	cyclictest	2031442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:56:02	1
1857390	99	83	70,7	cyclictest	1882675	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:45:07	1
1857386	99	83	37,28	cyclictest	1890849	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:14:41	0
2147689	2	82	0,4	sleep4	0	-21	swapper/4	12:24:54	4
1857408	99	82	76,3	cyclictest	0	-21	swapper/5	12:33:52	5
1857404	99	82	76,2	cyclictest	0	-21	swapper/4	12:28:33	4
1857404	99	82	75,3	cyclictest	0	-21	swapper/4	11:08:25	4
1857404	99	82	65,10	cyclictest	1897158	-21	diskmemload-4	11:51:41	4
1857398	99	82	69,7	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:35:13	3
1857398	99	82	69,7	cyclictest	1907117	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:35:13	3
1857398	99	82	69,7	cyclictest	1871334	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:18:35	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17