OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Fri May 15, 2026 12:46:30)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1520788	99	161	126,27	cyclictest	1620397	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:19:32	0
1587101	2	155	0,3	sleep2	0	-21	swapper/2	09:25:17	2
1520788	99	143	110,25	cyclictest	1620397	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:19:47	0
1520788	99	138	61,53	cyclictest	1602288	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:51:51	0
1520788	99	137	59,55	cyclictest	1646563	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:13:49	0
1520788	99	136	79,36	cyclictest	1567283	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:09:20	0
1520788	99	136	79,36	cyclictest	1567283	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:09:20	0
1520788	99	132	63,57	cyclictest	1610501	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:00:26	0
1520788	99	132	63,57	cyclictest	1610501	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:00:26	0
1520788	99	132	56,40	cyclictest	1526712	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:36:54	0
1520788	99	132	56,40	cyclictest	1526712	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:36:54	0
1520788	99	131	98,27	cyclictest	1637178	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:24:33	0
1520788	99	131	69,43	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:25:41	0
1520788	99	131	63,57	cyclictest	1801142	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:30:08	0
1520788	99	130	97,26	cyclictest	1572708	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:24:21	0
1520788	99	130	59,29	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:41:58	0
1520788	99	130	56,40	cyclictest	1546770	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:19:25	0
1520788	99	130	54,38	cyclictest	1808382	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:29:31	0
1520805	99	127	120,3	cyclictest	0	-21	swapper/4	10:19:32	4
1520788	99	126	66,47	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:55:10	0
1520788	99	125	90,27	cyclictest	1620397	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:44:36	0
1520788	99	125	53,36	cyclictest	1595572	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:35:00	0
1520800	99	124	110,7	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:39:12	3
1520788	99	123	89,27	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:17:35	0
1520788	99	122	77,21	cyclictest	0	-21	swapper/0	07:30:23	0
1520788	99	122	66,49	cyclictest	1653589	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:27:19	0
1520800	99	121	108,6	cyclictest	1672314	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:54:38	3
1520788	99	121	47,40	cyclictest	1528729	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:43:53	0
1520788	99	120	84,28	cyclictest	1567283	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	09:14:21	0
1520788	99	118	81,29	cyclictest	1731062	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:39:51	0
1690944	2	117	0,4	sleep5	0	-21	swapper/5	10:48:43	5
1520788	99	117	82,28	cyclictest	1731062	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:46:42	0
1520788	99	115	66,41	cyclictest	1602288	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	09:47:14	0
1520800	99	114	100,7	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:09:42	3
1520788	99	114	45,34	cyclictest	1534169	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:47:21	0
1520800	99	113	99,7	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:04:53	3
1520800	99	113	99,7	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:04:52	3
1520788	99	113	77,28	cyclictest	1801142	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:24:35	0
1533707	2	112	0,3	sleep3	0	-21	swapper/3	07:40:23	3
1520788	99	112	77,27	cyclictest	1554879	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:34:14	0
1520788	99	112	74,30	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:06:35	0
1520788	99	112	74,30	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	12:06:34	0
1520788	99	112	60,36	cyclictest	1801142	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	12:19:51	0
1520788	99	112	56,36	cyclictest	1572708	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:25:44	0
1520805	99	111	104,3	cyclictest	0	-21	swapper/4	11:19:47	4
1520788	99	111	77,27	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:04:19	0
1520788	99	111	75,29	cyclictest	1653589	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:31:16	0
1520788	99	111	72,30	cyclictest	1559731	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:58:26	0
1520797	99	110	96,7	cyclictest	1782540	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:09:53	2
1520797	99	110	96,7	cyclictest	1782540	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:09:52	2
1520788	99	110	75,28	cyclictest	1731062	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:33:34	0
1520788	99	110	74,28	cyclictest	1554879	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:35:36	0
1520788	99	110	49,53	cyclictest	1747991	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:00:44	0
1520788	99	110	49,53	cyclictest	1747991	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:00:43	0
1520788	99	109	74,28	cyclictest	1672314	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:36:50	0
1520788	99	109	74,28	cyclictest	1672314	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:36:49	0
1520788	99	108	74,27	cyclictest	1747991	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:51:36	0
1520800	99	107	94,7	cyclictest	1528729	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:04:09	3
1520800	99	107	91,8	cyclictest	1572708	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:34:24	3
1520800	99	105	52,19	cyclictest	1620397	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	10:24:23	3
1520788	99	105	45,52	cyclictest	1782540	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:35:48	0
1520805	99	104	92,6	cyclictest	1572609	-21	diskmemload-4	10:24:33	4
1520788	99	104	71,26	cyclictest	1572708	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:36:35	0
1520788	99	104	67,29	cyclictest	1620397	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:02:24	0
1520788	99	104	66,19	cyclictest	1543218	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:08:33	0
1520788	99	104	62,20	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:22:39	0
1520788	99	103	69,27	cyclictest	1679376	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	10:46:02	0
1520788	99	103	64,19	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:24:22	0
1520788	99	103	64,19	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:24:22	0
1520788	99	103	64,19	cyclictest	1516583	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:15:15	0
1520788	99	102	65,18	cyclictest	1768187	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	11:57:35	0
1520788	99	101	66,28	cyclictest	1534169	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:51:05	0
1520788	99	101	66,28	cyclictest	1534169	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	07:51:05	0
1520788	99	101	66,27	cyclictest	1793365	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	12:11:34	0
1520788	99	101	63,19	cyclictest	1559731	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:46:16	0
1520788	99	101	59,21	cyclictest	1747991	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:40:14	0
1520805	99	100	92,4	cyclictest	0	-21	swapper/4	09:24:21	4
1520788	99	100	65,27	cyclictest	1637178	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:06:49	0
1520788	99	100	62,18	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	11:06:40	0
1520788	99	100	60,19	cyclictest	1554879	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	08:43:03	0
1520788	99	100	59,21	cyclictest	1559731	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	08:54:52	0
1761041	2	99	0,4	sleep3	0	-21	swapper/3	11:45:12	3
1520805	99	99	85,8	cyclictest	1685682	-21	ssh	10:44:36	4
1520800	99	99	86,6	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	09:29:24	3
1520788	99	99	60,19	cyclictest	1610501	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	09:56:08	0
1520788	99	99	60,19	cyclictest	1524663	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:21:30	0
1520788	99	99	60,19	cyclictest	1524663	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	07:21:29	0
1520800	99	98	86,6	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:29:14	3
1520788	99	98	63,28	cyclictest	1620397	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	11:11:24	0
1520788	99	98	61,19	cyclictest	1672314	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	10:50:22	0
1520805	99	97	83,9	cyclictest	1577751	-21	ssh	09:17:35	4
1520800	99	97	59,8	cyclictest	1690452	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	10:48:21	3
1520788	99	97	61,18	cyclictest	1520330	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:13:50	0
1520800	99	96	67,7	cyclictest	1526712	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:39:39	3
1520800	99	96	67,7	cyclictest	1526712	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:39:38	3
1520797	99	95	82,6	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:24:13	2
1520800	99	94	80,7	cyclictest	1731062	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	11:44:49	3
1520788	99	94	56,18	cyclictest	1548965	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	08:25:05	0
1520788	99	94	55,19	cyclictest	1526712	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	07:26:22	0
1520800	99	92	77,8	cyclictest	1782540	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	12:10:14	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17