OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Mon Feb 16, 2026 00:46:44)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1217309	2	2395	2377,10	sleep5	0	-21	swapper/5	19:05:40	5
1218176	99	143	104,31	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:21:27	0
1218176	99	143	104,31	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:21:26	0
1218185	99	135	121,7	cyclictest	1384422	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:56:24	2
1218185	99	132	120,6	cyclictest	1488616	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:33:39	2
1218176	99	121	61,31	cyclictest	1467750	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:01:35	0
1218176	99	121	61,31	cyclictest	1467750	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:01:35	0
1218176	99	118	51,46	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:48:00	0
1218181	99	114	105,6	cyclictest	210	-21	kswapd0	00:30:26	1
1218194	99	113	100,7	cyclictest	1269967	-21	diskmemload-4	23:21:27	4
1218194	99	113	100,7	cyclictest	1269967	-21	diskmemload-4	23:21:26	4
1218181	99	113	100,7	cyclictest	1355873	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:41:23	1
1218181	99	113	100,7	cyclictest	1355873	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:41:22	1
1218176	99	112	42,47	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:41:41	0
1218176	99	112	42,47	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:41:40	0
1218185	99	110	98,6	cyclictest	1301581	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:46:12	2
1218181	99	110	97,7	cyclictest	1266343	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:31:07	1
1218176	99	108	29,59	cyclictest	13	-21	ksoftirqd/0	22:25:19	0
1218185	99	106	94,6	cyclictest	1355873	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:31:20	2
1218185	99	106	92,7	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:16:17	2
1218185	99	103	91,6	cyclictest	1224096	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:45:48	2
1218185	99	103	91,6	cyclictest	1224096	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:45:47	2
1218185	99	102	90,6	cyclictest	1219117	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:10:41	2
1218185	99	102	90,6	cyclictest	1219117	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:10:41	2
1218176	99	102	67,24	cyclictest	0	-21	swapper/0	20:35:16	0
1218181	99	101	88,7	cyclictest	1242043	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:35:57	1
1218181	99	101	71,9	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:20:35	1
1218181	99	101	71,9	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:20:34	1
1218190	99	100	87,6	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:46:24	3
1218176	99	99	71,20	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:15:19	0
1218190	99	98	79,8	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:24:04	3
1218185	99	98	86,6	cyclictest	1254358	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:51:01	2
1218185	99	98	86,6	cyclictest	1254358	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:51:00	2
1218185	99	98	84,7	cyclictest	1488616	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:19:14	2
1218176	99	98	50,39	cyclictest	1475683	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:24:27	0
1218176	99	98	40,45	cyclictest	13	-21	ksoftirqd/0	23:10:07	0
1218176	99	98	40,45	cyclictest	13	-21	ksoftirqd/0	23:10:07	0
1218176	99	97	71,19	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:26:28	0
1218176	99	97	71,19	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:26:28	0
1218185	99	96	83,6	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:08:34	2
1218176	99	96	70,19	cyclictest	1258544	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:41:45	0
1218176	99	96	14,49	cyclictest	1348893	-21	ssh	22:15:44	0
1218185	99	95	67,15	cyclictest	1258544	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:32:35	2
1218181	99	95	82,7	cyclictest	1384422	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:06:24	1
1218176	99	95	70,18	cyclictest	1242043	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:15:34	0
1218176	99	95	67,21	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:58:32	0
1218176	99	95	67,21	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:58:31	0
1218190	99	94	82,6	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:14:27	3
1218190	99	94	82,6	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:14:27	3
1218190	99	94	81,7	cyclictest	1413355	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:23:35	3
1218190	99	94	81,7	cyclictest	1413355	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:23:34	3
1218185	99	94	82,6	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:11:26	2
1218185	99	94	82,6	cyclictest	1392408	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:11:25	2
1218181	99	94	67,9	cyclictest	1467750	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:55:33	1
1218181	99	94	66,7	cyclictest	1254358	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:43:33	1
1218176	99	94	71,17	cyclictest	1244130	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:14:36	0
1218176	99	94	69,18	cyclictest	1467750	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:53:34	0
1218200	99	93	88,2	cyclictest	0	-21	swapper/5	22:55:30	5
1218185	99	93	62,7	cyclictest	1475683	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:03:14	2
1218185	99	93	62,7	cyclictest	1475683	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:03:14	2
1218176	99	93	67,19	cyclictest	1301581	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:21:18	0
1218176	99	93	60,26	cyclictest	1475683	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:30:56	0
1218176	99	93	50,25	cyclictest	0	-21	swapper/0	22:55:42	0
1218176	99	92	65,19	cyclictest	1437140	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:40:24	0
1218176	99	91	1,77	cyclictest	0	-21	swapper/0	20:53:51	0
1218176	99	91	1,77	cyclictest	0	-21	swapper/0	20:53:50	0
1218200	99	90	83,3	cyclictest	0	-21	swapper/5	22:15:22	5
1218185	99	90	60,7	cyclictest	1523444	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:36:53	2
1218176	99	90	61,21	cyclictest	1308270	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:00:45	0
1218176	99	90	61,21	cyclictest	1308270	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:00:44	0
1218176	99	90	57,26	cyclictest	1467750	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:57:22	0
1218176	99	90	27,58	cyclictest	0	-21	swapper/0	00:15:34	0
1218181	99	89	77,6	cyclictest	1244130	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:20:54	1
1218181	99	89	75,7	cyclictest	1219117	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:15:35	1
1218185	99	88	76,6	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:46:34	2
1218176	99	88	64,18	cyclictest	1488616	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:08:55	0
1218176	99	88	64,18	cyclictest	1488616	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:08:55	0
1218176	99	88	53,31	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:45:39	0
1218185	99	87	75,6	cyclictest	1258544	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:28:18	2
1218185	99	87	75,6	cyclictest	1258544	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:28:17	2
1218185	99	87	73,7	cyclictest	1258544	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:22:36	2
1218185	99	87	73,7	cyclictest	1258544	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:22:36	2
1218181	99	87	73,7	cyclictest	1224096	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:35:34	1
1218176	99	87	63,17	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:35:46	0
1218185	99	86	73,7	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:37:15	2
1218185	99	86	59,8	cyclictest	1355873	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:28:13	2
1218185	99	86	59,7	cyclictest	1224096	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:29:28	2
1218181	99	86	73,7	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:31:35	1
1218181	99	86	64,9	cyclictest	1437140	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:33:27	1
1218181	99	86	57,6	cyclictest	1224096	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:45:00	1
1218185	99	85	73,6	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:38:56	2
1218185	99	85	73,6	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:38:55	2
1218185	99	85	71,7	cyclictest	1301581	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:03:05	2
1218185	99	85	71,7	cyclictest	1301581	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:03:05	2
1218181	99	85	72,7	cyclictest	1294787	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:21:44	1
1218176	99	85	57,14	cyclictest	1261629	-21	ntpq	20:55:30	0
1218185	99	84	72,6	cyclictest	1475683	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:11:25	2
1218185	99	84	72,6	cyclictest	1475683	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:11:25	2
1218185	99	84	72,6	cyclictest	1421038	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:52:09	2
1218185	99	84	72,6	cyclictest	1250283	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:29:23	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17