OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Mon Jan 05, 2026 00:47:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1089891	2	3081	3066,6	sleep2	1081740	-21	kworker/2:2+events@ dbs_work_handler	19:09:37	2
1088495	2	1376	1346,12	sleep0	1088327	-21	kworker/0:0+events@ dbs_work_handler	19:05:20	0
1090094	99	140	126,7	cyclictest	1138355	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:12:17	2
1090094	99	140	126,7	cyclictest	1138355	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:12:17	2
1090094	99	140	125,8	cyclictest	1267624	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:12:38	2
1090094	99	139	126,7	cyclictest	1295834	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:32:40	2
1090094	99	132	118,7	cyclictest	1201872	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:22:29	2
1090094	99	132	118,7	cyclictest	1201872	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:22:29	2
1090094	99	131	116,8	cyclictest	1070066	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:22:00	2
1090084	99	131	111,16	cyclictest	210	-21	kswapd0	22:45:27	0
1090084	99	129	58,7	cyclictest	1248552	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:05:46	0
1090104	99	127	121,3	cyclictest	0	-21	swapper/4	22:42:32	4
1090104	99	127	121,3	cyclictest	0	-21	swapper/4	22:42:32	4
1355480	2	124	0,4	sleep5	0	-21	swapper/5	00:20:36	5
1090094	99	123	109,7	cyclictest	1321779	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:57:40	2
1090084	99	122	95,19	cyclictest	1248552	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:50:14	0
1089162	2	122	102,9	sleep1	1085020	-21	kworker/1:0+events@ dbs_work_handler	19:05:39	1
1090094	99	121	106,7	cyclictest	1236288	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:37:32	2
1090094	99	121	106,7	cyclictest	1236288	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:37:31	2
1244993	2	116	0,3	sleep0	0	-21	swapper/0	22:44:42	0
1244993	2	116	0,3	sleep0	0	-21	swapper/0	22:44:42	0
1090084	99	116	97,15	cyclictest	210	-21	kswapd0	22:00:26	0
1090094	99	115	104,7	cyclictest	210	-21	kswapd0	00:20:06	2
1090104	99	113	102,6	cyclictest	1165018	-21	ssh	21:34:35	4
1090104	99	113	102,6	cyclictest	1165018	-21	ssh	21:34:35	4
1090084	99	113	95,14	cyclictest	210	-21	kswapd0	00:35:27	0
1090084	99	112	36,17	cyclictest	13	-21	ksoftirqd/0	21:40:24	0
1090084	99	112	36,17	cyclictest	13	-21	ksoftirqd/0	21:40:24	0
1090104	99	111	106,2	cyclictest	0	-21	swapper/4	21:42:24	4
1090104	99	111	106,2	cyclictest	0	-21	swapper/4	21:42:24	4
1090090	99	111	101,6	cyclictest	210	-21	kswapd0	23:20:28	1
1090084	99	111	93,14	cyclictest	210	-21	kswapd0	00:30:01	0
1090104	99	110	105,2	cyclictest	0	-21	swapper/4	00:30:01	4
1090099	99	109	95,7	cyclictest	1113887	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:07:08	3
1090104	99	108	95,7	cyclictest	1337906	-21	ssh	00:05:26	4
1090104	99	105	99,2	cyclictest	0	-21	swapper/4	21:55:07	4
1090094	99	105	90,7	cyclictest	1295834	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:42:42	2
1090094	99	105	90,7	cyclictest	1295834	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:42:42	2
1090094	99	104	89,7	cyclictest	1095850	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:30:34	2
1090094	99	104	89,7	cyclictest	1095850	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:30:34	2
1090084	99	104	67,30	cyclictest	1295834	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:40:18	0
1090084	99	104	67,30	cyclictest	1295834	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:40:18	0
1090104	99	103	97,3	cyclictest	0	-21	swapper/4	20:30:35	4
1090084	99	103	70,25	cyclictest	1282782	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:28:04	0
1090094	99	102	89,7	cyclictest	1345218	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:13:23	2
1090090	99	102	91,7	cyclictest	1178063	-21	bingrep	21:45:26	1
1090104	99	99	93,3	cyclictest	0	-21	swapper/4	23:49:25	4
1090090	99	99	90,5	cyclictest	210	-21	kswapd0	00:10:00	1
1090084	99	99	80,12	cyclictest	1207961	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:27:31	0
1090084	99	99	80,12	cyclictest	1207961	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:27:30	0
1090109	99	98	92,3	cyclictest	0	-21	swapper/5	00:30:00	5
1090104	99	97	92,2	cyclictest	0	-21	swapper/4	23:05:46	4
1090084	99	97	81,7	cyclictest	1118233	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:30:33	0
1090084	99	97	57,23	cyclictest	1201872	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:20:06	0
1090084	99	97	57,23	cyclictest	1201872	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:20:06	0
1090104	99	96	85,6	cyclictest	1354302	-21	ssh	00:20:07	4
1090104	99	95	89,2	cyclictest	0	-21	swapper/4	23:15:12	4
1090094	99	95	82,7	cyclictest	1180323	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:57:26	2
1090094	99	95	79,9	cyclictest	1254837	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:55:34	2
1090084	99	94	76,12	cyclictest	1130219	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:52:15	0
1090084	99	94	75,15	cyclictest	210	-21	kswapd0	00:10:01	0
1090099	99	93	84,6	cyclictest	210	-21	kswapd0	23:45:00	3
1090099	99	93	84,6	cyclictest	210	-21	kswapd0	23:45:00	3
1090094	99	93	81,8	cyclictest	1246557	-21	bingrep	22:45:27	2
1090094	99	93	81,6	cyclictest	1120647	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:27:11	2
1090084	99	93	66,19	cyclictest	1157440	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:29:09	0
1090084	99	93	56,33	cyclictest	210	-21	kswapd0	23:15:13	0
1090084	99	93	38,47	cyclictest	1090351	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:18:13	0
1090084	99	93	38,47	cyclictest	1090351	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:18:12	0
1090099	99	91	76,8	cyclictest	1166012	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:40:28	3
1090099	99	91	76,8	cyclictest	1166012	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:40:28	3
1090094	99	91	78,7	cyclictest	1166012	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:47:16	2
1090084	99	91	47,28	cyclictest	1273610	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:23:05	0
1090104	99	90	76,9	cyclictest	1141675	-21	diskmemload-4	21:37:22	4
1090104	99	90	76,9	cyclictest	1141675	-21	diskmemload-4	21:37:22	4
1090099	99	90	75,8	cyclictest	1143839	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:17:18	3
1090094	99	90	77,7	cyclictest	1132344	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:56:35	2
1090084	99	90	68,15	cyclictest	1115962	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:12:34	0
1090084	99	90	65,17	cyclictest	1282782	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:34:21	0
1090084	99	90	63,19	cyclictest	1102517	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:49:47	0
1090109	99	89	84,2	cyclictest	0	-21	swapper/5	00:15:08	5
1090109	99	89	84,2	cyclictest	0	-21	swapper/5	00:15:07	5
1090099	99	89	62,6	cyclictest	1254837	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:59:00	3
1090094	99	89	76,7	cyclictest	1282782	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:26:54	2
1090094	99	89	76,6	cyclictest	1248552	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:15:38	2
1090094	99	89	60,7	cyclictest	1180323	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:01:30	2
1090094	99	89	59,7	cyclictest	1351583	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:17:31	2
1090094	99	89	59,7	cyclictest	1351583	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:17:30	2
1090090	99	89	79,6	cyclictest	210	-21	kswapd0	21:35:27	1
1090090	99	89	79,6	cyclictest	210	-21	kswapd0	21:35:27	1
1090084	99	89	65,16	cyclictest	1174560	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:16:26	0
1090084	99	89	65,16	cyclictest	1174560	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:16:25	0
1090084	99	89	54,23	cyclictest	1328070	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:12:38	0
1090084	99	89	1,35	cyclictest	0	-21	swapper/0	00:15:41	0
1090084	99	89	1,35	cyclictest	0	-21	swapper/0	00:15:41	0
1090094	99	88	75,7	cyclictest	1130219	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:35:14	2
1090094	99	88	75,7	cyclictest	1130219	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:35:13	2
1090090	99	88	58,8	cyclictest	1090351	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:21:50	1
1090084	99	88	15,25	cyclictest	0	-21	swapper/0	21:34:03	0
1090084	99	88	15,25	cyclictest	0	-21	swapper/0	21:34:03	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17