OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Apr 26, 2026 00:46:37)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
900578	2	139	123,6	sleep3	894718	-21	kworker/3:3+events@ dbs_work_handler	19:05:20	3
902096	99	112	98,7	cyclictest	965082	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:37:39	3
902085	99	112	77,19	cyclictest	210	-21	kswapd0	00:25:24	0
902085	99	112	77,19	cyclictest	210	-21	kswapd0	00:25:24	0
902096	99	109	95,7	cyclictest	1171602	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:05:34	3
902096	99	107	65,12	cyclictest	1144424	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:00:02	3
902096	99	105	93,6	cyclictest	1036677	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:32:47	3
902096	99	103	89,7	cyclictest	930009	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:42:40	3
954919	2	100	0,4	sleep1	0	-21	swapper/1	21:14:57	1
954919	2	100	0,4	sleep1	0	-21	swapper/1	21:14:57	1
902101	99	99	86,8	cyclictest	1069644	-21	ssh	22:41:35	4
902101	99	99	86,8	cyclictest	1069644	-21	ssh	22:41:35	4
902094	99	98	84,7	cyclictest	1036677	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:39:21	2
902101	99	97	91,3	cyclictest	0	-21	swapper/4	23:16:38	4
902096	99	97	85,6	cyclictest	1020378	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:14:35	3
902096	99	97	85,6	cyclictest	1020378	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:14:34	3
902096	99	97	66,7	cyclictest	1125908	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:50:49	3
902096	99	96	82,7	cyclictest	1213202	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:31:33	3
902096	99	94	79,7	cyclictest	1029990	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:16:14	3
902096	99	94	79,7	cyclictest	1029990	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:16:14	3
902101	99	93	86,3	cyclictest	0	-21	swapper/4	20:47:39	4
902096	99	93	79,7	cyclictest	942355	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:05:35	3
902101	99	91	85,3	cyclictest	0	-21	swapper/4	20:05:24	4
902096	99	91	77,7	cyclictest	965082	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:09:15	3
902089	99	91	76,7	cyclictest	1029990	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:13:54	1
902089	99	91	76,7	cyclictest	1029990	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:13:53	1
931048	2	90	0,5	sleep5	0	-21	swapper/5	20:20:24	5
902085	99	90	60,7	cyclictest	936837	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:43:52	0
902101	99	89	77,6	cyclictest	953972	-21	diskmemload-4	23:30:25	4
902101	99	89	77,6	cyclictest	953972	-21	diskmemload-4	23:30:25	4
902105	99	88	83,2	cyclictest	0	-21	swapper/5	23:15:33	5
902096	99	88	75,7	cyclictest	1058100	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:00:17	3
902096	99	88	74,7	cyclictest	1202269	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:25:37	3
902096	99	88	74,7	cyclictest	1202269	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:25:37	3
902089	99	88	74,7	cyclictest	1036677	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:35:09	1
902089	99	88	54,16	cyclictest	930009	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:52:16	1
902085	99	88	67,14	cyclictest	950464	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:40:48	0
902101	99	87	81,3	cyclictest	0	-21	swapper/4	21:38:13	4
902101	99	87	81,3	cyclictest	0	-21	swapper/4	19:17:33	4
902101	99	87	81,3	cyclictest	0	-21	swapper/4	00:36:29	4
902101	99	87	75,6	cyclictest	953972	-21	diskmemload-4	00:24:34	4
902096	99	87	73,7	cyclictest	1125908	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:02:20	3
902096	99	87	73,7	cyclictest	1058100	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:48:34	3
902096	99	87	73,7	cyclictest	1058100	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:48:34	3
902094	99	87	62,21	cyclictest	210	-21	kswapd0	00:25:16	2
902094	99	87	62,21	cyclictest	210	-21	kswapd0	00:25:15	2
902089	99	87	74,7	cyclictest	965082	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:22:14	1
902089	99	87	74,7	cyclictest	965082	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:22:14	1
902085	99	87	28,52	cyclictest	1088650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:15:05	0
902101	99	86	73,8	cyclictest	1096194	-21	ssh	23:02:00	4
902101	99	86	65,4	cyclictest	1180698	-21	sh	00:06:30	4
902096	99	86	72,7	cyclictest	950464	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:10:24	3
902096	99	86	72,7	cyclictest	950464	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:10:23	3
902096	99	86	56,8	cyclictest	1088650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:32:50	3
902096	99	86	56,8	cyclictest	1088650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:32:50	3
902085	99	86	73,6	cyclictest	942355	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:58:12	0
902105	99	85	78,3	cyclictest	0	-21	swapper/5	22:41:11	5
902105	99	85	78,3	cyclictest	0	-21	swapper/5	22:41:11	5
902085	99	85	46,17	cyclictest	981160	-21	awk	21:35:01	0
902085	99	85	3,12	cyclictest	0	-21	swapper/0	00:00:33	0
998847	2	84	0,4	sleep3	0	-21	swapper/3	21:48:01	3
902101	99	84	78,3	cyclictest	0	-21	swapper/4	00:04:33	4
902085	99	84	73,8	cyclictest	1125908	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:50:37	0
902085	99	84	4,56	cyclictest	1186512	-21	sh	00:10:47	0
902085	99	84	30,29	cyclictest	936837	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:45:27	0
900273	2	84	55,20	sleep5	0	-21	swapper/5	19:05:15	5
902105	99	83	78,2	cyclictest	0	-21	swapper/5	22:37:35	5
902105	99	83	78,2	cyclictest	0	-21	swapper/5	21:50:37	5
902105	99	83	77,3	cyclictest	0	-21	swapper/5	20:15:35	5
902096	99	83	70,7	cyclictest	930009	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:00:24	3
902096	99	83	69,7	cyclictest	965082	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:52:44	3
902105	99	82	75,3	cyclictest	0	-21	swapper/5	00:27:34	5
902105	99	82	75,3	cyclictest	0	-21	swapper/5	00:27:34	5
902101	99	82	75,4	cyclictest	0	-21	swapper/4	23:29:12	4
902101	99	82	75,3	cyclictest	0	-21	swapper/4	21:21:57	4
902101	99	82	75,3	cyclictest	0	-21	swapper/4	21:21:56	4
902101	99	82	75,3	cyclictest	0	-21	swapper/4	20:17:39	4
902101	99	82	75,3	cyclictest	0	-21	swapper/4	00:19:13	4
902101	99	82	74,3	cyclictest	0	-21	swapper/4	23:14:31	4
902101	99	82	73,4	cyclictest	0	-21	swapper/4	19:46:40	4
902101	99	82	68,8	cyclictest	1144809	-21	ssh	23:39:54	4
902101	99	82	68,8	cyclictest	1144809	-21	ssh	23:39:54	4
902096	99	82	68,7	cyclictest	905707	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:40:33	3
902096	99	82	68,7	cyclictest	1088650	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:12:48	3
902085	99	82	1,54	cyclictest	1008813	-21	ntpq	21:55:29	0
902101	99	81	74,4	cyclictest	0	-21	swapper/4	21:12:28	4
902101	99	81	74,4	cyclictest	0	-21	swapper/4	21:12:28	4
902101	99	81	74,3	cyclictest	0	-21	swapper/4	23:59:14	4
902096	99	81	68,6	cyclictest	1125908	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:15:47	3
902096	99	81	67,7	cyclictest	901866	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:10:20	3
902096	99	81	67,7	cyclictest	1144424	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:45:07	3
902096	99	81	66,7	cyclictest	950464	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:20:30	3
902096	99	81	66,7	cyclictest	950464	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:20:29	3
902089	99	81	66,8	cyclictest	930009	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:40:02	1
902085	99	81	71,7	cyclictest	1098318	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:29:34	0
902105	99	80	71,5	cyclictest	0	-21	swapper/5	19:41:07	5
902101	99	80	73,3	cyclictest	0	-21	swapper/4	22:51:34	4
902101	99	80	67,7	cyclictest	953972	-21	diskmemload-4	21:55:27	4
902101	99	80	66,8	cyclictest	1155199	-21	ssh	23:47:11	4
902096	99	80	67,7	cyclictest	979907	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:56:00	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17