OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Thu Mar 05, 2026 00:46:40)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
442540	2	1274	1251,7	sleep0	441999	-21	kworker/0:1+events@ dbs_work_handler	19:05:10	0
442406	2	211	184,17	sleep4	0	-21	swapper/4	19:05:02	4
444404	99	158	110,41	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:51:15	0
444404	99	152	107,38	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:30:58	0
444404	99	152	107,38	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:30:57	0
444404	99	144	106,31	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:46:13	0
444404	99	143	115,20	cyclictest	553098	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:56:15	0
444404	99	139	64,65	cyclictest	670771	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:51:01	0
444404	99	138	63,51	cyclictest	631390	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:08:47	0
444404	99	138	63,51	cyclictest	631390	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:08:46	0
444404	99	137	69,61	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:00:54	0
444409	99	135	121,7	cyclictest	470672	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:15:44	1
444404	99	135	56,69	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:44:45	0
444404	99	135	56,69	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:44:45	0
444413	99	130	116,7	cyclictest	691283	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:47:00	2
444413	99	129	116,7	cyclictest	553098	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:06:18	2
444413	99	129	116,7	cyclictest	553098	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:06:17	2
444404	99	128	66,37	cyclictest	662808	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:22:55	0
444404	99	125	56,45	cyclictest	520355	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:47:52	0
444404	99	124	55,46	cyclictest	480442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:38:21	0
444404	99	124	51,50	cyclictest	468350	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:06:57	0
444404	99	123	75,45	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:31:44	0
444409	99	122	110,6	cyclictest	553098	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:01:04	1
444404	99	122	84,31	cyclictest	446027	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:14:35	0
444404	99	122	58,42	cyclictest	473205	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:43:28	0
444422	99	121	109,7	cyclictest	631410	-21	ssh	22:56:16	4
444404	99	121	84,30	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:27:35	0
444404	99	121	62,51	cyclictest	528821	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:40:41	0
444409	99	120	108,6	cyclictest	711704	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:34:05	1
444404	99	120	85,28	cyclictest	507517	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:35:58	0
444404	99	120	81,31	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:38:23	0
444404	99	120	81,31	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:38:22	0
444404	99	120	74,39	cyclictest	577960	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:18:11	0
444404	99	120	74,39	cyclictest	577960	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:18:10	0
444404	99	119	82,30	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:50:51	0
444404	99	119	82,30	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:50:50	0
444404	99	119	51,44	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:01:07	0
444404	99	119	51,44	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:01:07	0
444404	99	118	79,32	cyclictest	452135	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:39:35	0
444404	99	118	55,56	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:49:02	0
444404	99	117	76,32	cyclictest	452135	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:40:14	0
444404	99	117	76,32	cyclictest	452135	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:40:14	0
444404	99	117	64,45	cyclictest	499354	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:26:51	0
444404	99	117	62,48	cyclictest	499354	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:20:53	0
444404	99	117	62,47	cyclictest	631390	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:04:02	0
444404	99	117	61,48	cyclictest	528821	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:51:17	0
444404	99	116	78,31	cyclictest	577960	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:21:08	0
444404	99	116	63,45	cyclictest	655292	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:17:39	0
444404	99	115	78,30	cyclictest	473205	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:20:45	0
444404	99	115	61,47	cyclictest	520355	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:03:12	0
444404	99	115	58,49	cyclictest	553098	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:57:10	0
444404	99	115	58,49	cyclictest	553098	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:57:09	0
444404	99	115	54,40	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:13:40	0
444422	99	114	104,6	cyclictest	624862	-21	ssh	22:51:14	4
444409	99	114	101,7	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:10:53	1
444404	99	114	63,44	cyclictest	470672	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:26:08	0
444404	99	113	64,41	cyclictest	655292	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:31:31	0
444404	99	113	59,46	cyclictest	670771	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:46:13	0
444404	99	112	76,30	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:11:19	0
444404	99	112	76,30	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:11:18	0
444404	99	112	73,32	cyclictest	757941	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:37:49	0
444404	99	112	60,44	cyclictest	473205	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:31:28	0
444404	99	112	50,55	cyclictest	468350	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:11:43	0
444404	99	112	50,55	cyclictest	468350	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:11:43	0
444413	99	111	98,7	cyclictest	711704	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:13:30	2
444413	99	111	97,7	cyclictest	611471	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:53:03	2
444404	99	111	63,41	cyclictest	719075	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:06:11	0
444427	99	110	104,3	cyclictest	0	-21	swapper/5	21:30:58	5
444427	99	110	104,3	cyclictest	0	-21	swapper/5	21:30:57	5
444427	99	110	103,3	cyclictest	0	-21	swapper/5	22:46:14	5
444404	99	110	73,30	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:59:35	0
444404	99	109	55,46	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:07:07	0
444404	99	109	55,46	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:07:06	0
444404	99	108	71,30	cyclictest	484680	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:11:04	0
444404	99	108	70,31	cyclictest	456284	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:50:26	0
444413	99	107	93,7	cyclictest	492736	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:15:55	2
444404	99	107	72,28	cyclictest	711704	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:16:26	0
444404	99	107	70,30	cyclictest	670771	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:56:28	0
444404	99	107	69,31	cyclictest	452135	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:26:46	0
444404	99	107	69,31	cyclictest	452135	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:26:46	0
444404	99	107	61,39	cyclictest	738679	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:25:11	0
444404	99	107	61,39	cyclictest	738679	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:25:10	0
444422	99	106	101,3	cyclictest	0	-21	swapper/4	21:30:58	4
444422	99	106	101,3	cyclictest	0	-21	swapper/4	21:30:57	4
444409	99	106	93,6	cyclictest	711704	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:03:22	1
444409	99	106	93,6	cyclictest	711704	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:03:22	1
444404	99	106	69,30	cyclictest	528821	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:25:10	0
444404	99	106	54,44	cyclictest	492736	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:16:18	0
444404	99	106	53,45	cyclictest	463521	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:58:23	0
444409	99	105	93,6	cyclictest	480442	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:40:46	1
444422	99	104	100,2	cyclictest	0	-21	swapper/4	22:46:14	4
444413	99	104	84,8	cyclictest	507517	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:31:21	2
444413	99	104	84,8	cyclictest	507517	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:31:21	2
444404	99	104	68,29	cyclictest	446027	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:18:19	0
444404	99	104	2,89	cyclictest	0	-21	swapper/0	22:10:22	0
444404	99	104	2,89	cyclictest	0	-21	swapper/0	22:10:22	0
444404	99	103	2,88	cyclictest	0	-21	swapper/0	23:40:39	0
444404	99	102	62,32	cyclictest	738679	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:22:03	0
444404	99	102	13,73	cyclictest	599524	-21	ssh	22:32:10	0
444404	99	100	62,31	cyclictest	528821	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:35:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17