OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Apr 15, 2026 00:46:39)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3610372	2	2640	2596,26	sleep0	3609272	-21	kworker/0:1+events@ dbs_work_handler	19:05:26	0
3610372	2	2640	2596,26	sleep0	3609272	-21	kworker/0:1+events@ dbs_work_handler	19:05:25	0
3611561	99	135	116,7	cyclictest	3703427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:57:02	3
3611548	99	132	65,31	cyclictest	3749993	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:52:28	0
3611548	99	121	68,45	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:44:36	0
3611548	99	113	80,14	cyclictest	3636453	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:30:16	0
3611548	99	112	69,24	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:15:50	0
3611548	99	112	69,24	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:15:49	0
3611561	99	111	95,7	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:06:51	3
3611561	99	111	95,7	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:06:51	3
3611561	99	110	94,7	cyclictest	3807404	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:17:15	3
3611548	99	109	94,7	cyclictest	3648002	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:41:44	0
3611548	99	109	82,7	cyclictest	3707587	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	22:00:48	0
3611561	99	108	95,6	cyclictest	3630603	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:00:34	3
3611548	99	108	83,6	cyclictest	3679409	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:28:19	0
3611548	99	108	40,59	cyclictest	3638658	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:46:57	0
3611565	99	106	94,6	cyclictest	3832688	-21	ssh	23:23:33	4
3611561	99	104	68,9	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:25:37	3
3611548	99	104	64,15	cyclictest	3780502	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:02:33	0
3611552	99	103	87,7	cyclictest	3828064	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:35:33	1
3611552	99	103	87,7	cyclictest	3828064	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:35:33	1
3611548	99	103	81,7	cyclictest	3828064	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:19:16	0
3611548	99	103	73,15	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:24:55	0
3611561	99	101	63,8	cyclictest	3851639	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:22:56	3
3611548	99	101	64,14	cyclictest	3749993	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:46:20	0
3611548	99	101	53,28	cyclictest	3749993	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:37:04	0
3611561	99	100	86,7	cyclictest	3606482	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:30:35	3
3611548	99	100	74,7	cyclictest	3630603	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:01:36	0
3611561	99	99	84,7	cyclictest	3638658	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:15:35	3
3611548	99	99	77,14	cyclictest	3828064	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:23:34	0
3611548	99	99	72,7	cyclictest	3606482	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:23:36	0
3611548	99	98	78,4	cyclictest	0	-21	swapper/0	21:45:41	0
3611548	99	97	48,28	cyclictest	3703427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:56:45	0
3611548	99	97	36,38	cyclictest	3606482	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:12:18	0
3611565	99	96	90,3	cyclictest	0	-21	swapper/4	20:01:36	4
3611552	99	96	81,7	cyclictest	3658186	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:16:52	1
3611565	99	95	89,3	cyclictest	0	-21	swapper/4	19:23:35	4
3611565	99	95	88,3	cyclictest	0	-21	swapper/4	21:39:31	4
3611565	99	95	88,3	cyclictest	0	-21	swapper/4	21:39:31	4
3611565	99	95	80,9	cyclictest	3749942	-21	ssh	22:20:04	4
3611565	99	95	80,9	cyclictest	3749942	-21	ssh	22:20:04	4
3611548	99	93	66,17	cyclictest	3920099	-21	ntpq	00:30:29	0
3611548	99	92	71,6	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:39:31	0
3611548	99	92	71,6	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:39:31	0
3611561	99	91	77,7	cyclictest	3733358	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:35:37	3
3611561	99	91	74,9	cyclictest	3773796	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:55:23	3
3611561	99	91	74,9	cyclictest	3773796	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:55:22	3
3611561	99	91	62,7	cyclictest	3623662	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:43:27	3
3611561	99	90	77,7	cyclictest	3749993	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:20:35	3
3611561	99	90	77,7	cyclictest	3749993	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:20:34	3
3611552	99	90	76,6	cyclictest	3828064	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:32:29	1
3611565	99	89	82,3	cyclictest	0	-21	swapper/4	00:30:28	4
3611561	99	89	76,7	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:49:15	3
3611556	99	89	73,8	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:51:59	2
3611548	99	89	76,6	cyclictest	3780502	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:56:04	0
3611548	99	89	76,6	cyclictest	3780502	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:56:04	0
3611565	99	88	82,3	cyclictest	0	-21	swapper/4	21:17:34	4
3611565	99	88	77,6	cyclictest	3700458	-21	ssh	21:41:22	4
3611565	99	88	76,7	cyclictest	3745706	-21	ssh	22:16:02	4
3611565	99	88	76,7	cyclictest	3745706	-21	ssh	22:16:01	4
3611548	99	88	75,7	cyclictest	3733358	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:07:14	0
3611561	99	86	74,6	cyclictest	3773796	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:42:23	3
3611561	99	86	73,7	cyclictest	3703427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:11:55	3
3611561	99	86	73,7	cyclictest	3703427	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:11:55	3
3611561	99	86	73,6	cyclictest	3617448	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:35:41	3
3611561	99	86	72,7	cyclictest	3836451	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:37:19	3
3611561	99	86	72,7	cyclictest	3836451	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:37:18	3
3611552	99	86	70,7	cyclictest	3648002	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:37:34	1
3611552	99	86	70,7	cyclictest	3648002	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:37:34	1
3611548	99	86	2,79	cyclictest	0	-21	swapper/0	22:10:16	0
3611548	99	86	2,79	cyclictest	0	-21	swapper/0	22:10:16	0
3611561	99	85	72,7	cyclictest	3773796	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:01:33	3
3611548	99	85	71,7	cyclictest	3636453	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:25:00	0
3611548	99	85	71,7	cyclictest	3636453	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:25:00	0
3611548	99	85	71,7	cyclictest	3617448	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:30:23	0
3611548	99	85	46,17	cyclictest	3880273	-21	aten2.4-expect	00:00:18	0
3611570	99	84	78,3	cyclictest	0	-21	swapper/5	22:35:25	5
3611565	99	84	78,3	cyclictest	0	-21	swapper/4	22:10:46	4
3611565	99	84	78,3	cyclictest	0	-21	swapper/4	22:10:46	4
3611565	99	84	70,9	cyclictest	3765494	-21	ssh	22:31:17	4
3611561	99	84	63,8	cyclictest	3836451	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:46:40	3
3611548	99	84	70,7	cyclictest	3851639	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:40:33	0
3611548	99	84	70,7	cyclictest	3851639	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:40:32	0
3611548	99	84	64,13	cyclictest	3851639	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:10:51	0
3611565	99	83	78,2	cyclictest	0	-21	swapper/4	00:28:23	4
3611561	99	83	70,7	cyclictest	3828064	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:57:20	3
3611561	99	83	70,7	cyclictest	3613371	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	19:45:45	3
3611561	99	83	69,8	cyclictest	3636453	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:40:34	3
3611561	99	83	69,7	cyclictest	3733358	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:32:05	3
3611552	99	83	69,7	cyclictest	3807404	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:27:15	1
3611552	99	83	59,7	cyclictest	3851639	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:23:41	1
3611548	99	83	68,12	cyclictest	3851639	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:29:02	0
3611548	99	83	65,6	cyclictest	3669310	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	21:19:01	0
3611548	99	83	62,18	cyclictest	3773796	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:08:11	0
3611565	99	82	75,3	cyclictest	0	-21	swapper/4	23:00:36	4
3611565	99	82	73,5	cyclictest	3848688	-21	ssh	23:35:36	4
3611565	99	82	73,5	cyclictest	3848688	-21	ssh	23:35:35	4
3611561	99	82	69,7	cyclictest	3654055	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:01:49	3
3611561	99	82	68,7	cyclictest	3925636	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:37:33	3
3611561	99	82	68,7	cyclictest	3733358	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:29:03	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17