OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Thu Feb 19, 2026 00:46:40)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
20057	99	122	107,8	cyclictest	287424	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:28:40	3
20057	99	122	107,8	cyclictest	287424	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:28:39	3
20043	99	117	21,64	cyclictest	20292	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:21:29	0
20043	99	117	21,64	cyclictest	20292	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:21:29	0
149461	2	113	0,3	sleep1	0	-21	swapper/1	22:12:13	1
20057	99	110	95,8	cyclictest	102033	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:40:54	3
20057	99	109	95,7	cyclictest	4185677	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:25:22	3
20043	99	108	1,85	cyclictest	13300	-21	snmpd	21:45:44	0
20043	99	108	1,85	cyclictest	13300	-21	snmpd	21:45:44	0
20043	99	107	27,41	cyclictest	20292	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:39:03	0
20043	99	107	27,41	cyclictest	20292	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:39:03	0
20057	99	105	90,7	cyclictest	261862	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:47:13	3
20066	99	103	97,2	cyclictest	0	-21	swapper/5	00:38:45	5
20043	99	103	27,54	cyclictest	34010	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:38:49	0
20043	99	102	0,86	cyclictest	0	-21	swapper/0	00:15:00	0
20057	99	100	86,6	cyclictest	102033	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:05:58	3
20043	99	100	21,58	cyclictest	229385	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:34:51	0
20043	99	100	1,84	cyclictest	0	-21	swapper/0	21:10:32	0
20043	99	100	1,84	cyclictest	0	-21	swapper/0	21:10:32	0
20057	99	99	85,6	cyclictest	20292	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:15:21	3
20043	99	99	25,42	cyclictest	269126	-21	kworker/u12:2+rpciod@ rpc_async_schedule	23:45:17	0
20057	99	98	84,7	cyclictest	73716	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:15:48	3
20057	99	98	84,7	cyclictest	73716	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:15:48	3
20043	99	97	66,17	cyclictest	690	50	irq/528-eth0-Tx	23:52:53	0
20043	99	95	59,14	cyclictest	0	-21	swapper/0	23:03:01	0
20043	99	95	32,39	cyclictest	690	50	irq/528-eth0-Tx	22:50:35	0
20057	99	94	63,7	cyclictest	261862	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:06:04	3
20043	99	94	2,77	cyclictest	0	-21	swapper/0	21:03:22	0
20043	99	94	0,78	cyclictest	108513	-21	ssh	21:40:45	0
20057	99	93	80,6	cyclictest	102033	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:55:57	3
20057	99	93	80,6	cyclictest	102033	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:55:57	3
20057	99	93	78,8	cyclictest	314503	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:18:34	3
20057	99	92	78,7	cyclictest	34010	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:11:35	3
20057	99	92	60,8	cyclictest	190939	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:26:00	3
20052	99	92	79,7	cyclictest	52456	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	20:35:41	2
20043	99	91	34,38	cyclictest	689	50	irq/527-eth0-Tx	22:35:28	0
20043	99	91	27,38	cyclictest	0	-21	swapper/0	23:35:18	0
20043	99	91	19,45	cyclictest	40227	-21	sed	20:00:01	0
20043	99	91	1,72	cyclictest	261862	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:05:34	0
20066	99	90	85,2	cyclictest	0	-21	swapper/5	20:45:33	5
20057	99	90	74,8	cyclictest	34010	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:57:05	3
20057	99	89	76,7	cyclictest	190939	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:56:10	3
20043	99	89	75,7	cyclictest	287424	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:15:39	0
20057	99	88	74,7	cyclictest	73716	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:25:13	3
20057	99	88	74,7	cyclictest	229385	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:22:17	3
20057	99	88	73,7	cyclictest	131494	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:15:28	3
20043	99	88	64,12	cyclictest	689	50	irq/527-eth0-Tx	20:50:03	0
20043	99	88	2,71	cyclictest	176165	-21	ssh	22:32:44	0
20043	99	88	2,71	cyclictest	176165	-21	ssh	22:32:44	0
20057	99	87	74,6	cyclictest	238910	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:34:08	3
20057	99	87	73,7	cyclictest	161352	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:53:47	3
20043	99	87	33,37	cyclictest	691	50	irq/529-eth0-Tx	00:34:31	0
20043	99	87	1,73	cyclictest	0	-21	swapper/0	19:28:22	0
20043	99	87	1,68	cyclictest	198145	-21	cat	22:50:01	0
20043	99	87	15,59	cyclictest	0	-21	swapper/0	23:55:37	0
20043	99	87	15,59	cyclictest	0	-21	swapper/0	23:55:36	0
20066	99	86	80,3	cyclictest	0	-21	swapper/5	23:11:11	5
20066	99	86	80,3	cyclictest	0	-21	swapper/5	23:11:10	5
20057	99	86	64,8	cyclictest	287424	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	00:03:16	3
20043	99	86	58,15	cyclictest	0	-21	swapper/0	20:03:31	0
20043	99	86	57,14	cyclictest	0	-21	swapper/0	20:17:41	0
20043	99	86	33,37	cyclictest	689	50	irq/527-eth0-Tx	22:10:36	0
20043	99	86	1,80	cyclictest	0	-21	swapper/0	20:55:03	0
20043	99	86	0,67	cyclictest	0	-21	swapper/0	23:10:44	0
20043	99	86	0,67	cyclictest	0	-21	swapper/0	23:10:43	0
20057	99	85	75,7	cyclictest	210	-21	kswapd0	22:40:25	3
20057	99	85	71,7	cyclictest	60933	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:34:45	3
20057	99	85	70,8	cyclictest	238910	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:35:50	3
20043	99	85	1,73	cyclictest	0	-21	swapper/0	20:25:29	0
20057	99	84	70,7	cyclictest	34010	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:03:25	3
20057	99	84	70,7	cyclictest	330534	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:34:56	3
20057	99	84	68,8	cyclictest	131494	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:21:08	3
20043	99	84	19,27	cyclictest	0	-21	swapper/0	22:15:31	0
20043	99	84	1,66	cyclictest	0	-21	swapper/0	21:58:29	0
20043	99	84	1,66	cyclictest	0	-21	swapper/0	21:58:28	0
20057	99	83	70,6	cyclictest	339075	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:37:15	3
20057	99	83	70,6	cyclictest	190939	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:01:11	3
20043	99	83	74,6	cyclictest	34010	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:19:57	0
20043	99	83	74,6	cyclictest	34010	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:19:56	0
20043	99	83	2,77	cyclictest	0	-21	swapper/0	19:15:19	0
20043	99	83	2,72	cyclictest	0	-21	swapper/0	20:30:03	0
20043	99	83	1,74	cyclictest	0	-21	swapper/0	21:08:34	0
20043	99	83	1,67	cyclictest	0	-21	swapper/0	20:20:19	0
20043	99	83	1,67	cyclictest	0	-21	swapper/0	20:20:19	0
20043	99	83	1,65	cyclictest	0	-21	swapper/0	19:40:13	0
20043	99	83	1,57	cyclictest	0	-21	swapper/0	20:40:27	0
20043	99	83	0,68	cyclictest	102783	-21	rm	21:36:38	0
135458	2	83	0,5	sleep5	0	-21	swapper/5	22:01:22	5
20057	99	82	70,6	cyclictest	60933	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:05:47	3
20057	99	82	67,8	cyclictest	261862	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:10:52	3
20057	99	82	65,9	cyclictest	222518	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:10:33	3
20057	99	82	65,9	cyclictest	222518	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:10:32	3
20043	99	82	55,13	cyclictest	0	-21	swapper/0	20:08:53	0
20043	99	82	55,13	cyclictest	0	-21	swapper/0	20:08:53	0
20043	99	82	53,18	cyclictest	0	-21	swapper/0	23:19:07	0
20043	99	82	53,18	cyclictest	0	-21	swapper/0	23:19:06	0
20043	99	82	17,32	cyclictest	0	-21	swapper/0	21:30:14	0
20043	99	82	1,57	cyclictest	68647	-21	diskmemload	22:00:30	0
20043	99	82	0,67	cyclictest	121459	-21	timerwakeupswit	21:50:42	0
20043	99	82	0,65	cyclictest	270224	-21	latency_hist	23:45:02	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17