OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat Apr 25, 2026 00:46:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2661289	2	1182	1156,17	sleep4	0	-21	swapper/4	19:05:40	4
2661289	2	1182	1156,17	sleep4	0	-21	swapper/4	19:05:39	4
2662039	99	158	50,84	cyclictest	2751351	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:48:25	0
2662039	99	154	29,87	cyclictest	2636358	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	19:25:41	0
2662039	99	136	39,79	cyclictest	2748662	-21	/usr/sbin/munin	21:40:23	0
2662039	99	136	22,83	cyclictest	2780902	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:18:57	0
2662039	99	136	22,83	cyclictest	2780902	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:18:57	0
2662039	99	129	39,73	cyclictest	2861660	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:50:29	0
2662039	99	129	26,58	cyclictest	2886008	-21	missed_timers	23:25:26	0
2662039	99	127	1,108	cyclictest	0	-21	swapper/0	19:35:32	0
2662039	99	126	21,58	cyclictest	2960508	-21	systemd-userwor	00:22:49	0
2662039	99	124	20,76	cyclictest	2912292	-21	ld	23:45:33	0
2662039	99	123	80,33	cyclictest	689	50	irq/527-eth0-Tx	23:05:45	0
2662039	99	123	74,41	cyclictest	2729014	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:30:27	0
2662039	99	123	1,112	cyclictest	2879383	-21	kernelversion	23:20:25	0
2662039	99	123	1,107	cyclictest	0	-21	swapper/0	20:50:39	0
2662039	99	123	1,107	cyclictest	0	-21	swapper/0	20:50:39	0
2662044	99	122	109,6	cyclictest	2758514	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:12:16	1
2662039	99	122	2,100	cyclictest	0	-21	swapper/0	21:20:45	0
2662039	99	121	21,53	cyclictest	0	-21	swapper/0	22:45:01	0
2662039	99	120	19,55	cyclictest	0	-21	swapper/0	22:20:27	0
2662039	99	120	19,55	cyclictest	0	-21	swapper/0	22:20:27	0
2662039	99	119	45,29	cyclictest	48	-21	rcuop/4	22:53:19	0
2662039	99	119	1,105	cyclictest	0	-21	swapper/0	20:31:21	0
2662059	99	117	111,3	cyclictest	0	-21	swapper/4	23:12:22	4
2662039	99	117	73,29	cyclictest	689	50	irq/527-eth0-Tx	22:07:36	0
2662039	99	117	61,46	cyclictest	690	50	irq/528-eth0-Tx	19:20:02	0
2662039	99	117	61,46	cyclictest	690	50	irq/528-eth0-Tx	19:20:02	0
2662039	99	117	1,99	cyclictest	0	-21	swapper/0	00:30:36	0
2662039	99	116	69,38	cyclictest	690	50	irq/528-eth0-Tx	23:10:19	0
2662039	99	116	25,58	cyclictest	2670464	-21	aten2_r3power_c	19:30:15	0
2662039	99	116	1,78	cyclictest	0	-21	swapper/0	22:59:35	0
2662039	99	116	1,73	cyclictest	0	-21	swapper/0	23:34:11	0
2662039	99	115	1,98	cyclictest	0	-21	swapper/0	19:45:21	0
2662039	99	114	68,36	cyclictest	689	50	irq/527-eth0-Tx	21:25:13	0
2662039	99	114	66,36	cyclictest	690	50	irq/528-eth0-Tx	22:45:23	0
2662039	99	114	66,32	cyclictest	2710385	-21	diskmemload	23:44:29	0
2662039	99	114	2,97	cyclictest	0	-21	swapper/0	21:18:52	0
2662039	99	114	21,59	cyclictest	2807869	-21	missed_timers	22:25:26	0
2662039	99	114	21,59	cyclictest	2807869	-21	missed_timers	22:25:26	0
2662039	99	114	1,99	cyclictest	0	-21	swapper/0	20:20:41	0
2662044	99	113	99,7	cyclictest	2861660	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	00:13:26	1
2662039	99	113	26,54	cyclictest	13301	-21	runrttasks	22:30:44	0
2662039	99	113	26,54	cyclictest	13301	-21	runrttasks	22:30:44	0
2662039	99	113	1,83	cyclictest	2696992	-21	/usr/sbin/munin	20:35:21	0
2662039	99	113	1,83	cyclictest	2696992	-21	/usr/sbin/munin	20:35:20	0
2662039	99	112	3,6	cyclictest	2931450	-21	memory	00:00:24	0
2662039	99	112	3,6	cyclictest	2931450	-21	memory	00:00:24	0
2662039	99	112	2,79	cyclictest	0	-21	swapper/0	20:25:18	0
2662039	99	112	2,79	cyclictest	0	-21	swapper/0	00:15:13	0
2662039	99	112	1,81	cyclictest	2713813	-21	ssh	21:13:59	0
2662039	99	112	1,79	cyclictest	0	-21	swapper/0	22:14:13	0
2662039	99	111	53,25	cyclictest	2688709	-21	aten2.4-expect	20:15:18	0
2662039	99	111	2,79	cyclictest	0	-21	swapper/0	00:26:52	0
2662039	99	111	23,55	cyclictest	2775611	-21	mailstats	22:00:42	0
2662039	99	110	63,35	cyclictest	690	50	irq/528-eth0-Tx	00:06:54	0
2662039	99	110	2,75	cyclictest	0	-21	swapper/0	20:10:38	0
2662039	99	110	2,74	cyclictest	0	-21	swapper/0	21:35:05	0
2662039	99	110	1,98	cyclictest	0	-21	swapper/0	19:40:28	0
2662055	99	109	94,8	cyclictest	2669848	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:35:36	3
2662039	99	109	57,23	cyclictest	0	-21	swapper/0	19:53:22	0
2662039	99	109	2,73	cyclictest	2665632	-21	/usr/sbin/munin	19:15:42	0
2662039	99	109	1,56	cyclictest	0	-21	swapper/0	23:00:21	0
2662055	99	108	96,6	cyclictest	2729014	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	21:27:11	3
2662039	99	108	26,52	cyclictest	2925519	-21	/usr/sbin/munin	23:55:42	0
2662039	99	108	26,52	cyclictest	2925519	-21	/usr/sbin/munin	23:55:42	0
2662039	99	108	1,77	cyclictest	0	-21	swapper/0	20:05:25	0
2928492	2	107	0,4	sleep5	0	-21	swapper/5	23:58:16	5
2928492	2	107	0,4	sleep5	0	-21	swapper/5	23:58:16	5
2662044	99	107	94,6	cyclictest	2736432	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:37:12	1
2662039	99	107	44,24	cyclictest	0	-21	swapper/0	23:18:09	0
2662039	99	107	44,24	cyclictest	0	-21	swapper/0	23:18:09	0
2662039	99	107	1,77	cyclictest	0	-21	swapper/0	22:35:35	0
2662066	99	106	98,4	cyclictest	0	-21	swapper/5	22:17:18	5
2662066	99	106	98,4	cyclictest	0	-21	swapper/5	22:17:17	5
2662039	99	106	57,22	cyclictest	689	50	irq/527-eth0-Tx	21:00:41	0
2662039	99	106	47,27	cyclictest	2765061	-21	ssh	21:52:51	0
2662039	99	105	59,21	cyclictest	0	-21	swapper/0	20:45:38	0
2662055	99	104	89,9	cyclictest	2877041	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:25:34	3
2662039	99	104	1,4	cyclictest	2771129	-21	ssh	21:57:22	0
2662044	99	103	89,8	cyclictest	2861660	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:40:14	1
2662039	99	103	2,6	cyclictest	2681275	-21	ntp_offset	19:55:33	0
2662039	99	103	2,6	cyclictest	2681275	-21	ntp_offset	19:55:32	0
2662039	99	103	2,5	cyclictest	2684327	-21	sed	20:05:00	0
2662039	99	103	20,54	cyclictest	0	-21	swapper/0	00:35:42	0
2662039	99	103	14,61	cyclictest	0	-21	swapper/0	19:10:41	0
2662044	99	102	87,7	cyclictest	2672063	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:46:45	1
2662066	99	100	93,3	cyclictest	0	-21	swapper/5	23:34:27	5
2662055	99	100	86,7	cyclictest	2843033	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:02:20	3
2662039	99	99	52,22	cyclictest	689	50	irq/527-eth0-Tx	00:14:34	0
2662039	99	99	19,51	cyclictest	0	-21	swapper/0	23:35:41	0
2662039	99	99	1,3	cyclictest	0	-21	swapper/0	21:05:36	0
2662044	99	98	85,6	cyclictest	2920662	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:03:34	1
2662044	99	98	85,6	cyclictest	2920662	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:03:34	1
2662066	99	97	89,4	cyclictest	0	-21	swapper/5	23:52:09	5
2662039	99	97	16,62	cyclictest	0	-21	swapper/0	20:40:33	0
2662039	99	97	1,60	cyclictest	0	-21	swapper/0	20:55:22	0
2662066	99	96	89,4	cyclictest	0	-21	swapper/5	19:35:18	5
2662059	99	95	80,9	cyclictest	2882194	-21	rm	23:22:24	4
2662050	99	95	22,20	cyclictest	2920662	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:00:34	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17