OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sat Sep 19, 2026 00:46:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3117706	2	1670	1641,19	sleep5	0	-21	swapper/5	19:05:22	5
3117513	2	1236	1213,8	sleep2	3111078	-21	kworker/2:2+events@ dbs_work_handler	19:05:19	2
3119013	99	174	104,48	cyclictest	3306958	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:11:38	0
3119024	99	119	104,8	cyclictest	3130861	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:41:17	3
3119024	99	119	104,8	cyclictest	3130861	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:41:16	3
3297585	2	113	0,7	sleep4	3170769	-21	diskmemload-4	22:55:22	4
3363856	2	106	0,5	sleep4	3363854	-21	ssh	23:48:53	4
3135686	2	105	0,5	sleep0	0	-21	swapper/0	19:50:17	0
3119024	99	105	91,7	cyclictest	3126667	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	19:56:18	3
3119024	99	105	91,7	cyclictest	3126667	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	19:56:18	3
3119024	99	105	90,8	cyclictest	3176890	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:26:28	3
3119013	99	102	70,13	cyclictest	3335603	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:31:40	0
3119036	99	99	94,2	cyclictest	0	-21	swapper/5	23:31:39	5
3119024	99	98	86,6	cyclictest	3343084	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:58:09	3
3119024	99	98	84,7	cyclictest	3281259	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:01:39	3
3316517	2	97	0,3	sleep5	0	-21	swapper/5	23:10:31	5
3119013	99	92	1,79	cyclictest	68	-21	kcompactd0	23:45:58	0
3119024	99	90	77,6	cyclictest	3306958	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:21:38	3
3119013	99	90	80,6	cyclictest	3388726	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:38:38	0
3119013	99	88	53,21	cyclictest	3319812	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:25:09	0
3119036	99	87	81,3	cyclictest	0	-21	swapper/5	00:08:21	5
3119036	99	87	81,3	cyclictest	0	-21	swapper/5	00:08:20	5
3119020	99	86	73,6	cyclictest	3388726	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:38:36	2
3119013	99	85	62,14	cyclictest	674	50	irq/528-eth0-Tx	22:58:01	0
3119030	99	84	71,7	cyclictest	3228039	-21	ssh	22:00:01	4
3119030	99	84	71,7	cyclictest	3228039	-21	ssh	22:00:01	4
3119013	99	84	55,16	cyclictest	0	-21	swapper/0	21:05:37	0
3119013	99	84	1,68	cyclictest	3167395	-21	diskmemload	22:45:14	0
3119013	99	84	1,68	cyclictest	3167395	-21	diskmemload	22:45:13	0
3119036	99	83	78,1	cyclictest	0	-21	swapper/5	20:30:19	5
3119036	99	83	78,1	cyclictest	0	-21	swapper/5	20:30:19	5
3119036	99	83	77,3	cyclictest	0	-21	swapper/5	22:10:14	5
3119036	99	82	75,3	cyclictest	0	-21	swapper/5	22:05:29	5
3119036	99	82	74,4	cyclictest	0	-21	swapper/5	21:36:35	5
3119024	99	82	69,6	cyclictest	3219504	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:36:37	3
3119013	99	82	44,31	cyclictest	3133527	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:59:27	0
3119013	99	82	44,31	cyclictest	3133527	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	19:59:26	0
3119013	99	82	1,70	cyclictest	631	-21	jbd2/mmcblk1p3-	21:37:29	0
3119013	99	81	66,7	cyclictest	3144973	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:30:11	0
3119013	99	81	66,7	cyclictest	3144973	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:30:11	0
3119013	99	79	59,16	cyclictest	3319812	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:17:04	0
3119013	99	79	45,18	cyclictest	3377032	-21	ssh	23:59:50	0
3119013	99	79	2,6	cyclictest	3129374	-21	find	19:35:13	0
3119013	99	79	1,5	cyclictest	3147547	-21	apt-get	20:20:13	0
3119013	99	78	62,4	cyclictest	674	50	irq/528-eth0-Tx	22:10:38	0
3119013	99	78	39,32	cyclictest	3140906	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:05:09	0
3119013	99	78	2,3	cyclictest	0	-21	swapper/0	22:06:49	0
3119013	99	78	1,63	cyclictest	0	-21	swapper/0	00:11:53	0
3119013	99	78	1,63	cyclictest	0	-21	swapper/0	00:11:52	0
3119036	99	77	70,4	cyclictest	0	-21	swapper/5	19:35:43	5
3119036	99	77	70,3	cyclictest	0	-21	swapper/5	23:45:18	5
3119030	99	77	63,8	cyclictest	3322905	-21	ssh	23:15:32	4
3119030	99	77	62,9	cyclictest	3318201	-21	ssh	23:11:39	4
3119024	99	77	67,4	cyclictest	3144973	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	20:36:22	3
3179354	2	76	0,5	chrt	0	-21	swapper/3	21:20:25	3
3119036	99	76	68,4	cyclictest	0	-21	swapper/5	22:54:34	5
3119030	99	76	62,7	cyclictest	3415934	-21	ssh	00:30:45	4
3119024	99	76	62,7	cyclictest	3170055	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:45:13	3
3119024	99	76	62,7	cyclictest	3170055	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:45:13	3
3119024	99	76	58,6	cyclictest	3219504	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:51:37	3
3119013	99	76	61,4	cyclictest	0	-21	swapper/0	00:05:31	0
3119013	99	76	61,4	cyclictest	0	-21	swapper/0	00:05:30	0
3119013	99	76	1,57	cyclictest	3281791	-21	taskset	22:42:35	0
3119013	99	76	1,57	cyclictest	3281791	-21	taskset	22:42:35	0
3119030	99	75	69,3	cyclictest	0	-21	swapper/4	20:37:05	4
3119030	99	75	64,6	cyclictest	3170769	-21	diskmemload-4	00:23:31	4
3119030	99	75	56,13	cyclictest	3170769	-21	diskmemload-4	23:41:42	4
3119013	99	75	61,6	cyclictest	3163102	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:04:08	0
3119013	99	75	59,4	cyclictest	673	50	irq/527-eth0-Tx	21:32:13	0
3119013	99	75	1,57	cyclictest	3209849	-21	ssh	21:45:17	0
3119013	99	75	1,57	cyclictest	3209849	-21	ssh	21:45:17	0
3119036	99	74	68,2	cyclictest	0	-21	swapper/5	00:33:33	5
3119036	99	74	67,3	cyclictest	0	-21	swapper/5	21:51:17	5
3119036	99	74	67,3	cyclictest	0	-21	swapper/5	19:55:31	5
3119036	99	74	67,3	cyclictest	0	-21	swapper/5	19:55:30	5
3119030	99	74	59,8	cyclictest	3170769	-21	diskmemload-4	22:24:43	4
3119013	99	74	2,5	cyclictest	3266629	-21	/usr/sbin/munin	22:30:29	0
3119013	99	74	1,70	cyclictest	0	-21	swapper/0	00:30:29	0
3119013	99	74	1,59	cyclictest	0	-21	swapper/0	19:15:37	0
3119030	99	73	68,2	cyclictest	0	-21	swapper/4	00:05:53	4
3119030	99	73	68,2	cyclictest	0	-21	swapper/4	00:05:53	4
3119030	99	73	59,8	cyclictest	3170769	-21	diskmemload-4	22:40:33	4
3119030	99	73	59,8	cyclictest	3170769	-21	diskmemload-4	22:40:33	4
3119024	99	73	60,6	cyclictest	3219504	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:21:34	3
3119013	99	73	51,5	cyclictest	673	50	irq/527-eth0-Tx	20:45:15	0
3119013	99	73	51,5	cyclictest	673	50	irq/527-eth0-Tx	20:45:15	0
3119013	99	73	1,63	cyclictest	0	-21	swapper/0	21:10:49	0
3119013	99	73	1,5	cyclictest	3125319	-21	apt-get	19:25:13	0
3119013	99	73	1,3	cyclictest	0	-21	swapper/0	20:25:35	0
3119036	99	72	66,3	cyclictest	0	-21	swapper/5	21:14:45	5
3119036	99	72	65,3	cyclictest	0	-21	swapper/5	22:30:39	5
3119030	99	72	58,7	cyclictest	3170769	-21	diskmemload-4	21:26:23	4
3119024	99	72	60,6	cyclictest	3300679	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:16:40	3
3119013	99	72	1,5	cyclictest	3291841	-21	ssh	22:50:30	0
3119030	99	71	51,14	cyclictest	3288559	-21	ssh	22:48:04	4
3119030	99	71	51,14	cyclictest	3288559	-21	ssh	22:48:03	4
3119024	99	71	58,6	cyclictest	3170055	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:31:27	3
3119018	99	71	58,6	cyclictest	3251677	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:26:34	1
3119013	99	71	1,5	cyclictest	3204468	-21	ntpq	21:40:29	0
3119013	99	71	1,5	cyclictest	3204468	-21	ntpq	21:40:29	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17