OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Wed Jun 17, 2026 00:46:19)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
774388	99	128	67,49	cyclictest	673	50	irq/527-eth0-Tx	21:10:35	0
1085992	2	102	0,3	sleep5	0	-21	swapper/5	00:25:37	5
774388	99	99	58,18	cyclictest	673	50	irq/527-eth0-Tx	21:25:12	0
825588	2	98	0,4	sleep5	0	-21	swapper/5	21:12:01	5
774388	99	97	2,64	cyclictest	0	-21	swapper/0	19:15:01	0
774388	99	96	49,19	cyclictest	1019435	-21	ps	23:35:39	0
774388	99	95	2,61	cyclictest	0	-21	swapper/0	20:35:43	0
774388	99	93	60,17	cyclictest	792284	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	20:11:10	0
774388	99	93	55,15	cyclictest	674	50	irq/528-eth0-Tx	20:55:21	0
774388	99	92	55,16	cyclictest	0	-21	swapper/0	20:50:15	0
774388	99	91	1,76	cyclictest	0	-21	swapper/0	21:39:04	0
774388	99	90	51,4	cyclictest	673	50	irq/527-eth0-Tx	22:15:32	0
774388	99	88	41,4	cyclictest	676	50	irq/530-eth0-Tx	22:45:13	0
774388	99	82	26,26	cyclictest	673	50	irq/527-eth0-Tx	22:50:22	0
774388	99	81	64,4	cyclictest	0	-21	swapper/0	23:56:13	0
774388	99	81	1,66	cyclictest	0	-21	swapper/0	19:52:13	0
774388	99	81	1,66	cyclictest	0	-21	swapper/0	19:52:13	0
774388	99	80	2,65	cyclictest	0	-21	swapper/0	21:20:01	0
774398	99	79	65,7	cyclictest	984948	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:11:48	2
774388	99	79	11,52	cyclictest	13	-21	ksoftirqd/0	00:15:21	0
774388	99	79	11,52	cyclictest	13	-21	ksoftirqd/0	00:15:21	0
774388	99	76	51,14	cyclictest	673	50	irq/527-eth0-Tx	23:15:37	0
774407	99	75	70,2	cyclictest	0	-21	swapper/4	19:56:07	4
774388	99	75	42,17	cyclictest	673	50	irq/527-eth0-Tx	23:25:33	0
774388	99	74	65,4	cyclictest	0	-21	swapper/0	22:05:45	0
774388	99	74	44,21	cyclictest	673	50	irq/527-eth0-Tx	00:20:23	0
774388	99	74	39,4	cyclictest	0	-21	swapper/0	19:25:13	0
774388	99	74	2,5	cyclictest	855135	-21	latency_hist	21:35:00	0
774388	99	74	2,55	cyclictest	15	-21	rcuc/0	22:35:43	0
774407	99	73	68,2	cyclictest	0	-21	swapper/4	19:25:15	4
774402	99	73	62,5	cyclictest	948746	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:01:46	3
774388	99	73	51,8	cyclictest	1018204	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:45:35	0
774402	99	72	58,7	cyclictest	1040457	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:12:03	3
774388	99	72	60,8	cyclictest	802471	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:21:13	0
774388	99	72	60,8	cyclictest	802471	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:21:13	0
774388	99	72	33,3	cyclictest	0	-21	swapper/0	22:04:41	0
774388	99	72	33,3	cyclictest	0	-21	swapper/0	22:04:40	0
774388	99	72	2,53	cyclictest	1064790	-21	acpi	00:10:10	0
774402	99	71	57,7	cyclictest	878850	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:55:46	3
774407	99	69	63,3	cyclictest	0	-21	swapper/4	21:13:12	4
774398	99	69	55,7	cyclictest	1002548	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:26:51	2
774398	99	69	53,8	cyclictest	778167	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	19:21:00	2
774388	99	69	44,14	cyclictest	0	-21	swapper/0	20:25:15	0
774388	99	69	33,18	cyclictest	0	-21	swapper/0	00:03:31	0
774388	99	69	31,16	cyclictest	676	50	irq/530-eth0-Tx	00:32:21	0
774388	99	69	26,17	cyclictest	13	-21	ksoftirqd/0	22:35:02	0
774388	99	69	1,25	cyclictest	0	-21	swapper/0	00:05:23	0
774407	99	68	62,3	cyclictest	0	-21	swapper/4	19:36:27	4
774407	99	68	62,3	cyclictest	0	-21	swapper/4	19:36:27	4
774402	99	68	54,7	cyclictest	822643	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:26:26	3
774388	99	68	49,4	cyclictest	676	50	irq/530-eth0-Tx	22:10:06	0
774388	99	68	49,3	cyclictest	0	-21	swapper/0	19:23:05	0
774388	99	68	31,4	cyclictest	674	50	irq/528-eth0-Tx	21:45:33	0
774388	99	68	24,17	cyclictest	673	50	irq/527-eth0-Tx	23:15:02	0
774388	99	68	2,40	cyclictest	1098162	-21	/usr/sbin/munin	00:35:43	0
774388	99	67	38,25	cyclictest	15	-21	rcuc/0	23:20:19	0
774388	99	67	31,16	cyclictest	908335	-21	kworker/u12:0+flush-179:96@ wb_workfn	23:00:40	0
774407	99	66	60,3	cyclictest	0	-21	swapper/4	22:54:20	4
774407	99	66	60,3	cyclictest	0	-21	swapper/4	00:01:32	4
774388	99	66	33,19	cyclictest	0	-21	swapper/0	20:30:25	0
774388	99	66	33,19	cyclictest	0	-21	swapper/0	20:30:25	0
774388	99	66	24,15	cyclictest	880569	-21	ssh	21:53:08	0
884847	2	65	0,5	sleep4	0	-21	swapper/4	21:55:43	4
774388	99	65	49,4	cyclictest	0	-21	swapper/0	23:30:13	0
774388	99	65	47,4	cyclictest	0	-21	swapper/0	22:55:35	0
774388	99	65	47,4	cyclictest	0	-21	swapper/0	22:55:35	0
774388	99	65	44,4	cyclictest	673	50	irq/527-eth0-Tx	19:35:00	0
774388	99	65	44,4	cyclictest	673	50	irq/527-eth0-Tx	19:35:00	0
774388	99	65	36,6	cyclictest	788040	-21	cat	19:40:41	0
1032320	2	65	0,13	chrt	37	-21	ksoftirqd/3	23:45:25	3
774407	99	64	59,2	cyclictest	0	-21	swapper/4	23:30:29	4
774407	99	64	58,3	cyclictest	0	-21	swapper/4	20:40:43	4
774407	99	64	58,3	cyclictest	0	-21	swapper/4	19:32:27	4
774407	99	64	58,3	cyclictest	0	-21	swapper/4	19:32:27	4
774402	99	64	51,6	cyclictest	941549	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:10:47	3
774388	99	64	2,6	cyclictest	48	-21	rcuop/4	23:40:17	0
774388	99	64	2,6	cyclictest	48	-21	rcuop/4	23:40:16	0
774388	99	64	2,20	cyclictest	674	50	irq/528-eth0-Tx	22:23:15	0
774388	99	64	1,3	cyclictest	0	-21	swapper/0	21:05:27	0
774388	99	63	47,3	cyclictest	0	-21	swapper/0	21:44:57	0
774388	99	63	47,3	cyclictest	0	-21	swapper/0	21:44:56	0
774388	99	63	2,38	cyclictest	978292	-21	/usr/sbin/munin	23:05:23	0
774414	99	62	56,3	cyclictest	0	-21	swapper/5	21:44:48	5
774414	99	62	56,3	cyclictest	0	-21	swapper/5	21:44:48	5
774402	99	62	49,6	cyclictest	974676	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:16:50	3
774398	99	62	49,6	cyclictest	941549	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:46:55	2
774388	99	62	29,4	cyclictest	675	50	irq/529-eth0-Tx	22:25:37	0
774388	99	62	24,17	cyclictest	673	50	irq/527-eth0-Tx	21:57:40	0
774407	99	61	53,3	cyclictest	0	-21	swapper/4	20:31:05	4
774407	99	61	53,3	cyclictest	0	-21	swapper/4	20:31:05	4
774402	99	61	29,8	cyclictest	908335	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	23:05:40	3
774388	99	61	33,16	cyclictest	673	50	irq/527-eth0-Tx	20:05:45	0
774388	99	61	33,16	cyclictest	673	50	irq/527-eth0-Tx	20:05:45	0
774414	99	60	54,3	cyclictest	0	-21	swapper/5	22:50:38	5
774402	99	60	47,7	cyclictest	802471	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:20:27	3
774402	99	60	47,7	cyclictest	802471	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	20:20:27	3
774402	99	60	37,9	cyclictest	1040457	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	00:03:24	3
774402	99	60	35,9	cyclictest	919850	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:37:41	3
774388	99	60	48,4	cyclictest	673	50	irq/527-eth0-Tx	21:20:26	0
774388	99	60	34,4	cyclictest	673	50	irq/527-eth0-Tx	22:40:39	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17