OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #3, slot #4

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance

Characteristics of the 100 highest latencies:

System rack3slot4.osadl.org (updated Sun Jul 13, 2025 00:46:55)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2178486	2	3177	3159,9	sleep2	2176512	-21	kworker/2:3+events@ dbs_work_handler	19:07:42	2
2178355	2	208	184,15	sleep4	0	-21	swapper/4	19:05:55	4
2178834	99	140	134,3	cyclictest	0	-21	swapper/4	21:13:16	4
2310551	2	119	0,4	sleep4	0	-21	swapper/4	22:25:17	4
2310551	2	119	0,4	sleep4	0	-21	swapper/4	22:25:16	4
2178834	99	111	105,3	cyclictest	0	-21	swapper/4	19:22:56	4
2178834	99	111	105,3	cyclictest	0	-21	swapper/4	19:22:55	4
2178830	99	111	99,6	cyclictest	2295832	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	22:13:26	3
2178830	99	110	96,7	cyclictest	2396558	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:48:39	3
2178815	99	107	50,28	cyclictest	2278242	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:23:27	0
2178815	99	107	50,28	cyclictest	2278242	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	22:23:26	0
2178815	99	107	16,60	cyclictest	2222235	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	21:08:14	0
2178815	99	106	1,62	cyclictest	0	-21	swapper/0	19:45:43	0
2178830	99	101	86,8	cyclictest	2284380	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	22:18:27	3
2178815	99	101	2,65	cyclictest	0	-21	swapper/0	21:11:52	0
2178824	99	100	86,7	cyclictest	2263722	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:03:25	2
2178824	99	99	87,6	cyclictest	2396558	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	00:33:47	2
2178815	99	99	53,26	cyclictest	15	-21	rcuc/0	21:55:42	0
2178815	99	99	1,61	cyclictest	2288831	-21	ssh	22:05:33	0
2178815	99	98	2,82	cyclictest	2400152	-21	ps	23:40:39	0
2178815	99	98	17,15	cyclictest	642	50	irq/527-eth0-Tx	00:21:36	0
2178815	99	98	17,15	cyclictest	642	50	irq/527-eth0-Tx	00:21:36	0
2178815	99	96	11,7	cyclictest	2330684	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:51:59	0
2178815	99	96	11,7	cyclictest	2330684	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:51:59	0
2178824	99	95	81,7	cyclictest	2229723	-21	kworker/u12:0+events_unbound@ flush_memcg_stats_dwork	21:43:20	2
2178815	99	93	67,19	cyclictest	2330684	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	23:33:38	0
2178815	99	93	1,3	cyclictest	0	-21	swapper/0	20:25:21	0
2178815	99	91	18,15	cyclictest	2293844	-21	df_abs	22:10:23	0
2178815	99	91	1,30	cyclictest	0	-21	swapper/0	21:15:38	0
2178830	99	90	76,7	cyclictest	2330684	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:48:32	3
2178830	99	90	76,7	cyclictest	2330684	-21	kworker/u12:1+events_unbound@ flush_memcg_stats_dwork	22:48:32	3
2178815	99	90	25,33	cyclictest	642	50	irq/527-eth0-Tx	22:50:42	0
2178815	99	90	25,33	cyclictest	642	50	irq/527-eth0-Tx	22:50:41	0
2178830	99	89	75,7	cyclictest	2307506	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:03:34	3
2178830	99	89	75,7	cyclictest	2307506	-21	kworker/u12:2+events_unbound@ flush_memcg_stats_dwork	23:03:33	3
2178815	99	89	32,31	cyclictest	643	50	irq/528-eth0-Tx	23:06:24	0
2178815	99	89	16,18	cyclictest	645	50	irq/530-eth0-Tx	21:30:32	0
2178815	99	89	16,18	cyclictest	645	50	irq/530-eth0-Tx	21:30:32	0
2178815	99	88	55,23	cyclictest	0	-21	swapper/0	23:23:40	0
2178815	99	88	2,35	cyclictest	0	-21	swapper/0	21:42:08	0
2178815	99	87	68,16	cyclictest	2396558	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:58:39	0
2178815	99	87	5,62	cyclictest	2297477	-1	kworker/u13:2+xprtiod@ xs_stream_data_receive_workfn	22:15:39	0
2178815	99	87	2,67	cyclictest	645	50	irq/530-eth0-Tx	21:24:21	0
2178815	99	87	2,67	cyclictest	645	50	irq/530-eth0-Tx	21:24:21	0
2178815	99	87	1,63	cyclictest	2406075	-21	rt-features	23:45:44	0
2178815	99	87	1,3	cyclictest	0	-21	swapper/0	19:30:25	0
2178815	99	87	12,15	cyclictest	642	50	irq/527-eth0-Tx	22:00:53	0
2178815	99	86	2,4	cyclictest	2369499	-21	apt-get	23:15:18	0
2178815	99	86	18,48	cyclictest	645	50	irq/530-eth0-Tx	23:37:33	0
2178815	99	86	1,75	cyclictest	0	-21	swapper/0	19:53:06	0
2178815	99	86	1,75	cyclictest	0	-21	swapper/0	19:53:05	0
2178815	99	86	17,53	cyclictest	645	50	irq/530-eth0-Tx	23:00:14	0
2178815	99	86	17,53	cyclictest	645	50	irq/530-eth0-Tx	23:00:14	0
2178815	99	86	1,3	cyclictest	0	-21	swapper/0	19:22:37	0
2178815	99	86	1,3	cyclictest	0	-21	swapper/0	19:22:37	0
2178815	99	85	1,74	cyclictest	0	-21	swapper/0	20:19:13	0
2178830	99	84	71,6	cyclictest	2396558	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:53:38	3
2178830	99	84	71,6	cyclictest	2396558	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	23:53:37	3
2178815	99	84	28,33	cyclictest	645	50	irq/530-eth0-Tx	22:35:47	0
2178815	99	84	28,33	cyclictest	645	50	irq/530-eth0-Tx	22:35:46	0
2178815	99	84	2,60	cyclictest	2382666	-21	rm	23:25:35	0
2178815	99	84	23,12	cyclictest	0	-21	swapper/0	22:34:04	0
2178815	99	84	23,12	cyclictest	0	-21	swapper/0	22:34:03	0
2178815	99	84	1,62	cyclictest	0	-21	swapper/0	00:06:07	0
2178815	99	84	1,62	cyclictest	0	-21	swapper/0	00:06:07	0
2178815	99	83	6,5	cyclictest	642	50	irq/527-eth0-Tx	21:50:28	0
2178815	99	83	24,40	cyclictest	2346537	-21	rm	22:55:38	0
2178815	99	83	21,12	cyclictest	0	-21	swapper/0	00:10:43	0
2178815	99	83	17,14	cyclictest	2258546	-21	ssh	21:39:36	0
2178815	99	83	13,17	cyclictest	643	50	irq/528-eth0-Tx	00:25:21	0
2178815	99	83	13,17	cyclictest	643	50	irq/528-eth0-Tx	00:25:21	0
2178834	99	82	76,3	cyclictest	0	-21	swapper/4	00:08:42	4
2178834	99	82	76,3	cyclictest	0	-21	swapper/4	00:08:42	4
2178815	99	82	2,6	cyclictest	2212268	-21	sendmail-mta	20:33:58	0
2178815	99	82	2,6	cyclictest	2212268	-21	sendmail-mta	20:33:57	0
2178815	99	82	2,4	cyclictest	2226528	-21	diskmemload	00:35:32	0
2178815	99	82	16,13	cyclictest	0	-21	swapper/0	21:49:10	0
2178815	99	81	1,3	cyclictest	0	-21	swapper/0	20:14:03	0
2178824	99	80	65,7	cyclictest	2436229	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	00:28:46	2
2178824	99	80	65,7	cyclictest	2436229	-21	kworker/u12:4+events_unbound@ flush_memcg_stats_dwork	00:28:46	2
2178815	99	80	2,27	cyclictest	2238985	-21	kworker/u12:2+rpciod@ rpc_async_schedule	21:28:46	0
2178815	99	80	19,14	cyclictest	642	50	irq/527-eth0-Tx	00:15:15	0
2178815	99	80	16,14	cyclictest	0	-21	swapper/0	22:45:01	0
2178815	99	80	16,14	cyclictest	0	-21	swapper/0	22:45:01	0
2178834	99	79	73,3	cyclictest	0	-21	swapper/4	21:48:21	4
2178815	99	79	2,59	cyclictest	2423090	-21	bingrep	00:00:28	0
2178815	99	79	2,59	cyclictest	2423090	-21	bingrep	00:00:27	0
2178834	99	78	70,4	cyclictest	0	-21	swapper/4	00:30:25	4
2178815	99	78	23,39	cyclictest	0	-21	swapper/0	22:45:23	0
2178815	99	78	23,39	cyclictest	0	-21	swapper/0	22:45:22	0
2178815	99	78	1,63	cyclictest	0	-21	swapper/0	20:21:14	0
2178815	99	78	1,63	cyclictest	0	-21	swapper/0	19:10:11	0
2178815	99	78	1,3	cyclictest	0	-21	swapper/0	20:47:34	0
2178834	99	77	64,8	cyclictest	2316431	-21	ssh	22:30:21	4
2178834	99	77	64,8	cyclictest	2316431	-21	ssh	22:30:20	4
2178820	99	77	65,6	cyclictest	2226388	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:33:20	1
2178820	99	77	65,6	cyclictest	2226388	-21	kworker/u12:3+events_unbound@ flush_memcg_stats_dwork	21:33:19	1
2178815	99	77	1,58	cyclictest	0	-21	swapper/0	23:10:24	0
2178815	99	77	1,3	cyclictest	0	-21	swapper/0	20:38:31	0
2178815	99	76	1,66	cyclictest	0	-21	swapper/0	20:40:53	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17