OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 50 highest latencies:

System rack0slot2.osadl.org (updated Tue Jul 01, 2025 00:43:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3271388	2	88	0,1	sleep7	3271386	-21	cut	04:28:31	7
3147413	2	56	22,30	sleep7	0	-21	swapper/7	03:29:26	7
3139018	2	36	25,7	sleep6	0	-21	swapper/6	03:28:29	6
3147450	2	32	22,7	sleep5	0	-21	swapper/5	03:29:56	5
3148003	99	31	29,2	cyclictest	3204131	-21	kworker/u16:3+flush-8:0	04:28:11	5
3147667	2	31	20,8	sleep4	0	-21	swapper/4	03:33:00	4
3148010	99	29	0,27	cyclictest	3482173	-21	latency_hist	06:13:11	7
3148010	99	29	0,27	cyclictest	3420353	-21	latency_hist	05:43:11	7
3148010	99	27	0,25	cyclictest	3158213	-21	latency_hist	03:38:12	7
3708979	2	26	0,0	sleep5	0	-21	swapper/5	08:03:10	5
3148010	99	25	0,23	cyclictest	3317095	-21	cat	04:53:11	7
3148003	99	25	23,2	cyclictest	3157046	-21	kworker/u16:1+flush-8:0	03:48:26	5
3148003	99	24	22,2	cyclictest	3378863	-21	kworker/u16:1+flush-8:0	05:53:38	5
3148003	99	24	22,2	cyclictest	3157046	-21	kworker/u16:1+flush-8:0	03:53:27	5
3148003	99	24	21,3	cyclictest	3595527	-21	kworker/u16:0+flush-8:0	07:23:40	5
3147999	99	24	22,2	cyclictest	3378863	-21	kworker/u16:1+events_unbound	05:39:00	4
3147999	99	24	22,2	cyclictest	3306321	-21	kworker/u16:2+events_unbound	04:46:34	4
3147999	99	24	13,10	cyclictest	0	-21	swapper/4	05:43:38	4
3148010	99	23	0,21	cyclictest	3823538	-21	latency_hist	09:03:10	7
3148003	99	22	20,2	cyclictest	3616305	-21	kworker/u16:1+flush-8:0	07:18:41	5
3148008	99	20	13,2	cyclictest	3483733	-21	/usr/sbin/munin	06:13:29	6
3148003	99	20	18,2	cyclictest	3440614	-21	kworker/u16:0+flush-8:0	06:53:26	5
3148003	99	20	18,2	cyclictest	3440614	-21	kworker/u16:0+events_unbound	06:48:33	5
3148003	99	20	18,2	cyclictest	3358032	-21	kworker/u16:2+events_unbound	05:23:42	5
3148003	99	20	18,2	cyclictest	3306321	-21	kworker/u16:2+events_unbound	04:45:59	5
3148003	99	20	17,2	cyclictest	3378863	-21	kworker/u16:1+events_unbound	06:03:30	5
3148010	99	19	0,17	cyclictest	1313	-21	snmpd	06:47:07	7
3148008	99	19	17,2	cyclictest	3595527	-21	kworker/u16:0+flush-8:0	07:23:36	6
3148003	99	19	17,2	cyclictest	3358032	-21	kworker/u16:2+flush-8:0	05:58:39	5
3148003	99	19	17,2	cyclictest	3358032	-21	kworker/u16:2+flush-8:0	05:48:06	5
3147999	99	19	17,2	cyclictest	3766084	-21	kworker/u16:4+events_unbound	08:43:06	4
3147999	99	19	17,2	cyclictest	3440614	-21	kworker/u16:0+events_unbound	06:34:13	4
3147999	99	19	17,2	cyclictest	3440614	-21	kworker/u16:0+events_unbound	06:34:13	4
3147999	99	19	17,2	cyclictest	3234148	-21	kworker/u16:1+events_unbound	04:48:29	4
3148010	99	18	0,17	cyclictest	643	-21	systemd-journal	03:58:12	7
3148008	99	18	13,4	cyclictest	3233445	-21	ntpq	04:08:37	6
3148003	99	18	16,2	cyclictest	3616305	-21	kworker/u16:1+flush-8:0	08:13:28	5
3148003	99	18	16,2	cyclictest	3616305	-21	kworker/u16:1+events_unbound	07:33:06	5
3552563	2	17	0,1	sleep4	0	-21	swapper/4	06:43:37	4
3224051	2	17	0,0	sleep6	0	-21	swapper/6	04:08:11	6
3148010	99	17	15,1	cyclictest	3440947	-21	awk	05:53:11	7
3148010	99	17	15,1	cyclictest	3440947	-21	awk	05:53:11	7
3148010	99	17	0,16	cyclictest	1313	-21	snmpd	06:07:09	7
3148010	99	17	0,15	cyclictest	3502823	-21	latency_hist	06:23:11	7
3148010	99	17	0,15	cyclictest	1313	-21	snmpd	07:51:30	7
3148008	99	17	0,1	cyclictest	0	-21	swapper/6	03:33:37	6
3148003	99	17	16,1	cyclictest	3204131	-21	kworker/u16:3+events_unbound	04:13:11	5
3148003	99	17	15,2	cyclictest	3708653	-21	kworker/u16:2+flush-8:0	08:08:05	5
3148003	99	17	15,2	cyclictest	3440614	-21	kworker/u16:0+flush-8:0	06:38:39	5
3148003	99	17	0,4	cyclictest	3250032	-21	cut	04:18:32	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17