OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 50 highest latencies:

System rack0slot2.osadl.org (updated Sat Apr 25, 2026 00:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3287921	2	99	0,1	sleep4	0	-21	swapper/4	00:34:42	4
2972659	2	96	0,1	sleep4	0	-21	swapper/4	22:24:43	4
2548938	2	50	40,7	sleep4	0	-21	swapper/4	19:07:07	4
2548852	2	50	24,8	sleep5	0	-21	swapper/5	19:05:56	5
2549395	99	47	45,2	cyclictest	2820194	-21	kworker/u16:3+flush-8:0	22:14:20	5
2549398	99	46	41,4	cyclictest	3110468	-21	latency_hist	23:24:19	7
2549398	99	46	0,44	cyclictest	2844192	-21	latency_hist	21:34:20	7
2549395	99	44	42,2	cyclictest	2773085	-21	kworker/u16:1+events_unbound	21:54:34	5
2549395	99	44	41,2	cyclictest	2476547	-21	kworker/u16:0+flush-8:0	19:44:20	5
2539951	2	43	3,34	sleep7	0	-21	swapper/7	19:04:29	7
2549398	99	42	37,4	cyclictest	2904785	-21	latency_hist	21:59:19	7
2549398	99	42	37,4	cyclictest	2774067	-21	latency_hist	21:04:19	7
2549398	99	41	36,4	cyclictest	3243719	-21	latency_hist	00:19:19	7
2549396	99	41	38,2	cyclictest	1847214	-21	kworker/u16:2+events_unbound	19:14:34	6
2549396	99	40	36,3	cyclictest	2649477	-21	kworker/u16:5+flush-8:0	20:14:19	6
3050890	2	38	0,0	chrt	3050891	-21	expr	22:59:32	7
2549398	99	33	28,4	cyclictest	635	-21	systemd-journal	23:34:14	7
2549395	99	33	31,2	cyclictest	3265620	-21	kworker/u16:2+events_unbound	00:32:34	5
2549395	99	32	28,4	cyclictest	2773085	-21	kworker/u16:1+flush-8:0	22:39:19	5
2549396	99	31	29,2	cyclictest	3046941	-21	kworker/u16:3+flush-8:0	23:04:50	6
2549395	99	31	29,2	cyclictest	2773085	-21	kworker/u16:1+events_unbound	23:18:51	5
2549396	99	30	28,2	cyclictest	2591632	-21	kworker/u16:1+flush-8:0	19:34:20	6
2549396	99	30	27,2	cyclictest	3046941	-21	kworker/u16:3+flush-8:0	23:34:50	6
2549396	99	30	25,2	cyclictest	3265620	-21	kworker/u16:2+flush-8:0	00:29:19	6
2549395	99	30	28,2	cyclictest	3046941	-21	kworker/u16:3+events_unbound	23:44:18	5
2549390	99	29	26,2	cyclictest	3086322	-21	kworker/u16:0+flush-8:0	23:34:19	4
2549082	2	29	5,7	sleep6	0	-21	swapper/6	19:09:10	6
2549395	99	28	26,2	cyclictest	3217137	-21	kworker/u16:2+events_unbound	00:06:54	5
2549395	99	28	25,2	cyclictest	2820194	-21	kworker/u16:3+events_unbound	22:29:21	5
2549395	99	28	25,2	cyclictest	2820194	-21	kworker/u16:3+events_unbound	22:29:21	5
2549395	99	27	25,2	cyclictest	2820194	-21	kworker/u16:3+flush-8:0	21:44:38	5
2549395	99	27	25,2	cyclictest	2820194	-21	kworker/u16:3+events_unbound	21:27:14	5
2549395	99	27	25,2	cyclictest	2511326	-21	kworker/u16:3+flush-8:0	19:14:25	5
2549396	99	26	24,2	cyclictest	2558857	-21	kworker/u16:4+flush-8:0	19:34:45	6
2549396	99	26	24,2	cyclictest	2558857	-21	kworker/u16:4+flush-8:0	19:34:45	6
2549395	99	26	24,2	cyclictest	3013709	-21	kworker/u16:4+events_unbound	22:58:55	5
2549395	99	26	24,2	cyclictest	2926564	-21	kworker/u16:4+flush-8:0	22:24:51	5
2549395	99	26	24,2	cyclictest	2820194	-21	kworker/u16:3+events_unbound	21:30:31	5
2549398	99	25	20,4	cyclictest	3171041	-21	latency_hist	23:49:19	7
2549396	99	24	21,2	cyclictest	2591632	-21	kworker/u16:1+events_unbound	19:54:34	6
2549395	99	24	22,2	cyclictest	3046941	-21	kworker/u16:3+events_unbound	00:00:19	5
2549395	99	24	22,2	cyclictest	2977577	-21	kworker/u16:0+events_unbound	22:49:19	5
2549396	99	23	21,2	cyclictest	2820195	-21	kworker/u16:5+flush-8:0	21:34:15	6
2549395	99	23	21,2	cyclictest	2820194	-21	kworker/u16:3+events_unbound	22:17:45	5
2549395	99	23	21,2	cyclictest	2687064	-21	kworker/u16:4+events_unbound	21:09:33	5
2549395	99	23	20,2	cyclictest	2842937	-21	kworker/u16:2+events_unbound	21:53:27	5
2549398	99	22	16,5	cyclictest	2764399	-21	latency_hist	20:59:19	7
2549396	99	22	20,2	cyclictest	2687064	-21	kworker/u16:4+flush-8:0	21:09:19	6
2549396	99	22	20,2	cyclictest	2687064	-21	kworker/u16:4+flush-8:0	21:09:19	6
2549390	99	22	20,2	cyclictest	2629037	-21	kworker/u16:2+flush-8:0	21:19:55	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17