OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Thu Sep 12, 2024 12:43:30)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
141224	2	56	20,31	sleep7	0	-21	swapper/7	06:57:19	7
141684	99	35	33,2	cyclictest	164757	-21	kworker/u16:1+events_unbound	07:14:33	6
141684	99	33	31,2	cyclictest	292857	-21	kworker/u16:3+events_unbound	09:04:48	6
141684	99	33	31,2	cyclictest	111795	-21	kworker/u16:0+events_unbound	07:39:32	6
141684	99	33	31,2	cyclictest	111795	-21	kworker/u16:0+events_unbound	07:39:32	6
141688	99	31	29,1	cyclictest	0	-21	swapper/7	09:24:18	7
141675	99	31	27,3	cyclictest	142049	-21	kworker/u16:2+flush-8:0	07:44:30	4
141155	2	31	5,8	sleep5	0	-21	swapper/5	06:56:21	5
141129	2	31	20,8	sleep6	0	-21	swapper/6	06:55:58	6
141684	99	30	27,2	cyclictest	142049	-21	kworker/u16:2+flush-8:0	08:24:45	6
141336	2	30	19,8	sleep4	0	-21	swapper/4	06:58:52	4
141684	99	29	27,2	cyclictest	670599	-21	kworker/u16:4+events_unbound	11:44:30	6
141684	99	29	27,2	cyclictest	457051	-21	kworker/u16:4+events_unbound	10:14:28	6
141684	99	29	27,2	cyclictest	292857	-21	kworker/u16:3+flush-8:0	08:14:43	6
141684	99	29	27,2	cyclictest	252145	-21	kworker/u16:3+flush-8:0	07:54:30	6
141684	99	29	26,2	cyclictest	524714	-21	kworker/u16:1+flush-8:0	10:29:35	6
141684	99	29	25,3	cyclictest	592580	-21	kworker/u16:2+flush-8:0	11:49:37	6
141684	99	29	25,3	cyclictest	592580	-21	kworker/u16:2+flush-8:0	11:49:37	6
141684	99	28	26,2	cyclictest	320800	-21	kworker/u16:4+events_unbound	08:29:41	6
141684	99	28	26,2	cyclictest	142049	-21	kworker/u16:2+flush-8:0	07:24:33	6
141684	99	27	25,2	cyclictest	408281	-21	kworker/u16:0+flush-8:0	10:39:47	6
141684	99	26	24,2	cyclictest	320800	-21	kworker/u16:4+flush-8:0	08:59:46	6
141684	99	26	24,2	cyclictest	164757	-21	kworker/u16:1+flush-8:0	07:34:39	6
141684	99	26	24,2	cyclictest	164757	-21	kworker/u16:1+flush-8:0	07:34:39	6
141684	99	25	23,2	cyclictest	716486	-21	kworker/u16:1+flush-8:0	12:24:38	6
141684	99	25	23,2	cyclictest	716486	-21	kworker/u16:1+flush-8:0	12:04:41	6
141684	99	25	23,2	cyclictest	650790	-21	kworker/u16:0+events_unbound	12:19:33	6
141684	99	25	23,2	cyclictest	292857	-21	kworker/u16:3+events_unbound	09:14:30	6
141684	99	25	23,2	cyclictest	164757	-21	kworker/u16:1+flush-8:0	08:19:42	6
141684	99	25	22,2	cyclictest	164757	-21	kworker/u16:1+flush-8:0	08:54:39	6
141675	99	25	22,2	cyclictest	292857	-21	kworker/u16:3+events_unbound	08:44:32	4
141675	99	25	21,3	cyclictest	524714	-21	kworker/u16:1+events_unbound	10:24:38	4
141688	99	24	22,1	cyclictest	0	-21	swapper/7	12:09:41	7
141684	99	24	22,2	cyclictest	524714	-21	kworker/u16:1+events_unbound	11:04:40	6
141684	99	24	22,2	cyclictest	142049	-21	kworker/u16:2+flush-8:0	07:29:44	6
141684	99	24	22,2	cyclictest	111795	-21	kworker/u16:0+flush-8:0	07:49:38	6
141688	99	23	20,1	cyclictest	0	-21	swapper/7	11:54:44	7
141684	99	23	21,2	cyclictest	524714	-21	kworker/u16:1+events_unbound	11:14:40	6
141684	99	23	21,2	cyclictest	292857	-21	kworker/u16:3+flush-8:0	09:39:43	6
141675	99	23	19,3	cyclictest	457051	-21	kworker/u16:4+flush-8:0	10:14:42	4
141688	99	22	14,7	cyclictest	0	-21	swapper/7	07:49:46	7
141684	99	22	20,2	cyclictest	728998	-21	kworker/u16:3+flush-8:0	11:59:39	6
141684	99	22	20,2	cyclictest	716486	-21	kworker/u16:1+events_unbound	11:54:42	6
141684	99	22	20,2	cyclictest	408281	-21	kworker/u16:0+flush-8:0	09:49:43	6
141684	99	22	20,2	cyclictest	408281	-21	kworker/u16:0+flush-8:0	09:49:43	6
141684	99	22	20,2	cyclictest	142049	-21	kworker/u16:2+flush-8:0	07:09:39	6
141681	99	22	20,2	cyclictest	292857	-21	kworker/u16:3+events_unbound	09:39:47	5
141681	99	22	18,3	cyclictest	378807	-21	awk	08:59:18	5
141675	99	22	20,2	cyclictest	716486	-21	kworker/u16:1+events_unbound	12:04:42	4
141675	99	22	20,2	cyclictest	457051	-21	kworker/u16:4+events_unbound	10:39:33	4
141688	99	21	19,1	cyclictest	0	-21	swapper/7	09:44:29	7
141684	99	21	19,2	cyclictest	670599	-21	kworker/u16:4+flush-8:0	11:29:47	6
141684	99	21	19,2	cyclictest	320800	-21	kworker/u16:4+flush-8:0	08:39:34	6
141681	99	21	19,2	cyclictest	164757	-21	kworker/u16:1+events_unbound	08:24:29	5
141675	99	21	19,2	cyclictest	748393	-21	kworker/u16:3+events_unbound	12:24:47	4
141675	99	21	19,2	cyclictest	650790	-21	kworker/u16:0+events_unbound	11:19:41	4
141675	99	21	19,2	cyclictest	466647	-21	kworker/u16:5+flush-8:0	09:54:19	4
141675	99	21	19,2	cyclictest	466647	-21	kworker/u16:5+flush-8:0	09:54:19	4
141675	99	21	19,2	cyclictest	408281	-21	kworker/u16:0+events_unbound	10:19:33	4
141675	99	21	10,10	cyclictest	0	-21	swapper/4	07:58:22	4
141684	99	20	18,2	cyclictest	631150	-21	kworker/u16:3+events_unbound	11:19:45	6
141684	99	20	18,2	cyclictest	466647	-21	kworker/u16:5+flush-8:0	09:54:38	6
141684	99	20	18,2	cyclictest	408281	-21	kworker/u16:0+flush-8:0	09:59:33	6
141684	99	20	17,2	cyclictest	408281	-21	kworker/u16:0+events_unbound	10:19:35	6
141681	99	20	18,2	cyclictest	631150	-21	kworker/u16:3+flush-8:0	11:11:29	5
141681	99	20	17,2	cyclictest	716486	-21	kworker/u16:1+events_unbound	12:04:32	5
141681	99	20	16,3	cyclictest	292857	-21	kworker/u16:3+events_unbound	09:29:18	5
141675	99	20	18,2	cyclictest	142049	-21	kworker/u16:2+events_unbound	08:19:35	4
141688	99	19	18,0	cyclictest	0	-21	swapper/7	07:54:33	7
141688	99	19	18,0	cyclictest	0	-21	swapper/7	07:04:19	7
141688	99	19	16,2	cyclictest	0	-21	swapper/7	12:03:26	7
141684	99	19	17,2	cyclictest	408281	-21	kworker/u16:0+flush-8:0	09:19:39	6
141681	99	19	17,2	cyclictest	320800	-21	kworker/u16:4+events_unbound	09:04:32	5
141681	99	19	17,2	cyclictest	164757	-21	kworker/u16:1+events_unbound	08:19:45	5
141681	99	19	15,3	cyclictest	651114	-21	latency_hist	11:19:18	5
141675	99	19	17,2	cyclictest	320800	-21	kworker/u16:4+flush-8:0	08:54:31	4
141675	99	19	17,2	cyclictest	320800	-21	kworker/u16:4+flush-8:0	08:44:14	4
141675	99	19	16,2	cyclictest	164757	-21	kworker/u16:1+flush-8:0	07:09:44	4
141675	99	19	15,3	cyclictest	111795	-21	kworker/u16:0+flush-8:0	07:34:45	4
141675	99	19	15,3	cyclictest	111795	-21	kworker/u16:0+flush-8:0	07:34:45	4
141688	99	18	16,1	cyclictest	168	50	irq/16-ehci_hcd:usb3	10:19:31	7
141688	99	18	11,6	cyclictest	0	-21	swapper/7	09:29:43	7
141688	99	18	0,4	cyclictest	0	-21	swapper/7	07:48:07	7
141684	99	18	16,2	cyclictest	457051	-21	kworker/u16:4+events_unbound	10:12:17	6
141684	99	18	16,2	cyclictest	320800	-21	kworker/u16:4+flush-8:0	09:09:34	6
141684	99	18	16,2	cyclictest	281450	-21	kworker/u16:0+flush-8:0	08:09:46	6
141684	99	18	16,2	cyclictest	164757	-21	kworker/u16:1+flush-8:0	07:59:41	6
141684	99	18	16,2	cyclictest	101595	-21	kworker/u16:4+events_unbound	07:04:48	6
141675	99	18	16,2	cyclictest	142049	-21	kworker/u16:2+events_unbound	07:39:41	4
141675	99	18	16,2	cyclictest	142049	-21	kworker/u16:2+events_unbound	07:39:41	4
141675	99	18	16,2	cyclictest	142049	-21	kworker/u16:2+events_unbound	07:04:23	4
141675	99	18	13,4	cyclictest	524903	-21	latency_hist	10:14:19	4
141675	99	18	0,17	cyclictest	496864	-21	if_p4p1	09:59:33	4
141688	99	17	7,8	cyclictest	0	-21	swapper/7	11:11:33	7
141688	99	17	4,5	cyclictest	0	-21	swapper/7	09:59:13	7
141688	99	17	16,0	cyclictest	0	-21	swapper/7	08:39:38	7
141688	99	17	0,15	cyclictest	0	-21	swapper/7	08:32:25	7
141684	99	17	15,2	cyclictest	716486	-21	kworker/u16:1+events_unbound	12:17:20	6
141684	99	17	15,2	cyclictest	524714	-21	kworker/u16:1+flush-8:0	10:24:36	6
141684	99	17	15,2	cyclictest	505811	-21	kworker/u16:2+events_unbound	10:07:59	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17