OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #8

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot8.osadl.org (updated Fri Apr 26, 2024 12:46:52)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
354538	99	707	407,166	cyclictest	441908	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	12:15:04	0
354538	99	706	429,144	cyclictest	300593	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	07:10:10	0
354538	99	685	407,144	cyclictest	366080	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	07:35:05	0
354538	99	684	407,144	cyclictest	589272	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	12:35:43	0
354538	99	684	407,144	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	10:55:23	0
354538	99	684	407,144	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	10:35:09	0
354538	99	684	407,144	cyclictest	441908	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	10:40:07	0
354538	99	684	407,144	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	08:55:06	0
354538	99	684	407,144	cyclictest	381651	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	09:05:22	0
354538	99	684	406,144	cyclictest	468592	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	09:30:03	0
354538	99	683	407,143	cyclictest	606490	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	12:10:55	0
354538	99	683	407,143	cyclictest	589272	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	12:05:17	0
354538	99	683	407,143	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	11:25:08	0
354538	99	683	407,143	cyclictest	531226	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	11:15:04	0
354538	99	683	407,143	cyclictest	531226	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	11:15:04	0
354538	99	683	407,143	cyclictest	478214	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	09:55:51	0
354538	99	683	407,143	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	08:50:55	0
354538	99	683	407,143	cyclictest	353899	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	08:25:05	0
354538	99	683	407,143	cyclictest	353899	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	08:25:05	0
354538	99	683	407,143	cyclictest	301374	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	07:40:02	0
354538	99	683	406,144	cyclictest	606490	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	12:00:02	0
354538	99	683	406,144	cyclictest	478214	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	10:10:01	0
354538	99	683	406,144	cyclictest	441908	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	12:20:02	0
354538	99	683	406,143	cyclictest	353899	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	07:50:15	0
354538	99	683	405,144	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	11:00:31	0
354538	99	682	406,143	cyclictest	478214	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	09:35:10	0
354538	99	682	406,143	cyclictest	441908	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	09:50:06	0
354538	99	682	406,143	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	08:30:06	0
354538	99	682	406,143	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	08:30:05	0
354538	99	682	406,143	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	08:20:09	0
354538	99	682	406,143	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	08:20:09	0
354538	99	638	407,93	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	10:32:37	0
354538	99	618	407,77	cyclictest	543372	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	10:45:08	0
354538	99	618	407,77	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	11:35:33	0
354538	99	617	407,77	cyclictest	381651	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	08:35:06	0
354538	99	617	406,77	cyclictest	478214	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	09:46:06	0
354538	99	617	406,77	cyclictest	373297	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	07:30:38	0
354538	99	616	407,76	cyclictest	441908	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	09:11:00	0
354538	99	616	406,77	cyclictest	589272	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	11:46:09	0
354538	99	616	406,77	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	11:30:26	0
354538	99	616	406,77	cyclictest	491127	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	10:00:59	0
354538	99	616	406,77	cyclictest	309300	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	07:15:07	0
354538	99	616	406,76	cyclictest	468592	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	10:15:40	0
354538	99	616	406,143	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	11:05:08	0
354538	99	616	406,143	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	11:05:08	0
354538	99	616	406,143	cyclictest	538383	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	11:10:54	0
354538	99	616	406,143	cyclictest	538383	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	11:10:54	0
354538	99	616	406,143	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	11:55:35	0
354538	99	615	406,142	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	11:20:27	0
354538	99	572	406,94	cyclictest	381651	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	08:40:59	0
354538	99	570	407,91	cyclictest	606490	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	12:26:11	0
354538	99	570	407,91	cyclictest	353783	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	07:21:39	0
354538	99	567	411,88	cyclictest	468592	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	10:24:36	0
354538	99	558	414,76	cyclictest	468592	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	09:25:28	0
354538	99	555	411,76	cyclictest	366080	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	07:27:16	0
354538	99	555	410,77	cyclictest	433078	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	09:04:18	0
354538	99	553	407,78	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	11:42:28	0
354538	99	553	407,78	cyclictest	373297	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	07:56:04	0
354538	99	552	407,78	cyclictest	551882	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	10:50:58	0
354538	99	552	407,78	cyclictest	381651	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	08:15:54	0
354538	99	552	406,78	cyclictest	491127	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	10:26:20	0
354538	99	551	407,77	cyclictest	606490	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	12:30:49	0
354538	99	551	407,77	cyclictest	433078	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	09:15:57	0
354538	99	551	407,77	cyclictest	381970	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	07:45:54	0
354538	99	550	406,77	cyclictest	468592	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	09:40:43	0
354538	99	547	410,69	cyclictest	478214	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	10:05:50	0
354551	99	498	424,2	cyclictest	538383	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	10:53:07	2
354552	99	497	423,2	cyclictest	381651	-21	kworker/u64:1+events_unbound@ intel_display_power_put_async_work	08:48:32	3
354552	99	492	419,1	cyclictest	468592	-21	kworker/u64:4+events_unbound@ intel_display_power_put_async_work	09:20:36	3
354552	99	492	419,1	cyclictest	366080	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	07:32:02	3
354552	99	491	419,1	cyclictest	381970	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	07:44:20	3
354552	99	490	417,1	cyclictest	309300	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	07:13:35	3
354551	99	486	414,1	cyclictest	441908	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	09:41:02	2
354541	99	449	373,2	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	10:36:41	9
354541	99	443	370,1	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	10:19:13	9
354541	99	440	368,1	cyclictest	606490	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	12:29:15	9
354541	99	440	367,1	cyclictest	638493	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	12:35:58	9
354541	99	438	366,1	cyclictest	366080	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	07:21:44	9
354555	99	429	429,0	cyclictest	0	-21	swapper/14	10:05:51	6
354549	99	429	356,1	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	09:44:26	15
354555	99	428	0,427	cyclictest	0	-21	swapper/14	11:46:16	6
354555	99	427	0,426	cyclictest	0	-21	swapper/14	12:08:07	6
354549	99	427	354,1	cyclictest	441908	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	10:39:57	15
354549	99	426	353,1	cyclictest	408427	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	08:57:45	15
354549	99	425	352,1	cyclictest	584677	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	11:45:13	15
354549	99	425	352,1	cyclictest	301374	-21	kworker/u64:2+events_unbound@ intel_display_power_put_async_work	07:18:47	15
354552	99	424	0,423	cyclictest	0	-21	swapper/11	10:36:41	3
354538	99	424	420,3	cyclictest	0	-21	swapper/0	08:48:32	0
354538	99	423	419,4	cyclictest	605976	-21	cat	11:50:39	0
354552	99	420	420,0	cyclictest	0	-21	swapper/11	10:19:13	3
354547	99	420	0,2	cyclictest	0	-21	swapper/8	09:35:09	14
354547	99	420	0,133	cyclictest	0	-21	swapper/8	12:00:03	14
354538	99	419	416,3	cyclictest	0	-21	swapper/0	09:20:36	0
354552	99	418	418,0	cyclictest	0	-21	swapper/11	12:29:16	3
354546	99	418	344,2	cyclictest	615912	-21	kworker/u64:5+events_unbound@ intel_display_power_put_async_work	12:07:58	13
354552	99	417	417,0	cyclictest	0	-21	swapper/11	12:35:58	3
354546	99	417	343,2	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	10:47:36	13
354546	99	417	343,2	cyclictest	381970	-21	kworker/u64:3+events_unbound@ intel_display_power_put_async_work	07:51:03	13
354552	99	416	416,0	cyclictest	0	-21	swapper/11	07:21:44	3
354543	99	414	340,2	cyclictest	501048	-21	kworker/u64:0+events_unbound@ intel_display_power_put_async_work	11:48:56	11
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17