OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Fri May 02, 2025 00:43:35)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
800978	2	60	49,7	sleep6	0	-21	swapper/6	03:35:38	6
801393	99	55	0,53	cyclictest	1379140	-21	latency_hist	08:17:11	7
800997	2	53	20,29	sleep7	0	-21	swapper/7	03:35:55	7
800947	2	48	38,7	sleep5	0	-21	swapper/5	03:35:13	5
801380	99	43	40,2	cyclictest	770901	-21	kworker/u16:1+flush-8:0	03:47:12	4
801078	2	43	33,7	sleep4	0	-21	swapper/4	03:37:05	4
801380	99	41	39,2	cyclictest	1124266	-21	kworker/u16:1+flush-8:0	06:27:12	4
923265	2	38	0,0	sleep7	923266	-21	grep	04:32:35	7
923265	2	38	0,0	sleep7	923266	-21	grep	04:32:35	7
801389	99	33	31,2	cyclictest	770902	-21	kworker/u16:3+events_unbound	03:56:23	6
801389	99	32	30,2	cyclictest	1430389	-21	kworker/u16:1+events_unbound	08:57:46	6
801389	99	32	30,2	cyclictest	1296177	-21	kworker/u16:2+events_unbound	07:50:23	6
801389	99	32	30,2	cyclictest	1286841	-21	kworker/u16:1+events_unbound	07:36:22	6
801389	99	32	30,2	cyclictest	1163010	-21	kworker/u16:5+events_unbound	06:31:22	6
801389	99	31	29,2	cyclictest	1276564	-21	kworker/u16:0+events_unbound	08:56:26	6
801389	99	31	29,2	cyclictest	1004946	-21	kworker/u16:3+events_unbound	05:41:55	6
801380	99	31	28,2	cyclictest	1173943	-21	kworker/u16:1+flush-8:0	06:37:42	4
801393	99	30	0,28	cyclictest	1481670	-21	latency_hist	09:07:11	7
801389	99	30	28,2	cyclictest	781558	-21	kworker/u16:2+events_unbound	04:40:14	6
801389	99	30	28,2	cyclictest	770901	-21	kworker/u16:1+events_unbound	04:17:29	6
801389	99	30	28,2	cyclictest	1399515	-21	kworker/u16:2+events_unbound	09:03:22	6
801389	99	30	28,2	cyclictest	1245946	-21	kworker/u16:5+events_unbound	07:17:46	6
801389	99	30	28,2	cyclictest	1234716	-21	kworker/u16:4+events_unbound	07:42:47	6
801389	99	30	28,2	cyclictest	1234716	-21	kworker/u16:4+events_unbound	07:42:47	6
801389	99	30	27,2	cyclictest	958820	-21	kworker/u16:1+events_unbound	05:02:15	6
801389	99	29	27,2	cyclictest	1367901	-21	kworker/u16:5+events_unbound	08:31:23	6
801389	99	29	27,2	cyclictest	1276564	-21	kworker/u16:0+events_unbound	07:29:03	6
801389	99	29	27,2	cyclictest	1173943	-21	kworker/u16:1+events_unbound	06:52:38	6
801380	99	29	27,2	cyclictest	1137551	-21	kworker/u16:3+events_unbound	06:27:27	4
801393	99	28	0,26	cyclictest	1266477	-21	latency_hist	07:22:12	7
801389	99	28	26,2	cyclictest	908529	-21	kworker/u16:0+events_unbound	04:46:15	6
801389	99	28	26,2	cyclictest	1367901	-21	kworker/u16:5+events_unbound	08:14:11	6
801389	99	28	26,2	cyclictest	1296177	-21	kworker/u16:2+events_unbound	07:58:23	6
801389	99	28	26,2	cyclictest	1276564	-21	kworker/u16:0+events_unbound	08:40:21	6
801389	99	28	26,2	cyclictest	1082225	-21	kworker/u16:0+events_unbound	06:09:11	6
801389	99	28	26,2	cyclictest	1082225	-21	kworker/u16:0+events_unbound	06:09:11	6
801389	99	28	25,2	cyclictest	1082760	-21	kworker/u16:2+events_unbound	06:57:29	6
801393	99	27	0,25	cyclictest	921	-21	dbus-daemon	07:12:11	7
801389	99	27	25,2	cyclictest	916736	-21	kworker/u16:3+events_unbound	04:30:14	6
801389	99	27	25,2	cyclictest	1399515	-21	kworker/u16:2+events_unbound	08:48:15	6
801389	99	27	24,2	cyclictest	1137551	-21	kworker/u16:3+flush-8:0	06:32:27	6
801389	99	27	24,2	cyclictest	1040991	-21	kworker/u16:4+events_unbound	05:57:15	6
888272	2	26	0,0	sleep4	0	-21	swapper/4	04:17:26	4
801393	99	26	22,2	cyclictest	1019566	-21	ntpq	05:17:42	7
801389	99	26	24,2	cyclictest	908529	-21	kworker/u16:0+events_unbound	04:58:22	6
801389	99	26	24,2	cyclictest	867522	-21	kworker/u16:0+events_unbound	04:08:11	6
801389	99	26	24,2	cyclictest	1124266	-21	kworker/u16:1+events_unbound	06:16:15	6
801380	99	26	24,2	cyclictest	908529	-21	kworker/u16:0+flush-8:0	04:57:12	4
878375	2	25	0,1	chrt	0	-21	swapper/6	04:12:31	6
801389	99	25	23,2	cyclictest	999146	-21	kworker/u16:1+flush-8:0	05:12:46	6
801389	99	25	23,2	cyclictest	781558	-21	kworker/u16:2+events_unbound	05:11:22	6
801389	99	25	23,2	cyclictest	770902	-21	kworker/u16:3+events_unbound	03:41:24	6
801389	99	25	23,2	cyclictest	1430389	-21	kworker/u16:1+events_unbound	08:42:37	6
801389	99	25	23,2	cyclictest	1173943	-21	kworker/u16:1+flush-8:0	07:22:22	6
801389	99	25	23,2	cyclictest	1124266	-21	kworker/u16:1+events_unbound	06:20:11	6
801389	99	25	22,2	cyclictest	958820	-21	kworker/u16:1+flush-8:0	04:52:29	6
801380	99	25	23,2	cyclictest	770902	-21	kworker/u16:3+flush-8:0	03:42:12	4
1074037	2	25	0,1	chrt	1074039	-21	kthreadcore	05:47:35	7
801389	99	24	22,2	cyclictest	999146	-21	kworker/u16:1+events_unbound	05:35:12	6
801389	99	24	22,2	cyclictest	1276564	-21	kworker/u16:0+events_unbound	08:32:20	6
801389	99	24	22,2	cyclictest	1234716	-21	kworker/u16:4+events_unbound	07:40:11	6
801389	99	24	22,2	cyclictest	1203984	-21	kworker/u16:0+events_unbound	07:10:21	6
801389	99	24	22,2	cyclictest	1163010	-21	kworker/u16:5+events_unbound	06:43:50	6
801389	99	24	22,2	cyclictest	1082760	-21	kworker/u16:2+events_unbound	07:03:46	6
801389	99	24	22,2	cyclictest	1004946	-21	kworker/u16:3+flush-8:0	05:42:39	6
801380	99	24	21,2	cyclictest	1286841	-21	kworker/u16:1+flush-8:0	07:47:42	4
801380	99	24	21,2	cyclictest	1276564	-21	kworker/u16:0+flush-8:0	08:12:29	4
801393	99	23	0,21	cyclictest	1256193	-21	latency_hist	07:17:12	7
801389	99	23	21,2	cyclictest	999146	-21	kworker/u16:1+events_unbound	05:31:22	6
801389	99	23	21,2	cyclictest	916736	-21	kworker/u16:3+events_unbound	04:49:11	6
801389	99	23	21,2	cyclictest	781558	-21	kworker/u16:2+events_unbound	03:46:15	6
801389	99	23	21,2	cyclictest	1163010	-21	kworker/u16:5+events_unbound	06:41:55	6
801389	99	23	21,2	cyclictest	1082760	-21	kworker/u16:2+flush-8:0	06:47:40	6
801389	99	23	21,2	cyclictest	1082760	-21	kworker/u16:2+events_unbound	06:26:19	6
801389	99	23	21,2	cyclictest	1082225	-21	kworker/u16:0+events_unbound	05:56:15	6
801389	99	22	20,2	cyclictest	781558	-21	kworker/u16:2+flush-8:0	04:22:47	6
801389	99	22	20,2	cyclictest	1082760	-21	kworker/u16:2+events_unbound	07:13:42	6
801389	99	22	20,2	cyclictest	1082225	-21	kworker/u16:0+events_unbound	06:03:27	6
801393	99	21	0,20	cyclictest	1215222	-21	latency_hist	06:57:11	7
801389	99	21	19,2	cyclictest	999146	-21	kworker/u16:1+events_unbound	05:26:11	6
801389	99	21	19,2	cyclictest	824923	-21	kworker/u16:5+events_unbound	04:07:10	6
801389	99	21	19,2	cyclictest	1040991	-21	kworker/u16:4+events_unbound	05:48:22	6
801389	99	21	18,2	cyclictest	1348120	-21	kworker/u16:1+events_unbound	08:02:28	6
801389	99	21	18,2	cyclictest	1004946	-21	kworker/u16:3+flush-8:0	05:17:22	6
801393	99	20	0,18	cyclictest	1032119	-21	tune2fs	05:27:31	7
801389	99	20	18,2	cyclictest	781558	-21	kworker/u16:2+events_unbound	03:49:27	6
801389	99	20	18,2	cyclictest	781558	-21	kworker/u16:2+events_unbound	03:49:27	6
801389	99	20	18,2	cyclictest	1276564	-21	kworker/u16:0+flush-8:0	08:17:47	6
801380	99	20	18,2	cyclictest	1040991	-21	kworker/u16:4+flush-8:0	05:47:35	4
801393	99	19	0,17	cyclictest	1286950	-21	latency_hist	07:32:11	7
801389	99	19	17,2	cyclictest	916736	-21	kworker/u16:3+events_unbound	04:36:19	6
801389	99	19	17,2	cyclictest	916736	-21	kworker/u16:3+events_unbound	04:36:19	6
801380	99	19	16,2	cyclictest	1137551	-21	kworker/u16:3+flush-8:0	06:32:37	4
801380	99	19	15,3	cyclictest	999146	-21	kworker/u16:1+flush-8:0	05:37:43	4
801393	99	18	15,2	cyclictest	1061548	-21	awk	05:42:12	7
801393	99	18	0,17	cyclictest	959105	-21	grep	04:52:12	7
801393	99	18	0,17	cyclictest	643	-21	systemd-journal	07:52:11	7
801389	99	18	16,2	cyclictest	1348120	-21	kworker/u16:1+flush-8:0	08:24:26	6
801393	99	17	0,15	cyclictest	1313	-21	snmpd	06:25:37	7
801393	99	17	0,15	cyclictest	1092286	-21	latency_hist	05:57:11	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17