OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Wed Feb 25, 2026 12:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4152308	2	57	47,7	sleep5	0	-21	swapper/5	07:00:51	5
4152883	99	53	51,2	cyclictest	173670	-21	kworker/u16:1+flush-8:0	09:10:28	6
4152875	99	52	50,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:25:24	4
4152875	99	47	45,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	11:35:26	4
4152447	2	47	37,7	sleep4	0	-21	swapper/4	07:02:50	4
4152883	99	43	41,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	11:34:31	6
4152875	99	43	41,2	cyclictest	652744	-21	kworker/u16:2+events_unbound	12:34:23	4
4152879	99	42	40,2	cyclictest	216798	-21	kworker/u16:0+events_unbound	09:35:28	5
4152879	99	42	39,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	10:24:59	5
4152875	99	42	40,2	cyclictest	360064	-21	kworker/u16:0+events_unbound	10:14:16	4
4152883	99	41	39,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	12:31:47	6
4152879	99	41	39,2	cyclictest	4133658	-21	kworker/u16:1+flush-8:0	07:10:25	5
4152875	99	41	38,2	cyclictest	216798	-21	kworker/u16:0+flush-8:0	09:35:25	4
4152592	2	41	6,30	sleep7	0	-21	swapper/7	07:04:54	7
4152875	99	40	38,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:17:52	4
4152883	99	39	37,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	11:59:03	6
4152883	99	39	37,2	cyclictest	360064	-21	kworker/u16:0+events_unbound	10:34:08	6
4152883	99	39	36,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	10:45:03	6
4152879	99	39	37,2	cyclictest	576731	-21	kworker/u16:1+events_unbound	12:09:11	5
4152879	99	39	37,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	11:56:40	5
4152875	99	39	37,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	11:07:00	4
4152875	99	39	37,2	cyclictest	30272	-21	kworker/u16:2+events_unbound	07:40:26	4
4152886	99	38	32,5	cyclictest	30004	-21	latency_hist	07:39:58	7
4152883	99	38	36,2	cyclictest	652744	-21	kworker/u16:2+events_unbound	12:19:28	6
4152883	99	38	36,2	cyclictest	432761	-21	kworker/u16:4+events_unbound	11:09:52	6
4152883	99	38	36,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:18:15	6
4152879	99	38	36,2	cyclictest	432761	-21	kworker/u16:4+events_unbound	10:57:55	5
4152879	99	38	36,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:22:52	5
4152879	99	38	36,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	11:31:08	5
4152879	99	38	36,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	09:07:55	5
4152879	99	38	35,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	11:36:23	5
4152875	99	38	36,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	09:58:16	4
4152875	99	38	36,2	cyclictest	201327	-21	kworker/u16:2+events_unbound	09:16:21	4
4152875	99	38	36,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:10:33	4
4152875	99	38	36,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	10:42:24	4
4152883	99	37	35,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:01:55	6
4152883	99	37	35,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	11:22:16	6
4152883	99	37	35,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	10:04:47	6
4152883	99	37	35,2	cyclictest	216798	-21	kworker/u16:0+events_unbound	09:31:32	6
4152883	99	37	35,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:37:41	6
4152883	99	37	35,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	10:56:23	6
4152879	99	37	35,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:17:15	5
4152879	99	37	35,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	11:26:31	5
4152879	99	37	35,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	11:04:39	5
4152879	99	37	35,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	10:54:39	5
4152879	99	37	35,2	cyclictest	360064	-21	kworker/u16:0+events_unbound	10:48:59	5
4152879	99	37	35,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	10:11:16	5
4152879	99	37	35,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	09:58:28	5
4152879	99	37	35,2	cyclictest	201327	-21	kworker/u16:2+events_unbound	09:11:16	5
4152879	99	37	35,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	10:22:32	5
4152879	99	37	35,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	12:01:12	5
4152875	99	37	35,2	cyclictest	360064	-21	kworker/u16:0+events_unbound	10:19:36	4
4152875	99	37	35,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	10:01:24	4
4152875	99	37	35,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	11:32:32	4
4152875	99	37	35,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	10:53:09	4
4152883	99	36	34,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	11:01:59	6
4152883	99	36	34,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	10:53:43	6
4152883	99	36	34,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	10:07:12	6
4152883	99	36	34,2	cyclictest	173670	-21	kworker/u16:1+flush-8:0	09:56:08	6
4152883	99	36	34,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	10:27:51	6
4152883	99	36	33,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:23:19	6
4152883	99	36	33,2	cyclictest	360064	-21	kworker/u16:0+events_unbound	10:35:07	6
4152879	99	36	34,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	11:46:15	5
4152879	99	36	34,2	cyclictest	432761	-21	kworker/u16:4+events_unbound	11:16:23	5
4152879	99	36	34,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:50:51	5
4152879	99	36	34,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:29:56	5
4152879	99	36	33,2	cyclictest	576731	-21	kworker/u16:1+events_unbound	11:50:07	5
4152875	99	36	34,2	cyclictest	372570	-21	kworker/u16:2+events_unbound	10:26:31	4
4152875	99	36	34,2	cyclictest	360064	-21	kworker/u16:0+events_unbound	10:31:16	4
4152875	99	36	34,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	10:07:47	4
4152875	99	36	34,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	09:42:32	4
4152883	99	35	33,2	cyclictest	576731	-21	kworker/u16:1+events_unbound	12:09:52	6
4152883	99	35	33,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:11:04	6
4152883	99	35	33,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	11:43:35	6
4152883	99	35	33,2	cyclictest	421038	-21	kworker/u16:1+events_unbound	11:25:40	6
4152883	99	35	33,2	cyclictest	276907	-21	kworker/u16:2+flush-8:0	09:40:32	6
4152883	99	35	33,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:07:41	6
4152883	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	11:11:32	6
4152883	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	10:18:24	6
4152879	99	35	33,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:28:47	5
4152879	99	35	33,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	12:12:59	5
4152879	99	35	33,2	cyclictest	432761	-21	kworker/u16:4+events_unbound	11:11:16	5
4152879	99	35	33,2	cyclictest	372570	-21	kworker/u16:2+events_unbound	10:37:12	5
4152879	99	35	33,2	cyclictest	216798	-21	kworker/u16:0+events_unbound	09:32:52	5
4152879	99	35	33,2	cyclictest	173670	-21	kworker/u16:1+events_unbound	09:16:35	5
4152879	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	12:31:27	5
4152879	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	12:24:47	5
4152879	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	09:47:00	5
4152875	99	35	33,2	cyclictest	576731	-21	kworker/u16:1+events_unbound	12:10:52	4
4152875	99	35	33,2	cyclictest	517134	-21	kworker/u16:0+events_unbound	11:51:31	4
4152875	99	35	33,2	cyclictest	360064	-21	kworker/u16:0+events_unbound	10:24:33	4
4152875	99	35	33,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	09:53:47	4
4152875	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	11:57:15	4
4152875	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	11:41:00	4
4152875	99	35	33,2	cyclictest	164102	-21	kworker/u16:3+events_unbound	09:33:31	4
4152886	99	34	28,5	cyclictest	576697	-21	latency_hist	11:44:58	7
4152886	99	34	27,5	cyclictest	650	-21	systemd-journal	08:39:58	7
4152883	99	34	32,2	cyclictest	551641	-21	kworker/u16:2+events_unbound	11:38:08	6
4152883	99	34	32,2	cyclictest	4175665	-21	kworker/u16:3+events_unbound	07:45:01	6
4152883	99	34	32,2	cyclictest	276907	-21	kworker/u16:2+events_unbound	09:53:31	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17