OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Aug 15, 2026 00:43:36)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
776633	99	44	38,5	cyclictest	648	-21	systemd-journal	19:12:56	7
776631	99	41	39,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	23:27:57	6
776021	2	41	31,7	sleep5	0	-21	swapper/5	19:03:36	5
776631	99	40	38,2	cyclictest	737955	-21	kworker/u16:3+flush-8:0	19:32:56	6
776626	99	40	38,2	cyclictest	936513	-21	kworker/u16:3+flush-8:0	20:37:55	4
776176	2	40	29,8	sleep4	0	-21	swapper/4	19:05:44	4
776071	2	40	5,30	sleep7	0	-21	swapper/7	19:04:19	7
776631	99	39	37,2	cyclictest	1423365	-21	kworker/u16:3+events_unbound	23:58:56	6
776631	99	39	37,2	cyclictest	1423365	-21	kworker/u16:3+events_unbound	23:58:56	6
776631	99	39	37,2	cyclictest	1060754	-21	kworker/u16:1+flush-8:0	21:32:56	6
776631	99	39	36,2	cyclictest	1372589	-21	kworker/u16:0+flush-8:0	23:52:55	6
776633	99	38	36,1	cyclictest	954923	2	sleep7	20:33:28	7
776631	99	37	35,2	cyclictest	1203310	-21	kworker/u16:0+flush-8:0	22:28:25	6
776631	99	37	35,2	cyclictest	1085437	-21	kworker/u16:2+flush-8:0	23:17:26	6
776631	99	37	35,2	cyclictest	1085437	-21	kworker/u16:2+flush-8:0	23:17:26	6
776627	99	37	35,2	cyclictest	1203310	-21	kworker/u16:0+events_unbound	22:24:54	5
776627	99	37	35,2	cyclictest	1121887	-21	kworker/u16:0+events_unbound	22:08:33	5
776627	99	37	34,2	cyclictest	1372589	-21	kworker/u16:0+flush-8:0	23:52:56	5
776627	99	37	34,2	cyclictest	1372589	-21	kworker/u16:0+flush-8:0	23:52:56	5
776631	99	36	34,2	cyclictest	1372589	-21	kworker/u16:0+events_unbound	23:42:29	6
776631	99	36	34,2	cyclictest	1229150	-21	kworker/u16:3+events_unbound	22:46:14	6
776631	99	36	34,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	23:06:14	6
776627	99	36	34,2	cyclictest	1444980	-21	kworker/u16:0+events_unbound	00:16:33	5
776627	99	36	34,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	22:22:53	5
776626	99	36	34,2	cyclictest	1432729	-21	kworker/u16:5+events_unbound	00:27:57	4
776631	99	35	33,2	cyclictest	915602	-21	kworker/u16:0+events_unbound	21:16:38	6
776631	99	35	33,2	cyclictest	915602	-21	kworker/u16:0+events_unbound	21:16:38	6
776631	99	35	33,2	cyclictest	1459551	-21	kworker/u16:1+events_unbound	00:20:57	6
776627	99	35	33,2	cyclictest	1216165	-21	kworker/u16:1+events_unbound	22:31:33	5
776631	99	34	32,2	cyclictest	964670	-21	kworker/u16:1+events_unbound	20:47:58	6
776631	99	34	32,2	cyclictest	1459551	-21	kworker/u16:1+events_unbound	00:27:18	6
776631	99	34	32,2	cyclictest	1203310	-21	kworker/u16:0+events_unbound	22:35:49	6
776631	99	34	32,2	cyclictest	1121887	-21	kworker/u16:0+events_unbound	22:12:02	6
776631	99	34	32,2	cyclictest	1121887	-21	kworker/u16:0+events_unbound	21:54:13	6
776631	99	34	32,2	cyclictest	1121887	-21	kworker/u16:0+events_unbound	21:54:13	6
776631	99	34	32,2	cyclictest	1013248	-21	kworker/u16:2+events_unbound	21:10:42	6
776627	99	34	32,2	cyclictest	1372589	-21	kworker/u16:0+events_unbound	23:42:33	5
776627	99	34	32,2	cyclictest	1229150	-21	kworker/u16:3+events_unbound	22:45:49	5
776627	99	34	32,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	23:51:42	5
776627	99	34	32,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	22:05:02	5
776627	99	34	32,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	22:01:13	5
776627	99	34	32,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	22:01:13	5
776627	99	34	31,2	cyclictest	737955	-21	kworker/u16:3+events_unbound	20:07:58	5
776079	2	34	24,7	sleep6	0	-21	swapper/6	19:04:26	6
776633	99	33	30,2	cyclictest	1299635	-21	ntp_states	23:03:25	7
776631	99	33	31,2	cyclictest	1444980	-21	kworker/u16:0+flush-8:0	00:30:49	6
776631	99	33	31,2	cyclictest	1444980	-21	kworker/u16:0+events_unbound	00:34:48	6
776631	99	33	31,2	cyclictest	1423365	-21	kworker/u16:3+events_unbound	00:10:53	6
776631	99	33	31,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	21:50:18	6
776631	99	33	31,2	cyclictest	1060754	-21	kworker/u16:1+events_unbound	21:34:50	6
776627	99	33	31,2	cyclictest	1459551	-21	kworker/u16:1+flush-8:0	00:24:25	5
776627	99	33	31,2	cyclictest	1432729	-21	kworker/u16:5+events_unbound	00:29:25	5
776627	99	33	31,2	cyclictest	1423365	-21	kworker/u16:3+flush-8:0	00:11:01	5
776627	99	33	31,2	cyclictest	1397250	-21	kworker/u16:1+events_unbound	23:45:37	5
776627	99	33	31,2	cyclictest	1290882	-21	kworker/u16:4+events_unbound	23:17:30	5
776627	99	33	31,2	cyclictest	1290882	-21	kworker/u16:4+events_unbound	23:17:30	5
776627	99	33	31,2	cyclictest	1290882	-21	kworker/u16:4+events_unbound	23:10:34	5
776627	99	33	31,2	cyclictest	1203310	-21	kworker/u16:0+events_unbound	22:34:34	5
776627	99	33	31,2	cyclictest	1085437	-21	kworker/u16:2+flush-8:0	23:20:25	5
776627	99	33	31,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	22:54:38	5
776627	99	33	31,2	cyclictest	1047443	-21	kworker/u16:4+events_unbound	21:51:17	5
776627	99	33	31,2	cyclictest	1013248	-21	kworker/u16:2+flush-8:0	21:13:42	5
776627	99	33	31,2	cyclictest	1013248	-21	kworker/u16:2+flush-8:0	21:13:42	5
776626	99	33	30,2	cyclictest	737955	-21	kworker/u16:3+flush-8:0	19:58:11	4
776631	99	32	30,2	cyclictest	974665	-21	kworker/u16:3+events_unbound	21:19:18	6
776631	99	32	30,2	cyclictest	751786	-21	kworker/u16:1+events_unbound	19:53:17	6
776631	99	32	30,2	cyclictest	1290882	-21	kworker/u16:4+events_unbound	23:19:45	6
776631	99	32	30,2	cyclictest	1229150	-21	kworker/u16:3+events_unbound	22:50:26	6
776631	99	32	30,2	cyclictest	1085437	-21	kworker/u16:2+flush-8:0	22:18:53	6
776631	99	32	30,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	21:44:38	6
776631	99	32	30,2	cyclictest	1060754	-21	kworker/u16:1+events_unbound	21:39:10	6
776627	99	32	30,2	cyclictest	974665	-21	kworker/u16:3+flush-8:0	21:21:13	5
776627	99	32	30,2	cyclictest	915602	-21	kworker/u16:0+events_unbound	21:36:42	5
776627	99	32	30,2	cyclictest	915602	-21	kworker/u16:0+events_unbound	21:27:30	5
776627	99	32	30,2	cyclictest	1423365	-21	kworker/u16:3+flush-8:0	23:58:41	5
776627	99	32	30,2	cyclictest	1423365	-21	kworker/u16:3+flush-8:0	23:58:41	5
776627	99	32	30,2	cyclictest	1229150	-21	kworker/u16:3+events_unbound	22:38:33	5
776627	99	32	30,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	21:44:13	5
776627	99	32	29,2	cyclictest	1229150	-21	kworker/u16:3+events_unbound	22:47:58	5
776626	99	32	30,2	cyclictest	1013248	-21	kworker/u16:2+flush-8:0	21:18:02	4
776633	99	31	30,0	cyclictest	0	-21	swapper/7	20:58:10	7
776631	99	31	29,2	cyclictest	1290882	-21	kworker/u16:4+events_unbound	23:26:53	6
776631	99	31	29,2	cyclictest	1229150	-21	kworker/u16:3+events_unbound	22:41:50	6
776631	99	31	29,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	22:01:54	6
776631	99	31	29,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	22:01:54	6
776627	99	31	29,2	cyclictest	974665	-21	kworker/u16:3+events_unbound	21:10:09	5
776627	99	31	29,2	cyclictest	1423365	-21	kworker/u16:3+events_unbound	00:34:22	5
776627	99	31	29,2	cyclictest	1423365	-21	kworker/u16:3+events_unbound	00:22:41	5
776627	99	31	29,2	cyclictest	1397250	-21	kworker/u16:1+events_unbound	00:06:29	5
776627	99	31	29,2	cyclictest	1241412	-21	kworker/u16:1+events_unbound	23:02:41	5
776627	99	31	29,2	cyclictest	1133962	-21	kworker/u16:3+events_unbound	22:14:01	5
776627	99	31	29,2	cyclictest	1060754	-21	kworker/u16:1+events_unbound	21:38:54	5
776627	99	31	28,2	cyclictest	915602	-21	kworker/u16:0+flush-8:0	20:27:58	5
776626	99	31	29,2	cyclictest	1290882	-21	kworker/u16:4+flush-8:0	23:18:29	4
776626	99	31	29,2	cyclictest	1290882	-21	kworker/u16:4+events_unbound	23:36:37	4
776626	99	31	29,2	cyclictest	1085437	-21	kworker/u16:2+events_unbound	23:03:28	4
776626	99	31	29,2	cyclictest	1013248	-21	kworker/u16:2+flush-8:0	21:12:55	4
776626	99	31	28,2	cyclictest	1121887	-21	kworker/u16:0+flush-8:0	22:07:58	4
776631	99	30	28,2	cyclictest	1432729	-21	kworker/u16:5+events_unbound	00:15:42	6
776631	99	30	28,2	cyclictest	1290882	-21	kworker/u16:4+events_unbound	23:35:25	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17