OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Fri Jun 26, 2026 00:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3962441	2	56	46,7	sleep4	0	-21	swapper/4	19:08:42	4
3962243	2	55	20,30	sleep7	0	-21	swapper/7	19:05:57	7
3962460	2	50	40,7	sleep5	0	-21	swapper/5	19:08:59	5
3962395	2	42	32,7	sleep6	0	-21	swapper/6	19:08:04	6
3962787	99	39	36,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	00:14:27	4
3962794	99	38	36,2	cyclictest	43386	-21	kworker/u16:4+events_unbound	21:43:56	6
3962787	99	37	34,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	00:25:43	4
3962797	99	36	0,34	cyclictest	92294	-21	latency_hist	21:44:26	7
3962794	99	36	34,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:35:16	6
3962794	99	36	34,2	cyclictest	358450	-21	kworker/u16:2+events_unbound	23:37:31	6
3962794	99	36	34,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	22:56:56	6
3962794	99	36	34,2	cyclictest	104882	-21	kworker/u16:3+flush-8:0	22:03:55	6
3962787	99	36	34,2	cyclictest	4142007	-21	kworker/u16:0+flush-8:0	21:27:04	4
3962787	99	36	34,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:24:12	4
3962787	99	36	33,2	cyclictest	251183	-21	kworker/u16:0+flush-8:0	23:00:27	4
3962794	99	35	33,2	cyclictest	446554	-21	kworker/u16:2+events_unbound	00:27:15	6
3962794	99	35	33,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:49:11	6
3962787	99	35	33,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	21:58:20	4
3962787	99	35	32,2	cyclictest	310752	-21	kworker/u16:2+events_unbound	23:20:44	4
3962794	99	33	31,2	cyclictest	507411	-21	kworker/u16:1+events_unbound	00:37:27	6
3962794	99	33	31,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	21:37:16	6
3962794	99	33	31,2	cyclictest	310752	-21	kworker/u16:2+events_unbound	23:12:16	6
3962787	99	33	31,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:22:32	4
3962787	99	33	31,2	cyclictest	382415	-21	kworker/u16:3+events_unbound	00:39:04	4
3962787	99	33	31,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	00:20:03	4
3962794	99	32	30,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:15:52	6
3962794	99	32	30,2	cyclictest	397940	-21	kworker/u16:5+flush-8:0	00:09:58	6
3962794	99	32	30,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	23:28:08	6
3962794	99	32	30,2	cyclictest	177920	-21	kworker/u16:0+events_unbound	22:34:12	6
3962787	99	32	30,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:12:36	4
3962787	99	32	30,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:12:36	4
3962787	99	32	30,2	cyclictest	4112451	-21	kworker/u16:2+flush-8:0	21:35:36	4
3962787	99	32	30,2	cyclictest	382415	-21	kworker/u16:3+events_unbound	23:46:03	4
3962787	99	32	30,2	cyclictest	358450	-21	kworker/u16:2+flush-8:0	23:56:35	4
3962787	99	32	30,2	cyclictest	214418	-21	kworker/u16:4+flush-8:0	23:15:28	4
3962787	99	32	30,2	cyclictest	214418	-21	kworker/u16:4+flush-8:0	23:15:28	4
3962794	99	31	29,2	cyclictest	65473	-21	kworker/u16:1+events_unbound	21:34:12	6
3962794	99	31	29,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:56:23	6
3962794	99	31	29,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:41:26	6
3962794	99	31	29,2	cyclictest	382415	-21	kworker/u16:3+events_unbound	23:41:39	6
3962794	99	31	29,2	cyclictest	382415	-21	kworker/u16:3+events_unbound	00:16:20	6
3962794	99	31	29,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	00:31:02	6
3962794	99	31	29,2	cyclictest	214418	-21	kworker/u16:4+events_unbound	23:03:03	6
3962794	99	31	28,2	cyclictest	3933873	-21	kworker/u16:2+events_unbound	19:39:27	6
3962787	99	31	29,2	cyclictest	251183	-21	kworker/u16:0+flush-8:0	00:30:19	4
3962787	99	31	29,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	23:06:40	4
3962787	99	31	29,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	22:52:46	4
3962787	99	31	29,2	cyclictest	152794	-21	kworker/u16:1+events_unbound	22:46:19	4
3962787	99	31	29,2	cyclictest	104882	-21	kworker/u16:3+events_unbound	22:34:23	4
3962787	99	31	28,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:14:35	4
3962797	99	30	24,5	cyclictest	650	-21	systemd-journal	23:19:25	7
3962797	99	30	24,5	cyclictest	650	-21	systemd-journal	23:19:25	7
3962794	99	30	28,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	22:06:44	6
3962794	99	30	28,2	cyclictest	152794	-21	kworker/u16:1+events_unbound	23:46:44	6
3962794	99	30	28,2	cyclictest	152794	-21	kworker/u16:1+events_unbound	23:08:04	6
3962794	99	30	28,2	cyclictest	104882	-21	kworker/u16:3+events_unbound	22:25:51	6
3962794	99	30	28,2	cyclictest	104882	-21	kworker/u16:3+events_unbound	22:14:04	6
3962794	99	30	27,2	cyclictest	4063847	-21	kworker/u16:1+events_unbound	20:19:35	6
3962787	99	30	28,2	cyclictest	92512	-21	kworker/u16:1+events_unbound	21:50:56	4
3962787	99	30	28,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:01:16	4
3962787	99	30	28,2	cyclictest	358450	-21	kworker/u16:2+events_unbound	23:41:23	4
3962787	99	30	28,2	cyclictest	3249620	-21	kworker/u16:3+events_unbound	19:24:40	4
3962787	99	30	28,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	23:31:39	4
3962787	99	30	28,2	cyclictest	177920	-21	kworker/u16:0+events_unbound	22:29:07	4
3962787	99	30	28,2	cyclictest	104882	-21	kworker/u16:3+events_unbound	22:05:51	4
3962787	99	30	27,2	cyclictest	382415	-21	kworker/u16:3+events_unbound	00:09:28	4
3962787	99	30	27,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	23:49:28	4
3962794	99	29	27,2	cyclictest	3933873	-21	kworker/u16:2+events_unbound	19:36:35	6
3962794	99	29	27,2	cyclictest	358450	-21	kworker/u16:2+flush-8:0	23:58:28	6
3962794	99	29	27,2	cyclictest	214418	-21	kworker/u16:4+events_unbound	22:51:18	6
3962794	99	29	27,2	cyclictest	152794	-21	kworker/u16:1+events_unbound	23:15:55	6
3962794	99	29	27,2	cyclictest	152794	-21	kworker/u16:1+events_unbound	23:15:55	6
3962794	99	29	26,2	cyclictest	3933873	-21	kworker/u16:2+events_unbound	19:49:35	6
3962787	99	29	27,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:39:44	4
3962787	99	29	27,2	cyclictest	4142007	-21	kworker/u16:0+events_unbound	21:17:25	4
3962787	99	29	27,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:36:56	4
3962787	99	29	27,2	cyclictest	214418	-21	kworker/u16:4+events_unbound	23:13:23	4
3962787	99	29	26,2	cyclictest	358450	-21	kworker/u16:2+events_unbound	23:59:28	4
3962794	99	28	26,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	21:27:27	6
3962794	99	28	26,2	cyclictest	3923059	-21	kworker/u16:1+events_unbound	19:15:36	6
3962794	99	28	26,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	23:50:23	6
3962794	99	28	25,2	cyclictest	3249620	-21	kworker/u16:3+events_unbound	19:24:28	6
3962787	99	28	27,1	cyclictest	358450	-21	kworker/u16:2+events_unbound	23:36:24	4
3962787	99	28	26,2	cyclictest	92512	-21	kworker/u16:1+flush-8:0	21:46:51	4
3962787	99	28	26,2	cyclictest	65473	-21	kworker/u16:1+events_unbound	21:31:59	4
3962787	99	28	26,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:13:27	4
3962794	99	27	25,2	cyclictest	3249620	-21	kworker/u16:3+events_unbound	19:21:36	6
3962794	99	27	25,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	00:23:46	6
3962787	99	27	25,2	cyclictest	382415	-21	kworker/u16:3+events_unbound	00:07:48	4
3962787	99	27	25,2	cyclictest	251183	-21	kworker/u16:0+events_unbound	22:57:56	4
3962794	99	26	24,2	cyclictest	92512	-21	kworker/u16:1+events_unbound	21:53:50	6
3962794	99	26	24,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	20:42:40	6
3962794	99	26	24,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	20:32:40	6
3962794	99	26	24,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	20:32:40	6
3962794	99	26	24,2	cyclictest	397940	-21	kworker/u16:5+events_unbound	00:04:04	6
3962794	99	26	24,2	cyclictest	3923059	-21	kworker/u16:1+events_unbound	19:32:40	6
3962787	99	26	24,2	cyclictest	4015491	-21	kworker/u16:0+events_unbound	20:19:23	4
3962787	99	26	24,2	cyclictest	152794	-21	kworker/u16:1+events_unbound	23:27:02	4
3962797	99	25	19,5	cyclictest	4063814	-21	latency_hist	19:59:26	7
3962794	99	25	23,2	cyclictest	4112451	-21	kworker/u16:2+events_unbound	22:17:10	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17