OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Feb 28, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4131915	2	96	0,1	sleep6	0	-21	swapper/6	09:18:28	6
3863088	99	59	56,2	cyclictest	4072885	-21	kworker/u16:2+events_unbound	09:25:00	4
3863092	99	57	53,3	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:45:01	5
3863092	99	54	52,2	cyclictest	4108907	-21	kworker/u16:1+events_unbound	09:55:00	5
3863092	99	54	52,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	10:15:15	5
3863092	99	54	52,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	12:20:14	5
3863092	99	52	49,2	cyclictest	3901386	-21	kworker/u16:3+events_unbound	07:35:04	5
3862562	2	52	41,8	sleep5	0	-21	swapper/5	07:01:18	5
3863088	99	51	49,2	cyclictest	4108907	-21	kworker/u16:1+flush-8:0	10:05:12	4
3863088	99	51	49,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	12:24:43	4
3863092	99	50	47,2	cyclictest	2879060	-21	kworker/u16:0+events_unbound	07:20:01	5
3863092	99	50	47,2	cyclictest	2879060	-21	kworker/u16:0+events_unbound	07:20:01	5
3863088	99	50	48,2	cyclictest	3901386	-21	kworker/u16:3+flush-8:0	07:35:16	4
3863092	99	49	47,2	cyclictest	3901386	-21	kworker/u16:3+events_unbound	09:05:17	5
3863092	99	48	46,2	cyclictest	69447	-21	kworker/u16:2+flush-8:0	10:40:20	5
3863088	99	48	45,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	12:00:00	4
3863088	99	47	45,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	11:54:59	4
3862797	2	47	37,7	sleep6	0	-21	swapper/6	07:04:39	6
3854691	2	47	3,37	sleep7	0	-21	swapper/7	07:00:15	7
3863092	99	46	44,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	12:10:16	5
3862795	2	46	36,7	sleep4	0	-21	swapper/4	07:04:37	4
3863092	99	45	42,2	cyclictest	144381	-21	kworker/u16:3+flush-8:0	10:55:16	5
3863088	99	45	43,2	cyclictest	2879060	-21	kworker/u16:0+flush-8:0	07:09:52	4
3863088	99	45	41,3	cyclictest	4108907	-21	kworker/u16:1+flush-8:0	09:40:02	4
3863092	99	44	42,2	cyclictest	4108907	-21	kworker/u16:1+flush-8:0	09:35:15	5
3863092	99	44	42,2	cyclictest	4108907	-21	kworker/u16:1+events_unbound	10:05:17	5
3863092	99	44	42,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	08:30:11	5
3863092	99	44	42,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:10:18	5
3863088	99	44	40,3	cyclictest	104901	-21	kworker/u16:1+flush-8:0	11:30:01	4
3863092	99	43	41,2	cyclictest	4072885	-21	kworker/u16:2+events_unbound	09:16:45	5
3863092	99	43	41,2	cyclictest	104901	-21	kworker/u16:1+events_unbound	11:08:03	5
3863088	99	43	40,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	11:15:01	4
3863092	99	42	41,1	cyclictest	2879060	-21	kworker/u16:0+events_unbound	07:09:51	5
3863092	99	42	40,2	cyclictest	4170165	-21	kworker/u16:3+events_unbound	10:14:20	5
3863092	99	42	40,2	cyclictest	4170165	-21	kworker/u16:3+events_unbound	10:14:20	5
3863092	99	42	40,2	cyclictest	4072885	-21	kworker/u16:2+events_unbound	09:26:24	5
3863092	99	42	40,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:43:47	5
3863092	99	42	40,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	11:36:15	5
3863092	99	41	39,2	cyclictest	4170165	-21	kworker/u16:3+events_unbound	09:52:25	5
3863092	99	41	39,2	cyclictest	4108907	-21	kworker/u16:1+events_unbound	10:04:15	5
3863092	99	41	39,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	12:30:39	5
3863092	99	41	39,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:16:51	5
3863092	99	41	38,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	11:24:55	5
3863088	99	41	39,2	cyclictest	4072885	-21	kworker/u16:2+events_unbound	09:10:20	4
3863088	99	41	39,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:50:04	4
3863088	99	41	38,3	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:05:19	4
3863092	99	40	38,2	cyclictest	4170165	-21	kworker/u16:3+events_unbound	10:20:36	5
3863092	99	40	38,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	10:26:08	5
3863092	99	40	38,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	09:31:48	5
3863092	99	40	38,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	09:31:48	5
3863092	99	40	38,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	09:23:08	5
3863092	99	40	38,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	09:11:56	5
3863092	99	40	38,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	12:19:27	5
3863092	99	40	38,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	11:04:03	5
3863092	99	40	38,2	cyclictest	104901	-21	kworker/u16:1+events_unbound	11:30:59	5
3863092	99	40	38,2	cyclictest	104901	-21	kworker/u16:1+events_unbound	10:52:56	5
3863092	99	40	38,2	cyclictest	104901	-21	kworker/u16:1+events_unbound	10:52:56	5
3863092	99	40	38,2	cyclictest	104901	-21	kworker/u16:1+events_unbound	10:47:55	5
3863092	99	40	37,2	cyclictest	3901386	-21	kworker/u16:3+flush-8:0	09:00:01	5
3863092	99	40	37,2	cyclictest	3876606	-21	kworker/u16:2+flush-8:0	08:00:01	5
3863088	99	40	38,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:00:59	4
3863092	99	39	37,2	cyclictest	4108907	-21	kworker/u16:1+flush-8:0	09:40:27	5
3863092	99	39	37,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	10:32:52	5
3863092	99	39	37,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:50:24	5
3863088	99	39	37,2	cyclictest	69447	-21	kworker/u16:2+flush-8:0	10:50:15	4
3863088	99	39	37,2	cyclictest	69447	-21	kworker/u16:2+flush-8:0	10:50:15	4
3863088	99	39	37,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	11:40:04	4
3923777	2	38	0,0	sleep6	0	-21	swapper/6	07:30:18	6
3863092	99	38	36,2	cyclictest	4170165	-21	kworker/u16:3+events_unbound	09:48:09	5
3863092	99	38	36,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	10:35:03	5
3863088	99	38	36,2	cyclictest	4072885	-21	kworker/u16:2+flush-8:0	09:15:16	4
3863088	99	38	36,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	10:25:19	4
3863092	99	37	35,2	cyclictest	346352	-21	kworker/u16:1+events_unbound	12:08:32	5
3863092	99	37	35,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	11:58:58	5
3863092	99	37	35,2	cyclictest	189074	-21	kworker/u16:4+events_unbound	12:01:55	5
3863088	99	37	34,2	cyclictest	144381	-21	kworker/u16:3+events_unbound	10:45:11	4
3863092	99	36	34,2	cyclictest	385129	-21	kworker/u16:1+events_unbound	12:28:16	5
3863092	99	36	34,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	11:21:20	5
3863088	99	36	34,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	10:15:09	4
3863088	99	36	34,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	12:25:52	4
3863102	99	35	0,34	cyclictest	156051	-21	latency_hist	10:49:46	7
3863088	99	35	33,2	cyclictest	4108907	-21	kworker/u16:1+events_unbound	09:50:18	4
3863088	99	35	33,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	11:23:55	4
3863088	99	35	33,2	cyclictest	104901	-21	kworker/u16:1+flush-8:0	10:55:11	4
3863088	99	35	32,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	10:20:00	4
3863088	99	35	32,2	cyclictest	4000851	-21	kworker/u16:0+events_unbound	09:59:59	4
3863088	99	34	32,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	11:45:05	4
3863092	99	33	30,2	cyclictest	3901386	-21	kworker/u16:3+events_unbound	08:19:59	5
3863088	99	33	31,2	cyclictest	288506	-21	kworker/u16:2+events_unbound	12:15:52	4
3863088	99	33	31,2	cyclictest	168082	-21	kworker/u16:0+events_unbound	12:10:04	4
3863088	99	32	30,2	cyclictest	4108907	-21	kworker/u16:1+events_unbound	09:30:57	4
3863088	99	32	30,2	cyclictest	4108907	-21	kworker/u16:1+events_unbound	09:30:57	4
3863088	99	32	30,2	cyclictest	3901386	-21	kworker/u16:3+flush-8:0	07:24:41	4
3863088	99	32	30,2	cyclictest	3901386	-21	kworker/u16:3+flush-8:0	07:24:41	4
3863097	99	31	28,2	cyclictest	4000851	-21	kworker/u16:0+flush-8:0	09:38:46	6
3863088	99	31	29,2	cyclictest	4072885	-21	kworker/u16:2+events_unbound	09:24:11	4
3863102	99	30	25,4	cyclictest	71756	-21	latency_hist	10:14:46	7
3863102	99	30	25,4	cyclictest	71756	-21	latency_hist	10:14:46	7
3863092	99	30	28,2	cyclictest	3901386	-21	kworker/u16:3+flush-8:0	08:24:57	5
3863092	99	30	27,2	cyclictest	3901386	-21	kworker/u16:3+flush-8:0	07:49:57	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17