OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Wed Apr 01, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3342414	99	61	58,2	cyclictest	3915795	-21	kworker/u16:2+events_unbound	11:22:54	6
3342414	99	60	58,2	cyclictest	4000340	-21	kworker/u16:4+events_unbound	12:23:13	6
3342414	99	60	58,2	cyclictest	4000340	-21	kworker/u16:4+events_unbound	12:23:13	6
3342414	99	60	58,2	cyclictest	3940020	-21	kworker/u16:5+events_unbound	11:38:10	6
3342414	99	55	52,2	cyclictest	3342169	-21	kworker/u16:2+events_unbound	07:47:54	6
3342414	99	53	50,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:12:58	6
3342414	99	52	50,2	cyclictest	3966722	-21	kworker/u16:3+events_unbound	11:53:09	6
3342414	99	52	50,2	cyclictest	3694759	-21	kworker/u16:0+flush-8:0	10:48:09	6
3342414	99	52	50,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	09:43:08	6
3342414	99	52	50,2	cyclictest	3587652	-21	kworker/u16:4+events_unbound	09:33:06	6
3342409	99	50	48,2	cyclictest	3855140	-21	kworker/u16:4+flush-8:0	11:18:09	5
3342414	99	49	47,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:03:10	6
3342414	99	49	47,2	cyclictest	3356777	-21	kworker/u16:0+events_unbound	07:18:11	6
3342404	99	49	45,3	cyclictest	3694759	-21	kworker/u16:0+flush-8:0	10:12:39	4
3342414	99	48	45,2	cyclictest	3842656	-21	kworker/u16:3+events_unbound	10:53:08	6
3342414	99	47	45,2	cyclictest	3793403	-21	kworker/u16:1+events_unbound	11:03:08	6
3342414	99	47	45,2	cyclictest	3793403	-21	kworker/u16:1+events_unbound	11:03:08	6
3342414	99	47	45,2	cyclictest	3587652	-21	kworker/u16:4+events_unbound	09:38:09	6
3342409	99	47	45,2	cyclictest	3468030	-21	kworker/u16:4+events_unbound	08:17:57	5
3342404	99	47	44,2	cyclictest	3915795	-21	kworker/u16:2+flush-8:0	11:32:39	4
3342414	99	46	44,2	cyclictest	3793403	-21	kworker/u16:1+events_unbound	11:08:07	6
3342414	99	46	44,2	cyclictest	3575852	-21	kworker/u16:1+flush-8:0	09:18:04	6
3342414	99	45	43,2	cyclictest	3963855	-21	kworker/u16:1+flush-8:0	12:08:09	6
3342409	99	45	43,2	cyclictest	3963855	-21	kworker/u16:1+events_unbound	11:52:40	5
3342414	99	44	42,2	cyclictest	3939546	-21	kworker/u16:0+events_unbound	12:18:10	6
3342414	99	44	42,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:43:08	6
3342414	99	44	42,2	cyclictest	3468030	-21	kworker/u16:4+events_unbound	08:03:08	6
3342409	99	44	42,2	cyclictest	4049030	-21	kworker/u16:3+events_unbound	12:30:09	5
3342409	99	44	42,2	cyclictest	3537615	-21	kworker/u16:2+events_unbound	09:03:12	5
3342409	99	44	39,2	cyclictest	3634563	-21	kworker/u16:3+events_unbound	09:46:33	5
3342415	99	43	38,4	cyclictest	650	-21	systemd-journal	11:12:33	7
3342414	99	43	41,2	cyclictest	3587652	-21	kworker/u16:4+flush-8:0	09:27:54	6
3342414	99	43	41,2	cyclictest	3479625	-21	kworker/u16:2+events_unbound	08:32:54	6
3342414	99	43	40,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:37:41	6
3342409	99	43	41,2	cyclictest	3587652	-21	kworker/u16:4+events_unbound	09:39:41	5
3342409	99	43	40,2	cyclictest	4000340	-21	kworker/u16:4+events_unbound	12:03:25	5
3342414	99	42	40,2	cyclictest	3939546	-21	kworker/u16:0+flush-8:0	12:12:54	6
3342414	99	42	40,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:31:34	6
3342414	99	42	40,2	cyclictest	3479625	-21	kworker/u16:2+flush-8:0	08:13:08	6
3342414	99	42	39,2	cyclictest	3575852	-21	kworker/u16:1+events_unbound	09:12:56	6
3342409	99	42	40,2	cyclictest	3915795	-21	kworker/u16:2+events_unbound	11:27:55	5
3342409	99	42	40,2	cyclictest	3793403	-21	kworker/u16:1+flush-8:0	10:33:13	5
3342409	99	42	40,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	11:10:41	5
3342409	99	42	40,2	cyclictest	3537615	-21	kworker/u16:2+flush-8:0	08:48:04	5
3341915	2	42	32,7	sleep4	0	-21	swapper/4	06:59:47	4
3342414	99	41	39,2	cyclictest	4000340	-21	kworker/u16:4+events_unbound	12:28:45	6
3342414	99	41	39,2	cyclictest	3939546	-21	kworker/u16:0+events_unbound	11:58:12	6
3342414	99	41	39,2	cyclictest	3939546	-21	kworker/u16:0+events_unbound	11:33:45	6
3342414	99	41	39,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:20:37	6
3342414	99	41	39,2	cyclictest	3575852	-21	kworker/u16:1+events_unbound	09:04:34	6
3342414	99	41	39,2	cyclictest	3498052	-21	kworker/u16:3+events_unbound	09:11:17	6
3342409	99	41	39,2	cyclictest	4000340	-21	kworker/u16:4+events_unbound	12:18:06	5
3342409	99	41	39,2	cyclictest	3939546	-21	kworker/u16:0+events_unbound	11:34:24	5
3342409	99	41	39,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	11:14:10	5
3342414	99	40	38,2	cyclictest	3939546	-21	kworker/u16:0+events_unbound	11:49:21	6
3342414	99	40	38,2	cyclictest	3915795	-21	kworker/u16:2+events_unbound	11:30:41	6
3342414	99	40	38,2	cyclictest	3855140	-21	kworker/u16:4+events_unbound	11:13:29	6
3342414	99	40	38,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:26:13	6
3342414	99	40	38,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:26:13	6
3342414	99	40	38,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:36:09	6
3342414	99	40	38,2	cyclictest	3537615	-21	kworker/u16:2+events_unbound	09:24:01	6
3342409	99	40	38,2	cyclictest	3966722	-21	kworker/u16:3+events_unbound	11:50:33	5
3342409	99	40	38,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:48:05	5
3342409	99	40	38,2	cyclictest	3587652	-21	kworker/u16:4+flush-8:0	09:28:00	5
3342409	99	40	37,2	cyclictest	3660616	-21	kworker/u16:1+events_unbound	09:47:55	5
3333816	2	40	3,30	sleep7	0	-21	swapper/7	06:57:58	7
3342414	99	39	37,2	cyclictest	3842656	-21	kworker/u16:3+events_unbound	10:58:46	6
3342414	99	39	37,2	cyclictest	3356777	-21	kworker/u16:0+flush-8:0	07:27:54	6
3342409	99	39	37,2	cyclictest	3963855	-21	kworker/u16:1+events_unbound	12:11:37	5
3342409	99	39	37,2	cyclictest	3915795	-21	kworker/u16:2+events_unbound	11:25:56	5
3342409	99	39	37,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:15:09	5
3342409	99	39	37,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	09:57:36	5
3342409	99	39	37,2	cyclictest	3634563	-21	kworker/u16:3+events_unbound	10:04:22	5
3342409	99	39	37,2	cyclictest	3312527	-21	kworker/u16:1+flush-8:0	07:13:06	5
3342414	99	38	36,2	cyclictest	3963855	-21	kworker/u16:1+events_unbound	11:45:26	6
3342414	99	38	36,2	cyclictest	3634563	-21	kworker/u16:3+events_unbound	09:59:29	6
3342414	99	38	36,2	cyclictest	3537615	-21	kworker/u16:2+events_unbound	08:47:57	6
3342414	99	38	36,2	cyclictest	3312527	-21	kworker/u16:1+flush-8:0	07:13:08	6
3342409	99	38	36,2	cyclictest	4049030	-21	kworker/u16:3+events_unbound	12:27:02	5
3342409	99	38	36,2	cyclictest	4049030	-21	kworker/u16:3+events_unbound	12:27:02	5
3342409	99	38	36,2	cyclictest	3939546	-21	kworker/u16:0+flush-8:0	12:13:09	5
3342409	99	38	36,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:53:15	5
3342409	99	38	36,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:47:18	5
3342409	99	38	36,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	10:20:18	5
3342409	99	38	36,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:23:45	5
3342409	99	38	36,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	10:23:45	5
3342409	99	38	36,2	cyclictest	3537615	-21	kworker/u16:2+events_unbound	09:19:25	5
3342409	99	38	36,2	cyclictest	3498052	-21	kworker/u16:3+events_unbound	09:10:06	5
3342409	99	38	35,2	cyclictest	3963855	-21	kworker/u16:1+flush-8:0	11:43:09	5
3342409	99	37	35,2	cyclictest	3634563	-21	kworker/u16:3+events_unbound	10:10:45	5
3342409	99	37	35,2	cyclictest	3587652	-21	kworker/u16:4+events_unbound	09:35:42	5
3342409	99	37	35,2	cyclictest	3498052	-21	kworker/u16:3+events_unbound	08:58:07	5
3342409	99	37	34,2	cyclictest	3498052	-21	kworker/u16:3+flush-8:0	08:52:55	5
3342404	99	37	34,2	cyclictest	3963855	-21	kworker/u16:1+flush-8:0	11:47:38	4
3342414	99	36	34,2	cyclictest	3694759	-21	kworker/u16:0+events_unbound	11:20:16	6
3342414	99	36	34,2	cyclictest	3672725	-21	kworker/u16:2+events_unbound	09:54:46	6
3342414	99	36	34,2	cyclictest	3342169	-21	kworker/u16:2+flush-8:0	07:33:05	6
3342414	99	36	34,2	cyclictest	3342169	-21	kworker/u16:2+flush-8:0	07:33:05	6
3342409	99	36	34,2	cyclictest	3767375	-21	kworker/u16:3+events_unbound	10:30:24	5
3342409	99	36	34,2	cyclictest	3537615	-21	kworker/u16:2+events_unbound	09:14:14	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17