OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Tue May 05, 2026 12:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1456471	99	56	54,2	cyclictest	1781090	-21	kworker/u16:1+events_unbound	10:14:00	6
1456467	99	56	54,2	cyclictest	1839405	-21	kworker/u16:2+events_unbound	10:29:04	5
1455958	2	55	45,7	sleep4	0	-21	swapper/4	07:05:49	4
1706847	2	54	0,0	sleep7	1706850	-21	cut	09:13:56	7
1456471	99	54	52,2	cyclictest	1613264	-21	kworker/u16:3+events_unbound	08:59:07	6
1456471	99	54	51,2	cyclictest	1479493	-21	kworker/u16:4+events_unbound	07:38:53	6
1456467	99	54	51,2	cyclictest	1768290	-21	kworker/u16:0+flush-8:0	11:13:52	5
1456467	99	53	51,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	11:59:08	5
1456467	99	52	50,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	10:19:08	5
1456467	99	52	49,2	cyclictest	1986607	-21	kworker/u16:1+flush-8:0	12:13:53	5
1456467	99	52	49,2	cyclictest	1565991	-21	kworker/u16:4+flush-8:0	08:13:53	5
1455932	2	51	41,7	sleep5	0	-21	swapper/5	07:05:26	5
1456471	99	50	47,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	11:13:50	6
1456467	99	50	47,2	cyclictest	2034686	-21	kworker/u16:3+events_unbound	12:09:08	5
1456467	99	48	45,2	cyclictest	1662357	-21	kworker/u16:1+flush-8:0	09:24:06	5
1456467	99	48	45,2	cyclictest	1613264	-21	kworker/u16:3+flush-8:0	08:58:52	5
1456471	99	46	44,2	cyclictest	1768290	-21	kworker/u16:0+flush-8:0	11:29:03	6
1456471	99	46	44,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	10:39:10	6
1456471	99	46	44,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	10:39:10	6
1456467	99	46	44,2	cyclictest	2034686	-21	kworker/u16:3+flush-8:0	12:34:05	5
1456471	99	45	43,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	11:54:11	6
1456467	99	45	43,2	cyclictest	1662357	-21	kworker/u16:1+events_unbound	09:13:52	5
1456471	99	44	42,2	cyclictest	1728495	-21	kworker/u16:4+flush-8:0	09:34:08	6
1456471	99	44	42,2	cyclictest	1585079	-21	kworker/u16:1+events_unbound	08:29:07	6
1456471	99	44	42,2	cyclictest	1522023	-21	kworker/u16:0+events_unbound	07:54:08	6
1456467	99	44	41,2	cyclictest	1585079	-21	kworker/u16:1+flush-8:0	08:38:53	5
1456467	99	44	41,2	cyclictest	1454527	-21	kworker/u16:1+events_unbound	07:49:07	5
1456467	99	44	41,2	cyclictest	1454527	-21	kworker/u16:1+events_unbound	07:49:07	5
1456467	99	44	41,2	cyclictest	1193014	-21	kworker/u16:3+events_unbound	07:28:53	5
1456472	99	43	41,1	cyclictest	1848512	-21	ssh	10:24:09	7
1456472	99	43	40,2	cyclictest	1564951	-21	ntpq	07:59:05	7
1456472	99	43	39,2	cyclictest	2105955	-21	ssh	12:09:06	7
1456471	99	43	41,2	cyclictest	1839405	-21	kworker/u16:2+events_unbound	11:04:11	6
1456467	99	43	41,2	cyclictest	2109265	-21	kworker/u16:4+flush-8:0	12:19:08	5
1456467	99	43	39,4	cyclictest	1768290	-21	kworker/u16:0+flush-8:0	11:03:38	5
1456472	99	42	39,2	cyclictest	1594218	-21	smart_sda	08:14:06	7
1456472	99	42	0,40	cyclictest	2170568	-21	latency_hist	12:38:37	7
1456467	99	42	40,2	cyclictest	1986607	-21	kworker/u16:1+events_unbound	11:33:57	5
1456471	99	41	38,2	cyclictest	1715090	-21	kworker/u16:2+events_unbound	09:18:53	6
1456467	99	41	39,2	cyclictest	1986607	-21	kworker/u16:1+events_unbound	11:39:04	5
1447358	2	41	3,31	sleep7	0	-21	swapper/7	07:03:52	7
1456472	99	40	39,0	cyclictest	0	-21	swapper/7	07:44:06	7
1456471	99	40	38,2	cyclictest	1768290	-21	kworker/u16:0+flush-8:0	10:44:06	6
1456467	99	40	38,2	cyclictest	1537187	-21	kworker/u16:2+events_unbound	07:59:38	5
1456467	99	40	38,2	cyclictest	1479493	-21	kworker/u16:4+events_unbound	07:34:06	5
1456472	99	39	38,0	cyclictest	0	-21	swapper/7	10:45:57	7
1456471	99	39	37,2	cyclictest	2034686	-21	kworker/u16:3+events_unbound	12:35:29	6
1456471	99	39	37,2	cyclictest	2034686	-21	kworker/u16:3+events_unbound	12:24:03	6
1456471	99	39	37,2	cyclictest	1986607	-21	kworker/u16:1+events_unbound	12:17:44	6
1456471	99	39	37,2	cyclictest	1839405	-21	kworker/u16:2+events_unbound	10:35:41	6
1456471	99	39	37,2	cyclictest	1728494	-21	kworker/u16:3+events_unbound	09:48:37	6
1456471	99	39	37,2	cyclictest	1585079	-21	kworker/u16:1+events_unbound	08:13:58	6
1456471	99	39	37,2	cyclictest	1522023	-21	kworker/u16:0+flush-8:0	08:04:06	6
1456471	99	39	36,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	10:04:11	6
1456467	99	39	37,2	cyclictest	2034686	-21	kworker/u16:3+events_unbound	12:26:12	5
1456467	99	39	36,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	11:54:13	5
1456467	99	39	36,2	cyclictest	1740502	-21	kworker/u16:5+events_unbound	09:57:37	5
1456472	99	38	37,0	cyclictest	0	-21	swapper/7	10:29:49	7
1456471	99	38	36,2	cyclictest	2034686	-21	kworker/u16:3+events_unbound	12:08:13	6
1456471	99	38	36,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	10:21:21	6
1456471	99	38	36,2	cyclictest	1662357	-21	kworker/u16:1+events_unbound	09:31:33	6
1456467	99	38	36,2	cyclictest	1595267	-21	kworker/u16:2+events_unbound	08:19:01	5
1456467	99	38	35,2	cyclictest	1728494	-21	kworker/u16:3+events_unbound	09:38:53	5
1456472	99	37	36,0	cyclictest	0	-21	swapper/7	11:47:13	7
1456472	99	37	34,2	cyclictest	1946599	-21	ntp_states	11:04:07	7
1456471	99	37	35,2	cyclictest	2011479	-21	kworker/u16:2+events_unbound	11:38:21	6
1456471	99	37	35,2	cyclictest	1740502	-21	kworker/u16:5+events_unbound	09:52:57	6
1456467	99	37	35,2	cyclictest	1839405	-21	kworker/u16:2+events_unbound	10:49:06	5
1456467	99	37	34,2	cyclictest	1652649	-21	kworker/u16:0+events_unbound	09:03:52	5
1456467	99	37	34,2	cyclictest	1522023	-21	kworker/u16:0+flush-8:0	08:09:04	5
1456471	99	36	34,2	cyclictest	1986607	-21	kworker/u16:1+events_unbound	12:09:49	6
1456471	99	36	34,2	cyclictest	1905773	-21	kworker/u16:3+events_unbound	10:57:44	6
1456471	99	36	34,2	cyclictest	1768290	-21	kworker/u16:0+flush-8:0	10:25:44	6
1456471	99	36	34,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	11:49:28	6
1456471	99	36	34,2	cyclictest	1662357	-21	kworker/u16:1+events_unbound	09:09:57	6
1456471	99	36	33,2	cyclictest	1522023	-21	kworker/u16:0+events_unbound	08:23:52	6
1456467	99	36	34,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	12:30:53	5
1456467	99	36	33,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	11:28:45	5
1456467	99	36	33,2	cyclictest	1585079	-21	kworker/u16:1+flush-8:0	08:44:02	5
1456471	99	35	33,2	cyclictest	1839405	-21	kworker/u16:2+events_unbound	10:53:01	6
1456471	99	35	33,2	cyclictest	1740502	-21	kworker/u16:5+events_unbound	09:41:04	6
1456471	99	35	33,2	cyclictest	1537187	-21	kworker/u16:2+flush-8:0	07:59:02	6
1456471	99	35	33,2	cyclictest	1193014	-21	kworker/u16:3+flush-8:0	07:33:57	6
1456471	99	35	32,2	cyclictest	1986607	-21	kworker/u16:1+events_unbound	11:43:40	6
1456471	99	35	32,2	cyclictest	1585079	-21	kworker/u16:1+flush-8:0	08:38:54	6
1456467	99	35	34,1	cyclictest	1662357	-21	kworker/u16:1+events_unbound	09:20:38	5
1456467	99	35	33,2	cyclictest	1781090	-21	kworker/u16:1+flush-8:0	10:14:08	5
1456467	99	35	33,2	cyclictest	1781090	-21	kworker/u16:1+events_unbound	10:38:16	5
1456467	99	35	33,2	cyclictest	1728494	-21	kworker/u16:3+events_unbound	09:34:11	5
1456467	99	35	32,2	cyclictest	1740502	-21	kworker/u16:5+flush-8:0	10:08:53	5
1456472	99	34	33,0	cyclictest	0	-21	swapper/7	11:34:44	7
1456472	99	34	33,0	cyclictest	0	-21	swapper/7	09:32:02	7
1456472	99	34	33,0	cyclictest	0	-21	swapper/7	08:08:41	7
1456471	99	34	32,2	cyclictest	2034686	-21	kworker/u16:3+events_unbound	12:19:10	6
1456471	99	34	32,2	cyclictest	2011479	-21	kworker/u16:2+events_unbound	11:41:33	6
1456471	99	34	32,2	cyclictest	1768290	-21	kworker/u16:0+events_unbound	12:32:25	6
1456471	99	34	32,2	cyclictest	1740502	-21	kworker/u16:5+events_unbound	10:11:33	6
1456471	99	34	32,2	cyclictest	1740502	-21	kworker/u16:5+events_unbound	10:00:13	6
1456471	99	34	32,2	cyclictest	1740502	-21	kworker/u16:5+events_unbound	10:00:13	6
1456471	99	34	32,2	cyclictest	1652649	-21	kworker/u16:0+events_unbound	09:15:20	6
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17