OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sun Feb 15, 2026 12:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3599697	2	57	47,7	sleep5	0	-21	swapper/5	07:03:30	5
3599831	2	55	45,7	sleep6	0	-21	swapper/6	07:05:23	6
3600131	99	52	49,2	cyclictest	4065257	-21	kworker/u16:3+events_unbound	12:05:52	4
3600135	99	51	49,2	cyclictest	79023	-21	kworker/u16:1+flush-8:0	12:15:53	5
3600131	99	51	49,2	cyclictest	3795277	-21	kworker/u16:1+events_unbound	10:11:04	4
3600135	99	50	48,2	cyclictest	3795277	-21	kworker/u16:1+flush-8:0	09:16:06	5
3600131	99	50	48,2	cyclictest	4065257	-21	kworker/u16:3+events_unbound	11:56:08	4
3600131	99	49	46,2	cyclictest	3922240	-21	kworker/u16:0+flush-8:0	11:01:07	4
3600131	99	49	46,2	cyclictest	3922240	-21	kworker/u16:0+flush-8:0	11:01:07	4
3600141	99	48	42,5	cyclictest	3708895	-21	latency_hist	08:00:38	7
3600137	99	48	45,2	cyclictest	2175268	-21	kworker/u16:1+flush-8:0	07:25:38	6
3600131	99	48	45,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	11:05:51	4
3600135	99	47	45,2	cyclictest	4112801	-21	kworker/u16:1+events_unbound	11:35:53	5
3600135	99	47	45,2	cyclictest	3892475	-21	kworker/u16:3+events_unbound	09:36:11	5
3600131	99	47	44,2	cyclictest	4004102	-21	kworker/u16:2+events_unbound	10:21:11	4
3599572	2	47	37,7	sleep4	0	-21	swapper/4	07:01:44	4
3600137	99	46	44,2	cyclictest	3922240	-21	kworker/u16:0+flush-8:0	11:15:38	6
3600137	99	45	43,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	09:41:04	6
3600131	99	44	41,2	cyclictest	3814365	-21	kworker/u16:4+flush-8:0	09:41:08	4
3600141	99	43	38,4	cyclictest	3869742	-21	latency_hist	09:20:38	7
3600137	99	43	40,2	cyclictest	52270	-21	kworker/u16:0+events_unbound	12:25:52	6
3600135	99	43	41,2	cyclictest	3922240	-21	kworker/u16:0+flush-8:0	11:01:08	5
3600135	99	43	41,2	cyclictest	3922240	-21	kworker/u16:0+flush-8:0	11:01:08	5
3600135	99	43	41,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	10:30:54	5
3600135	99	43	40,2	cyclictest	4065257	-21	kworker/u16:3+flush-8:0	11:30:52	5
3600131	99	43	40,2	cyclictest	3814365	-21	kworker/u16:4+flush-8:0	09:45:53	4
3600135	99	42	40,2	cyclictest	79023	-21	kworker/u16:1+events_unbound	12:26:06	5
3600135	99	42	40,2	cyclictest	52270	-21	kworker/u16:0+events_unbound	11:55:00	5
3600135	99	42	40,2	cyclictest	4065257	-21	kworker/u16:3+events_unbound	11:47:07	5
3600131	99	42	39,2	cyclictest	3879424	-21	kworker/u16:2+events_unbound	09:25:51	4
3600137	99	41	39,2	cyclictest	2175268	-21	kworker/u16:1+flush-8:0	08:31:02	6
3600135	99	41	39,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	10:12:55	5
3600135	99	41	39,2	cyclictest	2175268	-21	kworker/u16:1+events_unbound	08:11:08	5
3600135	99	41	38,2	cyclictest	4112801	-21	kworker/u16:1+events_unbound	11:15:39	5
3600137	99	40	38,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	11:35:37	6
3600135	99	40	38,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	10:55:27	5
3600135	99	40	38,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	10:46:55	5
3600135	99	40	38,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	09:43:03	5
3600131	99	40	38,2	cyclictest	4004102	-21	kworker/u16:2+flush-8:0	10:16:07	4
3600137	99	39	37,2	cyclictest	3536453	-21	kworker/u16:2+events_unbound	07:45:38	6
3600137	99	39	36,2	cyclictest	3795277	-21	kworker/u16:1+flush-8:0	09:55:54	6
3600135	99	39	37,2	cyclictest	4065257	-21	kworker/u16:3+events_unbound	12:10:08	5
3600135	99	39	37,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	10:03:15	5
3600135	99	39	37,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	09:54:56	5
3600135	99	39	36,2	cyclictest	4050515	-21	kworker/u16:2+events_unbound	10:40:50	5
3600135	99	39	36,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	11:29:12	5
3600135	99	39	36,2	cyclictest	3795277	-21	kworker/u16:1+events_unbound	09:20:48	5
3600131	99	39	37,2	cyclictest	2175268	-21	kworker/u16:1+flush-8:0	07:31:08	4
3600131	99	39	36,2	cyclictest	3795277	-21	kworker/u16:1+events_unbound	08:50:52	4
3590760	2	39	3,31	sleep7	0	-21	swapper/7	07:00:51	7
3600135	99	38	36,2	cyclictest	52270	-21	kworker/u16:0+events_unbound	12:23:00	5
3600135	99	38	36,2	cyclictest	4065257	-21	kworker/u16:3+events_unbound	11:24:11	5
3600135	99	38	36,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	11:08:47	5
3600131	99	38	35,2	cyclictest	3814365	-21	kworker/u16:4+flush-8:0	09:31:08	4
3600137	99	37	35,2	cyclictest	52270	-21	kworker/u16:0+events_unbound	12:01:07	6
3600135	99	37	35,2	cyclictest	4065257	-21	kworker/u16:3+events_unbound	10:57:40	5
3600135	99	37	35,2	cyclictest	4050515	-21	kworker/u16:2+events_unbound	10:37:03	5
3600135	99	37	35,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	11:14:11	5
3600135	99	37	35,2	cyclictest	3814113	-21	kworker/u16:0+events_unbound	09:07:52	5
3600135	99	37	35,2	cyclictest	3795277	-21	kworker/u16:1+events_unbound	09:59:20	5
3600135	99	37	35,2	cyclictest	3709274	-21	kworker/u16:3+events_unbound	08:45:41	5
3600135	99	37	35,2	cyclictest	2175268	-21	kworker/u16:1+events_unbound	08:06:01	5
3600131	99	37	35,2	cyclictest	4016502	-21	kworker/u16:1+events_unbound	10:36:12	4
3600131	99	37	33,3	cyclictest	3680414	-21	kworker/u16:0+flush-8:0	07:46:04	4
3600137	99	36	33,3	cyclictest	4004102	-21	kworker/u16:2+flush-8:0	10:21:05	6
3600137	99	36	33,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	09:15:41	6
3600135	99	36	34,2	cyclictest	79023	-21	kworker/u16:1+events_unbound	12:13:20	5
3600135	99	36	34,2	cyclictest	3892475	-21	kworker/u16:3+events_unbound	09:29:44	5
3600135	99	36	34,2	cyclictest	3795277	-21	kworker/u16:1+events_unbound	10:09:51	5
3600135	99	36	34,2	cyclictest	127741	-21	kworker/u16:4+events_unbound	12:31:09	5
3600135	99	36	33,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	10:25:39	5
3600131	99	36	34,2	cyclictest	3795277	-21	kworker/u16:1+flush-8:0	09:21:10	4
3600131	99	36	33,2	cyclictest	52270	-21	kworker/u16:0+events_unbound	12:10:51	4
3600137	99	35	33,2	cyclictest	3814113	-21	kworker/u16:0+events_unbound	09:10:52	6
3600137	99	35	32,2	cyclictest	127740	-21	kworker/u16:3+events_unbound	12:30:55	6
3600135	99	35	33,2	cyclictest	4065257	-21	kworker/u16:3+events_unbound	12:01:05	5
3600135	99	35	33,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	10:21:39	5
3600135	99	35	33,2	cyclictest	3814113	-21	kworker/u16:0+events_unbound	09:14:09	5
3600135	99	35	33,2	cyclictest	3795277	-21	kworker/u16:1+flush-8:0	08:51:05	5
3600135	99	35	33,2	cyclictest	2175268	-21	kworker/u16:1+flush-8:0	07:50:59	5
3600131	99	35	33,2	cyclictest	4112801	-21	kworker/u16:1+events_unbound	11:36:04	4
3600131	99	35	33,2	cyclictest	4016502	-21	kworker/u16:1+events_unbound	10:45:55	4
3600137	99	34	32,2	cyclictest	3795277	-21	kworker/u16:1+events_unbound	09:26:07	6
3600135	99	34	32,2	cyclictest	3814365	-21	kworker/u16:4+events_unbound	09:46:09	5
3600135	99	34	32,2	cyclictest	3536453	-21	kworker/u16:2+events_unbound	07:37:29	5
3600135	99	34	32,2	cyclictest	16528	-21	kworker/u16:2+events_unbound	11:44:11	5
3600135	99	34	32,2	cyclictest	16528	-21	kworker/u16:2+events_unbound	11:44:11	5
3600131	99	34	32,2	cyclictest	52270	-21	kworker/u16:0+events_unbound	12:00:53	4
3600137	99	33	31,2	cyclictest	3795277	-21	kworker/u16:1+flush-8:0	09:21:03	6
3600135	99	33	31,2	cyclictest	52270	-21	kworker/u16:0+events_unbound	11:57:58	5
3600135	99	33	31,2	cyclictest	3892475	-21	kworker/u16:3+events_unbound	09:31:31	5
3600131	99	33	31,2	cyclictest	3795277	-21	kworker/u16:1+events_unbound	09:40:38	4
3600131	99	33	29,3	cyclictest	3709274	-21	kworker/u16:3+flush-8:0	08:41:04	4
3600137	99	32	30,2	cyclictest	3922240	-21	kworker/u16:0+flush-8:0	10:50:55	6
3600137	99	32	30,2	cyclictest	3922240	-21	kworker/u16:0+events_unbound	11:16:04	6
3600137	99	32	30,2	cyclictest	2175268	-21	kworker/u16:1+flush-8:0	07:15:50	6
3600137	99	32	29,3	cyclictest	2175268	-21	kworker/u16:1+flush-8:0	08:05:54	6
3600137	99	32	29,2	cyclictest	79023	-21	kworker/u16:1+events_unbound	12:10:53	6
3600135	99	32	30,2	cyclictest	3709274	-21	kworker/u16:3+events_unbound	08:43:48	5
3600135	99	32	30,2	cyclictest	2175268	-21	kworker/u16:1+flush-8:0	08:31:07	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17