OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Fri May 22, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2784384	2	65	54,7	sleep5	0	-21	swapper/5	07:04:08	5
2784574	2	58	48,7	sleep4	0	-21	swapper/4	07:06:48	4
2784459	2	49	25,7	sleep6	0	-21	swapper/6	07:05:13	6
2784913	99	45	43,2	cyclictest	3385501	-21	kworker/u16:0+events_unbound	12:17:52	5
2784913	99	41	39,2	cyclictest	3165881	-21	kworker/u16:3+flush-8:0	11:07:54	5
2784424	2	41	6,30	sleep7	0	-21	swapper/7	07:04:42	7
2784913	99	38	36,2	cyclictest	3227100	-21	kworker/u16:0+flush-8:0	10:52:53	5
2784913	99	38	35,3	cyclictest	2097566	-21	kworker/u16:2+events_unbound	09:17:53	5
2784908	99	38	36,2	cyclictest	3385501	-21	kworker/u16:0+events_unbound	12:16:05	4
2784908	99	37	35,2	cyclictest	3361185	-21	kworker/u16:3+events_unbound	11:28:39	4
2784908	99	37	35,2	cyclictest	3240466	-21	kworker/u16:1+flush-8:0	10:45:51	4
2784908	99	37	35,2	cyclictest	3113950	-21	kworker/u16:3+flush-8:0	09:50:23	4
2784908	99	37	35,2	cyclictest	2904192	-21	kworker/u16:0+events_unbound	09:34:39	4
2784908	99	37	34,2	cyclictest	3385501	-21	kworker/u16:0+flush-8:0	12:32:41	4
2784908	99	37	34,2	cyclictest	3385501	-21	kworker/u16:0+flush-8:0	12:32:41	4
2784908	99	37	34,2	cyclictest	3200059	-21	kworker/u16:2+flush-8:0	10:33:17	4
2784922	99	36	35,0	cyclictest	0	-21	swapper/7	10:16:50	7
2784922	99	36	0,34	cyclictest	5819	-21	gnome-shell	11:28:39	7
2784913	99	36	34,2	cyclictest	3361185	-21	kworker/u16:3+flush-8:0	11:42:25	5
2784913	99	36	34,2	cyclictest	3009089	-21	kworker/u16:1+flush-8:0	09:32:26	5
2784908	99	36	34,2	cyclictest	3385501	-21	kworker/u16:0+flush-8:0	12:06:54	4
2784908	99	36	34,2	cyclictest	3346640	-21	kworker/u16:2+flush-8:0	11:37:02	4
2784908	99	36	34,2	cyclictest	3009089	-21	kworker/u16:1+flush-8:0	09:41:30	4
2784908	99	36	33,2	cyclictest	2904192	-21	kworker/u16:0+events_unbound	09:54:02	4
2784922	99	35	33,1	cyclictest	3019039	-21	diskmemload	11:40:50	7
2784922	99	35	33,1	cyclictest	0	-21	swapper/7	10:49:05	7
2784908	99	35	33,2	cyclictest	3385501	-21	kworker/u16:0+events_unbound	11:49:34	4
2784908	99	35	33,2	cyclictest	3385501	-21	kworker/u16:0+events_unbound	11:49:34	4
2784908	99	35	33,2	cyclictest	3346640	-21	kworker/u16:2+events_unbound	11:19:50	4
2784908	99	35	33,2	cyclictest	3150996	-21	kworker/u16:4+flush-8:0	10:07:06	4
2784908	99	35	33,2	cyclictest	3150996	-21	kworker/u16:4+events_unbound	10:19:26	4
2784908	99	35	33,2	cyclictest	3009089	-21	kworker/u16:1+flush-8:0	09:26:29	4
2784922	99	34	33,0	cyclictest	0	-21	swapper/7	11:06:30	7
2784913	99	34	32,2	cyclictest	3346640	-21	kworker/u16:2+events_unbound	11:27:13	5
2784913	99	34	32,2	cyclictest	2904192	-21	kworker/u16:0+events_unbound	09:47:27	5
2784913	99	34	32,2	cyclictest	2904192	-21	kworker/u16:0+events_unbound	09:47:27	5
2784908	99	34	32,2	cyclictest	3385501	-21	kworker/u16:0+flush-8:0	12:24:49	4
2784908	99	34	32,2	cyclictest	3150996	-21	kworker/u16:4+flush-8:0	10:02:09	4
2784908	99	34	32,2	cyclictest	3009089	-21	kworker/u16:1+flush-8:0	09:13:31	4
2784908	99	34	32,2	cyclictest	3009089	-21	kworker/u16:1+events_unbound	09:18:05	4
2784908	99	34	32,2	cyclictest	2904192	-21	kworker/u16:0+flush-8:0	08:42:25	4
2784908	99	34	32,2	cyclictest	2904192	-21	kworker/u16:0+events_unbound	10:13:50	4
2784922	99	33	32,0	cyclictest	0	-21	swapper/7	12:30:38	7
2784922	99	33	32,0	cyclictest	0	-21	swapper/7	12:30:38	7
2784922	99	33	32,0	cyclictest	0	-21	swapper/7	11:09:34	7
2784913	99	33	31,2	cyclictest	3385501	-21	kworker/u16:0+events_unbound	11:57:33	5
2784913	99	33	31,2	cyclictest	3361185	-21	kworker/u16:3+flush-8:0	11:54:58	5
2784913	99	33	31,2	cyclictest	3227100	-21	kworker/u16:0+events_unbound	11:01:45	5
2784913	99	33	30,2	cyclictest	3165881	-21	kworker/u16:3+events_unbound	10:37:27	5
2784908	99	33	31,2	cyclictest	3385501	-21	kworker/u16:0+events_unbound	11:59:46	4
2784908	99	33	31,2	cyclictest	3361185	-21	kworker/u16:3+events_unbound	12:20:05	4
2784908	99	33	31,2	cyclictest	3309871	-21	kworker/u16:4+flush-8:0	12:10:29	4
2784908	99	33	31,2	cyclictest	3227100	-21	kworker/u16:0+flush-8:0	11:25:26	4
2784908	99	33	31,2	cyclictest	3165881	-21	kworker/u16:3+events_unbound	10:10:02	4
2784908	99	33	30,2	cyclictest	3227100	-21	kworker/u16:0+events_unbound	10:59:58	4
2784908	99	33	26,2	cyclictest	3113950	-21	kworker/u16:3+events_unbound	09:43:37	4
2784908	99	33	26,2	cyclictest	3113950	-21	kworker/u16:3+events_unbound	09:43:37	4
2784922	99	32	31,0	cyclictest	0	-21	swapper/7	12:35:45	7
2784922	99	32	31,0	cyclictest	0	-21	swapper/7	12:35:45	7
2784922	99	32	31,0	cyclictest	0	-21	swapper/7	10:38:39	7
2784922	99	32	31,0	cyclictest	0	-21	swapper/7	09:32:21	7
2784922	99	32	27,4	cyclictest	3483168	-21	latency_hist	12:17:30	7
2784913	99	32	30,2	cyclictest	3361185	-21	kworker/u16:3+flush-8:0	12:29:46	5
2784913	99	32	30,2	cyclictest	3361185	-21	kworker/u16:3+flush-8:0	12:29:46	5
2784913	99	32	30,2	cyclictest	3200059	-21	kworker/u16:2+flush-8:0	10:20:25	5
2784913	99	32	30,2	cyclictest	3009089	-21	kworker/u16:1+events_unbound	09:09:29	5
2784908	99	32	31,1	cyclictest	3150996	-21	kworker/u16:4+events_unbound	10:25:26	4
2784908	99	32	30,2	cyclictest	3361185	-21	kworker/u16:3+events_unbound	11:57:03	4
2784908	99	32	30,2	cyclictest	3165881	-21	kworker/u16:3+events_unbound	11:08:35	4
2784908	99	32	30,2	cyclictest	3150996	-21	kworker/u16:4+events_unbound	10:30:41	4
2784908	99	32	30,2	cyclictest	3009089	-21	kworker/u16:1+events_unbound	09:10:19	4
2784922	99	31	30,0	cyclictest	0	-21	swapper/7	11:55:41	7
2784922	99	31	30,0	cyclictest	0	-21	swapper/7	10:45:34	7
2784922	99	31	30,0	cyclictest	0	-21	swapper/7	09:36:21	7
2784922	99	31	30,0	cyclictest	0	-21	swapper/7	09:24:06	7
2784922	99	31	29,1	cyclictest	3335767	-21	ssh	11:15:42	7
2784922	99	31	29,1	cyclictest	3019039	-21	diskmemload	12:18:05	7
2784922	99	31	29,1	cyclictest	0	-21	swapper/7	09:59:34	7
2784913	99	31	29,2	cyclictest	3297837	-21	kworker/u16:2+flush-8:0	11:02:34	5
2784913	99	31	29,2	cyclictest	3165881	-21	kworker/u16:3+flush-8:0	10:48:21	5
2784913	99	31	29,2	cyclictest	3078253	-21	kworker/u16:2+events_unbound	10:07:12	5
2784913	99	31	29,2	cyclictest	2893881	-21	kworker/u16:4+flush-8:0	08:22:25	5
2784913	99	31	28,2	cyclictest	2904192	-21	kworker/u16:0+events_unbound	09:32:42	5
2784908	99	31	29,2	cyclictest	3309871	-21	kworker/u16:4+flush-8:0	11:13:50	4
2784908	99	31	29,2	cyclictest	3165881	-21	kworker/u16:3+events_unbound	10:50:15	4
2784908	99	31	29,2	cyclictest	2097566	-21	kworker/u16:2+events_unbound	07:07:59	4
2784922	99	30	29,0	cyclictest	0	-21	swapper/7	12:03:17	7
2784922	99	30	29,0	cyclictest	0	-21	swapper/7	09:48:59	7
2784922	99	30	28,1	cyclictest	3030355	-21	ssh	09:10:57	7
2784913	99	30	28,2	cyclictest	3385501	-21	kworker/u16:0+flush-8:0	11:46:46	5
2784913	99	30	28,2	cyclictest	3309871	-21	kworker/u16:4+flush-8:0	12:10:09	5
2784913	99	30	28,2	cyclictest	3009089	-21	kworker/u16:1+flush-8:0	09:26:19	5
2784913	99	30	28,2	cyclictest	2904192	-21	kworker/u16:0+flush-8:0	10:11:22	5
2784908	99	30	29,1	cyclictest	3361185	-21	kworker/u16:3+events_unbound	12:30:15	4
2784908	99	30	29,1	cyclictest	3361185	-21	kworker/u16:3+events_unbound	12:30:15	4
2784908	99	30	28,2	cyclictest	3385501	-21	kworker/u16:0+events_unbound	11:45:49	4
2784908	99	30	28,2	cyclictest	3165881	-21	kworker/u16:3+events_unbound	11:05:30	4
2784922	99	29	28,0	cyclictest	0	-21	swapper/7	12:25:45	7
2784922	99	29	28,0	cyclictest	0	-21	swapper/7	11:44:45	7
2784922	99	29	28,0	cyclictest	0	-21	swapper/7	10:22:18	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17