OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Tue Aug 04, 2026 12:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2428412	2	55	21,29	sleep7	0	-21	swapper/7	07:08:36	7
2428727	99	51	45,5	cyclictest	3145953	-21	latency_hist	12:23:36	7
2428714	99	47	43,3	cyclictest	2442434	-21	kworker/u16:2+flush-8:0	07:23:37	4
2428177	2	47	37,7	sleep5	0	-21	swapper/5	07:05:21	5
2428723	99	44	40,3	cyclictest	2636518	-21	kworker/u16:0+flush-8:0	08:54:02	6
2428714	99	44	42,2	cyclictest	2129741	-21	kworker/u16:0+events_unbound	08:03:50	4
2428727	99	43	38,4	cyclictest	2626678	-21	latency_hist	08:48:36	7
2428714	99	41	39,2	cyclictest	2500706	-21	kworker/u16:3+flush-8:0	08:13:54	4
2419148	2	40	29,8	sleep4	0	-21	swapper/4	07:03:44	4
2428727	99	39	34,4	cyclictest	2961444	-21	latency_hist	11:08:35	7
2428714	99	39	36,2	cyclictest	2776481	-21	kworker/u16:4+events_unbound	10:43:51	4
2428720	99	36	31,4	cyclictest	2689989	-21	kworker/u16:0+flush-8:0	10:13:36	5
2428714	99	35	33,2	cyclictest	3052565	-21	kworker/u16:0+events_unbound	11:58:50	4
2844220	2	34	0,1	chrt	2844221	-21	kthreadcore	10:18:58	7
2428714	99	33	31,2	cyclictest	2689989	-21	kworker/u16:0+events_unbound	10:34:09	4
2428160	2	33	23,7	sleep6	0	-21	swapper/6	07:05:06	6
2428727	99	32	31,0	cyclictest	0	-21	swapper/7	09:29:02	7
2428727	99	32	31,0	cyclictest	0	-21	swapper/7	08:48:37	7
2428714	99	32	29,2	cyclictest	2970598	-21	kworker/u16:0+flush-8:0	11:13:50	4
2428714	99	32	29,2	cyclictest	2970598	-21	kworker/u16:0+flush-8:0	11:13:50	4
2428720	99	31	29,2	cyclictest	2776481	-21	kworker/u16:4+flush-8:0	11:39:05	5
2428714	99	29	27,2	cyclictest	2986063	-21	kworker/u16:2+events_unbound	11:43:49	4
2428714	99	29	27,2	cyclictest	2776481	-21	kworker/u16:4+flush-8:0	11:33:10	4
2428727	99	28	27,0	cyclictest	0	-21	swapper/7	11:56:47	7
2428727	99	28	27,0	cyclictest	0	-21	swapper/7	11:56:47	7
2428720	99	28	27,1	cyclictest	2689989	-21	kworker/u16:0+events_unbound	09:28:35	5
2428714	99	28	26,2	cyclictest	2776481	-21	kworker/u16:4+events_unbound	11:28:36	4
2428727	99	27	26,0	cyclictest	0	-21	swapper/7	08:56:10	7
2428727	99	27	26,0	cyclictest	0	-21	swapper/7	07:57:07	7
2428727	99	27	26,0	cyclictest	0	-21	swapper/7	07:14:09	7
2428714	99	27	25,2	cyclictest	2776481	-21	kworker/u16:4+events_unbound	10:49:02	4
2428714	99	27	24,2	cyclictest	2986063	-21	kworker/u16:2+flush-8:0	12:03:52	4
2428727	99	26	25,0	cyclictest	0	-21	swapper/7	08:06:14	7
2428720	99	26	22,3	cyclictest	2776481	-21	kworker/u16:4+flush-8:0	10:23:36	5
2428714	99	26	24,2	cyclictest	2776481	-21	kworker/u16:4+events_unbound	09:59:10	4
2509182	2	25	0,0	sleep5	0	-21	swapper/5	07:44:06	5
2428727	99	25	24,0	cyclictest	0	-21	swapper/7	08:40:26	7
2428727	99	25	24,0	cyclictest	0	-21	swapper/7	07:32:22	7
3013634	2	24	0,1	chrt	3013635	-21	kthreadcore	11:28:54	7
2428727	99	24	23,0	cyclictest	0	-21	swapper/7	08:37:34	7
2428727	99	24	23,0	cyclictest	0	-21	swapper/7	08:37:34	7
2428727	99	24	19,4	cyclictest	648	-21	systemd-journal	10:28:36	7
2428714	99	24	23,1	cyclictest	2735574	-21	kworker/u16:2+events_unbound	09:38:17	4
2428714	99	24	22,2	cyclictest	2714815	-21	kworker/u16:3+events_unbound	09:39:14	4
2428714	99	24	22,2	cyclictest	2500706	-21	kworker/u16:3+flush-8:0	08:49:01	4
2428714	99	24	21,2	cyclictest	2689989	-21	kworker/u16:0+events_unbound	09:43:38	4
2428727	99	23	22,0	cyclictest	0	-21	swapper/7	07:40:34	7
2428727	99	23	22,0	cyclictest	0	-21	swapper/7	07:34:58	7
2428714	99	23	22,1	cyclictest	2735574	-21	kworker/u16:2+events_unbound	09:52:45	4
2428714	99	23	21,2	cyclictest	2689989	-21	kworker/u16:0+events_unbound	10:33:30	4
2428714	99	23	21,2	cyclictest	2689989	-21	kworker/u16:0+events_unbound	09:18:37	4
2884252	2	22	0,1	chrt	2875631	-21	/usr/sbin/munin	10:34:05	7
2428727	99	22	21,0	cyclictest	0	-21	swapper/7	10:15:19	7
2428727	99	22	21,0	cyclictest	0	-21	swapper/7	09:59:25	7
2428727	99	22	21,0	cyclictest	0	-21	swapper/7	07:26:55	7
2428720	99	22	19,2	cyclictest	2529844	-21	kworker/u16:4+flush-8:0	09:18:56	5
2428714	99	22	20,2	cyclictest	3010682	-21	kworker/u16:1+events_unbound	12:27:18	4
2428714	99	22	20,2	cyclictest	2776481	-21	kworker/u16:4+events_unbound	10:19:06	4
2428714	99	22	19,2	cyclictest	2735574	-21	kworker/u16:2+flush-8:0	09:53:46	4
2428727	99	21	20,0	cyclictest	0	-21	swapper/7	12:18:18	7
2428727	99	21	20,0	cyclictest	0	-21	swapper/7	11:18:28	7
2428727	99	21	20,0	cyclictest	0	-21	swapper/7	11:18:28	7
2428727	99	21	20,0	cyclictest	0	-21	swapper/7	08:16:42	7
2428727	99	21	20,0	cyclictest	0	-21	swapper/7	07:59:58	7
2428727	99	21	19,1	cyclictest	0	-21	swapper/7	10:49:21	7
2428714	99	21	18,2	cyclictest	2986063	-21	kworker/u16:2+events_unbound	11:38:50	4
2428727	99	20	19,0	cyclictest	0	-21	swapper/7	11:42:11	7
2428727	99	20	19,0	cyclictest	0	-21	swapper/7	08:26:55	7
2428727	99	20	19,0	cyclictest	0	-21	swapper/7	07:44:07	7
2428727	99	20	15,4	cyclictest	2578048	-21	latency_hist	08:23:36	7
2428727	99	20	0,19	cyclictest	0	-21	swapper/7	09:26:19	7
2428723	99	20	16,3	cyclictest	2428430	-21	kworker/u16:3+flush-8:0	07:09:02	6
2428714	99	20	18,2	cyclictest	3096875	-21	kworker/u16:3+flush-8:0	12:08:58	4
2428714	99	20	18,2	cyclictest	2529844	-21	kworker/u16:4+events_unbound	08:28:54	4
2428714	99	20	18,2	cyclictest	2129741	-21	kworker/u16:0+flush-8:0	07:13:54	4
2428714	99	20	17,2	cyclictest	2689989	-21	kworker/u16:0+events_unbound	10:38:38	4
2428727	99	19	18,0	cyclictest	0	-21	swapper/7	10:57:08	7
2428727	99	19	18,0	cyclictest	0	-21	swapper/7	10:39:33	7
2428727	99	19	18,0	cyclictest	0	-21	swapper/7	09:48:25	7
2428727	99	19	17,1	cyclictest	2737088	-21	ssh	09:34:28	7
2428720	99	19	17,2	cyclictest	2636518	-21	kworker/u16:0+flush-8:0	08:53:56	5
2428714	99	19	17,2	cyclictest	2587648	-21	kworker/u16:1+flush-8:0	09:25:22	4
2428714	99	19	17,2	cyclictest	2500706	-21	kworker/u16:3+events_unbound	07:58:51	4
2428727	99	18	17,0	cyclictest	0	-21	swapper/7	10:07:59	7
2428727	99	18	17,0	cyclictest	0	-21	swapper/7	08:29:04	7
2428714	99	18	16,2	cyclictest	3010682	-21	kworker/u16:1+events_unbound	11:49:33	4
2428727	99	17	16,0	cyclictest	0	-21	swapper/7	12:36:27	7
2428727	99	17	16,0	cyclictest	0	-21	swapper/7	12:36:27	7
2428727	99	17	16,0	cyclictest	0	-21	swapper/7	12:28:26	7
2428727	99	17	16,0	cyclictest	0	-21	swapper/7	10:24:15	7
2428720	99	17	15,2	cyclictest	2689989	-21	kworker/u16:0+flush-8:0	10:39:06	5
2428714	99	17	15,2	cyclictest	2529844	-21	kworker/u16:4+flush-8:0	09:14:02	4
2428714	99	17	15,2	cyclictest	2529844	-21	kworker/u16:4+flush-8:0	09:14:02	4
2428714	99	17	15,2	cyclictest	2428430	-21	kworker/u16:3+flush-8:0	07:33:56	4
2428727	99	16	15,0	cyclictest	0	-21	swapper/7	09:42:12	7
2428727	99	16	15,0	cyclictest	0	-21	swapper/7	07:22:32	7
2428727	99	16	13,2	cyclictest	125	-21	kswapd0	10:58:50	7
2428720	99	16	13,2	cyclictest	2970598	-21	kworker/u16:0+flush-8:0	11:23:41	5
2428714	99	16	14,2	cyclictest	2129741	-21	kworker/u16:0+events_unbound	07:09:01	4
2428727	99	15	14,0	cyclictest	0	-21	swapper/7	09:01:29	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17