OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Thu Nov 20, 2025 12:43:31)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2432223	99	57	52,4	cyclictest	2466451	-21	latency_hist	15:38:39	7
2432219	99	55	53,2	cyclictest	2526752	-21	kworker/u16:3+events_unbound	16:08:29	6
2431819	2	53	19,30	sleep7	0	-21	swapper/7	15:22:14	7
2432223	99	52	47,4	cyclictest	2547206	-21	latency_hist	16:18:39	7
2432217	99	52	49,2	cyclictest	2678979	-21	kworker/u16:5+flush-8:0	18:39:06	5
2431896	2	52	42,7	sleep5	0	-21	swapper/5	15:23:17	5
2432223	99	51	50,0	cyclictest	0	-21	swapper/7	17:43:53	7
2432223	99	51	50,0	cyclictest	0	-21	swapper/7	17:43:53	7
2432217	99	51	49,2	cyclictest	2729411	-21	kworker/u16:0+flush-8:0	18:44:07	5
2432217	99	50	48,2	cyclictest	2982871	-21	kworker/u16:3+events_unbound	20:38:51	5
2432219	99	49	46,2	cyclictest	2456701	-21	kworker/u16:2+flush-8:0	16:14:05	6
2432217	99	49	47,2	cyclictest	2849793	-21	kworker/u16:3+flush-8:0	18:49:09	5
2432217	99	48	46,2	cyclictest	2931572	-21	kworker/u16:4+flush-8:0	19:39:09	5
2432219	99	47	45,2	cyclictest	2871147	-21	kworker/u16:2+events_unbound	19:34:08	6
2432219	99	47	45,2	cyclictest	2456701	-21	kworker/u16:2+events_unbound	15:39:04	6
2432219	99	47	44,3	cyclictest	2982871	-21	kworker/u16:3+events_unbound	20:29:05	6
2432217	99	47	45,2	cyclictest	2678271	-21	kworker/u16:1+events_unbound	17:20:39	5
2432210	99	47	44,2	cyclictest	2871147	-21	kworker/u16:2+flush-8:0	19:28:54	4
2432219	99	46	44,2	cyclictest	2567393	-21	kworker/u16:3+flush-8:0	16:44:03	6
2432219	99	46	43,3	cyclictest	3043615	-21	kworker/u16:1+flush-8:0	20:34:07	6
2432217	99	46	44,2	cyclictest	2718927	-21	kworker/u16:1+events_unbound	17:49:03	5
2432217	99	46	44,2	cyclictest	2628085	-21	kworker/u16:0+flush-8:0	17:17:30	5
2432210	99	46	43,2	cyclictest	2567393	-21	kworker/u16:3+flush-8:0	16:28:57	4
2432217	99	45	43,2	cyclictest	2982871	-21	kworker/u16:3+events_unbound	20:34:53	5
2432217	99	45	43,2	cyclictest	2871147	-21	kworker/u16:2+flush-8:0	19:49:05	5
2432217	99	45	42,2	cyclictest	2567393	-21	kworker/u16:3+events_unbound	16:48:58	5
2432210	99	45	43,2	cyclictest	2871147	-21	kworker/u16:2+events_unbound	20:01:39	4
2432219	99	44	41,2	cyclictest	2547059	-21	kworker/u16:4+flush-8:0	16:53:51	6
2432210	99	44	42,2	cyclictest	2931572	-21	kworker/u16:4+flush-8:0	19:44:11	4
2432210	99	44	42,2	cyclictest	2567393	-21	kworker/u16:3+flush-8:0	17:19:02	4
2432223	99	43	38,4	cyclictest	2597723	-21	latency_hist	16:43:40	7
2432217	99	43	41,2	cyclictest	2983710	-21	kworker/u16:4+flush-8:0	20:13:54	5
2432217	99	43	41,2	cyclictest	2789712	-21	kworker/u16:1+flush-8:0	19:04:10	5
2432217	99	43	41,2	cyclictest	2729411	-21	kworker/u16:0+events_unbound	18:04:02	5
2432217	99	43	41,2	cyclictest	2718927	-21	kworker/u16:1+flush-8:0	17:44:08	5
2432217	99	43	41,2	cyclictest	2718927	-21	kworker/u16:1+flush-8:0	17:44:08	5
2432217	99	43	41,2	cyclictest	2375082	-21	kworker/u16:0+events_unbound	15:41:30	5
2432210	99	43	41,2	cyclictest	2718927	-21	kworker/u16:1+flush-8:0	17:44:05	4
2432210	99	43	41,2	cyclictest	2718927	-21	kworker/u16:1+flush-8:0	17:44:05	4
2431897	2	43	33,7	sleep6	0	-21	swapper/6	15:23:18	6
2432217	99	42	40,2	cyclictest	3001807	-21	kworker/u16:5+events_unbound	20:21:53	5
2432217	99	42	40,2	cyclictest	2983710	-21	kworker/u16:4+events_unbound	20:00:54	5
2432217	99	42	39,2	cyclictest	2628085	-21	kworker/u16:0+flush-8:0	16:59:05	5
2432210	99	42	40,2	cyclictest	2708683	-21	kworker/u16:0+events_unbound	17:40:49	4
2432210	99	42	40,2	cyclictest	2567393	-21	kworker/u16:3+flush-8:0	16:54:01	4
2432210	99	42	39,2	cyclictest	2678979	-21	kworker/u16:5+events_unbound	17:54:08	4
2431613	2	42	31,8	sleep4	0	-21	swapper/4	15:19:22	4
2432219	99	41	39,2	cyclictest	3001806	-21	kworker/u16:0+flush-8:0	20:14:45	6
2432219	99	41	39,2	cyclictest	2871147	-21	kworker/u16:2+events_unbound	19:57:49	6
2432219	99	41	39,2	cyclictest	2759867	-21	kworker/u16:3+events_unbound	18:16:50	6
2432217	99	41	39,2	cyclictest	2789712	-21	kworker/u16:1+events_unbound	19:22:48	5
2432210	99	41	39,2	cyclictest	2401662	-21	kworker/u16:3+events_unbound	15:24:09	4
2432223	99	40	35,4	cyclictest	3103910	-21	latency_hist	20:53:38	7
2432219	99	40	35,4	cyclictest	2810026	-21	packagekitd	18:28:55	6
2432219	99	40	35,4	cyclictest	2810026	-21	packagekitd	18:28:55	6
2432217	99	40	38,2	cyclictest	2759867	-21	kworker/u16:3+flush-8:0	18:14:05	5
2432217	99	40	38,2	cyclictest	2401662	-21	kworker/u16:3+flush-8:0	15:58:39	5
2432217	99	40	38,2	cyclictest	2401662	-21	kworker/u16:3+events_unbound	15:34:07	5
2432217	99	40	37,2	cyclictest	2456701	-21	kworker/u16:2+events_unbound	16:18:54	5
2432210	99	40	38,2	cyclictest	2809858	-21	kworker/u16:2+flush-8:0	18:27:49	4
2432210	99	40	37,3	cyclictest	2628085	-21	kworker/u16:0+flush-8:0	17:14:04	4
2432223	99	39	34,4	cyclictest	2607821	-21	latency_hist	16:48:39	7
2432219	99	39	37,2	cyclictest	2901415	-21	kworker/u16:0+events_unbound	19:22:38	6
2432219	99	39	37,2	cyclictest	2547059	-21	kworker/u16:4+flush-8:0	16:29:12	6
2432219	99	39	37,2	cyclictest	2375082	-21	kworker/u16:0+events_unbound	15:29:14	6
2432219	99	39	37,2	cyclictest	2375082	-21	kworker/u16:0+events_unbound	15:29:14	6
2432219	99	39	36,2	cyclictest	2871147	-21	kworker/u16:2+events_unbound	19:13:56	6
2432219	99	39	36,2	cyclictest	2871147	-21	kworker/u16:2+events_unbound	19:13:56	6
2432217	99	39	37,2	cyclictest	2617616	-21	kworker/u16:2+events_unbound	16:54:05	5
2432217	99	39	36,2	cyclictest	2871147	-21	kworker/u16:2+flush-8:0	19:08:54	5
2432210	99	39	37,2	cyclictest	2729411	-21	kworker/u16:0+events_unbound	18:38:38	4
2432210	99	39	36,2	cyclictest	2718927	-21	kworker/u16:1+events_unbound	17:48:40	4
2432219	99	38	36,2	cyclictest	3001806	-21	kworker/u16:0+events_unbound	20:28:10	6
2432219	99	38	36,2	cyclictest	2901415	-21	kworker/u16:0+flush-8:0	19:48:54	6
2432219	99	38	36,2	cyclictest	2708683	-21	kworker/u16:0+events_unbound	17:39:09	6
2432219	99	38	36,2	cyclictest	2628085	-21	kworker/u16:0+flush-8:0	17:09:04	6
2432217	99	38	36,2	cyclictest	3001806	-21	kworker/u16:0+events_unbound	20:09:03	5
2432217	99	38	36,2	cyclictest	2871147	-21	kworker/u16:2+events_unbound	19:57:53	5
2432217	99	38	36,2	cyclictest	2729411	-21	kworker/u16:0+events_unbound	18:24:49	5
2432217	99	38	36,2	cyclictest	2678979	-21	kworker/u16:5+flush-8:0	17:33:55	5
2432217	99	38	36,2	cyclictest	2547059	-21	kworker/u16:4+events_unbound	17:05:32	5
2432210	99	38	35,3	cyclictest	2567393	-21	kworker/u16:3+flush-8:0	17:24:05	4
2432219	99	37	35,2	cyclictest	3001806	-21	kworker/u16:0+events_unbound	20:39:07	6
2432219	99	37	35,2	cyclictest	2983710	-21	kworker/u16:4+flush-8:0	20:09:07	6
2432217	99	37	35,2	cyclictest	2678979	-21	kworker/u16:5+flush-8:0	17:54:06	5
2432217	99	37	35,2	cyclictest	2401662	-21	kworker/u16:3+flush-8:0	15:49:31	5
2432210	99	37	35,2	cyclictest	2810146	-21	kworker/u16:4+flush-8:0	18:38:55	4
2432219	99	36	34,2	cyclictest	2729411	-21	kworker/u16:0+flush-8:0	18:19:02	6
2432219	99	36	34,2	cyclictest	2456701	-21	kworker/u16:2+flush-8:0	15:49:06	6
2432219	99	36	33,2	cyclictest	2526752	-21	kworker/u16:3+flush-8:0	16:08:50	6
2432217	99	36	34,2	cyclictest	3001806	-21	kworker/u16:0+flush-8:0	20:29:50	5
2432217	99	36	34,2	cyclictest	2931572	-21	kworker/u16:4+events_unbound	19:46:03	5
2432217	99	36	34,2	cyclictest	2729411	-21	kworker/u16:0+flush-8:0	18:08:42	5
2432217	99	36	34,2	cyclictest	2678979	-21	kworker/u16:5+flush-8:0	17:24:06	5
2432210	99	36	34,2	cyclictest	3043615	-21	kworker/u16:1+events_unbound	20:32:38	4
2432210	99	36	34,2	cyclictest	2678979	-21	kworker/u16:5+flush-8:0	17:29:27	4
2432210	99	36	33,2	cyclictest	2789712	-21	kworker/u16:1+flush-8:0	18:44:04	4
2432217	99	35	33,2	cyclictest	3001806	-21	kworker/u16:0+events_unbound	20:46:42	5
2432217	99	35	33,2	cyclictest	2983710	-21	kworker/u16:4+events_unbound	20:05:53	5
2432217	99	35	33,2	cyclictest	2849793	-21	kworker/u16:3+events_unbound	18:54:02	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17