OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Fri Aug 07, 2026 00:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3436463	2	70	0,1	sleep4	0	-21	swapper/4	23:31:57	4
2850026	2	59	48,8	sleep4	0	-21	swapper/4	19:07:46	4
2849940	2	58	48,7	sleep5	0	-21	swapper/5	19:06:35	5
2850380	99	52	47,4	cyclictest	3184043	-21	latency_hist	21:48:26	7
2850376	99	44	40,3	cyclictest	3497593	-21	kworker/u16:2+flush-8:0	00:33:26	6
2850376	99	44	40,3	cyclictest	3497593	-21	kworker/u16:2+flush-8:0	00:33:26	6
2850376	99	41	39,2	cyclictest	2999264	-21	kworker/u16:3+flush-8:0	20:23:26	6
2840949	2	41	3,31	sleep7	0	-21	swapper/7	19:03:40	7
2850380	99	38	36,1	cyclictest	3087462	-21	diskmemload	00:22:40	7
3364697	2	36	0,1	sleep6	0	-21	swapper/6	23:03:06	6
2850380	99	36	35,0	cyclictest	0	-21	swapper/7	23:23:54	7
2850380	99	36	35,0	cyclictest	0	-21	swapper/7	00:05:49	7
2850380	99	36	34,1	cyclictest	0	-21	swapper/7	23:31:49	7
2850376	99	36	34,2	cyclictest	3437339	-21	kworker/u16:1+events_unbound	23:54:09	6
2850380	99	35	34,0	cyclictest	0	-21	swapper/7	21:12:18	7
2850380	99	34	32,1	cyclictest	3087462	-21	diskmemload	21:50:13	7
2850380	99	34	32,1	cyclictest	3087462	-21	diskmemload	21:50:13	7
2850380	99	34	30,3	cyclictest	125	-21	kswapd0	22:08:26	7
2850380	99	33	32,0	cyclictest	0	-21	swapper/7	21:21:10	7
2849875	2	33	22,8	sleep6	0	-21	swapper/6	19:05:40	6
2850380	99	32	31,0	cyclictest	0	-21	swapper/7	23:42:06	7
2850376	99	32	30,2	cyclictest	3316786	-21	kworker/u16:4+events_unbound	23:48:49	6
2850376	99	32	30,2	cyclictest	3184514	-21	kworker/u16:2+flush-8:0	22:03:26	6
2850376	99	32	30,2	cyclictest	2796538	-21	kworker/u16:2+flush-8:0	19:13:27	6
2850380	99	31	30,0	cyclictest	0	-21	swapper/7	23:51:41	7
2850380	99	31	30,0	cyclictest	0	-21	swapper/7	23:38:06	7
2850380	99	31	30,0	cyclictest	0	-21	swapper/7	23:15:53	7
2850380	99	31	30,0	cyclictest	0	-21	swapper/7	23:03:28	7
2850380	99	31	30,0	cyclictest	0	-21	swapper/7	22:16:46	7
2850380	99	31	30,0	cyclictest	0	-21	swapper/7	21:32:21	7
2850380	99	31	29,1	cyclictest	0	-21	swapper/7	21:36:58	7
2850380	99	31	0,29	cyclictest	3292582	-21	latency_hist	22:33:26	7
2850376	99	31	27,3	cyclictest	2796538	-21	kworker/u16:2+flush-8:0	19:53:27	6
2850380	99	30	29,0	cyclictest	0	-21	swapper/7	22:34:33	7
2850380	99	30	29,0	cyclictest	0	-21	swapper/7	22:01:14	7
2850380	99	30	29,0	cyclictest	0	-21	swapper/7	21:28:10	7
2850380	99	30	29,0	cyclictest	0	-21	swapper/7	21:14:45	7
2850380	99	30	29,0	cyclictest	0	-21	swapper/7	00:12:33	7
2850380	99	30	28,1	cyclictest	3496045	-21	ssh	23:55:41	7
2850376	99	30	28,2	cyclictest	3316786	-21	kworker/u16:4+events_unbound	23:33:44	6
2850380	99	29	28,0	cyclictest	0	-21	swapper/7	23:20:01	7
2850380	99	29	28,0	cyclictest	0	-21	swapper/7	22:09:46	7
2850380	99	29	27,1	cyclictest	3087462	-21	diskmemload	23:12:22	7
2850380	99	29	27,1	cyclictest	3087462	-21	diskmemload	23:12:22	7
2850380	99	29	23,5	cyclictest	3068048	-21	latency_hist	20:58:27	7
2850376	99	29	27,2	cyclictest	3497593	-21	kworker/u16:2+events_unbound	00:04:29	6
2850376	99	29	27,2	cyclictest	2971187	-21	kworker/u16:2+flush-8:0	20:48:22	6
2850376	99	29	27,2	cyclictest	2960761	-21	kworker/u16:1+flush-8:0	22:38:47	6
2850380	99	28	27,0	cyclictest	0	-21	swapper/7	00:29:14	7
2850380	99	28	27,0	cyclictest	0	-21	swapper/7	00:29:14	7
2850380	99	27	26,0	cyclictest	0	-21	swapper/7	22:55:41	7
2850380	99	27	26,0	cyclictest	0	-21	swapper/7	19:41:38	7
2850376	99	27	25,2	cyclictest	3497593	-21	kworker/u16:2+events_unbound	00:27:46	6
2850376	99	27	25,2	cyclictest	2971187	-21	kworker/u16:2+events_unbound	20:33:46	6
2850376	99	27	25,2	cyclictest	2960761	-21	kworker/u16:1+events_unbound	20:03:41	6
2850380	99	26	25,0	cyclictest	0	-21	swapper/7	22:41:21	7
2850380	99	26	25,0	cyclictest	0	-21	swapper/7	21:42:13	7
2850376	99	26	23,2	cyclictest	2796538	-21	kworker/u16:2+flush-8:0	19:13:27	6
2850380	99	25	24,0	cyclictest	0	-21	swapper/7	00:02:59	7
2850376	99	25	23,2	cyclictest	3497593	-21	kworker/u16:2+events_unbound	00:36:02	6
2850376	99	25	23,2	cyclictest	3388954	-21	kworker/u16:1+events_unbound	23:16:01	6
2850380	99	24	23,0	cyclictest	0	-21	swapper/7	22:46:50	7
2850376	99	24	22,2	cyclictest	3184514	-21	kworker/u16:2+flush-8:0	22:19:05	6
2850380	99	22	21,0	cyclictest	0	-21	swapper/7	22:25:16	7
2850380	99	22	21,0	cyclictest	0	-21	swapper/7	20:27:37	7
2850380	99	22	18,3	cyclictest	3197902	-21	kthreadcore	21:53:46	7
2850376	99	22	20,2	cyclictest	2960761	-21	kworker/u16:1+flush-8:0	21:38:52	6
2850372	99	22	20,2	cyclictest	3362629	-21	kworker/u16:0+flush-8:0	23:13:51	5
2850380	99	21	20,0	cyclictest	0	-21	swapper/7	22:52:08	7
2850380	99	21	20,0	cyclictest	0	-21	swapper/7	19:10:37	7
2850380	99	21	19,1	cyclictest	3087462	-21	diskmemload	00:34:11	7
2850376	99	21	18,2	cyclictest	2960761	-21	kworker/u16:1+events_unbound	20:28:38	6
2850376	99	21	18,2	cyclictest	2960761	-21	kworker/u16:1+events_unbound	20:28:38	6
2850380	99	20	19,0	cyclictest	0	-21	swapper/7	23:46:25	7
2850376	99	20	18,2	cyclictest	2999264	-21	kworker/u16:3+flush-8:0	20:28:21	6
2850376	99	20	17,3	cyclictest	2960761	-21	kworker/u16:1+flush-8:0	20:48:47	6
2850380	99	19	18,0	cyclictest	0	-21	swapper/7	20:48:57	7
2850380	99	19	18,0	cyclictest	0	-21	swapper/7	20:47:41	7
2850380	99	19	18,0	cyclictest	0	-21	swapper/7	20:20:54	7
2850380	99	19	18,0	cyclictest	0	-21	swapper/7	20:06:03	7
2850380	99	19	18,0	cyclictest	0	-21	swapper/7	00:14:44	7
2850380	99	19	16,2	cyclictest	3266852	-21	ssh	22:20:15	7
2850376	99	19	17,2	cyclictest	3184514	-21	kworker/u16:2+flush-8:0	22:08:50	6
2850380	99	18	17,0	cyclictest	0	-21	swapper/7	20:39:42	7
2850380	99	18	17,0	cyclictest	0	-21	swapper/7	19:37:30	7
2850380	99	18	17,0	cyclictest	0	-21	swapper/7	00:24:48	7
2850380	99	18	12,5	cyclictest	3077757	-21	latency_hist	21:03:26	7
2850376	99	18	16,2	cyclictest	3401464	-21	kworker/u16:2+flush-8:0	23:29:10	6
2850376	99	18	16,2	cyclictest	3316786	-21	kworker/u16:4+events_unbound	23:43:55	6
2850372	99	18	0,1	cyclictest	0	-21	swapper/5	22:20:51	5
2850380	99	17	16,0	cyclictest	0	-21	swapper/7	19:23:30	7
2850370	99	17	17,0	cyclictest	0	-21	swapper/4	00:24:42	4
2850380	99	16	15,0	cyclictest	0	-21	swapper/7	20:36:21	7
2850376	99	16	14,2	cyclictest	3362629	-21	kworker/u16:0+events_unbound	00:02:37	6
2850376	99	16	13,3	cyclictest	2893339	-21	kworker/u16:3+flush-8:0	19:53:47	6
2850372	99	16	0,16	cyclictest	0	-21	swapper/5	23:24:42	5
2850372	99	16	0,15	cyclictest	0	-21	swapper/5	19:58:57	5
2850372	99	16	0,13	cyclictest	0	-21	swapper/5	23:34:57	5
2850380	99	15	14,0	cyclictest	0	-21	swapper/7	23:00:15	7
2850380	99	15	14,0	cyclictest	0	-21	swapper/7	19:20:36	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17