OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Aug 01, 2026 12:43:33)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2643593	2	56	46,7	sleep5	0	-21	swapper/5	07:07:16	5
2643460	2	54	19,30	sleep7	0	-21	swapper/7	07:05:25	7
2643602	2	45	34,8	sleep4	0	-21	swapper/4	07:07:23	4
2643977	99	44	38,5	cyclictest	2813121	-21	latency_hist	08:33:48	7
2643975	99	44	41,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:48:49	6
2643977	99	42	38,3	cyclictest	1067	-21	rs:main		7
2643970	99	42	40,2	cyclictest	2784378	-21	kworker/u16:3+events_unbound	08:44:19	5
2643977	99	41	36,4	cyclictest	2991540	-21	latency_hist	09:53:48	7
2643970	99	41	39,2	cyclictest	2823277	-21	kworker/u16:0+flush-8:0	09:24:21	5
2643975	99	40	38,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:37:34	6
2643975	99	37	35,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:24:23	6
2643975	99	37	34,2	cyclictest	2784378	-21	kworker/u16:3+flush-8:0	08:33:50	6
2643970	99	36	34,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	11:00:26	5
2643970	99	36	34,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:32:57	5
2643970	99	36	34,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:11:45	5
2643970	99	35	33,2	cyclictest	3321223	-21	kworker/u16:1+events_unbound	12:38:17	5
2643970	99	35	33,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	12:11:13	5
2643970	99	35	33,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	11:22:29	5
2643970	99	35	33,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:47:46	5
2643975	99	34	32,2	cyclictest	3077472	-21	kworker/u16:3+events_unbound	10:32:57	6
2643975	99	34	32,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:52:18	6
2643970	99	34	32,2	cyclictest	3321223	-21	kworker/u16:1+events_unbound	12:15:29	5
2643970	99	34	32,2	cyclictest	3258656	-21	kworker/u16:1+events_unbound	11:40:50	5
2643970	99	34	32,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	12:22:12	5
2643970	99	34	32,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:43:30	5
2643970	99	34	32,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:13:18	5
2643970	99	34	32,2	cyclictest	3001438	-21	kworker/u16:4+flush-8:0	10:30:49	5
2643970	99	34	32,2	cyclictest	2927053	-21	kworker/u16:1+events_unbound	10:05:22	5
2643970	99	34	32,2	cyclictest	2823277	-21	kworker/u16:0+flush-8:0	09:40:49	5
2643970	99	34	32,2	cyclictest	2823277	-21	kworker/u16:0+events_unbound	09:21:35	5
2643970	99	33	31,2	cyclictest	3273413	-21	kworker/u16:3+events_unbound	12:03:06	5
2643970	99	33	31,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	11:45:53	5
2643970	99	33	31,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	11:45:53	5
2643970	99	33	31,2	cyclictest	3151397	-21	kworker/u16:5+events_unbound	11:07:50	5
2643970	99	33	31,2	cyclictest	3001438	-21	kworker/u16:4+events_unbound	10:01:37	5
2643970	99	33	31,2	cyclictest	2823277	-21	kworker/u16:0+events_unbound	09:52:53	5
2643970	99	33	30,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:33:48	5
2643975	99	32	30,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:22:26	6
2643970	99	32	30,2	cyclictest	3151397	-21	kworker/u16:5+events_unbound	11:27:42	5
2643970	99	32	30,2	cyclictest	3090045	-21	kworker/u16:1+events_unbound	11:17:21	5
2643970	99	32	30,2	cyclictest	3090045	-21	kworker/u16:1+events_unbound	11:11:03	5
2643970	99	32	30,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:53:34	5
2643970	99	32	30,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:47:21	5
2643977	99	31	30,0	cyclictest	0	-21	swapper/7	10:39:12	7
2643977	99	31	27,3	cyclictest	3261072	-21	latency_hist	11:43:47	7
2643977	99	31	26,4	cyclictest	3248841	-21	latency_hist	11:38:47	7
2643975	99	31	30,1	cyclictest	3028724	-21	kworker/u16:0+events_unbound	11:25:19	6
2643975	99	31	29,2	cyclictest	3321223	-21	kworker/u16:1+flush-8:0	12:29:41	6
2643975	99	31	29,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	11:19:57	6
2643975	99	31	28,2	cyclictest	2676624	-21	kworker/u16:0+events_unbound	07:39:03	6
2643970	99	31	29,2	cyclictest	3321223	-21	kworker/u16:1+flush-8:0	12:26:01	5
2643970	99	31	29,2	cyclictest	3321223	-21	kworker/u16:1+flush-8:0	12:26:01	5
2643970	99	31	29,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	11:32:33	5
2643970	99	31	29,2	cyclictest	3090045	-21	kworker/u16:1+events_unbound	10:58:37	5
2643970	99	31	29,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	10:20:21	5
2643970	99	31	29,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:38:14	5
2643975	99	30	28,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	11:39:45	6
2643975	99	30	28,2	cyclictest	3090045	-21	kworker/u16:1+events_unbound	10:47:09	6
2643975	99	30	28,2	cyclictest	3001438	-21	kworker/u16:4+events_unbound	09:59:55	6
2643975	99	30	28,2	cyclictest	2927053	-21	kworker/u16:1+events_unbound	10:06:38	6
2643970	99	30	28,2	cyclictest	3200115	-21	kworker/u16:2+flush-8:0	12:07:25	5
2643970	99	30	28,2	cyclictest	2927053	-21	kworker/u16:1+events_unbound	10:14:54	5
2643970	99	30	28,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:14:49	5
2643975	99	29	27,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	12:20:05	6
2643975	99	29	27,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	12:00:57	6
2643975	99	29	27,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	11:48:37	6
2643975	99	29	27,2	cyclictest	3028724	-21	kworker/u16:0+events_unbound	11:48:37	6
2643975	99	29	27,2	cyclictest	2799853	-21	kworker/u16:2+events_unbound	09:13:17	6
2643970	99	29	27,2	cyclictest	3028724	-21	kworker/u16:0+flush-8:0	11:34:49	5
2643970	99	29	27,2	cyclictest	3001438	-21	kworker/u16:4+events_unbound	10:24:37	5
2643970	99	29	27,2	cyclictest	3001438	-21	kworker/u16:4+events_unbound	10:24:37	5
2643967	99	29	26,3	cyclictest	2927053	-21	kworker/u16:1+flush-8:0	09:59:21	4
2643517	2	29	7,7	sleep6	0	-21	swapper/6	07:06:12	6
2643977	99	28	26,1	cyclictest	3321366	-21	ssh	12:07:04	7
2643975	99	28	26,2	cyclictest	3001438	-21	kworker/u16:4+events_unbound	10:40:30	6
2643975	99	28	26,2	cyclictest	2823277	-21	kworker/u16:0+flush-8:0	09:23:09	6
2643975	99	28	26,2	cyclictest	2823277	-21	kworker/u16:0+events_unbound	09:18:35	6
2643970	99	28	26,2	cyclictest	3321223	-21	kworker/u16:1+flush-8:0	12:31:28	5
2643970	99	28	26,2	cyclictest	2676624	-21	kworker/u16:0+events_unbound	07:36:58	5
3175119	2	27	0,1	chrt	3175118	-21	ssh	11:08:13	7
2643977	99	27	26,0	cyclictest	0	-21	swapper/7	09:12:09	7
2643977	99	27	25,1	cyclictest	0	-21	swapper/7	11:00:21	7
2643975	99	27	25,2	cyclictest	3151397	-21	kworker/u16:5+events_unbound	11:37:58	6
2643977	99	26	25,0	cyclictest	0	-21	swapper/7	08:02:14	7
2643977	99	26	24,1	cyclictest	3332365	-21	ssh	12:09:51	7
2643977	99	26	24,1	cyclictest	3308971	-21	ssh	12:01:44	7
2643975	99	26	24,2	cyclictest	3321223	-21	kworker/u16:1+events_unbound	12:16:14	6
2643975	99	26	24,2	cyclictest	3200115	-21	kworker/u16:2+flush-8:0	12:06:18	6
2643975	99	26	24,2	cyclictest	3200115	-21	kworker/u16:2+events_unbound	11:56:49	6
2643975	99	26	24,2	cyclictest	3151397	-21	kworker/u16:5+events_unbound	11:10:01	6
2643975	99	26	24,2	cyclictest	3151397	-21	kworker/u16:5+events_unbound	11:06:26	6
2643975	99	26	24,2	cyclictest	3062012	-21	kworker/u16:2+events_unbound	10:27:13	6
2643975	99	26	24,2	cyclictest	3062012	-21	kworker/u16:2+events_unbound	10:27:13	6
2643975	99	26	24,2	cyclictest	2823277	-21	kworker/u16:0+events_unbound	09:43:46	6
2643970	99	26	24,2	cyclictest	3151397	-21	kworker/u16:5+events_unbound	11:53:51	5
2643970	99	26	24,2	cyclictest	2686899	-21	kworker/u16:1+events_unbound	07:31:51	5
2643970	99	26	24,2	cyclictest	2676624	-21	kworker/u16:0+events_unbound	07:54:12	5
2643970	99	26	23,2	cyclictest	2823277	-21	kworker/u16:0+events_unbound	08:48:57	5
2643970	99	26	23,2	cyclictest	2735269	-21	kworker/u16:1+events_unbound	08:38:51	5
2643967	99	26	23,2	cyclictest	2823277	-21	kworker/u16:0+flush-8:0	09:17:57	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17