OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Sat Nov 22, 2025 12:43:32)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
584867	2	60	48,8	sleep5	0	-21	swapper/5	15:23:14	5
585270	99	56	51,4	cyclictest	983421	-21	latency_hist	18:38:30	7
584684	2	53	18,31	sleep7	0	-21	swapper/7	15:20:43	7
585260	99	52	50,2	cyclictest	1033867	-21	kworker/u16:0+events_unbound	19:03:56	4
585270	99	51	46,4	cyclictest	670018	-21	latency_hist	16:03:31	7
585260	99	50	48,2	cyclictest	659689	-21	kworker/u16:0+events_unbound	16:21:14	4
584615	2	49	38,8	sleep4	0	-21	swapper/4	15:19:44	4
585270	99	47	0,45	cyclictest	993575	-21	latency_hist	18:43:31	7
585260	99	47	45,2	cyclictest	594956	-21	kworker/u16:3+flush-8:0	15:30:14	4
575249	2	47	36,7	sleep6	0	-21	swapper/6	15:18:34	6
585266	99	46	44,2	cyclictest	667510	-21	kworker/u16:4+events_unbound	16:25:13	6
585266	99	46	43,2	cyclictest	690033	-21	kworker/u16:1+events_unbound	16:13:33	6
585260	99	46	44,2	cyclictest	832218	-21	kworker/u16:3+events_unbound	17:44:00	4
585266	99	44	42,2	cyclictest	771056	-21	kworker/u16:5+events_unbound	17:13:13	6
585260	99	44	41,2	cyclictest	1154788	-21	kworker/u16:0+events_unbound	20:23:44	4
585266	99	43	41,2	cyclictest	3366955	-21	kworker/u16:5+events_unbound	15:24:14	6
585266	99	43	41,2	cyclictest	1114441	-21	kworker/u16:3+events_unbound	20:13:13	6
585270	99	42	37,3	cyclictest	589235	-21	systemd-journal	16:08:31	7
585270	99	42	36,5	cyclictest	912579	-21	latency_hist	18:03:31	7
585266	99	42	40,2	cyclictest	821765	-21	kworker/u16:2+events_unbound	18:08:14	6
585260	99	42	40,2	cyclictest	832218	-21	kworker/u16:3+events_unbound	17:25:10	4
585260	99	42	40,2	cyclictest	730323	-21	kworker/u16:2+flush-8:0	16:33:33	4
585260	99	41	39,2	cyclictest	821765	-21	kworker/u16:2+events_unbound	17:40:45	4
585270	99	40	35,4	cyclictest	589235	-21	systemd-journal	16:46:13	7
585270	99	40	34,5	cyclictest	659931	-21	latency_hist	15:58:31	7
585270	99	40	34,5	cyclictest	1054177	-21	latency_hist	19:13:31	7
585266	99	40	38,2	cyclictest	972984	-21	kworker/u16:1+flush-8:0	19:08:30	6
585266	99	39	37,2	cyclictest	1114441	-21	kworker/u16:3+flush-8:0	19:44:29	6
585266	99	38	36,2	cyclictest	832218	-21	kworker/u16:3+events_unbound	17:43:13	6
585266	99	38	36,2	cyclictest	821765	-21	kworker/u16:2+flush-8:0	18:09:13	6
585266	99	38	36,2	cyclictest	659689	-21	kworker/u16:0+events_unbound	16:36:13	6
585260	99	38	35,3	cyclictest	871947	-21	kworker/u16:1+flush-8:0	18:13:13	4
585266	99	37	35,2	cyclictest	667510	-21	kworker/u16:4+events_unbound	16:53:31	6
585266	99	37	34,2	cyclictest	821765	-21	kworker/u16:2+flush-8:0	17:43:33	6
585266	99	37	34,2	cyclictest	690033	-21	kworker/u16:1+events_unbound	16:43:33	6
585261	99	37	35,2	cyclictest	667510	-21	kworker/u16:4+flush-8:0	16:23:49	5
585260	99	37	34,2	cyclictest	1084177	-21	kworker/u16:1+events_unbound	19:33:34	4
585266	99	36	34,2	cyclictest	554576	-21	kworker/u16:1+flush-8:0	15:34:03	6
585261	99	36	33,2	cyclictest	1136119	-21	kworker/u16:2+events_unbound	20:23:48	5
585260	99	36	34,2	cyclictest	832218	-21	kworker/u16:3+flush-8:0	18:20:12	4
585260	99	36	33,2	cyclictest	972984	-21	kworker/u16:1+flush-8:0	18:33:41	4
585260	99	36	33,2	cyclictest	649558	-21	kworker/u16:1+flush-8:0	15:58:34	4
585266	99	35	33,2	cyclictest	659689	-21	kworker/u16:0+events_unbound	16:57:14	6
585260	99	35	33,2	cyclictest	1084177	-21	kworker/u16:1+flush-8:0	19:33:30	4
585260	99	35	33,2	cyclictest	1074040	-21	kworker/u16:0+events_unbound	19:24:00	4
585266	99	34	32,2	cyclictest	667510	-21	kworker/u16:4+flush-8:0	17:08:22	6
585266	99	34	32,2	cyclictest	1154788	-21	kworker/u16:0+events_unbound	20:02:14	6
585266	99	34	32,2	cyclictest	1013444	-21	kworker/u16:3+events_unbound	18:54:15	6
585261	99	34	32,2	cyclictest	972984	-21	kworker/u16:1+events_unbound	18:53:56	5
585260	99	34	32,2	cyclictest	700418	-21	kworker/u16:3+events_unbound	16:28:14	4
585270	99	33	27,5	cyclictest	589235	-21	systemd-journal	18:29:53	7
585266	99	33	31,2	cyclictest	932747	-21	kworker/u16:4+events_unbound	18:27:07	6
585266	99	33	31,2	cyclictest	832218	-21	kworker/u16:3+events_unbound	18:17:41	6
585266	99	33	31,2	cyclictest	584119	-21	kworker/u16:0+events_unbound	15:41:36	6
585261	99	33	31,2	cyclictest	1124677	-21	kworker/u16:1+flush-8:0	19:53:52	5
585266	99	32	30,2	cyclictest	993969	-21	kworker/u16:2+events_unbound	18:47:15	6
585266	99	32	30,2	cyclictest	1114441	-21	kworker/u16:3+events_unbound	20:15:41	6
585260	99	32	30,2	cyclictest	1114441	-21	kworker/u16:3+flush-8:0	19:49:28	4
585260	99	32	30,2	cyclictest	1013444	-21	kworker/u16:3+flush-8:0	19:11:14	4
585266	99	31	29,2	cyclictest	932732	-21	kworker/u16:0+events_unbound	18:31:41	6
585266	99	31	29,2	cyclictest	832218	-21	kworker/u16:3+flush-8:0	18:01:36	6
585266	99	31	29,2	cyclictest	1154788	-21	kworker/u16:0+flush-8:0	20:37:05	6
585266	99	31	29,2	cyclictest	1114441	-21	kworker/u16:3+events_unbound	19:57:42	6
585266	99	31	28,2	cyclictest	1033867	-21	kworker/u16:0+flush-8:0	19:14:00	6
585260	99	31	28,2	cyclictest	667510	-21	kworker/u16:4+flush-8:0	16:08:50	4
585260	99	31	28,2	cyclictest	584119	-21	kworker/u16:0+events_unbound	15:33:33	4
585270	99	30	25,4	cyclictest	589235	-21	systemd-journal	17:02:12	7
585266	99	30	28,2	cyclictest	821765	-21	kworker/u16:2+flush-8:0	17:58:30	6
585266	99	30	28,2	cyclictest	594956	-21	kworker/u16:3+flush-8:0	16:03:14	6
585266	99	30	28,2	cyclictest	594956	-21	kworker/u16:3+events_unbound	15:57:41	6
585260	99	30	28,2	cyclictest	832218	-21	kworker/u16:3+flush-8:0	17:35:13	4
585270	99	29	24,4	cyclictest	589235	-21	systemd-journal	17:23:32	7
585266	99	29	28,1	cyclictest	1084177	-21	kworker/u16:1+events_unbound	19:27:15	6
585266	99	29	27,2	cyclictest	821765	-21	kworker/u16:2+flush-8:0	17:34:14	6
585266	99	29	27,2	cyclictest	667510	-21	kworker/u16:4+flush-8:0	17:00:14	6
585266	99	29	27,2	cyclictest	594956	-21	kworker/u16:3+events_unbound	16:04:41	6
585266	99	29	27,2	cyclictest	1154788	-21	kworker/u16:0+flush-8:0	20:31:41	6
585266	99	29	27,2	cyclictest	1104292	-21	kworker/u16:2+events_unbound	19:41:15	6
585266	99	29	27,2	cyclictest	1104292	-21	kworker/u16:2+events_unbound	19:37:13	6
585266	99	29	26,2	cyclictest	594956	-21	kworker/u16:3+flush-8:0	15:43:43	6
585266	99	29	26,2	cyclictest	1124677	-21	kworker/u16:1+events_unbound	19:48:33	6
585261	99	29	26,2	cyclictest	730323	-21	kworker/u16:2+flush-8:0	16:48:52	5
585260	99	29	27,2	cyclictest	730323	-21	kworker/u16:2+flush-8:0	16:42:05	4
585260	99	29	27,2	cyclictest	1074040	-21	kworker/u16:0+flush-8:0	19:23:29	4
585260	99	29	27,2	cyclictest	1013444	-21	kworker/u16:3+events_unbound	18:56:15	4
585270	99	28	23,4	cyclictest	589235	-21	systemd-journal	16:23:31	7
585266	99	28	26,2	cyclictest	972984	-21	kworker/u16:1+events_unbound	18:38:06	6
585266	99	28	26,2	cyclictest	667510	-21	kworker/u16:4+flush-8:0	16:23:29	6
585266	99	28	26,2	cyclictest	659689	-21	kworker/u16:0+flush-8:0	17:18:05	6
585261	99	28	26,2	cyclictest	594956	-21	kworker/u16:3+events_unbound	15:43:45	5
585260	99	28	25,2	cyclictest	832218	-21	kworker/u16:3+events_unbound	18:41:41	4
585270	99	27	26,0	cyclictest	0	-21	swapper/7	20:08:53	7
585266	99	27	25,2	cyclictest	594956	-21	kworker/u16:3+flush-8:0	15:49:17	6
585266	99	27	25,2	cyclictest	1136119	-21	kworker/u16:2+events_unbound	20:46:40	6
585266	99	27	25,2	cyclictest	1136119	-21	kworker/u16:2+events_unbound	20:20:05	6
585260	99	27	25,2	cyclictest	932747	-21	kworker/u16:4+events_unbound	18:26:05	4
585260	99	27	25,2	cyclictest	1136119	-21	kworker/u16:2+events_unbound	20:19:14	4
585260	99	27	24,3	cyclictest	700418	-21	kworker/u16:3+flush-8:0	16:28:54	4
585270	99	26	25,0	cyclictest	0	-21	swapper/7	18:23:53	7
585270	99	26	20,5	cyclictest	932757	-21	latency_hist	18:13:31	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17