OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Wed Aug 19, 2026 00:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1874402	2	59	24,30	sleep7	0	-21	swapper/7	19:05:44	7
1865262	2	58	47,7	sleep4	0	-21	swapper/4	19:02:44	4
6324	89	45	0,38	rtkit-daemon	0	-21	swapper/6	19:04:56	6
1874837	99	42	36,5	cyclictest	1985106	-21	latency_hist	20:02:40	7
1874821	99	41	38,2	cyclictest	2505249	-21	kworker/u16:0+flush-8:0	23:57:41	4
1874821	99	38	36,2	cyclictest	1884239	-21	kworker/u16:0+flush-8:0	20:37:40	4
1874825	99	37	35,2	cyclictest	2147151	-21	kworker/u16:1+events_unbound	21:41:06	5
1874825	99	37	35,2	cyclictest	1874389	-21	kworker/u16:2+events_unbound	19:08:14	5
1874821	99	37	36,1	cyclictest	1864597	-21	kworker/u16:1+events_unbound	19:07:55	4
1874825	99	36	34,2	cyclictest	2265245	-21	kworker/u16:1+events_unbound	22:15:02	5
1874821	99	36	33,2	cyclictest	2543527	-21	kworker/u16:0+events_unbound	00:17:42	4
1874825	99	35	33,2	cyclictest	2324757	-21	kworker/u16:0+events_unbound	22:35:39	5
1874821	99	34	32,2	cyclictest	2265245	-21	kworker/u16:1+events_unbound	22:58:58	4
1874821	99	34	32,2	cyclictest	2147151	-21	kworker/u16:1+events_unbound	21:33:46	4
1874821	99	34	32,2	cyclictest	2147151	-21	kworker/u16:1+events_unbound	21:33:46	4
1874821	99	34	32,2	cyclictest	2091665	-21	kworker/u16:2+flush-8:0	22:28:10	4
1874837	99	33	27,5	cyclictest	2243084	-21	latency_hist	22:02:41	7
1874825	99	33	31,2	cyclictest	2543527	-21	kworker/u16:0+events_unbound	00:18:11	5
1874825	99	33	31,2	cyclictest	2398701	-21	kworker/u16:3+events_unbound	23:17:09	5
1874825	99	33	28,2	cyclictest	2147151	-21	kworker/u16:1+flush-8:0	21:52:40	5
2205264	2	32	0,1	chrt	2205262	-21	ssh	21:44:08	7
1874825	99	32	30,2	cyclictest	2519509	-21	kworker/u16:2+events_unbound	23:59:41	5
1874825	99	32	30,2	cyclictest	2485002	-21	kworker/u16:3+events_unbound	23:51:07	5
1874825	99	32	30,2	cyclictest	2423133	-21	kworker/u16:2+events_unbound	23:43:47	5
1874825	99	32	30,2	cyclictest	2219124	-21	kworker/u16:4+flush-8:0	22:07:06	5
1874825	99	32	30,2	cyclictest	1884239	-21	kworker/u16:0+events_unbound	19:33:05	5
1874825	99	32	29,2	cyclictest	2289732	-21	kworker/u16:0+events_unbound	22:22:41	5
1874821	99	32	29,2	cyclictest	2528501	-21	kworker/u16:5+events_unbound	00:02:41	4
1874255	2	32	22,7	sleep5	0	-21	swapper/5	19:03:41	5
1874825	99	31	29,2	cyclictest	2543527	-21	kworker/u16:0+events_unbound	00:17:05	5
1874825	99	31	29,2	cyclictest	2543527	-21	kworker/u16:0+events_unbound	00:17:05	5
1874825	99	31	29,2	cyclictest	2360807	-21	kworker/u16:3+events_unbound	22:54:38	5
1874825	99	31	29,2	cyclictest	2360807	-21	kworker/u16:3+events_unbound	22:54:38	5
1874825	99	31	29,2	cyclictest	2265245	-21	kworker/u16:1+events_unbound	23:00:22	5
1874821	99	31	29,2	cyclictest	2485002	-21	kworker/u16:3+events_unbound	23:55:41	4
1874821	99	31	29,2	cyclictest	2302247	-21	kworker/u16:3+events_unbound	22:38:08	4
1874821	99	31	29,2	cyclictest	2219124	-21	kworker/u16:4+events_unbound	22:08:12	4
1874821	99	31	29,2	cyclictest	2091665	-21	kworker/u16:2+events_unbound	21:27:35	4
1874825	99	30	28,2	cyclictest	2528501	-21	kworker/u16:5+events_unbound	00:11:17	5
1874825	99	30	28,2	cyclictest	2360807	-21	kworker/u16:3+events_unbound	22:48:54	5
1874825	99	30	28,2	cyclictest	2324757	-21	kworker/u16:0+flush-8:0	22:40:02	5
1874825	99	30	28,2	cyclictest	2133103	-21	kworker/u16:0+events_unbound	21:34:19	5
1874825	99	30	28,2	cyclictest	2133103	-21	kworker/u16:0+events_unbound	21:34:19	5
1874825	99	30	28,2	cyclictest	2101452	-21	kworker/u16:3+events_unbound	21:56:05	5
1874825	99	30	28,2	cyclictest	2091665	-21	kworker/u16:2+events_unbound	22:18:39	5
1874825	99	30	28,2	cyclictest	2091665	-21	kworker/u16:2+events_unbound	21:20:54	5
1874821	99	30	28,2	cyclictest	2485002	-21	kworker/u16:3+events_unbound	23:49:27	4
1874821	99	30	28,2	cyclictest	2265245	-21	kworker/u16:1+flush-8:0	23:20:49	4
1874821	99	30	28,2	cyclictest	2091665	-21	kworker/u16:2+events_unbound	21:09:51	4
1874821	99	30	28,2	cyclictest	2004446	-21	kworker/u16:2+events_unbound	20:28:51	4
1874837	99	29	23,5	cyclictest	648	-21	systemd-journal	19:12:40	7
1874825	99	29	27,2	cyclictest	2398701	-21	kworker/u16:3+flush-8:0	23:28:20	5
1874825	99	29	27,2	cyclictest	2373606	-21	kworker/u16:0+flush-8:0	23:05:38	5
1874821	99	29	27,2	cyclictest	2580481	-21	kworker/u16:1+events_unbound	00:33:14	4
1874821	99	29	27,2	cyclictest	2423133	-21	kworker/u16:2+events_unbound	23:40:50	4
1874821	99	29	27,2	cyclictest	2423133	-21	kworker/u16:2+events_unbound	23:40:50	4
1874821	99	29	27,2	cyclictest	2289732	-21	kworker/u16:0+events_unbound	22:22:43	4
1874825	99	28	26,2	cyclictest	2580481	-21	kworker/u16:1+events_unbound	00:28:52	5
1874825	99	28	26,2	cyclictest	2519509	-21	kworker/u16:2+events_unbound	00:07:32	5
1874825	99	28	26,2	cyclictest	2485002	-21	kworker/u16:3+events_unbound	00:23:32	5
1874825	99	28	26,2	cyclictest	2423133	-21	kworker/u16:2+events_unbound	23:19:26	5
1874825	99	28	26,2	cyclictest	2324757	-21	kworker/u16:0+events_unbound	22:44:15	5
1874825	99	28	26,2	cyclictest	2081939	-21	kworker/u16:1+flush-8:0	21:10:26	5
1874825	99	28	26,2	cyclictest	1884239	-21	kworker/u16:0+events_unbound	20:52:30	5
1874821	99	28	26,2	cyclictest	2543527	-21	kworker/u16:0+flush-8:0	00:17:39	4
1874821	99	28	26,2	cyclictest	2543527	-21	kworker/u16:0+flush-8:0	00:17:39	4
1874837	99	27	22,4	cyclictest	2291047	-21	latency_hist	22:22:40	7
1874825	99	27	25,2	cyclictest	2265245	-21	kworker/u16:1+events_unbound	23:53:34	5
1874825	99	27	25,2	cyclictest	2219124	-21	kworker/u16:4+events_unbound	22:01:47	5
1874821	99	27	25,2	cyclictest	2543527	-21	kworker/u16:0+flush-8:0	00:12:22	4
1874821	99	27	25,2	cyclictest	2398701	-21	kworker/u16:3+events_unbound	23:11:50	4
1874821	99	27	25,2	cyclictest	2373606	-21	kworker/u16:0+events_unbound	23:12:43	4
1874821	99	27	25,2	cyclictest	2265245	-21	kworker/u16:1+events_unbound	22:14:50	4
1874825	99	26	24,2	cyclictest	2603205	-21	kworker/u16:3+events_unbound	00:33:41	5
1874825	99	26	24,2	cyclictest	2423133	-21	kworker/u16:2+events_unbound	23:41:56	5
1874825	99	26	24,2	cyclictest	2423133	-21	kworker/u16:2+events_unbound	23:41:56	5
1874825	99	26	24,2	cyclictest	2265245	-21	kworker/u16:1+events_unbound	22:30:15	5
1874825	99	26	24,2	cyclictest	2219124	-21	kworker/u16:4+flush-8:0	22:08:06	5
1874825	99	26	24,2	cyclictest	2101452	-21	kworker/u16:3+events_unbound	21:46:18	5
1874825	99	26	24,2	cyclictest	2101452	-21	kworker/u16:3+events_unbound	21:28:37	5
1874825	99	26	24,2	cyclictest	2004446	-21	kworker/u16:2+events_unbound	20:42:26	5
1874825	99	26	24,2	cyclictest	1926682	-21	kworker/u16:1+events_unbound	19:56:11	5
1874837	99	25	0,23	cyclictest	2123033	-21	latency_hist	21:12:40	7
1874825	99	25	23,2	cyclictest	2423133	-21	kworker/u16:2+flush-8:0	23:24:35	5
1874825	99	25	23,2	cyclictest	2398701	-21	kworker/u16:3+events_unbound	23:10:40	5
1874825	99	25	23,2	cyclictest	2091665	-21	kworker/u16:2+flush-8:0	21:23:45	5
1874825	99	25	23,2	cyclictest	1926682	-21	kworker/u16:1+events_unbound	20:18:43	5
1874825	99	25	23,2	cyclictest	1884239	-21	kworker/u16:0+flush-8:0	19:23:26	5
1874825	99	25	23,2	cyclictest	1884239	-21	kworker/u16:0+events_unbound	20:56:26	5
1874825	99	25	22,2	cyclictest	2081939	-21	kworker/u16:1+events_unbound	20:57:50	5
1874825	99	25	22,2	cyclictest	2081939	-21	kworker/u16:1+events_unbound	20:57:50	5
1874821	99	25	23,2	cyclictest	2580481	-21	kworker/u16:1+events_unbound	00:29:49	4
1874821	99	25	23,2	cyclictest	2580481	-21	kworker/u16:1+events_unbound	00:24:42	4
1874821	99	25	23,2	cyclictest	2485002	-21	kworker/u16:3+events_unbound	23:45:06	4
1874821	99	25	23,2	cyclictest	2265245	-21	kworker/u16:1+events_unbound	23:07:26	4
1874821	99	25	23,2	cyclictest	2101452	-21	kworker/u16:3+events_unbound	21:39:42	4
1874821	99	25	23,2	cyclictest	2101452	-21	kworker/u16:3+events_unbound	21:32:34	4
1874825	99	24	22,2	cyclictest	2423133	-21	kworker/u16:2+events_unbound	23:34:40	5
1874825	99	24	22,2	cyclictest	2091665	-21	kworker/u16:2+flush-8:0	21:13:31	5
1874825	99	24	22,2	cyclictest	2091665	-21	kworker/u16:2+events_unbound	21:04:27	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17