OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Wed Jun 10, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2036454	2	57	47,7	sleep5	0	-21	swapper/5	07:02:48	5
2037008	99	51	49,2	cyclictest	1314489	-21	kworker/u16:1+flush-8:0	07:31:37	6
2036658	2	51	24,7	sleep4	0	-21	swapper/4	07:05:36	4
2037008	99	50	47,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:36:43	6
2037008	99	47	45,2	cyclictest	2069458	-21	kworker/u16:4+events_unbound	07:51:40	6
2037003	99	46	45,1	cyclictest	2522352	-21	kworker/u16:2+events_unbound	11:18:40	4
2037008	99	45	43,2	cyclictest	2474790	-21	kworker/u16:1+events_unbound	10:32:56	6
2037013	99	43	37,5	cyclictest	635	-21	systemd-journal	07:31:14	7
2037008	99	43	40,2	cyclictest	2332067	-21	kworker/u16:1+events_unbound	09:51:16	6
2037008	99	42	39,2	cyclictest	2203986	-21	kworker/u16:2+events_unbound	09:13:04	6
2037008	99	41	35,6	cyclictest	2487659	-21	kworker/u16:0+flush-8:0	10:45:55	6
2028030	2	41	4,31	sleep7	0	-21	swapper/7	07:01:30	7
2037008	99	40	38,2	cyclictest	2620428	-21	kworker/u16:4+events_unbound	12:03:11	6
2037008	99	40	38,2	cyclictest	2487659	-21	kworker/u16:0+events_unbound	11:02:56	6
2037008	99	40	38,2	cyclictest	2401555	-21	kworker/u16:2+events_unbound	09:59:44	6
2037008	99	40	34,6	cyclictest	2522352	-21	kworker/u16:2+events_unbound	10:59:27	6
2037008	99	39	37,2	cyclictest	2620428	-21	kworker/u16:4+events_unbound	12:08:00	6
2037008	99	39	37,2	cyclictest	2487659	-21	kworker/u16:0+events_unbound	11:09:19	6
2037008	99	38	36,2	cyclictest	2644917	-21	kworker/u16:0+events_unbound	12:17:43	6
2037008	99	38	36,2	cyclictest	2522352	-21	kworker/u16:2+events_unbound	10:50:55	6
2037008	99	38	35,2	cyclictest	2607917	-21	kworker/u16:1+events_unbound	11:38:16	6
2037008	99	38	35,2	cyclictest	2332067	-21	kworker/u16:1+events_unbound	10:11:12	6
2037005	99	38	36,2	cyclictest	2644917	-21	kworker/u16:0+events_unbound	12:21:35	5
2037005	99	38	35,2	cyclictest	2036470	-21	kworker/u16:2+flush-8:0	07:16:30	5
2037003	99	38	36,2	cyclictest	2620428	-21	kworker/u16:4+events_unbound	11:39:56	4
2037008	99	37	35,2	cyclictest	2761626	-21	kworker/u16:1+events_unbound	12:33:15	6
2037008	99	37	35,2	cyclictest	2462496	-21	kworker/u16:3+events_unbound	10:41:08	6
2037008	99	37	35,2	cyclictest	2203986	-21	kworker/u16:2+events_unbound	09:19:09	6
2037003	99	37	35,2	cyclictest	2487659	-21	kworker/u16:0+events_unbound	10:46:09	4
2037003	99	37	35,2	cyclictest	2203986	-21	kworker/u16:2+events_unbound	09:15:23	4
2037003	99	37	34,2	cyclictest	2401555	-21	kworker/u16:2+events_unbound	10:16:43	4
2037008	99	36	34,2	cyclictest	2761626	-21	kworker/u16:1+events_unbound	12:27:47	6
2037008	99	36	34,2	cyclictest	2644917	-21	kworker/u16:0+events_unbound	11:41:51	6
2037008	99	36	34,2	cyclictest	2522352	-21	kworker/u16:2+events_unbound	11:27:39	6
2037008	99	36	34,2	cyclictest	2401555	-21	kworker/u16:2+events_unbound	10:22:36	6
2037008	99	36	34,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:27:41	6
2037003	99	36	35,1	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:27:24	4
2037003	99	36	34,2	cyclictest	2761626	-21	kworker/u16:1+events_unbound	12:31:41	4
2037003	99	36	34,2	cyclictest	2644917	-21	kworker/u16:0+events_unbound	11:45:16	4
2037003	99	36	34,2	cyclictest	2297112	-21	kworker/u16:4+events_unbound	09:17:24	4
2037003	99	36	33,3	cyclictest	2522352	-21	kworker/u16:2+events_unbound	10:49:23	4
2037003	99	36	33,2	cyclictest	2487659	-21	kworker/u16:0+flush-8:0	11:21:24	4
2037013	99	35	30,4	cyclictest	2656504	-21	latency_hist	11:46:14	7
2037008	99	35	33,2	cyclictest	2678180	-21	kworker/u16:1+events_unbound	11:52:48	6
2037008	99	35	33,2	cyclictest	2487659	-21	kworker/u16:0+events_unbound	10:55:15	6
2037008	99	35	33,2	cyclictest	2332067	-21	kworker/u16:1+events_unbound	09:32:48	6
2037008	99	35	33,2	cyclictest	2203986	-21	kworker/u16:2+events_unbound	09:07:00	6
2037008	99	35	33,2	cyclictest	2203986	-21	kworker/u16:2+events_unbound	09:07:00	6
2037003	99	35	33,2	cyclictest	2462496	-21	kworker/u16:3+events_unbound	10:52:23	4
2037003	99	35	33,2	cyclictest	2297112	-21	kworker/u16:4+events_unbound	09:21:24	4
2037003	99	35	33,2	cyclictest	2232549	-21	kworker/u16:0+events_unbound	09:55:52	4
2037008	99	34	32,2	cyclictest	2607917	-21	kworker/u16:1+events_unbound	11:25:48	6
2037008	99	34	32,2	cyclictest	2558120	-21	kworker/u16:1+flush-8:0	11:17:11	6
2037008	99	34	32,2	cyclictest	2487659	-21	kworker/u16:0+events_unbound	11:15:16	6
2037008	99	34	32,2	cyclictest	2332067	-21	kworker/u16:1+events_unbound	10:03:04	6
2037008	99	34	32,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:01:11	6
2037008	99	34	32,2	cyclictest	2069458	-21	kworker/u16:4+events_unbound	07:30:24	6
2037008	99	34	32,2	cyclictest	1314489	-21	kworker/u16:1+events_unbound	07:16:45	6
2037008	99	34	31,2	cyclictest	1314489	-21	kworker/u16:1+flush-8:0	08:06:14	6
2037003	99	34	32,2	cyclictest	2644917	-21	kworker/u16:0+events_unbound	12:26:15	4
2037003	99	34	32,2	cyclictest	2607917	-21	kworker/u16:1+flush-8:0	11:28:15	4
2037003	99	34	32,2	cyclictest	2522352	-21	kworker/u16:2+events_unbound	10:58:12	4
2037003	99	34	32,2	cyclictest	2462496	-21	kworker/u16:3+events_unbound	10:39:23	4
2037003	99	34	31,2	cyclictest	2487659	-21	kworker/u16:0+events_unbound	11:06:23	4
2037008	99	33	31,2	cyclictest	2644917	-21	kworker/u16:0+flush-8:0	11:49:55	6
2037008	99	33	31,2	cyclictest	2644917	-21	kworker/u16:0+events_unbound	12:14:55	6
2037008	99	33	31,2	cyclictest	2620428	-21	kworker/u16:4+events_unbound	11:59:48	6
2037008	99	33	31,2	cyclictest	2474790	-21	kworker/u16:1+events_unbound	10:30:51	6
2037008	99	33	31,2	cyclictest	2474790	-21	kworker/u16:1+events_unbound	10:30:51	6
2037008	99	33	31,2	cyclictest	2439030	-21	kworker/u16:0+events_unbound	10:18:40	6
2037005	99	33	31,2	cyclictest	2098275	-21	kworker/u16:0+events_unbound	07:41:44	5
2037005	99	33	30,2	cyclictest	2741047	-21	kworker/u16:3+events_unbound	12:26:36	5
2037003	99	33	31,2	cyclictest	2714688	-21	kworker/u16:1+events_unbound	12:08:24	4
2037003	99	33	31,2	cyclictest	2522352	-21	kworker/u16:2+flush-8:0	11:35:56	4
2037003	99	33	31,2	cyclictest	2474790	-21	kworker/u16:1+events_unbound	10:34:12	4
2037008	99	32	30,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:42:01	6
2037008	99	32	30,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:25:19	6
2037003	99	32	30,2	cyclictest	2714688	-21	kworker/u16:1+events_unbound	12:18:24	4
2037003	99	32	30,2	cyclictest	2522352	-21	kworker/u16:2+flush-8:0	11:56:55	4
2037003	99	32	30,2	cyclictest	2522352	-21	kworker/u16:2+events_unbound	11:11:51	4
2037003	99	32	30,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:43:12	4
2037003	99	32	30,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:08:48	4
2037003	99	32	30,2	cyclictest	2189885	-21	kworker/u16:3+events_unbound	09:08:48	4
2037008	99	31	29,2	cyclictest	2522352	-21	kworker/u16:2+events_unbound	11:35:44	6
2037008	99	31	29,2	cyclictest	2165949	-21	kworker/u16:0+events_unbound	08:25:52	6
2037005	99	31	29,2	cyclictest	2462496	-21	kworker/u16:3+events_unbound	10:41:28	5
2037005	99	31	28,2	cyclictest	2474790	-21	kworker/u16:1+flush-8:0	10:46:31	5
2037003	99	31	30,1	cyclictest	2332067	-21	kworker/u16:1+events_unbound	10:07:59	4
2037003	99	31	29,2	cyclictest	2620428	-21	kworker/u16:4+events_unbound	11:48:36	4
2037003	99	31	29,2	cyclictest	2439030	-21	kworker/u16:0+events_unbound	10:15:48	4
2037013	99	30	27,2	cyclictest	2460980	-21	ssh	10:21:36	7
2037005	99	30	28,2	cyclictest	1314489	-21	kworker/u16:1+events_unbound	08:31:32	5
2037005	99	30	27,2	cyclictest	2203986	-21	kworker/u16:2+flush-8:0	09:01:15	5
2037003	99	30	28,2	cyclictest	2678180	-21	kworker/u16:1+events_unbound	11:56:07	4
2037003	99	30	27,3	cyclictest	2401555	-21	kworker/u16:2+events_unbound	10:26:00	4
2037003	99	30	27,2	cyclictest	2620428	-21	kworker/u16:4+events_unbound	12:03:07	4
2036409	2	30	20,7	sleep6	0	-21	swapper/6	07:02:09	6
2037008	99	29	27,2	cyclictest	2739311	-21	kworker/u16:2+flush-8:0	12:22:31	6
2037008	99	29	27,2	cyclictest	2203986	-21	kworker/u16:2+events_unbound	08:48:23	6
2037003	99	29	27,2	cyclictest	2714688	-21	kworker/u16:1+events_unbound	12:15:51	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17