OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Thu Aug 27, 2026 12:43:29)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1042895	2	74	0,0	sleep7	1042894	-21	ssh	09:24:09	7
768370	2	58	47,8	sleep4	0	-21	swapper/4	07:05:37	4
768527	2	54	19,30	sleep7	0	-21	swapper/7	07:07:48	7
768468	2	48	38,7	sleep5	0	-21	swapper/5	07:06:58	5
768948	99	36	32,3	cyclictest	1043775	-21	kworker/u16:4+events_unbound	09:35:22	5
768946	99	34	32,2	cyclictest	768729	-21	kworker/u16:1+events_unbound	07:15:11	4
767053	2	33	12,17	sleep6	0	-21	swapper/6	07:05:23	6
768948	99	32	31,1	cyclictest	1399161	-21	kworker/u16:1+events_unbound	12:03:11	5
768948	99	31	29,2	cyclictest	1290863	-21	kworker/u16:4+events_unbound	11:10:11	5
768948	99	29	28,1	cyclictest	1005253	-21	kworker/u16:5+events_unbound	09:17:15	5
768946	99	27	23,3	cyclictest	1080561	-21	cat	09:39:56	4
768948	99	26	24,2	cyclictest	1371939	-21	kworker/u16:2+flush-8:0	11:50:27	5
768948	99	26	24,2	cyclictest	1043775	-21	kworker/u16:4+events_unbound	10:30:27	5
768948	99	26	23,2	cyclictest	1031333	-21	kworker/u16:2+flush-8:0	09:30:07	5
768948	99	26	21,4	cyclictest	977056	-21	cat	08:54:56	5
768946	99	25	22,2	cyclictest	768729	-21	kworker/u16:1+flush-8:0	07:25:23	4
768948	99	24	22,2	cyclictest	1090486	-21	kworker/u16:3+flush-8:0	09:55:15	5
768948	99	24	21,3	cyclictest	860016	-21	kworker/u16:0+flush-8:0	08:55:14	5
768948	99	23	21,2	cyclictest	1031333	-21	kworker/u16:2+events_unbound	10:00:25	5
768948	99	22	20,2	cyclictest	1090486	-21	kworker/u16:3+flush-8:0	10:20:12	5
768948	99	21	19,2	cyclictest	1177182	-21	kworker/u16:0+flush-8:0	10:55:22	5
768948	99	21	18,2	cyclictest	1312558	-21	kworker/u16:0+events_unbound	11:34:58	5
768948	99	20	18,2	cyclictest	1487549	-21	kworker/u16:2+events_unbound	12:30:34	5
768948	99	20	17,2	cyclictest	860016	-21	kworker/u16:0+flush-8:0	08:35:07	5
768946	99	20	18,2	cyclictest	948171	-21	kworker/u16:1+flush-8:0	09:05:12	4
768954	99	19	18,0	cyclictest	0	-21	swapper/7	09:14:46	7
768954	99	19	0,17	cyclictest	1422809	-21	ssh	11:55:21	7
768954	99	19	0,17	cyclictest	1422809	-21	ssh	11:55:21	7
768952	99	19	15,3	cyclictest	1290445	-21	cat	11:04:56	6
768948	99	19	17,2	cyclictest	815717	-21	kworker/u16:2+flush-8:0	07:35:25	5
768948	99	19	17,2	cyclictest	1043775	-21	kworker/u16:4+events_unbound	09:45:26	5
768946	99	19	17,2	cyclictest	1312558	-21	kworker/u16:0+events_unbound	12:00:11	4
768954	99	18	17,0	cyclictest	0	-21	swapper/7	10:30:11	7
768954	99	18	16,1	cyclictest	0	-21	swapper/7	10:50:20	7
768954	99	18	16,1	cyclictest	0	-21	swapper/7	09:25:23	7
768954	99	18	15,2	cyclictest	1277	-21	snmpd	09:44:09	7
768952	99	18	16,2	cyclictest	987001	-21	kworker/u16:3+events_unbound	09:00:11	6
768952	99	18	16,2	cyclictest	880106	-21	kworker/u16:3+events_unbound	08:05:11	6
768948	99	18	16,2	cyclictest	860016	-21	kworker/u16:0+flush-8:0	08:30:24	5
768948	99	18	16,2	cyclictest	1399161	-21	kworker/u16:1+events_unbound	12:20:09	5
768948	99	18	16,2	cyclictest	1043775	-21	kworker/u16:4+events_unbound	10:05:45	5
768946	99	18	14,3	cyclictest	801841	-21	latency_hist	07:24:57	4
768954	99	17	16,0	cyclictest	0	-21	swapper/7	10:59:56	7
768954	99	17	14,2	cyclictest	1277	-21	snmpd	08:26:52	7
768954	99	17	0,15	cyclictest	1277	-21	snmpd	09:18:33	7
768948	99	17	15,2	cyclictest	1399161	-21	kworker/u16:1+events_unbound	12:29:18	5
768948	99	17	13,3	cyclictest	1312558	-21	kworker/u16:0+flush-8:0	11:49:56	5
768948	99	17	13,3	cyclictest	1277232	-21	kworker/u16:1+flush-8:0	11:05:21	5
768954	99	16	14,1	cyclictest	0	-21	swapper/7	12:15:19	7
768954	99	16	0,14	cyclictest	1311830	-21	ssh	11:10:20	7
768954	99	16	0,14	cyclictest	0	-21	swapper/7	11:25:19	7
768948	99	16	13,2	cyclictest	1177182	-21	kworker/u16:0+flush-8:0	11:00:15	5
768948	99	16	12,3	cyclictest	1177182	-21	kworker/u16:0+events_unbound	10:45:12	5
768948	99	16	11,4	cyclictest	1204091	-21	kworker/u16:2+events_unbound	10:54:56	5
768946	99	16	14,2	cyclictest	1399161	-21	kworker/u16:1+events_unbound	12:20:11	4
768946	99	16	14,2	cyclictest	1177182	-21	kworker/u16:0+events_unbound	10:25:10	4
768946	99	16	0,1	cyclictest	0	-21	swapper/4	11:45:20	4
768954	99	15	11,3	cyclictest	1277	-21	snmpd	07:52:09	7
768954	99	15	0,14	cyclictest	938050	-21	turbostat	08:34:57	7
768954	99	15	0,14	cyclictest	0	-21	swapper/7	08:35:19	7
768954	99	15	0,14	cyclictest	0	-21	swapper/7	07:25:20	7
768954	99	15	0,13	cyclictest	1277	-21	snmpd	08:47:05	7
768954	99	15	0,13	cyclictest	0	-21	swapper/7	12:10:18	7
768952	99	15	10,4	cyclictest	879715	-21	latency_hist	08:04:57	6
768952	99	15	10,4	cyclictest	1179296	-21	cat	10:19:56	6
768952	99	15	0,1	cyclictest	0	-21	swapper/6	07:19:57	6
768952	99	15	0,15	cyclictest	86	-21	ksoftirqd/6	12:12:32	6
768952	99	15	0,15	cyclictest	0	-21	swapper/6	09:17:33	6
768948	99	15	12,2	cyclictest	1399161	-21	kworker/u16:1+events_unbound	12:35:06	5
768946	99	15	0,14	cyclictest	0	-21	swapper/4	09:15:09	4
768954	99	14	13,0	cyclictest	0	-21	swapper/7	09:00:25	7
768954	99	14	0,1	cyclictest	0	-21	swapper/7	11:45:22	7
768954	99	14	0,1	cyclictest	0	-21	swapper/7	11:05:18	7
768954	99	14	0,1	cyclictest	0	-21	swapper/7	10:05:22	7
768954	99	14	0,1	cyclictest	0	-21	swapper/7	09:50:22	7
768954	99	14	0,1	cyclictest	0	-21	swapper/7	09:50:22	7
768954	99	14	0,1	cyclictest	0	-21	swapper/7	08:00:22	7
768954	99	14	0,13	cyclictest	0	-21	swapper/7	09:37:18	7
768952	99	14	13,1	cyclictest	0	-21	swapper/6	11:54:44	6
768952	99	14	13,1	cyclictest	0	-21	swapper/6	10:21:24	6
768952	99	14	13,1	cyclictest	0	-21	swapper/6	09:21:29	6
768952	99	14	0,1	cyclictest	0	-21	swapper/6	11:30:36	6
768952	99	14	0,1	cyclictest	0	-21	swapper/6	09:32:03	6
768952	99	14	0,14	cyclictest	0	-21	swapper/6	09:58:04	6
768952	99	14	0,14	cyclictest	0	-21	swapper/6	09:50:11	6
768952	99	14	0,14	cyclictest	0	-21	swapper/6	09:50:11	6
768952	99	14	0,14	cyclictest	0	-21	swapper/6	07:55:25	6
768948	99	14	9,4	cyclictest	1092783	-21	latency_hist	09:44:56	5
768948	99	14	12,2	cyclictest	768729	-21	kworker/u16:1+events_unbound	07:30:10	5
768948	99	14	12,2	cyclictest	1371939	-21	kworker/u16:2+events_unbound	11:55:18	5
768948	99	14	12,2	cyclictest	1371939	-21	kworker/u16:2+events_unbound	11:55:18	5
768948	99	14	12,2	cyclictest	1312558	-21	kworker/u16:0+events_unbound	11:30:11	5
768946	99	14	13,1	cyclictest	0	-21	swapper/4	11:58:47	4
768946	99	14	13,1	cyclictest	0	-21	swapper/4	11:58:47	4
768946	99	14	13,1	cyclictest	0	-21	swapper/4	11:03:36	4
768946	99	14	13,1	cyclictest	0	-21	swapper/4	09:12:00	4
768946	99	14	13,1	cyclictest	0	-21	swapper/4	08:15:14	4
768946	99	14	12,2	cyclictest	880106	-21	kworker/u16:3+flush-8:0	08:30:12	4
768946	99	14	0,1	cyclictest	0	-21	swapper/4	12:06:31	4
768946	99	14	0,1	cyclictest	0	-21	swapper/4	10:48:57	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17