OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #2

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot2.osadl.org (updated Tue Apr 21, 2026 12:43:34)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
787460	2	101	0,1	sleep7	787461	-21	kthreadcore	12:29:53	7
637497	2	98	0,1	sleep5	0	-21	swapper/5	11:29:48	5
347188	2	94	0,1	sleep5	0	-21	swapper/5	09:29:51	5
60483	2	58	48,7	sleep5	0	-21	swapper/5	07:05:53	5
60728	2	56	45,8	sleep4	0	-21	swapper/4	07:09:21	4
61046	99	42	40,2	cyclictest	698958	-21	kworker/u16:1+flush-8:0	12:04:33	5
60541	2	40	3,31	sleep7	0	-21	swapper/7	07:06:43	7
60455	2	33	21,8	sleep6	0	-21	swapper/6	07:05:30	6
61053	99	32	26,5	cyclictest	344026	-21	latency_hist	09:29:34	7
61046	99	32	30,2	cyclictest	112800	-21	kworker/u16:3+flush-8:0	08:14:33	5
61046	99	32	29,2	cyclictest	141474	-21	kworker/u16:0+events_unbound	07:49:48	5
61046	99	27	24,2	cyclictest	274263	-21	kworker/u16:1+flush-8:0	11:09:39	5
61046	99	27	24,2	cyclictest	274263	-21	kworker/u16:1+flush-8:0	11:09:39	5
61046	99	26	24,2	cyclictest	274263	-21	kworker/u16:1+events_unbound	10:55:02	5
61053	99	25	19,4	cyclictest	624017	-21	latency_hist	11:24:33	7
61046	99	25	23,2	cyclictest	274263	-21	kworker/u16:1+events_unbound	10:04:48	5
61053	99	24	19,4	cyclictest	636171	-21	latency_hist	11:29:33	7
61053	99	24	18,5	cyclictest	131852	-21	latency_hist	07:44:34	7
61046	99	24	23,1	cyclictest	782643	-21	kworker/u16:4+events_unbound	12:31:24	5
61046	99	24	19,4	cyclictest	502128	-21	kworker/u16:2+flush-8:0	10:39:33	5
61046	99	23	21,2	cyclictest	770267	-21	kworker/u16:0+events_unbound	12:35:03	5
61046	99	23	21,2	cyclictest	698958	-21	kworker/u16:1+flush-8:0	12:09:33	5
61046	99	23	21,2	cyclictest	295639	-21	kworker/u16:4+events_unbound	09:55:02	5
61042	99	23	19,3	cyclictest	467007	-21	diskstats	10:19:46	4
61042	99	23	0,13	cyclictest	0	-21	swapper/4	11:29:47	4
61046	99	22	20,2	cyclictest	274263	-21	kworker/u16:1+flush-8:0	09:22:54	5
61053	99	21	15,5	cyclictest	635	-21	systemd-journal	10:24:32	7
61046	99	20	18,2	cyclictest	633665	-21	kworker/u16:2+events_unbound	11:34:48	5
61046	99	20	18,2	cyclictest	3566974	-21	kworker/u16:3+flush-8:0	07:09:48	5
61053	99	19	13,5	cyclictest	635	-21	systemd-journal	11:04:32	7
61053	99	19	1,2	cyclictest	377325	-21	ssh	09:39:57	7
61053	99	18	14,2	cyclictest	645144	-21	ssh	11:29:57	7
61053	99	18	0,17	cyclictest	0	-21	swapper/7	08:04:57	7
61053	99	18	0,16	cyclictest	1053	-21	ntpd	08:41:54	7
61046	99	18	17,1	cyclictest	648500	-21	kworker/u16:4+events_unbound	11:55:33	5
61046	99	18	16,2	cyclictest	514720	-21	kworker/u16:5+events_unbound	10:50:01	5
61053	99	17	14,2	cyclictest	1234	-21	snmpd	10:04:17	7
61053	99	17	13,3	cyclictest	1234	-21	snmpd	07:27:29	7
61053	99	17	11,5	cyclictest	319576	-21	latency_hist	09:19:33	7
61048	99	17	16,1	cyclictest	0	-21	swapper/6	08:39:17	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	08:28:01	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	08:28:01	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	08:21:52	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	07:59:21	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	07:39:53	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	07:36:49	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	07:32:43	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	07:18:23	6
61048	99	17	16,1	cyclictest	0	-21	swapper/6	07:10:12	6
61048	99	17	15,1	cyclictest	0	-21	swapper/6	08:09:35	6
61048	99	17	14,2	cyclictest	0	-21	swapper/6	09:34:47	6
61042	99	17	14,2	cyclictest	392842	-21	kworker/u16:2+flush-8:0	10:09:33	4
61053	99	16	11,4	cyclictest	635	-21	systemd-journal	11:54:32	7
61053	99	16	0,14	cyclictest	1234	-21	snmpd	10:19:24	7
61053	99	16	0,14	cyclictest	0	-21	swapper/7	08:29:57	7
61048	99	16	15,1	cyclictest	0	-21	swapper/6	09:05:50	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	09:05:50	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	09:02:46	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:58:44	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:52:35	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:45:25	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:40:18	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:31:05	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:15:44	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:05:29	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	08:04:28	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	07:52:11	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	07:47:03	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	07:27:36	6
61048	99	16	15,1	cyclictest	0	-21	swapper/6	07:20:26	6
61048	99	16	11,4	cyclictest	0	-21	swapper/6	10:14:40	6
61046	99	16	14,2	cyclictest	392842	-21	kworker/u16:2+flush-8:0	10:10:03	5
61046	99	16	14,2	cyclictest	274263	-21	kworker/u16:1+flush-8:0	10:30:12	5
61046	99	16	13,2	cyclictest	2805975	-21	kworker/u16:5+events_unbound	07:24:47	5
61042	99	16	14,2	cyclictest	295639	-21	kworker/u16:4+flush-8:0	09:55:37	4
61042	99	16	13,2	cyclictest	755465	-21	kworker/u16:3+flush-8:0	12:19:58	4
61053	99	15	9,5	cyclictest	6382	-21	gvfs-afc-volume	07:09:54	7
61046	99	15	13,2	cyclictest	274263	-21	kworker/u16:1+flush-8:0	09:00:02	5
61046	99	15	11,3	cyclictest	112800	-21	kworker/u16:3+events_unbound	08:14:47	5
61046	99	15	0,14	cyclictest	734781	-21	perl	12:09:46	5
61042	99	15	0,14	cyclictest	0	-21	swapper/4	07:24:52	4
61053	99	14	11,2	cyclictest	1234	-21	snmpd	11:36:11	7
61053	99	14	11,2	cyclictest	1234	-21	snmpd	08:09:51	7
61053	99	14	10,3	cyclictest	6514	-21	gmain	12:09:46	7
61053	99	14	0,1	cyclictest	0	-21	swapper/7	10:04:57	7
61048	99	14	13,1	cyclictest	0	-21	swapper/6	11:32:14	6
61048	99	14	13,1	cyclictest	0	-21	swapper/6	09:55:26	6
61048	99	14	0,7	cyclictest	0	-21	swapper/6	12:34:50	6
61048	99	14	0,14	cyclictest	0	-21	swapper/6	12:31:03	6
61048	99	14	0,14	cyclictest	0	-21	swapper/6	12:09:55	6
61048	99	14	0,14	cyclictest	0	-21	swapper/6	10:41:57	6
61046	99	14	13,1	cyclictest	0	-21	swapper/5	10:43:04	5
61046	99	14	12,2	cyclictest	538964	-21	kworker/u16:0+events_unbound	11:50:02	5
61046	99	14	12,2	cyclictest	102235	-21	kworker/u16:2+flush-8:0	08:00:03	5
61046	99	14	11,2	cyclictest	422230	-21	kworker/u16:0+flush-8:0	10:01:09	5
61046	99	14	0,1	cyclictest	0	-21	swapper/5	11:46:26	5
61046	99	14	0,1	cyclictest	0	-21	swapper/5	11:06:14	5
61042	99	14	0,1	cyclictest	0	-21	swapper/4	10:24:58	4
61053	99	13	9,3	cyclictest	1234	-21	snmpd	12:04:30	7
61053	99	13	9,3	cyclictest	1234	-21	snmpd	11:16:37	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17