OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Fri Mar 27, 2026 00:43:48)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4086395	99	538	38,499	cyclictest	0	-21	swapper/5	21:17:43	11
4086391	99	526	29,497	cyclictest	0	-21	swapper/4	22:46:42	10
4086404	99	523	520,3	cyclictest	4189798	-21	kworker/7:2+i915-unordered	21:30:43	13
4086422	99	521	19,501	cyclictest	0	-21	swapper/11	21:37:43	3
4086385	99	508	506,1	cyclictest	33219	-21	kworker/2:1+i915-unordered	22:55:42	8
4086395	99	506	503,2	cyclictest	19190	-21	kworker/5:1+i915-unordered	22:27:43	11
4086395	99	505	4,497	cyclictest	0	-21	swapper/5	22:10:43	11
4086395	99	505	4,497	cyclictest	0	-21	swapper/5	22:10:43	11
4086437	99	499	496,3	cyclictest	0	-21	swapper/15	21:30:43	7
4086399	99	494	65,422	cyclictest	21136	-21	kworker/6:2+i915-unordered	22:17:43	12
4086399	99	494	65,422	cyclictest	21136	-21	kworker/6:2+i915-unordered	22:17:43	12
4086380	99	490	488,2	cyclictest	28356	-21	kworker/1:2+i915-unordered	23:48:42	1
4086399	99	488	485,2	cyclictest	4139186	-21	kworker/6:2+i915-unordered	20:18:43	12
4086399	99	485	483,2	cyclictest	21136	-21	kworker/6:2+i915-unordered	21:57:43	12
4086399	99	483	481,2	cyclictest	4107023	-21	kworker/6:0+i915-unordered	19:47:43	12
4086399	99	481	479,2	cyclictest	4139186	-21	kworker/6:2+i915-unordered	20:32:43	12
4086387	99	480	478,2	cyclictest	10367	-21	kworker/3:1+i915-unordered	21:37:43	9
4086399	99	478	65,410	cyclictest	68432	-21	kworker/6:1+i915-unordered	23:37:42	12
4086385	99	477	474,3	cyclictest	0	-21	swapper/2	20:43:43	8
4086399	99	473	472,1	cyclictest	28478	-21	kworker/6:1+i915-unordered	22:21:43	12
4086399	99	473	472,1	cyclictest	28478	-21	kworker/6:1+i915-unordered	22:21:43	12
4086399	99	471	15,456	cyclictest	0	-21	swapper/6	19:35:43	12
4086399	99	470	469,1	cyclictest	68432	-21	kworker/6:1+i915-unordered	23:32:42	12
4086399	99	468	13,454	cyclictest	0	-21	swapper/6	21:17:43	12
4086399	99	467	75,391	cyclictest	0	-21	swapper/6	19:18:43	12
4086429	99	465	464,1	cyclictest	4187730	-21	kworker/13:0+i915-unordered	21:17:43	5
4086410	99	463	8,58	cyclictest	0	-21	swapper/9	00:37:26	15
4086399	99	463	24,438	cyclictest	0	-21	swapper/6	22:10:43	12
4086399	99	463	24,438	cyclictest	0	-21	swapper/6	22:10:43	12
4086429	99	461	459,2	cyclictest	26263	-21	kworker/13:1+i915-unordered	22:10:43	5
4086429	99	461	459,2	cyclictest	26263	-21	kworker/13:1+i915-unordered	22:10:43	5
4086399	99	458	0,454	cyclictest	0	-21	swapper/6	20:43:43	12
4086410	99	456	26,29	cyclictest	0	-21	swapper/9	19:26:05	15
4086410	99	456	26,29	cyclictest	0	-21	swapper/9	19:26:05	15
4086395	99	455	452,3	cyclictest	0	-21	swapper/5	21:10:43	11
4086410	99	454	24,30	cyclictest	0	-21	swapper/9	22:31:04	15
4086427	99	453	451,2	cyclictest	48331	-21	kworker/12:2+i915-unordered	22:42:43	4
4086415	99	453	25,30	cyclictest	0	-21	swapper/10	23:10:04	2
4086410	99	453	26,30	cyclictest	0	-21	swapper/9	23:28:26	15
4086395	99	452	26,425	cyclictest	70	-21	ksoftirqd/5	21:33:42	11
4086399	99	449	448,1	cyclictest	0	-21	swapper/6	22:27:43	12
4086376	99	449	23,30	cyclictest	0	-21	swapper/0	20:01:43	0
4086429	99	448	26,29	cyclictest	0	-21	swapper/13	20:03:26	5
4086399	99	444	4,438	cyclictest	0	-21	swapper/6	22:55:42	12
4086427	99	443	2,3	cyclictest	0	-21	swapper/12	23:42:55	4
4086399	99	443	2,438	cyclictest	0	-21	swapper/6	22:42:43	12
4086399	99	443	1,439	cyclictest	0	-21	swapper/6	21:02:43	12
4086399	99	442	19,30	cyclictest	0	-21	swapper/6	21:53:42	12
4086406	99	441	18,30	cyclictest	0	-21	swapper/8	21:27:25	14
4086399	99	441	0,439	cyclictest	0	-21	swapper/6	21:37:43	12
4086399	99	439	438,1	cyclictest	0	-21	swapper/6	21:30:43	12
4086429	99	435	19,30	cyclictest	0	-21	swapper/13	21:13:43	5
4086422	99	435	8,426	cyclictest	124	-21	ksoftirqd/11	23:21:42	3
4086422	99	435	8,426	cyclictest	124	-21	ksoftirqd/11	00:06:42	3
4086410	99	435	9,30	cyclictest	0	-21	swapper/9	21:06:43	15
4086380	99	435	12,29	cyclictest	0	-21	swapper/1	21:20:42	1
4086437	99	434	431,3	cyclictest	1818	-21	snmpd	21:56:16	7
4086406	99	434	430,3	cyclictest	1818	-21	snmpd	21:22:54	14
4086395	99	434	10,30	cyclictest	70	-21	ksoftirqd/5	19:54:38	11
4086380	99	434	5,29	cyclictest	63537	-21	ntpq	23:00:03	1
4086385	99	431	9,30	cyclictest	0	-21	swapper/2	23:43:42	8
4086422	99	430	428,1	cyclictest	0	-21	swapper/11	20:23:43	3
4086399	99	430	428,2	cyclictest	0	-21	swapper/6	21:10:43	12
4086422	99	429	5,423	cyclictest	124	-21	ksoftirqd/11	23:17:42	3
4086410	99	429	0,29	cyclictest	0	-21	swapper/9	20:53:03	15
4086399	99	428	426,2	cyclictest	0	-21	swapper/6	23:48:42	12
4086429	99	427	3,29	cyclictest	0	-21	swapper/13	22:19:04	5
4086429	99	427	3,29	cyclictest	0	-21	swapper/13	22:19:04	5
4086410	99	427	0,30	cyclictest	0	-21	swapper/9	23:49:04	15
4086376	99	427	1,29	cyclictest	0	-21	swapper/0	20:05:43	0
4086422	99	425	0,424	cyclictest	124	-21	ksoftirqd/11	23:52:42	3
4086410	99	425	24,400	cyclictest	0	-21	swapper/9	20:16:28	15
4086399	99	425	423,2	cyclictest	0	-21	swapper/6	22:35:43	12
4086376	99	425	0,30	cyclictest	0	-21	swapper/0	20:40:43	0
4086410	99	424	26,395	cyclictest	0	-21	swapper/9	20:04:27	15
4086399	99	424	423,1	cyclictest	0	-21	swapper/6	22:46:42	12
4086380	99	424	1,30	cyclictest	34	-21	ksoftirqd/1	22:07:42	1
4086380	99	424	0,30	cyclictest	0	-21	swapper/1	20:51:43	1
4086385	99	423	0,30	cyclictest	0	-21	swapper/2	22:50:42	8
4086429	99	422	422,0	cyclictest	0	-21	swapper/13	22:40:42	5
4086404	99	422	419,3	cyclictest	4065736	-21	kworker/u64:11+events_unbound	19:38:43	13
4086433	99	421	22,398	cyclictest	0	-21	swapper/14	20:50:05	6
4086391	99	421	26,395	cyclictest	0	-21	swapper/4	19:10:27	10
4086415	99	420	25,392	cyclictest	0	-21	swapper/10	19:51:43	2
4086404	99	420	22,397	cyclictest	0	-21	swapper/7	21:35:05	13
4086387	99	420	0,30	cyclictest	0	-21	swapper/3	00:12:42	9
4086380	99	420	25,394	cyclictest	0	-21	swapper/1	22:03:42	1
4086422	99	419	25,393	cyclictest	0	-21	swapper/11	23:13:42	3
4086385	99	418	25,393	cyclictest	0	-21	swapper/2	21:05:43	8
4086437	99	416	17,398	cyclictest	0	-21	swapper/15	21:15:06	7
4086433	99	416	16,399	cyclictest	0	-21	swapper/14	21:25:05	6
4086415	99	416	18,395	cyclictest	0	-21	swapper/10	22:50:04	2
4086395	99	416	21,394	cyclictest	0	-21	swapper/5	20:31:43	11
4086380	99	415	21,393	cyclictest	0	-21	swapper/1	20:56:43	1
4086433	99	414	15,396	cyclictest	0	-21	swapper/14	22:33:27	6
4086429	99	414	414,0	cyclictest	0	-21	swapper/13	00:12:05	5
4086395	99	414	19,394	cyclictest	0	-21	swapper/5	20:37:43	11
4086437	99	413	19,393	cyclictest	0	-21	swapper/15	20:00:43	7
4086437	99	412	14,397	cyclictest	0	-21	swapper/15	00:35:05	7
4086429	99	412	21,390	cyclictest	0	-21	swapper/13	21:31:42	5
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17