OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Fri Nov 21, 2025 00:43:47)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2066840	99	680	286,394	cyclictest	0	-21	swapper/2	21:35:48	8
2066840	99	680	286,394	cyclictest	0	-21	swapper/2	21:35:48	8
2066859	99	552	1,550	cyclictest	88	-21	ksoftirqd/7	20:25:49	13
2066843	99	552	31,520	cyclictest	0	-21	swapper/3	23:52:48	9
2066851	99	548	2,26	cyclictest	70	-21	ksoftirqd/5	19:35:49	11
2066889	99	546	22,523	cyclictest	0	-21	swapper/14	20:15:49	6
2066889	99	543	6,536	cyclictest	0	-21	swapper/14	20:13:49	6
2066882	99	527	21,44	cyclictest	0	-21	swapper/12	22:56:48	4
2066843	99	517	515,2	cyclictest	2190827	-21	kworker/3:0+i915-unordered	21:38:49	9
2066843	99	517	515,2	cyclictest	2190827	-21	kworker/3:0+i915-unordered	21:38:49	9
2066882	99	514	9,29	cyclictest	133	-21	ksoftirqd/12	19:35:49	4
2066889	99	513	512,1	cyclictest	2096505	-21	kworker/14:2+i915-unordered	20:06:49	6
2066882	99	510	6,503	cyclictest	133	-21	ksoftirqd/12	20:25:49	4
2066877	99	508	507,1	cyclictest	2305841	-21	kworker/11:0+i915-unordered	23:52:48	3
2066882	99	506	82,423	cyclictest	2301902	-21	kworker/12:1+i915-unordered	00:30:48	4
2066851	99	505	26,475	cyclictest	2191149	-21	sleep	21:39:44	11
2066851	99	505	26,475	cyclictest	2191149	-21	sleep	21:39:44	11
2066882	99	499	22,477	cyclictest	0	-21	swapper/12	21:57:49	4
2066840	99	496	37,459	cyclictest	0	-21	swapper/2	22:35:48	8
2066843	99	495	494,1	cyclictest	0	-21	swapper/3	00:27:48	9
2066882	99	489	78,405	cyclictest	2113043	-21	kworker/12:0+i915-unordered	20:10:49	4
2066854	99	486	16,470	cyclictest	0	-21	swapper/6	19:26:49	12
2066889	99	484	482,2	cyclictest	2033465	-21	kworker/14:3+i915-unordered	19:16:49	6
2066835	99	484	482,1	cyclictest	2281352	-21	kworker/1:1+i915-unordered	00:08:48	1
2066877	99	482	481,1	cyclictest	2329286	-21	kworker/11:2+i915-unordered	00:27:48	3
2066835	99	481	12,468	cyclictest	0	-21	swapper/1	21:30:49	1
2066835	99	481	12,468	cyclictest	0	-21	swapper/1	21:30:49	1
2066882	99	478	4,473	cyclictest	0	-21	swapper/12	20:06:49	4
2066877	99	478	24,59	cyclictest	0	-21	swapper/11	19:40:49	3
2066882	99	475	13,461	cyclictest	0	-21	swapper/12	21:38:49	4
2066882	99	475	13,461	cyclictest	0	-21	swapper/12	21:38:49	4
2066882	99	473	12,460	cyclictest	0	-21	swapper/12	00:05:48	4
2066851	99	472	19,29	cyclictest	2185826	-21	ntpq	21:25:12	11
2066851	99	472	19,29	cyclictest	2185826	-21	ntpq	21:25:12	11
2066882	99	467	4,461	cyclictest	0	-21	swapper/12	20:15:49	4
2066882	99	466	4,461	cyclictest	0	-21	swapper/12	23:17:48	4
2066854	99	465	464,1	cyclictest	0	-21	swapper/6	21:57:49	12
2066865	99	463	461,2	cyclictest	2256679	-21	kworker/9:0+i915-unordered	22:56:48	15
2066859	99	463	18,29	cyclictest	2104773	-21	sleep	19:54:45	13
2066835	99	463	13,30	cyclictest	0	-21	swapper/1	22:42:11	1
2066854	99	462	459,2	cyclictest	2125249	-21	kworker/6:1+i915-unordered	20:15:49	12
2066859	99	459	17,29	cyclictest	0	-21	swapper/7	21:44:44	13
2066835	99	459	11,30	cyclictest	0	-21	swapper/1	22:27:12	1
2066882	99	458	457,1	cyclictest	0	-21	swapper/12	22:41:48	4
2066854	99	458	457,1	cyclictest	2121068	-21	kworker/6:0+i915-unordered	20:13:49	12
2066835	99	457	8,30	cyclictest	0	-21	swapper/1	22:46:10	1
2066835	99	457	10,30	cyclictest	0	-21	swapper/1	23:18:31	1
2066835	99	457	10,29	cyclictest	0	-21	swapper/1	00:01:34	1
2066854	99	453	451,1	cyclictest	0	-21	swapper/6	00:05:48	12
2066882	99	452	5,29	cyclictest	2252753	-21	sleep	22:54:44	4
2066851	99	452	2,29	cyclictest	0	-21	swapper/5	00:17:11	11
2066851	99	452	2,29	cyclictest	0	-21	swapper/5	00:17:11	11
2066882	99	450	450,0	cyclictest	0	-21	swapper/12	21:30:49	4
2066882	99	450	450,0	cyclictest	0	-21	swapper/12	21:30:49	4
2066873	99	450	0,29	cyclictest	0	-21	swapper/10	21:15:31	2
2066873	99	448	0,30	cyclictest	0	-21	swapper/10	23:06:11	2
2066859	99	448	0,447	cyclictest	0	-21	swapper/7	21:27:49	13
2066859	99	448	0,447	cyclictest	0	-21	swapper/7	21:27:49	13
2066851	99	448	2,30	cyclictest	2333862	-21	processes	00:25:12	11
2066882	99	447	447,0	cyclictest	0	-21	swapper/12	21:48:11	4
2066882	99	447	26,420	cyclictest	0	-21	swapper/12	23:29:10	4
2066894	99	446	26,420	cyclictest	0	-21	swapper/15	22:16:10	7
2066882	99	446	25,420	cyclictest	0	-21	swapper/12	20:59:33	4
2066882	99	446	25,420	cyclictest	0	-21	swapper/12	20:54:11	4
2066894	99	445	25,419	cyclictest	0	-21	swapper/15	22:56:33	7
2066882	99	445	24,420	cyclictest	0	-21	swapper/12	00:29:10	4
2066865	99	445	26,417	cyclictest	0	-21	swapper/9	21:25:48	15
2066865	99	445	26,417	cyclictest	0	-21	swapper/9	21:25:48	15
2066859	99	444	440,3	cyclictest	3682525	-21	snmpd	00:16:44	13
2066859	99	444	440,3	cyclictest	3682525	-21	snmpd	00:16:44	13
2066835	99	444	24,419	cyclictest	0	-21	swapper/1	21:38:32	1
2066835	99	444	24,419	cyclictest	0	-21	swapper/1	21:38:32	1
2066877	99	442	441,1	cyclictest	0	-21	swapper/11	21:38:49	3
2066877	99	442	441,1	cyclictest	0	-21	swapper/11	21:38:49	3
2066859	99	441	22,419	cyclictest	0	-21	swapper/7	22:25:12	13
2066851	99	441	0,439	cyclictest	0	-21	swapper/5	19:13:49	11
2066846	99	441	439,1	cyclictest	772	50	irq/159-i915	22:56:48	10
2066835	99	441	20,420	cyclictest	0	-21	swapper/1	22:57:11	1
2066882	99	440	21,419	cyclictest	0	-21	swapper/12	19:58:11	4
2066882	99	440	20,420	cyclictest	0	-21	swapper/12	20:49:33	4
2066882	99	440	19,421	cyclictest	0	-21	swapper/12	21:11:32	4
2066873	99	440	22,417	cyclictest	0	-21	swapper/10	23:40:48	2
2066854	99	440	22,29	cyclictest	0	-21	swapper/6	19:22:49	12
2066851	99	440	0,439	cyclictest	0	-21	swapper/5	19:16:49	11
2066835	99	440	20,419	cyclictest	0	-21	swapper/1	00:22:11	1
2066835	99	440	20,419	cyclictest	0	-21	swapper/1	00:22:11	1
2066882	99	439	18,420	cyclictest	0	-21	swapper/12	21:01:10	4
2066882	99	439	18,420	cyclictest	0	-21	swapper/12	20:43:10	4
2066873	99	439	22,416	cyclictest	0	-21	swapper/10	23:37:48	2
2066851	99	439	17,421	cyclictest	0	-21	swapper/5	23:28:12	11
2066835	99	439	19,419	cyclictest	0	-21	swapper/1	00:14:10	1
2066835	99	439	19,419	cyclictest	0	-21	swapper/1	00:14:10	1
2066851	99	438	18,419	cyclictest	0	-21	swapper/5	00:24:30	11
2066851	99	438	18,419	cyclictest	0	-21	swapper/5	00:24:30	11
2066846	99	438	437,1	cyclictest	772	50	irq/159-i915	23:52:48	10
2066835	99	438	17,420	cyclictest	0	-21	swapper/1	23:22:33	1
2066889	99	437	16,420	cyclictest	0	-21	swapper/14	21:09:10	6
2066886	99	437	437,0	cyclictest	0	-21	swapper/13	20:28:49	5
2066882	99	437	18,419	cyclictest	0	-21	swapper/12	23:58:31	4
2066873	99	437	17,419	cyclictest	0	-21	swapper/10	21:37:48	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17