OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Thu Nov 20, 2025 00:43:47)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2089200	99	746	325,420	cyclictest	0	-21	swapper/3	23:01:13	9
2089212	99	557	3,553	cyclictest	0	-21	swapper/6	21:06:50	12
2089223	99	556	35,521	cyclictest	0	-21	swapper/9	21:08:50	15
2089248	99	539	538,1	cyclictest	2154437	-21	kworker/14:1+i915-unordered	21:06:50	6
2089200	99	511	18,491	cyclictest	0	-21	swapper/3	22:50:50	9
2089235	99	510	508,2	cyclictest	2249650	-21	kworker/11:1+i915-unordered	22:50:50	3
2089235	99	503	501,2	cyclictest	2172868	-21	kworker/11:2+i915-unordered	21:30:50	3
2089235	99	498	468,30	cyclictest	0	-21	swapper/11	00:01:50	3
2089235	99	498	468,30	cyclictest	0	-21	swapper/11	00:01:50	3
2089208	99	498	497,1	cyclictest	0	-21	swapper/5	23:53:50	11
2089197	99	493	492,1	cyclictest	2174788	-21	kworker/2:2+i915-unordered	21:22:50	8
2089197	99	493	492,1	cyclictest	2174788	-21	kworker/2:2+i915-unordered	21:22:50	8
2089244	99	490	489,1	cyclictest	2283694	-21	kworker/13:0+i915-unordered	23:53:50	5
2089217	99	488	487,1	cyclictest	0	-21	swapper/7	21:50:50	13
2089197	99	486	486,0	cyclictest	2289869	-21	kworker/2:0+i915-unordered	23:57:50	8
2089200	99	480	479,1	cyclictest	0	-21	swapper/3	21:30:50	9
2089197	99	480	478,2	cyclictest	2088772	-21	kworker/2:2+i915-unordered	19:06:51	8
2089200	99	478	476,2	cyclictest	2306391	-21	kworker/3:0+i915-unordered	00:01:50	9
2089200	99	478	476,2	cyclictest	2306391	-21	kworker/3:0+i915-unordered	00:01:50	9
2089208	99	477	475,1	cyclictest	2265358	-21	kworker/5:1+i915-unordered	23:13:50	11
2089248	99	472	22,30	cyclictest	0	-21	swapper/14	21:03:14	6
2089208	99	470	469,1	cyclictest	1773567	-21	kworker/5:0+i915-unordered	19:50:51	11
2089197	99	469	467,2	cyclictest	2088772	-21	kworker/2:2+i915-unordered	19:13:51	8
2089248	99	467	20,29	cyclictest	0	-21	swapper/14	22:18:50	6
2089212	99	467	4,462	cyclictest	0	-21	swapper/6	21:22:50	12
2089212	99	467	4,462	cyclictest	0	-21	swapper/6	21:22:50	12
2089197	99	464	462,2	cyclictest	2138085	-21	kworker/2:2+i915-unordered	20:51:50	8
2089197	99	464	462,2	cyclictest	2129643	-21	kworker/2:1+i915-unordered	20:38:51	8
2089221	99	462	456,5	cyclictest	3682525	-21	snmpd	21:20:24	14
2089221	99	462	456,5	cyclictest	3682525	-21	snmpd	21:20:24	14
2089208	99	462	462,0	cyclictest	1773567	-21	kworker/5:0+i915-unordered	19:42:51	11
2089231	99	460	12,30	cyclictest	0	-21	swapper/10	22:15:36	2
2089248	99	459	458,1	cyclictest	772	50	irq/159-i915	21:50:50	6
2089203	99	459	15,29	cyclictest	0	-21	swapper/4	20:43:50	10
2089235	99	455	454,1	cyclictest	0	-21	swapper/11	21:54:12	3
2089203	99	454	11,30	cyclictest	0	-21	swapper/4	19:39:46	10
2089203	99	453	7,28	cyclictest	0	-21	swapper/4	21:38:50	10
2089197	99	453	452,1	cyclictest	0	-21	swapper/2	21:08:50	8
2089248	99	450	449,1	cyclictest	772	50	irq/159-i915	21:22:50	6
2089248	99	450	449,1	cyclictest	772	50	irq/159-i915	21:22:50	6
2089197	99	450	12,437	cyclictest	0	-21	swapper/2	19:42:51	8
2089208	99	449	0,448	cyclictest	0	-21	swapper/5	22:47:12	11
2089235	99	448	448,0	cyclictest	0	-21	swapper/11	23:35:12	3
2089235	99	448	448,0	cyclictest	0	-21	swapper/11	22:47:12	3
2089235	99	448	448,0	cyclictest	0	-21	swapper/11	21:59:12	3
2089240	99	447	26,420	cyclictest	0	-21	swapper/12	20:08:13	4
2089240	99	447	24,422	cyclictest	0	-21	swapper/12	00:21:11	4
2089235	99	447	447,0	cyclictest	0	-21	swapper/11	23:03:12	3
2089235	99	447	447,0	cyclictest	0	-21	swapper/11	20:02:12	3
2089248	99	446	444,2	cyclictest	0	-21	swapper/14	23:43:34	6
2089200	99	446	21,29	cyclictest	0	-21	swapper/3	20:50:50	9
2089197	99	446	445,1	cyclictest	0	-21	swapper/2	19:32:51	8
2089240	99	445	24,420	cyclictest	0	-21	swapper/12	20:54:13	4
2089231	99	445	24,418	cyclictest	0	-21	swapper/10	21:02:35	2
2089231	99	445	23,421	cyclictest	0	-21	swapper/10	20:06:13	2
2089223	99	445	444,1	cyclictest	2220170	-21	kworker/9:2+i915-unordered	22:15:14	15
2089223	99	445	22,422	cyclictest	0	-21	swapper/9	21:12:12	15
2089223	99	445	0,28	cyclictest	0	-21	swapper/9	00:05:13	15
2089223	99	445	0,28	cyclictest	0	-21	swapper/9	00:05:13	15
2089251	99	444	22,418	cyclictest	0	-21	swapper/15	20:54:46	7
2089248	99	444	24,419	cyclictest	0	-21	swapper/14	23:04:34	6
2089248	99	444	24,419	cyclictest	0	-21	swapper/14	00:27:34	6
2089248	99	444	0,26	cyclictest	0	-21	swapper/14	23:22:13	6
2089240	99	444	25,419	cyclictest	0	-21	swapper/12	21:15:33	4
2089240	99	444	25,419	cyclictest	0	-21	swapper/12	21:15:33	4
2089231	99	444	21,422	cyclictest	0	-21	swapper/10	21:22:33	2
2089231	99	444	21,422	cyclictest	0	-21	swapper/10	21:22:33	2
2089203	99	444	444,0	cyclictest	2261183	-21	kworker/4:3+pm	23:27:01	10
2089200	99	444	0,27	cyclictest	0	-21	swapper/3	23:50:50	9
2089231	99	443	442,1	cyclictest	772	50	irq/159-i915	20:51:50	2
2089231	99	443	21,419	cyclictest	0	-21	swapper/10	00:11:13	2
2089231	99	443	21,419	cyclictest	0	-21	swapper/10	00:11:13	2
2089223	99	443	22,420	cyclictest	0	-21	swapper/9	23:41:13	15
2089221	99	443	441,1	cyclictest	2300850	-21	kworker/8:2+i915-unordered	23:53:35	14
2089197	99	443	23,417	cyclictest	0	-21	swapper/2	21:13:50	8
2089244	99	442	24,417	cyclictest	0	-21	swapper/13	20:13:13	5
2089231	99	442	22,417	cyclictest	0	-21	swapper/10	21:19:12	2
2089231	99	442	22,417	cyclictest	0	-21	swapper/10	21:19:12	2
2089231	99	442	22,417	cyclictest	0	-21	swapper/10	20:20:35	2
2089223	99	442	21,420	cyclictest	0	-21	swapper/9	23:56:12	15
2089212	99	442	441,1	cyclictest	2187201	-21	kworker/6:0+i915-unordered	21:40:50	12
2089231	99	441	19,419	cyclictest	0	-21	swapper/10	20:10:35	2
2089223	99	441	441,0	cyclictest	0	-21	swapper/9	19:39:25	15
2089251	99	440	18,420	cyclictest	0	-21	swapper/15	20:37:34	7
2089223	99	440	21,419	cyclictest	0	-21	swapper/9	23:34:33	15
2089217	99	440	20,419	cyclictest	0	-21	swapper/7	23:05:12	13
2089248	99	439	22,417	cyclictest	0	-21	swapper/14	20:52:33	6
2089217	99	439	22,416	cyclictest	0	-21	swapper/7	22:40:14	13
2089203	99	439	25,414	cyclictest	2248993	-21	sleep	22:54:45	10
2089197	99	439	18,420	cyclictest	0	-21	swapper/2	19:45:50	8
2089235	99	438	408,30	cyclictest	0	-21	swapper/11	20:18:51	3
2089231	99	438	17,418	cyclictest	0	-21	swapper/10	00:06:36	2
2089231	99	438	17,418	cyclictest	0	-21	swapper/10	00:06:36	2
2089223	99	438	19,419	cyclictest	0	-21	swapper/9	22:23:33	15
2089203	99	438	18,420	cyclictest	0	-21	swapper/4	21:56:12	10
2089223	99	437	16,420	cyclictest	0	-21	swapper/9	23:16:35	15
2089208	99	437	18,418	cyclictest	0	-21	swapper/5	23:15:50	11
2089221	99	436	19,416	cyclictest	0	-21	swapper/8	20:03:31	14
2089221	99	436	19,416	cyclictest	0	-21	swapper/8	19:51:35	14
2089212	99	436	434,2	cyclictest	2277504	-21	kworker/6:0+i915-unordered	23:41:50	12
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17