OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Thu Oct 16, 2025 00:43:50)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2768946	99	539	537,2	cyclictest	2768624	-21	kworker/2:5+i915-unordered	19:37:57	8
2768965	99	538	15,522	cyclictest	0	-21	swapper/7	21:04:57	13
2768965	99	536	8,27	cyclictest	0	-21	swapper/7	22:07:57	13
2768939	99	534	3,531	cyclictest	0	-21	swapper/0	19:26:57	0
2768943	99	533	14,29	cyclictest	0	-21	swapper/1	23:11:56	1
2768965	99	526	5,519	cyclictest	0	-21	swapper/7	00:21:56	13
2768950	99	525	2,522	cyclictest	0	-21	swapper/3	19:57:57	9
2768946	99	523	0,522	cyclictest	0	-21	swapper/2	22:52:56	8
2768972	99	518	516,2	cyclictest	2967808	-21	kworker/9:2+i915-unordered	23:11:56	15
2769001	99	503	501,2	cyclictest	3000558	-21	kworker/15:2+i915-unordered	00:21:56	7
2768958	99	502	500,2	cyclictest	3008879	-21	kworker/5:0+i915-unordered	00:01:56	11
2768958	99	502	500,2	cyclictest	3008879	-21	kworker/5:0+i915-unordered	00:01:56	11
2768990	99	499	36,461	cyclictest	0	-21	swapper/12	20:12:57	4
2768965	99	496	5,490	cyclictest	0	-21	swapper/7	20:24:57	13
2768977	99	495	494,1	cyclictest	2818893	-21	kworker/10:1+i915-unordered	20:12:57	2
2768985	99	487	484,2	cyclictest	2810588	-21	kworker/11:2+i915-unordered	19:57:57	3
2769001	99	486	485,1	cyclictest	2910413	-21	kworker/15:0+i915-unordered	22:07:57	7
2768946	99	486	456,30	cyclictest	0	-21	swapper/2	20:12:57	8
2769001	99	484	483,1	cyclictest	2851676	-21	kworker/15:0+i915-unordered	21:04:57	7
2768977	99	484	484,0	cyclictest	0	-21	swapper/10	00:23:56	2
2768958	99	483	482,1	cyclictest	0	-21	swapper/5	21:39:57	11
2768993	99	482	482,0	cyclictest	2893728	-21	kworker/13:0+i915-unordered	21:39:57	5
2768977	99	480	480,0	cyclictest	0	-21	swapper/10	22:23:56	2
2768972	99	478	448,30	cyclictest	0	-21	swapper/9	19:38:57	15
2768977	99	477	476,1	cyclictest	2935004	-21	kworker/10:2+i915-unordered	22:52:56	2
2768962	99	477	26,29	cyclictest	0	-21	swapper/6	20:41:18	12
2769001	99	472	472,0	cyclictest	2835376	-21	kworker/15:0+i915-unordered	20:24:57	7
2768993	99	472	470,2	cyclictest	0	-21	swapper/13	00:01:56	5
2768993	99	472	470,2	cyclictest	0	-21	swapper/13	00:01:56	5
2768996	99	469	9,459	cyclictest	0	-21	swapper/14	00:23:56	6
2768977	99	469	23,29	cyclictest	0	-21	swapper/10	22:31:56	2
2768977	99	465	464,1	cyclictest	0	-21	swapper/10	19:37:57	2
2768977	99	465	19,29	cyclictest	0	-21	swapper/10	21:52:56	2
2768977	99	462	459,3	cyclictest	1811	-21	snmpd	20:49:54	2
2768996	99	461	0,460	cyclictest	0	-21	swapper/14	22:52:56	6
2768996	99	458	456,2	cyclictest	0	-21	swapper/14	22:06:57	6
2768996	99	456	455,1	cyclictest	1811	-21	snmpd	00:35:31	6
2768996	99	453	451,2	cyclictest	0	-21	swapper/14	23:11:56	6
2768953	99	453	452,1	cyclictest	772	50	irq/159-i915	20:12:57	10
2768953	99	452	452,0	cyclictest	772	50	irq/159-i915	22:23:56	10
2768990	99	448	1,29	cyclictest	0	-21	swapper/12	22:10:52	4
2769001	99	446	445,1	cyclictest	1811	-21	snmpd	22:58:52	7
2768972	99	445	24,420	cyclictest	0	-21	swapper/9	23:34:39	15
2768946	99	445	26,419	cyclictest	0	-21	swapper/2	22:21:56	8
2768965	99	444	24,419	cyclictest	0	-21	swapper/7	00:29:19	13
2768965	99	444	24,419	cyclictest	0	-21	swapper/7	00:01:38	13
2768965	99	444	24,419	cyclictest	0	-21	swapper/7	00:01:38	13
2768962	99	444	24,420	cyclictest	0	-21	swapper/6	20:10:41	12
2768962	99	444	22,422	cyclictest	0	-21	swapper/6	00:34:41	12
2768962	99	444	22,420	cyclictest	0	-21	swapper/6	22:21:20	12
2768946	99	444	442,1	cyclictest	2874163	-21	kworker/2:1+i915-unordered	21:16:18	8
2768946	99	444	442,1	cyclictest	2874163	-21	kworker/2:1+i915-unordered	21:16:18	8
2768996	99	443	443,0	cyclictest	0	-21	swapper/14	22:38:56	6
2768965	99	443	22,420	cyclictest	0	-21	swapper/7	00:20:18	13
2768965	99	443	21,421	cyclictest	0	-21	swapper/7	00:32:19	13
2768953	99	443	442,1	cyclictest	772	50	irq/159-i915	21:09:57	10
2768943	99	443	441,2	cyclictest	2794307	-21	kworker/1:0+i915-unordered	19:38:57	1
2769001	99	442	0,28	cyclictest	0	-21	swapper/15	22:12:56	7
2768996	99	442	23,418	cyclictest	0	-21	swapper/14	21:32:18	6
2768965	99	442	440,1	cyclictest	0	-21	swapper/7	22:21:43	13
2768965	99	442	22,419	cyclictest	0	-21	swapper/7	20:31:42	13
2768962	99	442	19,422	cyclictest	0	-21	swapper/6	21:58:19	12
2768965	99	441	21,420	cyclictest	0	-21	swapper/7	22:40:41	13
2768965	99	441	21,420	cyclictest	0	-21	swapper/7	21:46:41	13
2768965	99	440	20,420	cyclictest	0	-21	swapper/7	22:54:40	13
2768965	99	440	18,421	cyclictest	0	-21	swapper/7	23:50:42	13
2768965	99	439	18,420	cyclictest	0	-21	swapper/7	22:05:18	13
2768965	99	439	17,421	cyclictest	0	-21	swapper/7	22:18:41	13
2768962	99	439	17,421	cyclictest	0	-21	swapper/6	21:14:42	12
2768962	99	439	17,421	cyclictest	0	-21	swapper/6	21:14:42	12
2768950	99	439	436,2	cyclictest	2914790	-21	kworker/u64:1+events_unbound	23:27:56	9
2768946	99	439	19,420	cyclictest	0	-21	swapper/2	19:56:20	8
2768946	99	439	18,421	cyclictest	0	-21	swapper/2	00:16:20	8
2768939	99	439	438,1	cyclictest	0	-21	swapper/0	21:06:31	0
2768965	99	438	18,420	cyclictest	0	-21	swapper/7	22:48:41	13
2768965	99	438	17,420	cyclictest	0	-21	swapper/7	23:39:42	13
2768962	99	438	18,419	cyclictest	0	-21	swapper/6	21:25:18	12
2768962	99	438	16,420	cyclictest	0	-21	swapper/6	23:45:19	12
2768962	99	438	16,419	cyclictest	0	-21	swapper/6	23:14:39	12
2768953	99	438	437,1	cyclictest	772	50	irq/159-i915	21:38:57	10
2768969	99	437	434,2	cyclictest	2819326	-21	kworker/u64:6+events_unbound	20:19:19	14
2768965	99	437	18,419	cyclictest	0	-21	swapper/7	22:32:41	13
2768965	99	437	17,419	cyclictest	0	-21	swapper/7	21:13:41	13
2768965	99	437	17,419	cyclictest	0	-21	swapper/7	21:13:41	13
2768965	99	437	16,420	cyclictest	0	-21	swapper/7	21:55:41	13
2768962	99	437	17,419	cyclictest	0	-21	swapper/6	21:05:42	12
2768946	99	437	16,421	cyclictest	0	-21	swapper/2	21:26:41	8
2768969	99	436	433,2	cyclictest	2914790	-21	kworker/u64:1+events_unbound	22:13:44	14
2768965	99	436	434,2	cyclictest	2855804	-21	kworker/7:1+pm	21:06:31	13
2768962	99	436	17,417	cyclictest	0	-21	swapper/6	20:02:40	12
2768962	99	436	16,418	cyclictest	0	-21	swapper/6	00:04:40	12
2768962	99	436	16,418	cyclictest	0	-21	swapper/6	00:04:40	12
2768962	99	436	15,0	cyclictest	0	-21	swapper/6	22:28:41	12
2768953	99	436	436,0	cyclictest	772	50	irq/159-i915	22:07:57	10
2769001	99	435	24,410	cyclictest	0	-21	swapper/15	00:33:56	7
2768962	99	435	16,419	cyclictest	0	-21	swapper/6	22:38:41	12
2768953	99	435	433,2	cyclictest	2999269	-21	kworker/u64:2+events_unbound	00:21:56	10
2768972	99	434	16,417	cyclictest	0	-21	swapper/9	23:45:52	15
2768962	99	434	12,420	cyclictest	0	-21	swapper/6	23:25:52	12
2768950	99	434	433,1	cyclictest	2885572	-21	kworker/3:0+pm	21:42:29	9
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17