OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Tue Jun 02, 2026 00:43:48)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
4188169	99	702	302,399	cyclictest	0	-21	swapper/10	00:33:22	2
4188135	99	526	7,519	cyclictest	0	-21	swapper/1	20:40:40	1
4188145	99	515	514,1	cyclictest	256811	-21	kworker/4:0+i915-unordered	00:34:39	10
4188145	99	509	507,1	cyclictest	216539	-21	kworker/4:2+i915-unordered	23:53:40	10
4188145	99	499	497,2	cyclictest	148055	-21	kworker/4:2+i915-unordered	22:15:40	10
4188181	99	488	11,59	cyclictest	0	-21	swapper/12	22:43:24	4
4188139	99	485	483,2	cyclictest	35424	-21	kworker/2:1+i915-unordered	20:00:40	8
4188145	99	484	483,1	cyclictest	160398	-21	kworker/4:2+i915-unordered	22:36:40	10
4188145	99	481	18,462	cyclictest	0	-21	swapper/4	21:00:40	10
4188145	99	480	0,479	cyclictest	0	-21	swapper/4	23:21:40	10
4188139	99	477	476,1	cyclictest	132011	-21	kworker/2:0+i915-unordered	22:28:40	8
4188187	99	475	444,31	cyclictest	0	-21	swapper/14	20:49:40	6
4188177	99	475	474,1	cyclictest	51554	-21	kworker/11:2+i915-unordered	20:26:40	3
4188145	99	474	32,441	cyclictest	0	-21	swapper/4	23:50:40	10
4188145	99	472	9,461	cyclictest	0	-21	swapper/4	20:49:40	10
4188145	99	472	470,2	cyclictest	216539	-21	kworker/4:2+i915-unordered	23:43:40	10
4188154	99	471	24,29	cyclictest	0	-21	swapper/6	19:23:02	12
4188145	99	471	470,1	cyclictest	0	-21	swapper/4	20:40:40	10
4188131	99	469	19,30	cyclictest	0	-21	swapper/0	23:50:01	0
4188145	99	468	22,28	cyclictest	0	-21	swapper/4	21:41:40	10
4188145	99	467	20,446	cyclictest	61	-21	ksoftirqd/4	22:46:39	10
4188169	99	466	466,0	cyclictest	39252	-21	kworker/10:2+i915-unordered	20:11:40	2
4188169	99	466	466,0	cyclictest	39252	-21	kworker/10:2+i915-unordered	20:11:40	2
4188177	99	465	435,30	cyclictest	0	-21	swapper/11	19:36:40	3
4188154	99	465	19,29	cyclictest	0	-21	swapper/6	19:33:23	12
4188135	99	465	19,30	cyclictest	34	-21	ksoftirqd/1	21:46:40	1
4188157	99	461	11,447	cyclictest	0	-21	swapper/7	21:11:02	13
4188169	99	460	17,30	cyclictest	0	-21	swapper/10	20:19:40	2
4188169	99	460	17,30	cyclictest	0	-21	swapper/10	20:19:40	2
4188161	99	460	13,28	cyclictest	0	-21	swapper/8	00:03:02	14
4188157	99	459	11,30	cyclictest	0	-21	swapper/7	20:35:23	13
4188145	99	459	10,448	cyclictest	0	-21	swapper/4	20:28:40	10
4188177	99	457	456,1	cyclictest	0	-21	swapper/11	20:28:40	3
4188184	99	455	11,30	cyclictest	0	-21	swapper/13	19:30:40	5
4188169	99	455	425,30	cyclictest	0	-21	swapper/10	20:00:40	2
4188150	99	455	1,30	cyclictest	0	-21	swapper/5	21:25:02	11
4188145	99	455	13,28	cyclictest	107047	-21	smart_nvme0n1	21:23:03	10
4188161	99	454	453,1	cyclictest	0	-21	swapper/8	21:23:38	14
4188157	99	454	14,30	cyclictest	0	-21	swapper/7	20:12:35	13
4188157	99	454	14,30	cyclictest	0	-21	swapper/7	20:12:35	13
4188145	99	454	0,0	cyclictest	0	-21	swapper/4	19:41:40	10
4188131	99	454	7,29	cyclictest	0	-21	swapper/0	23:28:39	0
4188131	99	454	24,29	cyclictest	0	-21	swapper/0	19:10:23	0
4188181	99	453	4,30	cyclictest	0	-21	swapper/12	21:31:02	4
4188184	99	452	8,30	cyclictest	0	-21	swapper/13	19:21:40	5
4188181	99	452	5,29	cyclictest	0	-21	swapper/12	23:16:24	4
4188169	99	452	10,30	cyclictest	0	-21	swapper/10	19:45:40	2
4188135	99	452	451,1	cyclictest	1818	-21	snmpd	22:30:13	1
4188150	99	451	1,447	cyclictest	0	-21	swapper/5	22:06:21	11
4188135	99	451	0,30	cyclictest	0	-21	swapper/1	22:48:24	1
4188181	99	450	449,1	cyclictest	697	50	irq/159-i915	22:15:40	4
4188181	99	449	449,0	cyclictest	697	50	irq/159-i915	19:28:40	4
4188145	99	449	448,1	cyclictest	0	-21	swapper/4	22:28:40	10
4188145	99	449	10,438	cyclictest	0	-21	swapper/4	20:11:40	10
4188145	99	449	10,438	cyclictest	0	-21	swapper/4	20:11:40	10
4188142	99	449	448,1	cyclictest	0	-21	swapper/3	19:41:40	9
4188181	99	448	447,1	cyclictest	697	50	irq/159-i915	20:31:40	4
4188139	99	447	446,1	cyclictest	248673	-21	kworker/2:2+i915-unordered	00:23:39	8
4188135	99	445	443,1	cyclictest	43380	-21	kworker/1:0+i915-unordered	20:05:40	1
4188154	99	444	0,443	cyclictest	0	-21	swapper/6	21:04:40	12
4188154	99	443	20,29	cyclictest	0	-21	swapper/6	00:05:01	12
4188131	99	443	440,2	cyclictest	67510	-21	kworker/u64:6+events_unbound	20:49:27	0
4188154	99	442	441,1	cyclictest	0	-21	swapper/6	00:10:23	12
4188154	99	442	20,421	cyclictest	0	-21	swapper/6	20:07:22	12
4188150	99	442	22,419	cyclictest	0	-21	swapper/5	22:38:02	11
4188145	99	442	19,422	cyclictest	61	-21	ksoftirqd/4	19:10:40	10
4188135	99	442	24,417	cyclictest	0	-21	swapper/1	23:23:03	1
4188131	99	442	439,2	cyclictest	115812	-21	kworker/u64:3+events_unbound	21:41:24	0
4188145	99	441	441,0	cyclictest	0	-21	swapper/4	19:14:40	10
4188142	99	441	440,1	cyclictest	48270	-21	kworker/3:0+i915-unordered	20:28:40	9
4188135	99	441	22,418	cyclictest	0	-21	swapper/1	23:52:24	1
4188181	99	440	439,1	cyclictest	697	50	irq/159-i915	00:34:39	4
4188154	99	440	22,417	cyclictest	0	-21	swapper/6	21:17:25	12
4188154	99	440	21,419	cyclictest	0	-21	swapper/6	20:41:23	12
4188154	99	440	21,418	cyclictest	0	-21	swapper/6	22:11:00	12
4188154	99	440	20,417	cyclictest	0	-21	swapper/6	23:16:02	12
4188145	99	440	439,1	cyclictest	0	-21	swapper/4	20:00:40	10
4188177	99	439	21,417	cyclictest	0	-21	swapper/11	22:29:39	3
4188154	99	439	14,29	cyclictest	0	-21	swapper/6	20:31:03	12
4188154	99	438	19,418	cyclictest	0	-21	swapper/6	23:12:01	12
4188150	99	438	20,417	cyclictest	0	-21	swapper/5	19:53:03	11
4188145	99	438	436,1	cyclictest	0	-21	swapper/4	22:01:40	10
4188181	99	437	436,1	cyclictest	697	50	irq/159-i915	22:36:40	4
4188181	99	437	17,417	cyclictest	0	-21	swapper/12	21:44:23	4
4188177	99	437	436,1	cyclictest	132230	-21	kworker/11:2+i915-unordered	22:01:40	3
4188157	99	437	16,420	cyclictest	0	-21	swapper/7	21:59:24	13
4188157	99	437	11,30	cyclictest	0	-21	swapper/7	22:46:23	13
4188154	99	437	18,417	cyclictest	0	-21	swapper/6	21:00:02	12
4188150	99	437	437,0	cyclictest	0	-21	swapper/5	19:28:40	11
4188145	99	437	20,416	cyclictest	0	-21	swapper/4	22:41:39	10
4188145	99	437	0,436	cyclictest	0	-21	swapper/4	21:51:40	10
4188187	99	436	22,414	cyclictest	0	-21	swapper/14	21:03:40	6
4188177	99	436	436,0	cyclictest	0	-21	swapper/11	22:50:39	3
4188157	99	436	17,418	cyclictest	0	-21	swapper/7	23:56:22	13
4188157	99	436	15,420	cyclictest	0	-21	swapper/7	23:24:03	13
4188135	99	436	16,419	cyclictest	0	-21	swapper/1	19:45:02	1
4188187	99	435	434,1	cyclictest	0	-21	swapper/14	21:18:40	6
4188181	99	435	14,420	cyclictest	0	-21	swapper/12	00:32:23	4
4188154	99	435	14,417	cyclictest	0	-21	swapper/6	21:33:25	12
4188135	99	435	432,2	cyclictest	4179549	-21	kworker/u64:10+events_unbound	19:26:01	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17