OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Tue Aug 25, 2026 00:43:47)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2496047	99	542	7,534	cyclictest	0	-21	swapper/7	21:04:01	13
2496075	99	526	524,2	cyclictest	0	-21	swapper/14	23:01:01	6
2496047	99	525	0,521	cyclictest	0	-21	swapper/7	00:13:01	13
2496037	99	525	2,522	cyclictest	0	-21	swapper/4	19:33:01	10
2496070	99	518	517,1	cyclictest	2520725	-21	kworker/12:2+i915-unordered	19:33:01	4
2496047	99	516	0,515	cyclictest	0	-21	swapper/7	22:23:01	13
2496037	99	516	515,1	cyclictest	60	1	ktimers/4	19:41:01	10
2496039	99	515	485,30	cyclictest	0	-21	swapper/5	20:14:01	11
2496070	99	510	508,2	cyclictest	2504768	-21	kworker/12:1+i915-unordered	19:41:01	4
2496080	99	506	505,1	cyclictest	0	-21	swapper/15	22:31:01	7
2496039	99	505	503,2	cyclictest	2496014	-21	cyclictest	19:41:01	11
2496065	99	494	17,476	cyclictest	0	-21	swapper/11	19:41:01	3
2496042	99	489	15,26	cyclictest	0	-21	swapper/6	21:31:01	12
2496080	99	480	478,1	cyclictest	2736919	-21	kworker/15:1+i915-unordered	00:13:01	7
2496070	99	480	479,1	cyclictest	2605443	-21	kworker/12:1+i915-unordered	21:26:01	4
2496065	99	477	14,462	cyclictest	0	-21	swapper/11	22:31:01	3
2496037	99	477	477,0	cyclictest	0	-21	swapper/4	19:39:01	10
2496037	99	477	474,2	cyclictest	2504700	-21	kworker/4:0+i915-unordered	19:17:01	10
2496032	99	474	473,1	cyclictest	697	50	irq/159-i915	19:41:01	9
2496065	99	473	473,0	cyclictest	0	-21	swapper/11	23:13:01	3
2496080	99	472	470,2	cyclictest	2591898	-21	kworker/15:1+i915-unordered	21:04:01	7
2496075	99	472	24,31	cyclictest	2624371	-21	ntpq	21:40:24	6
2496075	99	472	24,31	cyclictest	2624371	-21	ntpq	21:40:24	6
2496070	99	472	471,0	cyclictest	2504768	-21	kworker/12:1+i915-unordered	19:39:01	4
2496042	99	471	24,29	cyclictest	0	-21	swapper/6	20:04:24	12
2496032	99	471	21,30	cyclictest	0	-21	swapper/3	21:29:25	9
2496028	99	471	22,29	cyclictest	0	-21	swapper/2	23:59:46	8
2496080	99	470	470,0	cyclictest	0	-21	swapper/15	20:26:01	7
2496080	99	470	468,2	cyclictest	0	-21	swapper/15	20:58:01	7
2496065	99	470	9,460	cyclictest	0	-21	swapper/11	20:26:01	3
2496065	99	469	466,2	cyclictest	2609272	-21	kworker/11:0+i915-unordered	21:34:01	3
2496037	99	469	468,1	cyclictest	2621209	-21	kworker/4:2+i915-unordered	21:39:01	10
2496037	99	469	468,1	cyclictest	2621209	-21	kworker/4:2+i915-unordered	21:39:01	10
2496024	99	466	16,29	cyclictest	0	-21	swapper/1	19:25:22	1
2496037	99	465	465,0	cyclictest	2653658	-21	kworker/4:0+i915-unordered	23:13:01	10
2496072	99	463	16,29	cyclictest	0	-21	swapper/13	19:22:22	5
2496024	99	463	15,29	cyclictest	0	-21	swapper/1	22:13:22	1
2496075	99	462	17,29	cyclictest	0	-21	swapper/14	20:03:01	6
2496070	99	462	462,0	cyclictest	0	-21	swapper/12	21:39:01	4
2496070	99	462	462,0	cyclictest	0	-21	swapper/12	21:39:01	4
2496065	99	462	461,1	cyclictest	0	-21	swapper/11	20:14:01	3
2496039	99	462	461,1	cyclictest	2553055	-21	kworker/5:1+i915-unordered	20:16:01	11
2496065	99	461	1,459	cyclictest	0	-21	swapper/11	21:39:01	3
2496065	99	461	1,459	cyclictest	0	-21	swapper/11	21:39:01	3
2496075	99	460	458,1	cyclictest	1818	-21	snmpd	23:29:13	6
2496024	99	460	16,30	cyclictest	0	-21	swapper/1	00:15:23	1
2496070	99	459	459,0	cyclictest	0	-21	swapper/12	23:13:01	4
2496072	99	457	455,2	cyclictest	2529001	-21	kworker/13:2+i915-unordered	20:14:01	5
2496037	99	456	455,1	cyclictest	0	-21	swapper/4	21:26:01	10
2496032	99	456	455,1	cyclictest	697	50	irq/159-i915	22:31:01	9
2496072	99	455	8,30	cyclictest	0	-21	swapper/13	20:28:23	5
2496065	99	455	453,2	cyclictest	0	-21	swapper/11	20:58:01	3
2496032	99	455	454,1	cyclictest	697	50	irq/159-i915	23:13:01	9
2496072	99	454	8,30	cyclictest	0	-21	swapper/13	22:49:23	5
2496072	99	454	8,30	cyclictest	0	-21	swapper/13	00:00:43	5
2496065	99	454	0,453	cyclictest	0	-21	swapper/11	19:17:01	3
2496072	99	452	7,29	cyclictest	0	-21	swapper/13	23:19:44	5
2496037	99	452	451,1	cyclictest	2508874	-21	kworker/4:1+i915-unordered	19:26:01	10
2496032	99	450	450,0	cyclictest	697	50	irq/159-i915	20:26:01	9
2496065	99	449	448,1	cyclictest	0	-21	swapper/11	23:01:01	3
2496065	99	449	448,1	cyclictest	0	-21	swapper/11	21:26:01	3
2496047	99	448	25,422	cyclictest	0	-21	swapper/7	22:10:24	13
2496037	99	448	447,1	cyclictest	2520844	-21	kworker/4:2+i915-unordered	19:54:01	10
2496032	99	448	447,1	cyclictest	697	50	irq/159-i915	21:34:01	9
2496042	99	447	444,2	cyclictest	2688462	-21	kworker/u64:8+events_unbound	23:33:01	12
2496075	99	446	25,420	cyclictest	0	-21	swapper/14	20:11:24	6
2496065	99	446	445,1	cyclictest	0	-21	swapper/11	22:23:01	3
2496065	99	446	440,5	cyclictest	1818	-21	snmpd	19:24:12	3
2496039	99	446	445,1	cyclictest	2665610	-21	kworker/5:3+i915-unordered	22:53:01	11
2496080	99	445	445,0	cyclictest	2653592	-21	kworker/15:0+i915-unordered	22:23:01	7
2496075	99	445	26,418	cyclictest	0	-21	swapper/14	00:23:46	6
2496075	99	445	26,418	cyclictest	0	-21	swapper/14	00:23:46	6
2496075	99	445	24,420	cyclictest	0	-21	swapper/14	00:33:24	6
2496075	99	445	24,420	cyclictest	0	-21	swapper/14	00:33:24	6
2496051	99	445	442,3	cyclictest	2719149	-21	kworker/u64:1+events_unbound	23:59:01	14
2496075	99	444	25,418	cyclictest	0	-21	swapper/14	19:28:23	6
2496024	99	444	24,419	cyclictest	0	-21	swapper/1	19:20:45	1
2496065	99	443	442,1	cyclictest	0	-21	swapper/11	23:16:01	3
2496047	99	443	23,419	cyclictest	0	-21	swapper/7	19:39:57	13
2496039	99	443	0,442	cyclictest	0	-21	swapper/5	23:44:01	11
2496032	99	443	442,1	cyclictest	697	50	irq/159-i915	20:14:01	9
2496028	99	443	22,420	cyclictest	0	-21	swapper/2	20:39:45	8
2496075	99	442	22,419	cyclictest	0	-21	swapper/14	20:53:23	6
2496075	99	442	22,419	cyclictest	0	-21	swapper/14	00:05:45	6
2496065	99	442	440,1	cyclictest	2569072	-21	kworker/11:1+i915-unordered	20:46:01	3
2496047	99	442	21,420	cyclictest	0	-21	swapper/7	19:45:23	13
2496075	99	441	22,418	cyclictest	0	-21	swapper/14	22:30:43	6
2496075	99	441	21,419	cyclictest	0	-21	swapper/14	20:06:23	6
2496070	99	441	441,0	cyclictest	0	-21	swapper/12	19:54:01	4
2496065	99	441	440,1	cyclictest	0	-21	swapper/11	19:54:01	3
2496060	99	441	440,1	cyclictest	1818	-21	snmpd	20:43:14	2
2496042	99	441	438,2	cyclictest	2597124	-21	kworker/u64:3+events_unbound	22:19:01	12
2496032	99	441	441,0	cyclictest	697	50	irq/159-i915	21:39:01	9
2496032	99	441	441,0	cyclictest	697	50	irq/159-i915	21:39:01	9
2496075	99	440	20,419	cyclictest	0	-21	swapper/14	23:48:23	6
2496072	99	440	21,418	cyclictest	0	-21	swapper/13	19:16:22	5
2496070	99	440	438,2	cyclictest	0	-21	swapper/12	19:17:01	4
2496051	99	440	20,419	cyclictest	0	-21	swapper/8	00:04:46	14
2496047	99	440	18,421	cyclictest	0	-21	swapper/7	22:19:24	13
2496080	99	439	0,30	cyclictest	0	-21	swapper/15	21:13:01	7
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17