OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Sat Jul 12, 2025 00:43:41)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3137737	99	746	327,418	cyclictest	0	-21	swapper/4	22:45:01	10
3137737	99	746	327,418	cyclictest	0	-21	swapper/4	22:45:01	10
3137773	99	567	15,551	cyclictest	0	-21	swapper/12	23:07:01	4
3137768	99	536	85,445	cyclictest	3325110	-21	kworker/11:2+i915-unordered	23:15:01	3
3137768	99	517	515,1	cyclictest	3320697	-21	kworker/11:0+i915-unordered	22:37:01	3
3137768	99	517	515,1	cyclictest	3320697	-21	kworker/11:0+i915-unordered	22:37:01	3
3137768	99	514	25,488	cyclictest	124	-21	ksoftirqd/11	20:45:02	3
3137737	99	497	496,1	cyclictest	3338261	-21	kworker/4:0+i915-unordered	23:07:01	10
3137768	99	496	35,461	cyclictest	0	-21	swapper/11	23:07:01	3
3137750	99	495	495,0	cyclictest	3195839	-21	kworker/7:0+i915-unordered	20:17:02	13
3137741	99	495	6,489	cyclictest	0	-21	swapper/5	21:21:01	11
3137768	99	493	1,29	cyclictest	0	-21	swapper/11	20:30:02	3
3137768	99	492	490,2	cyclictest	3106563	-21	kworker/11:3+i915-unordered	19:12:02	3
3137768	99	490	2,27	cyclictest	0	-21	swapper/11	20:10:02	3
3137768	99	489	13,475	cyclictest	0	-21	swapper/11	21:21:01	3
3137768	99	480	18,461	cyclictest	0	-21	swapper/11	21:45:01	3
3137750	99	480	480,0	cyclictest	3287058	-21	kworker/7:1+i915-unordered	22:02:01	13
3137768	99	478	27,29	cyclictest	1392	50	irq/164-enp3s0-tx-0	19:39:23	3
3137768	99	476	14,461	cyclictest	0	-21	swapper/11	20:20:02	3
3137750	99	472	472,0	cyclictest	3264552	-21	kworker/7:1+i915-unordered	21:45:01	13
3137741	99	471	22,30	cyclictest	0	-21	swapper/5	19:46:24	11
3137741	99	471	22,30	cyclictest	0	-21	swapper/5	19:46:24	11
3137773	99	469	21,445	cyclictest	0	-21	swapper/12	22:30:01	4
3137764	99	469	24,28	cyclictest	0	-21	swapper/10	22:44:23	2
3137764	99	469	24,28	cyclictest	0	-21	swapper/10	22:44:23	2
3137764	99	469	19,30	cyclictest	0	-21	swapper/10	22:42:43	2
3137764	99	469	19,30	cyclictest	0	-21	swapper/10	22:42:43	2
3137764	99	468	19,30	cyclictest	0	-21	swapper/10	22:04:24	2
3137764	99	468	18,30	cyclictest	0	-21	swapper/10	20:12:46	2
3137764	99	467	17,30	cyclictest	0	-21	swapper/10	23:36:47	2
3137764	99	466	19,28	cyclictest	0	-21	swapper/10	00:27:47	2
3137754	99	466	20,445	cyclictest	0	-21	swapper/8	22:36:45	14
3137754	99	466	20,445	cyclictest	0	-21	swapper/8	22:36:45	14
3137768	99	465	2,462	cyclictest	0	-21	swapper/11	00:13:01	3
3137737	99	465	464,1	cyclictest	0	-21	swapper/4	20:30:02	10
3137784	99	464	17,30	cyclictest	0	-21	swapper/15	00:17:01	7
3137784	99	463	16,30	cyclictest	0	-21	swapper/15	22:23:01	7
3137764	99	463	14,29	cyclictest	0	-21	swapper/10	23:50:46	2
3137733	99	463	462,1	cyclictest	772	50	irq/159-i915	23:56:01	9
3137756	99	462	9,30	cyclictest	0	-21	swapper/9	20:43:25	15
3137754	99	462	17,30	cyclictest	0	-21	swapper/8	21:24:46	14
3137733	99	462	459,2	cyclictest	3213211	-21	kworker/3:1+events	20:45:25	9
3137754	99	461	14,29	cyclictest	0	-21	swapper/8	20:27:48	14
3137756	99	460	14,29	cyclictest	0	-21	swapper/9	00:01:01	15
3137733	99	460	457,2	cyclictest	3233749	-21	kworker/3:0+events	21:06:45	9
3137756	99	459	10,29	cyclictest	0	-21	swapper/9	21:31:23	15
3137741	99	458	16,29	cyclictest	0	-21	swapper/5	23:30:01	11
3137733	99	458	458,0	cyclictest	772	50	irq/159-i915	20:17:02	9
3137756	99	454	6,28	cyclictest	0	-21	swapper/9	23:28:45	15
3137725	99	450	21,417	cyclictest	3241555	-21	ntpq	21:04:22	1
3137730	99	449	0,448	cyclictest	0	-21	swapper/2	19:58:24	8
3137730	99	449	0,448	cyclictest	0	-21	swapper/2	19:58:24	8
3137773	99	448	26,419	cyclictest	0	-21	swapper/12	20:31:24	4
3137773	99	447	25,421	cyclictest	0	-21	swapper/12	00:18:43	4
3137773	99	445	442,2	cyclictest	3107112	-21	kworker/u64:2+events_unbound	20:10:47	4
3137773	99	445	24,419	cyclictest	0	-21	swapper/12	22:28:24	4
3137768	99	445	22,419	cyclictest	0	-21	swapper/11	20:34:24	3
3137773	99	444	443,1	cyclictest	0	-21	swapper/12	21:26:46	4
3137773	99	444	24,418	cyclictest	0	-21	swapper/12	19:53:24	4
3137773	99	444	24,418	cyclictest	0	-21	swapper/12	19:53:24	4
3137768	99	444	23,420	cyclictest	0	-21	swapper/11	21:06:23	3
3137733	99	444	444,0	cyclictest	772	50	irq/159-i915	22:02:01	9
3137773	99	443	443,0	cyclictest	0	-21	swapper/12	22:40:46	4
3137773	99	443	443,0	cyclictest	0	-21	swapper/12	22:40:46	4
3137768	99	443	22,418	cyclictest	0	-21	swapper/11	20:24:24	3
3137764	99	443	23,419	cyclictest	0	-21	swapper/10	23:05:24	2
3137741	99	443	440,2	cyclictest	3310757	-21	kworker/u64:7+events_unbound	23:14:45	11
3137733	99	443	442,1	cyclictest	772	50	irq/159-i915	23:15:01	9
3137768	99	442	23,418	cyclictest	0	-21	swapper/11	22:06:01	3
3137764	99	442	22,418	cyclictest	0	-21	swapper/10	19:45:46	2
3137764	99	442	22,418	cyclictest	0	-21	swapper/10	19:45:46	2
3137773	99	441	19,421	cyclictest	0	-21	swapper/12	20:37:25	4
3137768	99	441	18,420	cyclictest	0	-21	swapper/11	19:16:45	3
3137773	99	440	24,415	cyclictest	0	-21	swapper/12	21:15:01	4
3137773	99	440	20,418	cyclictest	0	-21	swapper/12	19:22:46	4
3137773	99	440	19,418	cyclictest	0	-21	swapper/12	20:00:24	4
3137773	99	440	17,420	cyclictest	0	-21	swapper/12	00:35:23	4
3137756	99	440	20,418	cyclictest	0	-21	swapper/9	19:48:24	15
3137756	99	440	20,418	cyclictest	0	-21	swapper/9	19:48:24	15
3137756	99	440	19,418	cyclictest	0	-21	swapper/9	20:10:47	15
3137725	99	440	22,417	cyclictest	0	-21	swapper/1	20:12:01	1
3137773	99	439	20,418	cyclictest	0	-21	swapper/12	19:40:46	4
3137773	99	439	19,419	cyclictest	0	-21	swapper/12	19:18:44	4
3137773	99	439	19,418	cyclictest	0	-21	swapper/12	20:40:24	4
3137773	99	439	19,417	cyclictest	0	-21	swapper/12	23:24:44	4
3137773	99	439	18,420	cyclictest	0	-21	swapper/12	21:38:47	4
3137773	99	439	16,422	cyclictest	0	-21	swapper/12	21:10:23	4
3137773	99	439	15,420	cyclictest	0	-21	swapper/12	20:07:47	4
3137764	99	439	436,2	cyclictest	3290962	-21	kworker/u64:6+events_unbound	22:30:46	2
3137764	99	439	19,0	cyclictest	0	-21	swapper/10	23:30:46	2
3137750	99	439	18,420	cyclictest	0	-21	swapper/7	22:53:57	13
3137733	99	439	439,0	cyclictest	772	50	irq/159-i915	19:56:02	9
3137733	99	439	439,0	cyclictest	772	50	irq/159-i915	19:56:02	9
3137725	99	439	20,418	cyclictest	0	-21	swapper/1	23:52:01	1
3137773	99	438	18,418	cyclictest	0	-21	swapper/12	21:07:23	4
3137768	99	438	436,1	cyclictest	3141558	-21	kworker/u64:5+events_unbound	22:15:47	3
3137764	99	438	17,418	cyclictest	0	-21	swapper/10	23:54:48	2
3137756	99	438	19,417	cyclictest	0	-21	swapper/9	21:40:46	15
3137741	99	438	17,419	cyclictest	0	-21	swapper/5	23:00:25	11
3137773	99	437	17,420	cyclictest	0	-21	swapper/12	19:29:48	4
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17