OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Sun Aug 09, 2026 00:43:48)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3172255	99	547	16,530	cyclictest	0	-21	swapper/5	23:46:31	11
3172250	99	534	32,501	cyclictest	0	-21	swapper/4	22:37:31	10
3172255	99	527	34,0	cyclictest	0	-21	swapper/5	22:56:31	11
3172247	99	522	8,512	cyclictest	0	-21	swapper/3	23:48:31	9
3172247	99	521	520,1	cyclictest	3237110	-21	kworker/3:2+i915-unordered	20:41:31	9
3172288	99	520	518,1	cyclictest	3394250	-21	kworker/13:0+i915-unordered	23:46:31	5
3172242	99	520	22,497	cyclictest	0	-21	swapper/2	22:19:31	8
3172255	99	513	512,1	cyclictest	0	-21	swapper/5	00:23:31	11
3172288	99	485	485,0	cyclictest	3430254	-21	kworker/13:0+i915-unordered	00:23:31	5
3172279	99	485	484,1	cyclictest	3394996	-21	kworker/11:0+i915-unordered	23:48:31	3
3172297	99	483	481,2	cyclictest	3341821	-21	kworker/15:1+i915-unordered	22:44:31	7
3172236	99	482	21,460	cyclictest	0	-21	swapper/0	23:14:31	0
3172255	99	477	477,0	cyclictest	0	-21	swapper/5	20:22:31	11
3172255	99	476	476,0	cyclictest	3217072	-21	kworker/5:2+i915-unordered	20:02:31	11
3172236	99	474	20,454	cyclictest	16	-21	ksoftirqd/0	22:56:31	0
3172292	99	473	24,30	cyclictest	0	-21	swapper/14	22:27:15	6
3172259	99	473	472,1	cyclictest	3221025	-21	kworker/6:0+i915-unordered	20:21:31	12
3172236	99	471	15,455	cyclictest	0	-21	swapper/0	20:49:31	0
3172236	99	468	11,456	cyclictest	0	-21	swapper/0	22:37:31	0
3172236	99	466	27,438	cyclictest	0	-21	swapper/0	20:02:31	0
3172236	99	455	12,442	cyclictest	0	-21	swapper/0	19:32:32	0
3172288	99	454	8,30	cyclictest	0	-21	swapper/13	21:49:53	5
3172288	99	454	8,30	cyclictest	0	-21	swapper/13	21:49:53	5
3172288	99	452	451,1	cyclictest	0	-21	swapper/13	20:02:31	5
3172288	99	451	451,0	cyclictest	3221119	-21	kworker/13:1+i915-unordered	20:22:31	5
3172266	99	451	449,1	cyclictest	697	50	irq/159-i915	23:41:31	14
3172242	99	450	25,424	cyclictest	0	-21	swapper/2	21:56:16	8
3172242	99	450	25,424	cyclictest	0	-21	swapper/2	21:56:16	8
3172284	99	449	446,2	cyclictest	3337774	-21	kworker/12:0+i915-unordered	22:37:31	4
3172279	99	449	6,30	cyclictest	0	-21	swapper/11	23:52:31	3
3172269	99	448	26,421	cyclictest	0	-21	swapper/9	21:48:16	15
3172269	99	448	26,421	cyclictest	0	-21	swapper/9	21:48:16	15
3172239	99	448	0,27	cyclictest	0	-21	swapper/1	21:34:54	1
3172266	99	447	446,1	cyclictest	697	50	irq/159-i915	23:14:31	14
3172242	99	447	444,2	cyclictest	3376736	-21	kworker/u64:0+events_unbound	23:49:53	8
3172242	99	447	444,2	cyclictest	3233113	-21	kworker/u64:5+events_unbound	22:15:16	8
3172297	99	446	445,1	cyclictest	3241133	-21	kworker/15:0+i915-unordered	20:26:31	7
3172250	99	446	0,29	cyclictest	0	-21	swapper/4	23:19:17	10
3172250	99	444	24,419	cyclictest	0	-21	swapper/4	20:10:52	10
3172242	99	443	23,419	cyclictest	0	-21	swapper/2	23:59:53	8
3172247	99	442	22,419	cyclictest	0	-21	swapper/3	21:57:54	9
3172247	99	442	22,419	cyclictest	0	-21	swapper/3	21:57:54	9
3172247	99	442	21,420	cyclictest	0	-21	swapper/3	23:27:55	9
3172247	99	442	20,421	cyclictest	0	-21	swapper/3	23:58:54	9
3172239	99	442	439,2	cyclictest	3430238	-21	kworker/u64:7+events_unbound	00:27:53	1
3172288	99	441	441,0	cyclictest	0	-21	swapper/13	21:10:53	5
3172261	99	441	439,2	cyclictest	0	-21	swapper/7	22:44:31	13
3172261	99	441	20,30	cyclictest	0	-21	swapper/7	00:33:31	13
3172261	99	441	20,30	cyclictest	0	-21	swapper/7	00:33:31	13
3172259	99	440	439,1	cyclictest	0	-21	swapper/6	23:31:31	12
3172247	99	440	19,420	cyclictest	0	-21	swapper/3	23:53:55	9
3172288	99	439	438,0	cyclictest	3394250	-21	kworker/13:0+i915-unordered	23:41:31	5
3172266	99	439	439,0	cyclictest	697	50	irq/159-i915	22:56:31	14
3172247	99	439	20,419	cyclictest	0	-21	swapper/3	22:01:15	9
3172239	99	439	19,419	cyclictest	0	-21	swapper/1	23:56:53	1
3172266	99	438	436,1	cyclictest	697	50	irq/159-i915	00:01:31	14
3172266	99	436	435,1	cyclictest	697	50	irq/159-i915	20:49:31	14
3172236	99	436	432,3	cyclictest	1818	-21	snmpd	21:22:43	0
3172247	99	435	9,29	cyclictest	3174974	-21	ntpq	19:05:54	9
3172247	99	435	9,29	cyclictest	3174974	-21	ntpq	19:05:54	9
3172279	99	434	19,414	cyclictest	0	-21	swapper/11	00:19:31	3
3172297	99	433	430,2	cyclictest	3207848	-21	kworker/u64:10+events_unbound	20:05:55	7
3172284	99	433	433,0	cyclictest	3297525	-21	kworker/12:2+i915-unordered	21:46:31	4
3172284	99	433	433,0	cyclictest	3297525	-21	kworker/12:2+i915-unordered	21:46:31	4
3172261	99	433	433,0	cyclictest	0	-21	swapper/7	20:26:31	13
3172269	99	432	430,2	cyclictest	0	-21	swapper/9	20:12:44	15
3172266	99	432	431,1	cyclictest	697	50	irq/159-i915	22:37:31	14
3172266	99	431	431,0	cyclictest	697	50	irq/159-i915	20:22:31	14
3172266	99	431	431,0	cyclictest	697	50	irq/159-i915	20:02:31	14
3172247	99	430	428,1	cyclictest	3253582	-21	kworker/3:1+pm	21:09:06	9
3172292	99	429	9,30	cyclictest	0	-21	swapper/14	20:21:31	6
3172255	99	429	428,1	cyclictest	0	-21	swapper/5	23:41:31	11
3172239	99	429	426,2	cyclictest	3281426	-21	kworker/u64:0+events_unbound	22:43:53	1
3172279	99	428	6,28	cyclictest	0	-21	swapper/11	20:41:31	3
3172250	99	428	11,415	cyclictest	0	-21	swapper/4	21:52:54	10
3172250	99	428	11,415	cyclictest	0	-21	swapper/4	21:52:54	10
3172269	99	426	26,399	cyclictest	0	-21	swapper/9	00:34:16	15
3172269	99	426	26,399	cyclictest	0	-21	swapper/9	00:34:16	15
3172250	99	426	6,419	cyclictest	0	-21	swapper/4	22:15:16	10
3172250	99	426	423,2	cyclictest	3406092	-21	kworker/u64:2+events_unbound	23:54:54	10
3172288	99	425	425,0	cyclictest	3406199	-21	kworker/13:1+i915-unordered	00:01:31	5
3172284	99	425	423,2	cyclictest	0	-21	swapper/12	19:14:30	4
3172259	99	425	9,415	cyclictest	0	-21	swapper/6	22:04:31	12
3172250	99	425	5,419	cyclictest	0	-21	swapper/4	23:33:54	10
3172250	99	425	4,420	cyclictest	0	-21	swapper/4	22:17:15	10
3172242	99	425	6,419	cyclictest	0	-21	swapper/2	22:02:15	8
3172242	99	425	4,420	cyclictest	0	-21	swapper/2	23:45:16	8
3172250	99	424	5,417	cyclictest	0	-21	swapper/4	23:55:54	10
3172269	99	423	25,397	cyclictest	0	-21	swapper/9	00:20:15	15
3172239	99	423	420,2	cyclictest	3233113	-21	kworker/u64:5+events_unbound	22:33:14	1
3172269	99	422	0,419	cyclictest	0	-21	swapper/9	21:35:15	15
3172266	99	422	419,2	cyclictest	3385956	-21	kworker/u64:7+events_unbound	23:52:15	14
3172255	99	422	1,420	cyclictest	0	-21	swapper/5	21:53:54	11
3172255	99	422	1,420	cyclictest	0	-21	swapper/5	21:53:54	11
3172247	99	422	419,2	cyclictest	3415125	-21	kworker/3:2+events	00:11:53	9
3172247	99	422	419,2	cyclictest	3415125	-21	kworker/3:2+events	00:08:54	9
3172239	99	422	420,1	cyclictest	0	-21	swapper/1	23:23:53	1
3172239	99	422	419,2	cyclictest	3312510	-21	kworker/u64:9+events_unbound	22:29:31	1
3172279	99	421	10,30	cyclictest	0	-21	swapper/11	19:46:31	3
3172259	99	421	420,1	cyclictest	0	-21	swapper/6	00:25:53	12
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17