OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of system in rack #0, slot #5

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot5.osadl.org (updated Sun Aug 16, 2026 00:43:47)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2890418	99	569	18,550	cyclictest	0	-21	swapper/9	21:32:18	15
2890388	99	550	549,1	cyclictest	2971665	-21	kworker/1:6+i915-unordered	21:32:18	1
2890436	99	546	545,1	cyclictest	2911136	-21	kworker/13:0+i915-unordered	19:33:18	5
2890411	99	541	540,1	cyclictest	3047828	-21	kworker/7:2+i915-unordered	22:21:18	13
2890436	99	529	1,27	cyclictest	0	-21	swapper/13	19:22:18	5
2890436	99	522	4,0	cyclictest	0	-21	swapper/13	21:01:18	5
2890388	99	516	515,1	cyclictest	0	-21	swapper/1	21:47:18	1
2890388	99	516	515,1	cyclictest	0	-21	swapper/1	21:47:18	1
2890384	99	513	23,489	cyclictest	0	-21	swapper/0	21:06:18	0
2890384	99	503	12,490	cyclictest	16	-21	ksoftirqd/0	23:53:18	0
2890392	99	499	16,482	cyclictest	0	-21	swapper/2	20:29:18	8
2890444	99	489	488,1	cyclictest	0	-21	swapper/15	22:21:18	7
2890384	99	488	25,462	cyclictest	0	-21	swapper/0	22:21:18	0
2890421	99	483	480,3	cyclictest	2943589	-21	kworker/10:1+i915-unordered	20:29:18	2
2890411	99	483	482,1	cyclictest	3040043	-21	kworker/7:0+i915-unordered	22:26:18	13
2890403	99	475	27,28	cyclictest	0	-21	swapper/5	20:51:41	11
2890436	99	472	25,28	cyclictest	0	-21	swapper/13	20:57:03	5
2890441	99	471	24,30	cyclictest	0	-21	swapper/14	21:55:02	6
2890441	99	471	24,30	cyclictest	0	-21	swapper/14	21:55:02	6
2890436	99	471	22,30	cyclictest	0	-21	swapper/13	23:35:41	5
2890436	99	470	25,29	cyclictest	0	-21	swapper/13	20:42:03	5
2890436	99	470	22,29	cyclictest	0	-21	swapper/13	00:18:02	5
2890433	99	466	22,30	cyclictest	0	-21	swapper/12	22:48:18	4
2890444	99	460	460,0	cyclictest	0	-21	swapper/15	22:26:18	7
2890441	99	456	0,454	cyclictest	0	-21	swapper/14	23:48:18	6
2890418	99	455	454,1	cyclictest	3015681	-21	kworker/9:0+i915-unordered	21:47:18	15
2890418	99	455	454,1	cyclictest	3015681	-21	kworker/9:0+i915-unordered	21:47:18	15
2890436	99	454	5,29	cyclictest	0	-21	swapper/13	22:50:40	5
2890415	99	454	454,0	cyclictest	2983694	-21	kworker/8:0+i915-unordered	21:06:18	14
2890441	99	450	22,30	cyclictest	0	-21	swapper/14	21:49:40	6
2890441	99	450	22,30	cyclictest	0	-21	swapper/14	21:49:40	6
2890433	99	449	9,29	cyclictest	0	-21	swapper/12	20:43:18	4
2890421	99	448	446,2	cyclictest	1818	-21	snmpd	22:21:13	2
2890399	99	447	445,1	cyclictest	3022493	-21	kworker/4:2+i915-unordered	21:49:18	10
2890399	99	447	445,1	cyclictest	3022493	-21	kworker/4:2+i915-unordered	21:49:18	10
2890436	99	446	21,29	cyclictest	0	-21	swapper/13	21:09:01	5
2890415	99	445	26,418	cyclictest	0	-21	swapper/8	22:59:04	14
2890399	99	445	22,422	cyclictest	0	-21	swapper/4	20:47:03	10
2890415	99	444	444,0	cyclictest	697	50	irq/159-i915	23:53:18	14
2890407	99	444	0,29	cyclictest	0	-21	swapper/6	23:14:18	12
2890384	99	444	5,438	cyclictest	0	-21	swapper/0	23:21:18	0
2890415	99	443	25,417	cyclictest	0	-21	swapper/8	21:24:41	14
2890436	99	442	23,417	cyclictest	0	-21	swapper/13	23:13:40	5
2890433	99	442	6,30	cyclictest	0	-21	swapper/12	20:56:18	4
2890384	99	442	442,0	cyclictest	0	-21	swapper/0	22:26:18	0
2890433	99	441	441,0	cyclictest	0	-21	swapper/12	21:37:18	4
2890415	99	441	24,417	cyclictest	0	-21	swapper/8	19:30:40	14
2890415	99	441	23,417	cyclictest	0	-21	swapper/8	23:02:03	14
2890411	99	441	19,421	cyclictest	0	-21	swapper/7	23:17:40	13
2890388	99	441	441,0	cyclictest	0	-21	swapper/1	22:29:39	1
2890436	99	440	20,419	cyclictest	0	-21	swapper/13	22:42:04	5
2890433	99	440	26,413	cyclictest	0	-21	swapper/12	20:48:18	4
2890407	99	440	19,29	cyclictest	0	-21	swapper/6	00:08:18	12
2890407	99	440	14,425	cyclictest	79	-21	ksoftirqd/6	23:28:18	12
2890399	99	440	21,418	cyclictest	0	-21	swapper/4	22:03:40	10
2890399	99	440	20,419	cyclictest	0	-21	swapper/4	20:54:01	10
2890399	99	440	19,420	cyclictest	0	-21	swapper/4	21:03:04	10
2890436	99	439	21,416	cyclictest	0	-21	swapper/13	21:11:39	5
2890421	99	439	19,29	cyclictest	0	-21	swapper/10	00:17:18	2
2890407	99	439	439,0	cyclictest	0	-21	swapper/6	23:21:18	12
2890403	99	439	24,414	cyclictest	0	-21	swapper/5	21:14:18	11
2890399	99	439	17,421	cyclictest	0	-21	swapper/4	23:34:03	10
2890388	99	439	20,418	cyclictest	0	-21	swapper/1	19:50:02	1
2890444	99	438	436,1	cyclictest	3056010	-21	kworker/15:0+i915-unordered	22:46:18	7
2890433	99	438	437,1	cyclictest	1818	-21	snmpd	23:48:15	4
2890418	99	438	0,437	cyclictest	0	-21	swapper/9	23:14:12	15
2890415	99	438	437,1	cyclictest	0	-21	swapper/8	20:37:13	14
2890397	99	438	434,2	cyclictest	0	-21	swapper/3	21:01:18	9
2890433	99	437	21,416	cyclictest	0	-21	swapper/12	22:57:18	4
2890407	99	437	10,426	cyclictest	0	-21	swapper/6	20:10:42	12
2890403	99	437	24,413	cyclictest	0	-21	swapper/5	22:17:18	11
2890403	99	437	16,421	cyclictest	0	-21	swapper/5	19:21:18	11
2890388	99	437	21,415	cyclictest	0	-21	swapper/1	23:44:00	1
2890388	99	437	18,418	cyclictest	0	-21	swapper/1	21:12:02	1
2890407	99	436	435,1	cyclictest	697	50	irq/159-i915	19:33:18	12
2890397	99	436	434,2	cyclictest	2959354	-21	kworker/3:0+i915-unordered	20:32:18	9
2890399	99	435	433,1	cyclictest	0	-21	swapper/4	21:19:18	10
2890433	99	433	20,413	cyclictest	0	-21	swapper/12	23:01:18	4
2890418	99	433	18,414	cyclictest	0	-21	swapper/9	20:07:02	15
2890411	99	433	13,419	cyclictest	0	-21	swapper/7	20:59:02	13
2890444	99	432	13,418	cyclictest	0	-21	swapper/15	20:55:03	7
2890411	99	432	12,419	cyclictest	0	-21	swapper/7	23:37:41	13
2890403	99	432	17,415	cyclictest	0	-21	swapper/5	23:11:18	11
2890399	99	432	11,420	cyclictest	0	-21	swapper/4	23:55:41	10
2890436	99	431	11,419	cyclictest	0	-21	swapper/13	19:41:02	5
2890433	99	431	18,412	cyclictest	0	-21	swapper/12	21:29:18	4
2890411	99	431	8,422	cyclictest	0	-21	swapper/7	20:39:03	13
2890407	99	431	429,1	cyclictest	2873705	-21	kworker/u64:5+events_unbound	19:26:41	12
2890407	99	431	10,30	cyclictest	0	-21	swapper/6	19:24:18	12
2890388	99	431	430,1	cyclictest	0	-21	swapper/1	23:15:18	1
2890388	99	431	430,1	cyclictest	0	-21	swapper/1	19:25:42	1
2890436	99	430	428,2	cyclictest	0	-21	swapper/13	21:34:18	5
2890426	99	430	426,2	cyclictest	697	50	irq/159-i915	21:01:18	3
2890411	99	430	9,420	cyclictest	0	-21	swapper/7	23:29:40	13
2890411	99	430	429,1	cyclictest	1818	-21	snmpd	19:38:15	13
2890403	99	430	15,414	cyclictest	0	-21	swapper/5	19:42:18	11
2890388	99	430	429,1	cyclictest	0	-21	swapper/1	20:10:42	1
2890436	99	429	3,30	cyclictest	0	-21	swapper/13	23:07:41	5
2890433	99	429	23,405	cyclictest	0	-21	swapper/12	20:36:18	4
2890418	99	429	8,420	cyclictest	0	-21	swapper/9	19:54:02	15
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17