OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 50 highest latencies:

System rackeslot8s.osadl.org (updated Tue Oct 14, 2025 12:43:50)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2364184	99	753	747,5	cyclictest	2370463	-21	kworker/2:3+events	08:07:21	2
2364186	99	745	737,6	cyclictest	256986	-21	kworker/3:0+events	09:45:20	3
2364184	99	745	738,5	cyclictest	2370463	-21	kworker/2:3+events	08:39:16	2
2364184	99	744	739,4	cyclictest	2370463	-21	kworker/2:3+events	11:05:41	2
2364184	99	743	738,4	cyclictest	2370463	-21	kworker/2:3+events	11:31:37	2
2364184	99	743	737,5	cyclictest	2370463	-21	kworker/2:3+events	12:11:35	2
2364181	99	743	739,3	cyclictest	2709320	-21	kworker/1:0+events	11:51:47	1
2364186	99	742	737,4	cyclictest	2566112	-21	turbostat	09:54:55	3
2364184	99	742	737,4	cyclictest	2370463	-21	kworker/2:3+events	11:39:15	2
2364184	99	742	737,4	cyclictest	2370463	-21	kworker/2:3+events	11:17:30	2
2364181	99	742	738,3	cyclictest	2709320	-21	kworker/1:0+events	11:55:42	1
2364184	99	741	736,4	cyclictest	2370463	-21	kworker/2:3+events	11:22:22	2
2364184	99	741	736,4	cyclictest	2370463	-21	kworker/2:3+events	11:11:16	2
2364184	99	741	735,5	cyclictest	2370463	-21	kworker/2:3+events	08:01:44	2
2364181	99	741	737,3	cyclictest	2709320	-21	kworker/1:0+events	12:31:26	1
2364186	99	740	737,2	cyclictest	2516013	-21	turbostat	09:14:56	3
2364181	99	740	736,3	cyclictest	2709320	-21	kworker/1:0+events	12:04:11	1
2364184	99	738	734,3	cyclictest	2370463	-21	kworker/2:3+events	11:26:25	2
2364181	99	738	734,3	cyclictest	2709320	-21	kworker/1:0+events	12:26:05	1
2364181	99	738	734,3	cyclictest	2709320	-21	kworker/1:0+events	12:07:21	1
2364181	99	738	734,3	cyclictest	2528183	-21	kworker/1:2+events	11:41:28	1
2364181	99	736	732,3	cyclictest	2709320	-21	kworker/1:0+events	11:47:44	1
2364181	99	735	731,3	cyclictest	2709320	-21	kworker/1:0+events	12:37:30	1
2364186	99	733	729,3	cyclictest	256986	-21	kworker/3:0+events	08:12:06	3
2364186	99	732	728,3	cyclictest	256986	-21	kworker/3:0+events	07:38:35	3
2364186	99	728	725,2	cyclictest	2472470	-21	turbostat	08:39:55	3
2364186	99	728	722,5	cyclictest	256986	-21	kworker/3:0+events	08:30:20	3
2364186	99	726	722,3	cyclictest	256986	-21	kworker/3:0+events	09:25:22	3
2364186	99	726	719,6	cyclictest	256986	-21	kworker/3:0+events	10:43:17	3
2364186	99	721	717,3	cyclictest	256986	-21	kworker/3:0+events	07:31:47	3
2364186	99	720	716,3	cyclictest	256986	-21	kworker/3:0+events	08:22:28	3
2364186	99	716	712,3	cyclictest	256986	-21	kworker/3:0+events	09:09:18	3
2364186	99	715	712,2	cyclictest	2653147	-21	kworker/3:2+events	12:23:33	3
2364186	99	715	709,5	cyclictest	2370357	-21	turbostat	07:19:56	3
2364186	99	712	709,2	cyclictest	2653147	-21	kworker/3:2+events	11:03:36	3
2364186	99	711	706,4	cyclictest	256986	-21	kworker/3:0+events	09:40:21	3
2364186	99	711	706,4	cyclictest	256986	-21	kworker/3:0+events	08:57:10	3
2364186	99	709	706,2	cyclictest	256986	-21	kworker/3:0+events	08:45:22	3
2364186	99	709	704,4	cyclictest	256986	-21	kworker/3:0+events	08:15:21	3
2364186	99	705	702,2	cyclictest	256986	-21	kworker/3:0+events	10:01:59	3
2364186	99	705	702,2	cyclictest	256986	-21	kworker/3:0+events	07:14:23	3
2364186	99	702	699,2	cyclictest	256986	-21	kworker/3:0+events	07:50:21	3
2364186	99	701	697,3	cyclictest	256986	-21	kworker/3:0+events	09:22:21	3
2364186	99	699	692,6	cyclictest	256986	-21	kworker/3:0+events	10:25:21	3
2364186	99	697	693,3	cyclictest	2634797	-21	turbostat	10:49:55	3
2364186	99	695	692,2	cyclictest	2491161	-21	turbostat	08:54:55	3
2364186	99	694	684,5	cyclictest	256986	-21	kworker/3:0+events	09:00:21	3
2364186	99	689	685,3	cyclictest	256986	-21	kworker/3:0+events	10:14:22	3
2364186	99	689	684,4	cyclictest	256986	-21	kworker/3:0+events	09:36:25	3
2364181	99	689	685,3	cyclictest	2697216	-21	turbostat	11:39:56	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2022-03-28 - 20:20