OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu May 28, 2026 00:44:19)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
705640	99	3633	17,3611	cyclictest	799253	-21	kworker/1:2+events	00:00:13	1
705645	99	3280	16,3261	cyclictest	759124	-21	kworker/2:0+events	22:00:11	2
705645	99	3280	16,3259	cyclictest	723388	-21	kworker/2:2+events	20:05:18	2
705645	99	3074	15,3054	cyclictest	796162	-21	kworker/2:1+events	23:50:15	2
705645	99	2953	11,2938	cyclictest	794536	-21	kworker/2:2+events	23:55:14	2
705647	99	2951	13,2932	cyclictest	745025	-21	kworker/3:0+events	21:20:11	3
705645	99	2950	15,2931	cyclictest	744895	-21	kworker/2:1+events	21:10:16	2
705636	99	2919	14,2903	cyclictest	730113	-21	kworker/0:2+events	20:55:27	0
705640	99	2858	13,2841	cyclictest	721698	-21	kworker/1:0+events	20:01:51	1
705645	99	2838	14,2820	cyclictest	741674	-21	kworker/2:1+events	21:00:01	2
705645	99	2838	13,2821	cyclictest	746563	-21	kworker/2:0+events	21:33:59	2
705645	99	2831	12,2815	cyclictest	718455	-21	kworker/2:2+events	19:47:02	2
705636	99	2830	13,2813	cyclictest	807460	-21	kworker/0:2+events	00:27:58	0
705645	99	2815	13,2797	cyclictest	792619	-21	kworker/2:1+events	23:37:19	2
705645	99	2805	13,2788	cyclictest	715932	-21	kworker/2:1+events	20:01:27	2
705645	99	2802	13,2786	cyclictest	784921	-21	kworker/2:0+events	23:16:14	2
705645	99	2802	13,2785	cyclictest	784921	-21	kworker/2:0+events	23:44:06	2
705645	99	2802	12,2786	cyclictest	736431	-21	kworker/2:2+events	20:53:53	2
705645	99	2801	11,2786	cyclictest	715932	-21	kworker/2:1+events	19:41:22	2
705636	99	2801	12,2785	cyclictest	759387	-21	kworker/0:2+events	21:55:15	0
705645	99	2800	13,2783	cyclictest	803954	-21	kworker/2:0+events	00:11:40	2
705645	99	2797	13,2780	cyclictest	777619	-21	kworker/2:1+events	22:57:37	2
705645	99	2796	13,2779	cyclictest	746563	-21	kworker/2:0+events	21:28:13	2
705645	99	2795	13,2779	cyclictest	773931	-21	kworker/2:0+events	22:46:35	2
705645	99	2793	13,2776	cyclictest	768924	-21	kworker/2:2+events	22:23:23	2
705645	99	2793	13,2776	cyclictest	697432	-21	kworker/2:2+events	19:19:43	2
705645	99	2791	13,2774	cyclictest	805680	-21	kworker/2:1+events	00:30:35	2
705645	99	2789	13,2772	cyclictest	733078	-21	kworker/2:0+events	20:42:51	2
705645	99	2787	11,2773	cyclictest	746563	-21	kworker/2:0+events	21:42:01	2
705645	99	2787	11,2773	cyclictest	746563	-21	kworker/2:0+events	21:42:01	2
705636	99	2784	13,2767	cyclictest	794646	-21	kworker/0:0+events	23:44:30	0
705636	99	2779	13,2762	cyclictest	739661	-21	kworker/0:0+events	21:13:21	0
705645	99	2773	13,2756	cyclictest	767267	-21	kworker/2:1+events	22:16:52	2
705645	99	2771	13,2754	cyclictest	723388	-21	kworker/2:2+events	20:17:33	2
705647	99	2770	13,2752	cyclictest	805858	-21	kworker/3:0+events	00:30:13	3
705645	99	2769	11,2754	cyclictest	697432	-21	kworker/2:2+events	19:29:12	2
705640	99	2769	13,2752	cyclictest	757585	-21	kworker/1:0+events	21:48:49	1
705645	99	2768	13,2751	cyclictest	724990	-21	kworker/2:1+events	20:20:17	2
705640	99	2767	13,2750	cyclictest	738066	-21	kworker/1:0+events	20:54:17	1
705647	99	2764	8,2753	cyclictest	769101	-21	kworker/3:1+events	22:25:20	3
705640	99	2764	11,2751	cyclictest	773810	-21	kworker/1:1+events	22:50:47	1
705636	99	2761	12,2745	cyclictest	679642	-21	kworker/0:0+events	19:39:07	0
705640	99	2757	13,2740	cyclictest	738066	-21	kworker/1:0+events	20:56:36	1
705636	99	2755	13,2738	cyclictest	757729	-21	kworker/0:0+events	22:11:20	0
705636	99	2755	13,2737	cyclictest	730113	-21	kworker/0:2+events	20:31:18	0
705636	99	2752	11,2737	cyclictest	792767	-21	kworker/0:2+events	00:03:42	0
705636	99	2748	13,2731	cyclictest	772124	-21	kworker/0:0+events	22:43:31	0
705636	99	2746	11,2731	cyclictest	772124	-21	kworker/0:0+events	22:53:27	0
705640	99	2745	13,2728	cyclictest	733134	-21	kworker/1:1+events	20:33:12	1
705636	99	2743	12,2727	cyclictest	679642	-21	kworker/0:0+events	19:43:13	0
705640	99	2742	13,2725	cyclictest	807213	-21	kworker/1:1+events	00:39:18	1
705640	99	2741	10,2727	cyclictest	772212	-21	kworker/1:2+events	22:42:21	1
705640	99	2740	9,2728	cyclictest	712343	-21	kworker/1:1+events	19:28:49	1
705640	99	2740	9,2727	cyclictest	723327	-21	kworker/1:1+events	20:05:40	1
705640	99	2740	13,2723	cyclictest	773810	-21	kworker/1:1+events	23:07:02	1
705640	99	2740	11,2726	cyclictest	721698	-21	kworker/1:0+events	20:25:41	1
705636	99	2740	13,2723	cyclictest	772124	-21	kworker/0:0+events	22:36:13	0
705640	99	2739	13,2722	cyclictest	710681	-21	kworker/1:0+events	19:23:56	1
705636	99	2739	13,2722	cyclictest	759387	-21	kworker/0:2+events	22:08:17	0
705636	99	2739	13,2722	cyclictest	739661	-21	kworker/0:0+events	21:24:00	0
705645	99	2738	13,2722	cyclictest	783323	-21	kworker/2:2+events	23:12:24	2
705640	99	2738	13,2721	cyclictest	721698	-21	kworker/1:0+events	20:37:49	1
705636	99	2738	13,2721	cyclictest	721671	-21	kworker/0:1+events	19:59:10	0
705636	99	2738	11,2723	cyclictest	788136	-21	kworker/0:1+events	23:29:42	0
705636	99	2736	12,2720	cyclictest	726829	-21	kworker/0:0+events	20:19:31	0
705640	99	2735	11,2720	cyclictest	773810	-21	kworker/1:1+events	23:03:40	1
705640	99	2735	11,2720	cyclictest	718500	-21	kworker/1:0+events	19:46:16	1
705636	99	2735	12,2721	cyclictest	728422	-21	kworker/0:1+events	20:21:26	0
705636	99	2735	12,2718	cyclictest	775408	-21	kworker/0:1+events	22:48:29	0
705636	99	2732	8,2721	cyclictest	705146	-21	kworker/0:1+events	19:16:18	0
705636	99	2731	6,2721	cyclictest	743141	-21	kworker/0:1+events	21:03:25	0
705640	99	2729	13,2714	cyclictest	718500	-21	kworker/1:0+events	19:50:05	1
705640	99	2729	13,2714	cyclictest	718500	-21	kworker/1:0+events	19:50:05	1
705636	99	2727	11,2712	cyclictest	789736	-21	kworker/0:0+events	23:31:15	0
705640	99	2724	13,2707	cyclictest	788109	-21	kworker/1:0+events	23:28:34	1
705636	99	2721	9,2708	cyclictest	733344	-21	kworker/0:1+events	20:45:54	0
705640	99	2717	8,2705	cyclictest	734741	-21	kworker/1:2+events	20:43:15	1
705636	99	2717	13,2701	cyclictest	728422	-21	kworker/0:1+events	20:29:07	0
705647	99	2716	12,2700	cyclictest	760808	-21	kworker/3:1+events	22:06:44	3
705647	99	2715	12,2699	cyclictest	741435	-21	kworker/3:2+events	21:04:34	3
705640	99	2715	11,2700	cyclictest	765443	-21	kworker/1:2+events	22:21:53	1
705636	99	2715	13,2698	cyclictest	792767	-21	kworker/0:2+events	23:59:50	0
705636	99	2715	12,2699	cyclictest	757729	-21	kworker/0:0+events	21:54:29	0
705647	99	2712	12,2696	cyclictest	713826	-21	kworker/3:1+events	19:38:43	3
705647	99	2708	10,2694	cyclictest	775259	-21	kworker/3:0+events	22:42:45	3
705640	99	2708	11,2693	cyclictest	736373	-21	kworker/1:1+events	20:46:40	1
705636	99	2707	13,2692	cyclictest	717106	-21	kworker/0:1+events	19:45:06	0
705647	99	2700	13,2685	cyclictest	767445	-21	kworker/3:2+events	22:30:14	3
705647	99	2700	13,2684	cyclictest	786317	-21	kworker/3:1+events	23:24:50	3
705647	99	2699	12,2683	cyclictest	741435	-21	kworker/3:2+events	20:57:01	3
705645	99	2699	12,2683	cyclictest	736431	-21	kworker/2:2+events	21:19:50	2
705647	99	2698	9,2685	cyclictest	743321	-21	kworker/3:1+events	21:06:29	3
705645	99	2698	7,2688	cyclictest	777619	-21	kworker/2:1+events	23:05:54	2
705640	99	2689	13,2672	cyclictest	781750	-21	kworker/1:2+events	23:18:50	1
705647	99	2685	12,2670	cyclictest	805858	-21	kworker/3:0+events	00:25:20	3
705645	99	2684	11,2670	cyclictest	724990	-21	kworker/2:1+events	20:10:39	2
705647	99	2677	12,2660	cyclictest	751245	-21	kworker/3:1+events	21:49:57	3
705647	99	2671	13,2656	cyclictest	793174	-21	kworker/3:0+events	23:46:47	3
705647	99	2671	13,2656	cyclictest	793174	-21	kworker/3:0+events	23:46:47	3
705645	99	2671	12,2655	cyclictest	759124	-21	kworker/2:0+events	22:11:41	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00