OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Aug 20, 2026 00:44:19)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2748069	99	3106	15,3086	cyclictest	2804446	-21	kworker/3:0+events	22:10:14	3
2748064	99	3098	15,3079	cyclictest	2775691	-21	kworker/1:1+events	20:35:01	1
2748069	99	3026	12,3010	cyclictest	2784286	-21	kworker/3:0+events	21:04:13	3
2748066	99	3018	15,2998	cyclictest	2812335	-21	kworker/2:0+events	22:30:18	2
2748066	99	2915	9,2901	cyclictest	2846215	-21	kworker/2:1+events	00:15:14	2
2748064	99	2913	14,2893	cyclictest	2828046	-21	kworker/1:2+events	23:25:13	1
2748059	99	2863	13,2845	cyclictest	2786797	-21	kworker/0:0+events	21:10:19	0
2748069	99	2861	14,2843	cyclictest	2759272	-21	kworker/3:2+events	19:45:16	3
2748069	99	2838	12,2822	cyclictest	2831439	-21	kworker/3:1+events	23:30:09	3
2748064	99	2808	13,2792	cyclictest	2833315	-21	kworker/1:0+events	23:50:12	1
2748059	99	2800	13,2783	cyclictest	2828229	-21	kworker/0:0+events	00:02:46	0
2748069	99	2797	13,2780	cyclictest	2760932	-21	kworker/3:0+events	20:06:05	3
2748064	99	2772	13,2755	cyclictest	2780590	-21	kworker/1:3+events	21:05:22	1
2748064	99	2755	13,2737	cyclictest	2823532	-21	kworker/1:2+events	23:05:14	1
2748064	99	2744	13,2727	cyclictest	2807497	-21	kworker/1:2+events	22:25:21	1
2748064	99	2744	13,2727	cyclictest	2807497	-21	kworker/1:2+events	22:25:20	1
2748066	99	2730	14,2711	cyclictest	2751576	-21	kworker/2:2+events	19:20:12	2
2748066	99	2726	15,2707	cyclictest	2756112	-21	kworker/2:2+events	19:40:44	2
2748064	99	2710	13,2693	cyclictest	2761528	-21	kworker/1:1+events	20:00:20	1
2748064	99	2703	13,2686	cyclictest	2833315	-21	kworker/1:0+events	23:49:48	1
2748064	99	2699	13,2682	cyclictest	2793242	-21	kworker/1:2+events	21:29:37	1
2748059	99	2692	13,2675	cyclictest	2842957	-21	kworker/0:2+events	00:10:00	0
2748066	99	2689	13,2673	cyclictest	2790022	-21	kworker/2:2+events	21:35:14	2
2748064	99	2688	12,2672	cyclictest	2849299	-21	kworker/1:1+events	00:25:55	1
2748064	99	2684	11,2669	cyclictest	2843072	-21	kworker/1:2+events	00:16:44	1
2748064	99	2677	12,2661	cyclictest	2818107	-21	kworker/1:2+events	22:53:53	1
2748066	99	2674	13,2657	cyclictest	2782794	-21	kworker/2:1+events	21:42:24	2
2748069	99	2667	11,2652	cyclictest	2833111	-21	kworker/3:2+events	23:40:34	3
2748066	99	2666	13,2649	cyclictest	2815698	-21	kworker/2:3+events	22:51:38	2
2748069	99	2665	11,2650	cyclictest	2812184	-21	kworker/3:1+events	22:42:05	3
2748069	99	2664	13,2649	cyclictest	2802731	-21	kworker/3:1+events	22:05:17	3
2748064	99	2663	12,2647	cyclictest	2765750	-21	kworker/1:2+events	20:13:41	1
2748064	99	2658	14,2641	cyclictest	2820283	-21	kworker/1:0+events	23:02:17	1
2748066	99	2649	13,2632	cyclictest	2820108	-21	kworker/2:0+events	23:04:08	2
2748066	99	2641	13,2624	cyclictest	2754388	-21	kworker/2:1+events	19:33:11	2
2748069	99	2640	13,2623	cyclictest	2780187	-21	kworker/3:0+events	20:52:46	3
2748066	99	2640	13,2623	cyclictest	2756112	-21	kworker/2:2+events	19:38:28	2
2748066	99	2637	13,2620	cyclictest	2784957	-21	kworker/2:0+events	21:01:36	2
2748059	99	2637	13,2620	cyclictest	2846240	-21	kworker/0:0+events	00:26:40	0
2748059	99	2636	13,2621	cyclictest	2793188	-21	kworker/0:0+events	21:30:21	0
2748059	99	2629	12,2615	cyclictest	2852466	-21	kworker/0:1+events	00:35:45	0
2748069	99	2619	12,2603	cyclictest	2812184	-21	kworker/3:1+events	22:26:51	3
2748069	99	2619	12,2603	cyclictest	2812184	-21	kworker/3:1+events	22:26:51	3
2748064	99	2613	13,2596	cyclictest	2841294	-21	kworker/1:0+events	00:03:54	1
2748066	99	2611	12,2596	cyclictest	2767379	-21	kworker/2:1+events	20:24:23	2
2748066	99	2583	12,2567	cyclictest	2846215	-21	kworker/2:1+events	00:24:05	2
2748064	99	2579	12,2563	cyclictest	2805837	-21	kworker/1:1+events	22:07:11	1
2748064	99	2568	13,2551	cyclictest	2749409	-21	kworker/1:0+events	19:15:16	1
2748066	99	2557	13,2540	cyclictest	2812335	-21	kworker/2:0+events	22:35:14	2
2748059	99	2557	12,2540	cyclictest	2772601	-21	kworker/0:0+events	20:31:34	0
2748069	99	2555	12,2539	cyclictest	2744584	-21	kworker/3:2+events	19:20:59	3
2748069	99	2554	13,2537	cyclictest	2824865	-21	kworker/3:0+events	23:07:07	3
2748066	99	2554	12,2538	cyclictest	2810616	-21	kworker/2:1+events	22:24:58	2
2748064	99	2537	12,2523	cyclictest	2843072	-21	kworker/1:2+events	00:10:22	1
2748069	99	2535	10,2521	cyclictest	2799438	-21	kworker/3:1+events	21:47:47	3
2748066	99	2532	13,2515	cyclictest	2836691	-21	kworker/2:0+events	23:58:09	2
2748059	99	2530	13,2514	cyclictest	2794817	-21	kworker/0:2+events	21:40:52	0
2748069	99	2522	11,2507	cyclictest	2807673	-21	kworker/3:2+events	22:15:27	3
2748069	99	2517	5,2508	cyclictest	2752786	-21	kworker/3:0+events	19:41:07	3
2748069	99	2511	12,2495	cyclictest	2789784	-21	kworker/3:2+events	21:52:42	3
2748066	99	2506	11,2492	cyclictest	2826681	-21	kworker/2:0+events	23:22:35	2
2748066	99	2501	12,2486	cyclictest	2847822	-21	kworker/2:2+events	00:36:29	2
2748066	99	2499	12,2484	cyclictest	2833046	-21	kworker/2:0+events	23:32:24	2
2748069	99	2498	12,2482	cyclictest	2833111	-21	kworker/3:2+events	23:39:03	3
2748066	99	2498	12,2482	cyclictest	2767379	-21	kworker/2:1+events	20:25:53	2
2748064	99	2495	12,2479	cyclictest	2829671	-21	kworker/1:1+events	23:38:17	1
2748064	99	2492	12,2476	cyclictest	2809154	-21	kworker/1:0+events	22:20:45	1
2748066	99	2491	12,2475	cyclictest	2799468	-21	kworker/2:2+events	21:47:01	2
2748059	99	2490	12,2476	cyclictest	2817271	-21	kworker/0:0+events	22:55:04	0
2748064	99	2487	12,2471	cyclictest	2772489	-21	kworker/1:1+events	20:27:24	1
2748059	99	2485	11,2470	cyclictest	2759281	-21	kworker/0:0+events	19:58:04	0
2748064	99	2483	12,2469	cyclictest	2807497	-21	kworker/1:2+events	22:15:05	1
2748069	99	2482	12,2466	cyclictest	2765952	-21	kworker/3:2+events	20:15:15	3
2748069	99	2482	12,2466	cyclictest	2765952	-21	kworker/3:2+events	20:15:15	3
2748064	99	2482	11,2467	cyclictest	2786851	-21	kworker/1:1+events	21:12:55	1
2748069	99	2480	13,2463	cyclictest	2744584	-21	kworker/3:2+events	19:25:35	3
2748059	99	2480	10,2466	cyclictest	2824974	-21	kworker/0:1+events	23:19:12	0
2748066	99	2477	12,2461	cyclictest	2799848	-21	kworker/2:3+events	21:55:23	2
2748064	99	2477	12,2462	cyclictest	2747703	-21	kworker/1:2+events	19:25:57	1
2748064	99	2477	12,2461	cyclictest	2761528	-21	kworker/1:1+events	20:06:50	1
2748069	99	2476	13,2459	cyclictest	2838406	-21	kworker/3:2+events	00:06:33	3
2748064	99	2476	12,2460	cyclictest	2854408	-21	kworker/1:0+events	00:39:54	1
2748069	99	2475	12,2459	cyclictest	2813847	-21	kworker/3:2+events	22:36:24	3
2748064	99	2474	12,2459	cyclictest	2789664	-21	kworker/1:2+events	21:16:21	1
2748064	99	2474	12,2459	cyclictest	2761528	-21	kworker/1:1+events	19:53:37	1
2748064	99	2474	11,2460	cyclictest	2820283	-21	kworker/1:0+events	23:11:15	1
2748069	99	2473	9,2460	cyclictest	2802731	-21	kworker/3:1+events	21:59:35	3
2748064	99	2472	12,2457	cyclictest	2791582	-21	kworker/1:0+events	21:23:57	1
2748064	99	2472	12,2456	cyclictest	2847633	-21	kworker/1:0+events	00:23:42	1
2748064	99	2472	12,2456	cyclictest	2812397	-21	kworker/1:0+events	22:43:35	1
2748064	99	2472	11,2457	cyclictest	2780220	-21	kworker/1:2+events	20:51:37	1
2748064	99	2471	12,2455	cyclictest	2786851	-21	kworker/1:1+events	21:37:08	1
2748059	99	2471	11,2456	cyclictest	2772601	-21	kworker/0:0+events	20:39:57	0
2748064	99	2470	12,2456	cyclictest	2829671	-21	kworker/1:1+events	23:40:13	1
2748064	99	2470	12,2454	cyclictest	2799682	-21	kworker/1:2+events	22:02:35	1
2748064	99	2470	12,2454	cyclictest	2780590	-21	kworker/1:3+events	20:57:21	1
2748064	99	2470	11,2455	cyclictest	2786851	-21	kworker/1:1+events	21:53:05	1
2748069	99	2469	12,2453	cyclictest	2817198	-21	kworker/3:2+events	23:13:09	3
2748064	99	2469	12,2453	cyclictest	2849299	-21	kworker/1:1+events	00:33:54	1
2748064	99	2468	14,2450	cyclictest	2812397	-21	kworker/1:0+events	22:39:45	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00