OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Apr 27, 2026 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2759086	99	3383	14,3365	cyclictest	2855753	-21	kworker/0:1+events	00:25:01	0
2759100	99	3049	14,3030	cyclictest	2764216	-21	kworker/3:1+events	19:30:13	3
2759100	99	2982	14,2962	cyclictest	2767453	-21	kworker/3:2+events	19:35:12	3
2759086	99	2904	10,2889	cyclictest	2855753	-21	kworker/0:1+events	00:15:14	0
2759100	99	2817	13,2798	cyclictest	2812282	-21	kworker/3:0+events	21:55:18	3
2759095	99	2742	13,2727	cyclictest	2831255	-21	kworker/2:1+events	23:45:19	2
2759095	99	2726	13,2711	cyclictest	2782065	-21	kworker/2:3+events	20:30:02	2
2759090	99	2699	9,2685	cyclictest	2850595	-21	kworker/1:1+events	00:00:02	1
2759090	99	2699	9,2685	cyclictest	2850595	-21	kworker/1:1+events	00:00:01	1
2759100	99	2692	13,2676	cyclictest	2758607	-21	kworker/3:1+events	19:15:00	3
2759100	99	2658	13,2643	cyclictest	2821557	-21	kworker/3:0+events	22:50:18	3
2759100	99	2629	13,2613	cyclictest	2786725	-21	kworker/3:1+events	20:38:08	3
2759100	99	2535	12,2519	cyclictest	2775584	-21	kworker/3:1+events	20:05:51	3
2759086	99	2531	12,2515	cyclictest	2815303	-21	kworker/0:0+events	22:07:10	0
2759100	99	2526	11,2512	cyclictest	2809078	-21	kworker/3:0+events	21:44:38	3
2759100	99	2520	10,2507	cyclictest	2799380	-21	kworker/3:0+events	21:30:31	3
2759086	99	2519	10,2505	cyclictest	2788152	-21	kworker/0:1+events	20:52:24	0
2759100	99	2510	12,2494	cyclictest	2862595	-21	kworker/3:0+events	00:29:35	3
2759086	99	2496	12,2480	cyclictest	2807488	-21	kworker/0:0+events	21:42:21	0
2759086	99	2495	12,2479	cyclictest	2809105	-21	kworker/0:1+events	21:48:51	0
2759095	99	2494	12,2478	cyclictest	2831255	-21	kworker/2:1+events	23:38:46	2
2759086	99	2493	12,2478	cyclictest	2775380	-21	kworker/0:2+events	20:04:18	0
2759086	99	2490	12,2475	cyclictest	2838774	-21	kworker/0:1+events	23:24:18	0
2759100	99	2487	12,2471	cyclictest	2799380	-21	kworker/3:0+events	21:27:51	3
2759100	99	2485	12,2469	cyclictest	2852827	-21	kworker/3:4+events	00:21:59	3
2759095	99	2470	12,2456	cyclictest	2781794	-21	kworker/2:0+events	20:25:05	2
2759095	99	2470	12,2455	cyclictest	2823130	-21	kworker/2:2+events	22:35:53	2
2759100	99	2461	12,2446	cyclictest	2852827	-21	kworker/3:4+events	00:30:22	3
2759095	99	2456	12,2440	cyclictest	2823130	-21	kworker/2:2+events	22:45:20	2
2759095	99	2453	5,2444	cyclictest	2831255	-21	kworker/2:1+events	22:55:14	2
2759100	99	2451	12,2436	cyclictest	2831225	-21	kworker/3:2+events	22:58:38	3
2759100	99	2450	12,2434	cyclictest	2784892	-21	kworker/3:2+events	20:47:02	3
2759100	99	2449	11,2434	cyclictest	2741554	-21	kworker/3:2+events	19:27:09	3
2759086	99	2448	12,2433	cyclictest	2784861	-21	kworker/0:2+events	20:33:29	0
2759100	99	2447	12,2432	cyclictest	2821557	-21	kworker/3:0+events	22:40:47	3
2759100	99	2445	11,2431	cyclictest	2817319	-21	kworker/3:0+events	22:12:31	3
2759100	99	2445	11,2431	cyclictest	2817319	-21	kworker/3:0+events	22:12:31	3
2759090	99	2444	12,2429	cyclictest	2812252	-21	kworker/1:0+events	21:55:43	1
2759100	99	2441	12,2426	cyclictest	2807339	-21	kworker/3:1+events	22:21:42	3
2759100	99	2441	11,2426	cyclictest	2821557	-21	kworker/3:0+events	22:47:59	3
2759086	99	2438	12,2423	cyclictest	2775380	-21	kworker/0:2+events	20:08:06	0
2759100	99	2437	11,2423	cyclictest	2810682	-21	kworker/3:2+events	21:50:46	3
2759095	99	2436	4,2428	cyclictest	2781794	-21	kworker/2:0+events	20:21:42	2
2759100	99	2434	12,2419	cyclictest	2807339	-21	kworker/3:1+events	21:38:35	3
2759100	99	2434	12,2418	cyclictest	2789171	-21	kworker/3:0+events	20:42:00	3
2759100	99	2434	12,2418	cyclictest	2783296	-21	kworker/3:0+events	20:31:10	3
2759100	99	2433	12,2418	cyclictest	2773994	-21	kworker/3:2+events	19:55:20	3
2759086	99	2433	11,2418	cyclictest	2838774	-21	kworker/0:1+events	23:36:05	0
2759100	99	2432	12,2417	cyclictest	2794509	-21	kworker/3:2+events	20:58:31	3
2759100	99	2430	12,2415	cyclictest	2783296	-21	kworker/3:0+events	20:23:31	3
2759095	99	2429	13,2413	cyclictest	2776967	-21	kworker/2:0+events	20:03:56	2
2759100	99	2427	12,2411	cyclictest	2775584	-21	kworker/3:1+events	20:12:16	3
2759100	99	2426	11,2411	cyclictest	2837337	-21	kworker/3:1+events	23:12:30	3
2759095	99	2426	12,2410	cyclictest	2816175	-21	kworker/2:0+events	22:26:41	2
2759100	99	2425	12,2410	cyclictest	2765820	-21	kworker/3:0+events	19:48:05	3
2759100	99	2424	12,2409	cyclictest	2862595	-21	kworker/3:0+events	00:36:23	3
2759100	99	2424	12,2409	cyclictest	2783296	-21	kworker/3:0+events	20:28:08	3
2759100	99	2424	11,2410	cyclictest	2796137	-21	kworker/3:1+events	21:23:35	3
2759100	99	2423	11,2409	cyclictest	2849180	-21	kworker/3:0+events	00:02:40	3
2759100	99	2423	11,2409	cyclictest	2849180	-21	kworker/3:0+events	00:02:40	3
2759100	99	2422	11,2408	cyclictest	2844212	-21	kworker/3:0+events	23:35:44	3
2759100	99	2422	10,2409	cyclictest	2807339	-21	kworker/3:1+events	22:17:50	3
2759086	99	2422	12,2407	cyclictest	2813612	-21	kworker/0:1+events	22:19:00	0
2759100	99	2421	12,2406	cyclictest	2812282	-21	kworker/3:0+events	22:03:44	3
2759100	99	2421	12,2405	cyclictest	2840595	-21	kworker/3:2+events	23:44:11	3
2759100	99	2421	11,2406	cyclictest	2852827	-21	kworker/3:4+events	00:14:52	3
2759095	99	2421	12,2405	cyclictest	2782065	-21	kworker/2:3+events	20:36:37	2
2759100	99	2420	12,2405	cyclictest	2773994	-21	kworker/3:2+events	20:00:55	3
2759100	99	2419	12,2403	cyclictest	2799380	-21	kworker/3:0+events	21:15:55	3
2759086	99	2419	14,2402	cyclictest	2784861	-21	kworker/0:2+events	20:56:38	0
2759100	99	2416	11,2402	cyclictest	2791270	-21	kworker/3:1+events	20:52:48	3
2759095	99	2415	12,2400	cyclictest	2765669	-21	kworker/2:0+events	19:34:49	2
2759100	99	2413	12,2398	cyclictest	2775584	-21	kworker/3:1+events	20:19:02	3
2759090	99	2412	12,2396	cyclictest	2834574	-21	kworker/1:2+events	23:14:44	1
2759100	99	2410	11,2396	cyclictest	2807339	-21	kworker/3:1+events	21:46:56	3
2759100	99	2409	11,2394	cyclictest	2762593	-21	kworker/3:0+events	19:22:39	3
2759086	99	2409	10,2396	cyclictest	2827938	-21	kworker/0:0+events	22:46:49	0
2759095	99	2404	12,2388	cyclictest	2838878	-21	kworker/2:2+events	23:25:26	2
2759100	99	2403	12,2388	cyclictest	2792904	-21	kworker/3:0+events	21:02:48	3
2759086	99	2402	12,2386	cyclictest	2860848	-21	kworker/0:2+events	00:27:41	0
2759100	99	2401	12,2386	cyclictest	2821557	-21	kworker/3:0+events	22:35:29	3
2759086	99	2400	12,2386	cyclictest	2807488	-21	kworker/0:0+events	21:50:23	0
2759095	99	2398	12,2382	cyclictest	2795512	-21	kworker/2:1+events	21:07:49	2
2759095	99	2397	11,2382	cyclictest	2823130	-21	kworker/2:2+events	22:41:33	2
2759095	99	2397	10,2384	cyclictest	2856084	-21	kworker/2:0+events	00:10:43	2
2759095	99	2393	12,2378	cyclictest	2823130	-21	kworker/2:2+events	22:33:34	2
2759095	99	2390	12,2375	cyclictest	2831255	-21	kworker/2:1+events	23:15:53	2
2759095	99	2390	12,2374	cyclictest	2819925	-21	kworker/2:1+events	22:21:19	2
2759095	99	2390	12,2374	cyclictest	2805883	-21	kworker/2:2+events	21:35:55	2
2759086	99	2390	12,2375	cyclictest	2860848	-21	kworker/0:2+events	00:32:57	0
2759086	99	2389	12,2374	cyclictest	2794568	-21	kworker/0:0+events	21:22:49	0
2759095	99	2388	10,2375	cyclictest	2810470	-21	kworker/2:0+events	21:56:51	2
2759095	99	2387	9,2374	cyclictest	2800747	-21	kworker/2:0+events	21:18:13	2
2759095	99	2387	12,2371	cyclictest	2823130	-21	kworker/2:2+events	22:51:24	2
2759095	99	2387	12,2371	cyclictest	2782065	-21	kworker/2:3+events	20:41:14	2
2759095	99	2387	11,2372	cyclictest	2769133	-21	kworker/2:2+events	19:38:59	2
2759095	99	2386	9,2373	cyclictest	2844153	-21	kworker/2:2+events	23:42:38	2
2759095	99	2386	12,2371	cyclictest	2802376	-21	kworker/2:1+events	21:26:40	2
2759095	99	2386	12,2370	cyclictest	2831255	-21	kworker/2:1+events	23:51:19	2
2759095	99	2385	12,2370	cyclictest	2765669	-21	kworker/2:0+events	19:27:55	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00