OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Jun 18, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2256235	99	3161	15,3140	cyclictest	2278989	-21	kworker/1:2+events	20:45:11	1
2256235	99	3145	15,3125	cyclictest	2262788	-21	kworker/1:0+events	20:00:18	1
2256235	99	3124	15,3106	cyclictest	2355985	-21	kworker/1:0+events	00:20:16	1
2256235	99	2954	5,2944	cyclictest	2267854	-21	kworker/1:1+events	19:50:03	1
2256241	99	2913	13,2896	cyclictest	2334862	-21	kworker/3:2+events	23:45:20	3
2256241	99	2820	13,2803	cyclictest	2306355	-21	kworker/3:0+events	21:55:17	3
2256241	99	2783	13,2766	cyclictest	2296843	-21	kworker/3:2+events	22:08:58	3
2256238	99	2776	13,2759	cyclictest	2285465	-21	kworker/2:0+events	20:59:18	2
2256241	99	2770	11,2755	cyclictest	2346398	-21	kworker/3:0+events	00:00:15	3
2256241	99	2766	13,2749	cyclictest	2339975	-21	kworker/3:0+events	23:33:59	3
2256241	99	2766	12,2752	cyclictest	2296843	-21	kworker/3:2+events	21:30:10	3
2256241	99	2764	13,2747	cyclictest	2286824	-21	kworker/3:0+events	20:44:26	3
2256241	99	2764	11,2749	cyclictest	2318861	-21	kworker/3:0+events	22:28:21	3
2256241	99	2762	13,2746	cyclictest	2322099	-21	kworker/3:1+events	22:34:48	3
2256241	99	2760	13,2743	cyclictest	2296843	-21	kworker/3:2+events	22:21:29	3
2256241	99	2758	13,2742	cyclictest	2277623	-21	kworker/3:2+events	20:17:58	3
2256241	99	2758	11,2743	cyclictest	2323695	-21	kworker/3:0+events	22:41:12	3
2256235	99	2757	11,2742	cyclictest	2283925	-21	kworker/1:0+events	20:34:57	1
2256241	99	2755	13,2738	cyclictest	2293607	-21	kworker/3:0+events	21:18:47	3
2256241	99	2755	11,2740	cyclictest	2275995	-21	kworker/3:0+events	20:22:51	3
2256241	99	2754	12,2740	cyclictest	2346398	-21	kworker/3:0+events	00:15:02	3
2256241	99	2739	12,2723	cyclictest	2288717	-21	kworker/3:1+events	21:00:49	3
2256235	99	2737	13,2722	cyclictest	2331805	-21	kworker/1:2+events	23:10:09	1
2256241	99	2732	12,2716	cyclictest	2288717	-21	kworker/3:1+events	20:55:49	3
2256235	99	2725	13,2708	cyclictest	2293429	-21	kworker/1:1+events	21:03:53	1
2256235	99	2722	12,2706	cyclictest	2262788	-21	kworker/1:0+events	19:46:14	1
2256235	99	2721	12,2705	cyclictest	2310832	-21	kworker/1:1+events	22:03:17	1
2256235	99	2720	13,2703	cyclictest	2303128	-21	kworker/1:1+events	21:38:32	1
2256235	99	2720	13,2703	cyclictest	2278989	-21	kworker/1:2+events	20:23:34	1
2256235	99	2720	12,2704	cyclictest	2291369	-21	kworker/1:0+events	21:08:05	1
2256235	99	2717	13,2700	cyclictest	2317414	-21	kworker/1:0+events	22:26:52	1
2256235	99	2716	13,2699	cyclictest	2283925	-21	kworker/1:0+events	20:37:09	1
2256235	99	2715	13,2698	cyclictest	2303128	-21	kworker/1:1+events	21:41:37	1
2256235	99	2714	11,2699	cyclictest	2309236	-21	kworker/1:0+events	21:56:22	1
2256235	99	2701	11,2686	cyclictest	2323460	-21	kworker/1:0+events	22:39:18	1
2256231	99	2691	13,2674	cyclictest	2263383	-21	kworker/0:0+events	19:42:03	0
2256235	99	2689	12,2675	cyclictest	2306383	-21	kworker/1:2+events	21:51:07	1
2256238	99	2672	13,2655	cyclictest	2292072	-21	kworker/2:1+events	21:10:01	2
2256241	99	2667	12,2652	cyclictest	2304704	-21	kworker/3:1+events	21:39:43	3
2256235	99	2666	13,2650	cyclictest	2347820	-21	kworker/1:0+events	00:08:13	1
2256231	99	2639	13,2622	cyclictest	2285201	-21	kworker/0:1+events	20:42:52	0
2256231	99	2638	13,2621	cyclictest	2271812	-21	kworker/0:2+events	20:35:40	0
2256238	99	2632	13,2615	cyclictest	2355957	-21	kworker/2:1+events	00:35:23	2
2256241	99	2625	11,2610	cyclictest	2326954	-21	kworker/3:2+events	23:05:14	3
2256241	99	2624	13,2607	cyclictest	2288717	-21	kworker/3:1+events	20:47:27	3
2256241	99	2618	14,2601	cyclictest	2296843	-21	kworker/3:2+events	21:51:53	3
2256231	99	2616	12,2600	cyclictest	2293810	-21	kworker/0:0+events	21:28:38	0
2256235	99	2591	13,2574	cyclictest	2325138	-21	kworker/1:1+events	22:42:41	1
2256238	99	2580	5,2571	cyclictest	2335041	-21	kworker/2:0+events	23:26:00	2
2256238	99	2576	15,2559	cyclictest	2270245	-21	kworker/2:2+events	19:55:02	2
2256241	99	2564	3,2558	cyclictest	2284015	-21	kworker/3:3+events	20:38:18	3
2256235	99	2563	13,2546	cyclictest	2261158	-21	kworker/1:2+events	19:41:17	1
2256235	99	2559	13,2542	cyclictest	2278989	-21	kworker/1:2+events	20:54:18	1
2256238	99	2556	12,2541	cyclictest	2355957	-21	kworker/2:1+events	00:33:07	2
2256235	99	2556	9,2543	cyclictest	2262788	-21	kworker/1:0+events	20:07:46	1
2256241	99	2553	11,2538	cyclictest	2314004	-21	kworker/3:1+events	22:10:56	3
2256238	99	2551	12,2536	cyclictest	2292072	-21	kworker/2:1+events	21:00:27	2
2256241	99	2548	13,2530	cyclictest	2267938	-21	kworker/3:3+events	19:45:50	3
2256238	99	2544	12,2528	cyclictest	2309382	-21	kworker/2:2+events	21:59:05	2
2256241	99	2541	12,2525	cyclictest	2296843	-21	kworker/3:2+events	21:46:30	3
2256241	99	2540	12,2524	cyclictest	2284015	-21	kworker/3:3+events	20:51:13	3
2256241	99	2538	12,2523	cyclictest	2293607	-21	kworker/3:0+events	21:20:16	3
2256241	99	2537	12,2521	cyclictest	2301464	-21	kworker/3:0+events	21:29:00	3
2256241	99	2537	12,2521	cyclictest	2266113	-21	kworker/3:1+events	19:52:20	3
2256241	99	2536	12,2520	cyclictest	2275995	-21	kworker/3:0+events	20:32:16	3
2256241	99	2535	12,2520	cyclictest	2317203	-21	kworker/3:1+events	22:17:19	3
2256241	99	2535	12,2519	cyclictest	2334862	-21	kworker/3:2+events	23:21:05	3
2256241	99	2535	12,2519	cyclictest	2326954	-21	kworker/3:2+events	23:04:07	3
2256241	99	2535	12,2519	cyclictest	2326954	-21	kworker/3:2+events	22:55:22	3
2256241	99	2535	12,2519	cyclictest	2296843	-21	kworker/3:2+events	22:04:48	3
2256241	99	2534	12,2518	cyclictest	2255924	-21	kworker/3:2+events	19:18:54	3
2256241	99	2533	12,2517	cyclictest	2266113	-21	kworker/3:1+events	19:40:55	3
2256241	99	2531	9,2519	cyclictest	2320492	-21	kworker/3:2+events	22:37:49	3
2256241	99	2531	12,2515	cyclictest	2358971	-21	kworker/3:1+events	00:27:30	3
2256241	99	2530	12,2515	cyclictest	2272663	-21	kworker/3:2+events	19:59:32	3
2256241	99	2529	11,2514	cyclictest	2346398	-21	kworker/3:0+events	23:58:21	3
2256241	99	2528	12,2512	cyclictest	2339975	-21	kworker/3:0+events	23:41:12	3
2256241	99	2528	10,2515	cyclictest	2346398	-21	kworker/3:0+events	00:13:32	3
2256235	99	2526	13,2509	cyclictest	2275756	-21	kworker/1:1+events	20:17:13	1
2256238	99	2525	12,2510	cyclictest	2328004	-21	kworker/2:1+events	22:58:02	2
2256241	99	2524	1,2519	cyclictest	2293607	-21	kworker/3:0+events	21:06:10	3
2256241	99	2524	12,2508	cyclictest	2304704	-21	kworker/3:1+events	21:42:22	3
2256241	99	2523	12,2507	cyclictest	2272663	-21	kworker/3:2+events	20:07:22	3
2256241	99	2521	11,2506	cyclictest	2360595	-21	kworker/3:0+events	00:39:33	3
2256235	99	2519	12,2503	cyclictest	2347820	-21	kworker/1:0+events	23:52:58	1
2256241	99	2512	11,2497	cyclictest	2360595	-21	kworker/3:0+events	00:34:38	3
2256235	99	2509	11,2494	cyclictest	2340150	-21	kworker/1:1+events	23:30:33	1
2256235	99	2507	9,2494	cyclictest	2326744	-21	kworker/1:0+events	23:19:34	1
2256235	99	2503	12,2488	cyclictest	2296666	-21	kworker/1:1+events	21:26:22	1
2256241	99	2502	12,2486	cyclictest	2270974	-21	kworker/3:0+events	20:00:39	3
2256238	99	2501	12,2487	cyclictest	2309382	-21	kworker/2:2+events	22:05:35	2
2256235	99	2498	12,2482	cyclictest	2291369	-21	kworker/1:0+events	20:56:14	1
2256235	99	2496	12,2480	cyclictest	2315782	-21	kworker/1:1+events	22:19:34	1
2256235	99	2495	12,2479	cyclictest	2296666	-21	kworker/1:1+events	21:20:41	1
2256235	99	2494	9,2481	cyclictest	2280693	-21	kworker/1:0+events	20:27:41	1
2256235	99	2493	12,2477	cyclictest	2315782	-21	kworker/1:1+events	22:23:00	1
2256235	99	2492	7,2481	cyclictest	2295061	-21	kworker/1:2+events	21:18:25	1
2256235	99	2492	12,2476	cyclictest	2326744	-21	kworker/1:0+events	22:59:55	1
2256235	99	2491	4,2483	cyclictest	2285524	-21	kworker/1:1+events	20:40:35	1
2256235	99	2491	3,2484	cyclictest	2331805	-21	kworker/1:2+events	23:07:08	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00