OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sun May 10, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
512568	99	3584	18,3561	cyclictest	533770	-21	kworker/2:1+events	20:30:00	2
512571	99	3124	15,3103	cyclictest	585208	-21	kworker/3:0+events	23:10:17	3
512568	99	2998	14,2979	cyclictest	591808	-21	kworker/2:0+events	23:55:12	2
512563	99	2958	13,2939	cyclictest	581974	-21	kworker/1:0+events	22:45:13	1
512563	99	2938	14,2919	cyclictest	608933	-21	kworker/1:0+events	00:15:17	1
512558	99	2904	14,2884	cyclictest	571096	-21	kworker/0:0+events	22:10:17	0
512563	99	2880	14,2863	cyclictest	534018	-21	kworker/1:2+events	20:15:14	1
512558	99	2837	13,2822	cyclictest	593419	-21	kworker/0:0+events	23:35:13	0
512568	99	2829	13,2812	cyclictest	570887	-21	kworker/2:1+events	22:15:16	2
512563	99	2811	13,2794	cyclictest	577576	-21	kworker/1:2+events	22:40:00	1
512558	99	2791	13,2775	cyclictest	557907	-21	kworker/0:2+events	21:31:24	0
512571	99	2788	14,2770	cyclictest	590647	-21	kworker/3:1+events	23:40:11	3
512558	99	2788	12,2774	cyclictest	606264	-21	kworker/0:1+events	00:05:01	0
512558	99	2769	13,2753	cyclictest	574365	-21	kworker/0:2+events	22:24:27	0
512571	99	2765	13,2748	cyclictest	516090	-21	kworker/3:1+events	19:20:17	3
512558	99	2765	13,2748	cyclictest	562439	-21	kworker/0:1+events	21:52:01	0
512558	99	2761	12,2745	cyclictest	606264	-21	kworker/0:1+events	00:11:50	0
512558	99	2761	10,2747	cyclictest	571096	-21	kworker/0:0+events	22:17:07	0
512558	99	2751	12,2735	cyclictest	583753	-21	kworker/0:0+events	22:50:12	0
512563	99	2668	12,2652	cyclictest	519683	-21	kworker/1:0+events	19:31:20	1
512558	99	2653	13,2637	cyclictest	526021	-21	kworker/0:0+events	19:50:01	0
512568	99	2633	12,2617	cyclictest	574092	-21	kworker/2:0+events	22:20:12	2
512558	99	2621	13,2604	cyclictest	537161	-21	kworker/0:1+events	20:29:37	0
512568	99	2615	13,2599	cyclictest	575753	-21	kworker/2:2+events	22:33:11	2
512563	99	2582	11,2568	cyclictest	602989	-21	kworker/1:1+events	23:46:38	1
512568	99	2572	12,2557	cyclictest	564594	-21	kworker/2:0+events	21:50:30	2
512568	99	2568	12,2552	cyclictest	617942	-21	kworker/2:0+events	00:37:18	2
512568	99	2565	12,2551	cyclictest	533770	-21	kworker/2:1+events	20:45:32	2
512568	99	2563	12,2547	cyclictest	533770	-21	kworker/2:1+events	20:24:15	2
512568	99	2556	11,2541	cyclictest	568746	-21	kworker/2:0+events	22:03:52	2
512568	99	2555	12,2539	cyclictest	580061	-21	kworker/2:0+events	22:37:25	2
512568	99	2555	12,2539	cyclictest	580061	-21	kworker/2:0+events	22:37:25	2
512568	99	2551	11,2537	cyclictest	530528	-21	kworker/2:2+events	20:11:28	2
512568	99	2549	12,2534	cyclictest	591808	-21	kworker/2:0+events	23:28:44	2
512568	99	2549	12,2534	cyclictest	533770	-21	kworker/2:1+events	20:52:40	2
512568	99	2547	12,2531	cyclictest	587025	-21	kworker/2:1+events	23:13:00	2
512568	99	2547	10,2534	cyclictest	551065	-21	kworker/2:1+events	21:25:21	2
512568	99	2546	9,2534	cyclictest	546414	-21	kworker/2:2+events	21:06:26	2
512558	99	2542	12,2526	cyclictest	569495	-21	kworker/0:1+events	22:06:10	0
512558	99	2538	12,2523	cyclictest	520930	-21	kworker/0:2+events	19:36:42	0
512558	99	2533	9,2521	cyclictest	517598	-21	kworker/0:0+events	19:40:32	0
512563	99	2532	12,2516	cyclictest	536869	-21	kworker/1:0+events	20:48:12	1
512558	99	2532	12,2516	cyclictest	539961	-21	kworker/0:0+events	20:36:49	0
512558	99	2532	10,2519	cyclictest	557907	-21	kworker/0:2+events	21:44:43	0
512558	99	2531	8,2519	cyclictest	603019	-21	kworker/0:0+events	23:49:15	0
512558	99	2531	10,2519	cyclictest	613371	-21	kworker/0:1+events	00:25:08	0
512558	99	2529	12,2513	cyclictest	543212	-21	kworker/0:2+events	20:57:35	0
512558	99	2529	11,2514	cyclictest	562439	-21	kworker/0:1+events	21:56:35	0
512563	99	2528	13,2511	cyclictest	596852	-21	kworker/1:1+events	23:30:59	1
512558	99	2528	10,2514	cyclictest	598819	-21	kworker/0:1+events	23:42:26	0
512558	99	2526	12,2510	cyclictest	578782	-21	kworker/0:0+events	22:37:01	0
512558	99	2526	12,2510	cyclictest	578782	-21	kworker/0:0+events	22:37:01	0
512568	99	2524	12,2509	cyclictest	532140	-21	kworker/2:0+events	20:17:27	2
512563	99	2511	11,2496	cyclictest	562616	-21	kworker/1:0+events	22:01:59	1
512568	99	2502	12,2487	cyclictest	587025	-21	kworker/2:1+events	23:08:20	2
512568	99	2502	12,2486	cyclictest	570887	-21	kworker/2:1+events	22:12:12	2
512558	99	2500	10,2487	cyclictest	532230	-21	kworker/0:0+events	20:13:21	0
512568	99	2494	12,2480	cyclictest	559257	-21	kworker/2:1+events	21:45:06	2
512568	99	2494	12,2479	cyclictest	585293	-21	kworker/2:2+events	22:57:44	2
512568	99	2493	12,2477	cyclictest	580061	-21	kworker/2:0+events	22:42:17	2
512568	99	2492	9,2480	cyclictest	611206	-21	kworker/2:2+events	00:32:45	2
512568	99	2492	12,2477	cyclictest	591808	-21	kworker/2:0+events	23:36:22	2
512568	99	2492	12,2477	cyclictest	530528	-21	kworker/2:2+events	20:07:19	2
512568	99	2492	12,2476	cyclictest	593403	-21	kworker/2:2+events	23:22:36	2
512568	99	2492	11,2478	cyclictest	554438	-21	kworker/2:0+events	21:17:23	2
512558	99	2492	12,2476	cyclictest	545019	-21	kworker/0:0+events	20:51:13	0
512568	99	2491	10,2478	cyclictest	524271	-21	kworker/2:2+events	19:48:08	2
512558	99	2491	12,2476	cyclictest	556277	-21	kworker/0:1+events	21:28:03	0
512558	99	2491	12,2475	cyclictest	562439	-21	kworker/0:1+events	21:48:12	0
512558	99	2491	10,2477	cyclictest	530469	-21	kworker/0:2+events	20:05:45	0
512571	99	2490	12,2474	cyclictest	526509	-21	kworker/3:1+events	20:18:14	3
512568	99	2490	12,2474	cyclictest	583599	-21	kworker/2:1+events	22:52:07	2
512568	99	2490	11,2475	cyclictest	554438	-21	kworker/2:0+events	21:31:01	2
512563	99	2490	11,2476	cyclictest	612781	-21	kworker/1:2+events	00:20:38	1
512568	99	2487	12,2471	cyclictest	596761	-21	kworker/2:1+events	23:32:09	2
512568	99	2487	11,2472	cyclictest	612872	-21	kworker/2:1+events	00:17:58	2
512568	99	2486	12,2471	cyclictest	515933	-21	kworker/2:2+events	19:27:55	2
512568	99	2486	12,2470	cyclictest	580061	-21	kworker/2:0+events	22:45:36	2
512568	99	2486	12,2470	cyclictest	520902	-21	kworker/2:0+events	19:35:55	2
512568	99	2486	10,2472	cyclictest	533770	-21	kworker/2:1+events	20:43:16	2
512563	99	2486	6,2478	cyclictest	562616	-21	kworker/1:0+events	21:45:53	1
512568	99	2485	11,2470	cyclictest	606416	-21	kworker/2:2+events	00:04:16	2
512568	99	2483	12,2468	cyclictest	591808	-21	kworker/2:0+events	00:06:32	2
512558	99	2483	12,2468	cyclictest	585482	-21	kworker/0:1+events	23:23:23	0
512558	99	2483	11,2468	cyclictest	515906	-21	kworker/0:2+events	19:16:49	0
512563	99	2482	12,2466	cyclictest	512217	-21	kworker/1:1+events	19:24:53	1
512568	99	2479	12,2464	cyclictest	515933	-21	kworker/2:2+events	19:21:27	2
512568	99	2479	10,2465	cyclictest	591808	-21	kworker/2:0+events	23:50:21	2
512563	99	2479	12,2463	cyclictest	581974	-21	kworker/1:0+events	23:05:41	1
512563	99	2478	12,2463	cyclictest	530709	-21	kworker/1:0+events	20:10:23	1
512563	99	2477	12,2462	cyclictest	574156	-21	kworker/1:1+events	22:19:03	1
512563	99	2477	11,2463	cyclictest	536869	-21	kworker/1:0+events	20:41:21	1
512563	99	2475	7,2465	cyclictest	616041	-21	kworker/1:2+events	00:36:54	1
512563	99	2475	12,2459	cyclictest	600090	-21	kworker/1:2+events	23:42:50	1
512568	99	2473	11,2459	cyclictest	575753	-21	kworker/2:2+events	22:29:25	2
512563	99	2473	9,2461	cyclictest	536869	-21	kworker/1:0+events	21:03:45	1
512563	99	2473	9,2460	cyclictest	552906	-21	kworker/1:1+events	21:27:40	1
512568	99	2472	12,2457	cyclictest	557641	-21	kworker/2:2+events	21:35:34	2
512563	99	2471	12,2457	cyclictest	562616	-21	kworker/1:0+events	21:55:04	1
512568	99	2469	12,2454	cyclictest	611206	-21	kworker/2:2+events	00:14:31	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00