OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Fri May 01, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
438893	99	3216	15,3198	cyclictest	498268	-21	kworker/3:2+events	22:20:11	3
438883	99	2795	13,2778	cyclictest	472371	-21	kworker/0:2+events	21:05:13	0
438889	99	2791	14,2774	cyclictest	485190	-21	kworker/2:1+events	21:35:20	2
438883	99	2726	13,2708	cyclictest	523861	-21	kworker/0:2+events	23:35:20	0
438883	99	2707	13,2690	cyclictest	491560	-21	kworker/0:2+events	22:05:00	0
438893	99	2701	13,2684	cyclictest	439963	-21	kworker/3:0+events	19:20:11	3
438883	99	2701	13,2684	cyclictest	451939	-21	kworker/0:1+events	20:20:10	0
438893	99	2638	13,2621	cyclictest	486822	-21	kworker/3:2+events	21:45:10	3
438883	99	2592	12,2576	cyclictest	485582	-21	kworker/0:2+events	21:40:16	0
438893	99	2585	12,2570	cyclictest	445454	-21	kworker/3:0+events	20:10:19	3
438889	99	2578	12,2564	cyclictest	448536	-21	kworker/2:0+events	19:45:05	2
438883	99	2577	12,2561	cyclictest	479140	-21	kworker/0:2+events	21:19:42	0
438889	99	2574	12,2558	cyclictest	515556	-21	kworker/2:0+events	23:07:49	2
438889	99	2573	8,2561	cyclictest	456769	-21	kworker/2:2+events	20:05:23	2
438889	99	2569	12,2553	cyclictest	488537	-21	kworker/2:2+events	21:43:15	2
438889	99	2568	10,2554	cyclictest	528471	-21	kworker/2:2+events	00:03:30	2
438893	99	2558	12,2542	cyclictest	491712	-21	kworker/3:2+events	21:56:17	3
438883	99	2554	12,2538	cyclictest	512427	-21	kworker/0:0+events	23:08:58	0
438889	99	2550	12,2535	cyclictest	502837	-21	kworker/2:0+events	22:30:43	2
438893	99	2542	12,2526	cyclictest	502660	-21	kworker/3:1+events	22:33:01	3
438889	99	2540	12,2525	cyclictest	451815	-21	kworker/2:1+events	19:54:16	2
438883	99	2540	12,2524	cyclictest	477513	-21	kworker/0:0+events	21:11:16	0
438889	99	2536	4,2529	cyclictest	507693	-21	kworker/2:0+events	22:57:18	2
438883	99	2536	11,2521	cyclictest	533415	-21	kworker/0:0+events	00:03:07	0
438883	99	2533	12,2517	cyclictest	450279	-21	kworker/0:0+events	19:44:44	0
438893	99	2529	12,2513	cyclictest	498268	-21	kworker/3:2+events	22:16:21	3
438883	99	2528	12,2512	cyclictest	510805	-21	kworker/0:1+events	22:52:45	0
438883	99	2510	12,2494	cyclictest	519264	-21	kworker/0:1+events	23:28:02	0
438889	99	2505	12,2489	cyclictest	464560	-21	kworker/2:2+events	20:59:07	2
438883	99	2504	12,2488	cyclictest	519264	-21	kworker/0:1+events	23:46:42	0
438893	99	2500	12,2485	cyclictest	479078	-21	kworker/3:2+events	21:29:34	3
438893	99	2500	12,2484	cyclictest	466168	-21	kworker/3:2+events	20:47:01	3
438893	99	2499	12,2485	cyclictest	494995	-21	kworker/3:0+events	22:05:23	3
438889	99	2496	12,2481	cyclictest	540832	-21	kworker/2:2+events	00:36:32	2
438889	99	2496	12,2480	cyclictest	440231	-21	kworker/2:1+events	19:28:31	2
438893	99	2495	12,2480	cyclictest	521369	-21	kworker/3:2+events	23:25:45	3
438893	99	2495	12,2480	cyclictest	445454	-21	kworker/3:0+events	19:59:36	3
438893	99	2495	12,2479	cyclictest	451968	-21	kworker/3:1+events	19:50:50	3
438893	99	2495	0,2492	cyclictest	502660	-21	kworker/3:1+events	22:27:21	3
438893	99	2495	0,2492	cyclictest	502660	-21	kworker/3:1+events	22:27:20	3
438889	99	2494	12,2479	cyclictest	522248	-21	kworker/2:2+events	23:33:24	2
438889	99	2494	12,2479	cyclictest	477332	-21	kworker/2:2+events	21:30:43	2
438889	99	2494	12,2479	cyclictest	464560	-21	kworker/2:2+events	20:40:55	2
438889	99	2494	12,2478	cyclictest	475718	-21	kworker/2:0+events	21:11:39	2
438889	99	2494	12,2478	cyclictest	475718	-21	kworker/2:0+events	21:03:19	2
438889	99	2493	12,2478	cyclictest	510953	-21	kworker/2:2+events	23:00:38	2
438883	99	2493	9,2480	cyclictest	530042	-21	kworker/0:0+events	23:53:10	0
438893	99	2492	12,2477	cyclictest	519115	-21	kworker/3:0+events	23:19:17	3
438889	99	2492	12,2476	cyclictest	499434	-21	kworker/2:1+events	22:18:15	2
438889	99	2492	12,2476	cyclictest	493343	-21	kworker/2:1+events	22:08:23	2
438889	99	2492	11,2478	cyclictest	469375	-21	kworker/2:0+events	20:48:11	2
438893	99	2491	12,2476	cyclictest	532124	-21	kworker/3:3+events	00:04:39	3
438893	99	2491	12,2476	cyclictest	453630	-21	kworker/3:2+events	20:20:35	3
438889	99	2491	12,2476	cyclictest	528471	-21	kworker/2:2+events	00:05:45	2
438889	99	2491	12,2476	cyclictest	493343	-21	kworker/2:1+events	22:04:12	2
438889	99	2491	12,2475	cyclictest	480600	-21	kworker/2:1+events	21:18:32	2
438889	99	2490	12,2474	cyclictest	502987	-21	kworker/2:3+events	22:37:57	2
438889	99	2490	12,2474	cyclictest	494964	-21	kworker/2:0+events	22:20:35	2
438889	99	2490	10,2476	cyclictest	494964	-21	kworker/2:0+events	22:12:54	2
438889	99	2489	11,2475	cyclictest	510953	-21	kworker/2:2+events	22:54:40	2
438889	99	2489	11,2475	cyclictest	477332	-21	kworker/2:2+events	21:27:19	2
438889	99	2485	11,2470	cyclictest	528471	-21	kworker/2:2+events	23:47:05	2
438889	99	2484	12,2469	cyclictest	537276	-21	kworker/2:1+events	00:29:44	2
438889	99	2484	12,2469	cyclictest	528471	-21	kworker/2:2+events	23:56:36	2
438889	99	2484	11,2470	cyclictest	477332	-21	kworker/2:2+events	21:22:45	2
438893	99	2482	11,2467	cyclictest	535519	-21	kworker/3:1+events	00:11:49	3
438889	99	2481	11,2467	cyclictest	523890	-21	kworker/2:1+events	23:37:55	2
438889	99	2479	12,2464	cyclictest	506037	-21	kworker/2:1+events	22:44:28	2
438889	99	2477	12,2461	cyclictest	513929	-21	kworker/2:1+events	23:16:11	2
438889	99	2477	11,2462	cyclictest	448536	-21	kworker/2:0+events	19:42:49	2
438893	99	2476	12,2460	cyclictest	472277	-21	kworker/3:0+events	21:07:52	3
438883	99	2472	12,2456	cyclictest	451939	-21	kworker/0:1+events	20:06:32	0
438883	99	2472	12,2456	cyclictest	440108	-21	kworker/0:2+events	19:25:30	0
438889	99	2467	12,2451	cyclictest	513929	-21	kworker/2:1+events	23:12:22	2
438883	99	2467	7,2456	cyclictest	480749	-21	kworker/0:0+events	21:33:24	0
438889	99	2461	12,2446	cyclictest	540832	-21	kworker/2:2+events	00:34:59	2
438883	99	2456	12,2441	cyclictest	440108	-21	kworker/0:2+events	19:16:25	0
438889	99	2455	9,2443	cyclictest	537276	-21	kworker/2:1+events	00:23:15	2
438883	99	2451	12,2436	cyclictest	487913	-21	kworker/0:0+events	21:45:32	0
438883	99	2449	12,2433	cyclictest	540534	-21	kworker/0:0+events	00:33:29	0
438883	99	2448	12,2432	cyclictest	514076	-21	kworker/0:1+events	23:11:37	0
438883	99	2448	12,2432	cyclictest	497925	-21	kworker/0:0+events	22:12:31	0
438883	99	2448	12,2432	cyclictest	466257	-21	kworker/0:0+events	20:35:29	0
438883	99	2447	12,2432	cyclictest	463051	-21	kworker/0:2+events	20:33:55	0
438883	99	2446	9,2434	cyclictest	440108	-21	kworker/0:2+events	19:21:41	0
438883	99	2445	12,2429	cyclictest	504468	-21	kworker/0:2+events	22:38:17	0
438883	99	2445	11,2432	cyclictest	487913	-21	kworker/0:0+events	21:50:07	0
438883	99	2445	11,2431	cyclictest	534098	-21	kworker/0:1+events	00:11:25	0
438883	99	2444	12,2429	cyclictest	451939	-21	kworker/0:1+events	19:51:37	0
438883	99	2443	10,2430	cyclictest	525542	-21	kworker/0:0+events	23:40:11	0
438883	99	2442	12,2426	cyclictest	455322	-21	kworker/0:2+events	20:04:13	0
438883	99	2442	11,2428	cyclictest	533415	-21	kworker/0:0+events	00:06:30	0
438893	99	2439	12,2424	cyclictest	447057	-21	kworker/3:2+events	19:33:23	3
438883	99	2437	12,2423	cyclictest	444006	-21	kworker/0:1+events	19:36:49	0
438883	99	2436	12,2421	cyclictest	451939	-21	kworker/0:1+events	20:28:54	0
438893	99	2426	11,2412	cyclictest	509532	-21	kworker/3:1+events	23:09:20	3
438883	99	2425	12,2409	cyclictest	466257	-21	kworker/0:0+events	20:54:59	0
438889	99	2418	10,2405	cyclictest	458371	-21	kworker/2:0+events	20:10:41	2
438893	99	2413	12,2397	cyclictest	532124	-21	kworker/3:3+events	00:26:20	3
438893	99	2410	12,2394	cyclictest	502660	-21	kworker/3:1+events	22:35:18	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00