OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Sat May 02, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
913369	99	4522	23,4494	cyclictest	986694	-21	kworker/1:2+events	22:55:20	1
913369	99	4122	22,4095	cyclictest	942505	-21	kworker/1:1+events	20:40:01	1
913375	99	3246	16,3226	cyclictest	962465	-21	kworker/3:2+events	21:45:00	3
913371	99	2907	12,2890	cyclictest	964316	-21	kworker/2:2+events	21:55:12	2
913371	99	2878	13,2859	cyclictest	983020	-21	kworker/2:1+events	23:00:14	2
913375	99	2845	13,2828	cyclictest	947384	-21	kworker/3:1+events	20:55:14	3
913375	99	2824	13,2805	cyclictest	936124	-21	kworker/3:0+events	20:30:11	3
913375	99	2816	14,2798	cyclictest	953990	-21	kworker/3:2+events	21:15:19	3
913375	99	2804	13,2788	cyclictest	976817	-21	kworker/3:0+events	22:39:01	3
913369	99	2801	13,2784	cyclictest	955346	-21	kworker/1:2+events	21:17:14	1
913369	99	2797	11,2782	cyclictest	929146	-21	kworker/1:2+events	20:31:20	1
913371	99	2794	13,2776	cyclictest	983020	-21	kworker/2:1+events	23:05:11	2
913371	99	2787	14,2769	cyclictest	973506	-21	kworker/2:0+events	22:20:17	2
913371	99	2773	14,2755	cyclictest	997664	-21	kworker/2:0+events	23:30:19	2
913365	99	2770	9,2758	cyclictest	975372	-21	kworker/0:1+events	22:25:13	0
913375	99	2767	13,2750	cyclictest	922905	-21	kworker/3:2+events	19:41:05	3
913365	99	2760	13,2743	cyclictest	942654	-21	kworker/0:0+events	20:40:22	0
913365	99	2753	13,2738	cyclictest	1004296	-21	kworker/0:0+events	00:10:16	0
913371	99	2709	12,2693	cyclictest	975251	-21	kworker/2:2+events	22:45:51	2
913371	99	2704	13,2687	cyclictest	927726	-21	kworker/2:0+events	20:00:18	2
913369	99	2703	13,2686	cyclictest	1004139	-21	kworker/1:0+events	23:58:52	1
913369	99	2701	12,2685	cyclictest	956973	-21	kworker/1:0+events	21:27:51	1
913375	99	2687	13,2670	cyclictest	968760	-21	kworker/3:0+events	21:59:01	3
913365	99	2681	13,2665	cyclictest	981607	-21	kworker/0:2+events	22:50:01	0
913369	99	2680	12,2664	cyclictest	965672	-21	kworker/1:1+events	21:50:16	1
913371	99	2679	13,2663	cyclictest	973506	-21	kworker/2:0+events	22:15:18	2
913375	99	2625	13,2609	cyclictest	1014029	-21	kworker/3:3+events	00:30:20	3
913369	99	2614	8,2602	cyclictest	1015314	-21	kworker/1:0+events	00:26:09	1
913369	99	2587	12,2573	cyclictest	932714	-21	kworker/1:1+events	20:15:05	1
913375	99	2574	12,2558	cyclictest	921270	-21	kworker/3:1+events	19:33:46	3
913369	99	2572	12,2557	cyclictest	976726	-21	kworker/1:0+events	22:27:53	1
913369	99	2572	11,2557	cyclictest	955346	-21	kworker/1:2+events	21:20:16	1
913369	99	2571	12,2556	cyclictest	918151	-21	kworker/1:2+events	19:45:14	1
913365	99	2571	12,2556	cyclictest	1004296	-21	kworker/0:0+events	00:07:57	0
913369	99	2564	12,2548	cyclictest	929146	-21	kworker/1:2+events	21:09:19	1
913375	99	2562	12,2546	cyclictest	942412	-21	kworker/3:2+events	20:38:54	3
913369	99	2560	12,2544	cyclictest	999614	-21	kworker/1:2+events	23:37:55	1
913369	99	2549	12,2534	cyclictest	1009032	-21	kworker/1:1+events	00:21:59	1
913369	99	2549	10,2536	cyclictest	1004139	-21	kworker/1:0+events	00:09:07	1
913375	99	2547	12,2531	cyclictest	924514	-21	kworker/3:0+events	19:47:53	3
913375	99	2545	11,2530	cyclictest	932653	-21	kworker/3:1+events	20:12:49	3
913375	99	2543	12,2527	cyclictest	1014029	-21	kworker/3:3+events	00:28:02	3
913375	99	2542	12,2526	cyclictest	988099	-21	kworker/3:2+events	23:04:49	3
913375	99	2541	12,2525	cyclictest	936124	-21	kworker/3:0+events	20:29:02	3
913375	99	2540	12,2525	cyclictest	921270	-21	kworker/3:1+events	20:00:40	3
913365	99	2540	12,2524	cyclictest	928581	-21	kworker/0:2+events	19:58:27	0
913375	99	2538	5,2530	cyclictest	932653	-21	kworker/3:1+events	20:17:45	3
913375	99	2538	10,2524	cyclictest	981726	-21	kworker/3:1+events	22:41:40	3
913375	99	2537	10,2523	cyclictest	1013690	-21	kworker/3:2+events	00:35:14	3
913375	99	2534	12,2518	cyclictest	999375	-21	kworker/3:0+events	23:45:26	3
913365	99	2532	12,2516	cyclictest	932769	-21	kworker/0:2+events	20:16:37	0
913369	99	2530	11,2516	cyclictest	988326	-21	kworker/1:0+events	23:10:12	1
913365	99	2530	12,2514	cyclictest	924618	-21	kworker/0:2+events	19:44:05	0
913369	99	2528	12,2512	cyclictest	980030	-21	kworker/1:1+events	22:35:32	1
913365	99	2524	12,2509	cyclictest	999434	-21	kworker/0:1+events	23:35:36	0
913375	99	2522	12,2506	cyclictest	954106	-21	kworker/3:3+events	21:21:23	3
913375	99	2522	12,2506	cyclictest	921270	-21	kworker/3:1+events	19:52:23	3
913369	99	2522	12,2506	cyclictest	972517	-21	kworker/1:1+events	22:16:05	1
913375	99	2521	12,2505	cyclictest	984622	-21	kworker/3:0+events	22:51:53	3
913369	99	2519	12,2503	cyclictest	988326	-21	kworker/1:0+events	23:02:56	1
913375	99	2518	12,2502	cyclictest	942412	-21	kworker/3:2+events	20:53:41	3
913365	99	2517	9,2505	cyclictest	921303	-21	kworker/0:0+events	19:35:42	0
913365	99	2515	12,2499	cyclictest	965707	-21	kworker/0:1+events	21:51:24	0
913365	99	2514	11,2499	cyclictest	1004296	-21	kworker/0:0+events	00:18:13	0
913365	99	2514	10,2502	cyclictest	999434	-21	kworker/0:1+events	23:45:03	0
913365	99	2512	12,2496	cyclictest	973732	-21	kworker/0:2+events	22:17:14	0
913375	99	2510	12,2495	cyclictest	978543	-21	kworker/3:2+events	22:46:12	3
913365	99	2510	12,2494	cyclictest	999434	-21	kworker/0:1+events	23:33:42	0
913365	99	2510	12,2494	cyclictest	1004296	-21	kworker/0:0+events	00:32:09	0
913365	99	2508	12,2492	cyclictest	1005993	-21	kworker/0:2+events	00:04:11	0
913369	99	2507	10,2493	cyclictest	967306	-21	kworker/1:2+events	22:02:26	1
913369	99	2506	12,2491	cyclictest	930813	-21	kworker/1:0+events	20:01:49	1
913375	99	2505	12,2490	cyclictest	991345	-21	kworker/3:1+events	23:18:06	3
913365	99	2505	12,2490	cyclictest	970416	-21	kworker/0:0+events	22:22:55	0
913369	99	2499	12,2483	cyclictest	1005751	-21	kworker/1:1+events	23:52:00	1
913375	99	2498	10,2486	cyclictest	934518	-21	kworker/3:2+events	20:20:03	3
913369	99	2498	8,2486	cyclictest	947680	-21	kworker/1:0+events	21:04:20	1
913369	99	2496	11,2481	cyclictest	909496	-21	kworker/1:0+events	19:21:34	1
913369	99	2495	12,2481	cyclictest	995952	-21	kworker/1:2+events	23:25:01	1
913369	99	2495	12,2479	cyclictest	956973	-21	kworker/1:0+events	21:38:54	1
913375	99	2494	11,2479	cyclictest	960563	-21	kworker/3:0+events	21:35:05	3
913369	99	2494	12,2478	cyclictest	976726	-21	kworker/1:0+events	22:22:10	1
913375	99	2493	12,2478	cyclictest	1004264	-21	kworker/3:2+events	23:55:25	3
913375	99	2491	12,2475	cyclictest	997513	-21	kworker/3:1+events	23:26:31	3
913375	99	2490	12,2474	cyclictest	968760	-21	kworker/3:0+events	22:09:13	3
913369	99	2490	12,2474	cyclictest	984713	-21	kworker/1:1+events	22:50:24	1
913365	99	2490	12,2475	cyclictest	915499	-21	kworker/0:0+events	19:17:46	0
913369	99	2489	12,2474	cyclictest	956973	-21	kworker/1:0+events	22:10:19	1
913369	99	2489	12,2474	cyclictest	1012300	-21	kworker/1:2+events	00:15:11	1
913369	99	2489	12,2473	cyclictest	956973	-21	kworker/1:0+events	21:49:09	1
913375	99	2488	12,2473	cyclictest	964345	-21	kworker/3:1+events	21:54:25	3
913375	99	2488	11,2475	cyclictest	968760	-21	kworker/3:0+events	22:11:06	3
913375	99	2488	10,2474	cyclictest	952364	-21	kworker/3:0+events	21:13:26	3
913375	99	2487	10,2473	cyclictest	929377	-21	kworker/3:0+events	19:59:56	3
913369	99	2487	12,2471	cyclictest	1009032	-21	kworker/1:1+events	00:11:49	1
913375	99	2486	12,2470	cyclictest	976817	-21	kworker/3:0+events	22:34:23	3
913375	99	2486	10,2473	cyclictest	942811	-21	kworker/3:3+events	20:44:59	3
913375	99	2485	12,2469	cyclictest	950757	-21	kworker/3:1+events	21:06:15	3
913375	99	2485	11,2471	cyclictest	1012063	-21	kworker/3:0+events	00:11:28	3
913375	99	2484	12,2469	cyclictest	975156	-21	kworker/3:1+events	22:25:59	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00