OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Nov 03, 2025 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3426186	99	2965	14,2945	cyclictest	3458627	-21	kworker/1:1+events	21:15:20	1
3426186	99	2952	13,2934	cyclictest	3431171	-21	kworker/1:2+events	19:50:20	1
3426183	99	2777	13,2758	cyclictest	3495403	-21	kworker/0:2+events	22:45:15	0
3426189	99	2746	13,2729	cyclictest	3434757	-21	kworker/2:0+events	19:40:16	2
3426193	99	2627	12,2610	cyclictest	3527629	-21	kworker/3:0+events	00:25:22	3
3426193	99	2596	11,2581	cyclictest	3521318	-21	kworker/3:2+events	00:10:25	3
3426186	99	2583	13,2568	cyclictest	3524482	-21	kworker/1:1+events	00:17:38	1
3426189	99	2572	11,2558	cyclictest	3472972	-21	kworker/2:2+events	21:50:16	2
3426193	99	2554	12,2539	cyclictest	3498989	-21	kworker/3:0+events	23:09:54	3
3426193	99	2552	4,2544	cyclictest	3448838	-21	kworker/3:0+events	20:18:46	3
3426186	99	2548	12,2531	cyclictest	3475993	-21	kworker/1:1+events	22:00:14	1
3426186	99	2547	12,2531	cyclictest	3506774	-21	kworker/1:1+events	23:20:36	1
3426189	99	2532	11,2518	cyclictest	3478038	-21	kworker/2:1+events	21:55:17	2
3426183	99	2525	12,2510	cyclictest	3432807	-21	kworker/0:2+events	19:33:05	0
3426193	99	2516	12,2500	cyclictest	3461918	-21	kworker/3:1+events	21:08:07	3
3426189	99	2502	12,2486	cyclictest	3524661	-21	kworker/2:1+events	00:37:25	2
3426186	99	2497	0,2494	cyclictest	3458627	-21	kworker/1:1+events	21:01:35	1
3426186	99	2493	12,2478	cyclictest	3489067	-21	kworker/1:1+events	22:40:39	1
3426193	99	2492	12,2476	cyclictest	3453751	-21	kworker/3:2+events	20:36:08	3
3426186	99	2489	12,2474	cyclictest	3466787	-21	kworker/1:2+events	21:21:48	1
3426193	99	2481	11,2466	cyclictest	3440932	-21	kworker/3:0+events	19:54:27	3
3426193	99	2479	12,2463	cyclictest	3437715	-21	kworker/3:1+events	20:01:23	3
3426193	99	2478	12,2462	cyclictest	3492352	-21	kworker/3:1+events	22:39:10	3
3426186	99	2477	12,2462	cyclictest	3472722	-21	kworker/1:1+events	21:35:47	1
3426193	99	2476	9,2464	cyclictest	3511765	-21	kworker/3:0+events	23:42:50	3
3426186	99	2468	12,2453	cyclictest	3442350	-21	kworker/1:1+events	19:57:07	1
3426193	99	2465	11,2451	cyclictest	3492352	-21	kworker/3:1+events	22:51:19	3
3426186	99	2465	12,2450	cyclictest	3471137	-21	kworker/1:0+events	21:29:46	1
3426186	99	2465	11,2450	cyclictest	3526116	-21	kworker/1:0+events	00:27:18	1
3426193	99	2464	12,2449	cyclictest	3523421	-21	kworker/3:1+events	00:15:20	3
3426193	99	2463	12,2448	cyclictest	3458308	-21	kworker/3:1+events	20:49:02	3
3426193	99	2463	11,2449	cyclictest	3485687	-21	kworker/3:0+events	22:32:39	3
3426186	99	2463	12,2448	cyclictest	3431171	-21	kworker/1:2+events	19:23:31	1
3426193	99	2461	11,2446	cyclictest	3511765	-21	kworker/3:0+events	23:38:13	3
3426186	99	2461	12,2446	cyclictest	3434671	-21	kworker/1:0+events	19:40:38	1
3426193	99	2460	12,2444	cyclictest	3477682	-21	kworker/3:1+events	21:53:46	3
3426193	99	2460	10,2447	cyclictest	3459938	-21	kworker/3:0+events	20:55:55	3
3426183	99	2460	11,2445	cyclictest	3477443	-21	kworker/0:0+events	21:52:36	0
3426193	99	2459	12,2444	cyclictest	3431112	-21	kworker/3:1+events	19:27:22	3
3426193	99	2459	12,2443	cyclictest	3484083	-21	kworker/3:1+events	22:11:43	3
3426183	99	2451	12,2436	cyclictest	3508379	-21	kworker/0:1+events	23:26:48	0
3426183	99	2451	12,2435	cyclictest	3477443	-21	kworker/0:0+events	22:23:56	0
3426183	99	2450	12,2435	cyclictest	3439249	-21	kworker/0:1+events	20:14:33	0
3426183	99	2449	12,2434	cyclictest	3515742	-21	kworker/0:0+events	23:51:20	0
3426183	99	2449	11,2435	cyclictest	3497265	-21	kworker/0:0+events	23:23:42	0
3426183	99	2447	12,2432	cyclictest	3453460	-21	kworker/0:1+events	20:40:20	0
3426183	99	2444	10,2430	cyclictest	3444221	-21	kworker/0:0+events	20:04:48	0
3426183	99	2435	12,2419	cyclictest	3453460	-21	kworker/0:1+events	20:34:15	0
3426193	99	2429	11,2415	cyclictest	3500621	-21	kworker/3:2+events	23:00:26	3
3426189	99	2428	11,2413	cyclictest	3487448	-21	kworker/2:2+events	22:23:11	2
3426189	99	2426	12,2411	cyclictest	3444188	-21	kworker/2:1+events	20:20:38	2
3426186	99	2426	10,2412	cyclictest	3481006	-21	kworker/1:2+events	22:05:58	1
3426189	99	2422	11,2408	cyclictest	3521196	-21	kworker/2:2+events	00:08:53	2
3426189	99	2422	11,2407	cyclictest	3482277	-21	kworker/2:2+events	22:12:07	2
3426189	99	2422	10,2408	cyclictest	3466361	-21	kworker/2:2+events	21:23:41	2
3426186	99	2421	12,2406	cyclictest	3497657	-21	kworker/1:1+events	22:51:42	1
3426189	99	2418	11,2404	cyclictest	3429573	-21	kworker/2:2+events	19:46:27	2
3426186	99	2418	11,2403	cyclictest	3448683	-21	kworker/1:1+events	20:20:14	1
3426189	99	2411	12,2396	cyclictest	3521196	-21	kworker/2:2+events	00:12:15	2
3426189	99	2411	12,2395	cyclictest	3513344	-21	kworker/2:0+events	23:43:56	2
3426193	99	2409	11,2395	cyclictest	3458308	-21	kworker/3:1+events	20:50:11	3
3426193	99	2409	10,2395	cyclictest	3521318	-21	kworker/3:2+events	00:30:36	3
3426189	99	2408	12,2393	cyclictest	3440873	-21	kworker/2:1+events	19:53:21	2
3426189	99	2406	11,2392	cyclictest	3485806	-21	kworker/2:1+events	22:19:01	2
3426183	99	2405	9,2393	cyclictest	3497265	-21	kworker/0:0+events	23:14:02	0
3426186	99	2404	10,2390	cyclictest	3431171	-21	kworker/1:2+events	19:27:45	1
3426189	99	2402	11,2388	cyclictest	3459906	-21	kworker/2:2+events	21:02:43	2
3426183	99	2402	11,2389	cyclictest	3511586	-21	kworker/0:2+events	23:35:06	0
3426186	99	2393	11,2379	cyclictest	3453691	-21	kworker/1:2+events	20:44:53	1
3426193	99	2381	11,2366	cyclictest	3485687	-21	kworker/3:0+events	22:25:25	3
3426183	99	2373	10,2360	cyclictest	3449019	-21	kworker/0:2+events	20:47:54	0
3426193	99	2364	11,2350	cyclictest	3420892	-21	kworker/3:0+events	19:20:31	3
3426183	99	2362	12,2347	cyclictest	3497265	-21	kworker/0:0+events	23:32:26	0
3426193	99	2344	12,2329	cyclictest	3521318	-21	kworker/3:2+events	00:37:04	3
3426189	99	2342	11,2328	cyclictest	3517942	-21	kworker/2:0+events	23:58:13	2
3426193	99	2339	12,2324	cyclictest	3432741	-21	kworker/3:0+events	19:41:49	3
3426183	99	2337	10,2323	cyclictest	3487476	-21	kworker/0:1+events	22:41:02	0
3426193	99	2330	11,2315	cyclictest	3475870	-21	kworker/3:2+events	22:02:32	3
3426193	99	2324	12,2309	cyclictest	3471403	-21	kworker/3:2+events	21:30:31	3
3426183	99	2322	9,2310	cyclictest	3458369	-21	kworker/0:1+events	21:05:25	0
3426189	99	2321	12,2306	cyclictest	3489126	-21	kworker/2:0+events	22:40:16	2
3426183	99	2320	11,2306	cyclictest	3489097	-21	kworker/0:2+events	22:34:35	0
3426189	99	2317	11,2303	cyclictest	3461831	-21	kworker/2:1+events	21:15:44	2
3426186	99	2309	5,2301	cyclictest	3475993	-21	kworker/1:1+events	21:48:23	1
3426183	99	2299	10,2285	cyclictest	3459969	-21	kworker/0:0+events	20:53:59	0
3426183	99	2293	11,2279	cyclictest	3531165	-21	kworker/0:1+events	00:38:34	0
3426189	99	2292	11,2279	cyclictest	3442561	-21	kworker/2:0+events	20:00:13	2
3426186	99	2287	10,2274	cyclictest	3500526	-21	kworker/1:0+events	23:09:31	1
3426193	99	2284	10,2270	cyclictest	3453751	-21	kworker/3:2+events	21:04:18	3
3426186	99	2278	11,2264	cyclictest	3444042	-21	kworker/1:0+events	20:08:10	1
3426186	99	2275	11,2261	cyclictest	3456946	-21	kworker/1:0+events	20:53:36	1
3426186	99	2274	12,2259	cyclictest	3484049	-21	kworker/1:0+events	22:20:30	1
3426193	99	2273	11,2258	cyclictest	3437715	-21	kworker/3:1+events	19:57:53	3
3426193	99	2272	11,2258	cyclictest	3461918	-21	kworker/3:1+events	21:17:39	3
3426193	99	2272	11,2258	cyclictest	3432741	-21	kworker/3:0+events	19:34:58	3
3426186	99	2272	10,2259	cyclictest	3431171	-21	kworker/1:2+events	19:31:35	1
3426186	99	2271	11,2256	cyclictest	3452002	-21	kworker/1:1+events	20:28:37	1
3426193	99	2270	10,2257	cyclictest	3498989	-21	kworker/3:0+events	22:56:11	3
3426193	99	2270	10,2257	cyclictest	3492352	-21	kworker/3:1+events	22:41:26	3
3426186	99	2270	11,2256	cyclictest	3489067	-21	kworker/1:1+events	22:30:25	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00