OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Tue Mar 24, 2026 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3404886	99	3847	9,3833	cyclictest	3493112	-21	kworker/3:0+events	23:55:19	3
3404882	99	3191	16,3172	cyclictest	82	-21	kswapd0	23:12:28	1
3404886	99	3127	15,3106	cyclictest	3496496	-21	kworker/3:1+events	00:05:17	3
3404881	99	2967	11,2951	cyclictest	3448440	-21	kworker/0:2+events	21:25:17	0
3404886	99	2864	10,2849	cyclictest	3432767	-21	kworker/3:2+events	20:35:18	3
3404886	99	2782	12,2765	cyclictest	3398107	-21	kworker/3:0+events	19:50:11	3
3404881	99	2765	13,2747	cyclictest	3498006	-21	kworker/0:2+events	00:00:18	0
3404882	99	2762	11,2746	cyclictest	3447087	-21	kworker/1:1+events	21:20:21	1
3404882	99	2759	7,2748	cyclictest	3437557	-21	kworker/1:2+events	21:00:16	1
3404886	99	2695	13,2678	cyclictest	3448650	-21	kworker/3:0+events	21:30:13	3
3404886	99	2654	13,2637	cyclictest	3459706	-21	kworker/3:2+events	21:59:48	3
3404883	99	2650	13,2634	cyclictest	3466663	-21	kworker/2:2+events	22:35:21	2
3404886	99	2648	10,2633	cyclictest	3430907	-21	kworker/3:0+events	20:40:14	3
3404883	99	2643	13,2627	cyclictest	3474076	-21	kworker/2:1+events	22:45:14	2
3404886	99	2612	11,2598	cyclictest	3398107	-21	kworker/3:0+events	19:35:21	3
3404881	99	2604	12,2590	cyclictest	3399853	-21	kworker/0:1+events	19:20:13	0
3404881	99	2555	10,2541	cyclictest	3488452	-21	kworker/0:1+events	23:35:00	0
3404883	99	2551	12,2535	cyclictest	3474076	-21	kworker/2:1+events	22:42:35	2
3404883	99	2549	12,2533	cyclictest	3501001	-21	kworker/2:1+events	00:36:35	2
3404881	99	2529	12,2515	cyclictest	3501434	-21	kworker/0:1+events	00:15:34	0
3404883	99	2526	12,2510	cyclictest	3434424	-21	kworker/2:2+events	20:46:16	2
3404883	99	2525	12,2510	cyclictest	3425936	-21	kworker/2:1+events	20:18:00	2
3404882	99	2515	12,2499	cyclictest	3449982	-21	kworker/1:0+events	21:50:17	1
3404883	99	2497	12,2481	cyclictest	3475737	-21	kworker/2:2+events	22:51:15	2
3404883	99	2497	12,2481	cyclictest	3425936	-21	kworker/2:1+events	20:14:34	2
3404883	99	2497	12,2481	cyclictest	3416452	-21	kworker/2:2+events	19:52:06	2
3404883	99	2496	12,2481	cyclictest	3479129	-21	kworker/2:2+events	23:05:42	2
3404881	99	2496	12,2480	cyclictest	3406667	-21	kworker/0:2+events	19:15:14	0
3404883	99	2495	12,2480	cyclictest	3454748	-21	kworker/2:2+events	21:46:29	2
3404883	99	2494	12,2479	cyclictest	3414767	-21	kworker/2:0+events	19:39:07	2
3404883	99	2493	12,2478	cyclictest	3494804	-21	kworker/2:0+events	23:51:54	2
3404883	99	2492	12,2477	cyclictest	3437375	-21	kworker/2:1+events	20:55:22	2
3404883	99	2491	11,2477	cyclictest	3416452	-21	kworker/2:2+events	20:00:48	2
3404883	99	2490	12,2475	cyclictest	3496436	-21	kworker/2:1+events	23:58:21	2
3404883	99	2490	12,2474	cyclictest	3430759	-21	kworker/2:1+events	20:33:27	2
3404881	99	2490	12,2474	cyclictest	3419712	-21	kworker/0:2+events	20:10:42	0
3404883	99	2486	12,2471	cyclictest	3501001	-21	kworker/2:1+events	00:18:58	2
3404883	99	2486	12,2471	cyclictest	3501001	-21	kworker/2:1+events	00:08:22	2
3404883	99	2485	12,2470	cyclictest	3422701	-21	kworker/2:0+events	20:06:11	2
3404881	99	2483	12,2469	cyclictest	3472722	-21	kworker/0:2+events	23:00:00	0
3404883	99	2479	12,2464	cyclictest	3481889	-21	kworker/2:0+events	23:10:17	2
3404882	99	2472	11,2457	cyclictest	3501597	-21	kworker/1:2+events	00:12:08	1
3404883	99	2465	11,2451	cyclictest	3485407	-21	kworker/2:0+events	23:38:30	2
3404881	99	2463	12,2448	cyclictest	3477305	-21	kworker/0:0+events	23:11:50	0
3404882	99	2462	12,2447	cyclictest	3430790	-21	kworker/1:0+events	20:48:34	1
3404882	99	2458	9,2445	cyclictest	3477243	-21	kworker/1:2+events	22:56:34	1
3404881	99	2457	11,2442	cyclictest	3440668	-21	kworker/0:1+events	21:13:55	0
3404881	99	2456	12,2441	cyclictest	3436102	-21	kworker/0:2+events	21:01:03	0
3404881	99	2456	12,2441	cyclictest	3429191	-21	kworker/0:2+events	20:32:19	0
3404883	99	2455	12,2440	cyclictest	3442225	-21	kworker/2:2+events	21:03:15	2
3404881	99	2451	11,2437	cyclictest	3438945	-21	kworker/0:0+events	20:54:13	0
3404886	99	2450	11,2435	cyclictest	3462989	-21	kworker/3:2+events	22:28:26	3
3404881	99	2450	11,2436	cyclictest	3469160	-21	kworker/0:0+events	22:28:49	0
3404881	99	2448	12,2432	cyclictest	3448440	-21	kworker/0:2+events	21:24:09	0
3404881	99	2447	12,2433	cyclictest	3451735	-21	kworker/0:0+events	21:35:10	0
3404883	99	2445	11,2430	cyclictest	3501001	-21	kworker/2:1+events	00:22:46	2
3404881	99	2445	10,2433	cyclictest	3434365	-21	kworker/0:1+events	20:45:08	0
3404881	99	2444	12,2428	cyclictest	3493929	-21	kworker/0:1+events	23:48:52	0
3404881	99	2444	11,2430	cyclictest	3469160	-21	kworker/0:0+events	22:30:45	0
3404881	99	2443	12,2427	cyclictest	3456706	-21	kworker/0:3+events	22:18:06	0
3404886	99	2442	11,2428	cyclictest	3462989	-21	kworker/3:2+events	22:38:26	3
3404881	99	2442	11,2427	cyclictest	3413234	-21	kworker/0:1+events	19:49:03	0
3404883	99	2441	12,2426	cyclictest	3477452	-21	kworker/2:1+events	22:55:29	2
3404881	99	2441	11,2427	cyclictest	3477305	-21	kworker/0:0+events	23:17:05	0
3404886	99	2440	12,2424	cyclictest	3398107	-21	kworker/3:0+events	19:40:16	3
3404881	99	2438	10,2424	cyclictest	3488452	-21	kworker/0:1+events	23:38:08	0
3404886	99	2434	9,2422	cyclictest	3429162	-21	kworker/3:2+events	20:25:12	3
3404881	99	2434	10,2420	cyclictest	3499726	-21	kworker/0:0+events	00:14:48	0
3404883	99	2427	12,2412	cyclictest	3469008	-21	kworker/2:1+events	22:26:56	2
3404882	99	2425	12,2410	cyclictest	3437557	-21	kworker/1:2+events	20:50:27	1
3404881	99	2424	11,2410	cyclictest	3480703	-21	kworker/0:1+events	23:06:50	0
3404886	99	2421	12,2405	cyclictest	3437615	-21	kworker/3:2+events	20:58:23	3
3404882	99	2421	12,2405	cyclictest	3414799	-21	kworker/1:2+events	19:51:20	1
3404882	99	2421	11,2407	cyclictest	3435957	-21	kworker/1:1+events	20:44:00	1
3404881	99	2419	11,2404	cyclictest	3426590	-21	kworker/0:1+events	20:16:07	0
3404883	99	2418	9,2407	cyclictest	3461113	-21	kworker/2:2+events	22:05:08	2
3404883	99	2418	10,2404	cyclictest	3443941	-21	kworker/2:1+events	21:35:55	2
3404881	99	2417	12,2401	cyclictest	3491725	-21	kworker/0:0+events	23:44:17	0
3404881	99	2416	11,2402	cyclictest	3416511	-21	kworker/0:0+events	19:51:42	0
3404886	99	2412	5,2403	cyclictest	3424483	-21	kworker/3:2+events	20:11:06	3
3404883	99	2411	11,2396	cyclictest	3487122	-21	kworker/2:2+events	23:28:32	2
3404883	99	2408	12,2393	cyclictest	3446939	-21	kworker/2:2+events	21:31:21	2
3404886	99	2407	12,2392	cyclictest	3475911	-21	kworker/3:1+events	22:58:05	3
3404883	99	2406	10,2393	cyclictest	3493081	-21	kworker/2:2+events	23:48:30	2
3404886	99	2405	9,2392	cyclictest	3493112	-21	kworker/3:0+events	23:44:40	3
3404886	99	2405	12,2389	cyclictest	3498235	-21	kworker/3:3+events	00:01:51	3
3404882	99	2402	12,2386	cyclictest	3432675	-21	kworker/1:2+events	20:32:42	1
3404882	99	2401	11,2387	cyclictest	3493021	-21	kworker/1:0+events	23:51:31	1
3404882	99	2400	12,2386	cyclictest	3414799	-21	kworker/1:2+events	19:55:05	1
3404882	99	2399	12,2384	cyclictest	3472574	-21	kworker/1:0+events	23:09:30	1
3404882	99	2399	10,2386	cyclictest	3501597	-21	kworker/1:2+events	00:17:26	1
3404883	99	2398	12,2383	cyclictest	3427865	-21	kworker/2:2+events	20:20:16	2
3404886	99	2397	3,2391	cyclictest	3494866	-21	kworker/3:2+events	23:53:27	3
3404882	99	2395	11,2381	cyclictest	3485220	-21	kworker/1:0+events	23:27:46	1
3404882	99	2395	11,2381	cyclictest	3464472	-21	kworker/1:1+events	22:32:18	1
3404882	99	2394	12,2379	cyclictest	3462839	-21	kworker/1:0+events	22:13:56	1
3404882	99	2383	11,2369	cyclictest	3470622	-21	kworker/1:2+events	22:38:02	1
3404881	99	2376	11,2362	cyclictest	3470824	-21	kworker/0:1+events	22:36:53	0
3404882	99	2373	12,2358	cyclictest	3451797	-21	kworker/1:2+events	21:34:25	1
3404883	99	2370	12,2354	cyclictest	3501001	-21	kworker/2:1+events	00:11:46	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00