OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Apr 09, 2026 00:44:19)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2556091	99	3803	18,3777	cyclictest	2601368	-21	kworker/2:0+events	21:40:01	2
2556086	99	2814	14,2797	cyclictest	2636678	-21	kworker/0:0+events	23:40:14	0
2556086	99	2747	12,2731	cyclictest	2649109	-21	kworker/0:0+events	00:05:17	0
2556091	99	2726	13,2708	cyclictest	2586852	-21	kworker/2:0+events	21:05:10	2
2556091	99	2726	13,2708	cyclictest	2586852	-21	kworker/2:0+events	21:05:10	2
2556091	99	2700	13,2683	cyclictest	2568922	-21	kworker/2:2+events	20:06:07	2
2556091	99	2687	13,2670	cyclictest	2601368	-21	kworker/2:0+events	21:50:11	2
2556091	99	2639	13,2624	cyclictest	2628727	-21	kworker/2:0+events	23:15:35	2
2556091	99	2637	12,2621	cyclictest	2577193	-21	kworker/2:3+events	20:25:18	2
2556094	99	2618	13,2602	cyclictest	2612376	-21	kworker/3:1+events	22:15:14	3
2556091	99	2598	11,2583	cyclictest	2644398	-21	kworker/2:1+events	00:12:53	2
2556091	99	2586	12,2570	cyclictest	2660344	-21	kworker/2:2+events	00:35:12	2
2556091	99	2579	12,2563	cyclictest	2598059	-21	kworker/2:1+events	21:23:22	2
2556091	99	2573	10,2559	cyclictest	2630454	-21	kworker/2:1+events	23:04:14	2
2556091	99	2571	12,2556	cyclictest	2606199	-21	kworker/2:2+events	22:06:26	2
2556091	99	2569	12,2553	cyclictest	2634862	-21	kworker/2:2+events	23:12:34	2
2556094	99	2567	11,2553	cyclictest	2557337	-21	kworker/3:0+events	19:47:05	3
2556094	99	2549	11,2534	cyclictest	2625321	-21	kworker/3:2+events	22:44:27	3
2556094	99	2543	12,2527	cyclictest	2616028	-21	kworker/3:2+events	22:26:11	3
2556091	99	2537	12,2521	cyclictest	2619006	-21	kworker/2:1+events	22:49:02	2
2556091	99	2536	12,2520	cyclictest	2577193	-21	kworker/2:3+events	20:46:10	2
2556091	99	2536	12,2520	cyclictest	2577193	-21	kworker/2:3+events	20:46:10	2
2556086	99	2533	12,2517	cyclictest	2599796	-21	kworker/0:2+events	21:26:20	0
2556086	99	2528	12,2512	cyclictest	2641238	-21	kworker/0:2+events	23:34:35	0
2556091	99	2525	4,2517	cyclictest	2636615	-21	kworker/2:1+events	23:25:53	2
2556088	99	2522	13,2505	cyclictest	2599621	-21	kworker/1:0+events	21:39:14	1
2556091	99	2521	11,2507	cyclictest	2564388	-21	kworker/2:1+events	19:50:10	2
2556094	99	2519	12,2504	cyclictest	2578618	-21	kworker/3:0+events	20:17:16	3
2556094	99	2517	12,2501	cyclictest	2647365	-21	kworker/3:0+events	00:21:10	3
2556094	99	2512	12,2496	cyclictest	2580250	-21	kworker/3:1+events	20:28:43	3
2556094	99	2509	11,2495	cyclictest	2657427	-21	kworker/3:1+events	00:38:37	3
2556094	99	2499	12,2483	cyclictest	2639931	-21	kworker/3:1+events	23:34:13	3
2556094	99	2499	12,2483	cyclictest	2622059	-21	kworker/3:0+events	22:37:17	3
2556094	99	2496	12,2480	cyclictest	2557337	-21	kworker/3:0+events	19:42:30	3
2556091	99	2496	12,2481	cyclictest	2559264	-21	kworker/2:1+events	19:20:21	2
2556086	99	2496	12,2480	cyclictest	2612168	-21	kworker/0:1+events	22:15:39	0
2556094	99	2495	12,2480	cyclictest	2654172	-21	kworker/3:1+events	00:17:23	3
2556094	99	2495	12,2480	cyclictest	2572310	-21	kworker/3:2+events	20:03:30	3
2556094	99	2495	12,2479	cyclictest	2643240	-21	kworker/3:1+events	23:42:32	3
2556094	99	2495	12,2479	cyclictest	2586823	-21	kworker/3:1+events	20:53:03	3
2556094	99	2495	12,2479	cyclictest	2583508	-21	kworker/3:2+events	21:02:54	3
2556094	99	2495	12,2479	cyclictest	2583508	-21	kworker/3:2+events	21:02:53	3
2556091	99	2495	12,2480	cyclictest	2620693	-21	kworker/2:0+events	22:31:06	2
2556094	99	2494	12,2479	cyclictest	2612376	-21	kworker/3:1+events	22:07:58	3
2556094	99	2494	12,2478	cyclictest	2564450	-21	kworker/3:1+events	19:37:13	3
2556094	99	2493	11,2478	cyclictest	2601132	-21	kworker/3:0+events	21:29:02	3
2556094	99	2492	12,2476	cyclictest	2625321	-21	kworker/3:2+events	23:00:30	3
2556094	99	2492	11,2477	cyclictest	2576051	-21	kworker/3:2+events	20:14:10	3
2556091	99	2492	11,2477	cyclictest	2568922	-21	kworker/2:2+events	19:47:28	2
2556094	99	2491	12,2476	cyclictest	2598289	-21	kworker/3:2+events	21:22:59	3
2556094	99	2491	12,2475	cyclictest	2657427	-21	kworker/3:1+events	00:34:52	3
2556094	99	2491	12,2475	cyclictest	2607704	-21	kworker/3:0+events	21:57:21	3
2556094	99	2491	11,2476	cyclictest	2598289	-21	kworker/3:2+events	21:41:31	3
2556094	99	2490	12,2475	cyclictest	2625321	-21	kworker/3:2+events	23:14:27	3
2556091	99	2490	12,2475	cyclictest	2613798	-21	kworker/2:0+events	22:22:28	2
2556094	99	2489	12,2475	cyclictest	2594768	-21	kworker/3:1+events	21:10:05	3
2556091	99	2489	12,2474	cyclictest	2601368	-21	kworker/2:0+events	21:30:29	2
2556091	99	2489	12,2473	cyclictest	2644398	-21	kworker/2:1+events	00:04:11	2
2556091	99	2489	12,2473	cyclictest	2612195	-21	kworker/2:1+events	22:14:30	2
2556091	99	2489	12,2473	cyclictest	2568922	-21	kworker/2:2+events	19:57:02	2
2556094	99	2488	12,2473	cyclictest	2620396	-21	kworker/3:1+events	22:30:23	3
2556094	99	2488	12,2473	cyclictest	2586823	-21	kworker/3:1+events	20:57:11	3
2556094	99	2488	12,2472	cyclictest	2625321	-21	kworker/3:2+events	23:17:08	3
2556094	99	2488	12,2472	cyclictest	2583508	-21	kworker/3:2+events	20:48:07	3
2556094	99	2488	12,2472	cyclictest	2583508	-21	kworker/3:2+events	20:48:06	3
2556094	99	2488	11,2473	cyclictest	2638300	-21	kworker/3:2+events	23:28:55	3
2556094	99	2487	12,2472	cyclictest	2578618	-21	kworker/3:0+events	20:20:20	3
2556091	99	2487	12,2472	cyclictest	2630454	-21	kworker/2:1+events	23:05:43	2
2556091	99	2487	12,2472	cyclictest	2586852	-21	kworker/2:0+events	21:02:31	2
2556091	99	2487	12,2472	cyclictest	2586852	-21	kworker/2:0+events	21:02:31	2
2556091	99	2487	12,2471	cyclictest	2606199	-21	kworker/2:2+events	22:04:56	2
2556091	99	2487	11,2473	cyclictest	2606199	-21	kworker/2:2+events	21:58:52	2
2556091	99	2486	12,2470	cyclictest	2644398	-21	kworker/2:1+events	23:48:37	2
2556086	99	2485	12,2469	cyclictest	2557306	-21	kworker/0:2+events	19:20:44	0
2556091	99	2482	12,2467	cyclictest	2573815	-21	kworker/2:1+events	20:04:14	2
2556091	99	2480	12,2465	cyclictest	2640761	-21	kworker/2:2+events	23:42:56	2
2556091	99	2479	12,2463	cyclictest	2577193	-21	kworker/2:3+events	20:37:02	2
2556086	99	2479	12,2464	cyclictest	2604513	-21	kworker/0:2+events	21:40:44	0
2556088	99	2478	12,2462	cyclictest	2625353	-21	kworker/1:0+events	22:52:26	1
2556091	99	2476	12,2461	cyclictest	2644398	-21	kworker/2:1+events	00:20:46	2
2556091	99	2476	12,2460	cyclictest	2577193	-21	kworker/2:3+events	20:23:23	2
2556094	99	2474	12,2459	cyclictest	2557337	-21	kworker/3:0+events	19:34:51	3
2556094	99	2472	12,2456	cyclictest	2633405	-21	kworker/3:0+events	23:37:13	3
2556091	99	2471	11,2457	cyclictest	2598059	-21	kworker/2:1+events	21:18:50	2
2556091	99	2468	11,2453	cyclictest	2651062	-21	kworker/2:2+events	00:09:54	2
2556091	99	2465	11,2451	cyclictest	2644398	-21	kworker/2:1+events	23:53:54	2
2556094	99	2461	10,2447	cyclictest	2652546	-21	kworker/3:2+events	00:08:45	3
2556094	99	2453	11,2438	cyclictest	2606046	-21	kworker/3:1+events	21:54:42	3
2556091	99	2451	12,2435	cyclictest	2577193	-21	kworker/2:3+events	20:42:21	2
2556086	99	2450	12,2434	cyclictest	2644574	-21	kworker/0:2+events	23:59:36	0
2556091	99	2431	11,2416	cyclictest	2617357	-21	kworker/2:2+events	22:27:42	2
2556094	99	2427	12,2412	cyclictest	2570648	-21	kworker/3:1+events	19:59:18	3
2556091	99	2427	12,2412	cyclictest	2593772	-21	kworker/2:1+events	21:11:35	2
2556088	99	2424	12,2408	cyclictest	2639900	-21	kworker/1:2+events	23:33:06	1
2556088	99	2424	12,2408	cyclictest	2599621	-21	kworker/1:0+events	21:23:44	1
2556091	99	2405	12,2390	cyclictest	2562786	-21	kworker/2:0+events	19:32:56	2
2556091	99	2404	12,2388	cyclictest	2557217	-21	kworker/2:2+events	19:28:47	2
2556094	99	2403	4,2395	cyclictest	2612376	-21	kworker/3:1+events	22:10:18	3
2556094	99	2403	12,2388	cyclictest	2583508	-21	kworker/3:2+events	20:38:33	3
2556094	99	2398	10,2384	cyclictest	2625321	-21	kworker/3:2+events	22:58:38	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00