OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Fri Apr 10, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3033766	99	3030	14,3012	cyclictest	3137962	-21	kworker/1:1+events	00:35:01	1
3033766	99	2888	14,2870	cyclictest	3059500	-21	kworker/1:2+events	20:55:15	1
3033769	99	2806	12,2790	cyclictest	3109561	-21	kworker/2:0+events	23:11:07	2
3033769	99	2797	14,2781	cyclictest	3037726	-21	kworker/2:0+events	19:30:15	2
3033769	99	2752	13,2733	cyclictest	3093222	-21	kworker/2:0+events	22:15:12	2
3033769	99	2747	14,2729	cyclictest	3106303	-21	kworker/2:2+events	22:55:11	2
3033759	99	2742	13,2726	cyclictest	3112589	-21	kworker/0:2+events	23:15:13	0
3033766	99	2736	10,2722	cyclictest	3117520	-21	kworker/1:1+events	23:35:12	1
3033759	99	2718	12,2704	cyclictest	3062836	-21	kworker/0:1+events	20:45:21	0
3033759	99	2714	12,2698	cyclictest	3093428	-21	kworker/0:3+events	22:22:49	0
3033766	99	2706	13,2689	cyclictest	3112647	-21	kworker/1:2+events	23:58:12	1
3033766	99	2702	9,2689	cyclictest	3059500	-21	kworker/1:2+events	20:50:18	1
3033769	99	2693	13,2676	cyclictest	3078888	-21	kworker/2:2+events	21:34:13	2
3033769	99	2691	11,2676	cyclictest	3073058	-21	kworker/2:1+events	21:15:17	2
3033759	99	2677	11,2662	cyclictest	3083652	-21	kworker/0:0+events	21:45:19	0
3033774	99	2667	13,2650	cyclictest	3046764	-21	kworker/3:2+events	21:00:29	3
3033759	99	2640	12,2623	cyclictest	3044935	-21	kworker/0:1+events	19:50:18	0
3033766	99	2635	13,2619	cyclictest	3049746	-21	kworker/1:0+events	20:10:18	1
3033759	99	2607	13,2591	cyclictest	3099645	-21	kworker/0:0+events	22:39:54	0
3033769	99	2577	12,2561	cyclictest	3120519	-21	kworker/2:2+events	23:54:28	2
3033769	99	2570	11,2556	cyclictest	3083807	-21	kworker/2:0+events	21:58:37	2
3033769	99	2569	12,2554	cyclictest	3037726	-21	kworker/2:0+events	19:44:21	2
3033769	99	2567	12,2551	cyclictest	3111223	-21	kworker/2:1+events	23:09:58	2
3033769	99	2565	12,2549	cyclictest	3111223	-21	kworker/2:1+events	23:16:21	2
3033759	99	2562	8,2550	cyclictest	3086887	-21	kworker/0:0+events	22:00:29	0
3033769	99	2558	11,2544	cyclictest	3133269	-21	kworker/2:1+events	00:22:17	2
3033769	99	2556	12,2540	cyclictest	3133269	-21	kworker/2:1+events	00:30:13	2
3033769	99	2550	12,2535	cyclictest	3120519	-21	kworker/2:2+events	23:58:34	2
3033769	99	2547	10,2533	cyclictest	3077258	-21	kworker/2:0+events	21:37:17	2
3033769	99	2544	11,2530	cyclictest	3130069	-21	kworker/2:0+events	00:12:42	2
3033759	99	2539	11,2524	cyclictest	3127117	-21	kworker/0:2+events	00:15:21	0
3033759	99	2536	9,2522	cyclictest	3044935	-21	kworker/0:1+events	19:55:13	0
3033769	99	2534	12,2518	cyclictest	3067682	-21	kworker/2:0+events	21:07:17	2
3033759	99	2533	11,2518	cyclictest	3120663	-21	kworker/0:2+events	23:54:05	0
3033759	99	2532	12,2516	cyclictest	3061179	-21	kworker/0:0+events	20:33:51	0
3033769	99	2522	12,2508	cyclictest	3083807	-21	kworker/2:0+events	22:00:07	2
3033759	99	2518	11,2503	cyclictest	3109713	-21	kworker/0:0+events	23:05:26	0
3033759	99	2514	12,2498	cyclictest	3066121	-21	kworker/0:0+events	21:18:45	0
3033759	99	2508	13,2492	cyclictest	3038444	-21	kworker/0:0+events	19:24:38	0
3033759	99	2508	12,2493	cyclictest	3041702	-21	kworker/0:2+events	19:43:12	0
3033769	99	2507	12,2491	cyclictest	3051774	-21	kworker/2:1+events	20:11:24	2
3033769	99	2500	3,2494	cyclictest	3067682	-21	kworker/2:0+events	20:54:51	2
3033769	99	2499	12,2483	cyclictest	3055129	-21	kworker/2:2+events	20:17:25	2
3033769	99	2498	10,2484	cyclictest	3033367	-21	kworker/2:1+events	19:20:24	2
3033769	99	2497	12,2481	cyclictest	3093222	-21	kworker/2:0+events	22:47:52	2
3033759	99	2497	11,2483	cyclictest	3101333	-21	kworker/0:2+events	22:43:17	0
3033769	99	2496	12,2481	cyclictest	3120519	-21	kworker/2:2+events	23:42:02	2
3033769	99	2495	12,2480	cyclictest	3133269	-21	kworker/2:1+events	00:26:00	2
3033769	99	2494	12,2479	cyclictest	3091468	-21	kworker/2:2+events	22:08:48	2
3033766	99	2494	12,2479	cyclictest	3072788	-21	kworker/1:1+events	21:17:13	1
3033769	99	2493	12,2478	cyclictest	3093222	-21	kworker/2:0+events	22:24:44	2
3033769	99	2493	12,2478	cyclictest	3071188	-21	kworker/2:2+events	21:10:18	2
3033769	99	2493	12,2478	cyclictest	3053437	-21	kworker/2:0+events	20:25:25	2
3033769	99	2493	12,2477	cyclictest	3098353	-21	kworker/2:2+events	22:34:16	2
3033769	99	2493	11,2478	cyclictest	3130069	-21	kworker/2:0+events	00:07:26	2
3033769	99	2492	12,2477	cyclictest	3053437	-21	kworker/2:0+events	20:23:35	2
3033769	99	2492	12,2477	cyclictest	3053437	-21	kworker/2:0+events	20:23:34	2
3033769	99	2492	12,2477	cyclictest	3046021	-21	kworker/2:1+events	19:56:21	2
3033769	99	2492	12,2476	cyclictest	3120519	-21	kworker/2:2+events	23:49:10	2
3033769	99	2492	12,2476	cyclictest	3046021	-21	kworker/2:1+events	19:48:52	2
3033769	99	2491	12,2476	cyclictest	3046021	-21	kworker/2:1+events	19:51:49	2
3033769	99	2490	10,2475	cyclictest	3101244	-21	kworker/2:1+events	22:54:24	2
3033766	99	2488	12,2472	cyclictest	3034888	-21	kworker/1:0+events	19:20:46	1
3033769	99	2487	12,2472	cyclictest	3049833	-21	kworker/2:2+events	20:03:05	2
3033766	99	2487	8,2475	cyclictest	3067621	-21	kworker/1:0+events	21:09:55	1
3033766	99	2485	11,2470	cyclictest	3114241	-21	kworker/1:0+events	23:18:14	1
3033769	99	2483	12,2467	cyclictest	3131662	-21	kworker/2:2+events	00:18:04	2
3033766	99	2483	12,2468	cyclictest	3104704	-21	kworker/1:1+events	22:55:55	1
3033766	99	2483	12,2467	cyclictest	3085504	-21	kworker/1:0+events	21:52:51	1
3033766	99	2483	12,2467	cyclictest	3072788	-21	kworker/1:1+events	21:28:35	1
3033766	99	2483	12,2467	cyclictest	3043458	-21	kworker/1:2+events	19:43:58	1
3033769	99	2482	12,2467	cyclictest	3077258	-21	kworker/2:0+events	21:23:40	2
3033769	99	2482	11,2468	cyclictest	3118883	-21	kworker/2:0+events	23:34:02	2
3033769	99	2482	11,2467	cyclictest	3101244	-21	kworker/2:1+events	22:43:38	2
3033766	99	2481	12,2465	cyclictest	3067621	-21	kworker/1:0+events	21:11:53	1
3033766	99	2481	10,2467	cyclictest	3093282	-21	kworker/1:1+events	22:14:50	1
3033766	99	2480	11,2465	cyclictest	3062739	-21	kworker/1:1+events	20:41:30	1
3033769	99	2478	12,2462	cyclictest	3062801	-21	kworker/2:1+events	20:41:09	2
3033769	99	2476	12,2461	cyclictest	3037726	-21	kworker/2:0+events	19:38:34	2
3033769	99	2475	12,2459	cyclictest	3109561	-21	kworker/2:0+events	23:22:41	2
3033766	99	2471	10,2457	cyclictest	3049746	-21	kworker/1:0+events	20:23:57	1
3033766	99	2471	10,2457	cyclictest	3049746	-21	kworker/1:0+events	20:23:56	1
3033769	99	2468	11,2453	cyclictest	3106303	-21	kworker/2:2+events	23:01:13	2
3033769	99	2465	12,2450	cyclictest	3083807	-21	kworker/2:0+events	21:49:49	2
3033769	99	2464	12,2449	cyclictest	3114520	-21	kworker/2:2+events	23:25:18	2
3033759	99	2463	12,2448	cyclictest	3133517	-21	kworker/0:1+events	00:20:24	0
3033766	99	2460	11,2446	cyclictest	3104704	-21	kworker/1:1+events	22:54:00	1
3033759	99	2460	12,2445	cyclictest	3104556	-21	kworker/0:1+events	22:50:29	0
3033759	99	2460	11,2445	cyclictest	3041702	-21	kworker/0:2+events	19:47:01	0
3033769	99	2459	9,2447	cyclictest	3062801	-21	kworker/2:1+events	20:39:39	2
3033766	99	2457	8,2446	cyclictest	3122379	-21	kworker/1:1+events	23:49:54	1
3033759	99	2457	10,2444	cyclictest	3109713	-21	kworker/0:0+events	23:27:11	0
3033766	99	2456	12,2440	cyclictest	3104704	-21	kworker/1:1+events	23:14:53	1
3033769	99	2455	12,2439	cyclictest	3138278	-21	kworker/2:0+events	00:39:31	2
3033759	99	2455	12,2440	cyclictest	3086887	-21	kworker/0:0+events	22:11:04	0
3033759	99	2454	11,2440	cyclictest	3056333	-21	kworker/0:0+events	20:21:38	0
3033759	99	2454	11,2440	cyclictest	3056333	-21	kworker/0:0+events	20:21:38	0
3033769	99	2448	12,2433	cyclictest	3069544	-21	kworker/2:1+events	21:03:07	2
3033766	99	2448	11,2434	cyclictest	3038571	-21	kworker/1:2+events	19:27:59	1
3033759	99	2448	12,2433	cyclictest	3127117	-21	kworker/0:2+events	00:07:04	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00