OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Fri Aug 29, 2025 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3879634	99	3939	17,3916	cyclictest	3891126	-21	kworker/2:2+events	19:45:12	2
3879624	99	3599	18,3575	cyclictest	3886195	-21	kworker/0:1+events	19:30:01	0
3879624	99	3241	14,3222	cyclictest	3903773	-21	kworker/0:0+events	20:30:21	0
3879624	99	3138	14,3120	cyclictest	3946055	-21	kworker/0:2+events	22:35:01	0
3879634	99	2850	14,2831	cyclictest	3941251	-21	kworker/2:0+events	22:30:21	2
3879638	99	2837	13,2817	cyclictest	3902471	-21	kworker/3:0+events	20:35:13	3
3879634	99	2819	10,2805	cyclictest	3929661	-21	kworker/2:0+events	21:45:19	2
3879634	99	2801	13,2784	cyclictest	3916744	-21	kworker/2:2+events	21:15:18	2
3879634	99	2792	13,2775	cyclictest	3978795	-21	kworker/2:2+events	00:11:32	2
3879638	99	2788	14,2770	cyclictest	3951070	-21	kworker/3:1+events	23:00:00	3
3879624	99	2782	10,2767	cyclictest	3957545	-21	kworker/0:1+events	23:20:00	0
3879638	99	2766	13,2747	cyclictest	3980593	-21	kworker/3:2+events	00:20:14	3
3879634	99	2749	11,2733	cyclictest	3926109	-21	kworker/2:1+events	21:40:19	2
3879638	99	2714	11,2698	cyclictest	3944224	-21	kworker/3:1+events	22:32:16	3
3879634	99	2665	13,2650	cyclictest	3957405	-21	kworker/2:1+events	23:15:02	2
3879638	99	2661	12,2645	cyclictest	3951070	-21	kworker/3:1+events	23:05:01	3
3879634	99	2615	9,2602	cyclictest	3941251	-21	kworker/2:0+events	22:29:14	2
3879634	99	2615	9,2602	cyclictest	3941251	-21	kworker/2:0+events	22:29:13	2
3879638	99	2580	10,2566	cyclictest	3936062	-21	kworker/3:2+events	22:25:00	3
3879634	99	2576	12,2562	cyclictest	3913442	-21	kworker/2:0+events	21:10:23	2
3879634	99	2558	11,2543	cyclictest	3889496	-21	kworker/2:0+events	19:38:50	2
3879634	99	2548	12,2532	cyclictest	3936018	-21	kworker/2:0+events	22:02:22	2
3879634	99	2521	12,2505	cyclictest	3941251	-21	kworker/2:0+events	22:48:51	2
3879638	99	2519	12,2505	cyclictest	3968937	-21	kworker/3:0+events	23:55:08	3
3879634	99	2518	12,2504	cyclictest	3908525	-21	kworker/2:0+events	20:45:10	2
3879634	99	2512	12,2496	cyclictest	3955772	-21	kworker/2:0+events	23:10:23	2
3879638	99	2505	8,2493	cyclictest	3936062	-21	kworker/3:2+events	22:05:50	3
3879626	99	2499	12,2483	cyclictest	3980563	-21	kworker/1:0+events	00:21:47	1
3879626	99	2498	11,2483	cyclictest	3954118	-21	kworker/1:1+events	22:57:43	1
3879634	99	2497	12,2481	cyclictest	3962305	-21	kworker/2:2+events	23:25:49	2
3879638	99	2496	12,2480	cyclictest	3902471	-21	kworker/3:0+events	20:31:07	3
3879634	99	2495	12,2480	cyclictest	3980417	-21	kworker/2:1+events	00:18:42	2
3879634	99	2493	12,2478	cyclictest	3908525	-21	kworker/2:0+events	20:36:00	2
3879638	99	2491	12,2475	cyclictest	3960503	-21	kworker/3:1+events	23:41:02	3
3879634	99	2488	12,2473	cyclictest	3952468	-21	kworker/2:2+events	22:59:37	2
3879634	99	2488	12,2472	cyclictest	3976001	-21	kworker/2:0+events	00:23:44	2
3879634	99	2488	10,2474	cyclictest	3963926	-21	kworker/2:1+events	23:39:10	2
3879638	99	2487	12,2472	cyclictest	3886341	-21	kworker/3:1+events	19:55:20	3
3879638	99	2485	12,2470	cyclictest	3886341	-21	kworker/3:1+events	19:40:43	3
3879638	99	2485	12,2469	cyclictest	3978949	-21	kworker/3:1+events	00:17:12	3
3879634	99	2485	12,2470	cyclictest	3903783	-21	kworker/2:1+events	20:30:43	2
3879638	99	2484	12,2469	cyclictest	3934418	-21	kworker/3:1+events	21:57:21	3
3879638	99	2483	12,2468	cyclictest	3960503	-21	kworker/3:1+events	23:34:39	3
3879638	99	2482	12,2467	cyclictest	3982298	-21	kworker/3:1+events	00:29:29	3
3879638	99	2481	5,2472	cyclictest	3968937	-21	kworker/3:0+events	00:03:33	3
3879638	99	2480	11,2465	cyclictest	3970631	-21	kworker/3:2+events	23:53:34	3
3879634	99	2480	12,2465	cyclictest	3923275	-21	kworker/2:0+events	21:28:06	2
3879634	99	2480	11,2467	cyclictest	3950855	-21	kworker/2:1+events	22:50:03	2
3879634	99	2479	12,2463	cyclictest	3937929	-21	kworker/2:2+events	22:24:37	2
3879634	99	2478	12,2462	cyclictest	3986837	-21	kworker/2:0+events	00:37:38	2
3879634	99	2478	12,2462	cyclictest	3887607	-21	kworker/2:2+events	19:33:28	2
3879626	99	2478	12,2463	cyclictest	3963907	-21	kworker/1:0+events	23:43:40	1
3879634	99	2477	12,2461	cyclictest	3972123	-21	kworker/2:0+events	23:53:58	2
3879634	99	2477	11,2462	cyclictest	3926109	-21	kworker/2:1+events	21:57:44	2
3879634	99	2476	9,2464	cyclictest	3965553	-21	kworker/2:0+events	23:42:55	2
3879634	99	2476	12,2461	cyclictest	3980417	-21	kworker/2:1+events	00:25:39	2
3879634	99	2476	12,2460	cyclictest	3939641	-21	kworker/2:3+events	22:18:30	2
3879634	99	2474	11,2460	cyclictest	3910165	-21	kworker/2:2+events	20:55:50	2
3879634	99	2473	8,2461	cyclictest	3894480	-21	kworker/2:1+events	19:56:29	2
3879634	99	2472	12,2457	cyclictest	3926109	-21	kworker/2:1+events	22:05:26	2
3879626	99	2467	12,2452	cyclictest	3911898	-21	kworker/1:1+events	20:50:50	1
3879626	99	2467	12,2452	cyclictest	3911898	-21	kworker/1:1+events	20:50:50	1
3879638	99	2466	6,2456	cyclictest	3947731	-21	kworker/3:2+events	22:42:44	3
3879634	99	2463	12,2447	cyclictest	3900541	-21	kworker/2:0+events	20:23:09	2
3879624	99	2460	11,2445	cyclictest	3908615	-21	kworker/0:0+events	20:44:47	0
3879638	99	2457	12,2441	cyclictest	3932319	-21	kworker/3:0+events	21:54:00	3
3879638	99	2455	8,2443	cyclictest	3906975	-21	kworker/3:2+events	20:47:02	3
3879626	99	2454	10,2441	cyclictest	3975604	-21	kworker/1:0+events	00:04:41	1
3879638	99	2447	12,2431	cyclictest	3958821	-21	kworker/3:0+events	23:11:57	3
3879638	99	2447	12,2431	cyclictest	3951070	-21	kworker/3:1+events	23:10:01	3
3879638	99	2444	11,2429	cyclictest	3968937	-21	kworker/3:0+events	00:05:48	3
3879624	99	2443	11,2428	cyclictest	3929686	-21	kworker/0:2+events	21:44:09	0
3879638	99	2442	8,2431	cyclictest	3913441	-21	kworker/3:1+events	20:56:37	3
3879638	99	2441	11,2426	cyclictest	3960503	-21	kworker/3:1+events	23:22:44	3
3879626	99	2439	8,2427	cyclictest	3968904	-21	kworker/1:1+events	23:55:32	1
3879634	99	2431	11,2416	cyclictest	3900541	-21	kworker/2:0+events	20:27:18	2
3879638	99	2428	12,2412	cyclictest	3926308	-21	kworker/3:0+events	21:41:06	3
3879634	99	2428	10,2415	cyclictest	3960645	-21	kworker/2:0+events	23:24:40	2
3879624	99	2424	11,2410	cyclictest	3959267	-21	kworker/0:2+events	23:23:54	0
3879638	99	2422	10,2408	cyclictest	3941340	-21	kworker/3:0+events	22:36:10	3
3879634	99	2418	11,2403	cyclictest	3941251	-21	kworker/2:0+events	22:38:06	2
3879634	99	2417	11,2402	cyclictest	3900541	-21	kworker/2:0+events	20:13:54	2
3879638	99	2416	11,2401	cyclictest	3929862	-21	kworker/3:1+events	21:49:03	3
3879626	99	2412	12,2396	cyclictest	3954118	-21	kworker/1:1+events	23:07:17	1
3879626	99	2411	12,2396	cyclictest	3963907	-21	kworker/1:0+events	23:50:31	1
3879626	99	2411	10,2397	cyclictest	3902623	-21	kworker/1:2+events	20:34:51	1
3879638	99	2410	12,2394	cyclictest	3886341	-21	kworker/3:1+events	19:35:21	3
3879638	99	2407	12,2391	cyclictest	3947731	-21	kworker/3:2+events	22:48:29	3
3879638	99	2407	10,2393	cyclictest	3958821	-21	kworker/3:0+events	23:18:51	3
3879638	99	2404	12,2388	cyclictest	3944224	-21	kworker/3:1+events	22:29:59	3
3879638	99	2404	12,2388	cyclictest	3944224	-21	kworker/3:1+events	22:29:59	3
3879638	99	2404	12,2388	cyclictest	3913441	-21	kworker/3:1+events	21:00:25	3
3879638	99	2404	11,2390	cyclictest	3897427	-21	kworker/3:2+events	20:04:47	3
3879626	99	2404	12,2388	cyclictest	3954118	-21	kworker/1:1+events	23:21:57	1
3879626	99	2402	11,2387	cyclictest	3923221	-21	kworker/1:0+events	21:30:43	1
3879624	99	2402	12,2386	cyclictest	3968672	-21	kworker/0:0+events	23:45:36	0
3879624	99	2402	11,2389	cyclictest	3972316	-21	kworker/0:2+events	00:05:03	0
3879624	99	2401	11,2387	cyclictest	3962086	-21	kworker/0:0+events	23:26:34	0
3879638	99	2400	12,2384	cyclictest	3922994	-21	kworker/3:2+events	21:29:12	3
3879638	99	2400	11,2385	cyclictest	3911840	-21	kworker/3:0+events	20:52:02	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00