OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Feb 26, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
3616521	99	3166	15,3146	cyclictest	3645177	-21	kworker/3:0+events	20:50:11	3
3616521	99	3133	15,3113	cyclictest	3616106	-21	kworker/3:1+events	19:15:11	3
3616506	99	2946	12,2931	cyclictest	3627659	-21	kworker/0:1+events	20:00:18	0
3616506	99	2816	13,2800	cyclictest	3621591	-21	kworker/0:1+events	19:30:19	0
3616521	99	2807	13,2788	cyclictest	3688500	-21	kworker/3:1+events	22:55:12	3
3616521	99	2800	13,2783	cyclictest	3670963	-21	kworker/3:2+events	22:00:11	3
3616521	99	2770	13,2753	cyclictest	3705949	-21	kworker/3:2+events	23:50:15	3
3616511	99	2765	10,2751	cyclictest	3685294	-21	kworker/1:1+events	22:50:16	1
3616506	99	2722	13,2705	cyclictest	3683967	-21	kworker/0:0+events	22:39:59	0
3616516	99	2660	13,2644	cyclictest	3662789	-21	kworker/2:1+events	21:45:14	2
3616511	99	2578	8,2566	cyclictest	3656582	-21	kworker/1:2+events	21:15:19	1
3616516	99	2547	12,2532	cyclictest	3694783	-21	kworker/2:1+events	23:27:40	2
3616516	99	2540	11,2526	cyclictest	3640519	-21	kworker/2:1+events	20:34:33	2
3616516	99	2536	12,2520	cyclictest	3671055	-21	kworker/2:1+events	22:23:23	2
3616516	99	2532	12,2516	cyclictest	3694783	-21	kworker/2:1+events	23:30:20	2
3616511	99	2532	12,2517	cyclictest	3629495	-21	kworker/1:0+events	20:03:20	1
3616511	99	2525	12,2510	cyclictest	3627689	-21	kworker/1:1+events	19:55:01	1
3616511	99	2509	12,2493	cyclictest	3676145	-21	kworker/1:0+events	22:16:53	1
3616511	99	2508	11,2493	cyclictest	3704468	-21	kworker/1:2+events	23:45:16	1
3616511	99	2504	7,2493	cyclictest	3672674	-21	kworker/1:2+events	22:14:14	1
3616521	99	2498	12,2482	cyclictest	3685682	-21	kworker/3:2+events	23:01:15	3
3616516	99	2489	12,2473	cyclictest	3626069	-21	kworker/2:0+events	20:04:53	2
3616506	99	2489	11,2474	cyclictest	3621591	-21	kworker/0:1+events	19:35:15	0
3616516	99	2487	12,2472	cyclictest	3626069	-21	kworker/2:0+events	20:06:24	2
3616511	99	2486	12,2470	cyclictest	3664623	-21	kworker/1:1+events	21:38:53	1
3616516	99	2483	11,2469	cyclictest	3647370	-21	kworker/2:1+events	20:52:50	2
3616516	99	2482	11,2467	cyclictest	3688442	-21	kworker/2:0+events	23:39:14	2
3616516	99	2479	12,2463	cyclictest	3715432	-21	kworker/2:0+events	00:18:00	2
3616516	99	2478	12,2463	cyclictest	3671055	-21	kworker/2:1+events	22:04:20	2
3616506	99	2477	12,2461	cyclictest	3695085	-21	kworker/0:1+events	23:23:48	0
3616521	99	2475	12,2460	cyclictest	3688500	-21	kworker/3:1+events	22:51:47	3
3616506	99	2474	13,2457	cyclictest	3672438	-21	kworker/0:2+events	22:13:51	0
3616506	99	2471	10,2458	cyclictest	3677396	-21	kworker/0:1+events	22:20:42	0
3616516	99	2467	12,2451	cyclictest	3667843	-21	kworker/2:2+events	21:54:03	2
3616506	99	2465	6,2457	cyclictest	3691607	-21	kworker/0:0+events	23:05:05	0
3616516	99	2464	12,2449	cyclictest	3654747	-21	kworker/2:1+events	21:11:53	2
3616511	99	2463	12,2446	cyclictest	3714127	-21	kworker/1:1+events	00:19:33	1
3616516	99	2461	12,2447	cyclictest	3671055	-21	kworker/2:1+events	22:10:01	2
3616511	99	2461	12,2446	cyclictest	3678818	-21	kworker/1:1+events	22:32:51	1
3616511	99	2456	12,2440	cyclictest	3672674	-21	kworker/1:2+events	22:25:16	1
3616516	99	2454	11,2439	cyclictest	3650099	-21	kworker/2:0+events	21:01:13	2
3616516	99	2450	11,2435	cyclictest	3690160	-21	kworker/2:1+events	22:59:45	2
3616516	99	2449	12,2435	cyclictest	3626069	-21	kworker/2:0+events	19:40:07	2
3616516	99	2448	12,2434	cyclictest	3694783	-21	kworker/2:1+events	23:15:50	2
3616516	99	2447	9,2435	cyclictest	3662789	-21	kworker/2:1+events	21:42:37	2
3616516	99	2447	9,2434	cyclictest	3671055	-21	kworker/2:1+events	22:16:08	2
3616511	99	2447	11,2433	cyclictest	3629495	-21	kworker/1:0+events	20:05:14	1
3616516	99	2445	12,2430	cyclictest	3685622	-21	kworker/2:1+events	22:45:42	2
3616521	99	2443	12,2428	cyclictest	3656704	-21	kworker/3:1+events	21:26:43	3
3616521	99	2443	12,2428	cyclictest	3656704	-21	kworker/3:1+events	21:26:42	3
3616511	99	2443	11,2429	cyclictest	3718537	-21	kworker/1:1+events	00:25:58	1
3616516	99	2438	11,2423	cyclictest	3654747	-21	kworker/2:1+events	21:22:12	2
3616511	99	2438	11,2423	cyclictest	3699657	-21	kworker/1:2+events	23:28:03	1
3616511	99	2433	12,2418	cyclictest	3654686	-21	kworker/1:0+events	21:08:03	1
3616511	99	2432	10,2418	cyclictest	3702846	-21	kworker/1:1+events	23:40:43	1
3616521	99	2429	11,2415	cyclictest	3693451	-21	kworker/3:1+events	23:14:17	3
3616511	99	2427	12,2412	cyclictest	3706102	-21	kworker/1:0+events	23:51:46	1
3616511	99	2426	10,2413	cyclictest	3654686	-21	kworker/1:0+events	21:10:19	1
3616511	99	2425	11,2411	cyclictest	3706102	-21	kworker/1:0+events	23:59:47	1
3616521	99	2424	9,2412	cyclictest	3720447	-21	kworker/3:0+events	00:35:29	3
3616511	99	2422	13,2405	cyclictest	3699657	-21	kworker/1:2+events	23:33:25	1
3616511	99	2422	12,2406	cyclictest	3706102	-21	kworker/1:0+events	00:03:37	1
3616511	99	2422	11,2408	cyclictest	3688563	-21	kworker/1:2+events	23:07:03	1
3616511	99	2420	12,2404	cyclictest	3698051	-21	kworker/1:0+events	23:35:44	1
3616521	99	2419	12,2404	cyclictest	3660292	-21	kworker/3:0+events	21:40:00	3
3616511	99	2419	12,2404	cyclictest	3686925	-21	kworker/1:0+events	22:56:42	1
3616511	99	2419	12,2404	cyclictest	3654686	-21	kworker/1:0+events	21:34:42	1
3616511	99	2419	11,2404	cyclictest	3686925	-21	kworker/1:0+events	22:47:35	1
3616511	99	2419	11,2404	cyclictest	3637142	-21	kworker/1:0+events	20:18:09	1
3616521	99	2418	9,2406	cyclictest	3627541	-21	kworker/3:1+events	19:42:00	3
3616511	99	2418	11,2404	cyclictest	3672674	-21	kworker/1:2+events	22:08:06	1
3616521	99	2417	11,2402	cyclictest	3699747	-21	kworker/3:1+events	23:46:00	3
3616511	99	2417	11,2402	cyclictest	3710927	-21	kworker/1:2+events	00:14:12	1
3616511	99	2416	13,2400	cyclictest	3710927	-21	kworker/1:2+events	00:07:22	1
3616521	99	2412	11,2397	cyclictest	3710955	-21	kworker/3:2+events	00:21:03	3
3616511	99	2412	12,2397	cyclictest	3671025	-21	kworker/1:1+events	21:59:48	1
3616521	99	2411	12,2396	cyclictest	3664650	-21	kworker/3:1+events	21:46:25	3
3616521	99	2411	12,2395	cyclictest	3647168	-21	kworker/3:2+events	21:01:37	3
3616521	99	2410	12,2394	cyclictest	3715493	-21	kworker/3:1+events	00:29:25	3
3616521	99	2410	11,2395	cyclictest	3664650	-21	kworker/3:1+events	21:40:43	3
3616521	99	2408	11,2395	cyclictest	3664650	-21	kworker/3:1+events	22:05:07	3
3616511	99	2408	12,2394	cyclictest	3682199	-21	kworker/1:2+events	22:40:45	1
3616511	99	2408	10,2396	cyclictest	3688563	-21	kworker/1:2+events	23:00:09	1
3616521	99	2407	12,2392	cyclictest	3695055	-21	kworker/3:0+events	23:31:52	3
3616521	99	2407	12,2392	cyclictest	3680477	-21	kworker/3:1+events	22:29:26	3
3616511	99	2406	12,2391	cyclictest	3640486	-21	kworker/1:1+events	20:25:22	1
3616521	99	2405	12,2390	cyclictest	3658430	-21	kworker/3:2+events	21:22:32	3
3616511	99	2402	9,2390	cyclictest	3669414	-21	kworker/1:0+events	22:00:57	1
3616506	99	2401	12,2385	cyclictest	3708035	-21	kworker/0:0+events	00:08:53	0
3616521	99	2399	12,2384	cyclictest	3638808	-21	kworker/3:1+events	20:28:26	3
3616516	99	2399	11,2384	cyclictest	3715432	-21	kworker/2:0+events	00:34:21	2
3616506	99	2396	11,2381	cyclictest	3658094	-21	kworker/0:2+events	21:16:51	0
3616521	99	2394	7,2385	cyclictest	3707556	-21	kworker/3:1+events	00:00:10	3
3616516	99	2394	12,2378	cyclictest	3715432	-21	kworker/2:0+events	00:21:49	2
3616506	99	2394	12,2380	cyclictest	3685592	-21	kworker/0:1+events	22:45:19	0
3616521	99	2393	10,2379	cyclictest	3638808	-21	kworker/3:1+events	20:38:04	3
3616506	99	2392	12,2377	cyclictest	3635451	-21	kworker/0:0+events	20:21:33	0
3616506	99	2392	12,2376	cyclictest	3695085	-21	kworker/0:1+events	23:35:20	0
3616521	99	2391	11,2377	cyclictest	3715493	-21	kworker/3:1+events	00:30:33	3
3616511	99	2388	10,2375	cyclictest	3654686	-21	kworker/1:0+events	21:40:22	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00