OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon Jun 30, 2025 00:44:18)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
521828	99	3128	15,3108	cyclictest	528239	-21	kworker/1:1+events	19:35:18	1
521826	99	2997	9,2982	cyclictest	552441	-21	kworker/0:2+events	21:00:00	0
521828	99	2988	15,2967	cyclictest	575112	-21	kworker/1:0+events	22:15:21	1
521826	99	2787	13,2769	cyclictest	612807	-21	kworker/0:2+events	00:00:00	0
521828	99	2777	13,2760	cyclictest	573258	-21	kworker/1:1+events	21:50:14	1
521828	99	2736	13,2719	cyclictest	566930	-21	kworker/1:0+events	21:30:18	1
521833	99	2715	13,2698	cyclictest	528556	-21	kworker/2:2+events	19:40:19	2
521833	99	2697	12,2681	cyclictest	536606	-21	kworker/2:0+events	20:20:21	2
521828	99	2677	13,2661	cyclictest	533401	-21	kworker/1:1+events	20:10:27	1
521826	99	2615	12,2599	cyclictest	566663	-21	kworker/0:0+events	21:45:20	0
521836	99	2587	12,2571	cyclictest	609885	-21	kworker/3:0+events	00:00:22	3
521836	99	2574	12,2558	cyclictest	531802	-21	kworker/3:2+events	19:50:15	3
521836	99	2573	12,2558	cyclictest	621312	-21	kworker/3:1+events	00:20:14	3
521836	99	2572	12,2556	cyclictest	569833	-21	kworker/3:2+events	21:47:36	3
521836	99	2571	12,2555	cyclictest	571449	-21	kworker/3:0+events	21:42:43	3
521836	99	2568	12,2553	cyclictest	531802	-21	kworker/3:2+events	19:48:22	3
521826	99	2549	12,2533	cyclictest	542796	-21	kworker/0:2+events	20:17:38	0
521836	99	2543	12,2528	cyclictest	569833	-21	kworker/3:2+events	22:10:25	3
521826	99	2504	12,2488	cyclictest	617910	-21	kworker/0:2+events	00:14:07	0
521826	99	2502	12,2486	cyclictest	573138	-21	kworker/0:2+events	21:53:35	0
521826	99	2495	12,2479	cyclictest	571493	-21	kworker/0:1+events	21:44:34	0
521826	99	2494	12,2479	cyclictest	557289	-21	kworker/0:0+events	21:03:47	0
521826	99	2493	12,2478	cyclictest	546083	-21	kworker/0:2+events	20:28:41	0
521836	99	2491	12,2476	cyclictest	545961	-21	kworker/3:2+events	20:30:12	3
521836	99	2489	12,2473	cyclictest	547591	-21	kworker/3:1+events	20:39:46	3
521826	99	2489	12,2473	cyclictest	558971	-21	kworker/0:1+events	21:07:14	0
521826	99	2488	12,2473	cyclictest	539487	-21	kworker/0:1+events	20:24:08	0
521836	99	2486	11,2471	cyclictest	589135	-21	kworker/3:0+events	22:45:18	3
521826	99	2485	12,2470	cyclictest	582797	-21	kworker/0:0+events	22:20:42	0
521826	99	2485	11,2470	cyclictest	526577	-21	kworker/0:1+events	19:42:15	0
521826	99	2483	11,2469	cyclictest	526577	-21	kworker/0:1+events	19:29:34	0
521826	99	2483	11,2468	cyclictest	539487	-21	kworker/0:1+events	20:12:44	0
521836	99	2482	12,2466	cyclictest	574996	-21	kworker/3:0+events	21:56:35	3
521836	99	2482	11,2468	cyclictest	544335	-21	kworker/3:0+events	20:22:38	3
521833	99	2482	12,2467	cyclictest	534882	-21	kworker/2:2+events	19:58:16	2
521836	99	2481	12,2466	cyclictest	615048	-21	kworker/3:2+events	00:11:26	3
521836	99	2480	12,2464	cyclictest	565333	-21	kworker/3:1+events	21:32:32	3
521836	99	2480	12,2464	cyclictest	528312	-21	kworker/3:1+events	19:33:23	3
521836	99	2479	12,2463	cyclictest	597257	-21	kworker/3:2+events	23:16:57	3
521836	99	2479	11,2464	cyclictest	550861	-21	kworker/3:0+events	20:44:21	3
521836	99	2478	12,2463	cyclictest	539472	-21	kworker/3:2+events	20:05:27	3
521836	99	2477	10,2463	cyclictest	547591	-21	kworker/3:1+events	20:45:29	3
521836	99	2476	12,2460	cyclictest	558850	-21	kworker/3:0+events	21:03:02	3
521836	99	2475	12,2460	cyclictest	525105	-21	kworker/3:2+events	19:27:41	3
521836	99	2472	11,2458	cyclictest	593980	-21	kworker/3:0+events	23:34:36	3
521836	99	2471	11,2458	cyclictest	589135	-21	kworker/3:0+events	22:42:15	3
521828	99	2463	12,2449	cyclictest	551167	-21	kworker/1:2+events	20:45:06	1
521826	99	2461	12,2445	cyclictest	539487	-21	kworker/0:1+events	20:32:56	0
521828	99	2457	10,2443	cyclictest	533401	-21	kworker/1:1+events	19:48:00	1
521836	99	2455	10,2442	cyclictest	581309	-21	kworker/3:1+events	22:21:52	3
521828	99	2454	12,2439	cyclictest	555600	-21	kworker/1:2+events	20:52:45	1
521826	99	2453	10,2440	cyclictest	575025	-21	kworker/0:0+events	21:57:43	0
521833	99	2434	11,2419	cyclictest	576476	-21	kworker/2:0+events	22:20:19	2
521836	99	2426	10,2413	cyclictest	593980	-21	kworker/3:0+events	23:07:55	3
521833	99	2421	12,2406	cyclictest	544839	-21	kworker/2:2+events	20:26:24	2
521826	99	2409	10,2396	cyclictest	616297	-21	kworker/0:0+events	00:04:10	0
521833	99	2404	12,2388	cyclictest	547443	-21	kworker/2:1+events	20:58:06	2
521828	99	2403	12,2387	cyclictest	614682	-21	kworker/1:2+events	00:03:47	1
521828	99	2403	11,2388	cyclictest	617960	-21	kworker/1:0+events	00:08:49	1
521828	99	2403	10,2389	cyclictest	598531	-21	kworker/1:1+events	23:09:47	1
521828	99	2402	12,2386	cyclictest	608647	-21	kworker/1:2+events	23:42:56	1
521828	99	2401	12,2385	cyclictest	528239	-21	kworker/1:1+events	19:28:03	1
521828	99	2400	11,2386	cyclictest	547712	-21	kworker/1:0+events	20:37:51	1
521828	99	2399	12,2383	cyclictest	537944	-21	kworker/1:2+events	20:06:36	1
521828	99	2398	11,2385	cyclictest	560362	-21	kworker/1:2+events	21:10:16	1
521828	99	2396	12,2381	cyclictest	584485	-21	kworker/1:1+events	22:44:54	1
521828	99	2396	12,2380	cyclictest	547712	-21	kworker/1:0+events	20:41:20	1
521836	99	2395	12,2379	cyclictest	557168	-21	kworker/3:1+events	21:06:52	3
521833	99	2395	11,2380	cyclictest	601943	-21	kworker/2:1+events	23:36:07	2
521828	99	2394	9,2382	cyclictest	524626	-21	kworker/1:2+events	19:16:22	1
521828	99	2394	12,2378	cyclictest	575112	-21	kworker/1:0+events	22:03:51	1
521833	99	2389	11,2376	cyclictest	547443	-21	kworker/2:1+events	21:11:02	2
521833	99	2386	12,2370	cyclictest	570200	-21	kworker/2:2+events	22:00:27	2
521828	99	2385	11,2370	cyclictest	581190	-21	kworker/1:1+events	22:12:40	1
521828	99	2375	12,2360	cyclictest	592533	-21	kworker/1:2+events	22:59:08	1
521826	99	2368	10,2355	cyclictest	568278	-21	kworker/0:1+events	21:34:47	0
521836	99	2355	11,2340	cyclictest	545961	-21	kworker/3:2+events	20:28:18	3
521833	99	2355	7,2345	cyclictest	623186	-21	kworker/2:3+events	00:34:21	2
521826	99	2355	12,2340	cyclictest	547981	-21	kworker/0:0+events	20:46:16	0
521828	99	2348	12,2332	cyclictest	575112	-21	kworker/1:0+events	21:55:49	1
521826	99	2348	10,2335	cyclictest	547981	-21	kworker/0:0+events	20:36:21	0
521836	99	2337	10,2323	cyclictest	563655	-21	kworker/3:2+events	21:22:42	3
521833	99	2335	14,2318	cyclictest	601943	-21	kworker/2:1+events	23:45:32	2
521826	99	2334	12,2319	cyclictest	531700	-21	kworker/0:2+events	19:54:53	0
521836	99	2332	11,2318	cyclictest	544335	-21	kworker/3:0+events	20:18:48	3
521826	99	2331	11,2317	cyclictest	617910	-21	kworker/0:2+events	00:35:52	0
521833	99	2330	12,2313	cyclictest	525139	-21	kworker/2:1+events	19:47:37	2
521833	99	2328	11,2311	cyclictest	557780	-21	kworker/2:0+events	21:01:55	2
521836	99	2325	12,2310	cyclictest	615048	-21	kworker/3:2+events	00:05:43	3
521833	99	2323	12,2308	cyclictest	565063	-21	kworker/2:2+events	21:21:33	2
521833	99	2320	12,2305	cyclictest	609683	-21	kworker/2:0+events	23:52:26	2
521826	99	2320	11,2305	cyclictest	600157	-21	kworker/0:1+events	23:34:13	0
521833	99	2317	12,2302	cyclictest	528556	-21	kworker/2:2+events	19:33:01	2
521833	99	2317	11,2303	cyclictest	547443	-21	kworker/2:1+events	20:54:40	2
521833	99	2316	11,2301	cyclictest	595811	-21	kworker/2:2+events	23:01:47	2
521833	99	2316	11,2301	cyclictest	549108	-21	kworker/2:0+events	20:34:24	2
521833	99	2314	12,2299	cyclictest	557780	-21	kworker/2:0+events	21:05:19	2
521833	99	2311	12,2296	cyclictest	576476	-21	kworker/2:0+events	22:26:02	2
521833	99	2311	12,2295	cyclictest	614890	-21	kworker/2:1+events	00:19:29	2
521833	99	2309	12,2294	cyclictest	576476	-21	kworker/2:0+events	22:07:42	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00