OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Apr 23, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
860830	99	3289	12,3269	cyclictest	940705	-21	kworker/1:0+events	00:00:17	1
860836	99	2873	14,2856	cyclictest	891505	-21	kworker/3:1+events	20:55:12	3
860832	99	2825	13,2808	cyclictest	924607	-21	kworker/2:1+events	23:00:19	2
860832	99	2824	11,2808	cyclictest	918086	-21	kworker/2:1+events	22:20:15	2
860836	99	2785	13,2768	cyclictest	935878	-21	kworker/3:1+events	23:10:00	3
860836	99	2726	11,2711	cyclictest	901575	-21	kworker/3:1+events	21:16:35	3
860832	99	2718	11,2703	cyclictest	918086	-21	kworker/2:1+events	22:18:22	2
860830	99	2709	13,2692	cyclictest	911678	-21	kworker/1:2+events	21:52:46	1
860836	99	2666	13,2649	cyclictest	869261	-21	kworker/3:1+events	20:05:00	3
860832	99	2643	13,2626	cyclictest	889021	-21	kworker/2:2+events	20:50:15	2
860826	99	2639	13,2622	cyclictest	926093	-21	kworker/0:2+events	22:55:18	0
860836	99	2637	13,2620	cyclictest	954901	-21	kworker/3:2+events	00:20:16	3
860832	99	2628	11,2613	cyclictest	879951	-21	kworker/2:0+events	20:20:17	2
860830	99	2587	10,2574	cyclictest	921410	-21	kworker/1:0+events	22:30:11	1
860832	99	2571	11,2557	cyclictest	955020	-21	kworker/2:2+events	00:05:36	2
860832	99	2566	9,2553	cyclictest	895892	-21	kworker/2:1+events	21:00:48	2
860826	99	2550	12,2535	cyclictest	916747	-21	kworker/0:2+events	22:05:25	0
860836	99	2539	10,2525	cyclictest	876978	-21	kworker/3:0+events	20:15:18	3
860830	99	2531	12,2515	cyclictest	900668	-21	kworker/1:1+events	21:25:19	1
860832	99	2512	12,2496	cyclictest	889021	-21	kworker/2:2+events	20:38:51	2
860830	99	2511	12,2496	cyclictest	900668	-21	kworker/1:1+events	21:35:15	1
860830	99	2509	12,2492	cyclictest	951746	-21	kworker/1:1+events	23:55:17	1
860832	99	2505	11,2490	cyclictest	889021	-21	kworker/2:2+events	20:48:20	2
860832	99	2498	12,2482	cyclictest	883101	-21	kworker/2:1+events	20:34:40	2
860832	99	2493	12,2478	cyclictest	878232	-21	kworker/2:2+events	20:08:25	2
860836	99	2492	12,2476	cyclictest	946908	-21	kworker/3:1+events	00:00:39	3
860832	99	2492	12,2477	cyclictest	865900	-21	kworker/2:3+events	19:51:16	2
860832	99	2492	12,2477	cyclictest	865900	-21	kworker/2:3+events	19:38:22	2
860830	99	2489	12,2473	cyclictest	889639	-21	kworker/1:1+events	20:53:41	1
860832	99	2488	11,2474	cyclictest	876604	-21	kworker/2:0+events	19:58:56	2
860826	99	2488	12,2473	cyclictest	947057	-21	kworker/0:0+events	23:53:01	0
860832	99	2485	12,2469	cyclictest	961179	-21	kworker/2:0+events	00:26:47	2
860836	99	2484	12,2468	cyclictest	921225	-21	kworker/3:1+events	22:27:30	3
860830	99	2483	12,2467	cyclictest	916777	-21	kworker/1:0+events	22:06:12	1
860832	99	2482	11,2467	cyclictest	868871	-21	kworker/2:0+events	19:42:55	2
860832	99	2481	10,2468	cyclictest	964358	-21	kworker/2:1+events	00:32:12	2
860832	99	2479	12,2464	cyclictest	908671	-21	kworker/2:2+events	21:42:06	2
860832	99	2479	12,2464	cyclictest	900757	-21	kworker/2:2+events	21:16:14	2
860832	99	2478	12,2463	cyclictest	930983	-21	kworker/2:2+events	22:48:27	2
860832	99	2474	12,2459	cyclictest	899172	-21	kworker/2:0+events	21:13:15	2
860830	99	2463	12,2447	cyclictest	937427	-21	kworker/1:1+events	23:08:52	1
860836	99	2457	12,2440	cyclictest	945196	-21	kworker/3:2+events	23:35:00	3
860830	99	2443	9,2430	cyclictest	934156	-21	kworker/1:2+events	23:10:24	1
860830	99	2443	12,2427	cyclictest	962905	-21	kworker/1:0+events	00:28:44	1
860836	99	2439	12,2425	cyclictest	924577	-21	kworker/3:2+events	22:30:33	3
860832	99	2437	4,2429	cyclictest	961179	-21	kworker/2:0+events	00:35:18	2
860830	99	2433	12,2418	cyclictest	886203	-21	kworker/1:2+events	20:40:20	1
860836	99	2426	10,2412	cyclictest	867390	-21	kworker/3:0+events	19:35:17	3
860836	99	2416	11,2402	cyclictest	954901	-21	kworker/3:2+events	00:09:07	3
860830	99	2409	12,2393	cyclictest	940705	-21	kworker/1:0+events	23:28:31	1
860830	99	2408	10,2394	cyclictest	959696	-21	kworker/1:2+events	00:30:14	1
860836	99	2406	12,2391	cyclictest	897710	-21	kworker/3:2+events	21:28:24	3
860836	99	2404	12,2389	cyclictest	876978	-21	kworker/3:0+events	20:06:09	3
860826	99	2404	12,2388	cyclictest	888128	-21	kworker/0:2+events	20:34:17	0
860830	99	2403	12,2388	cyclictest	934156	-21	kworker/1:2+events	23:15:48	1
860830	99	2403	12,2388	cyclictest	870565	-21	kworker/1:2+events	19:52:01	1
860836	99	2402	10,2389	cyclictest	869261	-21	kworker/3:1+events	20:12:12	3
860830	99	2402	12,2387	cyclictest	951746	-21	kworker/1:1+events	00:22:37	1
860830	99	2402	11,2389	cyclictest	889639	-21	kworker/1:1+events	21:00:06	1
860836	99	2401	12,2385	cyclictest	958112	-21	kworker/3:1+events	00:17:10	3
860830	99	2401	12,2385	cyclictest	962905	-21	kworker/1:0+events	00:37:10	1
860836	99	2400	11,2385	cyclictest	907038	-21	kworker/3:0+events	21:33:23	3
860830	99	2400	10,2388	cyclictest	876786	-21	kworker/1:0+events	20:00:04	1
860836	99	2399	12,2384	cyclictest	953167	-21	kworker/3:0+events	23:58:45	3
860830	99	2399	9,2386	cyclictest	921410	-21	kworker/1:0+events	22:24:29	1
860830	99	2399	11,2386	cyclictest	940705	-21	kworker/1:0+events	23:35:45	1
860830	99	2399	11,2385	cyclictest	940705	-21	kworker/1:0+events	23:54:54	1
860836	99	2398	11,2384	cyclictest	911944	-21	kworker/3:0+events	21:53:34	3
860830	99	2398	12,2383	cyclictest	870565	-21	kworker/1:2+events	19:42:10	1
860830	99	2398	12,2382	cyclictest	899012	-21	kworker/1:2+events	21:09:50	1
860830	99	2398	11,2384	cyclictest	942336	-21	kworker/1:1+events	23:34:13	1
860836	99	2397	12,2383	cyclictest	871833	-21	kworker/3:2+events	19:45:13	3
860836	99	2397	12,2381	cyclictest	939152	-21	kworker/3:0+events	23:16:58	3
860836	99	2396	11,2382	cyclictest	886082	-21	kworker/3:0+events	20:28:36	3
860836	99	2396	10,2383	cyclictest	961358	-21	kworker/3:1+events	00:36:27	3
860836	99	2396	10,2382	cyclictest	918024	-21	kworker/3:2+events	22:21:25	3
860836	99	2390	12,2375	cyclictest	937519	-21	kworker/3:2+events	23:13:05	3
860836	99	2389	12,2373	cyclictest	928079	-21	kworker/3:1+events	22:45:00	3
860836	99	2388	12,2372	cyclictest	915256	-21	kworker/3:0+events	22:02:44	3
860836	99	2378	12,2362	cyclictest	954901	-21	kworker/3:2+events	00:11:00	3
860836	99	2377	12,2361	cyclictest	928079	-21	kworker/3:1+events	22:53:23	3
860832	99	2374	11,2360	cyclictest	942275	-21	kworker/2:1+events	23:57:59	2
860826	99	2360	12,2345	cyclictest	945392	-21	kworker/0:1+events	23:37:41	0
860832	99	2357	11,2342	cyclictest	924607	-21	kworker/2:1+events	22:38:13	2
860830	99	2352	11,2338	cyclictest	881403	-21	kworker/1:0+events	20:31:37	1
860836	99	2349	12,2334	cyclictest	897710	-21	kworker/3:2+events	21:06:28	3
860826	99	2348	12,2333	cyclictest	899279	-21	kworker/0:2+events	21:12:28	0
860826	99	2347	12,2332	cyclictest	886172	-21	kworker/0:0+events	20:57:33	0
860826	99	2346	12,2331	cyclictest	956411	-21	kworker/0:2+events	00:09:30	0
860826	99	2345	11,2330	cyclictest	884575	-21	kworker/0:1+events	20:27:04	0
860830	99	2344	14,2328	cyclictest	855681	-21	kworker/1:2+events	19:30:46	1
860826	99	2340	12,2325	cyclictest	886172	-21	kworker/0:0+events	20:44:53	0
860826	99	2339	10,2326	cyclictest	903860	-21	kworker/0:2+events	21:23:02	0
860826	99	2336	11,2323	cyclictest	924455	-21	kworker/0:0+events	22:40:07	0
860826	99	2336	11,2321	cyclictest	922855	-21	kworker/0:1+events	22:25:13	0
860826	99	2335	10,2322	cyclictest	926093	-21	kworker/0:2+events	22:47:40	0
860830	99	2329	11,2314	cyclictest	870565	-21	kworker/1:2+events	19:46:01	1
860826	99	2329	12,2315	cyclictest	947057	-21	kworker/0:0+events	23:55:41	0
860836	99	2327	12,2312	cyclictest	869261	-21	kworker/3:1+events	20:23:42	3
860830	99	2325	12,2310	cyclictest	951746	-21	kworker/1:1+events	00:06:23	1
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00