OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu May 14, 2026 00:44:17)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
2410544	99	3574	9,3560	cyclictest	2453982	-21	kworker/3:1+events	21:40:17	3
2410541	99	2843	13,2827	cyclictest	2504708	-21	kworker/2:1+events	00:05:12	2
2410534	99	2840	13,2825	cyclictest	2425319	-21	kworker/0:0+events	20:00:17	0
2410539	99	2812	12,2795	cyclictest	2488280	-21	kworker/1:2+events	23:15:13	1
2410541	99	2809	13,2791	cyclictest	2459154	-21	kworker/2:3+events	21:45:17	2
2410534	99	2805	12,2789	cyclictest	2421864	-21	kworker/0:0+events	19:45:19	0
2410534	99	2794	12,2779	cyclictest	2498231	-21	kworker/0:1+events	23:40:18	0
2410541	99	2760	12,2745	cyclictest	2476657	-21	kworker/2:0+events	23:05:01	2
2410541	99	2742	13,2725	cyclictest	2494940	-21	kworker/2:2+events	23:55:36	2
2410539	99	2732	13,2716	cyclictest	2507828	-21	kworker/1:0+events	00:25:17	1
2410539	99	2686	13,2669	cyclictest	2452399	-21	kworker/1:2+events	21:20:17	1
2410539	99	2619	13,2603	cyclictest	2498081	-21	kworker/1:1+events	23:45:17	1
2410539	99	2566	12,2550	cyclictest	2480061	-21	kworker/1:0+events	22:45:18	1
2410541	99	2542	12,2527	cyclictest	2413959	-21	kworker/2:0+events	19:25:16	2
2410534	99	2541	12,2526	cyclictest	2454012	-21	kworker/0:0+events	21:25:13	0
2410541	99	2532	7,2521	cyclictest	2418403	-21	kworker/2:1+events	19:40:43	2
2410539	99	2532	12,2516	cyclictest	2488280	-21	kworker/1:2+events	23:36:12	1
2410541	99	2531	12,2516	cyclictest	2424842	-21	kworker/2:0+events	20:09:44	2
2410539	99	2527	11,2513	cyclictest	2480061	-21	kworker/1:0+events	22:50:13	1
2410539	99	2527	10,2514	cyclictest	2507828	-21	kworker/1:0+events	00:21:50	1
2410539	99	2527	10,2514	cyclictest	2507828	-21	kworker/1:0+events	00:21:49	1
2410541	99	2525	11,2510	cyclictest	2465469	-21	kworker/2:1+events	22:02:00	2
2410539	99	2516	12,2500	cyclictest	2493399	-21	kworker/1:1+events	23:27:02	1
2410541	99	2515	11,2500	cyclictest	2501506	-21	kworker/2:1+events	23:49:30	2
2410541	99	2508	12,2492	cyclictest	2493276	-21	kworker/2:1+events	23:26:18	2
2410541	99	2498	12,2482	cyclictest	2437907	-21	kworker/2:0+events	20:36:03	2
2410539	99	2496	12,2478	cyclictest	2509699	-21	kworker/1:2+events	00:16:57	1
2410539	99	2495	12,2479	cyclictest	2457211	-21	kworker/1:0+events	21:51:00	1
2410539	99	2494	12,2478	cyclictest	2458866	-21	kworker/1:1+events	21:44:07	1
2410539	99	2490	11,2475	cyclictest	2488280	-21	kworker/1:2+events	23:40:42	1
2410539	99	2489	12,2473	cyclictest	2473604	-21	kworker/1:1+events	22:27:50	1
2410541	99	2488	11,2473	cyclictest	2471964	-21	kworker/2:1+events	22:22:33	2
2410539	99	2488	11,2474	cyclictest	2436212	-21	kworker/1:1+events	20:28:26	1
2410541	99	2487	11,2474	cyclictest	2471964	-21	kworker/2:1+events	22:25:12	2
2410539	99	2487	12,2472	cyclictest	2473604	-21	kworker/1:1+events	22:42:13	1
2410539	99	2487	12,2472	cyclictest	2452399	-21	kworker/1:2+events	21:25:57	1
2410539	99	2485	12,2471	cyclictest	2441202	-21	kworker/1:3+events	20:56:00	1
2410539	99	2483	12,2467	cyclictest	2450498	-21	kworker/1:0+events	21:14:06	1
2410539	99	2482	11,2468	cyclictest	2484191	-21	kworker/1:1+events	23:08:49	1
2410534	99	2482	12,2467	cyclictest	2493037	-21	kworker/0:2+events	23:21:40	0
2410539	99	2479	11,2464	cyclictest	2418674	-21	kworker/1:0+events	19:59:54	1
2410539	99	2476	12,2460	cyclictest	2418674	-21	kworker/1:0+events	19:51:09	1
2410539	99	2473	11,2459	cyclictest	2458866	-21	kworker/1:1+events	22:15:42	1
2410539	99	2470	11,2456	cyclictest	2441202	-21	kworker/1:3+events	21:00:56	1
2410534	99	2470	12,2454	cyclictest	2514262	-21	kworker/0:2+events	00:32:14	0
2410539	99	2467	12,2452	cyclictest	2457211	-21	kworker/1:0+events	21:33:32	1
2410544	99	2466	13,2449	cyclictest	2458777	-21	kworker/3:0+events	21:50:12	3
2410541	99	2459	11,2443	cyclictest	2436242	-21	kworker/2:2+events	20:28:50	2
2410539	99	2457	10,2443	cyclictest	2488280	-21	kworker/1:2+events	23:10:20	1
2410541	99	2453	12,2437	cyclictest	2441730	-21	kworker/2:2+events	20:55:15	2
2410541	99	2449	12,2433	cyclictest	2424842	-21	kworker/2:0+events	20:13:32	2
2410534	99	2448	11,2434	cyclictest	2501716	-21	kworker/0:1+events	00:07:48	0
2410541	99	2447	12,2431	cyclictest	2467094	-21	kworker/2:2+events	22:14:09	2
2410541	99	2446	11,2432	cyclictest	2494940	-21	kworker/2:2+events	23:31:14	2
2410541	99	2444	12,2430	cyclictest	2508150	-21	kworker/2:2+events	00:15:04	2
2410541	99	2443	12,2427	cyclictest	2491390	-21	kworker/2:0+events	23:19:23	2
2410541	99	2443	12,2427	cyclictest	2447124	-21	kworker/2:0+events	21:02:02	2
2410541	99	2441	12,2426	cyclictest	2476657	-21	kworker/2:0+events	22:51:41	2
2410541	99	2441	11,2426	cyclictest	2455792	-21	kworker/2:2+events	21:36:52	2
2410534	99	2438	12,2422	cyclictest	2465715	-21	kworker/0:1+events	22:11:51	0
2410541	99	2437	10,2423	cyclictest	2424842	-21	kworker/2:0+events	20:15:52	2
2410534	99	2433	12,2417	cyclictest	2478345	-21	kworker/0:2+events	22:38:04	0
2410539	99	2430	12,2414	cyclictest	2468537	-21	kworker/1:2+events	22:24:04	1
2410541	99	2428	11,2413	cyclictest	2503106	-21	kworker/2:0+events	00:00:57	2
2410541	99	2427	12,2411	cyclictest	2511417	-21	kworker/2:3+events	00:27:37	2
2410541	99	2427	11,2413	cyclictest	2452209	-21	kworker/2:0+events	21:28:39	2
2410534	99	2422	12,2407	cyclictest	2481572	-21	kworker/0:0+events	23:12:12	0
2410534	99	2417	12,2402	cyclictest	2457302	-21	kworker/0:0+events	21:46:47	0
2410541	99	2415	11,2400	cyclictest	2478315	-21	kworker/2:1+events	22:41:28	2
2410534	99	2415	12,2400	cyclictest	2465715	-21	kworker/0:1+events	22:02:24	0
2410541	99	2414	11,2400	cyclictest	2432630	-21	kworker/2:1+events	20:24:59	2
2410541	99	2413	12,2398	cyclictest	2511417	-21	kworker/2:3+events	00:23:47	2
2410541	99	2413	12,2398	cyclictest	2511417	-21	kworker/2:3+events	00:23:46	2
2410534	99	2413	10,2400	cyclictest	2455635	-21	kworker/0:1+events	21:30:52	0
2410534	99	2410	12,2394	cyclictest	2481572	-21	kworker/0:0+events	23:18:37	0
2410541	99	2406	10,2392	cyclictest	2486853	-21	kworker/2:3+events	23:12:32	2
2410534	99	2406	12,2391	cyclictest	2478345	-21	kworker/0:2+events	22:56:38	0
2410534	99	2406	11,2392	cyclictest	2481572	-21	kworker/0:0+events	23:47:34	0
2410534	99	2405	12,2390	cyclictest	2427916	-21	kworker/0:1+events	20:34:55	0
2410534	99	2404	12,2390	cyclictest	2501716	-21	kworker/0:1+events	00:10:03	0
2410534	99	2404	12,2389	cyclictest	2470139	-21	kworker/0:0+events	22:21:27	0
2410541	99	2403	12,2387	cyclictest	2486853	-21	kworker/2:3+events	23:08:03	2
2410534	99	2403	12,2388	cyclictest	2481572	-21	kworker/0:0+events	23:32:45	0
2410534	99	2403	10,2389	cyclictest	2427916	-21	kworker/0:1+events	20:46:12	0
2410534	99	2402	12,2386	cyclictest	2432785	-21	kworker/0:0+events	20:18:34	0
2410534	99	2402	11,2387	cyclictest	2501716	-21	kworker/0:1+events	00:16:34	0
2410544	99	2398	12,2383	cyclictest	2471904	-21	kworker/3:2+events	22:23:43	3
2410534	99	2397	13,2381	cyclictest	2464042	-21	kworker/0:0+events	21:58:13	0
2410534	99	2397	12,2382	cyclictest	2503318	-21	kworker/0:2+events	23:59:48	0
2410534	99	2386	12,2370	cyclictest	2481572	-21	kworker/0:0+events	23:38:05	0
2410544	99	2385	12,2369	cyclictest	2476628	-21	kworker/3:2+events	22:41:06	3
2410539	99	2381	10,2367	cyclictest	2495151	-21	kworker/1:0+events	23:32:22	1
2410534	99	2380	12,2365	cyclictest	2412151	-21	kworker/0:3+events	19:27:11	0
2410534	99	2373	10,2360	cyclictest	2458897	-21	kworker/0:1+events	21:39:54	0
2410534	99	2370	12,2355	cyclictest	2447384	-21	kworker/0:0+events	21:10:45	0
2410544	99	2364	12,2349	cyclictest	2447526	-21	kworker/3:2+events	21:12:16	3
2410539	99	2364	12,2348	cyclictest	2514778	-21	kworker/1:2+events	00:35:42	1
2410541	99	2357	12,2342	cyclictest	2515765	-21	kworker/2:1+events	00:34:10	2
2410539	99	2356	11,2342	cyclictest	2420601	-21	kworker/1:2+events	19:44:55	1
2410544	99	2351	12,2336	cyclictest	2440947	-21	kworker/3:2+events	20:51:46	3
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00