OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Mon May 04, 2026 00:44:16)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1859008	99	4360	21,4334	cyclictest	1945491	-21	kworker/0:1+events	23:40:19	0
1859012	99	3212	16,3192	cyclictest	1915543	-21	kworker/1:2+events	22:20:17	1
1859012	99	3170	15,3150	cyclictest	1922849	-21	kworker/1:1+events	22:30:13	1
1859008	99	3126	15,3105	cyclictest	1873517	-21	kworker/0:1+events	20:00:17	0
1859008	99	3031	13,3014	cyclictest	1932643	-21	kworker/0:1+events	23:10:38	0
1859008	99	2962	12,2945	cyclictest	1950319	-21	kworker/0:0+events	23:55:12	0
1859018	99	2845	11,2830	cyclictest	1892588	-21	kworker/3:1+events	21:05:17	3
1859012	99	2804	13,2788	cyclictest	1897411	-21	kworker/1:1+events	21:15:35	1
1859012	99	2804	13,2787	cyclictest	1876415	-21	kworker/1:0+events	20:01:28	1
1859014	99	2800	10,2786	cyclictest	1924839	-21	kworker/2:2+events	22:45:48	2
1859014	99	2799	12,2783	cyclictest	1879701	-21	kworker/2:0+events	20:20:47	2
1859008	99	2797	16,2778	cyclictest	1862172	-21	kworker/0:2+events	19:25:18	0
1859014	99	2775	2,2769	cyclictest	1960367	-21	kworker/2:2+events	00:25:14	2
1859014	99	2775	13,2758	cyclictest	1868565	-21	kworker/2:2+events	19:42:25	2
1859014	99	2762	13,2744	cyclictest	1879701	-21	kworker/2:0+events	20:30:18	2
1859012	99	2759	13,2742	cyclictest	1892302	-21	kworker/1:0+events	20:53:07	1
1859012	99	2748	10,2734	cyclictest	1940882	-21	kworker/1:1+events	23:26:13	1
1859018	99	2736	13,2718	cyclictest	1916583	-21	kworker/3:1+events	22:10:18	3
1859008	99	2734	13,2716	cyclictest	1898862	-21	kworker/0:2+events	21:15:11	0
1859014	99	2722	13,2705	cyclictest	1910540	-21	kworker/2:0+events	21:56:55	2
1859008	99	2710	13,2693	cyclictest	1898862	-21	kworker/0:2+events	21:12:06	0
1859018	99	2660	13,2644	cyclictest	1870252	-21	kworker/3:1+events	19:58:23	3
1859018	99	2652	13,2636	cyclictest	1887612	-21	kworker/3:0+events	21:01:31	3
1859014	99	2629	11,2614	cyclictest	1907333	-21	kworker/2:1+events	21:53:09	2
1859018	99	2623	13,2607	cyclictest	1879668	-21	kworker/3:2+events	20:15:47	3
1859014	99	2620	13,2603	cyclictest	1878100	-21	kworker/2:2+events	20:08:12	2
1859014	99	2619	13,2602	cyclictest	1955404	-21	kworker/2:1+events	00:20:18	2
1859018	99	2614	13,2597	cyclictest	1887612	-21	kworker/3:0+events	20:38:31	3
1859014	99	2612	12,2596	cyclictest	1945307	-21	kworker/2:1+events	23:41:52	2
1859014	99	2575	12,2560	cyclictest	1876445	-21	kworker/2:1+events	20:04:51	2
1859014	99	2575	12,2559	cyclictest	1934276	-21	kworker/2:2+events	23:13:39	2
1859014	99	2571	12,2555	cyclictest	1868565	-21	kworker/2:2+events	19:59:08	2
1859014	99	2567	12,2551	cyclictest	1896017	-21	kworker/2:2+events	21:14:00	2
1859014	99	2565	12,2550	cyclictest	1907333	-21	kworker/2:1+events	21:40:53	2
1859014	99	2563	12,2547	cyclictest	1879701	-21	kworker/2:0+events	20:27:38	2
1859014	99	2562	12,2546	cyclictest	1876445	-21	kworker/2:1+events	20:11:37	2
1859014	99	2561	9,2549	cyclictest	1879701	-21	kworker/2:0+events	20:41:11	2
1859014	99	2561	10,2548	cyclictest	1862768	-21	kworker/2:0+events	19:30:57	2
1859014	99	2560	12,2544	cyclictest	1890850	-21	kworker/2:1+events	20:53:51	2
1859012	99	2559	12,2543	cyclictest	1897411	-21	kworker/1:1+events	21:31:14	1
1859012	99	2556	12,2540	cyclictest	1908718	-21	kworker/1:0+events	21:49:43	1
1859018	99	2554	11,2539	cyclictest	1921516	-21	kworker/3:0+events	22:25:11	3
1859012	99	2554	12,2539	cyclictest	1897411	-21	kworker/1:1+events	21:29:43	1
1859012	99	2553	12,2537	cyclictest	1951888	-21	kworker/1:1+events	00:12:20	1
1859012	99	2552	11,2537	cyclictest	1878068	-21	kworker/1:1+events	20:26:06	1
1859014	99	2550	12,2534	cyclictest	1907333	-21	kworker/2:1+events	21:48:34	2
1859012	99	2550	9,2537	cyclictest	1868627	-21	kworker/1:1+events	19:42:01	1
1859012	99	2549	12,2533	cyclictest	1879762	-21	kworker/1:2+events	20:17:21	1
1859012	99	2548	12,2532	cyclictest	1902098	-21	kworker/1:2+events	21:24:21	1
1859012	99	2548	12,2532	cyclictest	1870343	-21	kworker/1:0+events	19:53:54	1
1859012	99	2548	12,2532	cyclictest	1864140	-21	kworker/1:2+events	19:30:34	1
1859012	99	2548	10,2535	cyclictest	1934244	-21	kworker/1:2+events	23:09:07	1
1859012	99	2546	12,2531	cyclictest	1935901	-21	kworker/1:0+events	23:19:20	1
1859012	99	2544	12,2529	cyclictest	1951888	-21	kworker/1:1+events	00:19:31	1
1859012	99	2537	12,2521	cyclictest	1872006	-21	kworker/1:1+events	19:56:32	1
1859014	99	2536	12,2520	cyclictest	1924839	-21	kworker/2:2+events	22:34:19	2
1859012	99	2536	12,2520	cyclictest	1884355	-21	kworker/1:2+events	20:43:52	1
1859012	99	2529	12,2514	cyclictest	1940882	-21	kworker/1:1+events	23:45:40	1
1859014	99	2528	10,2515	cyclictest	1865353	-21	kworker/2:1+events	19:35:12	2
1859012	99	2528	12,2514	cyclictest	1943972	-21	kworker/1:0+events	23:35:01	1
1859014	99	2527	7,2517	cyclictest	1896017	-21	kworker/2:2+events	21:29:19	2
1859014	99	2527	12,2512	cyclictest	1941697	-21	kworker/2:0+events	23:38:04	2
1859012	99	2522	12,2507	cyclictest	1908718	-21	kworker/1:0+events	22:05:17	1
1859018	99	2521	11,2506	cyclictest	1944137	-21	kworker/3:0+events	23:37:40	3
1859012	99	2521	12,2507	cyclictest	1939228	-21	kworker/1:2+events	23:30:05	1
1859012	99	2519	12,2503	cyclictest	1895812	-21	kworker/1:2+events	21:06:03	1
1859014	99	2518	12,2503	cyclictest	1865353	-21	kworker/2:1+events	19:27:31	2
1859014	99	2511	12,2495	cyclictest	1915064	-21	kworker/2:1+events	22:06:51	2
1859012	99	2511	12,2495	cyclictest	1878068	-21	kworker/1:1+events	20:07:26	1
1859014	99	2510	11,2495	cyclictest	1892497	-21	kworker/2:2+events	20:55:46	2
1859012	99	2508	12,2493	cyclictest	1915543	-21	kworker/1:2+events	22:29:03	1
1859008	99	2505	9,2492	cyclictest	1888695	-21	kworker/0:0+events	20:41:58	0
1859008	99	2505	12,2489	cyclictest	1913470	-21	kworker/0:0+events	22:02:58	0
1859018	99	2503	12,2485	cyclictest	1900596	-21	kworker/3:2+events	21:23:12	3
1859014	99	2501	12,2486	cyclictest	1919896	-21	kworker/2:1+events	22:19:31	2
1859014	99	2500	11,2486	cyclictest	1924839	-21	kworker/2:2+events	22:35:52	2
1859014	99	2499	0,2495	cyclictest	1950167	-21	kworker/2:1+events	23:57:29	2
1859012	99	2496	12,2480	cyclictest	1935901	-21	kworker/1:0+events	23:24:21	1
1859012	99	2496	12,2480	cyclictest	1908718	-21	kworker/1:0+events	21:52:24	1
1859012	99	2496	12,2480	cyclictest	1886137	-21	kworker/1:0+events	20:38:09	1
1859018	99	2495	11,2480	cyclictest	1892588	-21	kworker/3:1+events	21:13:14	3
1859012	99	2495	12,2479	cyclictest	1950135	-21	kworker/1:2+events	23:53:19	1
1859012	99	2494	12,2479	cyclictest	1945603	-21	kworker/1:2+events	23:41:28	1
1859012	99	2494	12,2478	cyclictest	1881429	-21	kworker/1:0+events	20:23:06	1
1859014	99	2492	12,2477	cyclictest	1941697	-21	kworker/2:0+events	23:29:43	2
1859012	99	2492	12,2478	cyclictest	1915543	-21	kworker/1:2+events	22:11:04	1
1859012	99	2492	12,2476	cyclictest	1924716	-21	kworker/1:0+events	22:55:23	1
1859012	99	2492	10,2478	cyclictest	1928066	-21	kworker/1:1+events	22:43:29	1
1859012	99	2491	12,2476	cyclictest	1960676	-21	kworker/1:0+events	00:32:30	1
1859012	99	2491	12,2476	cyclictest	1928066	-21	kworker/1:1+events	22:47:19	1
1859012	99	2491	12,2476	cyclictest	1908718	-21	kworker/1:0+events	22:01:28	1
1859012	99	2491	12,2475	cyclictest	1884355	-21	kworker/1:2+events	20:33:40	1
1859008	99	2491	10,2477	cyclictest	1884624	-21	kworker/0:1+events	20:32:34	0
1859012	99	2490	9,2477	cyclictest	1897411	-21	kworker/1:1+events	21:35:29	1
1859012	99	2490	12,2474	cyclictest	1935901	-21	kworker/1:0+events	23:12:30	1
1859018	99	2489	12,2474	cyclictest	1877004	-21	kworker/3:0+events	20:11:59	3
1859012	99	2489	12,2474	cyclictest	1879762	-21	kworker/1:2+events	20:14:18	1
1859014	99	2488	12,2473	cyclictest	1853505	-21	kworker/2:2+events	19:16:47	2
1859012	99	2488	12,2474	cyclictest	1924716	-21	kworker/1:0+events	22:37:48	1
1859008	99	2488	12,2472	cyclictest	1890724	-21	kworker/0:1+events	20:47:21	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00