OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails

Click here to display the system's profile data.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rackfslot7s.osadl.org (updated Thu Aug 27, 2026 00:44:21)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1855318	99	4417	18,4396	cyclictest	1893628	-21	kworker/2:2+events	21:10:17	2
1855318	99	3492	17,3461	cyclictest	1927912	-21	kworker/2:0+events	23:05:22	2
1855309	99	3328	16,3308	cyclictest	1890557	-21	kworker/0:1+events	21:05:22	0
1855318	99	3159	15,3139	cyclictest	1955938	-21	kworker/2:1+events	00:25:18	2
1855314	99	3093	15,3074	cyclictest	1897843	-21	kworker/1:0+events	21:32:17	1
1855314	99	3045	15,3025	cyclictest	1836661	-21	kworker/1:2+events	19:25:21	1
1855318	99	2974	14,2957	cyclictest	1947529	-21	kworker/2:1+events	00:05:01	2
1855318	99	2974	14,2957	cyclictest	1947529	-21	kworker/2:1+events	00:05:01	2
1855309	99	2932	12,2914	cyclictest	1933013	-21	kworker/0:2+events	23:15:13	0
1855314	99	2844	10,2830	cyclictest	1921568	-21	kworker/1:2+events	22:40:13	1
1855320	99	2828	13,2812	cyclictest	1858473	-21	kworker/3:1+events	19:55:17	3
1855314	99	2761	12,2745	cyclictest	1887447	-21	kworker/1:2+events	20:53:36	1
1855318	99	2754	10,2740	cyclictest	1860457	-21	kworker/2:2+events	19:35:15	2
1855309	99	2753	11,2739	cyclictest	1913337	-21	kworker/0:2+events	22:10:15	0
1855318	99	2735	11,2719	cyclictest	1900350	-21	kworker/2:0+events	21:46:11	2
1855318	99	2719	13,2702	cyclictest	1903577	-21	kworker/2:2+events	21:43:36	2
1855309	99	2688	12,2672	cyclictest	1903345	-21	kworker/0:0+events	21:39:06	0
1855320	99	2687	13,2670	cyclictest	1900254	-21	kworker/3:0+events	21:30:21	3
1855320	99	2674	12,2659	cyclictest	1858473	-21	kworker/3:1+events	19:30:19	3
1855320	99	2649	13,2633	cyclictest	1905004	-21	kworker/3:2+events	21:50:00	3
1855309	99	2649	13,2632	cyclictest	1903345	-21	kworker/0:0+events	21:42:31	0
1855318	99	2648	11,2632	cyclictest	1866676	-21	kworker/2:0+events	20:00:11	2
1855320	99	2627	11,2613	cyclictest	1886232	-21	kworker/3:1+events	20:49:28	3
1855320	99	2608	13,2591	cyclictest	1942930	-21	kworker/3:0+events	23:50:14	3
1855320	99	2608	13,2591	cyclictest	1942930	-21	kworker/3:0+events	23:50:14	3
1855320	99	2577	12,2561	cyclictest	1905004	-21	kworker/3:2+events	21:43:15	3
1855320	99	2576	12,2560	cyclictest	1942930	-21	kworker/3:0+events	23:44:53	3
1855320	99	2575	11,2560	cyclictest	1931113	-21	kworker/3:0+events	23:08:43	3
1855320	99	2573	9,2560	cyclictest	1866734	-21	kworker/3:2+events	19:52:16	3
1855320	99	2572	12,2556	cyclictest	1931113	-21	kworker/3:0+events	23:14:27	3
1855320	99	2570	12,2554	cyclictest	1956093	-21	kworker/3:0+events	00:23:25	3
1855309	99	2570	11,2555	cyclictest	1908432	-21	kworker/0:0+events	22:01:08	0
1855309	99	2570	11,2555	cyclictest	1908432	-21	kworker/0:0+events	22:01:07	0
1855320	99	2565	12,2549	cyclictest	1934488	-21	kworker/3:2+events	23:18:40	3
1855318	99	2561	12,2545	cyclictest	1856567	-21	kworker/2:0+events	19:21:59	2
1855320	99	2555	12,2539	cyclictest	1956093	-21	kworker/3:0+events	00:30:13	3
1855318	99	2555	11,2541	cyclictest	1900350	-21	kworker/2:0+events	21:31:54	2
1855320	99	2547	12,2532	cyclictest	1956093	-21	kworker/3:0+events	00:25:42	3
1855320	99	2544	12,2528	cyclictest	1934488	-21	kworker/3:2+events	23:34:42	3
1855314	99	2539	3,2532	cyclictest	1946199	-21	kworker/1:1+events	23:51:47	1
1855314	99	2539	3,2532	cyclictest	1946199	-21	kworker/1:1+events	23:51:46	1
1855314	99	2535	8,2522	cyclictest	1882501	-21	kworker/1:1+events	20:41:08	1
1855314	99	2533	9,2520	cyclictest	1884162	-21	kworker/1:2+events	20:39:36	1
1855314	99	2532	11,2518	cyclictest	1929345	-21	kworker/1:2+events	23:02:18	1
1855314	99	2529	12,2513	cyclictest	1936065	-21	kworker/1:0+events	23:20:57	1
1855320	99	2526	12,2510	cyclictest	1896709	-21	kworker/3:1+events	21:35:40	3
1855320	99	2526	11,2512	cyclictest	1954481	-21	kworker/3:2+events	00:19:58	3
1855314	99	2526	12,2510	cyclictest	1910250	-21	kworker/1:1+events	22:08:47	1
1855320	99	2519	12,2504	cyclictest	1924725	-21	kworker/3:1+events	22:56:57	3
1855314	99	2510	12,2495	cyclictest	1903591	-21	kworker/1:2+events	21:40:37	1
1855309	99	2509	12,2495	cyclictest	1905037	-21	kworker/0:2+events	21:45:06	0
1855320	99	2498	12,2482	cyclictest	1949271	-21	kworker/3:1+events	00:05:25	3
1855320	99	2498	12,2482	cyclictest	1949271	-21	kworker/3:1+events	00:05:24	3
1855320	99	2498	12,2482	cyclictest	1874812	-21	kworker/3:2+events	20:21:22	3
1855320	99	2498	0,2494	cyclictest	1934588	-21	kworker/3:3+events	23:24:43	3
1855314	99	2498	12,2482	cyclictest	1897843	-21	kworker/1:0+events	22:18:16	1
1855320	99	2496	12,2482	cyclictest	1890646	-21	kworker/3:0+events	21:00:06	3
1855320	99	2496	12,2480	cyclictest	1916328	-21	kworker/3:2+events	22:40:37	3
1855320	99	2495	12,2479	cyclictest	1942930	-21	kworker/3:0+events	23:48:41	3
1855320	99	2495	12,2479	cyclictest	1927772	-21	kworker/3:2+events	23:03:51	3
1855320	99	2495	12,2479	cyclictest	1909862	-21	kworker/3:1+events	22:11:46	3
1855320	99	2494	12,2478	cyclictest	1916328	-21	kworker/3:2+events	22:33:26	3
1855320	99	2493	12,2477	cyclictest	1880946	-21	kworker/3:1+events	20:33:58	3
1855320	99	2492	12,2476	cyclictest	1874812	-21	kworker/3:2+events	20:14:59	3
1855320	99	2492	12,2476	cyclictest	1874812	-21	kworker/3:2+events	20:14:59	3
1855320	99	2491	12,2475	cyclictest	1892263	-21	kworker/3:2+events	21:06:07	3
1855320	99	2491	12,2475	cyclictest	1863848	-21	kworker/3:0+events	19:37:52	3
1855320	99	2490	12,2474	cyclictest	1942930	-21	kworker/3:0+events	23:56:20	3
1855314	99	2490	11,2475	cyclictest	1919909	-21	kworker/1:1+events	22:31:56	1
1855320	99	2489	12,2475	cyclictest	1924725	-21	kworker/3:1+events	22:45:36	3
1855320	99	2489	12,2473	cyclictest	1934488	-21	kworker/3:2+events	23:26:40	3
1855314	99	2489	12,2474	cyclictest	1836661	-21	kworker/1:2+events	19:20:50	1
1855318	99	2487	11,2472	cyclictest	1877941	-21	kworker/2:1+events	20:27:53	2
1855318	99	2487	10,2473	cyclictest	1926322	-21	kworker/2:1+events	22:51:57	2
1855318	99	2487	10,2473	cyclictest	1921420	-21	kworker/2:2+events	22:33:48	2
1855318	99	2485	8,2473	cyclictest	1917968	-21	kworker/2:1+events	22:37:57	2
1855320	99	2484	12,2469	cyclictest	1908256	-21	kworker/3:0+events	21:58:49	3
1855320	99	2484	10,2472	cyclictest	1909862	-21	kworker/3:1+events	22:20:33	3
1855318	99	2484	9,2472	cyclictest	1935791	-21	kworker/2:2+events	23:45:15	2
1855320	99	2483	12,2469	cyclictest	1892263	-21	kworker/3:2+events	21:16:00	3
1855318	99	2482	12,2467	cyclictest	1905191	-21	kworker/2:1+events	22:06:31	2
1855320	99	2481	11,2466	cyclictest	1961532	-21	kworker/3:1+events	00:35:58	3
1855318	99	2480	12,2465	cyclictest	1881189	-21	kworker/2:0+events	21:03:08	2
1855318	99	2480	11,2465	cyclictest	1881189	-21	kworker/2:0+events	20:54:23	2
1855320	99	2479	12,2464	cyclictest	1918014	-21	kworker/3:0+events	22:28:30	3
1855318	99	2479	9,2466	cyclictest	1927912	-21	kworker/2:0+events	23:00:00	2
1855318	99	2478	8,2466	cyclictest	1881189	-21	kworker/2:0+events	20:57:27	2
1855314	99	2478	12,2462	cyclictest	1942631	-21	kworker/1:0+events	23:46:25	1
1855320	99	2477	9,2465	cyclictest	1908256	-21	kworker/3:0+events	22:00:44	3
1855320	99	2477	9,2465	cyclictest	1908256	-21	kworker/3:0+events	22:00:43	3
1855320	99	2477	12,2462	cyclictest	1858473	-21	kworker/3:1+events	20:06:12	3
1855320	99	2477	12,2461	cyclictest	1886232	-21	kworker/3:1+events	20:52:05	3
1855320	99	2477	12,2461	cyclictest	1876444	-21	kworker/3:1+events	20:19:28	3
1855320	99	2475	12,2460	cyclictest	1886232	-21	kworker/3:1+events	20:59:22	3
1855318	99	2475	12,2461	cyclictest	1898435	-21	kworker/2:1+events	21:25:03	2
1855320	99	2474	11,2460	cyclictest	1949271	-21	kworker/3:1+events	00:03:52	3
1855320	99	2473	12,2458	cyclictest	1908256	-21	kworker/3:0+events	21:54:13	3
1855318	99	2473	12,2457	cyclictest	1935791	-21	kworker/2:2+events	23:39:59	2
1855320	99	2471	12,2455	cyclictest	1916328	-21	kworker/3:2+events	22:38:42	3
1855318	99	2471	11,2456	cyclictest	1927912	-21	kworker/2:0+events	23:10:35	2
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2024-07-29 - 23:00