OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8
Special All - All RT - Optimization - Ethernet - Thumbnails - Next

Click here to display the system's profile data or here to proceed to next system.

Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.
Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system

Characteristics of the 100 highest latencies:

System rack0slot6s.osadl.org (updated Sat Apr 20, 2024 00:45:15)
Delayed (victim)					Switcher (culprit)			Timestamp	CPU
PID	Prio	Total latency (µs)	T^(,W^*) latency (µs)	Cmd	PID	Prio	Cmd	Timestamp	CPU
1360060	99	21363	21359,4	cyclictest	16	-1	pr/ttyS0	21:33:43	1
1360089	99	1965	0,1964	cyclictest	1455724	-21	conntrack	21:00:15	2
1360065	99	1950	0,1949	cyclictest	1472590	-21	conntrack	21:20:16	13
1360084	99	1932	0,1931	cyclictest	1476801	-21	conntrack	21:25:12	19
1360060	99	1930	0,1929	cyclictest	1603185	-21	conntrack	23:55:11	1
1360100	99	1926	0,1925	cyclictest	1506364	-21	conntrack	22:00:14	6
1360100	99	1925	0,1924	cyclictest	1392480	-21	conntrack	19:45:15	6
1360063	99	1922	0,1921	cyclictest	1493653	-21	conntrack	21:45:16	12
1360103	99	1919	0,1918	cyclictest	1632917	-21	conntrack	00:30:11	7
1360079	99	1918	0,1917	cyclictest	1400892	-21	conntrack	19:55:23	17
1360112	99	1916	0,1915	cyclictest	1447254	-21	conntrack	20:50:19	10
1360060	99	1916	0,1915	cyclictest	1523198	-21	conntrack	22:20:12	1
1360100	99	1915	0,1914	cyclictest	1599008	-21	conntrack	23:50:13	6
1360115	99	1913	0,1912	cyclictest	1417762	-21	conntrack	20:15:14	11
1360079	99	1912	0,1911	cyclictest	1426201	-21	conntrack	20:25:17	17
1360103	99	1911	0,1910	cyclictest	1464154	-21	conntrack	21:10:13	7
1360089	99	1907	0,1906	cyclictest	1565315	-21	conntrack	23:10:11	2
1360081	99	1906	0,1905	cyclictest	1430409	-21	conntrack	20:30:13	18
1360079	99	1906	0,1905	cyclictest	1481016	-21	conntrack	21:30:12	17
1360075	99	1900	0,1899	cyclictest	1611831	-21	conntrack	00:05:13	16
1360060	99	1898	0,1897	cyclictest	1443051	-21	conntrack	20:45:15	1
1360060	99	1892	0,1891	cyclictest	1421990	-21	conntrack	20:20:14	1
1360115	99	1887	0,1886	cyclictest	1628698	-21	conntrack	00:25:12	11
1360063	99	1887	0,1886	cyclictest	1607491	-21	conntrack	00:00:14	12
1360065	99	1886	0,1885	cyclictest	1582178	-21	conntrack	23:30:14	13
1360081	99	1885	0,1884	cyclictest	1616052	-21	conntrack	00:10:13	18
1360089	99	1884	0,1883	cyclictest	1502074	-21	conntrack	21:55:15	2
1360100	99	1880	0,1879	cyclictest	1489449	-21	conntrack	21:40:15	6
1360079	99	1879	0,1878	cyclictest	1544237	-21	conntrack	22:45:16	17
1360060	99	1876	0,1875	cyclictest	1384059	-21	conntrack	19:35:17	1
1360060	99	1876	0,1875	cyclictest	1384059	-21	conntrack	19:35:16	1
1360060	99	1875	0,1874	cyclictest	1438834	-21	conntrack	20:40:14	1
1360089	99	1874	0,1873	cyclictest	1586388	-21	conntrack	23:35:14	2
1360063	99	1871	0,1870	cyclictest	1459961	-21	conntrack	21:05:17	12
1360100	99	1870	0,1869	cyclictest	1620273	-21	conntrack	00:15:17	6
1360103	99	1869	0,1868	cyclictest	1405167	-21	conntrack	20:00:14	7
1360073	99	1868	0,1867	cyclictest	1514775	-21	conntrack	22:10:13	15
1360073	99	1868	0,1867	cyclictest	1514775	-21	conntrack	22:10:13	15
1360091	99	1866	0,1865	cyclictest	1497887	-21	conntrack	21:50:14	3
1360112	99	1865	0,1864	cyclictest	1548418	-21	conntrack	22:50:14	10
1360081	99	1863	0,1862	cyclictest	1361905	-21	conntrack	19:10:16	18
1360075	99	1863	0,1862	cyclictest	1590596	-21	conntrack	23:40:14	16
1360063	99	1860	0,1859	cyclictest	1375619	-21	conntrack	19:25:16	12
1360063	99	1860	0,1859	cyclictest	1375619	-21	conntrack	19:25:15	12
1360081	99	1854	0,1853	cyclictest	1388266	-21	conntrack	19:40:17	18
1360063	99	1853	0,1852	cyclictest	1531607	-21	conntrack	22:30:13	12
1360060	99	1853	0,1852	cyclictest	1624486	-21	conntrack	00:20:13	1
1360105	99	1850	0,1849	cyclictest	1527404	-21	conntrack	22:25:13	8
1360100	99	1850	0,1849	cyclictest	1451477	-21	conntrack	20:55:13	6
1360065	99	1847	0,1846	cyclictest	1552648	-21	conntrack	22:55:12	13
1360091	99	1846	0,1845	cyclictest	1371416	-21	conntrack	19:20:11	3
1360065	99	1838	0,1837	cyclictest	1535818	-21	conntrack	22:35:14	13
1360089	99	1837	0,1836	cyclictest	1577960	-21	conntrack	23:25:14	2
1360110	99	1835	0,1834	cyclictest	1379845	-21	conntrack	19:30:17	9
1360110	99	1835	0,1834	cyclictest	1379845	-21	conntrack	19:30:16	9
1360060	99	1834	0,1833	cyclictest	1367195	-21	conntrack	19:15:15	1
1360073	99	1818	0,1817	cyclictest	1637138	-21	conntrack	00:35:16	15
1360089	99	1813	0,1812	cyclictest	1413560	-21	conntrack	20:10:13	2
1360089	99	1811	0,1810	cyclictest	1540037	-21	conntrack	22:40:14	2
1360089	99	1791	0,1790	cyclictest	1409360	-21	conntrack	20:05:20	2
1360063	99	1781	0,1780	cyclictest	1468356	-21	conntrack	21:15:14	12
1360079	99	1772	0,1771	cyclictest	1594784	-21	conntrack	23:45:14	17
1360103	99	1770	0,1769	cyclictest	1518985	-21	conntrack	22:15:14	7
1360103	99	1769	0,1768	cyclictest	1510560	-21	conntrack	22:05:14	7
1360103	99	1769	0,1768	cyclictest	1510560	-21	conntrack	22:05:13	7
1360081	99	1763	0,1762	cyclictest	1561105	-21	conntrack	23:05:13	18
1360100	99	1760	0,1759	cyclictest	1573743	-21	conntrack	23:20:13	6
1360060	99	1757	0,1756	cyclictest	1485239	-21	conntrack	21:35:13	1
1360063	99	1752	0,1751	cyclictest	1556891	-21	conntrack	23:00:14	12
1360110	99	1741	0,1740	cyclictest	1434631	-21	conntrack	20:35:15	9
1360075	99	1741	0,1740	cyclictest	1569536	-21	conntrack	23:15:18	16
1360081	99	1737	0,1736	cyclictest	1396695	-21	conntrack	19:50:22	18
1360081	99	1135	1132,3	cyclictest	1363858	-21	kworker/8:2+inode_switch_wbs	19:45:44	18
1360110	99	1125	1121,3	cyclictest	1364260	-21	kworker/17:2+inode_switch_wbs	20:00:08	9
1360115	99	1027	1020,6	cyclictest	1634678	-21	kworker/19:1+inode_switch_wbs	00:34:40	11
1360056	99	1016	1012,4	cyclictest	1350981	-21	kworker/0:3+inode_switch_wbs	19:25:02	0
1360056	99	1016	1012,4	cyclictest	1350981	-21	kworker/0:3+inode_switch_wbs	19:25:01	0
1360065	99	986	982,3	cyclictest	1453361	-21	kworker/3:2+inode_switch_wbs	21:41:00	13
1360089	99	962	959,3	cyclictest	1225620	-21	kworker/10:1+inode_switch_wbs	19:17:40	2
1360103	99	860	858,2	cyclictest	1377509	-21	kworker/15:0+inode_switch_wbs	19:38:56	7
1360103	99	860	858,2	cyclictest	1377509	-21	kworker/15:0+inode_switch_wbs	19:38:55	7
1360103	99	857	854,2	cyclictest	1559079	-21	kworker/15:2+inode_switch_wbs	00:08:53	7
1360060	99	826	0,825	cyclictest	1371420	-21	conntrack	19:20:12	1
1360081	99	816	812,3	cyclictest	1495566	-21	kworker/8:1+inode_switch_wbs	21:52:22	18
1360089	99	813	0,812	cyclictest	1371415	-21	conntrack	19:20:11	2
1360065	99	809	0,808	cyclictest	1544236	-21	conntrack	22:45:16	13
1360112	99	804	801,2	cyclictest	1407351	-21	kworker/18:2+inode_switch_wbs	20:09:37	10
1360103	99	798	796,2	cyclictest	1559079	-21	kworker/15:2+inode_switch_wbs	00:02:48	7
1360065	99	793	0,793	cyclictest	1531606	-21	conntrack	22:30:13	13
1360065	99	791	0,790	cyclictest	1367194	-21	conntrack	19:15:15	13
1360069	99	786	784,2	cyclictest	1491432	-21	kworker/4:1+inode_switch_wbs	22:17:10	14
1360112	99	784	781,2	cyclictest	1526139	-21	kworker/18:0+inode_switch_wbs	23:52:11	10
1360105	99	765	763,2	cyclictest	1415339	-21	kworker/16:0+inode_switch_wbs	21:15:58	8
1360081	99	758	756,2	cyclictest	1500812	-21	kworker/8:0+inode_switch_wbs	22:12:51	18
1360081	99	758	756,2	cyclictest	1500812	-21	kworker/8:0+inode_switch_wbs	22:12:50	18
1360063	99	757	755,2	cyclictest	1367642	-21	kworker/2:2+inode_switch_wbs	19:56:21	12
1360089	99	752	0,751	cyclictest	1384063	-21	conntrack	19:35:17	2
1360089	99	752	0,751	cyclictest	1384063	-21	conntrack	19:35:16	2
1360089	99	733	730,2	cyclictest	1478808	-21	kworker/10:0+inode_switch_wbs	21:44:01	2
1360056	99	732	730,2	cyclictest	1529429	-21	kworker/0:0+inode_switch_wbs	22:30:07	0
^Timer ^*Wakeup (latency=timer+wakeup+contextswitch)


Access: public		Short link to this page
This page was last modified on 2019-05-28 - 00:17