You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 18:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackfslot7s.osadl.org (updated Sat Jan 03, 2026 00:44:18)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180476899583927,5808cyclictest1804290-21kworker/3:0+events19:11:163
180475899582727,5797cyclictest1804408-21kworker/0:2+events19:11:380
180476599317816,3157cyclictest1840006-21kworker/2:1+events21:10:192
180476299295114,2934cyclictest1804228-21kworker/1:2+events19:12:001
180476599289211,2878cyclictest1824049-21kworker/2:1+events20:10:172
180476299272713,2711cyclictest1892278-21kworker/1:0+events00:00:021
180476899260513,2590cyclictest1909929-21kworker/3:1+events00:35:023
180476299250512,2488cyclictest1843410-21kworker/1:1+events21:15:131
180476299249712,2482cyclictest1825353-21kworker/1:0+events20:29:591
180475899245012,2434cyclictest1884169-21kworker/0:0+events23:20:210
180475899245012,2434cyclictest1884169-21kworker/0:0+events23:20:210
180476899241811,2404cyclictest1902046-21kworker/3:2+events00:15:133
180475899237812,2362cyclictest1828667-21kworker/0:0+events20:35:160
180475899235112,2336cyclictest1808449-21kworker/0:1+events19:30:130
180476599234012,2324cyclictest1864774-21kworker/2:1+events22:15:132
180476599226311,2249cyclictest1843767-21kworker/2:2+events21:18:362
180476299222011,2207cyclictest1817668-21kworker/1:0+events19:50:241
180476599220810,2195cyclictest1884001-21kworker/2:1+events23:14:342
180475899220710,2194cyclictest1872609-21kworker/0:2+events22:38:510
18047629922058,2195cyclictest1838284-21kworker/1:2+events20:55:061
180476899219910,2185cyclictest1880385-21kworker/3:2+events23:10:243
180476299219811,2184cyclictest1906614-21kworker/1:1+events00:25:561
18047689921978,2186cyclictest1820633-21kworker/3:1+events19:59:593
180476299219611,2182cyclictest1870975-21kworker/1:2+events22:37:431
180476899219411,2179cyclictest1861201-21kworker/3:1+events22:20:113
180476899219111,2177cyclictest1840865-21kworker/3:1+events21:08:293
18047589921889,2176cyclictest1875917-21kworker/0:2+events23:11:080
180476299218410,2171cyclictest1843410-21kworker/1:1+events21:22:291
180475899218311,2168cyclictest1828667-21kworker/0:0+events20:41:170
18047589921829,2169cyclictest1851683-21kworker/0:0+events22:16:220
180476599217910,2166cyclictest1836505-21kworker/2:2+events20:50:512
18047589921798,2168cyclictest1825414-21kworker/0:1+events20:16:280
18047689921689,2155cyclictest1902046-21kworker/3:2+events00:31:143
180476599216711,2152cyclictest1884001-21kworker/2:1+events23:16:072
180476599216710,2154cyclictest1836505-21kworker/2:2+events21:03:542
18047629921657,2155cyclictest1867737-21kworker/1:0+events22:34:391
180476599214711,2133cyclictest1815914-21kworker/2:1+events19:43:322
180475899213810,2125cyclictest1898353-21kworker/0:0+events00:02:200
18047629921098,2098cyclictest1892278-21kworker/1:0+events23:54:401
180476899209510,2082cyclictest1861201-21kworker/3:1+events22:05:463
180476299208211,2067cyclictest1811326-21kworker/1:2+events20:00:201
180476599208110,2068cyclictest1804380-21kworker/2:1+events19:12:462
180476899207510,2062cyclictest1812570-21kworker/3:0+events19:44:413
180475899207510,2062cyclictest1844773-21kworker/0:0+events21:23:120
18047629920747,2064cyclictest1838284-21kworker/1:2+events21:13:211
180476599206111,2047cyclictest1849893-21kworker/2:0+events21:28:152
18047629920518,2039cyclictest1861530-21kworker/1:2+events22:12:111
18047689920499,2037cyclictest1836566-21kworker/3:2+events20:49:183
18047689920499,2037cyclictest1836566-21kworker/3:2+events20:49:173
18047589920439,2031cyclictest1808449-21kworker/0:1+events19:36:430
18047659920426,2033cyclictest1901774-21kworker/2:0+events00:29:432
180476599204210,2029cyclictest1911848-21kworker/2:1+events00:39:322
18047689920419,2029cyclictest1872546-21kworker/3:2+events22:44:123
18047659920395,2031cyclictest1826960-21kworker/2:0+events20:34:092
18047589920389,2026cyclictest1825414-21kworker/0:1+events20:28:070
18047629920358,2025cyclictest1870975-21kworker/1:2+events22:55:091
180476899203410,2021cyclictest1830053-21kworker/3:0+events20:42:263
18047689920307,2020cyclictest1902046-21kworker/3:2+events00:25:323
18047629920249,2011cyclictest1898502-21kworker/1:1+events00:10:181
18047589920229,2010cyclictest1868033-21kworker/0:0+events22:27:200
180476299202010,2007cyclictest1880357-21kworker/1:1+events23:02:001
180476299202010,2007cyclictest1880357-21kworker/1:1+events23:01:591
18047689920199,2007cyclictest1875986-21kworker/3:1+events23:01:143
18047689920199,2007cyclictest1875986-21kworker/3:1+events23:01:133
180476299201910,2007cyclictest1880357-21kworker/1:1+events23:05:501
180476299201810,2005cyclictest1830114-21kworker/1:2+events20:31:301
180476899201710,2004cyclictest1893664-21kworker/3:2+events23:45:283
18047689920166,2007cyclictest1883970-21kworker/3:1+events23:23:233
18047689920166,2007cyclictest1883970-21kworker/3:1+events23:23:233
18047589920169,2004cyclictest1817606-21kworker/0:0+events20:01:070
180476299201310,1999cyclictest1888950-21kworker/1:2+events23:34:431
180475899201310,2000cyclictest1849984-21kworker/0:2+events21:29:230
18047689920126,2003cyclictest1809756-21kworker/3:1+events19:30:373
180476899201210,1999cyclictest1830053-21kworker/3:0+events21:04:163
18047629920125,2005cyclictest1906614-21kworker/1:1+events00:30:051
180476299201210,1998cyclictest1831801-21kworker/1:1+events20:39:271
18047689920117,2000cyclictest1885901-21kworker/3:0+events00:00:253
18047629920119,1999cyclictest1814265-21kworker/1:0+events19:42:001
18047629920118,2000cyclictest1827225-21kworker/1:1+events20:22:511
18047689920109,1998cyclictest1885901-21kworker/3:0+events23:59:393
18047689920098,1997cyclictest1861201-21kworker/3:1+events22:12:353
18047629920099,1997cyclictest1867737-21kworker/1:0+events22:22:301
180476299200910,1995cyclictest1861530-21kworker/1:2+events22:18:171
18047689920089,1996cyclictest1831660-21kworker/3:2+events20:33:003
18047689920086,1999cyclictest1887655-21kworker/3:2+events23:29:503
180476899200810,1995cyclictest1906461-21kworker/3:0+events00:24:453
180476899200810,1995cyclictest1885901-21kworker/3:0+events23:53:093
18047629920088,1997cyclictest1870975-21kworker/1:2+events23:14:571
18047629920088,1997cyclictest1849802-21kworker/1:0+events21:27:051
18047629920088,1997cyclictest1811326-21kworker/1:2+events20:09:091
180476299200810,1995cyclictest1906614-21kworker/1:1+events00:35:451
180476899200710,1994cyclictest1872546-21kworker/3:2+events22:50:143
180476899200710,1994cyclictest1823954-21kworker/3:1+events20:20:373
18047629920075,1999cyclictest1811326-21kworker/1:2+events19:32:081
18047589920079,1995cyclictest1844773-21kworker/0:0+events21:12:140
180475899200710,1994cyclictest1849984-21kworker/0:2+events21:30:550
18047689920069,1994cyclictest1815825-21kworker/3:1+events19:51:313
18047689920067,1996cyclictest1870854-21kworker/3:0+events22:47:333
18047689920066,1997cyclictest1809756-21kworker/3:1+events19:28:213
180476299200610,1993cyclictest1887290-21kworker/1:1+events23:24:551
180476299200610,1993cyclictest1887290-21kworker/1:1+events23:24:541
180476299200610,1993cyclictest1831801-21kworker/1:1+events20:41:411
18047689920059,1993cyclictest1861201-21kworker/3:1+events22:30:513
180476899200510,1992cyclictest1825623-21kworker/3:0+events20:19:523
18047629920059,1993cyclictest1870975-21kworker/1:2+events22:52:521
18047629920059,1993cyclictest1814265-21kworker/1:0+events19:38:151
180476899200410,1991cyclictest1840865-21kworker/3:1+events21:22:043
18047629920048,1993cyclictest1892278-21kworker/1:0+events23:58:521
18047689920028,1991cyclictest1900455-21kworker/3:1+events00:06:513
180476899200110,1988cyclictest1859502-21kworker/3:0+events21:56:333
180476299200010,1987cyclictest1808008-21kworker/1:0+events19:23:471
18047689919999,1987cyclictest1885901-21kworker/3:0+events23:37:033
18047629919999,1987cyclictest1890667-21kworker/1:1+events23:35:301
18047629919996,1990cyclictest1838284-21kworker/1:2+events21:03:301
18047589919996,1990cyclictest1875917-21kworker/0:2+events23:15:430
180476899199810,1985cyclictest1840865-21kworker/3:1+events21:15:593
180476899199810,1984cyclictest1857499-21kworker/3:2+events21:51:583
180476599199810,1985cyclictest1824049-21kworker/2:1+events20:22:062
18047629919988,1987cyclictest1874202-21kworker/1:0+events22:45:431
18047629919987,1988cyclictest1890667-21kworker/1:1+events23:41:411
180476299199810,1985cyclictest1843410-21kworker/1:1+events21:34:231
180475899199810,1985cyclictest1880599-21kworker/0:1+events23:06:590
180475899199810,1985cyclictest1817606-21kworker/0:0+events19:56:540
18047689919979,1985cyclictest1854673-21kworker/3:1+events21:44:433
180476899199710,1984cyclictest1846517-21kworker/3:2+events21:37:253
18047589919976,1987cyclictest1804408-21kworker/0:2+events19:20:190
18047589919974,1990cyclictest1838344-21kworker/0:0+events20:55:290
18047689919969,1984cyclictest1812570-21kworker/3:0+events19:39:213
18047689919968,1985cyclictest1857499-21kworker/3:2+events22:04:383
18047689919968,1985cyclictest1846517-21kworker/3:2+events21:34:013
18047689919968,1984cyclictest1878758-21kworker/3:0+events22:57:043
18047689919966,1987cyclictest1823954-21kworker/3:1+events20:26:353
180476899199610,1984cyclictest1864657-21kworker/3:0+events22:15:363
180476899199610,1983cyclictest1848265-21kworker/3:0+events21:27:513
180476299199610,1983cyclictest1904979-21kworker/1:0+events00:17:521
18047589919969,1984cyclictest1901924-21kworker/0:1+events00:08:470
180475899199610,1982cyclictest1872609-21kworker/0:2+events22:42:410
18047689919957,1985cyclictest1822262-21kworker/3:2+events20:11:503
180476299199510,1984cyclictest1890667-21kworker/1:1+events23:45:061
18047589919956,1987cyclictest1868033-21kworker/0:0+events22:30:040
18047589919948,1983cyclictest1825414-21kworker/0:1+events20:30:440
180476899199310,1980cyclictest1902046-21kworker/3:2+events00:12:363
180476299199110,1977cyclictest1815946-21kworker/1:1+events19:45:251
18047659919892,1984cyclictest1843767-21kworker/2:2+events21:56:102
18047659919885,1980cyclictest1890401-21kworker/2:1+events23:41:182
18047629919878,1976cyclictest1831801-21kworker/1:1+events20:50:041
180475899198710,1974cyclictest1851683-21kworker/0:0+events21:56:570
180476599198610,1973cyclictest1840006-21kworker/2:1+events21:08:072
18047589919867,1976cyclictest1875917-21kworker/0:2+events22:52:290
18047689919855,1977cyclictest1831660-21kworker/3:2+events20:37:083
18047659919859,1973cyclictest1885870-21kworker/2:2+events23:27:332
18047659919859,1973cyclictest1872697-21kworker/2:2+events22:51:002
18047589919859,1973cyclictest1895114-21kworker/0:1+events23:51:350
18047589919859,1973cyclictest1817606-21kworker/0:0+events20:05:430
18047689919849,1972cyclictest1853045-21kworker/3:0+events21:45:533
18047659919844,1977cyclictest1843767-21kworker/2:2+events22:00:492
18047659919843,1977cyclictest1806087-21kworker/2:0+events19:24:112
18047589919849,1972cyclictest1884169-21kworker/0:0+events23:34:210
18047589919848,1973cyclictest1898353-21kworker/0:0+events00:13:190
18047589919848,1973cyclictest1825414-21kworker/0:1+events20:20:590
180476899198310,1971cyclictest1885901-21kworker/3:0+events23:42:263
18047659919835,1975cyclictest1878788-21kworker/2:1+events22:58:592
180476299198310,1971cyclictest1859717-21kworker/1:1+events21:59:161
18047589919839,1970cyclictest1851683-21kworker/0:0+events21:35:540
18047589919833,1977cyclictest1905103-21kworker/0:1+events00:22:050
18047589919829,1971cyclictest1854523-21kworker/0:2+events21:45:070
18047589919829,1970cyclictest1851683-21kworker/0:0+events21:43:120
18047589919829,1970cyclictest1812718-21kworker/0:2+events19:40:510
18047589919826,1973cyclictest1903510-21kworker/0:2+events00:16:200
18047659919818,1970cyclictest1828609-21kworker/2:2+events20:27:442
180476599198110,1969cyclictest1856067-21kworker/2:1+events21:50:032
18047629919814,1974cyclictest1867737-21kworker/1:0+events22:29:421
18047589919819,1969cyclictest1836474-21kworker/0:2+events20:50:280
18047589919816,1971cyclictest1834783-21kworker/0:1+events20:47:460
18047589919816,1971cyclictest1834783-21kworker/0:1+events20:47:460
180475899198110,1970cyclictest1816007-21kworker/0:1+events19:45:040
180476599198010,1969cyclictest1890401-21kworker/2:1+events23:35:072
180476299198010,1967cyclictest1870975-21kworker/1:2+events22:43:031
18047589919803,1974cyclictest1890492-21kworker/0:1+events23:36:400
18047659919789,1966cyclictest1880415-21kworker/2:0+events23:08:292
18047659919769,1964cyclictest1901774-21kworker/2:0+events00:23:132
180476599197510,1962cyclictest1901774-21kworker/2:0+events00:12:132
180476599197510,1962cyclictest1843767-21kworker/2:2+events21:37:492
180476899197410,1960cyclictest1836566-21kworker/3:2+events20:56:573
18047659919749,1962cyclictest1909992-21kworker/2:2+events00:32:452
18047659919749,1961cyclictest1862854-21kworker/2:2+events22:28:312
18047689919739,1961cyclictest1883970-21kworker/3:1+events23:16:283
18047659919739,1960cyclictest1808159-21kworker/2:1+events19:34:002
180476599197210,1960cyclictest1872697-21kworker/2:2+events22:40:002
18047629919726,1963cyclictest1856155-21kworker/1:1+events21:47:241
18047589919726,1963cyclictest1808449-21kworker/0:1+events19:26:500
18047659919718,1960cyclictest1869483-21kworker/2:1+events22:33:562
18047659919713,1965cyclictest1862854-21kworker/2:2+events22:24:202
180476599197110,1959cyclictest1851565-21kworker/2:1+events21:34:462
18047659919706,1961cyclictest1857962-21kworker/2:0+events22:08:002
180476599197010,1957cyclictest1896690-21kworker/2:0+events23:55:252
180476599197010,1957cyclictest1893695-21kworker/2:2+events23:50:512
18047589919708,1959cyclictest1817606-21kworker/0:0+events19:54:360
18047659919698,1958cyclictest1856067-21kworker/2:1+events21:46:162
18047659919695,1961cyclictest1898410-21kworker/2:1+events00:01:562
18047659919695,1961cyclictest1884001-21kworker/2:1+events23:21:072
18047659919695,1961cyclictest1884001-21kworker/2:1+events23:21:072
18047659919693,1963cyclictest1820784-21kworker/2:2+events20:01:292
18047629919689,1956cyclictest1784849-21kworker/1:1+events19:25:191
180476599196710,1954cyclictest1830231-21kworker/2:1+events20:36:232
18047659919668,1955cyclictest1843767-21kworker/2:2+events21:23:362
18047629919648,1955cyclictest1853325-21kworker/1:0+events22:00:041
18047589919629,1950cyclictest1888892-21kworker/0:2+events23:29:040
180475899196210,1949cyclictest1866201-21kworker/0:1+events22:20:580
18047659919597,1949cyclictest1838373-21kworker/2:0+events20:58:282
18047589919599,1947cyclictest1895114-21kworker/0:1+events23:56:590
18047589919555,1947cyclictest1851683-21kworker/0:0+events21:54:160
180476899195410,1941cyclictest1867887-21kworker/3:2+events22:26:353
18047659919549,1942cyclictest1808159-21kworker/2:1+events19:27:582
18047689919506,1941cyclictest1885901-21kworker/3:0+events23:32:063
180476299195010,1937cyclictest1901863-21kworker/1:2+events00:22:291
18047659919499,1936cyclictest1826960-21kworker/2:0+events20:18:212
180476899194710,1934cyclictest1870854-21kworker/3:0+events22:37:203
18047659919478,1936cyclictest1830231-21kworker/2:1+events20:42:052
18047659919469,1934cyclictest1808159-21kworker/2:1+events19:36:212
180476599194610,1933cyclictest1830231-21kworker/2:1+events20:48:092
180476599194610,1933cyclictest1830231-21kworker/2:1+events20:48:082
180476899194510,1932cyclictest1830053-21kworker/3:0+events20:52:463
180476299194410,1931cyclictest1808008-21kworker/1:0+events19:19:111
18047629919439,1931cyclictest1851475-21kworker/1:2+events21:41:371
18047629919438,1932cyclictest1853325-21kworker/1:0+events21:52:201
180475899194310,1930cyclictest1875917-21kworker/0:2+events23:03:560
180475899194310,1930cyclictest1875917-21kworker/0:2+events23:03:560
18047689919417,1931cyclictest1882311-21kworker/3:0+events23:09:363
18047659919419,1926cyclictest1819180-21kworker/2:1+events19:55:212
18047629919417,1931cyclictest1841808-21kworker/1:0+events21:07:201
18047629919409,1928cyclictest1817668-21kworker/1:0+events19:59:111
18047589919409,1928cyclictest1911878-21kworker/0:0+events00:38:250
18047629919397,1929cyclictest1836388-21kworker/1:0+events20:47:241
18047629919397,1929cyclictest1836388-21kworker/1:0+events20:47:241
180476299193710,1924cyclictest1811326-21kworker/1:2+events20:12:141
18047589919373,1931cyclictest1838344-21kworker/0:0+events21:01:330
18047589919364,1929cyclictest1878819-21kworker/0:0+events22:57:480
18047689919359,1923cyclictest1840865-21kworker/3:1+events21:12:363
18047659919359,1923cyclictest1814294-21kworker/2:2+events19:48:522
18047589919339,1921cyclictest1874319-21kworker/0:1+events22:49:510
18047589919336,1924cyclictest1836474-21kworker/0:2+events21:09:570
18047589919325,1924cyclictest1846456-21kworker/0:2+events21:19:010
18047589919324,1925cyclictest1884169-21kworker/0:0+events23:40:320
18047689919298,1918cyclictest1815825-21kworker/3:1+events19:46:363
18047589919299,1917cyclictest1895114-21kworker/0:1+events23:48:100
18047589919299,1917cyclictest1862706-21kworker/0:2+events22:09:070
180475899192910,1916cyclictest1909959-21kworker/0:1+events00:33:530
180476599192610,1913cyclictest1880415-21kworker/2:0+events23:03:322
180476599192610,1913cyclictest1880415-21kworker/2:0+events23:03:322
180476899192210,1910cyclictest1812570-21kworker/3:0+events20:06:043
18047589919219,1909cyclictest1859913-21kworker/0:1+events22:04:160
18047589919214,1914cyclictest1804408-21kworker/0:2+events19:18:240
18047689919203,1914cyclictest1812570-21kworker/3:0+events20:00:453
18047689919196,1910cyclictest1808126-21kworker/3:0+events19:21:513
180476599191910,1906cyclictest1893695-21kworker/2:2+events23:46:152
18047589919199,1907cyclictest1817606-21kworker/0:0+events20:10:410
18047659919187,1908cyclictest1872697-21kworker/2:2+events22:48:192
18047589919176,1908cyclictest1851683-21kworker/0:0+events22:13:410
18047659919159,1903cyclictest1898410-21kworker/2:1+events00:08:012
18047659919159,1903cyclictest1822411-21kworker/2:0+events20:06:282
18047689919107,1900cyclictest1789883-21kworker/3:2+events19:15:473
18047659919059,1893cyclictest1901774-21kworker/2:0+events00:18:162
18047659919059,1893cyclictest1869483-21kworker/2:1+events22:38:302
18047659919058,1893cyclictest1853194-21kworker/2:0+events21:43:572
18047659919037,1893cyclictest1890401-21kworker/2:1+events23:32:502
18047659918979,1884cyclictest1814294-21kworker/2:2+events19:51:532
18047659918967,1886cyclictest1857962-21kworker/2:0+events22:10:422
18047659918918,1880cyclictest1806087-21kworker/2:0+events19:19:562
18047629918689,1856cyclictest1811326-21kworker/1:2+events20:16:061
18047629918668,1855cyclictest1861530-21kworker/1:2+events22:07:161
18047629918639,1851cyclictest1901863-21kworker/1:2+events00:09:081
18047629918369,1824cyclictest1883912-21kworker/1:0+events23:27:561
18043972162133,24sleep20-21swapper/219:08:182
18044802144113,26sleep10-21swapper/119:09:221
1804468214499,25sleep00-21swapper/019:09:120
18043102139106,29sleep30-21swapper/319:07:113
180476299169,5cyclictest1851935-21chrt21:35:081
180476299151,13cyclictest0-21swapper/123:15:141
1804758991312,1cyclictest0-21swapper/000:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional