You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 18:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #f, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackfslot7s.osadl.org (updated Fri Jan 02, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132419699583627,5805cyclictest1323655-21kworker/1:1+events19:11:231
132420499580721,5783cyclictest1322621-21kworker/3:1+events19:11:473
132419399323415,3215cyclictest1322323-21kworker/0:2+events19:12:100
132419699283614,2818cyclictest1420238-21kworker/1:0+events00:12:281
132419699271613,2698cyclictest1423593-21kworker/1:0+events00:25:191
132420499269411,2679cyclictest1341724-21kworker/3:1+events20:15:203
132420499264913,2634cyclictest1367362-21kworker/3:2+events21:30:103
132419399252612,2509cyclictest1407543-21kworker/0:2+events23:40:110
132419399239012,2375cyclictest1364366-21kworker/0:1+events21:15:160
132420499232812,2313cyclictest1385339-21kworker/3:2+events22:20:113
132419699232712,2311cyclictest1380482-21kworker/1:0+events22:10:201
13241939922579,2245cyclictest1388420-21kworker/0:1+events22:44:400
132419399224811,2235cyclictest1397926-21kworker/0:0+events23:00:070
13241939922418,2229cyclictest1414144-21kworker/0:1+events00:00:130
132419699223711,2221cyclictest1327497-21kworker/1:2+events19:20:111
132419699219111,2177cyclictest1383654-21kworker/1:1+events22:17:551
132419699218211,2168cyclictest1343148-21kworker/1:0+events20:09:171
13241969921798,2168cyclictest1407573-21kworker/1:2+events23:28:271
132419699217911,2165cyclictest1372623-21kworker/1:2+events21:40:531
132420099217811,2164cyclictest1426851-21kworker/2:1+events00:35:202
132419699217810,2165cyclictest1365973-21kworker/1:0+events21:50:271
13241969921736,2163cyclictest1407573-21kworker/1:2+events23:35:171
13241969921663,2159cyclictest1401483-21kworker/1:0+events23:33:221
13241969921639,2152cyclictest1365973-21kworker/1:0+events21:30:551
132420499215910,2146cyclictest1372473-21kworker/3:0+events21:38:103
132420499215611,2142cyclictest1379370-21kworker/3:1+events22:36:393
132420499215511,2141cyclictest1420272-21kworker/3:1+events00:11:393
13241969921559,2143cyclictest1365973-21kworker/1:0+events21:25:161
132420499215411,2140cyclictest1403059-21kworker/3:0+events23:19:383
132420499215411,2140cyclictest1364427-21kworker/3:0+events21:14:313
13242049921538,2142cyclictest1420272-21kworker/3:1+events00:18:533
132420499215210,2139cyclictest1357845-21kworker/3:0+events20:52:473
132420499215210,2139cyclictest1357845-21kworker/3:0+events20:52:473
13241939921477,2137cyclictest1341636-21kworker/0:1+events20:34:440
132420099214311,2129cyclictest1412463-21kworker/2:2+events23:50:472
132420099214310,2130cyclictest1353041-21kworker/2:2+events20:47:032
132420099214211,2128cyclictest1404522-21kworker/2:2+events23:34:092
13242049921308,2119cyclictest1330696-21kworker/3:2+events19:30:523
13241969921294,2121cyclictest1341514-21kworker/1:2+events20:28:111
132420499212810,2115cyclictest1328950-21kworker/3:1+events19:25:533
132420099212211,2108cyclictest1386880-21kworker/2:2+events22:24:032
132419399211910,2106cyclictest1414144-21kworker/0:1+events00:29:120
132419699211710,2104cyclictest1385521-21kworker/1:2+events22:27:061
13241969921168,2106cyclictest1403563-21kworker/1:2+events23:20:001
132419399211411,2100cyclictest1399707-21kworker/0:2+events23:16:340
132419399208310,2070cyclictest1385674-21kworker/0:0+events22:25:330
132419399208010,2067cyclictest1375616-21kworker/0:2+events21:56:110
13241939920779,2064cyclictest1354705-21kworker/0:2+events20:52:250
13241939920779,2064cyclictest1354705-21kworker/0:2+events20:52:250
13241939920778,2066cyclictest1427091-21kworker/0:0+events00:34:110
13241939920774,2070cyclictest1333762-21kworker/0:1+events19:45:450
132419399207610,2063cyclictest1335600-21kworker/0:2+events19:57:110
132419399207510,2062cyclictest1414144-21kworker/0:1+events00:17:230
13241939920748,2063cyclictest1364366-21kworker/0:1+events21:21:260
132419399207310,2060cyclictest1420147-21kworker/0:0+events00:08:380
132419399207310,2060cyclictest1407543-21kworker/0:2+events23:29:590
13241939920729,2060cyclictest1361008-21kworker/0:1+events21:01:560
13241939920727,2061cyclictest1361008-21kworker/0:1+events21:05:450
13241939920726,2063cyclictest1407543-21kworker/0:2+events23:48:300
13242049920713,2065cyclictest1405099-21kworker/3:2+events23:26:103
132419399207110,2058cyclictest1397926-21kworker/0:0+events22:57:010
132419399207010,2056cyclictest1371110-21kworker/0:1+events21:36:150
13241939920698,2058cyclictest1407543-21kworker/0:2+events23:51:580
13241939920698,2058cyclictest1388420-21kworker/0:1+events22:38:350
132420099206710,2054cyclictest1399949-21kworker/2:1+events23:28:482
132420099206610,2053cyclictest1402856-21kworker/2:0+events23:18:072
13241939920665,2058cyclictest1330546-21kworker/0:2+events19:32:240
13241939920663,2060cyclictest1388420-21kworker/0:1+events23:07:000
13242009920659,2053cyclictest1353041-21kworker/2:2+events20:42:262
13241939920657,2055cyclictest1354705-21kworker/0:2+events21:13:220
13241939920649,2053cyclictest1354705-21kworker/0:2+events20:45:100
132419399206410,2051cyclictest1390181-21kworker/0:2+events22:34:430
132419399206410,2051cyclictest1375616-21kworker/0:2+events22:04:390
13242009920608,2049cyclictest1336774-21kworker/2:0+events19:47:162
132419399205810,2046cyclictest1322323-21kworker/0:2+events19:19:470
132420499205610,2043cyclictest1334804-21kworker/3:2+events19:46:533
13241939920558,2045cyclictest1354705-21kworker/0:2+events21:40:060
13241939920553,2049cyclictest1427091-21kworker/0:0+events00:36:520
132420099205310,2041cyclictest1354736-21kworker/2:0+events20:59:402
13242009920529,2040cyclictest1332095-21kworker/2:2+events19:56:022
132419399204310,2030cyclictest1375616-21kworker/0:2+events21:54:380
13241939920339,2021cyclictest1344979-21kworker/0:0+events20:16:490
13241939920339,2021cyclictest1328915-21kworker/0:1+events19:23:150
13242009920267,2016cyclictest1374332-21kworker/2:1+events21:45:282
132420499202510,2012cyclictest1336836-21kworker/3:0+events19:50:393
132420499202210,2009cyclictest1398107-21kworker/3:1+events23:00:283
132419399201910,2006cyclictest1383539-21kworker/0:2+events22:22:540
132420499201811,2004cyclictest1412311-21kworker/3:0+events23:54:103
13241939920187,2008cyclictest1335600-21kworker/0:2+events19:51:470
132419699201610,2003cyclictest1364216-21kworker/1:2+events21:12:361
13241969920145,2006cyclictest1385521-21kworker/1:2+events22:31:171
13241939920139,2001cyclictest1381875-21kworker/0:1+events22:16:020
13241939920135,2005cyclictest1353011-21kworker/0:0+events20:42:490
13241969920129,1999cyclictest1322030-21kworker/1:0+events19:33:101
13242049920105,2002cyclictest1367362-21kworker/3:2+events21:25:393
13241969920099,1997cyclictest1376670-21kworker/1:2+events21:57:201
13241939920099,1997cyclictest1383539-21kworker/0:2+events22:14:510
132420499200810,1996cyclictest1396350-21kworker/3:0+events22:55:043
13241969920079,1995cyclictest1337042-21kworker/1:1+events19:56:251
13241969920075,1999cyclictest1416987-21kworker/1:2+events00:05:571
13241939920079,1995cyclictest1402947-21kworker/0:1+events23:34:560
13241939920074,2000cyclictest1393494-21kworker/0:2+events22:50:260
13241969920067,1996cyclictest1348091-21kworker/1:1+events20:39:421
13241939920069,1994cyclictest1351405-21kworker/0:2+events20:37:220
13242049920059,1993cyclictest1374135-21kworker/3:2+events21:46:373
13241939920058,1994cyclictest1423384-21kworker/0:0+events00:21:340
13241939920055,1997cyclictest1354705-21kworker/0:2+events21:32:500
132419399200510,1993cyclictest1323903-21kworker/0:0+events19:27:240
132419699200410,1991cyclictest1423593-21kworker/1:0+events00:23:511
13241939920046,1995cyclictest1371110-21kworker/0:1+events21:46:590
13241939920038,1992cyclictest1401308-21kworker/0:0+events23:11:130
13241939920037,1993cyclictest1414144-21kworker/0:1+events23:56:050
13241969920022,1997cyclictest1365973-21kworker/1:0+events21:39:201
13241969920019,1989cyclictest1335234-21kworker/1:2+events19:42:191
13241969920018,1990cyclictest1332441-21kworker/1:1+events19:37:241
13241939920019,1989cyclictest1414144-21kworker/0:1+events00:12:040
13241939920019,1989cyclictest1349507-21kworker/0:0+events20:28:590
13241939920008,1989cyclictest1341636-21kworker/0:1+events20:09:410
13241969919997,1989cyclictest1349719-21kworker/1:0+events20:30:531
132419699199910,1986cyclictest1401483-21kworker/1:0+events23:45:561
132419699199910,1986cyclictest1394954-21kworker/1:2+events22:52:001
13241969919989,1985cyclictest1354522-21kworker/1:0+events21:05:201
13241939919988,1987cyclictest1343383-21kworker/0:2+events20:11:120
132419399199810,1985cyclictest1402947-21kworker/0:1+events23:21:580
13241969919979,1985cyclictest1337042-21kworker/1:1+events19:50:161
13241939919976,1988cyclictest1323903-21kworker/0:0+events19:40:510
13241939919969,1984cyclictest1377399-21kworker/0:0+events22:06:070
13241969919958,1984cyclictest1418635-21kworker/1:1+events00:04:251
132419699199410,1981cyclictest1398198-21kworker/1:2+events23:09:171
132419699199410,1981cyclictest1365973-21kworker/1:0+events21:19:551
13242049919909,1979cyclictest1356241-21kworker/3:2+events21:00:253
13241939919909,1978cyclictest1367603-21kworker/0:0+events21:29:010
13241969919887,1978cyclictest1346374-21kworker/1:0+events20:22:321
132419699198610,1973cyclictest1423593-21kworker/1:0+events00:34:331
132419699198610,1973cyclictest1390057-21kworker/1:1+events22:43:081
13241969919857,1975cyclictest1376670-21kworker/1:2+events22:05:451
13241969919849,1972cyclictest1378794-21kworker/1:1+events22:02:181
13241969919829,1970cyclictest1329125-21kworker/1:1+events19:28:331
13241969919826,1973cyclictest1361042-21kworker/1:1+events21:23:211
132419699198210,1969cyclictest1401483-21kworker/1:0+events23:59:081
13241969919819,1969cyclictest1403563-21kworker/1:2+events23:16:111
13241969919819,1969cyclictest1396560-21kworker/1:1+events23:11:371
132419699198110,1969cyclictest1396560-21kworker/1:1+events23:00:521
13242049919746,1965cyclictest1412311-21kworker/3:0+events23:59:523
13242049919745,1966cyclictest1351439-21kworker/3:0+events20:40:523
13241969919747,1964cyclictest1429910-21kworker/1:1+events00:37:131
13242049919738,1962cyclictest1361131-21kworker/3:0+events21:06:313
132420499197310,1960cyclictest1379370-21kworker/3:1+events22:13:223
13242049919728,1961cyclictest1340044-21kworker/3:2+events20:00:333
132420499197210,1959cyclictest1372473-21kworker/3:0+events21:55:483
13242049919720,1969cyclictest1341724-21kworker/3:1+events20:08:553
13242049919718,1960cyclictest1405099-21kworker/3:2+events23:30:423
132420499197110,1958cyclictest1353101-21kworker/3:1+events20:49:203
13242049919708,1958cyclictest1428339-21kworker/3:1+events00:39:093
13242049919702,1965cyclictest1364427-21kworker/3:0+events21:24:543
132420499197010,1957cyclictest1379370-21kworker/3:1+events22:16:463
13241969919709,1958cyclictest1341514-21kworker/1:2+events20:01:421
13241939919708,1959cyclictest1323903-21kworker/0:0+events19:38:090
132420499196910,1956cyclictest1405099-21kworker/3:2+events23:24:373
13242049919667,1956cyclictest1362732-21kworker/3:1+events21:15:383
13242049919646,1955cyclictest1386968-21kworker/3:0+events22:25:113
132420499196410,1951cyclictest1379370-21kworker/3:1+events22:01:543
13242049919634,1956cyclictest1347880-21kworker/3:2+events20:35:523
13242009919626,1953cyclictest1340160-21kworker/2:0+events20:12:392
13241939919629,1950cyclictest1341636-21kworker/0:1+events20:23:180
13242049919619,1949cyclictest1401431-21kworker/3:2+events23:13:313
13242009919619,1949cyclictest1420419-21kworker/2:0+events00:26:082
13241969919618,1950cyclictest1383654-21kworker/1:1+events22:21:211
13241939919614,1954cyclictest1388420-21kworker/0:1+events22:49:420
132420499196010,1947cyclictest1332305-21kworker/3:1+events19:44:573
13242049919595,1950cyclictest1336836-21kworker/3:0+events19:57:363
132420499195910,1946cyclictest1410635-21kworker/3:1+events23:37:343
13242009919593,1953cyclictest1410573-21kworker/2:1+events23:39:262
132420499195810,1945cyclictest1420272-21kworker/3:1+events00:20:243
13241969919585,1950cyclictest1416987-21kworker/1:2+events00:18:321
13242009919577,1942cyclictest1341812-21kworker/2:2+events20:29:212
132420099195310,1940cyclictest1399949-21kworker/2:1+events23:24:152
132420499195110,1938cyclictest1398107-21kworker/3:1+events23:07:203
13242009919516,1941cyclictest1349392-21kworker/2:0+events20:33:562
13241969919519,1939cyclictest1401483-21kworker/1:0+events23:53:471
13242049919509,1938cyclictest1405099-21kworker/3:2+events23:40:573
13242049919509,1938cyclictest1379370-21kworker/3:1+events22:32:043
13242049919499,1937cyclictest1345249-21kworker/3:0+events20:21:243
13242009919498,1938cyclictest1398168-21kworker/2:0+events23:03:322
13242009919498,1938cyclictest1388573-21kworker/2:1+events22:46:352
132420099194910,1936cyclictest1377103-21kworker/2:2+events21:52:202
13242009919487,1938cyclictest1418785-21kworker/2:2+events00:13:142
13242009919485,1940cyclictest1396501-21kworker/2:2+events22:53:552
13242009919484,1941cyclictest1345040-21kworker/2:1+events20:20:382
13241969919489,1936cyclictest1341514-21kworker/1:2+events20:10:251
132420499194710,1934cyclictest1412311-21kworker/3:0+events00:27:173
13242009919478,1936cyclictest1369254-21kworker/2:2+events21:27:532
13242009919474,1940cyclictest1341812-21kworker/2:2+events20:05:552
13242009919469,1934cyclictest1338531-21kworker/2:1+events19:54:312
132420099194610,1933cyclictest1418785-21kworker/2:2+events00:09:472
132420099194610,1933cyclictest1366035-21kworker/2:0+events21:21:502
13242009919453,1939cyclictest1361220-21kworker/2:1+events21:08:472
13242009919449,1932cyclictest1351410-21kworker/2:1+events20:38:322
13241969919447,1935cyclictest1365973-21kworker/1:0+events21:45:041
13242009919427,1932cyclictest1371036-21kworker/2:1+events21:35:512
132420099194210,1930cyclictest1359446-21kworker/2:2+events21:00:042
132420099194210,1929cyclictest1356649-21kworker/2:1+events20:53:562
132420099194210,1929cyclictest1356649-21kworker/2:1+events20:53:552
13241939919429,1930cyclictest1338404-21kworker/0:0+events20:02:290
13242049919419,1929cyclictest1357845-21kworker/3:0+events20:55:493
13242009919416,1932cyclictest1396501-21kworker/2:2+events22:58:562
132420099193911,1927cyclictest1325452-21kworker/2:0+events19:15:082
13242009919386,1929cyclictest1333914-21kworker/2:1+events19:44:342
13242049919369,1924cyclictest1379370-21kworker/3:1+events22:09:123
132419699193610,1925cyclictest1354522-21kworker/1:0+events20:55:031
13241969919317,1921cyclictest1341514-21kworker/1:2+events20:17:351
13241969919317,1921cyclictest1322030-21kworker/1:0+events19:19:001
13241969919309,1918cyclictest1390057-21kworker/1:1+events22:46:591
13241969919298,1918cyclictest1354522-21kworker/1:0+events21:01:101
13241969919278,1916cyclictest1401483-21kworker/1:0+events23:43:371
13241969919273,1921cyclictest1322030-21kworker/1:0+events19:49:321
13241969919205,1912cyclictest1390057-21kworker/1:1+events22:36:141
13241969919199,1907cyclictest1393315-21kworker/1:0+events22:57:471
132420499191710,1904cyclictest1375736-21kworker/3:1+events21:53:313
13241969919179,1905cyclictest1356419-21kworker/1:1+events20:48:341
132420499191510,1902cyclictest1332305-21kworker/3:1+events19:35:523
13242009919149,1902cyclictest1366035-21kworker/2:0+events21:31:182
13242009919148,1903cyclictest1372654-21kworker/2:0+events21:42:022
13242009919148,1903cyclictest1362822-21kworker/2:2+events21:12:112
13241969919143,1908cyclictest1354522-21kworker/1:0+events20:50:051
13241969919143,1908cyclictest1354522-21kworker/1:0+events20:50:041
13242049919114,1904cyclictest1391902-21kworker/3:0+events22:40:273
132420499190910,1896cyclictest1320834-21kworker/3:0+events19:19:253
13242009919099,1897cyclictest1386880-21kworker/2:2+events22:27:292
132420099190910,1897cyclictest1388573-21kworker/2:1+events22:40:062
13242009919070,1904cyclictest1420419-21kworker/2:0+events00:15:312
132420499190510,1892cyclictest1412311-21kworker/3:0+events00:02:313
13242049919044,1897cyclictest1370859-21kworker/3:1+events21:41:153
132420499190410,1891cyclictest1343325-21kworker/3:2+events20:11:343
13242049918978,1886cyclictest1420272-21kworker/3:1+events00:09:023
13242049918974,1890cyclictest1320834-21kworker/3:0+events19:22:063
132420099189710,1884cyclictest1425154-21kworker/2:2+events00:22:182
13242049918969,1884cyclictest1393526-21kworker/3:2+events22:53:103
132420499189610,1883cyclictest1347880-21kworker/3:2+events20:31:393
13242009918963,1890cyclictest1378823-21kworker/2:0+events22:01:092
13242009918957,1885cyclictest1374332-21kworker/2:1+events21:57:422
132420099189510,1882cyclictest1315991-21kworker/2:1+events19:21:202
13242049918948,1883cyclictest1347880-21kworker/3:2+events20:27:503
13242049918944,1887cyclictest1412311-21kworker/3:0+events23:45:323
13242009918929,1880cyclictest1426851-21kworker/2:1+events00:30:442
13242009918929,1880cyclictest1338531-21kworker/2:1+events20:01:192
13242009918924,1885cyclictest1345040-21kworker/2:1+events20:18:202
13242049918919,1879cyclictest1393526-21kworker/3:2+events22:49:183
132420499189010,1877cyclictest1428339-21kworker/3:1+events00:33:253
13242009918875,1879cyclictest1408024-21kworker/2:0+events23:47:242
132420099188510,1872cyclictest1383829-21kworker/2:1+events22:19:262
13242009918845,1876cyclictest1388573-21kworker/2:1+events22:31:412
132420099188310,1870cyclictest1414092-21kworker/2:1+events00:04:012
132420099188310,1870cyclictest1399949-21kworker/2:1+events23:13:082
13242009918829,1870cyclictest1330485-21kworker/2:0+events19:28:082
13242009918816,1872cyclictest1386880-21kworker/2:2+events22:35:292
13242009918805,1872cyclictest1374332-21kworker/2:1+events22:05:022
13242009918804,1873cyclictest1362822-21kworker/2:2+events21:17:582
13241969918788,1867cyclictest1352863-21kworker/1:2+events20:42:011
13242009918779,1865cyclictest1408024-21kworker/2:0+events23:44:232
13242009918685,1860cyclictest1380452-21kworker/2:2+events22:11:302
13242009918178,1806cyclictest1396501-21kworker/2:2+events23:07:442
13242009918169,1804cyclictest1330485-21kworker/2:0+events19:30:292
13242009918159,1803cyclictest1414092-21kworker/2:1+events23:57:592
13242009918075,1799cyclictest1315991-21kworker/2:1+events19:13:162
13238122154111,24sleep10-21swapper/119:08:201
13239062151105,27sleep00-21swapper/019:09:310
13239422142109,28sleep30-21swapper/319:09:573
13238182137108,24sleep20-21swapper/219:08:242
132420099127125,1cyclictest1332095-21kworker/2:2+pm19:39:562
132419399141,2cyclictest0-21swapper/023:35:130
132419399141,1cyclictest0-21swapper/020:55:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional