You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 19:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Mon Mar 23, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14940459920420,2038cyclictest17675942sleep310:24:553
1494045993510,346cyclictest1885804-21turbostat11:44:553
1494045993250,321cyclictest1657109-21turbostat09:19:563
149404599181,14cyclictest1689432-21taskset09:35:033
149404599174,8cyclictest15475212sleep307:50:123
149404599165,7cyclictest16495862sleep309:10:093
149404599162,11cyclictest1947510-21taskset12:17:593
1494045991613,1cyclictest0-21swapper/309:05:013
149404599161,12cyclictest1838701-21taskset11:09:573
149404599161,11cyclictest1976460-21taskset12:35:193
149404599161,11cyclictest1862106-21taskset11:24:443
149404599161,11cyclictest1630009-21taskset08:54:553
149404599161,11cyclictest1617723-21taskset08:45:143
149404599161,11cyclictest1597263-21taskset08:25:203
149404599161,11cyclictest1591890-21taskset08:25:013
149404599161,11cyclictest1566005-21taskset08:01:023
149404599161,11cyclictest1541276-21taskset07:45:153
19411482151,5sleep11941821-21cut12:15:161
149404599155,7cyclictest1579070-21sleep08:19:543
1494045991513,1cyclictest0-21swapper/311:10:403
1494045991512,1cyclictest0-21swapper/312:29:263
1494045991512,1cyclictest0-21swapper/311:38:173
1494045991512,1cyclictest0-21swapper/310:02:583
149404599151,12cyclictest1935278-21taskset12:10:163
149404599151,12cyclictest1572926-21taskset08:10:013
149404599151,11cyclictest1970285-21taskset12:31:233
149404599151,11cyclictest1917273-21taskset12:00:013
149404599151,11cyclictest1681514-21taskset09:30:013
149404599151,11cyclictest1672393-21taskset09:24:033
149404599151,11cyclictest1636349-21taskset08:59:583
149404599151,11cyclictest1617005-21taskset08:41:003
149404599151,11cyclictest1610605-21taskset08:36:083
149404599151,11cyclictest1572467-21taskset08:07:203
149404599151,11cyclictest1508661-21taskset07:17:043
149404599151,10cyclictest1815485-21taskset10:55:123
149404599151,10cyclictest1720894-21taskset09:55:073
149404599150,12cyclictest1901380-21taskset11:49:543
149404599150,11cyclictest1534912-21taskset07:40:133
16758652140,4sleep11677753-21kthreadcore09:25:191
16607472140,7sleep11662568-21sed09:15:211
149404599141,9cyclictest1954554-21taskset12:20:523
149404599141,9cyclictest1703530-21chrt09:40:363
149404599141,9cyclictest1648345-21taskset09:05:223
149404599141,8cyclictest1744445-21taskset10:10:113
1494045991412,0cyclictest0-21swapper/312:06:233
1494045991412,0cyclictest0-21swapper/307:27:583
1494045991411,1cyclictest0-21swapper/311:25:193
1494045991411,1cyclictest0-21swapper/310:50:423
1494045991411,1cyclictest0-21swapper/310:15:433
149404599141,10cyclictest1915653-21taskset11:55:573
149404599141,10cyclictest1875613-21taskset11:30:183
149404599141,10cyclictest1852711-21taskset11:15:263
149404599141,10cyclictest1829443-21taskset11:00:383
149404599141,10cyclictest1797995-21taskset10:42:083
149404599141,10cyclictest1717246-21taskset09:50:193
149404599141,10cyclictest1710869-21taskset09:45:253
149404599141,10cyclictest1673554-21taskset09:25:163
149404599141,10cyclictest1604391-21taskset08:32:473
149404599141,10cyclictest1528295-21taskset07:35:113
149404599141,10cyclictest1527690-21taskset07:30:393
149404599141,10cyclictest1509361-21taskset07:20:123
149404599141,10cyclictest1500205-21taskset07:12:253
149404599140,11cyclictest1901761-21taskset11:50:113
149404599140,11cyclictest1799184-21taskset10:45:023
149404599140,10cyclictest1772606-21taskset10:25:203
149404599140,10cyclictest1772606-21taskset10:25:203
17944942130,3sleep0221rcuc/010:40:180
15729742132,8sleep11572971-21apt-get08:10:121
149404599132,8cyclictest15552912sleep307:55:183
149404599131,9cyclictest1783541-21taskset10:35:033
149404599131,9cyclictest1736557-21taskset10:05:073
149404599131,10cyclictest1781885-21taskset10:30:453
19636372120,9sleep01963643-21ssh12:29:520
19515472120,4sleep01953491-21tr12:20:180
15347642121,2sleep10-21swapper/107:40:111
15004592121,8sleep11501736-21tr07:15:011
14938632120,3sleep30-21swapper/307:09:153
19732702110,8sleep11974551-21grep12:35:191
19559362110,8sleep21956006-21ssh12:25:012
18857512111,7sleep21885755-21ssh11:39:562
18185902110,8sleep11820516-21cut10:55:201
17679842110,2sleep00-21swapper/010:25:140
17679842110,2sleep00-21swapper/010:25:130
16830522111,2sleep20-21swapper/209:30:172
14994152112,6sleep11499461-21ntpq07:10:211
19329182100,2sleep00-21swapper/012:10:070
19095572101,2sleep10-21swapper/111:55:121
18627112103,4sleep01862755-21cut11:25:140
18364502101,5sleep01836574-21ntpq11:05:210
17757902102,4sleep01775784-21apt-get10:30:120
17288102101,5sleep21728814-21ssh10:00:142
17153832100,1sleep20-21swapper/209:50:182
16109052101,6sleep21610907-21cron08:40:002
15535622101,5sleep11553573-21unix_chkpwd07:54:591
15219222100,7sleep11521972-21awk07:30:141
1978546290,4sleep01649262-21diskmemload12:37:500
1970641290,2sleep20-21swapper/212:32:272
1962573290,6sleep11962579-21ssh12:26:351
1877208290,6sleep11877214-21ssh11:32:501
1870036291,5sleep11870069-21munin-run11:30:001
1846876291,4sleep01846898-21apt-get11:15:120
1828730291,4sleep11828774-21ntpq11:00:211
1775953291,5sleep21776068-21perl10:30:132
1752248290,5sleep11752274-21ssh10:15:131
1751870290,3sleep21751876-21ssh10:14:532
1750716290,6sleep11750722-21ssh10:11:231
1734976290,7sleep11649262-21diskmemload10:01:081
1710715290,6sleep01710764-21ntpq09:45:230
1706323290,2sleep21706803-21ssh09:45:172
1704162291,5sleep01649262-21diskmemload09:42:310
1696961290,1sleep10-21swapper/109:39:421
1673059291,4sleep21673094-21apt-get09:25:122
1664045291,4sleep20-21swapper/209:17:262
1656837291,2sleep21656843-21ssh09:14:132
1655739292,4sleep11655742-21sh09:11:031
1636641292,4sleep11636674-21apt-get09:00:131
1611395290,5sleep11611594-21hddtemp_smartct08:40:151
1592099291,4sleep11592132-21apt-get08:25:121
1560246291,4sleep11560248-21apt-get08:00:131
1534448291,5sleep21-21systemd07:40:002
1520942290,6sleep01521133-21grep07:25:270
1490311291,5sleep11492300-21kthreadcore07:05:201
1978297280,5sleep21978303-21ssh12:37:082
1948482280,4sleep11948515-21apt-get12:20:111
1944726280,4sleep01945885-21memory12:15:190
1917808281,4sleep11918781-21irqrtprio12:00:161
1909885280,5sleep01910018-21ssh11:55:150
1904904280,5sleep01906819-21tr11:50:200
1899347281,4sleep01899396-21ntp_states11:45:240
1893587281,4sleep01893609-21apt11:45:000
1883605281,4sleep01883684-21ntpq11:35:200
1860931280,5sleep21860937-21ssh11:21:112
1860291280,5sleep01860387-21cat11:20:250
1848714280,6sleep21850523-21grep11:15:182
1836625280,5sleep21836676-21ntp_states11:05:232
1823005281,4sleep21823011-21ssh10:59:572
1814434281,4sleep21814143-21mconf10:53:162
1767224280,1sleep1171rcu_preempt10:23:471
1761834280,5sleep21763636-21kthreadcore10:20:192
1722158280,6sleep21723182-21cut09:55:152
1720005280,2sleep11720011-21ssh09:53:151
1689699280,2sleep21689894-21ssh09:35:152
1673107280,4sleep01673268-21diskstats09:25:140
1665412281,4sleep21665577-21gltestperf09:20:142
1617615281,4sleep21617720-21tr08:45:142
1617590281,3sleep11617612-21apt-get08:45:131
1541081281,4sleep01541113-21apt-get07:45:130
1514412281,4sleep01514440-21ntpq07:20:220
1494234281,3sleep01494267-21apt-get07:10:120
1489285280,5sleep01490308-21kthreadcore07:05:190
1956294270,4sleep21956454-21ssh12:25:122
1932005270,4sleep21932011-21ssh12:08:082
1931757270,1sleep00-21swapper/012:07:260
1914855271,3sleep21914896-21ntpq11:55:212
1892312270,5sleep11892318-21ssh11:41:081
1883686271,3sleep11883734-21ntpq11:35:211
1870333271,3sleep21870370-21apt-get11:30:102
1862952270,3sleep21863536-21ps11:25:172
1846515270,4sleep11846519-21ssh11:15:001
1832640270,4sleep11833711-21cut11:05:181
1829413271,3sleep21649262-21diskmemload11:00:342
1820895271,3sleep00-21swapper/010:55:230
1813857270,1sleep10-21swapper/110:52:511
1800706271,3sleep00-21swapper/010:45:150
1791454270,4sleep21791460-21ssh10:40:122
1784033270,5sleep21784876-21cut10:35:192
1783841270,5sleep11784030-21if_eno110:35:181
1774017271,2sleep20-21swapper/210:25:412
1774017271,2sleep20-21swapper/210:25:402
1760487270,4sleep01760993-21cut10:20:170
1752275271,4sleep21752233-21/usr/sbin/munin10:15:142
1743290270,5sleep21743294-21ssh10:07:322
1742711270,4sleep01649262-21diskmemload10:05:490
1731438270,5sleep01733313-21kthreadcore10:00:190
1726901270,1sleep00-21swapper/009:55:260
1726137270,4sleep11726281-21ntpq09:55:191
1713149271,3sleep01713152-21apt-get09:50:130
1705344271,3sleep11705347-21apt-get09:45:121
1697407270,3sleep21697413-21ssh09:40:122
1697367271,3sleep11697404-21apt-get09:40:111
1689521271,3sleep00-21swapper/009:35:120
1643093271,2sleep10-21swapper/109:05:141
1636841271,3sleep01637042-21hddtemp_smartct09:00:160
1624519271,4sleep11625412-21ps08:50:181
1623958270,4sleep21624114-21diskstats08:50:152
1580563273,2sleep11581626-21kthreadcore08:15:161
1568694271,3sleep20-21swapper/208:05:202
1566614271,3sleep00-21swapper/008:05:130
1556229270,4sleep01558193-21cut07:55:190
1548945271,3sleep01550181-21cut07:50:170
1521886271,3sleep01521919-21apt-get07:30:130
1515540271,3sleep11515573-21apt-get07:25:121
1509620270,5sleep11510169-21irqrtprio07:20:151
1508079270,4sleep01508201-21python307:15:240
1507995270,4sleep21508037-21ntpq07:15:232
1487828270,2sleep20-21swapper/207:05:132
1965490260,3sleep11966566-21cut12:30:171
1941823260,3sleep21942909-21cut12:15:182
1934185261,2sleep20-21swapper/212:10:162
1930597261,2sleep10-21swapper/112:05:231
1923386260,4sleep20-21swapper/212:00:372
1917325261,2sleep00-21swapper/012:00:110
1908405260,1sleep20-21swapper/211:52:362
1901701261,3sleep11901488-21appstreamcli11:50:011
1894719261,2sleep20-21swapper/211:45:172
1893197260,3sleep20-21swapper/211:43:542
1846824260,3sleep11846541-21apt-get11:15:051
1844235260,3sleep21844351-21ntpq11:10:202
1806529260,2sleep20-21swapper/210:49:222
1797509260,3sleep11797513-21ssh10:40:481
1790900260,1sleep00-21swapper/010:39:290
1775735260,1sleep11775741-21ssh10:30:081
1774830260,1sleep10-21swapper/110:28:121
1774830260,1sleep10-21swapper/110:28:111
1757666260,3sleep01757713-21ntp_states10:15:230
1749791260,4sleep01749840-21ntpq10:10:220
1743158261,2sleep10-21swapper/110:07:111
1681608260,3sleep10-21swapper/109:30:131
1672637261,2sleep10-21swapper/109:24:421
1671604260,1sleep00-21swapper/009:21:360
1657470261,2sleep00-21swapper/009:15:150
1651595260,3sleep01653406-21cut09:10:170
1648558260,3sleep21648709-21cat09:05:262
1632548261,3sleep11634504-21kthreadcore08:55:181
1624316260,4sleep01624409-21irqcore08:50:170
1617275260,1sleep00-21swapper/008:44:320
1609941260,3sleep11609985-21ntpq08:35:221
1604832261,2sleep00-21swapper/008:35:130
1599865261,3sleep11600017-21kthreadcore08:30:161
1598497261,2sleep00-21swapper/008:30:110
1567613260,4sleep11568073-21kthreadcore08:05:181
1563311261,2sleep00-21swapper/008:00:200
1560254260,1sleep20-21swapper/208:00:142
1554303260,3sleep21555290-21irqstats07:55:172
1542675261,2sleep20-21swapper/207:45:192
1541744261,2sleep10-21swapper/107:45:181
1539847261,3sleep21539891-21ntpq07:40:212
1534735261,2sleep00-21swapper/007:40:100
1529545260,3sleep11530579-21grep07:35:191
1528332261,2sleep01528328-21apt-get07:35:140
1515174260,1sleep20-21swapper/207:23:452
1499720260,3sleep21499894-21ls07:10:252
1964044250,2sleep00-21swapper/012:30:110
1932902250,2sleep11649262-21diskmemload12:10:041
1900374250,2sleep10-21swapper/111:46:581
1845291251,1sleep00-21swapper/011:11:180
1823387251,1sleep00-21swapper/011:00:110
1813994250,2sleep00-21swapper/010:53:140
1799218250,3sleep11799223-21diskmemload10:45:081
1688793250,3sleep00-21swapper/009:33:530
1623589250,2sleep01585499-21kworker/0:1+kacpid08:49:120
1611194250,2sleep20-21swapper/208:40:122
1592135250,2sleep20-21swapper/208:25:132
1591529251,2sleep2421rcuc/208:21:042
1591146251,2sleep00-21swapper/008:20:260
1585305250,1sleep20-21swapper/208:18:262
1579337250,2sleep00-21swapper/008:15:120
1577871251,2sleep01578048-21needreboot08:10:190
1574398251,2sleep20-21swapper/208:10:172
1547475250,1sleep20-21swapper/207:50:032
1523456250,2sleep20-21swapper/207:30:192
1520510251,2sleep21520648-21nfs4_client07:25:212
1856793240,2sleep10-21swapper/111:20:181
1643057240,2sleep00-21swapper/009:05:130
1641765240,1sleep20-21swapper/209:00:222
1600020240,2sleep20-21swapper/208:30:172
1588331241,1sleep10-21swapper/108:20:191
1553829240,1sleep10-21swapper/107:55:121
1870302230,1sleep00-21swapper/011:30:040
1630317230,1sleep00-21swapper/008:55:130
1630279230,1sleep20-21swapper/208:55:112
1592295230,1sleep00-21swapper/008:25:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional