You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-30 - 05:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sun Nov 30, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
188643021030,1sleep30-21swapper/321:35:233
20653332340,1sleep10-21swapper/123:28:061
1687539992724,1cyclictest0-21swapper/322:30:003
1687539992320,1cyclictest0-21swapper/323:50:003
1687539992320,1cyclictest0-21swapper/323:25:013
1687539992219,1cyclictest0-21swapper/320:40:193
168753999211,14cyclictest2131110-21taskset00:10:003
168753999211,14cyclictest2033913-21turbostat23:10:003
1687539992017,1cyclictest0-21swapper/321:10:163
1687539992017,1cyclictest0-21swapper/320:25:173
1687539992017,1cyclictest0-21swapper/300:10:143
1687539992017,1cyclictest0-21swapper/300:00:003
147598200,3rtkit-daemon1693936-21munin-node19:54:252
168753999192,7cyclictest2122760-21turbostat00:05:003
1687539991916,1cyclictest0-21swapper/322:54:593
1687539991916,1cyclictest0-21swapper/321:30:013
168753999191,14cyclictest2049981-21turbostat23:20:013
1687539991815,1cyclictest0-21swapper/300:18:373
168753999181,13cyclictest1929461-21taskset22:05:013
168753999181,13cyclictest1921599-21taskset22:00:153
168753999181,13cyclictest1852412-21taskset21:15:183
168753999181,12cyclictest2172079-21taskset00:35:013
168753999181,12cyclictest2155798-21taskset00:25:153
168753999181,12cyclictest1733549-21turbostat19:45:003
21232552170,9sleep22123259-21ssh00:05:032
21130842170,9sleep22113090-21ssh23:56:292
1687539991715,1cyclictest0-21swapper/322:45:153
1687539991714,1cyclictest0-21swapper/321:55:003
1687539991714,1cyclictest0-21swapper/319:30:203
1687539991714,1cyclictest0-21swapper/319:15:163
168753999171,13cyclictest1990820-21taskset22:40:183
168753999171,13cyclictest1905017-21turbostat21:50:003
168753999171,12cyclictest2098843-21chrt23:50:043
168753999171,12cyclictest1972216-21taskset22:30:173
168753999171,12cyclictest1939901-21taskset22:10:173
168753999171,12cyclictest1878953-21taskset21:31:103
168753999170,13cyclictest1766666-21chrt20:10:183
19269842161,2sleep10-21swapper/122:00:271
168753999161,12cyclictest2169356-21taskset00:30:243
168753999161,12cyclictest2153813-21chrt00:21:453
168753999161,12cyclictest2066426-21taskset23:30:093
168753999161,12cyclictest2061043-21taskset23:25:193
168753999161,12cyclictest2035699-21taskset23:10:173
168753999161,12cyclictest2024420-21chrt23:01:353
168753999161,12cyclictest1983660-21taskset22:35:383
168753999161,12cyclictest1983660-21taskset22:35:383
168753999161,12cyclictest1959594-21taskset22:20:563
168753999161,12cyclictest1951665-21taskset22:16:073
168753999161,12cyclictest1895021-21taskset21:41:003
168753999161,12cyclictest1863669-21taskset21:23:093
168753999161,12cyclictest1834191-21turbostat21:05:013
168753999161,12cyclictest1827904-21turbostat21:00:013
168753999161,12cyclictest1752289-21taskset19:55:373
168753999161,12cyclictest1727099-21taskset19:38:093
168753999161,12cyclictest1714044-21chrt19:25:223
168753999161,12cyclictest1707694-21taskset19:20:223
168753999161,11cyclictest2010072-21taskset22:55:143
168753999160,9cyclictest1921098-21taskset21:59:563
168753999160,13cyclictest1819102-21chrt20:50:193
19429112151,10sleep01943030-21/usr/sbin/munin22:10:240
16952232151,11sleep01695999-21python319:15:030
1687539991512,1cyclictest0-21swapper/323:35:183
1687539991512,1cyclictest0-21swapper/320:35:383
1687539991512,1cyclictest0-21swapper/319:45:153
168753999151,12cyclictest2089976-21chrt23:44:153
168753999151,12cyclictest1796384-21taskset20:33:443
168753999151,12cyclictest1783625-21chrt20:20:323
168753999151,11cyclictest1840385-21taskset21:09:293
168753999151,11cyclictest1815037-21chrt20:46:383
168753999151,11cyclictest1758637-21taskset20:01:463
168753999150,12cyclictest1759139-21chrt20:05:023
168753999150,12cyclictest1745765-21chrt19:51:003
1687539991411,1cyclictest0-21swapper/320:15:173
168753999140,11cyclictest1693161-21taskset19:10:243
19999262130,4sleep11999934-21ssh22:45:591
19751852131,5sleep01975356-21timerwakeupswit22:30:230
19551102130,10sleep11956622-21cut22:20:181
18796952130,2sleep00-21swapper/021:32:520
16870572131,8sleep21687058-21sshd19:05:262
147598130,6rtkit-daemon1540-21sendmail-mta22:06:041
20338902120,9sleep22033957-21sed23:10:012
16870952120,2sleep30-21swapper/319:05:563
147598120,8rtkit-daemon1726652-21cat19:35:252
147598120,4rtkit-daemon214-21plymouthd00:14:091
21224282110,3sleep02122435-21sh00:04:210
21058492110,8sleep02105857-21ssh23:53:180
20745282110,8sleep02074567-21apt-get23:35:110
19681112111,8sleep01968118-21sh22:27:020
18269782110,7sleep11827037-21ntp_states20:55:221
17984272111,7sleep11800425-21grep20:35:191
17526302110,3sleep11752695-21munin-run20:00:001
17154072110,7sleep11716062-21sed19:30:191
147598110,7rtkit-daemon2120262-21ntpq00:00:221
147598110,7rtkit-daemon1951635-21ssh22:16:022
147598110,7rtkit-daemon1540-21sendmail-mta21:46:241
147598110,6rtkit-daemon515-21gmain00:28:121
19774322100,7sleep11977675-21ssh22:35:011
19774322100,7sleep11977675-21ssh22:35:001
18162402100,2sleep10-21swapper/120:50:181
17024842101,5sleep11702517-21apt-get19:20:131
16974842100,7sleep11698594-21cat19:15:201
147598100,7rtkit-daemon515-21gmain20:29:372
147598100,6rtkit-daemon313-21systemd-udevd20:17:432
147598100,6rtkit-daemon2113212-21ssh23:56:451
147598100,6rtkit-daemon1540-21sendmail-mta22:39:292
147598100,6rtkit-daemon1540-21sendmail-mta22:39:282
147598100,5rtkit-daemon1994116-21df22:45:150
147598100,2rtkit-daemon720-21snmpd23:45:410
147598100,2rtkit-daemon1873546-21ssh21:30:161
147598100,1rtkit-daemon0-21swapper/123:00:291
2139829290,6sleep12140145-21cut00:15:161
2097142290,1sleep10-21swapper/123:47:111
2074178291,6sleep22074186-21ssh23:34:572
2004686293,3sleep12006718-21kthreadcore22:50:201
1945631291,5sleep01945795-21/usr/sbin/munin22:15:150
1919824290,1sleep00-21swapper/021:56:570
1882407290,3sleep11884209-21kthreadcore21:35:181
1863068290,6sleep21863076-21ssh21:21:442
1833321290,6sleep11833400-21find21:00:231
1808209291,5sleep21808314-21cat20:40:252
1803429290,6sleep01803926-21sed20:40:190
1754383290,7sleep21756345-21kthreadcore20:00:202
1710149296,1sleep10-21swapper/119:25:181
14759890,5rtkit-daemon22110-21packagekitd20:39:132
14759890,5rtkit-daemon214-21plymouthd23:41:230
14759890,5rtkit-daemon214-21plymouthd22:43:460
14759890,5rtkit-daemon2112812-21kworker/u16:2+rpciod00:21:091
14759890,4rtkit-daemon214-21plymouthd19:32:572
14759890,4rtkit-daemon2014217-21grep22:55:201
14759890,3rtkit-daemon720-21snmpd21:12:541
14759890,1rtkit-daemon0-21swapper/100:36:561
2154837280,1sleep20-21swapper/200:24:152
2146664280,6sleep02146672-21ssh00:18:520
2138955280,1sleep20-21swapper/200:14:362
2105417281,5sleep12105425-21sh23:52:241
2089529280,1sleep20-21swapper/223:43:112
2066436281,3sleep02066469-21apt-get23:30:110
2050316282,3sleep02050349-21apt-get23:20:130
1991670280,2sleep10-21swapper/122:40:301
1968402280,3sleep21968410-21ssh22:27:492
1926862280,6sleep01926983-21ssh22:00:260
1889507281,4sleep01890227-21sed21:40:180
1878144281,4sleep21878274-21mailstats21:30:222
1853875281,4sleep11853939-21ssh21:15:221
1765857281,5sleep21766664-21cut20:10:182
1758281281,4sleep01758527-21users20:00:270
1757999280,5sleep11758058-21ntpq20:00:231
1686343280,5sleep01681493-21/usr/sbin/munin19:05:210
14759880,5rtkit-daemon729-21lldpd21:59:501
14759880,5rtkit-daemon1693936-21munin-node23:16:320
14759880,4rtkit-daemon730-21ntpd23:15:122
14759880,4rtkit-daemon214-21plymouthd23:36:051
14759880,4rtkit-daemon214-21plymouthd21:54:471
14759880,4rtkit-daemon214-21plymouthd20:21:352
14759880,4rtkit-daemon2033182-21ssh23:08:151
14759880,4rtkit-daemon1886377-21python321:35:230
14759880,4rtkit-daemon1878984-21kworker/u16:2-xprtiod22:40:262
14759880,4rtkit-daemon1738204-21kthreadcore19:45:202
14759880,4rtkit-daemon1714733-21runrttasks19:30:002
14759880,4rtkit-daemon1693936-21munin-node21:01:392
14759880,4rtkit-daemon1693936-21munin-node20:31:242
14759880,4rtkit-daemon1692106-21cut19:10:202
14759880,4rtkit-daemon1-21systemd00:34:221
14759880,3rtkit-daemon761-21gmain22:15:002
14759880,3rtkit-daemon1818422-21cut20:50:182
14759880,1rtkit-daemon0-21swapper/223:13:182
14759880,1rtkit-daemon0-21swapper/121:42:591
2172146271,3sleep02172310-21diskstats00:35:140
2124595270,4sleep10-21swapper/100:05:181
2114607271,3sleep00-21swapper/000:00:000
2040198270,2sleep0214-21plymouthd23:10:510
2027874270,4sleep02029861-21grep23:05:170
2025797270,1sleep00-21swapper/023:04:500
2017813270,5sleep02018058-21cat23:00:000
1996199271,4sleep20-21swapper/222:45:202
1912839270,2sleep21878984-21kworker/u16:2+rpciod21:54:262
1898734270,4sleep01899971-21cut21:45:190
1871312270,1sleep10-21swapper/121:27:121
1836934270,5sleep21839028-21kthreadcore21:05:212
1815300270,4sleep01815317-21munin-run20:50:010
1751792270,1sleep00-21swapper/019:55:230
1726934270,2sleep0214-21plymouthd19:36:030
1681492270,2sleep10-21swapper/119:05:131
14759870,4rtkit-daemon720-21snmpd20:08:432
14759870,4rtkit-daemon720-21snmpd19:23:572
14759870,4rtkit-daemon214-21plymouthd21:11:022
14759870,3rtkit-daemon730-21ntpd22:30:372
14759870,3rtkit-daemon730-21ntpd22:10:101
14759870,3rtkit-daemon730-21ntpd19:40:142
14759870,3rtkit-daemon720-21snmpd20:55:172
14759870,3rtkit-daemon214-21plymouthd21:25:242
14759870,3rtkit-daemon2066386-21ssh23:30:041
14759870,3rtkit-daemon2064588-21ssh23:26:212
14759870,3rtkit-daemon1693936-21munin-node21:19:312
14759870,3rtkit-daemon1693936-21munin-node19:15:262
14759870,3rtkit-daemon1693936-21munin-node00:05:560
14759870,3rtkit-daemon1-21systemd22:21:542
14759870,3rtkit-daemon1-21systemd20:45:202
14759870,2rtkit-daemon214-21plymouthd22:50:060
14759870,1rtkit-daemon0-21swapper/219:55:022
2177983260,1sleep20-21swapper/200:35:372
2171748260,1sleep00-21swapper/000:34:510
2171035260,1sleep20-21swapper/200:33:122
2162947260,4sleep00-21swapper/000:28:540
2154026260,1sleep00-21swapper/000:22:240
2139442261,2sleep20-21swapper/200:15:132
2137888260,1sleep00-21swapper/000:12:100
2120964260,1sleep20-21swapper/200:00:542
2105805260,1sleep20-21swapper/223:53:132
2097642260,1sleep20-21swapper/223:48:242
2088781260,4sleep10-21swapper/123:41:301
2056510260,1sleep10-21swapper/123:21:141
2052454262,2sleep2431ktimers/223:20:192
2042715260,3sleep12043283-21ps23:15:161
2040298260,1sleep12040302-21ssh23:11:041
2025491261,3sleep22025497-21ssh23:04:122
2007919260,1sleep20-21swapper/222:50:532
1975846260,1sleep10-21swapper/122:31:121
1935379260,4sleep0214-21plymouthd22:05:390
1932801260,4sleep21934563-21sed22:05:212
1922323261,3sleep20-21swapper/222:00:202
1920606260,1sleep20-21swapper/221:58:432
1902054261,2sleep20-21swapper/221:45:212
1891362262,2sleep244-21ksoftirqd/221:40:202
1880937260,1sleep20-21swapper/221:35:112
1870805260,1sleep00-21swapper/021:25:590
1863913260,1sleep10-21swapper/121:23:401
1855511260,4sleep00-21swapper/021:17:540
1834424261,2sleep00-21swapper/021:05:150
1827824260,1sleep00-21swapper/020:59:220
1815023260,1sleep10-21swapper/120:46:281
1803927261,2sleep10-21swapper/120:40:201
1796382260,1sleep10-21swapper/120:33:431
1796142260,1sleep00-21swapper/020:30:410
1773719261,2sleep10-21swapper/120:15:191
1771070260,1sleep10-21swapper/120:10:501
1764412261,2sleep10-21swapper/120:05:251
1764322261,2sleep00-21swapper/020:05:240
1745737260,1sleep00-21swapper/019:50:380
1726987260,1sleep10-21swapper/119:36:441
1720660260,1sleep00-21swapper/019:30:580
1714505260,1sleep00-21swapper/019:27:050
1708178260,1sleep00-21swapper/019:21:000
1693707260,1sleep00-21swapper/019:14:030
2155762250,2sleep20-21swapper/200:25:152
2080464250,2sleep2214-21plymouthd23:35:502
1962076251,2sleep10-21swapper/122:25:141
1953672250,2sleep00-21swapper/022:20:130
1911945250,3sleep00-21swapper/021:52:240
1856721250,2sleep0214-21plymouthd21:20:130
1842203250,3sleep01843737-21cut21:10:200
1840099250,1sleep10-21swapper/121:05:481
1828155250,2sleep00-21swapper/021:00:140
1797570250,3sleep01798426-21kthreadcore20:35:170
1784637250,2sleep10-21swapper/120:25:171
1783864250,3sleep10-21swapper/120:23:371
1772637250,2sleep0221rcuc/020:15:180
1767794250,3sleep01769883-21kthreadcore20:10:210
1736829250,3sleep01738742-21sed19:45:210
1731733251,2sleep10-21swapper/119:40:211
1729700250,2sleep00-21swapper/019:40:190
1693579250,3sleep10-21swapper/119:12:281
2017639240,2sleep22017645-21ssh22:59:392
1977755240,2sleep01977794-21apt-get22:35:120
1977755240,2sleep01977794-21apt-get22:35:120
1945542240,2sleep1214-21plymouthd22:15:091
1821478240,2sleep0214-21plymouthd20:53:370
1788418240,1sleep00-21swapper/020:25:200
1779268240,2sleep00-21swapper/020:20:190
1745845240,3sleep10-21swapper/119:52:021
2058351230,1sleep00-21swapper/023:25:060
1733773230,1sleep10-21swapper/119:45:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional