You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-13 - 21:24
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sun Oct 13, 2024 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19325822880,1sleep10-21swapper/110:33:571
18357552400,1chrt0-21swapper/009:30:190
19505712380,1chrt0-21swapper/310:45:163
1649601993026,3cyclictest2065893-21idleruntime-cro11:59:590
1649608992724,2cyclictest522-21in:imuxsock07:30:002
1649608992522,2cyclictest2120953-21cron12:35:012
1649606992420,2cyclictest1972692-21latency_hist11:00:001
1649606992415,8cyclictest0-21swapper/108:00:001
1649601992320,2cyclictest1847488-21sh09:39:590
1649611992210,1cyclictest0-21swapper/309:55:153
1649611992210,1cyclictest0-21swapper/308:05:133
1649608992218,2cyclictest3004-21cron10:50:002
164961199219,1cyclictest0-21swapper/311:10:243
164961199219,1cyclictest0-21swapper/309:30:133
1649611992118,1cyclictest0-21swapper/311:25:003
1649611992110,1cyclictest0-21swapper/309:15:003
1649611992110,1cyclictest0-21swapper/307:55:373
1649608992119,1cyclictest1694953-21idleruntime-cro07:44:592
1649608992117,2cyclictest0-21swapper/208:20:012
1649606992118,2cyclictest3004-21cron11:25:001
1649606992118,2cyclictest2065913-21munin-run11:59:591
1649601992116,3cyclictest1776506-21grep08:50:130
164961199209,1cyclictest0-21swapper/312:35:183
164961199209,1cyclictest0-21swapper/312:15:243
164961199209,1cyclictest0-21swapper/310:10:243
164961199209,1cyclictest0-21swapper/310:05:223
164961199209,1cyclictest0-21swapper/307:30:173
164961199208,2cyclictest1688765-21turbostat07:40:003
164961199208,1cyclictest0-21swapper/308:10:183
1649611992011,6cyclictest0-21swapper/308:20:013
1649611992010,1cyclictest0-21swapper/312:30:213
1649611992010,1cyclictest0-21swapper/310:04:243
1649611992010,1cyclictest0-21swapper/307:15:133
1649608992017,2cyclictest3004-21cron09:15:002
1649608992016,2cyclictest2121578-21cut12:35:152
1649601992018,1cyclictest1886658-21/usr/sbin/munin10:05:220
1649601992018,1cyclictest0-21swapper/010:25:000
164961199199,1cyclictest0-21swapper/310:25:203
164961199199,1cyclictest0-21swapper/310:25:203
164961199199,1cyclictest0-21swapper/307:10:183
164961199198,1cyclictest0-21swapper/311:50:173
164961199198,1cyclictest0-21swapper/307:45:013
1649611991916,1cyclictest0-21swapper/311:40:003
1649611991913,4cyclictest0-21swapper/310:50:173
1649611991910,1cyclictest0-21swapper/310:15:173
1649608991916,2cyclictest0-21swapper/212:05:002
1649608991915,3cyclictest500-21avahi-daemon11:00:002
1649608991915,3cyclictest1800803-21gpgconf09:10:012
1649606991916,2cyclictest0-21swapper/108:20:001
1649601991915,3cyclictest1701991-21tail07:50:140
164961199189,1cyclictest0-21swapper/308:25:163
164961199188,1cyclictest0-21swapper/312:05:193
164961199188,1cyclictest0-21swapper/311:45:193
164961199188,1cyclictest0-21swapper/311:40:103
164961199188,1cyclictest0-21swapper/308:40:003
164961199187,1cyclictest0-21swapper/310:35:143
1649611991815,1cyclictest0-21swapper/309:55:013
1649611991813,3cyclictest0-21swapper/311:00:003
1649611991812,4cyclictest0-21swapper/309:10:023
1649611991811,5cyclictest0-21swapper/310:40:223
1649611991810,1cyclictest0-21swapper/310:23:433
1649611991810,1cyclictest0-21swapper/307:53:093
1649608991815,2cyclictest514-21systemd-logind12:10:002
1649608991814,2cyclictest0-21swapper/208:00:002
1649606991816,1cyclictest0-21swapper/112:05:011
1649606991815,2cyclictest1870878-21latency_hist09:55:011
1649606991815,2cyclictest1664721-21irqcore07:20:151
1649606991814,2cyclictest0-21swapper/108:40:011
1649606991812,4cyclictest1886355-21cron10:04:591
1649601991816,1cyclictest0-21swapper/008:40:010
1649601991815,2cyclictest277-21plymouthd08:55:150
1649601991815,2cyclictest2082190-21apt-key12:10:000
1649601991815,2cyclictest2073938-21latency_hist12:05:010
1649601991815,2cyclictest1950617-21tr10:45:180
1649601991815,2cyclictest0-21swapper/011:39:590
1649601991811,6cyclictest1755027-21kworker/0:0+kacpid11:25:010
164961199178,1cyclictest0-21swapper/311:30:023
164961199177,1cyclictest0-21swapper/310:35:013
164961199177,1cyclictest0-21swapper/309:15:253
164961199176,2cyclictest1775719-21taskset08:47:213
1649611991711,4cyclictest0-21swapper/309:40:223
164961199170,14cyclictest1824185-21sleep09:25:003
1649608991714,2cyclictest501-21dbus-daemon10:30:012
1649608991714,2cyclictest501-21dbus-daemon10:30:002
1649608991714,2cyclictest1910497-21sed10:20:152
1649608991714,2cyclictest0-21swapper/207:35:002
1649608991713,3cyclictest1933026-21cron10:35:012
1649608991713,2cyclictest0-21swapper/210:40:002
1649606991714,2cyclictest2093151-21sed12:15:171
1649606991714,2cyclictest1800911-21apt-config09:10:011
1649606991714,2cyclictest1688746-21sendmail07:40:011
1649606991714,2cyclictest0-21swapper/111:40:001
1649606991714,2cyclictest0-21swapper/108:30:001
1649606991713,3cyclictest7550irq/9-acpi12:25:121
1649606991713,3cyclictest1856490-21irqcore09:45:151
1649606991712,4cyclictest1732235-21cron08:15:001
1649601991714,2cyclictest0-21swapper/009:55:000
1649601991713,2cyclictest0-21swapper/008:10:000
164961199167,1cyclictest0-21swapper/311:20:003
1649611991611,3cyclictest0-21swapper/311:58:463
1649611991611,2cyclictest1701379-21turbostat07:49:593
1649611991610,4cyclictest0-21swapper/312:20:213
1649611991610,4cyclictest0-21swapper/308:55:133
1649608991613,2cyclictest2026968-21cron11:35:002
1649608991613,2cyclictest1876184-21needreboot09:55:192
1649608991613,2cyclictest1847482-21sh09:39:592
1649608991613,2cyclictest1739195-21fschecks_time08:20:152
1649608991613,2cyclictest1720428-21fschecks_time08:05:152
1649608991613,2cyclictest0-21swapper/209:35:022
1649608991612,3cyclictest2010426-21sh11:22:342
1649608991612,2cyclictest0-21swapper/207:15:012
1649606991613,2cyclictest2119667-21sshd12:31:431
1649606991613,2cyclictest2082743-21gltestperf12:10:161
1649606991613,2cyclictest2036015-21irqrtprio11:40:131
1649606991613,2cyclictest0-21swapper/108:55:001
1649606991612,3cyclictest1896044-21kthreadcore10:10:161
1649606991612,3cyclictest1843048-21kthreadcore09:35:191
1649606991612,3cyclictest1-21systemd11:14:421
1649606991612,3cyclictest0-21swapper/112:35:151
1649606991612,2cyclictest1959975-21kthreadcore10:50:181
1649606991612,2cyclictest1918096-21fschecks_time10:25:151
1649606991612,2cyclictest1918096-21fschecks_time10:25:141
1649606991612,2cyclictest0-21swapper/111:50:141
1649606991612,2cyclictest0-21swapper/109:10:221
1649606991610,4cyclictest1-21systemd10:21:421
164960199169,2cyclictest0-21swapper/009:10:020
164960199161,5cyclictest1738024-21users08:15:230
1649601991613,2cyclictest508-21polkitd09:25:210
1649601991613,2cyclictest1871438-21gltestperf09:55:150
1649601991613,2cyclictest1800823-21apt-key09:10:010
1649601991613,2cyclictest0-21swapper/011:35:000
1649601991613,2cyclictest0-21swapper/011:30:010
1649601991613,2cyclictest0-21swapper/010:40:230
1649601991612,2cyclictest0-21swapper/011:15:150
164961199154,2cyclictest1862740-21taskset09:49:173
1649611991512,1cyclictest0-21swapper/312:11:073
1649611991512,1cyclictest0-21swapper/311:30:243
1649611991512,1cyclictest0-21swapper/311:05:543
1649611991512,1cyclictest0-21swapper/311:00:143
1649611991512,1cyclictest0-21swapper/309:29:353
1649608991513,1cyclictest1808950-21/usr/sbin/munin09:15:212
1649608991512,2cyclictest489-21rpcbind11:05:042
1649608991512,2cyclictest2098114-21cpuspeed_turbos12:20:152
1649608991512,2cyclictest2090421-21fschecks_time12:15:142
1649608991512,2cyclictest2036300-21irqrtprio11:40:142
1649608991512,2cyclictest1977730-21latency11:00:202
1649608991512,2cyclictest1907339-21ntp_kernel_pll_10:15:202
1649608991512,2cyclictest1894112-21cut10:10:002
1649608991512,2cyclictest1787842-21unixbench_singl08:55:242
1649608991512,2cyclictest1756727-21unixbench_multi08:30:222
1649608991512,2cyclictest1756727-21unixbench_multi08:30:222
1649608991512,2cyclictest1658530-21irqcore07:15:142
1649608991512,2cyclictest0-21swapper/208:40:012
1649608991511,3cyclictest277-21plymouthd08:45:002
1649608991511,3cyclictest1770681-21irqcore08:45:172
1649608991511,2cyclictest0-21swapper/210:15:002
1649606991512,2cyclictest1934253-21irqcore10:35:161
1649606991512,2cyclictest1905070-21kthreadcore10:15:181
1649606991512,2cyclictest1850833-21kthreadcore09:40:171
1649606991512,2cyclictest1694442-21unixbench-2d07:40:231
1649606991511,2cyclictest1674017-21kthreadcore07:25:181
1649606991511,2cyclictest0-21swapper/111:30:131
1649606991510,4cyclictest1872603-21kthreadcore09:55:161
1649606991510,3cyclictest0-21swapper/112:10:001
164960199159,4cyclictest3561480-21systemd-journal07:25:000
1649601991513,1cyclictest1800624-21diskmemload10:00:160
1649601991512,2cyclictest508-21polkitd11:00:010
1649601991512,2cyclictest2119136-21unixbench_singl12:30:240
1649601991512,2cyclictest2085281-21kthreadcore12:10:190
1649601991512,2cyclictest1988718-21gltestperf11:10:140
1649601991512,2cyclictest1938840-21unixbench-2d10:35:230
1649601991512,2cyclictest1824178-21munin-plugin-st09:25:010
1649601991512,2cyclictest1755027-21kworker/0:0+kacpid11:09:270
1649601991511,3cyclictest1689334-21gltestperf07:40:130
164960199150,1cyclictest0-21swapper/009:40:210
1649611991411,1cyclictest0-21swapper/312:25:153
1649611991411,1cyclictest0-21swapper/312:02:483
1649611991411,1cyclictest0-21swapper/309:00:133
1649611991411,1cyclictest0-21swapper/308:50:253
1649611991411,1cyclictest0-21swapper/308:30:183
1649611991411,1cyclictest0-21swapper/308:30:173
1649611991411,1cyclictest0-21swapper/308:00:193
1649611991411,1cyclictest0-21swapper/307:24:313
164960899149,4cyclictest1782090-21cron08:55:002
1649608991412,1cyclictest1863075-21systemd-run09:50:002
1649608991412,1cyclictest0-21swapper/209:20:152
1649608991411,2cyclictest2043570-21irqcore11:45:182
1649608991411,2cyclictest1825379-21irqcore09:25:142
1649608991411,2cyclictest1800624-21diskmemload11:15:192
1649608991411,2cyclictest1750552-21unixbench-2d08:25:222
1649608991411,2cyclictest1701894-21fschecks_time07:50:132
1649608991411,2cyclictest0-21swapper/211:55:132
1649608991411,2cyclictest0-21swapper/207:40:002
1649606991412,1cyclictest1715773-21kthreadcore08:00:171
1649606991412,1cyclictest0-21swapper/109:30:001
1649606991411,2cyclictest4094375-21kworker/u8:3-nfsiod09:30:171
1649606991411,2cyclictest2015883-21kthreadcore11:25:191
1649606991411,2cyclictest1977939-21ntp_kernel_pll_11:00:211
1649606991411,2cyclictest1884878-21kworker/u8:3-nfsiod10:10:011
1649606991411,2cyclictest1821782-21netstat09:20:221
1649606991411,2cyclictest1742120-21kthreadcore08:20:201
1649606991411,2cyclictest1677533-21irqrtprio07:30:161
1649606991411,2cyclictest0-21swapper/111:20:011
1649606991410,3cyclictest1782680-21gltestperf08:55:151
1649606991410,2cyclictest1941547-21cpuspeed_turbos10:40:141
1649606991410,2cyclictest0-21swapper/108:05:161
1649606991410,2cyclictest0-21swapper/107:15:021
164960199148,4cyclictest1663957-21cron07:20:010
1649601991412,1cyclictest0-21swapper/009:45:230
1649601991411,2cyclictest2050709-21cpu11:50:130
1649601991411,2cyclictest1918114-21cut10:25:150
1649601991411,2cyclictest1918114-21cut10:25:140
1649601991411,2cyclictest1902728-21irqcore10:15:160
1649601991411,2cyclictest1731285-21needreboot08:10:210
1649601991411,2cyclictest1695783-21gltestperf07:45:150
1649601991411,2cyclictest1655728-21turbostat07:15:000
1649601991411,2cyclictest1643365-21kworker/0:1+kacpid07:39:150
1649601991411,2cyclictest0-21swapper/012:40:010
1649601991410,3cyclictest277-21plymouthd11:49:590
1649601991410,3cyclictest2036475-21kthreadcore11:40:160
1649601991410,3cyclictest1930705-21grep10:30:210
1649611991311,1cyclictest0-21swapper/309:35:123
1649611991311,1cyclictest0-21swapper/308:20:123
1649611991310,1cyclictest0-21swapper/307:25:433
164960899136,2cyclictest1719941-21grep08:04:592
164960899133,3cyclictest2106110-21sed12:25:142
1649608991311,1cyclictest0-21swapper/209:00:132
1649608991310,2cyclictest431ktimers/207:25:012
1649608991310,2cyclictest1991049-21kthreadcore11:10:162
1649608991310,2cyclictest1957741-21irqcore10:50:172
1649608991310,2cyclictest1942286-21irqcore10:40:172
1649608991310,2cyclictest1868912-21unixbench_multi09:50:252
1649608991310,2cyclictest1731781-21unixbench_multi08:10:242
1649608991310,2cyclictest1696840-21kthreadcore07:45:172
1649608991310,2cyclictest0-21swapper/212:15:002
164960699139,3cyclictest1790990-21kthreadcore09:00:171
164960699138,4cyclictest1814156-21systemctl09:15:231
1649606991311,1cyclictest2047544-21kthreadcore11:45:191
1649606991311,1cyclictest1769975-21latency_hist08:45:001
1649606991310,2cyclictest547-21gdbus08:45:231
1649606991310,2cyclictest2100975-21kthreadcore12:20:201
1649606991310,2cyclictest1985994-21threads11:05:241
1649606991310,2cyclictest1756678-21unixbench-2d08:30:231
1649606991310,2cyclictest1756678-21unixbench-2d08:30:221
1649606991310,2cyclictest1699939-21kthreadcore07:45:181
1649606991310,2cyclictest1654774-21needreboot07:10:211
164960199139,3cyclictest501-21dbus-daemon08:45:230
164960199136,6cyclictest2072017-21kworker/0:1+kacpi_notify12:15:220
164960199136,5cyclictest3561480-21systemd-journal08:30:000
164960199135,6cyclictest547-21gdbus08:35:010
164960199135,6cyclictest547-21gdbus08:35:000
1649601991311,1cyclictest1755027-21kworker/0:0+kacpid10:10:010
1649601991311,1cyclictest1755027-21kworker/0:0+kacpid09:19:200
1649601991311,1cyclictest1755027-21kworker/0:0+kacpid08:40:130
1649601991311,1cyclictest1676716-21tr07:30:130
1649601991311,1cyclictest1643365-21kworker/0:1+kacpid08:24:100
1649601991311,1cyclictest1643365-21kworker/0:1+kacpid07:55:290
1649601991311,1cyclictest1643365-21kworker/0:1+kacpid07:27:390
164960199131,10cyclictest1956964-21apt-get10:50:120
1649601991310,2cyclictest2106500-21irqcore12:25:150
1649601991310,2cyclictest2100238-21kthreadcore12:20:190
1649601991310,2cyclictest0-21swapper/008:00:240
16491492130,1sleep30-21swapper/307:05:503
1649611991210,1cyclictest0-21swapper/308:40:163
164960899129,2cyclictest2051525-21irqcore11:50:162
164960899129,2cyclictest2027420-21cpuspeed_turbos11:35:122
164960899129,2cyclictest0-21swapper/209:40:132
1649608991210,1cyclictest1800624-21diskmemload10:00:082
1649608991210,1cyclictest0-21swapper/211:30:012
164960199129,2cyclictest1972962-21cpuspeed_turbos11:00:130
1649601991210,1cyclictest1755027-21kworker/0:0+kacpid09:00:020
164960699119,1cyclictest0-21swapper/110:45:171
164960699107,2cyclictest0-21swapper/107:50:131
16496089984,3cyclictest1649665-21cat07:10:002
16496019981,4cyclictest1649603-21latency_hist07:10:000
1649476280,4sleep11649538-21munin-run07:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional