You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-20 - 01:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sun Oct 19, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
169593327666,7sleep60-21swapper/615:24:476
1696438996661,4cyclictest2128518-21latency_hist18:45:467
169552025848,7sleep40-21swapper/415:22:364
168589525420,29sleep70-21swapper/715:20:557
169585325343,7sleep50-21swapper/515:24:225
1696438994641,4cyclictest1743155-21latency_hist15:45:477
1696428994644,2cyclictest2331995-21kworker/u16:3+events_unbound20:36:144
1696428994543,2cyclictest2095602-21kworker/u16:0+events_unbound19:26:304
1696438994338,4cyclictest2374857-21latency_hist20:40:477
1696428994341,2cyclictest1956257-21kworker/u16:0+events_unbound17:26:154
1696428994341,2cyclictest1956257-21kworker/u16:0+events_unbound17:26:154
1696438994237,4cyclictest1839372-21latency_hist16:30:477
1696428994240,2cyclictest1706448-21kworker/u16:0+events_unbound15:37:314
1696428994037,2cyclictest2052006-21kworker/u16:4+flush-8:018:31:114
1696431993835,2cyclictest1884595-21kworker/u16:4+events_unbound17:01:025
1696428993836,2cyclictest2246081-21kworker/u16:1+events_unbound19:43:304
1696428993836,2cyclictest1653894-21kworker/u16:3+events_unbound16:12:484
1696428993835,2cyclictest2095602-21kworker/u16:0+events_unbound20:27:304
1696431993734,2cyclictest1838553-21kworker/u16:0+flush-8:016:50:475
1696428993634,2cyclictest2289053-21kworker/u16:4+events_unbound20:34:294
1696428993634,2cyclictest2289053-21kworker/u16:4+events_unbound20:34:294
1696428993634,2cyclictest2064257-21kworker/u16:2+events_unbound19:17:314
1696428993634,2cyclictest2064257-21kworker/u16:2+events_unbound18:48:224
1696428993533,2cyclictest2246081-21kworker/u16:1+events_unbound19:51:314
1696428993533,2cyclictest1674039-21kworker/u16:2+events_unbound15:53:474
1696428993432,2cyclictest2064257-21kworker/u16:2+events_unbound18:53:034
1696428993432,2cyclictest2052006-21kworker/u16:4+events_unbound18:11:164
1696428993432,2cyclictest2052006-21kworker/u16:4+events_unbound18:11:164
1696428993432,2cyclictest1653894-21kworker/u16:3+events_unbound16:09:294
1696428993331,2cyclictest2256820-21kworker/u16:2+events_unbound19:48:314
1696428993331,2cyclictest1936677-21kworker/u16:1+events_unbound17:36:404
1696428993331,2cyclictest1817147-21kworker/u16:1+events_unbound16:40:194
1696428993330,2cyclictest2031459-21kworker/u16:3+flush-8:018:15:484
1696428993230,2cyclictest2289053-21kworker/u16:4+events_unbound20:45:024
1696428993230,2cyclictest2106465-21kworker/u16:1+events_unbound18:40:114
1696428993230,2cyclictest2095602-21kworker/u16:0+events_unbound18:44:234
1696428993230,2cyclictest1987702-21kworker/u16:2+events_unbound17:53:034
1696428993230,2cyclictest1956257-21kworker/u16:0+events_unbound17:44:184
1696428993230,2cyclictest1956257-21kworker/u16:0+events_unbound17:32:304
1696428993230,2cyclictest1870584-21kworker/u16:3+flush-8:017:01:304
1696438993130,0cyclictest0-21swapper/719:09:087
1696431993128,2cyclictest1956257-21kworker/u16:0+events_unbound17:26:055
1696431993128,2cyclictest1956257-21kworker/u16:0+events_unbound17:26:055
1696428993129,2cyclictest2331995-21kworker/u16:3+events_unbound20:24:584
1696428993129,2cyclictest2246081-21kworker/u16:1+events_unbound20:04:034
1696428993129,2cyclictest2095602-21kworker/u16:0+flush-8:019:06:294
1696428993129,2cyclictest1849627-21kworker/u16:2+events_unbound16:47:594
1696428993129,2cyclictest1849627-21kworker/u16:2+events_unbound16:44:044
1696428993129,2cyclictest1849627-21kworker/u16:2+events_unbound16:44:044
1696428993129,2cyclictest1838553-21kworker/u16:0+events_unbound16:53:194
1696428993129,2cyclictest1774618-21kworker/u16:1+events_unbound15:59:314
1696428993129,2cyclictest1774618-21kworker/u16:1+events_unbound15:59:314
1696438993029,0cyclictest0-21swapper/717:25:557
1696438993029,0cyclictest0-21swapper/717:25:557
1696438993027,2cyclictest27944-21gnome-software19:32:157
169643899300,29cyclictest2096367-21latency_hist18:30:477
1696428993028,2cyclictest2374430-21kworker/u16:1+flush-8:020:54:314
1696428993028,2cyclictest2289053-21kworker/u16:4+events_unbound20:15:184
1696428993028,2cyclictest2095602-21kworker/u16:0+events_unbound20:47:484
1696428993028,2cyclictest2095602-21kworker/u16:0+events_unbound20:19:284
1696428993028,2cyclictest2064257-21kworker/u16:2+events_unbound19:14:154
1696428993028,2cyclictest1706449-21kworker/u16:4+events_unbound15:27:474
1696428993028,2cyclictest1674039-21kworker/u16:2+flush-8:015:31:484
1696428993028,2cyclictest1674039-21kworker/u16:2+events_unbound15:46:234
1696428993027,2cyclictest1987702-21kworker/u16:2+events_unbound17:55:554
1696438992928,0cyclictest0-21swapper/717:58:357
1696428992927,2cyclictest2256820-21kworker/u16:2+events_unbound19:58:064
1696428992927,2cyclictest2149159-21kworker/u16:1+events_unbound19:22:394
1696428992927,2cyclictest2031459-21kworker/u16:3+events_unbound18:25:044
1696428992927,2cyclictest1849627-21kworker/u16:2+events_unbound16:34:494
1696428992927,2cyclictest1653894-21kworker/u16:3+events_unbound16:24:594
1696438992827,0cyclictest0-21swapper/719:52:147
1696431992826,2cyclictest2289053-21kworker/u16:4+flush-8:020:41:025
1696431992825,2cyclictest1936677-21kworker/u16:1+events_unbound17:46:055
1696428992826,2cyclictest2095602-21kworker/u16:0+events_unbound18:57:234
1696428992826,2cyclictest2052006-21kworker/u16:4+events_unbound18:26:304
1696428992826,2cyclictest2052006-21kworker/u16:4+events_unbound18:09:284
1696428992826,2cyclictest1956257-21kworker/u16:0+events_unbound17:22:594
1696428992826,2cyclictest1838553-21kworker/u16:0+events_unbound17:08:084
169643899270,25cyclictest2214248-21latency_hist19:25:477
1696428992725,2cyclictest1987702-21kworker/u16:2+events_unbound17:48:594
1696428992725,2cyclictest1838553-21kworker/u16:0+events_unbound16:27:084
1696428992725,2cyclictest1674039-21kworker/u16:2+events_unbound15:43:024
1696438992625,0cyclictest0-21swapper/719:41:357
1696438992625,0cyclictest0-21swapper/719:28:147
1696438992620,5cyclictest2074971-21latency_hist18:20:477
1696435992623,2cyclictest1936677-21kworker/u16:1+flush-8:017:56:036
1696428992624,2cyclictest2192857-21kworker/u16:4+events_unbound19:38:314
1696428992624,2cyclictest2149159-21kworker/u16:1+events_unbound19:02:004
1696428992624,2cyclictest1936677-21kworker/u16:1+events_unbound17:20:234
1696428992624,2cyclictest1817147-21kworker/u16:1+events_unbound16:18:284
1696428992624,2cyclictest1674039-21kworker/u16:2+events_unbound16:04:574
1696438992524,0cyclictest0-21swapper/720:15:267
1696438992519,5cyclictest589235-21systemd-journal19:49:287
1696431992521,3cyclictest2095602-21kworker/u16:0+flush-8:019:32:195
1696428992523,2cyclictest2095602-21kworker/u16:0+events_unbound20:08:154
1696428992523,2cyclictest1987702-21kworker/u16:2+flush-8:018:01:174
1696428992523,2cyclictest1912842-21kworker/u16:2+events_unbound17:13:074
1696428992522,2cyclictest2192857-21kworker/u16:4+flush-8:019:32:204
1696438992423,0cyclictest0-21swapper/719:12:387
1696438992423,0cyclictest0-21swapper/718:54:507
1696438992322,0cyclictest0-21swapper/716:00:197
1696438992322,0cyclictest0-21swapper/716:00:197
169643899230,21cyclictest589253-21gmain20:15:577
1696431992321,2cyclictest1706449-21kworker/u16:4+flush-8:015:30:525
1696428992321,2cyclictest1884595-21kworker/u16:4+events_unbound16:57:334
1696438992221,0cyclictest0-21swapper/720:51:027
1696438992221,0cyclictest0-21swapper/718:10:317
1696438992221,0cyclictest0-21swapper/717:11:597
1696438992221,0cyclictest0-21swapper/716:53:587
1696438992217,4cyclictest589235-21systemd-journal17:19:307
1696438992216,5cyclictest2107092-21latency_hist18:35:477
1696438992121,0cyclictest0-21swapper/719:19:517
1696438992120,0cyclictest0-21swapper/720:26:227
1696438992120,0cyclictest0-21swapper/717:07:027
1696438992120,0cyclictest0-21swapper/716:07:537
1696438992115,5cyclictest1989245-21latency_hist17:40:477
1696435992119,2cyclictest2331995-21kworker/u16:3+events_unbound20:36:016
1696431992118,3cyclictest1706448-21kworker/u16:0+flush-8:015:41:035
1696438992020,0cyclictest0-21swapper/720:49:167
1696438992020,0cyclictest0-21swapper/720:45:107
1696438992019,0cyclictest0-21swapper/715:31:117
1696438992018,1cyclictest0-21swapper/716:42:077
1696438992018,1cyclictest0-21swapper/716:42:077
1696438991918,0cyclictest0-21swapper/719:04:467
1696438991918,0cyclictest0-21swapper/718:15:067
1696438991918,0cyclictest0-21swapper/718:15:067
1696438991918,0cyclictest0-21swapper/717:42:427
1696438991917,1cyclictest1785979-21date16:05:477
1696435991913,5cyclictest1979632-21perl17:36:026
1696431991917,2cyclictest1838553-21kworker/u16:0+events_unbound16:56:035
1696438991817,0cyclictest0-21swapper/717:05:407
1696438991817,0cyclictest0-21swapper/716:58:207
1696438991817,0cyclictest0-21swapper/716:14:027
1696438991817,0cyclictest0-21swapper/715:26:237
1696438991816,1cyclictest0-21swapper/718:21:147
1696438991815,2cyclictest1313-21snmpd18:58:177
1696438991717,0cyclictest0-21swapper/715:37:387
1696438991716,0cyclictest0-21swapper/720:34:337
1696438991716,0cyclictest0-21swapper/720:34:337
1696438991716,0cyclictest0-21swapper/720:22:447
1696438991716,0cyclictest0-21swapper/718:36:147
1696438991716,0cyclictest0-21swapper/717:34:107
1696438991716,0cyclictest0-21swapper/717:23:047
1696438991715,1cyclictest976-21in:imjournal20:05:477
1696438991715,1cyclictest0-21swapper/716:31:137
1696431991715,2cyclictest2246081-21kworker/u16:1+flush-8:020:01:105
1696431991714,2cyclictest2095602-21kworker/u16:0+flush-8:019:41:045
1696431991713,3cyclictest1674039-21kworker/u16:2+flush-8:016:06:005
1696438991615,0cyclictest0-21swapper/718:47:177
1696438991615,0cyclictest0-21swapper/715:46:177
1696438991614,1cyclictest0-21swapper/716:47:567
169643899160,14cyclictest1822762-21cut16:21:087
1696431991612,3cyclictest1936677-21kworker/u16:1+flush-8:017:16:175
1696438991510,4cyclictest589235-21systemd-journal20:07:297
169643599150,14cyclictest0-21swapper/617:41:056
169643599150,12cyclictest0-21swapper/618:46:596
1696431991511,3cyclictest2149159-21kworker/u16:1+flush-8:019:20:595
1696431991511,3cyclictest1653894-21kworker/u16:3+flush-8:016:26:125
169643199150,1cyclictest0-21swapper/516:51:015
169643199150,12cyclictest0-21swapper/520:35:585
1696438991413,0cyclictest0-21swapper/719:39:357
1696438991413,0cyclictest0-21swapper/715:52:587
169643599146,7cyclictest27396-21gdbus19:32:356
1696435991413,1cyclictest0-21swapper/620:41:166
1696435991411,2cyclictest2031459-21kworker/u16:3+flush-8:018:06:026
169643599140,14cyclictest0-21swapper/619:11:066
169643599140,11cyclictest0-21swapper/618:13:526
169643599140,11cyclictest0-21swapper/618:13:526
169643599140,11cyclictest0-21swapper/616:58:126
169643199140,1cyclictest0-21swapper/519:17:565
169643199140,1cyclictest0-21swapper/518:36:195
169643899134,8cyclictest27204-21gmain18:01:067
1696438991313,0cyclictest0-21swapper/717:54:517
1696438991311,1cyclictest0-21swapper/716:16:107
169643599138,4cyclictest0-21swapper/615:51:076
169643599135,7cyclictest2033285-21cat18:01:036
169643599130,5cyclictest0-21swapper/617:01:036
169643599130,3cyclictest22042111cstates19:20:586
169643599130,3cyclictest21510391fschecks_time18:56:006
169643599130,3cyclictest19711441kthreadcore17:31:076
169643599130,3cyclictest19442281kthreadcore17:16:106
169643599130,3cyclictest19318121kthreadcore17:11:076
169643599130,3cyclictest18452471kthreadcore16:31:096
169643599130,3cyclictest17480181kthreadcore15:46:086
169643599130,3cyclictest17088811kthreadcore15:30:506
169643599130,13cyclictest0-21swapper/620:16:126
169643599130,0cyclictest0-21swapper/617:48:396
169643199133,4cyclictest2363125-21unixbench-2d20:31:175
169643199133,4cyclictest2363125-21unixbench-2d20:31:175
1696431991312,1cyclictest0-21swapper/515:56:285
1696431991312,1cyclictest0-21swapper/515:56:285
1696431991311,2cyclictest0-21swapper/515:27:475
1696431991310,2cyclictest2095602-21kworker/u16:0+flush-8:018:56:005
169643199130,13cyclictest0-21swapper/519:58:275
169643199130,13cyclictest0-21swapper/518:01:575
169643199130,13cyclictest0-21swapper/517:06:095
169643899129,2cyclictest1313-21snmpd17:47:377
169643599128,3cyclictest0-21swapper/617:06:036
169643599126,5cyclictest0-21swapper/618:16:156
169643599125,6cyclictest2174032-21kthreadcore19:06:056
169643599124,7cyclictest2101937-21cut18:31:066
169643599123,8cyclictest2357421-21cut20:31:076
169643599123,8cyclictest2357421-21cut20:31:076
169643599121,9cyclictest2258076-21cat19:45:596
1696435991211,1cyclictest0-21swapper/619:58:046
1696435991211,1cyclictest0-21swapper/619:01:576
1696435991211,1cyclictest0-21swapper/616:16:076
169643599120,4cyclictest2406272-21taskset20:52:176
169643599120,4cyclictest2246426-21taskset19:40:226
169643599120,4cyclictest2149568-21chrt18:53:436
169643599120,4cyclictest2127983-21chrt18:43:016
169643599120,4cyclictest2096347-21chrt18:30:436
169643599120,4cyclictest1967107-21chrt17:27:056
169643599120,4cyclictest1967107-21chrt17:27:056
169643599120,4cyclictest1956400-21chrt17:22:086
169643599120,4cyclictest1731662-21chrt15:36:406
169643599120,1cyclictest0-21swapper/620:13:416
169643599120,1cyclictest0-21swapper/617:53:426
169643199125,1cyclictest0-21swapper/518:51:115
169643199123,4cyclictest2049831-21cut18:06:085
1696431991211,1cyclictest0-21swapper/516:38:245
1696431991210,2cyclictest1936677-21kworker/u16:1+flush-8:017:41:185
1696431991210,2cyclictest0-21swapper/520:11:425
169643199120,5cyclictest0-21swapper/518:46:035
169643199120,1cyclictest0-21swapper/520:55:035
169643199120,1cyclictest0-21swapper/519:50:535
169643199120,1cyclictest0-21swapper/516:12:525
169643899118,2cyclictest1313-21snmpd19:56:077
169643899110,2cyclictest21523-21lldpd16:36:107
169643599114,6cyclictest2348324-21cut20:26:076
169643599113,7cyclictest2306146-21tr20:06:076
169643599113,7cyclictest2275466-21cut19:51:076
169643599113,7cyclictest2081543-21cut18:21:106
169643599113,7cyclictest1852022-21cat16:36:076
169643599113,7cyclictest1801457-21tr16:11:046
169643599112,8cyclictest2292584-21kthreadcore20:01:076
169643599112,8cyclictest2108201-21fschecks_time18:36:056
169643599112,8cyclictest1791730-21cut16:06:086
169643599111,9cyclictest1874702-21kthreadcore16:46:076
169643599110,5cyclictest984965-21wsdd19:44:476
169643599110,4cyclictest2217703-21cat19:26:066
169643599110,4cyclictest2193645-21cstates19:16:026
169643599110,4cyclictest1882965-21cat16:51:016
169643599110,4cyclictest1765026-21cat15:56:016
169643599110,4cyclictest1765026-21cat15:56:016
169643599110,4cyclictest1742909-21chrt15:44:336
169643599110,4cyclictest1696727-21/usr/sbin/munin15:26:036
169643599110,3cyclictest1871415-21chrt16:45:396
169643599110,3cyclictest1871415-21chrt16:45:396
169643599110,3cyclictest1776433-21sh16:01:046
169643199119,2cyclictest1817147-21kworker/u16:1+flush-8:016:21:035
169643199118,2cyclictest0-21swapper/519:01:145
169643199115,1cyclictest0-21swapper/518:30:595
169643199113,3cyclictest2237567-21kthreadcore19:36:045
169643199113,3cyclictest2123702-21cut18:41:085
169643199113,3cyclictest1949202-21cut17:21:075
169643199113,3cyclictest1929161-21cut17:11:065
169643199113,3cyclictest1863633-21grep16:41:065
169643199113,3cyclictest1863633-21grep16:41:065
169643199113,3cyclictest1808856-21cut16:16:045
169643199112,4cyclictest1977661-21uptime17:31:185
169643199112,3cyclictest2324087-21grep20:16:045
169643199112,3cyclictest2304825-21cut20:06:065
1696431991110,1cyclictest0-21swapper/519:15:255
1696431991110,1cyclictest0-21swapper/519:07:045
1696431991110,1cyclictest0-21swapper/516:34:095
1696431991110,1cyclictest0-21swapper/516:01:405
169643199110,1cyclictest0-21swapper/520:28:245
169643199110,11cyclictest0-21swapper/519:30:335
169643199110,11cyclictest0-21swapper/517:39:065
169643599102,7cyclictest1829455-21cat16:26:016
169643599100,6cyclictest0-21swapper/616:21:026
169643599100,4cyclictest2333288-21iostat20:21:066
169643199107,1cyclictest0-21swapper/519:48:225
169643199104,2cyclictest2087521-21kthreadcore18:26:055
169643199103,3cyclictest2084141-21netstat18:21:135
169643199103,3cyclictest1744356-21hwlatdetect15:46:045
169643199102,4cyclictest2019935-21sed17:51:155
169643199102,3cyclictest1761427-21grep15:51:105
169643199102,3cyclictest1726674-21grep15:36:085
16964359990,4cyclictest2385990-21grep20:46:016
16964319998,1cyclictest0-21swapper/520:46:045
16964319992,4cyclictest2064645-21wc18:15:595
16964319975,1cyclictest0-21swapper/517:56:045
16964319974,2cyclictest2054723-21if_p4p118:11:055
16964319974,2cyclictest2054723-21if_p4p118:11:055
16964319972,4cyclictest2333410-21sed20:21:075
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional