You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-29 - 00:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Mon Sep 28, 2026 12:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
238044021010,1sleep72380442-21cat11:59:567
21933192950,1sleep72193317-21ssh10:44:307
21521182920,1sleep50-21swapper/510:25:055
172037725747,7sleep50-21swapper/507:07:055
172046325419,30sleep70-21swapper/707:08:207
1720861994745,2cyclictest1841595-21kworker/u16:2+flush-8:008:19:416
172047824718,8sleep40-21swapper/407:08:334
1720856994340,2cyclictest2016595-21kworker/u16:2+events_unbound10:04:554
1720857994240,2cyclictest2016595-21kworker/u16:2+events_unbound09:59:565
1720856994240,2cyclictest2152981-21kworker/u16:0+events_unbound10:36:434
172054624232,7sleep60-21swapper/607:09:316
1720865994136,4cyclictest2317195-21latency_hist11:34:407
1720857994138,2cyclictest2045415-21kworker/u16:1+events_unbound10:10:045
1720856994038,2cyclictest2277846-21kworker/u16:1+flush-8:012:00:274
1720856994038,2cyclictest2277846-21kworker/u16:1+events_unbound11:24:244
1720856994038,2cyclictest1958792-21kworker/u16:3+events_unbound09:47:044
1720856994038,2cyclictest1958792-21kworker/u16:3+events_unbound09:47:044
1720865993937,1cyclictest2067018-21ssh09:50:127
1720865993936,2cyclictest2055318-21sh09:46:087
1720865993936,2cyclictest2055318-21sh09:46:087
1720857993935,2cyclictest2304978-21kworker/u16:4+flush-8:012:29:405
1720856993937,2cyclictest2304978-21kworker/u16:4+events_unbound12:24:354
1720856993937,2cyclictest2304978-21kworker/u16:4+events_unbound11:36:354
1720856993937,2cyclictest2304076-21kworker/u16:2+events_unbound11:44:044
1720856993937,2cyclictest2045415-21kworker/u16:1+events_unbound10:28:034
1720857993835,2cyclictest1870350-21kworker/u16:1+events_unbound09:29:435
1720856993836,2cyclictest2152981-21kworker/u16:0+events_unbound10:33:354
1720856993836,2cyclictest2016595-21kworker/u16:2+events_unbound10:54:244
1720856993836,2cyclictest1958792-21kworker/u16:3+events_unbound09:52:404
1720856993836,2cyclictest1890411-21kworker/u16:0+events_unbound09:43:214
1720856993836,2cyclictest1890411-21kworker/u16:0+events_unbound09:43:214
1720865993736,0cyclictest0-21swapper/710:33:087
1720865993736,0cyclictest0-21swapper/710:04:577
1720865993733,2cyclictest2256451-21diskstats11:09:567
1720865993732,4cyclictest2429790-21fschecks_count12:19:567
1720857993735,2cyclictest1870350-21kworker/u16:1+flush-8:008:54:415
1720857993731,5cyclictest2181510-21kworker/u16:3+flush-8:011:44:405
1720856993735,2cyclictest2277846-21kworker/u16:1+events_unbound12:16:524
1720856993735,2cyclictest2277846-21kworker/u16:1+events_unbound11:55:364
1720856993735,2cyclictest2181510-21kworker/u16:3+events_unbound11:07:434
1720856993735,2cyclictest2181510-21kworker/u16:3+events_unbound11:07:434
1720856993735,2cyclictest2128993-21kworker/u16:3+events_unbound10:23:044
1720856993735,2cyclictest2128993-21kworker/u16:3+events_unbound10:23:044
1720856993735,2cyclictest2106834-21kworker/u16:0+events_unbound10:11:324
1720865993635,0cyclictest0-21swapper/711:54:557
1720865993634,1cyclictest1958310-21diskmemload11:00:087
1720865993634,1cyclictest1958310-21diskmemload11:00:087
1720856993634,2cyclictest2304978-21kworker/u16:4+events_unbound12:06:034
1720856993634,2cyclictest2304076-21kworker/u16:2+events_unbound11:33:434
1720856993634,2cyclictest2304076-21kworker/u16:2+events_unbound11:29:324
1720856993634,2cyclictest2277846-21kworker/u16:1+events_unbound11:16:524
1720856993634,2cyclictest2045415-21kworker/u16:1+events_unbound10:03:044
1720856993634,2cyclictest2016595-21kworker/u16:2+events_unbound10:49:114
1720856993634,2cyclictest2016595-21kworker/u16:2+events_unbound10:41:364
1720856993634,2cyclictest1870350-21kworker/u16:1+events_unbound09:28:524
1720857993533,2cyclictest2304978-21kworker/u16:4+flush-8:011:39:355
1720857993533,2cyclictest2277846-21kworker/u16:1+flush-8:012:20:195
1720856993533,2cyclictest2429052-21kworker/u16:2+events_unbound12:31:004
1720856993533,2cyclictest2304978-21kworker/u16:4+events_unbound12:25:554
1720856993533,2cyclictest2181510-21kworker/u16:3+events_unbound11:11:324
1720856993533,2cyclictest2016595-21kworker/u16:2+events_unbound10:17:124
1720856993533,2cyclictest1958792-21kworker/u16:3+events_unbound09:36:514
1720856993533,2cyclictest1870350-21kworker/u16:1+events_unbound09:16:214
1720856993533,2cyclictest1870350-21kworker/u16:1+events_unbound09:11:074
1720865993432,1cyclictest2414154-21ssh12:10:527
1720857993432,2cyclictest2016595-21kworker/u16:2+flush-8:011:00:045
1720857993432,2cyclictest2016595-21kworker/u16:2+flush-8:011:00:045
1720856993432,2cyclictest2379170-21kworker/u16:0+events_unbound12:10:474
1720856993432,2cyclictest2304978-21kworker/u16:4+events_unbound11:53:444
1720856993432,2cyclictest1870350-21kworker/u16:1+flush-8:009:24:274
1720865993332,0cyclictest0-21swapper/709:26:087
1720865993332,0cyclictest0-21swapper/709:20:207
1720865993328,4cyclictest1958309-21latency_hist09:09:417
1720857993331,2cyclictest2277846-21kworker/u16:1+events_unbound12:10:355
1720857993330,2cyclictest2181510-21kworker/u16:3+events_unbound11:24:435
1720856993331,2cyclictest2304978-21kworker/u16:4+events_unbound12:36:564
1720856993331,2cyclictest2152981-21kworker/u16:0+events_unbound11:02:234
1720856993331,2cyclictest2152981-21kworker/u16:0+events_unbound11:02:234
1720856993331,2cyclictest2152981-21kworker/u16:0+events_unbound10:55:564
1720865993230,1cyclictest0-21swapper/710:01:037
1720865993229,2cyclictest2454007-21cpuspeed_turbos12:29:527
1720857993230,2cyclictest2429052-21kworker/u16:2+flush-8:012:30:475
1720857993230,2cyclictest2152981-21kworker/u16:0+events_unbound10:44:555
1720857993230,2cyclictest2016595-21kworker/u16:2+events_unbound10:39:445
1720857993229,2cyclictest1938550-21kworker/u16:3+flush-8:008:59:415
1720856993230,2cyclictest2016595-21kworker/u16:2+events_unbound09:34:204
1720865993129,1cyclictest2329051-21ssh11:38:407
1720856993129,2cyclictest2277846-21kworker/u16:1+events_unbound11:48:204
1720865993029,0cyclictest0-21swapper/710:35:437
1720857993028,2cyclictest2045415-21kworker/u16:1+events_unbound09:54:245
1720856993028,2cyclictest1841595-21kworker/u16:2+events_unbound08:38:524
1720865992928,0cyclictest0-21swapper/710:15:237
1720865992928,0cyclictest0-21swapper/709:40:117
1720865992928,0cyclictest0-21swapper/709:40:117
1720861992927,2cyclictest2379170-21kworker/u16:0+events_unbound12:19:366
1720861992927,2cyclictest2277846-21kworker/u16:1+flush-8:011:25:126
1720861992927,2cyclictest2016595-21kworker/u16:2+events_unbound10:29:356
1720857992928,1cyclictest2304978-21kworker/u16:4+events_unbound12:07:395
1720857992927,2cyclictest2243127-21kworker/u16:4+events_unbound11:06:525
1720857992927,2cyclictest2243127-21kworker/u16:4+events_unbound11:06:525
1720857992927,2cyclictest2016595-21kworker/u16:2+events_unbound10:54:285
1720857992927,2cyclictest1958792-21kworker/u16:3+events_unbound09:39:565
1720857992927,2cyclictest1958792-21kworker/u16:3+events_unbound09:39:565
1720857992927,2cyclictest1958792-21kworker/u16:3+events_unbound09:24:325
1720857992927,2cyclictest1890411-21kworker/u16:0+flush-8:009:10:245
1720865992826,1cyclictest2204154-21ssh10:46:487
1720865992826,1cyclictest2155651-21ssh10:28:367
1720857992826,2cyclictest2277846-21kworker/u16:1+flush-8:012:00:515
1720857992826,2cyclictest2277846-21kworker/u16:1+events_unbound11:23:525
1720857992826,2cyclictest2128993-21kworker/u16:3+events_unbound10:16:475
1720865992726,0cyclictest0-21swapper/711:46:447
1720865992725,1cyclictest2466832-21ssh12:34:557
1720865992724,2cyclictest2080159-21ssh09:56:217
1720861992725,2cyclictest2016595-21kworker/u16:2+flush-8:009:44:366
1720861992725,2cyclictest2016595-21kworker/u16:2+flush-8:009:44:366
1720861992725,2cyclictest1780559-21kworker/u16:2+flush-8:007:54:416
1720857992725,2cyclictest2277846-21kworker/u16:1+flush-8:011:15:475
1720856992725,2cyclictest1821635-21kworker/u16:4+flush-8:008:28:514
1720865992625,0cyclictest0-21swapper/712:14:557
1720865992625,0cyclictest0-21swapper/710:14:047
1720865992624,1cyclictest1742985-21strings07:15:027
1720865992622,3cyclictest2029656-21switchtime09:35:127
1720861992624,2cyclictest1691542-21kworker/u16:3+flush-8:007:35:046
1720857992624,2cyclictest2304978-21kworker/u16:4+flush-8:011:50:115
1720857992624,2cyclictest2016595-21kworker/u16:2+events_unbound09:49:055
1720857992624,2cyclictest2016595-21kworker/u16:2+events_unbound09:49:055
1720857992624,2cyclictest1890411-21kworker/u16:0+events_unbound09:14:485
1720857992623,2cyclictest2304076-21kworker/u16:2+events_unbound11:31:045
1720857992623,2cyclictest2243127-21kworker/u16:4+flush-8:011:09:475
1720856992624,2cyclictest1958792-21kworker/u16:3+events_unbound09:57:454
1720856992624,2cyclictest1821635-21kworker/u16:4+events_unbound08:18:524
1720865992524,0cyclictest0-21swapper/709:11:397
1720865992523,1cyclictest2341554-21ssh11:43:527
1720865992523,1cyclictest1060-21runrttasks09:15:277
1720865992520,4cyclictest2020197-21latency_hist09:34:417
1720857992523,2cyclictest2181510-21kworker/u16:3+events_unbound10:56:525
1720857992523,2cyclictest2016595-21kworker/u16:2+flush-8:009:34:525
1720857992523,2cyclictest1958792-21kworker/u16:3+events_unbound09:25:235
1720857992522,2cyclictest1821635-21kworker/u16:4+flush-8:008:04:415
1720856992523,2cyclictest1890411-21kworker/u16:0+events_unbound09:06:514
1720856992523,2cyclictest1730512-21kworker/u16:1+events_unbound07:15:094
1720856992522,2cyclictest1691542-21kworker/u16:3+flush-8:007:44:524
1720865992423,0cyclictest0-21swapper/710:49:517
1720865992422,1cyclictest2277860-21ssh11:15:447
1720865992422,1cyclictest0-21swapper/708:30:017
1720861992422,2cyclictest1958792-21kworker/u16:3+flush-8:009:14:466
1720861992422,2cyclictest1870350-21kworker/u16:1+events_unbound09:20:086
1720857992422,2cyclictest2128993-21kworker/u16:3+flush-8:010:19:585
1720857992422,2cyclictest2128993-21kworker/u16:3+flush-8:010:19:585
1720857992422,2cyclictest2016595-21kworker/u16:2+flush-8:010:35:275
1720857992422,2cyclictest2016595-21kworker/u16:2+events_unbound10:05:115
1720857992422,2cyclictest1730512-21kworker/u16:1+flush-8:007:15:045
1720856992422,2cyclictest1730512-21kworker/u16:1+events_unbound07:34:384
1720865992322,0cyclictest0-21swapper/707:14:287
1720857992321,2cyclictest2181510-21kworker/u16:3+events_unbound11:49:235
1720857992321,2cyclictest2045415-21kworker/u16:1+events_unbound10:34:285
1720857992321,2cyclictest1958792-21kworker/u16:3+events_unbound09:57:415
1720856992321,2cyclictest1691542-21kworker/u16:3+events_unbound07:29:044
1720865992221,0cyclictest0-21swapper/708:55:567
1720861992220,2cyclictest1890411-21kworker/u16:0+flush-8:009:25:056
1720857992221,1cyclictest2304978-21kworker/u16:4+events_unbound12:37:135
1720857992220,2cyclictest2379170-21kworker/u16:0+events_unbound12:17:315
1720857992220,2cyclictest1841595-21kworker/u16:2+flush-8:008:14:365
1720857992220,2cyclictest1841595-21kworker/u16:2+events_unbound08:24:285
1720857992220,2cyclictest1691542-21kworker/u16:3+flush-8:007:20:025
1720857992220,2cyclictest1691542-21kworker/u16:3+events_unbound07:40:045
1720856992219,2cyclictest1730512-21kworker/u16:1+events_unbound07:34:444
1720865992120,0cyclictest0-21swapper/712:07:437
1720865992120,0cyclictest0-21swapper/711:52:157
172086599210,19cyclictest2229383-21ssh10:57:337
1720857992117,3cyclictest1049698-21kworker/u16:0+events_unbound07:59:535
1720856992119,2cyclictest1841595-21kworker/u16:2+events_unbound08:52:524
1720856992119,2cyclictest1821618-21kworker/u16:1+events_unbound08:04:324
22906912200,1chrt2290690-21ssh11:21:337
1720861992018,2cyclictest1948324-21kworker/u16:2+flush-8:009:04:366
1720856992018,2cyclictest1890411-21kworker/u16:0+events_unbound08:59:044
1720856992018,2cyclictest1730512-21kworker/u16:1+events_unbound07:21:054
1720865991918,0cyclictest0-21swapper/711:08:367
1720865991918,0cyclictest0-21swapper/711:08:367
1720861991917,2cyclictest1780559-21kworker/u16:2+flush-8:007:55:006
1720861991917,2cyclictest1049698-21kworker/u16:0+flush-8:008:00:076
1720861991916,2cyclictest2106834-21kworker/u16:0+events_unbound10:09:446
1720857991917,2cyclictest1691542-21kworker/u16:3+events_unbound07:55:545
1720857991917,2cyclictest1691542-21kworker/u16:3+events_unbound07:54:285
1720856991917,2cyclictest1948324-21kworker/u16:2+events_unbound09:04:034
1720856991917,2cyclictest1870350-21kworker/u16:1+events_unbound08:32:524
1720856991917,2cyclictest1049698-21kworker/u16:0+flush-8:007:56:034
1720865991816,1cyclictest2302359-21sh11:25:207
1720861991816,2cyclictest2243127-21kworker/u16:4+flush-8:011:05:476
1720861991816,2cyclictest2243127-21kworker/u16:4+flush-8:011:05:476
1720861991816,2cyclictest2181510-21kworker/u16:3+events_unbound11:39:486
1720861991815,3cyclictest2304978-21kworker/u16:4+events_unbound12:24:556
1720861991815,2cyclictest2304978-21kworker/u16:4+events_unbound11:49:526
1720857991816,2cyclictest2304978-21kworker/u16:4+events_unbound11:58:045
1720856991816,2cyclictest1049698-21kworker/u16:0+events_unbound07:13:044
1720865991716,0cyclictest0-21swapper/710:20:067
1720865991716,0cyclictest0-21swapper/710:20:067
1720865991715,1cyclictest0-21swapper/708:05:027
1720861991715,2cyclictest2016595-21kworker/u16:2+events_unbound09:45:156
1720861991715,2cyclictest2016595-21kworker/u16:2+events_unbound09:45:156
1720857991714,2cyclictest1841595-21kworker/u16:2+flush-8:008:15:015
1720856991715,2cyclictest1890411-21kworker/u16:0+events_unbound08:42:054
1720865991615,0cyclictest0-21swapper/708:35:027
172086599160,14cyclictest1275-21snmpd08:44:217
1720861991614,2cyclictest1890411-21kworker/u16:0+flush-8:009:05:066
1720861991614,2cyclictest1890411-21kworker/u16:0+events_unbound09:14:326
1720861991614,2cyclictest1691542-21kworker/u16:3+events_unbound07:40:086
1720861991614,2cyclictest1049698-21kworker/u16:0+events_unbound07:10:126
1720865991514,0cyclictest0-21swapper/708:14:547
1720861991514,1cyclictest2277846-21kworker/u16:1+events_unbound11:22:446
1720861991513,2cyclictest2304978-21kworker/u16:4+flush-8:012:19:596
1720861991513,2cyclictest2304076-21kworker/u16:2+events_unbound11:30:516
1720861991512,2cyclictest1730512-21kworker/u16:1+events_unbound07:14:466
172086199150,15cyclictest86-21ksoftirqd/609:59:196
172086199150,15cyclictest0-21swapper/611:14:126
1720857991513,2cyclictest769100-21kworker/u16:2+flush-8:007:10:075
1720857991513,2cyclictest1691542-21kworker/u16:3+events_unbound07:30:145
1720856991513,2cyclictest1780559-21kworker/u16:2+events_unbound07:54:404
172086599140,1cyclictest0-21swapper/708:10:077
172086599140,1cyclictest0-21swapper/707:35:057
1720861991413,1cyclictest0-21swapper/611:38:006
1720861991413,1cyclictest0-21swapper/611:17:406
1720861991413,1cyclictest0-21swapper/611:01:456
1720861991413,1cyclictest0-21swapper/611:01:456
1720861991413,1cyclictest0-21swapper/610:06:066
1720861991412,2cyclictest2379170-21kworker/u16:0+events_unbound12:14:416
1720861991412,2cyclictest1730512-21kworker/u16:1+flush-8:007:24:566
172086199140,1cyclictest0-21swapper/612:05:176
172086199140,1cyclictest0-21swapper/610:52:556
172086199140,14cyclictest0-21swapper/611:49:026
172086199140,14cyclictest0-21swapper/610:40:286
172086199140,14cyclictest0-21swapper/610:21:236
172086199140,14cyclictest0-21swapper/610:21:236
1720857991412,2cyclictest1870350-21kworker/u16:1+flush-8:008:49:425
1720857991412,2cyclictest1821635-21kworker/u16:4+flush-8:008:29:565
1720856991412,2cyclictest1890411-21kworker/u16:0+flush-8:008:44:564
1720856991412,2cyclictest1821618-21kworker/u16:1+events_unbound08:08:014
1720856991412,2cyclictest1730512-21kworker/u16:1+events_unbound07:43:494
172086599139,3cyclictest1275-21snmpd08:22:547
172086599136,6cyclictest6797-21gmain07:44:397
172086599136,6cyclictest6733-21gmain08:04:037
172086599136,6cyclictest6157-21gmain12:29:357
1720861991312,1cyclictest0-21swapper/612:32:246
1720861991311,2cyclictest2277846-21kworker/u16:1+events_unbound11:58:166
1720861991311,2cyclictest2021541-21kworker/u16:4+flush-8:009:35:056
1720861991311,2cyclictest2016595-21kworker/u16:2+events_unbound10:54:596
172086599129,2cyclictest1275-21snmpd08:51:007
172086599128,3cyclictest1275-21snmpd07:46:087
172086599127,4cyclictest6325-21gmain08:25:037
172086599125,6cyclictest6466-21gmain07:52:477
1720865991211,0cyclictest0-21swapper/708:59:547
172086199125,6cyclictest0-21swapper/607:30:036
1720861991211,1cyclictest0-21swapper/610:38:446
1720861991210,1cyclictest0-21swapper/608:40:106
172086199120,1cyclictest0-21swapper/608:30:146
172086199120,12cyclictest0-21swapper/608:46:106
172085799120,12cyclictest0-21swapper/509:06:385
172086599117,3cyclictest6733-21gmain07:25:077
172086599117,3cyclictest1275-21snmpd07:34:117
172086599114,6cyclictest6157-21gmain07:54:517
172086199119,2cyclictest86-21ksoftirqd/612:00:116
172086199119,2cyclictest1841595-21kworker/u16:2+flush-8:008:19:566
172086199117,3cyclictest1871833-21cat08:24:556
172086199116,4cyclictest1849462-21kthreadcore08:10:036
1720861991110,1cyclictest0-21swapper/608:06:366
172086199110,1cyclictest0-21swapper/608:36:146
172085799118,2cyclictest1730512-21kworker/u16:1+flush-8:007:34:575
172085799110,11cyclictest0-21swapper/507:48:365
172085699119,2cyclictest1841595-21kworker/u16:2+events_unbound08:13:534
172086599104,5cyclictest6797-21gmain08:45:197
172086599103,5cyclictest1748621-21kthreadcore07:19:597
172086199109,1cyclictest0-21swapper/610:47:336
172086199108,2cyclictest2429052-21kworker/u16:2+events_unbound12:35:046
172086199108,2cyclictest2152981-21kworker/u16:0+events_unbound10:32:446
172086199108,2cyclictest2128993-21kworker/u16:3+events_unbound10:15:526
172086199108,2cyclictest1730512-21kworker/u16:1+flush-8:007:49:366
172086199107,2cyclictest0-21swapper/608:54:556
172086199105,4cyclictest1920719-21ps08:49:556
172085799109,1cyclictest0-21swapper/508:41:255
172085799108,2cyclictest1821635-21kworker/u16:4+events_unbound08:24:525
17208619997,2cyclictest86-21ksoftirqd/609:51:416
17208619997,2cyclictest86-21ksoftirqd/609:32:226
17208619995,3cyclictest1748412-21grep07:19:586
17208579997,2cyclictest1870350-21kworker/u16:1+events_unbound09:02:525
17208569997,2cyclictest1841595-21kworker/u16:2+events_unbound08:22:254
17208619985,2cyclictest2083772-21chrt09:59:576
17208579986,1cyclictest0-21swapper/507:24:565
17208579983,4cyclictest1891247-21sed08:34:565
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional