You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 09:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Mon Dec 01, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
410902325848,7sleep60-21swapper/603:18:486
4109681995451,2cyclictest30610-21kworker/u16:5+flush-8:005:02:576
410923525039,7sleep40-21swapper/403:21:434
4109684994843,4cyclictest556389-21latency_hist08:42:567
4109681994644,2cyclictest505475-21kworker/u16:5+events_unbound08:13:216
4109681994240,2cyclictest364805-21kworker/u16:3+events_unbound07:08:206
410916024231,7sleep50-21swapper/503:20:405
41090432427,30sleep70-21swapper/703:19:057
410968499410,39cyclictest589235-21systemd-journal07:07:577
4109681994138,2cyclictest302373-21kworker/u16:3+flush-8:006:37:576
4109673994139,2cyclictest130874-21kworker/u16:3+events_unbound05:13:124
410968499400,38cyclictest293255-21latency_hist06:27:577
4109676993836,2cyclictest353582-21kworker/u16:2+flush-8:006:58:235
4109676993735,2cyclictest302373-21kworker/u16:3+events_unbound06:35:205
4109676993634,2cyclictest30610-21kworker/u16:5+flush-8:004:25:205
4109681993533,2cyclictest3396967-21kworker/u16:7+events_unbound03:23:126
4109681993533,2cyclictest242783-21kworker/u16:1+events_unbound06:53:216
4109681993532,2cyclictest212293-21kworker/u16:3+flush-8:006:03:206
4109676993533,2cyclictest60443-21kworker/u16:0+flush-8:004:53:235
4109676993533,2cyclictest251947-21kworker/u16:4+events_unbound06:13:255
4109681993431,2cyclictest323223-21kworker/u16:4+flush-8:006:42:576
4109676993432,2cyclictest434637-21kworker/u16:4+events_unbound07:50:055
4109676993431,2cyclictest505475-21kworker/u16:5+flush-8:008:18:235
4109673993432,2cyclictest353582-21kworker/u16:2+flush-8:007:08:244
4109676993331,2cyclictest242783-21kworker/u16:1+events_unbound06:26:095
4109676993330,2cyclictest60985-21kworker/u16:2+flush-8:005:02:595
4109684993231,0cyclictest0-21swapper/704:49:177
4109684993231,0cyclictest0-21swapper/703:39:087
4109676993230,2cyclictest60443-21kworker/u16:0+flush-8:005:08:285
4109676993230,2cyclictest364805-21kworker/u16:3+events_unbound07:42:115
4109676993230,2cyclictest323223-21kworker/u16:4+events_unbound07:14:125
4109676993230,2cyclictest323223-21kworker/u16:4+events_unbound07:03:525
4109676993230,2cyclictest251947-21kworker/u16:4+events_unbound06:03:395
4109676993230,2cyclictest242783-21kworker/u16:1+flush-8:006:51:205
4109676993230,2cyclictest212293-21kworker/u16:3+flush-8:005:55:395
4109676993229,3cyclictest4179563-21kworker/u16:2+events_unbound04:05:195
4109673993230,2cyclictest60443-21kworker/u16:0+flush-8:005:23:234
4109673993230,2cyclictest242783-21kworker/u16:1+flush-8:006:03:124
4109673993230,2cyclictest19672-21kworker/u16:0+flush-8:004:13:124
4109681993129,2cyclictest364805-21kworker/u16:3+events_unbound07:18:206
4109681993128,2cyclictest323223-21kworker/u16:4+flush-8:007:13:126
4109676993129,2cyclictest60443-21kworker/u16:0+events_unbound06:01:495
4109676993129,2cyclictest535998-21kworker/u16:4+events_unbound08:35:245
4109676993129,2cyclictest30610-21kworker/u16:5+events_unbound04:40:005
4109676993129,2cyclictest19672-21kworker/u16:0+events_unbound04:12:055
4109676993129,2cyclictest162505-21kworker/u16:2+flush-8:005:28:485
4109684993029,0cyclictest0-21swapper/708:43:367
4109684993029,0cyclictest0-21swapper/707:25:247
4109684993029,0cyclictest0-21swapper/704:19:047
4109684993029,0cyclictest0-21swapper/703:47:167
4109681993028,2cyclictest434637-21kworker/u16:4+events_unbound08:03:116
4109681993028,2cyclictest242783-21kworker/u16:1+flush-8:007:43:196
4109681993028,2cyclictest242783-21kworker/u16:1+flush-8:006:02:576
4109681993026,3cyclictest60985-21kworker/u16:2+flush-8:004:37:576
4109676993028,2cyclictest364805-21kworker/u16:3+events_unbound07:37:125
4109676993028,2cyclictest323223-21kworker/u16:4+events_unbound07:22:075
4109676993028,2cyclictest30951-21kworker/u16:1+flush-8:004:29:005
4109676993028,2cyclictest30610-21kworker/u16:5+events_unbound05:00:085
4109676993028,2cyclictest242783-21kworker/u16:1+events_unbound07:09:055
4109676993028,2cyclictest242783-21kworker/u16:1+events_unbound06:32:015
4109676993028,2cyclictest231822-21kworker/u16:2+events_unbound06:09:275
4109676993028,2cyclictest111311-21kworker/u16:1+events_unbound05:21:035
4109673993028,2cyclictest4163687-21kworker/u16:0+events_unbound03:50:044
4109673993027,2cyclictest434637-21kworker/u16:4+events_unbound07:53:214
4109684992928,0cyclictest0-21swapper/707:29:447
4109684992928,0cyclictest0-21swapper/704:56:257
4109684992928,0cyclictest0-21swapper/704:30:167
4109684992928,0cyclictest0-21swapper/704:16:297
4109681992927,2cyclictest242783-21kworker/u16:1+events_unbound08:43:156
4109681992925,3cyclictest4163687-21kworker/u16:0+flush-8:003:51:016
4109676992927,2cyclictest60443-21kworker/u16:0+events_unbound04:37:125
4109676992927,2cyclictest434637-21kworker/u16:4+flush-8:008:08:405
4109676992927,2cyclictest4091714-21kworker/u16:3+flush-8:003:29:485
4109676992927,2cyclictest3396967-21kworker/u16:7+events_unbound03:26:535
4109676992927,2cyclictest283146-21kworker/u16:0+events_unbound06:40:005
4109676992927,2cyclictest242783-21kworker/u16:1+events_unbound08:24:255
4109676992927,2cyclictest100536-21kworker/u16:4+events_unbound05:34:085
4109676992927,2cyclictest100536-21kworker/u16:4+events_unbound04:48:565
4109673992927,2cyclictest212293-21kworker/u16:3+flush-8:005:58:124
4109673992927,2cyclictest111311-21kworker/u16:1+flush-8:005:33:204
4109673992926,2cyclictest60985-21kworker/u16:2+events_unbound04:48:244
4109673992926,2cyclictest364805-21kworker/u16:3+flush-8:007:13:234
4109673992926,2cyclictest242783-21kworker/u16:1+flush-8:006:28:284
4109684992827,0cyclictest0-21swapper/707:17:237
4109684992826,1cyclictest0-21swapper/707:47:357
4109684992823,4cyclictest464737-21latency_hist07:52:577
4109676992826,2cyclictest91092-21kworker/u16:3+flush-8:004:43:365
4109676992826,2cyclictest565525-21kworker/u16:3+events_unbound08:49:445
4109676992826,2cyclictest535998-21kworker/u16:4+events_unbound08:44:045
4109676992826,2cyclictest454497-21kworker/u16:0+events_unbound08:00:355
4109676992826,2cyclictest364805-21kworker/u16:3+events_unbound07:44:125
4109676992826,2cyclictest242783-21kworker/u16:1+events_unbound08:32:365
4109673992826,2cyclictest454603-21kworker/u16:2+events_unbound07:52:444
4109673992826,2cyclictest353582-21kworker/u16:2+events_unbound06:59:234
4109673992826,2cyclictest251947-21kworker/u16:4+events_unbound06:13:294
4109673992825,2cyclictest646-21kworker/u16:4+flush-8:004:08:214
1620312280,1chrt162032-21sshd-session05:22:207
4109684992726,0cyclictest0-21swapper/707:21:287
4109684992726,0cyclictest0-21swapper/705:37:167
4109684992726,0cyclictest0-21swapper/705:09:567
4109684992726,0cyclictest0-21swapper/705:04:407
4109684992721,5cyclictest589235-21systemd-journal06:43:207
4109676992725,2cyclictest434637-21kworker/u16:4+events_unbound08:04:435
4109676992725,2cyclictest4091714-21kworker/u16:3+events_unbound04:01:405
4109676992725,2cyclictest3396967-21kworker/u16:7+flush-8:003:33:485
4109676992725,2cyclictest323223-21kworker/u16:4+events_unbound07:24:025
4109676992725,2cyclictest283146-21kworker/u16:0+events_unbound06:54:125
4109676992724,2cyclictest4133760-21kworker/u16:1+flush-8:003:48:045
4109673992725,2cyclictest323223-21kworker/u16:4+events_unbound07:26:324
4109673992725,2cyclictest242783-21kworker/u16:1+events_unbound07:43:114
4109684992625,0cyclictest0-21swapper/708:15:047
4109684992625,0cyclictest0-21swapper/708:10:317
4109684992625,0cyclictest0-21swapper/706:37:407
4109684992625,0cyclictest0-21swapper/705:48:487
4109684992625,0cyclictest0-21swapper/704:45:487
4109681992624,2cyclictest4091714-21kworker/u16:3+flush-8:004:28:246
4109681992624,2cyclictest353582-21kworker/u16:2+flush-8:006:58:126
4109681992624,2cyclictest242783-21kworker/u16:1+flush-8:007:53:146
4109681992624,2cyclictest231822-21kworker/u16:2+flush-8:006:13:206
4109681992624,2cyclictest111311-21kworker/u16:1+events_unbound05:23:146
4109676992624,2cyclictest505475-21kworker/u16:5+events_unbound08:13:135
4109676992624,2cyclictest242783-21kworker/u16:1+events_unbound07:56:525
4109676992624,2cyclictest111311-21kworker/u16:1+flush-8:005:13:365
4109673992624,2cyclictest485151-21kworker/u16:2+events_unbound08:14:394
4109673992624,2cyclictest302373-21kworker/u16:3+flush-8:006:44:104
4109673992624,2cyclictest302373-21kworker/u16:3+events_unbound06:38:264
4109684992524,0cyclictest0-21swapper/703:57:147
4109684992524,0cyclictest0-21swapper/703:37:247
4109681992523,2cyclictest251947-21kworker/u16:4+events_unbound06:23:216
4109681992523,2cyclictest111311-21kworker/u16:1+flush-8:005:38:136
4109676992523,2cyclictest4091714-21kworker/u16:3+events_unbound03:45:445
4109676992523,2cyclictest30951-21kworker/u16:1+events_unbound04:22:295
4109676992523,2cyclictest212293-21kworker/u16:3+flush-8:005:45:355
4109676992523,2cyclictest100536-21kworker/u16:4+events_unbound05:27:285
4109673992523,2cyclictest535998-21kworker/u16:4+events_unbound08:33:404
4109673992523,2cyclictest364805-21kworker/u16:3+flush-8:007:18:234
4109684992423,0cyclictest0-21swapper/705:31:037
4109684992423,0cyclictest0-21swapper/704:38:077
4109684992423,0cyclictest0-21swapper/703:31:407
4109681992421,2cyclictest4179563-21kworker/u16:2+flush-8:004:03:136
4109676992422,2cyclictest4091714-21kworker/u16:3+flush-8:003:38:045
4109676992422,2cyclictest100536-21kworker/u16:4+events_unbound05:48:325
4109676992422,2cyclictest100536-21kworker/u16:4+events_unbound05:40:455
4109676992421,2cyclictest535998-21kworker/u16:4+events_unbound08:37:585
4109673992422,2cyclictest454497-21kworker/u16:0+events_unbound08:07:114
4109673992422,2cyclictest242783-21kworker/u16:1+flush-8:007:05:314
4109673992422,2cyclictest231822-21kworker/u16:2+events_unbound06:10:044
4109673992422,2cyclictest212293-21kworker/u16:3+flush-8:005:54:354
4109673992422,2cyclictest100536-21kworker/u16:4+events_unbound05:28:264
4109673992420,3cyclictest242783-21kworker/u16:1+flush-8:006:48:154
4109684992322,0cyclictest0-21swapper/708:23:487
4109681992321,2cyclictest60443-21kworker/u16:0+events_unbound05:53:106
4109676992321,2cyclictest4133760-21kworker/u16:1+events_unbound03:54:485
4109673992321,2cyclictest4081448-21kworker/u16:2+events_unbound03:29:194
4109673992321,2cyclictest353582-21kworker/u16:2+events_unbound06:56:194
4109684992221,0cyclictest0-21swapper/707:59:427
4109684992221,0cyclictest0-21swapper/707:11:407
4109684992221,0cyclictest0-21swapper/703:48:487
4109681992220,2cyclictest242783-21kworker/u16:1+flush-8:008:33:226
4109681992219,2cyclictest100536-21kworker/u16:4+flush-8:005:43:236
4109676992220,2cyclictest302373-21kworker/u16:3+events_unbound06:43:525
4109673992220,2cyclictest60985-21kworker/u16:2+flush-8:004:31:254
4109673992220,2cyclictest4091714-21kworker/u16:3+events_unbound03:37:404
4109673992220,2cyclictest353582-21kworker/u16:2+events_unbound07:34:434
4109673992220,2cyclictest242783-21kworker/u16:1+events_unbound08:23:214
4109673992220,2cyclictest231822-21kworker/u16:2+flush-8:006:33:224
4109673992220,2cyclictest212293-21kworker/u16:3+events_unbound05:48:244
4109673992220,2cyclictest111311-21kworker/u16:1+flush-8:005:01:064
4109673992219,2cyclictest4091714-21kworker/u16:3+events_unbound03:38:014
4109684992120,0cyclictest0-21swapper/706:17:297
4109684992120,0cyclictest0-21swapper/706:12:447
4109684992120,0cyclictest0-21swapper/705:17:557
4109684992120,0cyclictest0-21swapper/704:24:537
4109684992119,1cyclictest0-21swapper/706:18:447
4109684992119,1cyclictest0-21swapper/704:34:227
4109684992115,5cyclictest363890-21latency_hist07:02:577
4109681992119,2cyclictest242783-21kworker/u16:1+flush-8:008:38:266
4109676992119,2cyclictest646-21kworker/u16:4+events_unbound04:13:375
4109676992119,2cyclictest364805-21kworker/u16:3+flush-8:007:31:535
4109673992119,2cyclictest100536-21kworker/u16:4+flush-8:005:40:014
4109673992118,2cyclictest4179563-21kworker/u16:2+events_unbound03:53:264
4109684992019,0cyclictest0-21swapper/704:58:307
4109684992019,0cyclictest0-21swapper/703:25:327
4109681992018,2cyclictest60443-21kworker/u16:0+events_unbound04:48:156
4109681992016,3cyclictest111311-21kworker/u16:1+flush-8:005:03:146
4109676992018,2cyclictest251947-21kworker/u16:4+events_unbound06:20:435
4109673992018,2cyclictest60443-21kworker/u16:0+events_unbound04:37:434
4109673992018,2cyclictest565525-21kworker/u16:3+events_unbound08:50:484
4109673992018,2cyclictest535998-21kworker/u16:4+events_unbound08:41:274
4109673992018,2cyclictest434637-21kworker/u16:4+events_unbound08:08:434
4109673992018,2cyclictest4179563-21kworker/u16:2+flush-8:003:58:594
4109673992018,2cyclictest242783-21kworker/u16:1+events_unbound08:31:234
4109673992018,2cyclictest111311-21kworker/u16:1+events_unbound05:43:354
4109684991918,0cyclictest0-21swapper/705:42:237
4109684991918,0cyclictest0-21swapper/704:02:377
4109684991917,1cyclictest0-21swapper/707:54:517
4109681991917,2cyclictest485151-21kworker/u16:2+events_unbound08:28:186
4109681991916,2cyclictest4091714-21kworker/u16:3+flush-8:003:38:286
4109681991916,2cyclictest364805-21kworker/u16:3+events_unbound07:28:166
4109673991917,2cyclictest60985-21kworker/u16:2+events_unbound04:53:474
4109673991917,2cyclictest505475-21kworker/u16:5+flush-8:008:18:174
4109673991917,2cyclictest434448-21kworker/u16:0+events_unbound07:38:144
4109673991917,2cyclictest364805-21kworker/u16:3+events_unbound07:28:264
4109673991917,2cyclictest30951-21kworker/u16:1+flush-8:004:22:364
4109673991917,2cyclictest242783-21kworker/u16:1+flush-8:007:58:214
4109684991817,0cyclictest0-21swapper/706:04:007
4109681991816,2cyclictest60443-21kworker/u16:0+events_unbound04:38:136
4109681991816,2cyclictest353582-21kworker/u16:2+flush-8:007:33:166
4109681991815,2cyclictest60443-21kworker/u16:0+flush-8:005:20:516
4109681991815,2cyclictest130874-21kworker/u16:3+events_unbound05:08:156
4109673991816,2cyclictest60443-21kworker/u16:0+events_unbound05:08:264
4109673991816,2cyclictest60443-21kworker/u16:0+events_unbound05:07:144
4109673991816,2cyclictest4081448-21kworker/u16:2+events_unbound03:25:394
4109673991816,2cyclictest242783-21kworker/u16:1+events_unbound06:24:064
4109673991815,2cyclictest646-21kworker/u16:4+flush-8:004:07:214
4109684991716,0cyclictest0-21swapper/707:34:517
4109684991716,0cyclictest0-21swapper/706:49:157
4109684991716,0cyclictest0-21swapper/706:28:077
4109684991716,0cyclictest0-21swapper/704:12:117
4109681991715,2cyclictest485151-21kworker/u16:2+flush-8:008:08:216
4109681991715,2cyclictest302373-21kworker/u16:3+events_unbound06:43:256
4109673991715,2cyclictest60985-21kworker/u16:2+events_unbound04:40:184
4109673991715,2cyclictest60443-21kworker/u16:0+flush-8:005:20:384
4109673991715,2cyclictest4163687-21kworker/u16:0+events_unbound03:46:064
4109673991715,2cyclictest212293-21kworker/u16:3+flush-8:006:19:424
4109684991615,0cyclictest0-21swapper/708:36:467
4109684991615,0cyclictest0-21swapper/707:39:347
4109684991615,0cyclictest0-21swapper/705:46:027
4109684991615,0cyclictest0-21swapper/704:04:287
4109681991614,2cyclictest565525-21kworker/u16:3+flush-8:008:48:226
4109673991614,2cyclictest535998-21kworker/u16:4+events_unbound08:43:504
4109684991514,0cyclictest0-21swapper/706:56:507
4109684991512,2cyclictest96-21ksoftirqd/705:54:467
4109681991513,2cyclictest242783-21kworker/u16:1+flush-8:007:23:136
4109681991513,2cyclictest100536-21kworker/u16:4+flush-8:004:53:146
4109673991513,2cyclictest60985-21kworker/u16:2+events_unbound04:43:164
4109673991513,2cyclictest30610-21kworker/u16:5+flush-8:004:24:304
4109684991413,0cyclictest0-21swapper/708:07:407
4109681991412,2cyclictest4133760-21kworker/u16:1+events_unbound03:58:136
4109681991412,2cyclictest212293-21kworker/u16:3+flush-8:006:12:526
410968499139,3cyclictest4175659-21snmpd08:21:497
410968499139,3cyclictest4175659-21snmpd05:59:157
4109684991313,0cyclictest0-21swapper/708:32:387
4109681991311,2cyclictest130874-21kworker/u16:3+flush-8:005:13:236
4109681991310,3cyclictest30610-21kworker/u16:5+flush-8:004:23:236
410968499129,2cyclictest4175659-21snmpd06:42:077
4109684991212,0cyclictest0-21swapper/705:25:037
410968199129,2cyclictest60443-21kworker/u16:0+flush-8:005:48:136
4109681991211,1cyclictest0-21swapper/603:28:106
4109681991210,2cyclictest242783-21kworker/u16:1+flush-8:008:23:176
4109681991210,2cyclictest100536-21kworker/u16:4+events_unbound05:28:246
410968499116,4cyclictest27763-21gvfs-afc-volume08:48:137
410968199119,2cyclictest454497-21kworker/u16:0+flush-8:007:58:256
410968199119,2cyclictest323223-21kworker/u16:4+flush-8:007:03:246
410968199117,3cyclictest4134879-21cat03:33:166
4109681991110,1cyclictest0-21swapper/607:49:236
4109681991110,1cyclictest0-21swapper/607:41:496
4109681991110,1cyclictest0-21swapper/603:57:116
410968199110,1cyclictest0-21swapper/606:18:456
410968199110,11cyclictest0-21swapper/606:28:506
410968199110,11cyclictest0-21swapper/604:47:196
410968199108,2cyclictest30951-21kworker/u16:1+flush-8:004:18:236
410968199107,2cyclictest302373-21kworker/u16:3+flush-8:006:48:236
41096819997,2cyclictest19672-21kworker/u16:0+events_unbound04:13:146
41096819996,2cyclictest646-21kworker/u16:4+flush-8:004:08:166
41096819990,1cyclictest0-21swapper/605:33:216
41096819986,2cyclictest4133760-21kworker/u16:1+flush-8:003:43:166
41096819976,1cyclictest0-21swapper/608:18:526
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional