You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 16:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue Jun 02, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25078521290,67pltrace0-21swapper/707:05:167
25078521230,105pltrace0-21swapper/307:05:223
25078521190,115pltrace0-21swapper/607:05:136
25078521170,108pltrace0-21swapper/507:05:045
25078521110,107pltrace0-21swapper/207:05:122
14284521040,2pltrace0-21swapper/311:47:483
25078521030,99pltrace0-21swapper/107:05:191
248672660,0sleep30-21swapper/310:50:143
2782926147,10sleep00-21swapper/007:07:310
2524225743,10sleep40-21swapper/407:05:014
3094352550,6pltrace78-21ksoftirqd/709:10:517
694152510,14pltrace78-21ksoftirqd/709:22:277
1428452410,0pltrace0-21swapper/711:47:587
503952390,1pltrace0-21swapper/711:41:567
3256752380,7pltrace78-21ksoftirqd/711:02:157
27572360,1sleep015-21ksoftirqd/012:10:170
1799952360,9pltrace78-21ksoftirqd/710:43:447
944052350,8pltrace78-21ksoftirqd/711:10:287
1472152350,6pltrace78-21ksoftirqd/712:23:437
2450252340,8pltrace78-21ksoftirqd/709:41:507
1799952340,1pltrace0-21swapper/710:45:547
3238652330,5pltrace78-21ksoftirqd/711:34:057
2807852330,8pltrace78-21ksoftirqd/712:37:597
2450252330,7pltrace78-21ksoftirqd/709:38:047
503952320,6pltrace78-21ksoftirqd/711:38:177
2243752310,7pltrace78-21ksoftirqd/710:50:437
1174952310,6pltrace78-21ksoftirqd/709:25:527
107432310,0sleep6681rcuc/608:30:206
996552300,3pltrace0-21swapper/712:19:067
3271852300,6pltrace78-21ksoftirqd/709:49:287
2765152280,6pltrace78-21ksoftirqd/710:21:087
1472152260,1pltrace0-21swapper/712:25:097
2824699240,23cyclictest0-21swapper/507:30:205
2823799230,22cyclictest0-21swapper/309:36:223
2823499200,19cyclictest0-21swapper/212:07:562
2823499200,19cyclictest0-21swapper/212:07:562
196152200,8pltrace0-21swapper/707:22:237
2825599190,7cyclictest0-21swapper/710:19:547
2823499190,18cyclictest0-21swapper/210:00:222
2823499190,10cyclictest3890-21expr09:15:132
2773752190,0pltrace0-21swapper/712:03:377
2773752190,0pltrace0-21swapper/712:03:377
996552180,11pltrace54-21ksoftirqd/412:18:224
304152180,11pltrace0-21swapper/308:20:183
2823499181,16cyclictest0-21swapper/211:47:422
2823499180,9cyclictest16111-21sed10:40:152
2823499180,8cyclictest31101-21munin-node12:25:202
2823499180,5cyclictest0-21swapper/212:10:022
2286652180,9pltrace54-21ksoftirqd/411:24:214
2824699171,4cyclictest0-21swapper/510:34:405
28242991712,4cyclictest0-21swapper/410:07:174
28242991711,5cyclictest0-21swapper/412:00:004
28242991711,5cyclictest0-21swapper/412:00:004
2823499175,11cyclictest1055-13auditd11:59:592
2823499175,11cyclictest1055-13auditd11:59:592
2823499170,17cyclictest0-21swapper/211:18:432
2823499170,17cyclictest0-21swapper/210:38:342
2823499170,17cyclictest0-21swapper/209:22:292
2823499170,16cyclictest0-21swapper/210:24:482
2823499170,16cyclictest0-21swapper/209:00:182
2823499170,16cyclictest0-21swapper/209:00:182
2823499170,11cyclictest25080-21uname10:50:162
2823499170,10cyclictest25343-21grep12:00:122
2823499170,10cyclictest25343-21grep12:00:122
2822999171,4cyclictest0-21swapper/109:05:491
2822999170,15cyclictest0-21swapper/111:29:021
28225991711,5cyclictest0-21swapper/009:54:510
1918852170,10pltrace54-21ksoftirqd/412:31:414
982652160,12pltrace13681-21ssh11:46:221
304152160,11pltrace0-21swapper/608:20:186
2825599160,2cyclictest0-21swapper/708:07:477
2825599160,15cyclictest1146-21snmpd10:02:067
2824699161,14cyclictest0-21swapper/508:33:235
2824699160,8cyclictest0-21swapper/512:27:205
2824299161,3cyclictest0-21swapper/410:02:324
2824299161,14cyclictest0-21swapper/412:22:064
2824299161,14cyclictest0-21swapper/408:42:144
2824299161,13cyclictest0-21swapper/412:05:554
2824299161,13cyclictest0-21swapper/412:05:554
2824299160,8cyclictest0-21swapper/411:54:434
28237991611,3cyclictest0-21swapper/311:58:573
28237991611,3cyclictest0-21swapper/311:58:573
28237991611,3cyclictest0-21swapper/311:06:073
28237991611,3cyclictest0-21swapper/310:02:113
28237991610,5cyclictest0-21swapper/312:05:213
28237991610,5cyclictest0-21swapper/312:05:213
2823799161,8cyclictest0-21swapper/311:21:593
2823799161,4cyclictest0-21swapper/312:12:363
2823799161,14cyclictest0-21swapper/311:04:523
2823799161,14cyclictest0-21swapper/310:27:483
2823799160,15cyclictest0-21swapper/311:34:183
2823799160,15cyclictest0-21swapper/309:41:253
2823499161,7cyclictest0-21swapper/211:36:502
2823499161,14cyclictest0-21swapper/209:46:172
2823499161,14cyclictest0-21swapper/207:54:312
2823499160,8cyclictest0-21swapper/209:36:382
2823499160,15cyclictest0-21swapper/208:36:092
2823499160,15cyclictest0-21swapper/208:20:482
2823499160,10cyclictest31153-21runrttasks11:30:332
28229991610,5cyclictest0-21swapper/109:48:531
2822999161,8cyclictest0-21swapper/111:37:021
2822599161,7cyclictest0-21swapper/008:12:500
2822599161,14cyclictest0-21swapper/007:10:450
2822599160,4cyclictest0-21swapper/008:49:000
2822599160,15cyclictest0-21swapper/011:34:170
2822599160,15cyclictest0-21swapper/010:08:300
2533452160,0pltrace0-21swapper/709:00:147
2533452160,0pltrace0-21swapper/709:00:147
2425052160,1pltrace0-21swapper/207:58:432
2363052160,11pltrace0-21swapper/112:36:581
1589152160,12pltrace54-21ksoftirqd/407:45:554
982652150,2pltrace13561-21ssh11:46:065
753052150,3pltrace54-21ksoftirqd/407:29:024
3271852150,10pltrace0-21swapper/609:52:286
304152150,2pltrace0-21swapper/708:21:517
2825599150,7cyclictest0-21swapper/709:55:517
2825599150,7cyclictest0-21swapper/709:06:527
2825599150,7cyclictest0-21swapper/707:29:577
2825599150,4cyclictest0-21swapper/707:48:197
28251991514,1cyclictest0-21swapper/607:35:126
2825199150,8cyclictest0-21swapper/609:30:536
2825199150,7cyclictest0-21swapper/610:24:496
2825199150,4cyclictest0-21swapper/610:38:546
2825199150,14cyclictest0-21swapper/609:35:216
2824699159,5cyclictest0-21swapper/510:22:255
2824699150,8cyclictest0-21swapper/508:37:145
2824699150,7cyclictest0-21swapper/512:14:165
2824699150,7cyclictest0-21swapper/507:22:415
2824699150,14cyclictest0-21swapper/511:36:005
2824699150,14cyclictest0-21swapper/507:49:275
2824699150,1cyclictest0-21swapper/512:05:285
2824699150,1cyclictest0-21swapper/512:05:285
28242991512,2cyclictest26623-21ssh11:26:054
2824299151,7cyclictest0-21swapper/408:50:474
2824299150,3cyclictest0-21swapper/410:55:244
2824299150,14cyclictest0-21swapper/407:10:204
28237991513,1cyclictest0-21swapper/310:10:453
28237991511,3cyclictest0-21swapper/309:55:023
28237991510,3cyclictest0-21swapper/309:24:043
2823799151,3cyclictest0-21swapper/307:55:273
2823799150,7cyclictest0-21swapper/307:11:423
2823799150,4cyclictest0-21swapper/312:31:263
2823499157,7cyclictest1478-21lldpd09:09:222
2823499150,9cyclictest30748-21cstates08:10:102
2823499150,8cyclictest0-21swapper/212:19:542
2823499150,7cyclictest0-21swapper/212:37:282
2823499150,7cyclictest0-21swapper/208:51:152
2823499150,4cyclictest0-21swapper/208:04:202
2823499150,3cyclictest0-21swapper/211:52:202
2823499150,14cyclictest24926-21fschecks_time10:15:152
2823499150,14cyclictest0-21swapper/212:33:292
2823499150,14cyclictest0-21swapper/209:53:452
2823499150,14cyclictest0-21swapper/209:40:532
2823499150,14cyclictest0-21swapper/209:29:562
2823499150,14cyclictest0-21swapper/208:33:452
2823499150,14cyclictest0-21swapper/207:11:002
2823499150,13cyclictest17175-21fschecks_time07:45:132
28229991511,3cyclictest1065-17sedispatch12:15:001
28229991510,4cyclictest0-21swapper/109:14:551
2822999151,3cyclictest0-21swapper/107:53:281
2822999150,8cyclictest0-21swapper/110:53:471
2822999150,7cyclictest0-21swapper/111:55:451
2822999150,7cyclictest0-21swapper/111:55:451
2822999150,7cyclictest0-21swapper/111:40:561
2822999150,7cyclictest0-21swapper/109:39:231
2822999150,4cyclictest0-21swapper/111:12:531
2822999150,14cyclictest0-21swapper/111:17:141
28225991513,1cyclictest0-21swapper/009:23:380
2822599151,7cyclictest0-21swapper/008:08:170
2822599150,8cyclictest0-21swapper/008:25:470
2822599150,7cyclictest0-21swapper/011:56:260
2822599150,7cyclictest0-21swapper/011:56:260
2822599150,7cyclictest0-21swapper/010:14:420
2822599150,7cyclictest0-21swapper/009:38:290
2822599150,4cyclictest0-21swapper/007:23:330
2822599150,14cyclictest0-21swapper/009:13:550
2822599150,14cyclictest0-21swapper/008:30:220
2822599150,1cyclictest0-21swapper/011:02:430
2533452150,2pltrace0-21swapper/708:59:347
2533452150,2pltrace0-21swapper/708:59:347
195172150,0sleep70-21swapper/710:10:137
117962150,1sleep50-21swapper/507:35:145
103422150,1sleep30-21swapper/310:34:593
304152140,2pltrace4988-21ntp_kernel_pll_08:20:145
2825599140,12cyclictest0-21swapper/709:20:017
2825199149,3cyclictest0-21swapper/611:40:006
28251991413,1cyclictest0-21swapper/611:03:456
28251991413,1cyclictest0-21swapper/610:09:506
2825199140,3cyclictest0-21swapper/611:51:366
2825199140,13cyclictest0-21swapper/610:25:036
2825199140,1cyclictest0-21swapper/612:12:346
2825199140,1cyclictest0-21swapper/611:23:016
2825199140,1cyclictest0-21swapper/609:45:236
2824699140,7cyclictest0-21swapper/511:44:255
2824699140,7cyclictest0-21swapper/509:33:225
2824699140,14cyclictest0-21swapper/511:28:435
2824699140,13cyclictest0-21swapper/512:33:025
2824699140,13cyclictest0-21swapper/510:00:575
2824699140,1cyclictest0-21swapper/510:36:545
2824699140,1cyclictest0-21swapper/509:44:265
2824299149,3cyclictest0-21swapper/409:14:214
2824299140,14cyclictest0-21swapper/412:13:124
2824299140,14cyclictest0-21swapper/410:33:274
2824299140,14cyclictest0-21swapper/409:53:174
2824299140,13cyclictest0-21swapper/407:19:484
2824299140,1cyclictest0-21swapper/410:36:124
2824299140,1cyclictest0-21swapper/410:27:564
2823799148,3cyclictest0-21swapper/308:55:233
2823799148,3cyclictest0-21swapper/308:55:233
2823799140,14cyclictest0-21swapper/310:55:263
2823799140,12cyclictest0-21swapper/308:17:103
2823799140,1cyclictest0-21swapper/311:35:163
2823799140,1cyclictest0-21swapper/310:40:133
2823799140,1cyclictest0-21swapper/309:19:063
2823499149,3cyclictest0-21swapper/207:19:122
2823499148,5cyclictest0-21swapper/207:40:192
2823499146,7cyclictest1146-21snmpd09:11:002
2823499142,11cyclictest0-21swapper/208:41:512
2823499140,8cyclictest10176-21sh11:09:342
2823499140,8cyclictest10001-21latency_hist10:34:592
2823499140,7cyclictest0-21swapper/212:21:552
2823499140,3cyclictest0-21swapper/211:10:342
2823499140,3cyclictest0-21swapper/208:08:472
2823499140,13cyclictest0-21swapper/210:46:272
2823499140,12cyclictest3423-21grep07:20:142
2822999148,4cyclictest0-21swapper/110:38:521
28229991411,2cyclictest0-21swapper/110:25:191
28229991410,2cyclictest0-21swapper/110:07:211
2822999140,13cyclictest0-21swapper/110:33:441
28225991413,1cyclictest0-21swapper/011:47:050
28225991413,1cyclictest0-21swapper/011:15:010
2822599140,8cyclictest0-21swapper/008:43:500
2822599140,14cyclictest0-21swapper/011:36:140
2822599140,13cyclictest0-21swapper/012:34:080
2822599140,1cyclictest6647-21strings07:25:170
2822599140,1cyclictest0-21swapper/012:08:270
2822599140,1cyclictest0-21swapper/012:08:270
2822599140,1cyclictest0-21swapper/011:40:070
2822599140,1cyclictest0-21swapper/010:48:180
2822599140,1cyclictest0-21swapper/010:23:320
2822599140,1cyclictest0-21swapper/007:55:140
982652130,5pltrace0-21swapper/611:46:156
3256752130,8pltrace54-21ksoftirqd/411:00:594
3094352130,1pltrace1563-21ssh09:11:093
3072952130,5pltrace0-21swapper/707:17:077
304152130,3pltrace4723-21wc08:20:141
304152130,0pltrace0-21swapper/708:18:457
28255991311,1cyclictest0-21swapper/710:38:517
2825599130,12cyclictest0-21swapper/707:31:187
28251991312,1cyclictest0-21swapper/612:25:316
28251991312,1cyclictest0-21swapper/612:06:156
28251991312,1cyclictest0-21swapper/612:06:156
28251991312,1cyclictest0-21swapper/611:56:426
28251991312,1cyclictest0-21swapper/611:56:426
28251991312,1cyclictest0-21swapper/610:41:346
28251991312,1cyclictest0-21swapper/610:15:216
28251991312,1cyclictest0-21swapper/610:12:356
28251991310,2cyclictest1146-21snmpd09:20:166
2825199130,6cyclictest0-21swapper/608:17:506
2825199130,12cyclictest0-21swapper/608:39:496
2825199130,1cyclictest0-21swapper/609:05:196
2825199130,1cyclictest0-21swapper/608:13:556
2824699139,3cyclictest26647-21fschecks_time09:00:155
2824699139,3cyclictest26647-21fschecks_time09:00:145
2824699137,5cyclictest0-21swapper/507:55:365
2824699137,3cyclictest0-21swapper/507:41:155
28246991312,1cyclictest0-21swapper/511:55:555
28246991312,1cyclictest0-21swapper/511:55:555
28246991312,1cyclictest0-21swapper/511:31:085
28246991312,1cyclictest0-21swapper/511:17:235
28246991312,1cyclictest0-21swapper/510:41:555
28246991312,1cyclictest0-21swapper/509:15:085
28246991311,1cyclictest0-21swapper/512:16:585
2824699130,13cyclictest0-21swapper/512:24:445
2824699130,12cyclictest0-21swapper/508:19:555
28242991312,1cyclictest0-21swapper/411:16:414
28242991312,1cyclictest0-21swapper/410:21:284
28242991311,1cyclictest0-21swapper/409:55:534
28242991310,2cyclictest0-21swapper/407:41:184
2824299130,13cyclictest0-21swapper/412:02:404
2824299130,13cyclictest0-21swapper/412:02:404
2823799137,5cyclictest0-21swapper/312:35:193
2823799137,5cyclictest0-21swapper/310:22:033
2823799137,5cyclictest0-21swapper/309:25:223
28237991312,1cyclictest0-21swapper/311:19:343
28237991312,1cyclictest0-21swapper/310:16:163
2823799130,3cyclictest3111-21sh09:50:183
2823799130,13cyclictest0-21swapper/312:29:113
2823499133,9cyclictest6228-21expr07:25:142
2823499131,11cyclictest0-21swapper/210:05:182
2823499130,8cyclictest12453-21sensors07:35:212
2823499130,12cyclictest24763-21sort08:55:222
2823499130,12cyclictest24763-21sort08:55:222
2823499130,12cyclictest21788-21head11:20:212
2823499130,11cyclictest8355-21expr07:30:122
2823499130,11cyclictest6681-21grep08:25:142
2823499130,11cyclictest19018-21grep08:45:202
2823499130,11cyclictest1422-21fschecks_count08:15:132
2822999138,2cyclictest14121-21ssh12:21:261
2822999130,13cyclictest0-21swapper/112:05:421
2822999130,13cyclictest0-21swapper/112:05:411
2822599137,3cyclictest0-21swapper/011:27:450
28225991312,1cyclictest0-21swapper/012:22:320
28225991312,1cyclictest0-21swapper/012:15:150
28225991312,1cyclictest0-21swapper/010:00:230
28225991310,2cyclictest0-21swapper/009:07:530
2822599130,13cyclictest0-21swapper/012:00:310
2822599130,13cyclictest0-21swapper/012:00:310
2822599130,13cyclictest0-21swapper/010:41:010
2822599130,13cyclictest0-21swapper/010:26:460
2822599130,12cyclictest0-21swapper/009:42:320
2822599130,12cyclictest0-21swapper/009:18:550
2822599130,1cyclictest0-21swapper/010:50:340
2822599130,1cyclictest0-21swapper/009:49:320
2773752130,5pltrace0-21swapper/312:03:413
2773752130,5pltrace0-21swapper/312:03:413
1975752130,6pltrace0-21swapper/508:51:075
1729252130,6pltrace22196-21ssh10:12:211
1729252130,5pltrace0-21swapper/510:12:205
1418452130,5pltrace0-21swapper/708:41:047
1418452130,5pltrace0-21swapper/508:41:075
1354652130,5pltrace0-21swapper/110:41:401
996552120,1pltrace10367-21ssh12:18:331
944052120,4pltrace0-21swapper/311:12:343
852552120,5pltrace0-21swapper/110:01:281
474852120,5pltrace0-21swapper/307:26:023
3265852120,0pltrace0-21swapper/708:13:537
3094352120,4pltrace0-21swapper/609:11:116
2825599126,5cyclictest0-21swapper/708:28:387
2825599125,6cyclictest0-21swapper/711:08:027
2825599125,6cyclictest0-21swapper/710:08:037
2825599120,12cyclictest0-21swapper/711:18:317
2825599120,11cyclictest0-21swapper/711:22:517
2825599120,11cyclictest0-21swapper/710:25:257
2825199127,3cyclictest0-21swapper/608:05:236
2825199126,3cyclictest0-21swapper/608:43:246
2825199123,8cyclictest0-21swapper/607:19:176
28251991211,1cyclictest0-21swapper/612:15:096
28251991210,1cyclictest0-21swapper/607:12:526
2825199120,12cyclictest0-21swapper/608:55:226
2825199120,12cyclictest0-21swapper/608:55:226
2825199120,11cyclictest0-21swapper/608:48:216
2824699129,2cyclictest1066-13audispd10:10:005
2824699127,3cyclictest8300-21ssh09:57:125
2824699127,3cyclictest0-21swapper/509:27:585
28246991211,1cyclictest0-21swapper/509:45:435
2824299126,5cyclictest0-21swapper/412:39:294
2824299126,5cyclictest0-21swapper/408:30:414
2824299126,5cyclictest0-21swapper/407:21:154
28242991211,1cyclictest0-21swapper/410:41:144
28242991211,1cyclictest0-21swapper/409:25:464
28242991211,1cyclictest0-21swapper/409:21:244
28242991210,1cyclictest0-21swapper/409:45:024
28237991211,1cyclictest0-21swapper/310:37:283
28237991210,1cyclictest0-21swapper/308:00:063
2823499123,8cyclictest29578-21expr10:55:122
2823499123,8cyclictest17523-21hostname09:30:112
2823499122,9cyclictest5797-21cpuspeed_turbos09:55:122
2823499120,11cyclictest7286-21cut11:40:132
2823499120,11cyclictest24506-21tr11:25:112
2823499120,11cyclictest2251-21cstates11:00:112
2823499120,11cyclictest20357-21needreboot10:10:172
2823499120,11cyclictest1884-21expr10:25:122
28229991211,1cyclictest0-21swapper/110:49:561
28229991211,1cyclictest0-21swapper/109:44:121
28229991211,1cyclictest0-21swapper/107:40:011
2822999120,11cyclictest0-21swapper/107:57:201
2822999120,1cyclictest0-21swapper/111:51:361
2822999120,1cyclictest0-21swapper/109:59:351
28225991211,1cyclictest0-21swapper/010:38:160
28225991211,1cyclictest0-21swapper/009:26:420
2773752120,5pltrace0-21swapper/512:03:475
2773752120,5pltrace0-21swapper/512:03:475
2706352120,5pltrace0-21swapper/508:02:475
2533452120,0pltrace0-21swapper/309:00:483
2533452120,0pltrace0-21swapper/309:00:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional