You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 17:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot8s (updated Tue Jul 01, 2025 12:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8250182132119,8sleep20-21swapper/207:05:162
826951213191,21sleep60-21swapper/607:07:376
827043212290,9sleep40-21swapper/407:08:554
8268362122108,9sleep10-21swapper/107:05:541
8271012121107,9sleep50-21swapper/507:09:445
8268782121107,9sleep70-21swapper/707:06:337
8268152121107,9sleep00-21swapper/007:05:370
8270042119104,10sleep30-21swapper/307:08:223
827386991030,100cyclictest0-21swapper/608:01:496
827381991030,100cyclictest0-21swapper/512:26:205
827364991030,102cyclictest0-21swapper/110:38:031
8273869910299,2cyclictest573-21snmpd11:08:186
8273819910299,2cyclictest842378-21ntp_states07:35:245
827368991020,100cyclictest1065816-21grep12:15:142
8273649910299,3cyclictest573-21snmpd08:40:081
8273649910299,3cyclictest573-21snmpd08:10:131
827388991010,101cyclictest0-21swapper/709:30:397
8273869910199,2cyclictest573-21snmpd11:42:346
8273869910199,2cyclictest573-21snmpd11:24:346
8273869910199,2cyclictest573-21snmpd10:45:426
8273869910198,3cyclictest1023955-21cat11:35:156
827386991010,100cyclictest0-21swapper/612:15:426
8273819910198,3cyclictest573-21snmpd12:38:525
827381991010,99cyclictest0-21swapper/508:39:435
827381991010,99cyclictest0-21swapper/508:12:155
827381991010,101cyclictest0-21swapper/512:34:155
827381991010,101cyclictest0-21swapper/511:16:195
827381991010,101cyclictest0-21swapper/507:53:315
827381991010,0cyclictest0-21swapper/509:18:095
8273779910199,2cyclictest573-21snmpd08:50:454
8273779910199,2cyclictest573-21snmpd08:26:294
8273779910199,2cyclictest573-21snmpd08:15:434
8273779910198,3cyclictest573-21snmpd07:24:304
8273779910197,4cyclictest573-21snmpd11:22:104
827377991010,99cyclictest0-21swapper/409:01:304
827377991010,99cyclictest0-21swapper/407:17:464
827377991010,100cyclictest0-21swapper/411:51:234
827377991010,100cyclictest0-21swapper/410:03:264
827377991010,100cyclictest0-21swapper/408:05:164
8273689910199,1cyclictest573-21snmpd08:28:442
827368991010,100cyclictest0-21swapper/212:05:032
8273649910199,2cyclictest573-21snmpd07:36:561
8273649910198,3cyclictest925584-21cat09:50:141
8273649910197,3cyclictest573-21snmpd12:26:481
82736499101100,1cyclictest573-21snmpd10:16:141
827364991010,99cyclictest0-21swapper/108:58:451
827364991010,101cyclictest0-21swapper/107:49:461
8273609910199,1cyclictest573-21snmpd10:35:420
827360991010,99cyclictest0-21swapper/010:20:530
827360991010,99cyclictest0-21swapper/007:30:440
827360991010,101cyclictest0-21swapper/008:57:210
827360991010,101cyclictest0-21swapper/007:29:540
827360991010,100cyclictest0-21swapper/008:50:270
827360991010,0cyclictest0-21swapper/011:25:070
8273889910099,1cyclictest0-21swapper/711:35:267
827388991000,99cyclictest0-21swapper/708:15:047
827388991000,100cyclictest0-21swapper/712:10:157
827388991000,100cyclictest0-21swapper/708:56:187
8273869910099,1cyclictest573-21snmpd11:53:416
8273869910099,1cyclictest573-21snmpd11:30:016
8273869910099,1cyclictest573-21snmpd11:13:006
8273869910099,1cyclictest573-21snmpd07:33:486
8273869910098,2cyclictest573-21snmpd11:45:236
8273869910097,3cyclictest573-21snmpd09:00:476
827386991000,99cyclictest0-21swapper/608:22:326
8273819910099,1cyclictest573-21snmpd11:03:075
8273819910099,1cyclictest573-21snmpd10:16:285
8273819910098,2cyclictest573-21snmpd07:25:035
827381991000,99cyclictest0-21swapper/511:55:385
827381991000,99cyclictest0-21swapper/511:37:015
827381991000,99cyclictest0-21swapper/511:31:565
827381991000,99cyclictest0-21swapper/509:27:125
827381991000,98cyclictest0-21swapper/507:18:265
8273779910099,1cyclictest573-21snmpd12:17:274
8273779910099,1cyclictest573-21snmpd12:10:574
8273779910099,1cyclictest573-21snmpd10:32:064
8273779910099,1cyclictest573-21snmpd08:46:324
8273779910099,1cyclictest573-21snmpd08:30:564
8273779910099,0cyclictest573-21snmpd08:59:324
827377991000,100cyclictest0-21swapper/412:24:384
827377991000,100cyclictest0-21swapper/411:41:294
827377991000,100cyclictest0-21swapper/410:35:174
8273729910099,1cyclictest573-21snmpd12:09:303
8273729910099,1cyclictest573-21snmpd10:53:513
8273729910099,1cyclictest573-21snmpd10:00:503
8273729910099,1cyclictest573-21snmpd09:17:123
8273729910099,1cyclictest573-21snmpd08:23:083
8273729910099,1cyclictest573-21snmpd07:58:493
8273729910098,1cyclictest573-21snmpd09:40:133
8273689910099,1cyclictest573-21snmpd10:04:382
8273689910099,1cyclictest573-21snmpd08:24:052
8273689910099,1cyclictest573-21snmpd07:53:012
8273689910099,1cyclictest573-21snmpd07:17:262
8273689910099,1cyclictest0-21swapper/211:58:552
827368991000,99cyclictest0-21swapper/211:25:162
827368991000,99cyclictest0-21swapper/211:12:432
827368991000,99cyclictest0-21swapper/209:59:562
827368991000,100cyclictest0-21swapper/210:45:172
8273649910099,1cyclictest573-21snmpd12:00:081
8273649910099,1cyclictest573-21snmpd11:35:171
8273649910099,1cyclictest573-21snmpd10:09:011
8273649910097,3cyclictest573-21snmpd12:30:331
8273649910097,3cyclictest573-21snmpd09:18:051
827364991000,99cyclictest0-21swapper/108:16:161
827364991000,100cyclictest0-21swapper/110:57:061
827364991000,100cyclictest0-21swapper/108:07:221
827364991000,100cyclictest0-21swapper/107:25:571
8273609910099,1cyclictest573-21snmpd12:29:570
8273609910099,1cyclictest573-21snmpd10:19:170
8273609910099,1cyclictest573-21snmpd09:31:340
8273609910099,1cyclictest573-21snmpd07:15:110
8273609910098,2cyclictest573-21snmpd10:46:060
8273609910098,1cyclictest573-21snmpd08:04:430
827360991000,99cyclictest0-21swapper/011:08:010
827360991000,100cyclictest0-21swapper/009:18:030
82738899990,99cyclictest0-21swapper/711:59:597
82738899990,99cyclictest0-21swapper/710:26:247
82738899990,99cyclictest0-21swapper/709:40:107
82738899990,99cyclictest0-21swapper/708:45:327
82738899990,99cyclictest0-21swapper/708:44:317
82738899990,99cyclictest0-21swapper/708:14:287
82738899990,0cyclictest0-21swapper/711:02:437
82738899990,0cyclictest0-21swapper/707:21:447
827386999999,0cyclictest573-21snmpd08:07:556
827386999998,1cyclictest573-21snmpd12:31:356
827386999998,1cyclictest573-21snmpd11:25:196
827386999998,1cyclictest573-21snmpd11:01:376
827386999998,1cyclictest573-21snmpd08:38:056
827386999998,1cyclictest573-21snmpd07:37:096
827386999998,1cyclictest573-21snmpd07:16:116
827386999997,2cyclictest573-21snmpd08:13:316
827386999996,3cyclictest573-21snmpd08:43:316
82738699990,99cyclictest0-21swapper/612:07:036
82738699990,99cyclictest0-21swapper/610:53:546
82738699990,99cyclictest0-21swapper/610:39:546
82738699990,99cyclictest0-21swapper/608:25:566
82738699990,99cyclictest0-21swapper/607:55:256
827381999999,0cyclictest573-21snmpd11:14:135
827381999999,0cyclictest573-21snmpd11:06:455
827381999999,0cyclictest573-21snmpd07:48:475
827381999998,1cyclictest573-21snmpd10:32:245
827381999998,1cyclictest573-21snmpd09:13:125
827381999996,3cyclictest573-21snmpd07:42:215
82738199990,99cyclictest0-21swapper/511:46:235
82738199990,99cyclictest0-21swapper/510:49:545
82738199990,99cyclictest0-21swapper/510:08:145
82738199990,99cyclictest0-21swapper/509:58:385
82738199990,99cyclictest0-21swapper/509:22:405
82738199990,99cyclictest0-21swapper/509:07:245
82738199990,98cyclictest0-21swapper/508:41:355
82738199990,98cyclictest0-21swapper/508:05:585
82738199990,0cyclictest0-21swapper/511:24:135
827377999998,1cyclictest573-21snmpd10:27:574
827377999998,1cyclictest573-21snmpd09:21:084
827377999998,1cyclictest573-21snmpd07:49:204
827377999997,2cyclictest573-21snmpd10:21:324
82737799990,99cyclictest0-21swapper/407:12:504
827372999999,0cyclictest573-21snmpd12:14:033
827372999999,0cyclictest573-21snmpd11:29:453
827372999999,0cyclictest573-21snmpd11:24:583
827372999999,0cyclictest573-21snmpd10:59:583
827372999999,0cyclictest573-21snmpd10:10:373
827372999999,0cyclictest573-21snmpd09:51:133
827372999999,0cyclictest573-21snmpd09:29:253
827372999999,0cyclictest573-21snmpd08:46:263
827372999999,0cyclictest573-21snmpd08:44:083
827372999999,0cyclictest573-21snmpd07:20:573
827372999998,1cyclictest573-21snmpd11:59:523
827372999998,1cyclictest573-21snmpd10:25:363
827372999998,1cyclictest573-21snmpd08:54:393
827372999998,1cyclictest573-21snmpd07:52:073
827368999999,0cyclictest573-21snmpd12:04:542
827368999999,0cyclictest573-21snmpd08:33:402
827368999998,1cyclictest894918-21cat09:15:162
827368999998,1cyclictest573-21snmpd11:17:072
827368999998,1cyclictest573-21snmpd10:39:182
827368999998,1cyclictest573-21snmpd10:25:332
82736899990,99cyclictest0-21swapper/212:27:002
82736899990,99cyclictest0-21swapper/211:53:372
82736899990,99cyclictest0-21swapper/211:47:082
82736899990,99cyclictest0-21swapper/209:35:042
82736899990,99cyclictest0-21swapper/209:02:062
82736899990,99cyclictest0-21swapper/208:40:382
82736899990,99cyclictest0-21swapper/208:08:242
82736899990,98cyclictest0-21swapper/210:12:292
82736899990,98cyclictest0-21swapper/209:34:372
82736899990,0cyclictest0-21swapper/207:46:542
82736899990,0cyclictest0-21swapper/207:35:442
827364999999,0cyclictest573-21snmpd12:23:421
827364999999,0cyclictest573-21snmpd11:59:261
827364999999,0cyclictest573-21snmpd10:52:171
827364999999,0cyclictest573-21snmpd09:33:581
827364999999,0cyclictest573-21snmpd07:55:491
827364999998,1cyclictest573-21snmpd11:29:011
827364999998,1cyclictest573-21snmpd10:47:151
827364999998,1cyclictest573-21snmpd10:22:201
827364999998,1cyclictest573-21snmpd08:53:021
827364999996,3cyclictest573-21snmpd08:48:211
82736499990,99cyclictest889313-21diskmemload12:11:421
82736499990,99cyclictest0-21swapper/110:41:001
82736499990,99cyclictest0-21swapper/109:56:351
82736499990,99cyclictest0-21swapper/109:40:571
82736499990,99cyclictest0-21swapper/109:13:061
82736499990,99cyclictest0-21swapper/107:43:511
82736499990,98cyclictest0-21swapper/111:47:171
82736499990,0cyclictest0-21swapper/111:11:311
82736499990,0cyclictest0-21swapper/109:00:031
827360999999,0cyclictest573-21snmpd12:22:150
827360999999,0cyclictest573-21snmpd12:15:270
827360999999,0cyclictest573-21snmpd09:58:110
827360999999,0cyclictest573-21snmpd09:20:210
827360999998,1cyclictest573-21snmpd10:12:530
827360999996,2cyclictest0-21swapper/010:31:360
82736099990,99cyclictest0-21swapper/009:48:430
82736099990,98cyclictest0-21swapper/008:32:110
82736099990,0cyclictest0-21swapper/010:28:260
82736099990,0cyclictest0-21swapper/008:36:230
82736099990,0cyclictest0-21swapper/008:16:400
827388999898,0cyclictest0-21swapper/707:41:457
82738899980,98cyclictest0-21swapper/708:54:337
82738899980,98cyclictest0-21swapper/708:26:087
82738899980,98cyclictest0-21swapper/708:22:257
827386999897,1cyclictest573-21snmpd11:15:436
827386999896,2cyclictest573-21snmpd11:57:476
827386999896,2cyclictest573-21snmpd10:03:026
827381999898,0cyclictest573-21snmpd12:11:215
827381999898,0cyclictest573-21snmpd09:00:005
827381999897,1cyclictest958761-21cat10:25:175
827381999897,1cyclictest573-21snmpd10:10:175
82738199980,97cyclictest0-21swapper/511:50:115
82738199980,97cyclictest0-21swapper/507:57:525
827377999897,1cyclictest836979-21cat07:25:164
827377999897,1cyclictest573-21snmpd09:16:184
82737799980,98cyclictest0-21swapper/410:51:544
82737799980,98cyclictest0-21swapper/408:03:254
82737799980,97cyclictest0-21swapper/412:29:214
827372999897,1cyclictest573-21snmpd11:33:313
827372999897,1cyclictest573-21snmpd10:23:023
827372999897,1cyclictest573-21snmpd08:55:323
827368999898,0cyclictest573-21snmpd11:37:442
827368999898,0cyclictest573-21snmpd09:21:322
827368999897,1cyclictest990593-21cat11:00:182
827368999897,1cyclictest573-21snmpd10:55:052
827368999897,1cyclictest573-21snmpd10:20:022
827368999897,1cyclictest573-21snmpd09:43:332
827368999892,1cyclictest141rcu_preempt12:31:432
82736899980,98cyclictest0-21swapper/211:44:562
82736899980,98cyclictest0-21swapper/210:54:272
82736899980,97cyclictest0-21swapper/210:42:452
827364999898,0cyclictest573-21snmpd09:23:191
827364999896,2cyclictest573-21snmpd11:34:351
827364999896,2cyclictest573-21snmpd11:17:461
827364999896,2cyclictest573-21snmpd07:18:031
827364999895,2cyclictest849560-21cat07:50:181
82736499980,98cyclictest0-21swapper/110:12:081
827360999898,0cyclictest573-21snmpd11:11:520
827360999897,1cyclictest573-21snmpd12:02:410
827360999897,1cyclictest573-21snmpd09:25:340
827360999896,2cyclictest573-21snmpd08:28:310
82736099980,98cyclictest0-21swapper/012:07:540
82736099980,97cyclictest0-21swapper/010:59:160
82736099980,97cyclictest0-21swapper/009:40:460
82738899970,97cyclictest0-21swapper/711:24:437
82738899970,97cyclictest0-21swapper/710:55:307
82738899970,97cyclictest0-21swapper/710:41:157
82738899970,96cyclictest0-21swapper/710:11:327
82738699970,97cyclictest0-21swapper/612:04:236
82738699970,96cyclictest0-21swapper/607:53:526
827381999797,0cyclictest573-21snmpd09:52:005
827381999796,1cyclictest912202-21cat09:35:185
827381999796,1cyclictest0-21swapper/512:06:275
827381999795,1cyclictest0-21swapper/508:15:065
82738199970,97cyclictest0-21swapper/510:42:265
827377999796,1cyclictest573-21snmpd07:43:024
82737799970,97cyclictest0-21swapper/411:16:524
82737799970,97cyclictest0-21swapper/410:07:294
827372999796,1cyclictest573-21snmpd12:37:163
827372999795,2cyclictest573-21snmpd12:33:243
827368999797,0cyclictest573-21snmpd09:49:402
827368999797,0cyclictest573-21snmpd08:00:302
827368999796,1cyclictest573-21snmpd09:09:452
827368999796,1cyclictest1071733-21cat12:20:162
827368999796,0cyclictest573-21snmpd07:57:042
82736899970,96cyclictest0-21swapper/209:53:572
827364999796,1cyclictest573-21snmpd11:22:391
82736499970,97cyclictest0-21swapper/110:32:141
82736499970,97cyclictest0-21swapper/110:29:351
827360999797,0cyclictest573-21snmpd11:44:590
827360999797,0cyclictest573-21snmpd11:31:110
827360999796,1cyclictest573-21snmpd10:52:020
827360999796,1cyclictest573-21snmpd08:08:070
827360999796,1cyclictest573-21snmpd07:38:570
827360999796,1cyclictest573-21snmpd07:14:500
827360999795,1cyclictest0-21swapper/012:35:480
827360999795,1cyclictest0-21swapper/008:45:250
827360999794,3cyclictest573-21snmpd11:16:210
82736099970,97cyclictest0-21swapper/009:12:200
827388999695,1cyclictest0-21swapper/712:35:007
827388999695,1cyclictest0-21swapper/709:55:217
82738899960,96cyclictest0-21swapper/712:33:327
82738899960,96cyclictest0-21swapper/709:15:247
827386999696,0cyclictest573-21snmpd07:49:336
827386999695,1cyclictest573-21snmpd09:45:586
827386999695,1cyclictest0-21swapper/610:25:066
827386999695,1cyclictest0-21swapper/608:55:176
827386999695,0cyclictest573-21snmpd07:10:026
827381999695,1cyclictest573-21snmpd12:24:485
827381999695,1cyclictest0-21swapper/512:00:345
827381999694,2cyclictest0-21swapper/508:47:575
82738199960,96cyclictest0-21swapper/509:40:225
827377999695,1cyclictest573-21snmpd12:39:224
827377999695,1cyclictest0-21swapper/411:26:464
827377999695,1cyclictest0-21swapper/410:57:434
827377999695,1cyclictest0-21swapper/410:18:444
827377999694,2cyclictest573-21snmpd10:11:134
827377999693,3cyclictest573-21snmpd09:55:504
827377999693,3cyclictest573-21snmpd09:54:164
82737799960,96cyclictest0-21swapper/409:45:154
827372999695,1cyclictest573-21snmpd11:35:323
827372999695,1cyclictest573-21snmpd08:10:193
827368999694,2cyclictest0-21swapper/208:36:292
827368999692,2cyclictest31-21ksoftirqd/212:39:172
827364999695,1cyclictest573-21snmpd09:27:011
827360999695,1cyclictest0-21swapper/010:00:580
827360999695,0cyclictest0-21swapper/011:01:040
82736099960,96cyclictest0-21swapper/011:21:450
827388999595,0cyclictest0-21swapper/709:47:167
827388999594,1cyclictest0-21swapper/710:54:367
827386999595,0cyclictest0-21swapper/609:33:046
827386999594,1cyclictest0-21swapper/609:28:516
827386999594,0cyclictest573-21snmpd10:06:506
827386999593,2cyclictest573-21snmpd12:37:496
827386999593,2cyclictest573-21snmpd12:10:186
827386999593,2cyclictest573-21snmpd09:59:596
827386999592,3cyclictest573-21snmpd09:13:396
827386999592,2cyclictest573-21snmpd12:25:476
827381999595,0cyclictest0-21swapper/509:34:225
827381999595,0cyclictest0-21swapper/507:30:215
827381999594,1cyclictest573-21snmpd11:25:105
827381999593,2cyclictest0-21swapper/508:53:185
827377999594,1cyclictest573-21snmpd07:32:274
827377999594,1cyclictest0-21swapper/412:05:574
827377999594,1cyclictest0-21swapper/411:30:244
827377999594,1cyclictest0-21swapper/407:39:184
827377999593,2cyclictest573-21snmpd11:08:374
827372999595,0cyclictest573-21snmpd10:41:333
827372999595,0cyclictest573-21snmpd09:46:393
827372999594,1cyclictest573-21snmpd09:39:253
827372999594,1cyclictest573-21snmpd08:27:233
827368999594,1cyclictest0-21swapper/211:09:342
827368999594,1cyclictest0-21swapper/209:25:152
827368999593,2cyclictest890025-21cpuspeed_turbos09:10:132
827368999593,2cyclictest827654-21apt-get07:10:122
827368999593,2cyclictest0-21swapper/211:30:332
827368999593,1cyclictest31-21ksoftirqd/210:09:302
827368999593,1cyclictest0-21swapper/208:11:492
827364999594,1cyclictest935183-21cat10:00:161
827364999594,1cyclictest0-21swapper/112:05:151
827364999594,1cyclictest0-21swapper/111:04:011
827364999594,1cyclictest0-21swapper/108:30:191
827364999593,2cyclictest573-21snmpd12:35:031
827360999595,0cyclictest0-21swapper/007:41:510
827360999594,1cyclictest573-21snmpd10:05:200
827360999594,1cyclictest1059962-21cat12:10:150
827388999494,0cyclictest0-21swapper/709:52:137
827388999493,1cyclictest0-21swapper/710:38:577
827386999494,0cyclictest573-21snmpd10:44:176
827386999494,0cyclictest0-21swapper/610:14:596
827386999494,0cyclictest0-21swapper/608:30:296
827386999493,1cyclictest573-21snmpd10:17:526
827386999493,1cyclictest0-21swapper/609:50:006
827386999492,2cyclictest573-21snmpd09:35:136
827381999491,3cyclictest573-21snmpd10:21:235
827377999494,0cyclictest0-21swapper/411:12:314
827372999493,1cyclictest573-21snmpd10:19:323
827368999494,0cyclictest0-21swapper/212:10:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional