You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-05-31 - 01:33

x86 Intel Atom x6425E @2000 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #e, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot3 (updated Tue May 30, 2023 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3907792997441,31cyclictest4007385-21kworker/2:210:30:222
3907792996739,18cyclictest1606724-1kworker/2:2H08:04:592
3907792996738,17cyclictest4050833-21kworker/2:111:30:202
3907792996461,2cyclictest0-21swapper/212:20:492
3907792996460,2cyclictest0-21swapper/211:17:372
3907792996335,19cyclictest3971845-21kworker/2:109:50:172
3907792996259,2cyclictest0-21swapper/209:25:392
3907792996244,17cyclictest3904756-21kworker/2:007:20:012
3907792996238,16cyclictest3946466-21kworker/2:009:05:192
3907792996057,2cyclictest0-21swapper/212:33:082
3907792995956,2cyclictest0-21swapper/209:48:442
3907792995936,22cyclictest3919138-21kworker/2:108:10:192
3907792995842,15cyclictest1606724-1kworker/2:2H09:58:372
3907792995841,16cyclictest4026119-21kworker/2:011:06:292
3907792995841,16cyclictest3929820-21kworker/2:208:20:202
3907792995840,16cyclictest3919138-21kworker/2:108:05:212
3907792995742,14cyclictest3954538-21kworker/2:109:24:322
3907792995741,15cyclictest4089626-21kworker/2:012:25:232
3907792995739,17cyclictest4065769-21kworker/2:011:50:182
3907792995641,14cyclictest3929820-21kworker/2:208:17:312
3907792995641,14cyclictest1606724-1kworker/2:2H11:25:222
3907792995640,15cyclictest4026119-21kworker/2:011:00:012
3907792995640,15cyclictest3919138-21kworker/2:107:50:292
3907792995640,15cyclictest3916919-21kworker/2:207:35:322
3907792995639,16cyclictest4065769-21kworker/2:011:55:292
3907792995639,16cyclictest3937698-21kworker/2:109:00:222
3907792995637,18cyclictest3971845-21kworker/2:110:05:172
390779299560,55cyclictest0-21swapper/209:14:422
3907795995551,2cyclictest4019529-21kworker/3:210:47:113
3907792995540,14cyclictest3937698-21kworker/2:108:50:232
3907792995540,14cyclictest3919138-21kworker/2:107:55:212
3907792995540,14cyclictest3904756-21kworker/2:007:20:202
3907792995539,15cyclictest4026119-21kworker/2:011:10:282
3907792995539,15cyclictest4026119-21kworker/2:010:55:332
3907792995538,16cyclictest3971845-21kworker/2:109:44:412
3907792995533,21cyclictest3971845-21kworker/2:110:10:362
390779299551,2cyclictest0-21swapper/210:00:322
3907795995442,3cyclictest1656442-1kworker/3:2H08:25:223
3907792995439,14cyclictest4007385-21kworker/2:210:35:012
3907792995439,14cyclictest4007385-21kworker/2:210:35:002
3907792995439,14cyclictest3904756-21kworker/2:007:12:372
3907792995438,15cyclictest4080474-21kworker/2:112:15:082
3907792995438,15cyclictest3994247-21kworker/2:010:25:272
3907792995438,15cyclictest3931816-21kworker/2:008:30:182
3907792995438,15cyclictest1606724-1kworker/2:2H10:53:362
3907792995438,15cyclictest1606724-1kworker/2:2H10:40:062
3907792995437,16cyclictest4065769-21kworker/2:012:06:382
390779299540,52cyclictest4018432-21fschecks_count10:45:202
3907791995448,3cyclictest3969927-1kworker/1:1H11:00:211
3907795995348,3cyclictest1656442-1kworker/3:2H08:40:053
3907792995338,14cyclictest3946466-21kworker/2:009:15:212
3907792995338,14cyclictest3919138-21kworker/2:107:46:302
3907792995337,15cyclictest3966931-21kworker/2:209:35:252
3907792995337,15cyclictest3937698-21kworker/2:108:56:432
3907792995335,17cyclictest4038807-21kworker/2:211:45:382
390779299531,51cyclictest0-21swapper/211:22:052
3907791995349,3cyclictest3357748-21kworker/1:207:48:361
3907791995348,3cyclictest3937760-21kworker/1:009:02:021
3907795995248,3cyclictest1656442-1kworker/3:2H09:15:333
3907792995237,14cyclictest4065769-21kworker/2:012:00:302
3907792995237,14cyclictest3994247-21kworker/2:010:15:012
3907792995237,14cyclictest3931816-21kworker/2:008:45:012
3907792995236,15cyclictest3962561-21kworker/2:009:30:212
3907792995234,17cyclictest3919138-21kworker/2:107:40:322
390779299520,51cyclictest0-21swapper/208:25:052
3907791995248,3cyclictest4021320-21kworker/1:011:19:371
3907791995247,3cyclictest3357748-21kworker/1:207:25:421
3907789995248,2cyclictest3913076-21kworker/0:107:29:240
3907789995247,3cyclictest3628734-1kworker/0:1H09:34:390
3907795995148,2cyclictest4035022-21kworker/3:011:10:003
3907795995148,2cyclictest3972265-21kworker/3:009:56:373
3907795995146,3cyclictest4014044-1kworker/3:0H12:34:363
3907795995145,4cyclictest1656442-1kworker/3:2H10:10:293
3907792995147,2cyclictest3939948-21fschecks_count08:45:192
3907792995136,14cyclictest4038807-21kworker/2:211:40:002
3907792995136,14cyclictest3994247-21kworker/2:010:20:052
3907792995136,14cyclictest3904756-21kworker/2:007:30:202
3907792995136,14cyclictest3904756-21kworker/2:007:25:332
3907792995135,15cyclictest4089626-21kworker/2:012:35:012
3907792995135,15cyclictest4080474-21kworker/2:112:10:202
3907791995147,3cyclictest3969927-1kworker/1:1H11:24:461
3907789995146,3cyclictest3628734-1kworker/0:1H10:08:040
3907795995046,3cyclictest4014044-1kworker/3:0H11:36:593
3907791995047,2cyclictest3937760-21kworker/1:008:41:421
3907791995046,2cyclictest1164068-1kworker/1:0H08:50:241
3907791995045,3cyclictest3969927-1kworker/1:1H11:14:371
390779199501,44cyclictest0-21swapper/112:17:521
3907789995047,2cyclictest4101491-21kworker/0:212:39:380
3907789995046,3cyclictest3913076-21kworker/0:108:30:490
3907789995046,3cyclictest3628734-1kworker/0:1H10:58:370
3907789995046,2cyclictest3628734-1kworker/0:1H08:10:260
3907789995045,3cyclictest3628734-1kworker/0:1H10:26:370
3907789995045,3cyclictest3628734-1kworker/0:1H08:55:290
3907792994934,14cyclictest3931816-21kworker/2:008:39:552
3907791994945,3cyclictest3969927-1kworker/1:1H10:55:061
3907789994946,2cyclictest4070377-21kworker/0:212:00:240
3907789994945,2cyclictest3628734-1kworker/0:1H10:33:370
3907789994944,3cyclictest3946118-21kworker/0:209:11:370
3907789994944,3cyclictest3901763-21kworker/0:207:18:020
3907795994846,1cyclictest1656442-1kworker/3:2H07:10:293
3907795994845,2cyclictest4072482-21kworker/3:112:17:063
3907795994843,3cyclictest4046653-21kworker/3:311:25:013
3907795994843,3cyclictest4014044-1kworker/3:0H10:43:413
3907791994845,2cyclictest3357748-21kworker/1:207:34:171
3907791994844,2cyclictest3969927-1kworker/1:1H11:40:211
3907789994844,2cyclictest3984998-21kworker/0:010:04:430
3907789994844,2cyclictest3937687-21kworker/0:008:54:020
3907789994843,3cyclictest3628734-1kworker/0:1H12:18:380
3907789994843,3cyclictest3628734-1kworker/0:1H09:50:290
3907789994843,3cyclictest3628734-1kworker/0:1H08:02:370
3907789994842,4cyclictest3628734-1kworker/0:1H07:40:310
3907791994744,2cyclictest4040456-21kworker/1:211:55:521
3907791994744,2cyclictest3992001-21kworker/1:210:24:521
3907791994744,2cyclictest3357748-21kworker/1:208:05:361
3907791994743,3cyclictest3969927-1kworker/1:1H10:14:511
3907791994743,3cyclictest1164068-1kworker/1:0H09:36:471
3907791994743,3cyclictest1164068-1kworker/1:0H08:49:021
3907789994743,2cyclictest3913076-21kworker/0:107:35:360
3907789994742,3cyclictest3628734-1kworker/0:1H11:31:370
3907789994735,8cyclictest3628734-1kworker/0:1H09:20:210
3907795994642,2cyclictest3959236-21kworker/3:109:35:153
3907795994642,2cyclictest1656442-1kworker/3:2H09:49:553
3907795994640,3cyclictest1656442-1kworker/3:2H08:55:213
3907792994630,15cyclictest4055439-21kworker/2:011:35:382
3907791994643,2cyclictest3984669-21kworker/1:010:05:341
3907791994643,2cyclictest3937760-21kworker/1:009:16:371
3907791994642,2cyclictest1164068-1kworker/1:0H07:20:191
3907791994640,5cyclictest1164068-1kworker/1:0H08:39:021
3907789994643,2cyclictest4078947-21kworker/0:112:24:380
3907789994641,3cyclictest3628734-1kworker/0:1H07:50:220
3907789994640,4cyclictest3628734-1kworker/0:1H09:36:420
3907795994542,2cyclictest3994835-21kworker/3:110:25:583
3907795994541,3cyclictest3909287-21kworker/3:107:17:363
3907791994542,2cyclictest4080028-21kworker/1:012:20:491
3907791994541,3cyclictest3969927-1kworker/1:1H10:40:371
3907791994540,3cyclictest3969927-1kworker/1:1H11:25:241
3907789994542,2cyclictest4075087-21kworker/0:012:07:430
3907789994541,2cyclictest3628734-1kworker/0:1H08:05:310
3907789994540,3cyclictest4023389-21kworker/0:211:35:240
3907789994540,3cyclictest4023389-21kworker/0:211:26:550
3907795994440,3cyclictest4014044-1kworker/3:0H11:29:553
3907795994439,3cyclictest4014044-1kworker/3:0H11:45:063
3907791994441,2cyclictest3924540-21kworker/1:008:04:471
3907791994441,2cyclictest3357748-21kworker/1:208:24:021
3907791994441,2cyclictest3357748-21kworker/1:207:44:431
3907789994441,2cyclictest3913076-21kworker/0:108:29:280
3907789994441,2cyclictest3901763-21kworker/0:207:13:070
3907789994441,2cyclictest3628734-1kworker/0:1H08:45:380
3907795994340,2cyclictest4019529-21kworker/3:210:51:033
3907795994339,3cyclictest4014044-1kworker/3:0H12:12:383
3907795994339,3cyclictest3944228-21kworker/3:209:02:123
3907795994339,2cyclictest4014044-1kworker/3:0H12:05:003
3907791994340,2cyclictest1164068-1kworker/1:0H07:10:441
3907791994339,3cyclictest4080028-21kworker/1:012:15:001
3907791994336,6cyclictest1164068-1kworker/1:0H09:14:071
3907789994341,1cyclictest3913076-21kworker/0:108:20:060
3907789994340,2cyclictest3984998-21kworker/0:010:16:370
3907789994339,3cyclictest4023389-21kworker/0:211:02:370
3907789994338,3cyclictest4089640-21kworker/0:012:25:460
3907789994338,3cyclictest3628734-1kworker/0:1H10:43:360
3907789994337,4cyclictest3628734-1kworker/0:1H07:32:090
3907789994336,4cyclictest3628734-1kworker/0:1H09:40:190
3907795994238,2cyclictest1656442-1kworker/3:2H08:15:213
3907795994237,3cyclictest4014044-1kworker/3:0H11:12:413
3907795994237,3cyclictest1656442-1kworker/3:2H07:44:553
3907791994238,3cyclictest3992001-21kworker/1:210:25:231
3907791994238,3cyclictest3969927-1kworker/1:1H09:52:071
3907791994238,2cyclictest3972588-21kworker/1:009:43:021
3907791994238,2cyclictest3969927-1kworker/1:1H10:20:001
3907791994238,2cyclictest3969927-1kworker/1:1H10:00:201
3907789994239,2cyclictest4061905-21kworker/0:111:58:380
3907789994238,2cyclictest4023389-21kworker/0:211:45:270
3907789994229,12cyclictest3944500-21kworker/0:109:02:370
3907795994138,2cyclictest4088079-21kworker/3:012:27:093
3907795994137,2cyclictest1656442-1kworker/3:2H09:45:003
3907795994136,3cyclictest1656442-1kworker/3:2H08:05:213
3907791994138,2cyclictest1164068-1kworker/1:0H07:56:371
3907791994137,2cyclictest3969927-1kworker/1:1H10:45:201
3907791994135,3cyclictest1164068-1kworker/1:0H08:15:221
3907789994138,2cyclictest4075087-21kworker/0:012:10:370
3907789994138,2cyclictest4014323-21kworker/0:010:50:480
3907789994138,2cyclictest3919607-21kworker/0:007:47:020
3907789994138,2cyclictest3913076-21kworker/0:108:41:020
3907789994138,2cyclictest3913076-21kworker/0:108:16:450
3907795994037,2cyclictest3972265-21kworker/3:009:50:163
3907795994037,2cyclictest3926098-21kworker/3:208:14:363
3907795994035,4cyclictest3972265-21kworker/3:010:16:083
3907791994037,2cyclictest1164068-1kworker/1:0H08:30:001
3907791994037,2cyclictest1164068-1kworker/1:0H07:50:341
3907791994037,2cyclictest0-21swapper/112:08:201
3907791994035,4cyclictest1164068-1kworker/1:0H09:29:411
3907789994037,2cyclictest3949344-21kworker/0:009:19:320
3907789994035,3cyclictest3628734-1kworker/0:1H12:30:210
3907789994034,4cyclictest3628734-1kworker/0:1H10:49:490
3907789994033,4cyclictest3628734-1kworker/0:1H10:35:200
3907789994033,4cyclictest3628734-1kworker/0:1H10:35:200
3907795993936,2cyclictest4101297-21kworker/3:012:40:003
3907791993936,2cyclictest1164068-1kworker/1:0H09:20:241
3907791993934,3cyclictest1164068-1kworker/1:0H09:32:011
3907789993937,1cyclictest4023389-21kworker/0:211:05:060
3907789993937,1cyclictest3913076-21kworker/0:107:59:370
3907789993936,2cyclictest4023389-21kworker/0:211:12:410
3907789993936,2cyclictest3981201-21kworker/0:109:59:420
3907789993935,3cyclictest3628734-1kworker/0:1H09:08:370
3907789993934,3cyclictest3628734-1kworker/0:1H11:43:060
3907795993835,2cyclictest4072482-21kworker/3:112:08:083
3907795993835,2cyclictest3914763-21kworker/3:307:49:543
3907795993833,3cyclictest1656442-1kworker/3:2H08:45:333
3907791993835,2cyclictest4040456-21kworker/1:211:47:551
3907791993835,2cyclictest3969927-1kworker/1:1H12:33:031
3907791993833,2cyclictest3983767-21ssh09:58:001
3907791993832,3cyclictest3969927-1kworker/1:1H10:40:001
3907791993832,3cyclictest3969927-1kworker/1:1H10:40:001
3907789993835,2cyclictest3628734-1kworker/0:1H09:25:540
3907789993833,3cyclictest3628734-1kworker/0:1H07:20:210
3907795993734,2cyclictest4019529-21kworker/3:210:55:233
3907795993734,2cyclictest3994835-21kworker/3:110:20:283
3907795993732,3cyclictest4014044-1kworker/3:0H11:15:273
3907795993731,2cyclictest4019529-21kworker/3:211:03:073
3907791993734,2cyclictest3969927-1kworker/1:1H11:53:371
3907791993733,2cyclictest3969927-1kworker/1:1H12:35:061
390779199372,33cyclictest0-21swapper/110:31:301
3907789993732,3cyclictest3628734-1kworker/0:1H11:21:370
3907789993731,4cyclictest3628734-1kworker/0:1H09:45:230
3907795993633,2cyclictest3914763-21kworker/3:307:39:553
3907795993633,2cyclictest1656442-1kworker/3:2H09:12:033
3907795993632,2cyclictest1656442-1kworker/3:2H10:35:003
3907795993629,4cyclictest1656442-1kworker/3:2H10:00:203
3907791993633,2cyclictest4040456-21kworker/1:211:35:281
3907789993631,3cyclictest4023389-21kworker/0:211:16:310
3907795993532,2cyclictest3944228-21kworker/3:209:05:203
3907795993532,2cyclictest1656442-1kworker/3:2H07:20:353
3907795993530,3cyclictest4014044-1kworker/3:0H11:55:253
3907795993530,3cyclictest1656442-1kworker/3:2H07:50:243
390779599350,2cyclictest151rcu_preempt11:54:053
390779599350,2cyclictest151rcu_preempt10:07:173
3907791993532,2cyclictest1164068-1kworker/1:0H08:59:031
3907791993532,2cyclictest1164068-1kworker/1:0H08:31:051
3907791993531,3cyclictest3969927-1kworker/1:1H12:00:491
3907791993531,2cyclictest1164068-1kworker/1:0H08:10:201
3907789993532,2cyclictest3990168-21kworker/0:110:13:070
3907795993431,2cyclictest4014044-1kworker/3:0H12:22:373
3907795993431,2cyclictest1656442-1kworker/3:2H08:00:223
3907789993430,3cyclictest3984998-21kworker/0:010:23:360
390779599331,2cyclictest151rcu_preempt09:25:083
3907791993328,3cyclictest3969927-1kworker/1:1H11:35:001
3907791993328,3cyclictest3969927-1kworker/1:1H10:54:081
3907795993229,2cyclictest1656442-1kworker/3:2H08:33:023
3907791993229,2cyclictest1164068-1kworker/1:0H09:08:011
390779199321,2cyclictest3969927-1kworker/1:1H09:45:191
3907789993229,2cyclictest3913076-21kworker/0:108:36:030
3907791993128,2cyclictest4080028-21kworker/1:012:25:041
3907789993128,2cyclictest4061905-21kworker/0:111:51:470
3907795993027,2cyclictest1656442-1kworker/3:2H07:30:053
3907795993027,2cyclictest1656442-1kworker/3:2H07:29:553
390779599300,6cyclictest0-21swapper/309:24:323
390779599300,2cyclictest151rcu_preempt11:33:173
3907795992926,2cyclictest1656442-1kworker/3:2H09:30:333
3907791992926,2cyclictest1164068-1kworker/1:0H07:35:211
3907791992923,5cyclictest1164068-1kworker/1:0H07:16:021
390779199290,4cyclictest0-21swapper/111:06:191
3907795992825,2cyclictest4006346-21kworker/3:010:35:183
3907795992825,2cyclictest4006346-21kworker/3:010:35:173
390779599271,15cyclictest3941222-21apt-get08:50:183
390779599260,2cyclictest151rcu_preempt11:40:203
390779599260,24cyclictest3936977-21kernelversion08:35:183
390779299260,3cyclictest0-21swapper/207:10:002
390779599230,5cyclictest0-21swapper/308:20:173
3907795992219,2cyclictest1656442-1kworker/3:2H07:55:063
390778999137,3cyclictest0-21swapper/007:10:010
390779199113,5cyclictest26-21ksoftirqd/107:10:011
39077959993,4cyclictest40-21ksoftirqd/307:10:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional