You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-04-02 - 10:36

x86 Intel Atom x6425E @2000 MHz, Linux 5.15.49-rt47 (Profile)

Latency plot of system in rack #e, slot #3
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackeslot3 (updated Sun Apr 02, 2023 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
406563199700,55cyclictest4105257-21diskmemload21:50:012
4065631996461,2cyclictest0-21swapper/223:52:022
4065631996461,2cyclictest0-21swapper/223:52:012
406563199640,62cyclictest0-21swapper/219:18:032
4065631996347,15cyclictest42785-21kworker/2:100:10:242
406563199630,2cyclictest0-21swapper/219:57:222
406563199630,1cyclictest0-21swapper/221:53:282
4065631996244,17cyclictest4064143-21kworker/2:019:25:012
406563199620,60cyclictest0-21swapper/221:05:462
4065631996144,16cyclictest4081238-21kworker/2:120:20:012
406563199610,60cyclictest0-21swapper/223:55:502
4065631996045,14cyclictest4091224-21kworker/2:220:35:212
4065631995956,2cyclictest0-21swapper/220:57:272
4065631995942,16cyclictest4157004-21kworker/2:222:15:262
4065631995942,16cyclictest4157004-21kworker/2:222:15:252
4065631995942,16cyclictest4128944-1kworker/2:1H21:59:332
4065631995942,16cyclictest4128944-1kworker/2:1H00:15:352
4065631995942,16cyclictest4081238-21kworker/2:120:00:012
4065631995941,17cyclictest4097117-21kworker/2:121:10:262
4065631995843,14cyclictest42785-21kworker/2:100:05:202
4065631995842,15cyclictest4070965-21kworker/2:119:30:062
4065631995841,16cyclictest42785-21kworker/2:100:04:322
4065631995841,16cyclictest4189394-21kworker/2:023:05:202
4065631995841,16cyclictest4081238-21kworker/2:120:15:182
4065631995841,16cyclictest4073133-21kworker/2:219:35:192
4065631995839,18cyclictest1762869-1kworker/2:0H19:53:332
4065631995838,18cyclictest4097117-21kworker/2:121:00:192
4065631995755,1cyclictest0-21swapper/220:52:422
4065631995742,14cyclictest4157004-21kworker/2:222:20:212
4065631995742,14cyclictest4125241-21kworker/2:021:40:232
4065631995741,16cyclictest4091224-21kworker/2:220:40:202
4065631995741,15cyclictest4166110-21kworker/2:122:30:202
4065631995741,15cyclictest4128944-1kworker/2:1H23:29:012
4065631995741,15cyclictest4125241-21kworker/2:022:07:522
4065631995741,15cyclictest4091224-21kworker/2:220:30:192
4065631995740,16cyclictest4128944-1kworker/2:1H22:45:332
4065631995740,16cyclictest4097117-21kworker/2:121:20:202
4065631995736,18cyclictest1762869-1kworker/2:0H19:14:592
4065631995654,1cyclictest0-21swapper/220:48:032
4065631995653,2cyclictest0-21swapper/223:14:292
4065631995641,14cyclictest9656-21kworker/2:223:35:192
4065631995641,14cyclictest64707-21kworker/2:000:30:272
4065631995641,14cyclictest4081238-21kworker/2:120:05:182
4065631995641,14cyclictest4073133-21kworker/2:219:45:222
4065631995640,15cyclictest9656-21kworker/2:223:15:182
4065631995640,15cyclictest64707-21kworker/2:000:35:222
4065631995640,15cyclictest4183675-21kworker/2:122:55:322
4065631995640,15cyclictest4073133-21kworker/2:219:40:252
4065631995639,16cyclictest4125241-21kworker/2:021:37:042
4065631995636,19cyclictest9656-21kworker/2:223:45:202
4065631995629,26cyclictest60294-21kworker/2:200:20:212
406563199560,53cyclictest4167904-21cron22:30:002
4065631995553,1cyclictest0-21swapper/222:04:022
4065631995540,14cyclictest4174754-21kworker/2:222:40:012
4065631995539,15cyclictest4097117-21kworker/2:121:25:202
4065631995539,15cyclictest4070965-21kworker/2:119:25:002
4065630995550,3cyclictest3274650-1kworker/1:0H21:35:191
4065630995550,3cyclictest3274650-1kworker/1:0H00:00:031
4065631995439,14cyclictest4189394-21kworker/2:023:00:212
4065631995437,16cyclictest4081238-21kworker/2:120:10:232
4065631995436,16cyclictest4128944-1kworker/2:1H22:55:002
4065631995434,18cyclictest4097117-21kworker/2:121:15:212
4065630995450,3cyclictest4079071-21kworker/1:220:02:041
4065629995449,3cyclictest1608679-1kworker/0:1H21:53:320
4065629995449,3cyclictest1608679-1kworker/0:1H00:17:320
4065629995448,4cyclictest1608679-1kworker/0:1H21:44:020
4065631995338,14cyclictest9656-21kworker/2:223:30:352
4065631995338,14cyclictest64707-21kworker/2:000:25:232
4065631995338,14cyclictest4152486-21kworker/2:122:11:022
4065631995336,16cyclictest4097117-21kworker/2:121:30:182
4065630995348,3cyclictest4101995-21kworker/1:021:48:181
4065630995249,2cyclictest4190518-21kworker/1:200:18:291
4065630995249,2cyclictest4169329-21kworker/1:122:56:331
4065630995249,2cyclictest4079071-21kworker/1:220:37:091
4065630995247,3cyclictest4101995-21kworker/1:022:04:331
4065630995247,3cyclictest3274650-1kworker/1:0H21:51:261
4065630995247,3cyclictest3274650-1kworker/1:0H00:07:421
4065630995246,3cyclictest3274650-1kworker/1:0H00:10:241
4065629995247,3cyclictest44355-21kworker/0:100:08:280
4065629995246,4cyclictest1608679-1kworker/0:1H21:10:520
4065631995136,14cyclictest9656-21kworker/2:223:40:312
406563199511,49cyclictest0-21swapper/222:37:032
4065630995146,3cyclictest4079071-21kworker/1:220:20:471
4065630995146,3cyclictest3274650-1kworker/1:0H22:12:071
4065629995147,3cyclictest1608679-1kworker/0:1H22:33:310
4065629995145,4cyclictest1608679-1kworker/0:1H23:33:320
4065632995045,3cyclictest1534052-1kworker/3:1H22:05:063
4065632995045,3cyclictest1534052-1kworker/3:1H20:15:303
4065632995044,4cyclictest1534052-1kworker/3:1H00:35:523
4065631995034,15cyclictest9656-21kworker/2:223:20:282
406563199500,49cyclictest0-21swapper/220:28:032
4065630995045,3cyclictest4079071-21kworker/1:220:58:021
4065630995036,7cyclictest3274650-1kworker/1:0H21:26:031
4065629995044,4cyclictest1608679-1kworker/0:1H20:15:260
4065632994945,3cyclictest1534052-1kworker/3:1H23:59:333
4065632994944,3cyclictest1534052-1kworker/3:1H22:40:423
4065630994945,3cyclictest4190518-21kworker/1:223:14:031
4065630994945,3cyclictest4059625-21kworker/1:019:20:311
4065630994945,2cyclictest3274650-1kworker/1:0H20:50:171
4065630994944,3cyclictest4101995-21kworker/1:021:18:291
4065630994944,3cyclictest3274650-1kworker/1:0H22:49:031
4065632994842,3cyclictest4131821-21kworker/3:022:00:043
4065632994842,3cyclictest4074153-21kworker/3:220:27:293
4065632994835,7cyclictest1534052-1kworker/3:1H21:55:183
4065630994845,2cyclictest4190518-21kworker/1:223:50:471
4065630994845,2cyclictest4190518-21kworker/1:223:50:461
4065630994844,3cyclictest4079071-21kworker/1:221:02:031
4065630994843,3cyclictest4079071-21kworker/1:219:51:321
4065630994842,4cyclictest3274650-1kworker/1:0H23:36:341
4065629994843,4cyclictest1608679-1kworker/0:1H21:46:410
4065632994743,3cyclictest4162258-21kworker/3:223:23:343
4065632994743,3cyclictest1534052-1kworker/3:1H00:28:133
4065630994744,2cyclictest71845-21kworker/1:100:36:291
4065630994744,2cyclictest4190518-21kworker/1:223:31:321
4065630994743,3cyclictest4190518-21kworker/1:223:59:271
4065630994743,3cyclictest4079071-21kworker/1:220:11:271
4065629994741,4cyclictest1608679-1kworker/0:1H22:29:030
4065632994642,3cyclictest1534052-1kworker/3:1H19:10:223
4065632994642,2cyclictest4162258-21kworker/3:223:43:013
4065632994641,3cyclictest1534052-1kworker/3:1H23:28:443
4065632994641,3cyclictest1534052-1kworker/3:1H23:00:223
4065632994641,3cyclictest1534052-1kworker/3:1H22:34:323
4065632994641,3cyclictest1534052-1kworker/3:1H00:03:063
4065630994643,2cyclictest4169329-21kworker/1:122:51:271
4065630994643,2cyclictest4101995-21kworker/1:021:21:031
4065630994643,2cyclictest4079071-21kworker/1:219:55:461
4065630994642,2cyclictest4079071-21kworker/1:220:47:021
4065630994641,3cyclictest4101995-21kworker/1:022:26:001
4065632994540,3cyclictest1534052-1kworker/3:1H21:20:473
4065632994540,3cyclictest1534052-1kworker/3:1H19:34:023
4065632994539,3cyclictest1534052-1kworker/3:1H19:35:323
4065630994542,2cyclictest4101995-21kworker/1:021:11:181
4065629994541,2cyclictest4105211-21kworker/0:021:20:200
4065629994539,3cyclictest1608679-1kworker/0:1H20:47:350
4065629994539,3cyclictest1608679-1kworker/0:1H00:25:230
4065629994538,5cyclictest59150irq/160-enp0s2923:14:290
4065632994440,3cyclictest1534052-1kworker/3:1H19:53:023
4065630994440,2cyclictest4101995-21kworker/1:021:31:041
4065630994438,4cyclictest3274650-1kworker/1:0H21:58:041
4065630994438,3cyclictest3274650-1kworker/1:0H20:30:181
4065629994440,2cyclictest1608679-1kworker/0:1H22:41:330
4065629994439,3cyclictest1608679-1kworker/0:1H23:01:330
4065629994439,3cyclictest1608679-1kworker/0:1H22:55:200
4065629994439,3cyclictest1608679-1kworker/0:1H19:30:180
4065632994340,2cyclictest4064144-21kworker/3:019:29:333
4065632994340,2cyclictest1534052-1kworker/3:1H20:10:063
4065632994339,3cyclictest1534052-1kworker/3:1H23:17:493
4065632994339,3cyclictest1534052-1kworker/3:1H20:50:303
4065632994338,3cyclictest1534052-1kworker/3:1H23:09:553
4065630994340,2cyclictest4190518-21kworker/1:223:00:271
4065630994339,2cyclictest3274650-1kworker/1:0H23:43:091
4065630994339,2cyclictest0-21swapper/123:06:251
4065630994338,3cyclictest3274650-1kworker/1:0H23:45:221
4065630994338,3cyclictest3274650-1kworker/1:0H22:33:301
4065630994338,3cyclictest3274650-1kworker/1:0H19:32:161
4065629994341,1cyclictest4097106-21kworker/0:220:55:170
4065629994339,2cyclictest1608679-1kworker/0:1H00:25:010
4065629994338,2cyclictest4074147-21kworker/0:019:35:330
4065632994239,2cyclictest4162258-21kworker/3:222:50:053
4065632994239,2cyclictest1534052-1kworker/3:1H19:20:253
4065632994238,3cyclictest1534052-1kworker/3:1H22:36:093
4065632994238,3cyclictest1534052-1kworker/3:1H22:14:343
4065632994238,3cyclictest1534052-1kworker/3:1H19:17:033
4065632994237,3cyclictest1534052-1kworker/3:1H21:52:043
4065630994239,2cyclictest4190518-21kworker/1:223:19:091
4065630994239,2cyclictest4079071-21kworker/1:220:41:031
4065630994239,2cyclictest4059625-21kworker/1:019:27:031
4065630994237,3cyclictest4059625-21kworker/1:019:11:321
4065629994238,3cyclictest1608679-1kworker/0:1H22:17:340
4065629994238,3cyclictest1608679-1kworker/0:1H22:17:330
4065629994237,3cyclictest1608679-1kworker/0:1H21:55:190
4065632994138,2cyclictest1534052-1kworker/3:1H23:30:453
4065632994138,2cyclictest1534052-1kworker/3:1H21:30:163
4065632994136,3cyclictest1534052-1kworker/3:1H22:15:213
4065632994136,3cyclictest1534052-1kworker/3:1H22:15:203
406563299410,4cyclictest0-21swapper/323:10:203
4065630994138,2cyclictest4059625-21kworker/1:019:18:381
4065630994137,3cyclictest4079071-21kworker/1:220:05:461
4065630994134,4cyclictest3274650-1kworker/1:0H22:20:011
4065630994134,4cyclictest3274650-1kworker/1:0H22:20:001
4065629994138,2cyclictest4147150-21kworker/0:222:11:010
4065629994138,2cyclictest1608679-1kworker/0:1H23:40:250
4065629994137,2cyclictest1608679-1kworker/0:1H20:00:320
4065629994136,3cyclictest1608679-1kworker/0:1H19:25:180
4065632994037,2cyclictest55195-21kworker/3:000:14:323
4065632994037,2cyclictest4131821-21kworker/3:021:49:553
4065632994037,2cyclictest4074153-21kworker/3:219:45:123
4065632994036,3cyclictest34672-21kworker/3:123:53:103
4065632994036,3cyclictest34672-21kworker/3:123:53:093
4065632994036,3cyclictest1534052-1kworker/3:1H22:58:363
4065632994036,3cyclictest1534052-1kworker/3:1H00:32:023
4065632994033,4cyclictest1534052-1kworker/3:1H20:43:033
4065630994037,2cyclictest4169329-21kworker/1:122:35:271
4065630994035,3cyclictest3274650-1kworker/1:0H21:10:001
4065629994037,2cyclictest59150irq/160-enp0s2922:00:180
4065629994037,2cyclictest40273-21kworker/0:000:11:120
4065629994036,3cyclictest1608679-1kworker/0:1H21:18:340
4065629994033,6cyclictest1608679-1kworker/0:1H23:57:320
4065632993936,2cyclictest1534052-1kworker/3:1H19:41:333
4065632993935,2cyclictest1534052-1kworker/3:1H21:29:563
4065630993934,4cyclictest3274650-1kworker/1:0H00:23:241
4065630993934,3cyclictest3274650-1kworker/1:0H22:24:031
4065629993936,2cyclictest4063956-21kworker/0:019:15:060
4065629993936,2cyclictest1608679-1kworker/0:1H21:36:330
4065629993935,3cyclictest1608679-1kworker/0:1H22:48:350
4065632993835,2cyclictest4103602-21kworker/3:121:07:033
4065632993835,2cyclictest1534052-1kworker/3:1H20:45:573
4065632993833,3cyclictest4074153-21kworker/3:220:00:183
406563299380,5cyclictest4105257-21diskmemload00:18:173
4065630993835,2cyclictest4101995-21kworker/1:021:42:341
4065630993835,2cyclictest4059625-21kworker/1:019:40:461
4065629993835,2cyclictest1608679-1kworker/0:1H20:53:070
4065629993835,2cyclictest1608679-1kworker/0:1H00:03:500
4065629993834,2cyclictest1608679-1kworker/0:1H21:28:220
406562999383,3cyclictest14-21ksoftirqd/022:52:030
406562999382,4cyclictest14-21ksoftirqd/023:15:050
4065632993733,3cyclictest1534052-1kworker/3:1H22:49:343
4065632993732,3cyclictest1534052-1kworker/3:1H21:10:223
4065630993734,2cyclictest4059625-21kworker/1:019:45:281
4065629993734,2cyclictest4147150-21kworker/0:222:38:010
4065629993734,2cyclictest35177-21kworker/0:223:53:020
4065629993734,2cyclictest35177-21kworker/0:223:53:010
4065629993733,3cyclictest4147150-21kworker/0:222:23:300
4065629993733,3cyclictest1608679-1kworker/0:1H19:40:310
406563299363,4cyclictest401ksoftirqd/321:42:013
4065632993633,2cyclictest1534052-1kworker/3:1H22:25:233
4065632993632,3cyclictest1534052-1kworker/3:1H23:49:333
4065630993632,3cyclictest3274650-1kworker/1:0H23:28:131
4065629993633,2cyclictest1608679-1kworker/0:1H23:49:270
4065629993633,2cyclictest1608679-1kworker/0:1H23:23:440
4065629993632,3cyclictest4082260-21kworker/0:120:24:590
4065629993631,2cyclictest1608679-1kworker/0:1H19:57:220
406563299350,3cyclictest0-21swapper/320:30:253
406563299350,10cyclictest4105257-21diskmemload21:19:163
4065630993532,2cyclictest4190518-21kworker/1:223:24:021
4065629993532,2cyclictest1608679-1kworker/0:1H22:07:340
4065632993429,3cyclictest1534052-1kworker/3:1H23:35:183
4065632993423,8cyclictest1534052-1kworker/3:1H00:05:203
4065630993431,2cyclictest4190518-21kworker/1:200:33:271
4065630993430,3cyclictest4101995-21kworker/1:022:06:381
4065629993429,3cyclictest1608679-1kworker/0:1H23:25:180
4065630993331,1cyclictest0-21swapper/100:25:021
4065630993330,2cyclictest4059625-21kworker/1:019:35:071
4065630993330,2cyclictest0-21swapper/122:42:071
406562999337,4cyclictest14-21ksoftirqd/023:35:070
4065629993330,2cyclictest1608679-1kworker/0:1H19:20:470
406563299320,8cyclictest40-21ksoftirqd/319:55:193
406563299320,5cyclictest63198-21sh00:23:233
4065629993229,2cyclictest1608679-1kworker/0:1H23:05:460
4065629993228,2cyclictest1608679-1kworker/0:1H21:35:010
4065632993128,2cyclictest1534052-1kworker/3:1H20:24:043
4065629993128,2cyclictest4085519-21kworker/0:020:28:100
4065629993126,3cyclictest1608679-1kworker/0:1H19:45:200
406563299303,3cyclictest151rcu_preempt20:05:263
4065632993026,3cyclictest1534052-1kworker/3:1H20:57:413
406563299301,4cyclictest0-21swapper/321:39:303
406563299300,8cyclictest40-21ksoftirqd/322:23:423
4065629992927,1cyclictest40273-21kworker/0:000:30:210
4065629992926,2cyclictest40273-21kworker/0:000:35:060
4065629992925,3cyclictest4085519-21kworker/0:020:35:200
4065629992923,3cyclictest1608679-1kworker/0:1H20:07:240
406563299280,8cyclictest0-21swapper/320:40:013
4065629992822,4cyclictest4096785-21awk20:40:260
406563299271,6cyclictest0-21swapper/321:05:003
406563099271,15cyclictest4087404-21apt-get20:15:161
4065629992725,1cyclictest4063956-21kworker/0:019:12:090
4065629992724,2cyclictest1608679-1kworker/0:1H21:09:350
4065629992724,2cyclictest1608679-1kworker/0:1H21:03:070
4065629992724,2cyclictest1608679-1kworker/0:1H19:52:330
4065629992623,2cyclictest1608679-1kworker/0:1H20:31:020
406562999260,5cyclictest0-21swapper/020:10:230
406563199250,23cyclictest0-21swapper/219:10:012
406563099257,8cyclictest151rcu_preempt20:25:211
406563099141,2cyclictest151rcu_preempt19:10:001
406562999144,7cyclictest0-21swapper/019:10:000
406563299130,4cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional