You are here: Home / Projects / QA Farm Realtime / Latency plots / 
2021-05-12 - 14:20

AMD Eng Sample: ZM277192H4468_36/27/15/06_130C, Linux 4.9.47-rt37 (Profile)

Latency plot of system in rack #4, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack4slot1.osadl.org (updated Wed Jul 22, 2020 00:43:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170002258118,93sleep20-21swapper/218:21:012
166982226118,97sleep30-21swapper/318:17:213
166532153118,26sleep00-21swapper/018:16:460
167992151119,23sleep10-21swapper/118:18:231
1148321110,2sleep30-21swapper/321:32:493
2252421070,2sleep01726099cyclictest18:31:250
312292920,2sleep20-21swapper/218:51:232
286812890,2sleep10-21swapper/123:34:221
296022880,2sleep10-21swapper/121:51:441
17260998073,5cyclictest942-21snmpd21:18:220
29512790,1sleep10-21swapper/123:41:231
17279997975,2cyclictest0-21swapper/319:43:013
1727099790,76cyclictest23996-21cat21:46:282
17279997874,2cyclictest18487-21ssh20:31:353
17279997874,2cyclictest18487-21ssh20:31:353
17279997874,2cyclictest0-21swapper/323:48:593
17260997872,1cyclictest942-21snmpd19:33:040
17260997865,7cyclictest942-21snmpd18:53:180
17260997865,7cyclictest942-21snmpd18:53:180
17279997774,2cyclictest0-21swapper/322:31:423
17260997771,1cyclictest942-21snmpd19:52:020
17260997764,7cyclictest942-21snmpd20:07:200
226402760,0sleep322643-21latency20:36:293
17279997673,2cyclictest0-21swapper/323:31:493
17265997674,1cyclictest0-21swapper/122:20:171
17265997674,1cyclictest0-21swapper/121:33:251
17265997674,1cyclictest0-21swapper/121:08:091
17260997665,5cyclictest942-21snmpd19:43:250
17279997572,1cyclictest0-21swapper/322:24:263
17279997571,2cyclictest0-21swapper/323:23:013
17279997571,2cyclictest0-21swapper/318:27:063
17270997573,1cyclictest0-21swapper/221:14:462
17279997472,1cyclictest0-21swapper/322:11:053
17279997471,1cyclictest0-21swapper/321:36:403
17279997471,1cyclictest0-21swapper/319:47:253
17270997472,1cyclictest0-21swapper/220:11:082
17265997472,1cyclictest0-21swapper/120:56:121
17279997370,1cyclictest0-21swapper/322:39:423
17279997370,1cyclictest0-21swapper/320:43:423
17279997370,1cyclictest0-21swapper/320:12:173
17270997370,2cyclictest0-21swapper/218:58:302
17265997371,1cyclictest0-21swapper/118:41:151
1726599730,71cyclictest942-21snmpd22:43:181
17265997270,1cyclictest0-21swapper/123:19:161
17265997270,1cyclictest0-21swapper/121:49:371
17265997270,1cyclictest0-21swapper/120:03:441
17260997264,6cyclictest942-21snmpd18:41:000
17279997165,3cyclictest26992-21if_p32p119:51:293
17265997169,1cyclictest0-21swapper/120:47:121
17265997169,1cyclictest0-21swapper/118:29:451
17279997067,1cyclictest0-21swapper/318:46:273
17279997066,2cyclictest0-21swapper/323:19:103
17279997066,2cyclictest0-21swapper/322:45:123
17279997066,2cyclictest0-21swapper/321:20:553
17279997066,2cyclictest0-21swapper/320:10:083
17279997066,2cyclictest0-21swapper/318:45:393
17279997065,2cyclictest0-21swapper/322:57:273
17279997064,4cyclictest72-21kswapd022:12:233
17270997065,3cyclictest12543-21sh22:08:262
1727099700,68cyclictest942-21snmpd21:16:222
1727099700,68cyclictest942-21snmpd18:36:302
1727099700,67cyclictest15285-21cat22:11:282
17265997068,1cyclictest0-21swapper/122:11:441
17265997068,1cyclictest0-21swapper/122:05:171
150162700,2sleep00-21swapper/022:46:190
17279996966,1cyclictest0-21swapper/319:31:043
17279996965,2cyclictest0-21swapper/323:39:403
17279996965,2cyclictest0-21swapper/323:27:403
17279996965,2cyclictest0-21swapper/320:59:183
17279996965,2cyclictest0-21swapper/320:53:273
17279996965,2cyclictest0-21swapper/320:50:093
17279996965,2cyclictest0-21swapper/319:19:283
17279996965,2cyclictest0-21swapper/319:01:493
17279996962,4cyclictest30189-21kworker/3:121:55:593
17270996967,1cyclictest0-21swapper/223:39:072
17270996965,2cyclictest1445-21fschecks_count22:31:272
17270996965,2cyclictest0-21swapper/222:23:322
17265996966,1cyclictest0-21swapper/118:54:001
17265996966,1cyclictest0-21swapper/118:54:001
17265996965,2cyclictest30185-21interrupts23:01:271
17260996966,1cyclictest942-21snmpd19:24:310
17260996965,2cyclictest942-21snmpd19:56:320
17260996965,2cyclictest942-21snmpd19:08:430
17260996962,5cyclictest942-21snmpd22:04:530
17279996865,1cyclictest0-21swapper/323:13:103
17279996865,1cyclictest0-21swapper/323:11:063
17279996865,1cyclictest0-21swapper/322:26:383
17279996865,1cyclictest0-21swapper/322:26:383
17279996865,1cyclictest0-21swapper/322:03:383
17279996865,1cyclictest0-21swapper/322:00:203
17279996865,1cyclictest0-21swapper/321:46:463
17279996865,1cyclictest0-21swapper/321:11:543
17279996865,1cyclictest0-21swapper/321:09:303
17279996865,1cyclictest0-21swapper/320:21:443
17279996865,1cyclictest0-21swapper/319:41:013
17279996865,1cyclictest0-21swapper/319:13:463
17279996865,1cyclictest0-21swapper/318:56:423
17279996865,1cyclictest0-21swapper/318:52:093
17279996865,1cyclictest0-21swapper/318:52:093
17279996865,1cyclictest0-21swapper/318:31:393
17279996864,2cyclictest0-21swapper/321:23:103
17279996864,2cyclictest0-21swapper/319:34:043
17279996864,2cyclictest0-21swapper/319:21:283
17279996864,2cyclictest0-21swapper/318:37:063
17270996866,1cyclictest0-21swapper/220:56:422
17270996865,2cyclictest0-21swapper/223:26:432
17270996865,2cyclictest0-21swapper/219:16:342
17270996865,1cyclictest0-21swapper/223:24:552
17270996865,1cyclictest0-21swapper/222:54:362
17270996865,1cyclictest0-21swapper/220:01:442
17270996865,1cyclictest0-21swapper/219:56:502
17270996865,1cyclictest0-21swapper/219:42:042
17270996865,1cyclictest0-21swapper/218:41:332
17270996864,2cyclictest25012-21ssh20:39:242
17270996864,2cyclictest0-21swapper/222:57:182
17270996864,2cyclictest0-21swapper/220:49:212
1727099680,66cyclictest942-21snmpd19:05:492
17265996866,1cyclictest0-21swapper/122:50:361
17265996866,1cyclictest0-21swapper/120:37:061
17265996866,1cyclictest0-21swapper/120:18:111
17265996866,1cyclictest0-21swapper/119:54:351
17265996866,1cyclictest0-21swapper/119:18:011
17265996865,1cyclictest0-21swapper/123:16:071
17265996865,1cyclictest0-21swapper/119:22:491
17265996864,2cyclictest0-21swapper/119:43:011
1726599681,65cyclictest942-21snmpd19:26:311
17260996865,1cyclictest942-21snmpd23:43:370
17260996865,1cyclictest942-21snmpd22:30:240
17260996865,1cyclictest942-21snmpd22:30:240
17260996865,1cyclictest942-21snmpd21:27:490
17260996865,1cyclictest942-21snmpd20:20:560
17260996865,1cyclictest942-21snmpd20:02:410
17260996865,1cyclictest942-21snmpd19:18:220
17260996865,1cyclictest942-21snmpd18:57:000
69012670,3sleep21727099cyclictest21:27:592
17279996765,1cyclictest0-21swapper/320:18:023
17279996765,1cyclictest0-21swapper/319:56:263
17279996764,2cyclictest0-21swapper/321:03:003
17279996764,1cyclictest0-21swapper/323:42:463
17279996764,1cyclictest0-21swapper/323:04:543
17279996764,1cyclictest0-21swapper/322:17:113
17279996764,1cyclictest0-21swapper/321:42:403
17279996764,1cyclictest0-21swapper/320:28:323
17279996764,1cyclictest0-21swapper/320:04:443
17279996764,1cyclictest0-21swapper/319:08:403
1727999670,65cyclictest5227-21cat21:26:283
17270996765,1cyclictest0-21swapper/223:46:522
17270996765,1cyclictest0-21swapper/223:45:402
17270996765,1cyclictest0-21swapper/220:41:282
17270996765,1cyclictest0-21swapper/219:37:462
17270996765,1cyclictest0-21swapper/219:35:072
17270996765,1cyclictest0-21swapper/219:22:552
17270996765,1cyclictest0-21swapper/218:25:482
17270996764,2cyclictest0-21swapper/222:41:152
17270996764,2cyclictest0-21swapper/220:28:352
17270996764,1cyclictest0-21swapper/218:51:272
17270996764,1cyclictest0-21swapper/218:51:272
17270996763,2cyclictest0-21swapper/223:21:162
17270996763,2cyclictest0-21swapper/220:12:442
1727099670,65cyclictest942-21snmpd18:34:452
17265996765,1cyclictest0-21swapper/123:37:221
17265996765,1cyclictest0-21swapper/123:28:371
17265996765,1cyclictest0-21swapper/123:21:461
17265996765,1cyclictest0-21swapper/123:10:121
17265996765,1cyclictest0-21swapper/122:51:241
17265996765,1cyclictest0-21swapper/122:30:121
17265996765,1cyclictest0-21swapper/122:30:121
17265996765,1cyclictest0-21swapper/122:22:021
17265996765,1cyclictest0-21swapper/121:27:401
17265996765,1cyclictest0-21swapper/121:25:461
17265996765,1cyclictest0-21swapper/121:04:121
17265996765,1cyclictest0-21swapper/120:43:451
17265996765,1cyclictest0-21swapper/120:28:531
17265996765,1cyclictest0-21swapper/120:23:381
17265996765,1cyclictest0-21swapper/120:12:261
17265996765,1cyclictest0-21swapper/120:08:381
17265996765,1cyclictest0-21swapper/119:50:591
17265996765,1cyclictest0-21swapper/119:34:281
17265996765,1cyclictest0-21swapper/119:14:071
17265996765,1cyclictest0-21swapper/118:58:031
17265996765,1cyclictest0-21swapper/118:46:361
17265996765,1cyclictest0-21swapper/118:44:541
17265996765,1cyclictest0-21swapper/118:31:301
17265996764,1cyclictest0-21swapper/121:13:451
17265996764,1cyclictest0-21swapper/119:07:401
17265996763,2cyclictest0-21swapper/123:48:591
17265996763,2cyclictest0-21swapper/120:31:351
17265996763,2cyclictest0-21swapper/120:31:351
17260996764,1cyclictest942-21snmpd23:30:010
17260996764,1cyclictest942-21snmpd23:05:420
17260996764,1cyclictest942-21snmpd22:48:000
17260996764,1cyclictest942-21snmpd22:25:020
17260996759,6cyclictest942-21snmpd19:26:400
17279996663,2cyclictest0-21swapper/318:21:243
17279996662,2cyclictest0-21swapper/322:50:303
17270996664,1cyclictest0-21swapper/223:34:162
17270996664,1cyclictest0-21swapper/221:40:192
17270996664,1cyclictest0-21swapper/221:09:062
17270996664,1cyclictest0-21swapper/220:17:352
17270996664,1cyclictest0-21swapper/219:55:592
17270996664,1cyclictest0-21swapper/219:13:102
17270996663,1cyclictest0-21swapper/222:18:382
17270996663,1cyclictest0-21swapper/221:24:102
17270996662,2cyclictest0-21swapper/223:06:302
17265996664,1cyclictest0-21swapper/122:59:571
17265996664,1cyclictest0-21swapper/121:44:251
17265996664,1cyclictest0-21swapper/119:56:291
17265996664,1cyclictest0-21swapper/119:36:311
17265996664,1cyclictest0-21swapper/119:01:581
17265996664,1cyclictest0-21swapper/118:21:271
17265996663,2cyclictest0-21swapper/122:31:421
17265996663,2cyclictest0-21swapper/121:37:551
17265996663,1cyclictest0-21swapper/122:37:301
17260996663,1cyclictest942-21snmpd22:41:210
17260996663,1cyclictest942-21snmpd20:39:060
17279996562,1cyclictest0-21swapper/322:52:033
17270996563,1cyclictest0-21swapper/223:11:452
17270996563,1cyclictest0-21swapper/222:01:502
17270996563,1cyclictest0-21swapper/221:41:282
17270996562,2cyclictest0-21swapper/223:01:392
17270996562,1cyclictest0-21swapper/219:29:012
17270996561,2cyclictest0-21swapper/221:03:392
1727099650,63cyclictest942-21snmpd19:46:402
17265996563,1cyclictest0-21swapper/122:08:471
17260996562,1cyclictest942-21snmpd22:51:450
17260996562,1cyclictest942-21snmpd21:53:110
17260996562,1cyclictest942-21snmpd19:04:220
17270996462,1cyclictest0-21swapper/222:41:282
17270996462,1cyclictest0-21swapper/219:07:372
17270996462,1cyclictest0-21swapper/218:26:392
17270996461,1cyclictest0-21swapper/221:58:052
17270996460,2cyclictest0-21swapper/222:50:122
1727099640,62cyclictest17908-21cat20:31:282
1727099640,62cyclictest17908-21cat20:31:282
17265996462,1cyclictest0-21swapper/121:57:591
17265996462,1cyclictest0-21swapper/121:20:011
17265996462,1cyclictest0-21swapper/121:00:331
17260996462,1cyclictest10616-21cat22:06:270
17260996461,1cyclictest942-21snmpd23:12:520
17260996461,1cyclictest942-21snmpd20:52:210
17270996361,1cyclictest0-21swapper/220:22:232
17260996360,1cyclictest942-21snmpd19:13:220
17270996259,2cyclictest0-21swapper/220:54:272
17260996259,1cyclictest942-21snmpd22:14:440
17270996159,1cyclictest0-21swapper/222:26:272
17270996159,1cyclictest0-21swapper/222:26:272
17260996158,1cyclictest942-21snmpd18:44:270
1727099600,57cyclictest9905-21cat21:31:282
17260996057,1cyclictest942-21snmpd21:11:210
17260996057,1cyclictest942-21snmpd20:27:110
17260996052,6cyclictest942-21snmpd19:37:100
17260995754,1cyclictest942-21snmpd23:47:220
17260995654,1cyclictest18529-21cat21:06:280
2901525545,7sleep0942-21snmpd23:34:580
17260995552,1cyclictest24762-21cat19:46:280
17260995552,1cyclictest16869-21cat23:21:270
17260995350,1cyclictest942-21snmpd21:06:210
17260995148,1cyclictest942-21snmpd20:50:210
17260995148,1cyclictest942-21snmpd18:22:390
17260995148,1cyclictest14589-21cat21:36:280
17270995047,2cyclictest0-21swapper/221:52:472
17260994240,1cyclictest32603-21cat21:21:280
17260994239,1cyclictest8373-21cat20:21:280
22812410,0sleep00-21swapper/022:31:310
17260994038,1cyclictest942-21snmpd22:01:170
17260993734,1cyclictest9927-21cat21:31:280
17260993431,1cyclictest942-21snmpd23:07:420
17260993331,1cyclictest942-21snmpd22:17:200
17260992926,1cyclictest942-21snmpd18:50:180
17260992825,1cyclictest942-21snmpd20:44:180
17260991916,1cyclictest25490-21cat22:56:270
17260991614,1cyclictest3-21ksoftirqd/023:37:420
212552150,7sleep00-21swapper/018:26:320
17260991513,1cyclictest942-21snmpd23:18:040
17260991412,1cyclictest3-21ksoftirqd/021:49:150
17260991412,1cyclictest3-21ksoftirqd/020:15:100
1726099141,11cyclictest0-21swapper/021:41:550
17260991311,1cyclictest3-21ksoftirqd/020:57:390
1726099121,9cyclictest0-21swapper/020:32:470
1726099121,9cyclictest0-21swapper/020:32:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional