Regression: massive slowdown on planning since 2.39

[lifeofguenter]

Since 2.39 we are hitting massive slowdown issues on every plan causing them to run for 5min vs. 22 seconds before.

Downgrading to 2.38 immediately solves the issue - without any other changes.

Adds 2 minutes:

[2019-12-09T11:23:04.383Z] 2019-12-09T11:23:04.186Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:23:04 [INFO] No assume_role block read from configuration
[2019-12-09T11:23:04.404Z] 2019-12-09T11:23:04.186Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:23:04 [INFO] Building AWS auth structure
[2019-12-09T11:23:04.404Z] 2019-12-09T11:23:04.186Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:23:04 [INFO] Setting AWS metadata API timeout to 100ms
[2019-12-09T11:23:04.404Z] 2019-12-09T11:23:04.186Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:23:04 [INFO] Attempting to use session-derived credentials
[2019-12-09T11:24:40.837Z] .task" is waiting for "module.app.var.name"
[2019-12-09T11:25:07.327Z] 2019-12-09T11:25:06.710Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:25:06 [INFO] Successfully derived credentials from session
[2019-12-09T11:25:07.327Z] 2019-12-09T11:25:06.710Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:25:06 [INFO] AWS Auth provider used: "AssumeRoleProvider"
[2019-12-09T11:25:07.327Z] 2019-12-09T11:25:06.711Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:25:06 [DEBUG] Trying to get account information via sts:GetCallerIdentity
[

Adds 2 minutes:

[2019-12-09T11:25:18.604Z] 2019-12-09T11:25:18.530Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:25:18 [INFO] Attempting to use session-derived credentials
[2019-12-09T11:25:45.077Z] roup_ids"
[2019-12-09T11:26:41.227Z] aws_security_group.main" is waiting for "module.app.var.tags"
[2019-12-09T11:27:27.824Z] 2019-12-09T11:27:21.924Z [DEBUG] plugin.terraform-provider-aws_v2.40.0_x4: 2019/12/09 11:27:21 [INFO] Successfully derived credentials from session

Update:

I went through: v2.38.0...v2.39.0 and can pin-point the following commit to have caused the slow-down:
b8ee7e6 - e.g. the upgrade of aws-sdk from 1.25.37 to 1.25.38

Seems like it is related to the following change: aws/aws-sdk-go#2958

There are already bugs reported upstream:

• AWS sdk session init latency aws/aws-sdk-go#2989
• Get credentials from role has become slow aws/aws-sdk-go#2972
• Provide an environment variable to disable IMDSv2 path aws/aws-sdk-go#2980

[justinretzolk]

Hey @lifeofguenter 👋 Thank you for taking the time to file this issue. Given that there's been a number of AWS provider releases since you initially filed it, can you confirm whether you're still experiencing this behavior?

[github-actions]

Marking this issue as stale due to inactivity. This helps our maintainers find and focus on the active issues. If this issue receives no comments in the next 30 days it will automatically be closed. Maintainers can also remove the stale label.

If this issue was automatically closed and you feel this issue should be reopened, we encourage creating a new issue linking back to this one for added context. Thank you!