Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws_glue_crawler : s3_target doesn't support sample size #20177

Closed
nivedita-p opened this issue Jul 14, 2021 · 2 comments · Fixed by #20203
Closed

aws_glue_crawler : s3_target doesn't support sample size #20177

nivedita-p opened this issue Jul 14, 2021 · 2 comments · Fixed by #20203
Labels
enhancement Requests to existing resources that expand the functionality or scope. service/glue Issues and PRs that pertain to the glue service.
Milestone

Comments

@nivedita-p
Copy link

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

Description

AWS Glue Crawler API supports specifying sample_size for Amazon S3 data stores (aka s3_targets) https://docs.aws.amazon.com/glue/latest/dg/define-crawler.html

This functionality is not supported in terraform AWS Provider yet. This feature can reduce crawl time significantly.

New or Affected Resource(s)

  • aws_glue_crawler

Potential Terraform Configuration

resource "aws_glue_crawler" "example" {
  database_name = aws_glue_catalog_database.example.name
  name          = "example"
  role          = aws_iam_role.example.arn

  s3_target {
    path = "s3://${aws_s3_bucket.example.bucket}"
    sample_size = 120
  }
}

References

  • #0000
@nivedita-p nivedita-p added the enhancement Requests to existing resources that expand the functionality or scope. label Jul 14, 2021
@github-actions github-actions bot added needs-triage Waiting for first response or review from a maintainer. service/glue Issues and PRs that pertain to the glue service. labels Jul 14, 2021
@DrFaust92 DrFaust92 removed the needs-triage Waiting for first response or review from a maintainer. label Jul 14, 2021
@github-actions github-actions bot added this to the v3.51.0 milestone Jul 19, 2021
@github-actions
Copy link

This functionality has been released in v3.51.0 of the Terraform AWS Provider. Please see the Terraform documentation on provider versioning or reach out if you need any assistance upgrading.

For further feature requests or bug reports with this functionality, please create a new GitHub issue following the template. Thank you!

@github-actions
Copy link

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Aug 22, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement Requests to existing resources that expand the functionality or scope. service/glue Issues and PRs that pertain to the glue service.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants