Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document missing AWS Glue configs in Hive connector #3689

Merged
merged 1 commit into from
Jun 24, 2020
Merged

Document missing AWS Glue configs in Hive connector #3689

merged 1 commit into from
Jun 24, 2020

Conversation

hashhar
Copy link
Member

@hashhar hashhar commented May 10, 2020

Document the new configurations introduced as part of
#1465 and a few other configs
introduced over time.

@cla-bot
Copy link

cla-bot bot commented May 10, 2020

Thank you for your pull request and welcome to our community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. In order for us to review and merge your code, please submit the signed CLA to [email protected]. For more information, see https://github.com/prestosql/cla.

@findepi findepi requested a review from mosabua May 11, 2020 06:13
Copy link
Member

@mosabua mosabua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggested a couple of minor edits

@hashhar
Copy link
Member Author

hashhar commented May 12, 2020

I'll address the review comments over the weekend - a little busy with work stuff for now. I hope that's okay.

@cla-bot
Copy link

cla-bot bot commented May 16, 2020

Thank you for your pull request and welcome to our community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. In order for us to review and merge your code, please submit the signed CLA to [email protected]. For more information, see https://github.com/prestosql/cla.

@hashhar
Copy link
Member Author

hashhar commented May 18, 2020

@mosabua can you do a re-review. I have applied the suggested changes.

@@ -305,13 +305,24 @@ Property Name Description
running in EC2, or when the catalog is in a different region.
Example: ``us-east-1``

``hive.metastore.glue.endpoint-url`` Glue API endpoint URL (optional). Might be useful in
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove "Might be" and simplify .. so .. "Useful when all requests to Glue should be proxied.

``hive.metastore.glue.default-warehouse-dir`` Default warehouse directory for tables created without an
explicit ``LOCATION`` property.

``hive.metastore.glue.catalogid`` Glue Catalog id (optional).
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

either ID or identifier.

Copy link
Member

@mosabua mosabua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two minor changes .. otherwise good to go.

@cla-bot cla-bot bot added the cla-signed label May 19, 2020
@hashhar
Copy link
Member Author

hashhar commented May 19, 2020

@mosabua Applied recent suggestions. Thanks for the review.

Copy link
Member

@mosabua mosabua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs look good.

@hashhar hashhar requested a review from findepi May 22, 2020 20:40
Comment on lines 309 to 326
``hive.metastore.glue.endpoint-url`` Glue API endpoint URL (optional). Useful when all requests
to Glue should be proxied.
Example: ``https://glue.us-east-1.amazonaws.com``
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure "be proxied" is the right term, as this implies they would end up hitting AWS APIs somehow, whereas this could be used to provide your own standalone glue implementation.

I think "Glue API endpoint URL" should be enough for now.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changed. That makes sense.

Copy link
Member

@findepi findepi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One more, sorry overlooked that previously

presto-docs/src/main/sphinx/connector/hive.rst Outdated Show resolved Hide resolved
Document the new configurations introduced as part of
#1465 and a few other configs
introduced over time.

Co-authored-by: Piotr Findeisen <[email protected]>
@findepi findepi merged commit b13103e into trinodb:master Jun 24, 2020
@findepi
Copy link
Member

findepi commented Jun 24, 2020

Merged, thanks!

@hashhar hashhar deleted the hive-glue-docs branch June 25, 2020 03:17
v-jizhang added a commit to v-jizhang/presto that referenced this pull request May 7, 2021
arhimondr pushed a commit to prestodb/presto that referenced this pull request May 12, 2021
v-jizhang added a commit to v-jizhang/presto that referenced this pull request Jun 2, 2021
Cherry-pick of trinodb/trino#1363,
trinodb/trino#741 and
trinodb/trino#3689

Add config hive.metastore.glue.aws-credentials-provider for glue
credential provider. where value is fully qualified class name of
custom aws credential provider implementation.

Co-authored-by: Li Yu <[email protected]>
Co-authored-by: Anoop Johnson <[email protected]>
Co-authored-by: Ashhar Hasan <[email protected]>
v-jizhang added a commit to v-jizhang/presto that referenced this pull request Jul 23, 2021
Cherry-pick of trinodb/trino#3689

Add configuration property
  ``hive.metastore.glue.aws-credentials-provider`` to supply a
custom credential provider.

Co-authored-by: Ashhar Hasan <[email protected]>
Co-authored-by: Piotr Findeisen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

3 participants