Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#4657] Improvement (docs): Add documentation for the Gravitino-Trino connector running on AWS S3. #4658

Merged
merged 5 commits into from
Oct 11, 2024

Conversation

diqiu50
Copy link
Contributor

@diqiu50 diqiu50 commented Aug 23, 2024

What changes were proposed in this pull request?

Add documentation for the Gravitino-Trino connector running on AWS S3.
The Hive catalog and Iceberg catalog support S3

Why are the changes needed?

Fix: #4657

Does this PR introduce any user-facing change?

Update docs

How was this patch tested?

NO

'lakehouse-iceberg',
map(
array['uri', 'catalog-backend', 'warehouse',
'trino.bypass.hive.s3.aws-access-key', 'trino.bypass.hive.s3.aws-secret-key', 'trino.bypass.hive.s3.region',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we add s3 endpoint?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's ok. If we use original s3, we don't need it

'lakehouse-iceberg',
map(
array['uri', 'catalog-backend', 'warehouse',
'trino.bypass.hive.s3.aws-access-key', 'trino.bypass.hive.s3.aws-secret-key', 'trino.bypass.hive.s3.region',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's tricky to add aws-access-key and trino.bypass.hive.s3.aws-access-key, could you set the security key when do the query?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The internal connector like Hive connector doesn't support it. I think we need to encrypt the sensitive data.

@diqiu50
Copy link
Contributor Author

diqiu50 commented Sep 9, 2024

@yuqi1129 @FANNG1 Do you have any other suggestions?

@diqiu50 diqiu50 requested review from FANNG1 and yuqi1129 September 9, 2024 03:15
@yuqi1129
Copy link
Contributor

Generally LGTM, @FANNG1 , do you have any further comments?

@FANNG1
Copy link
Contributor

FANNG1 commented Oct 11, 2024

Generally LGTM, @FANNG1 , do you have any further comments?

It's not proper to distribute AKSK in trino.bypass, is there any other way?

@yuqi1129 yuqi1129 merged commit 344e98d into apache:main Oct 11, 2024
17 checks passed
@diqiu50 diqiu50 deleted the trino-s3 branch October 30, 2024 03:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Improvement] Add documentation for the Gravitino-Trino connector running on AWS S3.
3 participants