Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#480] test(lakehouse-iceberg): support JdbcCatalog for Iceberg REST service IT #520

Merged
merged 3 commits into from
Oct 17, 2023

Conversation

FANNG1
Copy link
Contributor

@FANNG1 FANNG1 commented Oct 17, 2023

What changes were proposed in this pull request?

support JdbcCatalog for Iceberg REST service IT

Why are the changes needed?

Fix: #480

Does this PR introduce any user-facing change?

No

How was this patch tested?

add Jdbc IT

@github-actions
Copy link

github-actions bot commented Oct 17, 2023

Code Coverage Report

Overall Project 62.19% 🟢
Files changed 100% 🟢

Module Coverage
catalog-lakehouse-iceberg 81.18% 🟢
Files
Module File Coverage
catalog-lakehouse-iceberg IcebergConfig.java 100% 🟢

@FANNG1 FANNG1 marked this pull request as draft October 17, 2023 03:54
@FANNG1
Copy link
Contributor Author

FANNG1 commented Oct 17, 2023

after #501 , mysql jar is automatically downloaded by Graviton, we could merge this pr

@FANNG1 FANNG1 marked this pull request as ready for review October 17, 2023 12:08
@FANNG1 FANNG1 requested review from jerryshao and Clearvive October 17, 2023 12:08
+ IcebergRESTService.SERVICE_NAME
+ "."
+ IcebergConfig.CATALOG_WAREHOUSE.getKey(),
"file:///tmp/user/hive/warehouse-mysql/");
Copy link
Contributor

@jerryshao jerryshao Oct 17, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you need to change the name to not specify "mysql". Also Do you need to change to HDFS since @mchades 's PR is ready?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

plan to propose a new PR to change localfs to HDFS for JdbcCatalog and HiveCatalog

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So please create a new issue to track this thing.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

create #530 to track

jerryshao
jerryshao previously approved these changes Oct 17, 2023

public static final ConfigEntry<String> JDBC_PASSWORD =
new ConfigBuilder(ICEBERG_JDBC_PASSWORD)
.doc("The password of the Jdbc")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Jdbc catalog

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

using Jdbc connection

configMap.put(
AuxiliaryServiceManager.GRAVITINO_AUX_SERVICE_PREFIX
+ IcebergRESTService.SERVICE_NAME
+ "."
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I suggest introducing a temporary variation, as it has been repeated several times.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's ok to keep this, since this is a test code.

@jerryshao jerryshao merged commit e4fdb66 into apache:main Oct 17, 2023
2 checks passed
jerryshao pushed a commit that referenced this pull request Oct 26, 2023
…service IT (#520)

### What changes were proposed in this pull request?
support JdbcCatalog for Iceberg REST service IT

### Why are the changes needed?

Fix: #480 

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
add Jdbc IT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Subtask] support IcebergIT with HiveCatalog&JdbcCatalog
3 participants