Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] support load HDFS config files for graviton server #445

Closed
FANNG1 opened this issue Sep 25, 2023 · 0 comments · Fixed by #468
Closed

[Subtask] support load HDFS config files for graviton server #445

FANNG1 opened this issue Sep 25, 2023 · 0 comments · Fixed by #468
Assignees
@FANNG1
Milestone
Graviton v0.2.0

Comments

@FANNG1
Copy link
Contributor

FANNG1 commented Sep 25, 2023

Describe the subtask

as IcebergCatalog directly writes TableMetaData to HDFS, we need to add HDFS configuration files to graviton Server

Parent issue

#321
@FANNG1 FANNG1 self-assigned this Sep 25, 2023
@FANNG1 FANNG1 added this to the Graviton v0.2.0 milestone Sep 25, 2023
@FANNG1 FANNG1 mentioned this issue Oct 7, 2023
Merged
jerryshao pushed a commit that referenced this issue Oct 13, 2023
@FANNG1
[#445] feat(lakehouse-iceberg): support load HDFS config files for Ic…
314e587 
…eberg REST server (#468)

### What changes were proposed in this pull request?
support load HDFS config files for Iceberg REST server, support multiple
classpath for `graviton.auxService.iceberg-rest.classpath`, such as
`catalogs/lakehouse-iceberg/libs, catalogs/lakehouse-iceberg/conf`

### Why are the changes needed?
HDFS configs are complicated, we should put `core-site.xml` and
`hdfs-site.xml` to the classpath

Fix: #445 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
1. setup local HDFS cluster.
2. start the graviton server with HDFS config files.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@FANNG1 FANNG1

Labels
None yet
Projects
None yet
Milestone
Graviton v0.2.0
Development

Successfully merging a pull request may close this issue.

[#445] feat(lakehouse-iceberg): support load HDFS config files for Iceberg REST server
1 participant
@FANNG1