Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] Simplify hive matestore configuration #196

Closed
Tracked by #58
xunliu opened this issue Aug 9, 2023 · 4 comments · Fixed by #489
Closed
Tracked by #58

[Subtask] Simplify hive matestore configuration #196

xunliu opened this issue Aug 9, 2023 · 4 comments · Fixed by #489
Assignees
@xunliu @yuqi1129
Milestone
Graviton v0.2.0

Comments

@xunliu
Copy link
Member

xunliu commented Aug 9, 2023

Describe the subtask

The current hive matestore is very difficult to configuration using hive-site.xml.
Graviton's catalog-hive uses only a few parameters, so we can use catalog-hive.properties or catalog-hive.conf file to simplify configuration.

Parent issue

#58
@xunliu xunliu mentioned this issue Aug 8, 2023
Closed
7 tasks
@jerryshao
Copy link
Contributor

@xunliu would you please help to work on this when you have time?

@xunliu xunliu self-assigned this Aug 31, 2023
@xunliu
Copy link
Member Author

xunliu commented Aug 31, 2023 •
edited
Loading

This task depends on #308

@jerryshao
Copy link
Contributor

This should be related to #415

@yuqi1129
Copy link
Contributor

In #478, we will add catalog-specific configuration files like hive.conf besides hive-site.xml to the classpath, hive-site.xml will be automatically loaded when using HiveConf, at the same, we can also set Hive metadata-related configurations in hive.conf.

@yuqi1129 yuqi1129 mentioned this issue Oct 12, 2023
Merged
jerryshao pushed a commit that referenced this issue Oct 12, 2023
@yuqi1129
[#478] feat(core, catalogs): Refactor catalog configurations (#489)
4d9e7a9 
### What changes were proposed in this pull request?

In this PR, we introduce the following points:
- Remove the catalog-related configuration from `Graviton` server
configuration file.
- Support setting catalog configuration with a separate config file
located in `catalogs` module
- Provide catalog-related configurations for a specific engine with an
unique prefix.

### Why are the changes needed?

Fix: #478 
Fix: #196 

### Does this PR introduce _any_ user-facing change?

N/A

### How was this patch tested?

New UTs
Clearvive pushed a commit that referenced this issue Oct 17, 2023
@yuqi1129
[#478] feat(core, catalogs): Refactor catalog configurations (#489)
646b5a5 
### What changes were proposed in this pull request?

In this PR, we introduce the following points:
- Remove the catalog-related configuration from `Graviton` server
configuration file.
- Support setting catalog configuration with a separate config file
located in `catalogs` module
- Provide catalog-related configurations for a specific engine with an
unique prefix.

### Why are the changes needed?

Fix: #478 
Fix: #196 

### Does this PR introduce _any_ user-facing change?

N/A

### How was this patch tested?

New UTs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@xunliu xunliu

@yuqi1129 yuqi1129

Labels
None yet
Projects
None yet
Milestone
Graviton v0.2.0
Development

Successfully merging a pull request may close this issue.

[#478] feat(core, catalogs): Refactor catalog configurations yuqi1129/graviton
3 participants
@jerryshao @xunliu @yuqi1129