Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improvement] Add universal type support for Gravitino #2373

Closed
jerryshao opened this issue Feb 27, 2024 · 4 comments
Closed

[Improvement] Add universal type support for Gravitino #2373

jerryshao opened this issue Feb 27, 2024 · 4 comments
Assignees
Labels
0.6.0 Release v0.6.0 improvement Improvements on everything

Comments

@jerryshao
Copy link
Contributor

What would you like to be improved?

With the supported catalogs increased, Gravitino will face a problem that current type system cannot cover all the scenarios, like unsigned types, UDTs. In the meantime, we need to support DDL, so we should cover all the types.

How should we improve?

So to handle this problem, we should:

  1. Support UDTs, developers can define their own types based on our frameworks to support customized scenario.
  2. Support type variations to mapping the types to the target system.

We can refer to Substrait's type system (https://substrait.io/types/type_system/) to achieve our own.

CC @mchades @yuqi1129 @zhoukangcn

@mchades
Copy link
Contributor

mchades commented Feb 29, 2024

The issue discussed in #1761 is also something that needs to be considered for the universal type:
the types in Gravitino have the same name as the types in the catalog, but they have different semantics.

@jerryshao
Copy link
Contributor Author

Yeah, we need to have a complete solution to handle them all.

@mchades
Copy link
Contributor

mchades commented May 17, 2024

@mchades mchades added the 0.6.0 Release v0.6.0 label Aug 5, 2024
@mchades
Copy link
Contributor

mchades commented Aug 5, 2024

Close due to duplication with #3427

@mchades mchades closed this as not planned Won't fix, can't repro, duplicate, stale Aug 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.6.0 Release v0.6.0 improvement Improvements on everything
Projects
None yet
Development

No branches or pull requests

2 participants