Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA]Support nested types for parsing JSON #4608

Open
Tracked by #9
GaryShen2008 opened this issue Jan 24, 2022 · 2 comments
Open
Tracked by #9

[FEA]Support nested types for parsing JSON #4608

GaryShen2008 opened this issue Jan 24, 2022 · 2 comments
Labels
cudf_dependency An issue or PR with this label depends on a new feature in cudf task Work required that improves the product but is not user facing

Comments

@GaryShen2008
Copy link
Collaborator

Spark supports Struct, Array and Map types when parsing JSON.
Schema must be provided for Map types otherwise it will be inferred as a struct.

Depends on rapidsai/cudf#8827.
@GaryShen2008 GaryShen2008 added feature request New feature or request ? - Needs Triage Need team to review and classify labels Jan 24, 2022
@GaryShen2008 GaryShen2008 mentioned this issue Jan 24, 2022
Open
62 tasks
@sameerz sameerz added task Work required that improves the product but is not user facing and removed feature request New feature or request ? - Needs Triage Need team to review and classify labels Jan 25, 2022
@ttnghia
Copy link
Collaborator

ttnghia commented Nov 30, 2022

Cudf dependency was merged. This can be re-prioritized if needed.

@andygrove andygrove changed the title [FEA]Support netsted types for parsing JSON [FEA]Support nested types for parsing JSON Dec 13, 2023
@revans2 revans2 added the cudf_dependency An issue or PR with this label depends on a new feature in cudf label Mar 13, 2024
@revans2
Copy link
Collaborator

revans2 commented Mar 13, 2024

There are a number of follow on issues that are needed to really make this work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
cudf_dependency An issue or PR with this label depends on a new feature in cudf task Work required that improves the product but is not user facing
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@revans2 @sameerz @ttnghia @GaryShen2008