Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEA] Java APIs for writing structs to ORC #9233

Closed
jlowe opened this issue Sep 15, 2021 · 0 comments · Fixed by #9334
Closed

[FEA] Java APIs for writing structs to ORC #9233

jlowe opened this issue Sep 15, 2021 · 0 comments · Fixed by #9334
Labels
feature request New feature or request Java Affects Java cuDF API. Spark Functionality that helps Spark RAPIDS

Comments

@jlowe
Copy link
Member

jlowe commented Sep 15, 2021

#9025 added struct support to the libcudf ORC writer, but this functionality was not exposed through the Java APIs in that PR. The Java APIs should add struct writing support for ORC similar to the struct writing support that was added for Parquet in #7998. This will be a breaking change the RAPIDS Accelerator for Apache Spark, so this change should be coordinated with a corresponding change in that project to minimize the time the Spark plugin builds are broken.
@jlowe jlowe added feature request New feature or request Java Affects Java cuDF API. Spark Functionality that helps Spark RAPIDS labels Sep 15, 2021
This was referenced Sep 15, 2021
Merged
Closed
@firestarman firestarman mentioned this issue Sep 29, 2021
Merged
rapids-bot bot pushed a commit that referenced this issue Oct 13, 2021
@firestarman
JNI: Support nested types in ORC writer (#9334)
df27da2 
This fixes #9233.

Besides it should also cover lists and maps.

Signed-off-by: Firestarman <[email protected]>

Authors:
  - Liangcai Li (https://github.com/firestarman)

Approvers:
  - Raza Jafri (https://github.com/razajafri)

URL: #9334
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature request New feature or request Java Affects Java cuDF API. Spark Functionality that helps Spark RAPIDS
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

JNI: Support nested types in ORC writer firestarman/cudf
1 participant
@jlowe