Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ArrowUtilsShims in preparation for Spark 3.5.0 #8947

Merged
merged 3 commits into from
Aug 9, 2023
Merged

Add ArrowUtilsShims in preparation for Spark 3.5.0 #8947

merged 3 commits into from
Aug 9, 2023

Conversation

andygrove
Copy link
Contributor

Part of #8121

Spark 3.5.0 moved getPythonRunnerConfMap from ArrowUtils to ArrowPythonRunner.

This PR moves all calls to getPythonRunnerConfMap into the shim layer.

@andygrove andygrove added the Spark 3.5+ Spark 3.5+ issues label Aug 7, 2023
@andygrove andygrove self-assigned this Aug 7, 2023
revans2
revans2 previously approved these changes Aug 8, 2023
View reviewed changes
jlowe
jlowe previously approved these changes Aug 8, 2023
View reviewed changes
@jlowe
Copy link
Member

jlowe commented Aug 8, 2023

build

@andygrove andygrove dismissed stale reviews from jlowe and revans2 via 78b667e August 8, 2023 21:28
@andygrove
Copy link
Contributor Author

build

jlowe
jlowe previously approved these changes Aug 8, 2023
View reviewed changes
@andygrove
Copy link
Contributor Author

build

@andygrove andygrove merged commit d4ce3c7 into NVIDIA:branch-23.10 Aug 9, 2023
27 checks passed
@andygrove andygrove deleted the shim-arrow-utils branch August 9, 2023 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jlowe jlowe jlowe approved these changes

@revans2 revans2 revans2 left review comments

Assignees

@andygrove andygrove

Labels
Spark 3.5+ Spark 3.5+ issues
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@andygrove @jlowe @revans2