Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spark 3.2 Support #168

Closed
nevi-me opened this issue Jun 9, 2022 · 1 comment
Closed

Spark 3.2 Support #168

nevi-me opened this issue Jun 9, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@nevi-me
Copy link
Contributor

nevi-me commented Jun 9, 2022

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

I would like to run blaze on Spark 3.2

Describe the solution you'd like

Building blaze against 3.2, or having an option to choose a Spark version between 3.0 and 3.2

Describe alternatives you've considered

Remaining on 3.0

Additional context

I found this while benchmarking some SQL queries, I had to make sure that I use 3.0, but my local stack runs on 3.2

@richox
Copy link
Collaborator

richox commented Sep 26, 2023

now we have supports for spark-3.0 and 3.3. for supporting other versions, we have to create a new shims package. i believe it should be not that hard because spark-3.2 have similar apis to 3.0/3.3.

@richox richox closed this as completed Sep 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants