Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add Spark 3.5 on JDK 17 #16

Merged
merged 5 commits into from
Nov 29, 2024
Merged

add Spark 3.5 on JDK 17 #16

merged 5 commits into from
Nov 29, 2024

Conversation

barend-xebia
Copy link
Contributor

@barend-xebia barend-xebia commented Nov 28, 2024

This PR adds a build for Spark version 3.5 on JDK 17.

The GitHub Actions build had been in hibernation due to repo inactivity. Upon arousal, enough of the world had changed around it that it no longer worked. This PR revises the GHA build to make the build matrix easier to read (no more string-splitting build identifiers) and replace the variable wrangling by the docker/metadata-action. This has the side effect of cleaning up some deprecation warnings.

  • bycatch: use latest version of the various Actions involved in the build
  • bycatch: netcat package was renamed
  • bycatch: deprecated ENV syntax in Dockerfile

Note: the HADOOP_VERSION value has been copied from existing builds. I don't know why the specific versions are chosen for the specific images. Perhaps a comment would be nice.

bycatch: netcat package was renamed
bycatch: deprecated ENV syntax in Dockerfile
@barend-xebia barend-xebia force-pushed the spark-3.5 branch 7 times, most recently from d5a8715 to e5e91e7 Compare November 28, 2024 12:03
@barend-xebia barend-xebia force-pushed the spark-3.5 branch 2 times, most recently from ed19acb to 9f35702 Compare November 28, 2024 15:56
@barend-xebia barend-xebia merged commit 81fedaa into master Nov 29, 2024
6 checks passed
@barend-xebia barend-xebia deleted the spark-3.5 branch November 29, 2024 09:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants