-
Notifications
You must be signed in to change notification settings - Fork 717
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
M1 support, upgrade to newer RocksDB and AWS Java SDK #8533
M1 support, upgrade to newer RocksDB and AWS Java SDK #8533
Conversation
@DevinTDHa Can we not call those native files |
Yes, let me change it actually to M1 so it is clearer. Regarding Linux and Windows compatibility there shouldn't be an issue, as this is for the mac dylibs only (i'll add another condition for |
1.11.828 is the minimum AWS Java SDK supported by EMR 6.1.1 (the first version to support Spark 3.x)
Description
This PR enables Spark NLP to be built with M1 support. Most of the required packages have already been published and have been integrated into the build.
This PR fixes the remaining compatibility issues:
build.sbt
to use a newerrocksdbjni
version if m1 was selected for the build.TODO:
Motivation and Context
How Has This Been Tested?
Screenshots (if appropriate):
Types of changes