Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update to spark3.1 #366

Merged
merged 1 commit into from
Aug 5, 2021
Merged

update to spark3.1 #366

merged 1 commit into from
Aug 5, 2021

Commits on May 24, 2021

  1. update to spark3.1

    AFAIU the only requirement is update for <apache/spark#29983>.
    In order to be consistent with the previous behavior and pass the
    existing test suite, this PR is essentially equavalent to setting
    `spark.sql.legacy.statisticalAggregate` to `true`.
    
    Now the code is incompatible with spark-2.x or spark-3.0, and so I'd
    like to recommend only supporting spark 3.1 and higher and scala 2.12
    from now on.
    aviatesk committed May 24, 2021
    Configuration menu
    Copy the full SHA
    12c8e91 View commit details
    Browse the repository at this point in the history