Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Use spark3 by default #1549

Merged
merged 7 commits into from
Oct 19, 2021
Merged

Use spark3 by default #1549

merged 7 commits into from
Oct 19, 2021

Commits on Oct 14, 2021

  1. Update base version to pyspark>=3.0.0

    Jianjie Liu committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    b576098 View commit details
    Browse the repository at this point in the history

  2. Upgrade to java 11

    Jianjie Liu committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    1ed9320 View commit details
    Browse the repository at this point in the history

  3. update setup.md on default support on Spark3

    Jianjie Liu committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    557a2fe View commit details
    Browse the repository at this point in the history

  4. Mark more flaky spark tests

    Jianjie Liu committed Oct 14, 2021
    Configuration menu
    Copy the full SHA
    c13a0e6 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2021

  1. Revert "update setup.md on default support on Spark3" 

    This reverts commit 557a2fe.
    Jianjie Liu committed Oct 19, 2021
    Configuration menu
    Copy the full SHA
    47c3120 View commit details
    Browse the repository at this point in the history

  2. Revert "Update base version to pyspark>=3.0.0" 

    This reverts commit b576098.
    Jianjie Liu committed Oct 19, 2021
    Configuration menu
    Copy the full SHA
    6297721 View commit details
    Browse the repository at this point in the history

  3. Set pyspark upper bound to <3.2.0

    Jianjie Liu committed Oct 19, 2021
    Configuration menu
    Copy the full SHA
    ce81bdd View commit details
    Browse the repository at this point in the history