Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-23914][SQL] Add array_union function #21061

Closed
wants to merge 34 commits into from
Closed

[SPARK-23914][SQL] Add array_union function #21061

wants to merge 34 commits into from

Commits on Jun 27, 2018

  1. initial commit

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    dc9d6f0 View commit details
    Browse the repository at this point in the history

  2. update description

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    3019840 View commit details
    Browse the repository at this point in the history

  3. fix test failure

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    8cee6cf View commit details
    Browse the repository at this point in the history

  4. address review comments

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    2041ec4 View commit details
    Browse the repository at this point in the history

  5. introduce ArraySetUtils to reuse code among array_union/array_interse… 

    …ct/array_except
    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    8c2280b View commit details
    Browse the repository at this point in the history

  6. fix python test failure

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    b3a3132 View commit details
    Browse the repository at this point in the history

  7. fix python test failure

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    a2c7dd1 View commit details
    Browse the repository at this point in the history

  8. simplification

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    5313680 View commit details
    Browse the repository at this point in the history

  9. fix pyspark test failure

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    98f8d1f View commit details
    Browse the repository at this point in the history

  10. address review comments

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    30ee7fc View commit details
    Browse the repository at this point in the history

  11. add new tests based on review comment

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    cd347e9 View commit details
    Browse the repository at this point in the history

  12. fix mistakes in rebase

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    d2eaee3 View commit details
    Browse the repository at this point in the history

  13. fix unexpected changes

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    2ddeb06 View commit details
    Browse the repository at this point in the history

  14. merge changes in apache#21103 

    fix test failure
    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    71b31f0 View commit details
    Browse the repository at this point in the history

  15. use GenericArrayData if UnsafeArrayData cannot be used 

    use ctx.addReferenceObj for DataType
    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    7e71340 View commit details
    Browse the repository at this point in the history

  16. use BinaryArrayExpressionWithImplicitCast 

    rename ArraySetUtils to ArraySetLike

update an condition to use GenericArrayData
    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    04c97c3 View commit details
    Browse the repository at this point in the history

  17. update test cases 

    fix test failure
    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    401ca7a View commit details
    Browse the repository at this point in the history

  18. rebase with master

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    15b953b View commit details
    Browse the repository at this point in the history

  19. support complex types

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    f050922 View commit details
    Browse the repository at this point in the history

  20. add test cases with duplication in an array

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    8a27667 View commit details
    Browse the repository at this point in the history

  21. rebase with master

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    e50bc55 View commit details
    Browse the repository at this point in the history

  22. address review comments

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    7e3f2ef View commit details
    Browse the repository at this point in the history

  23. address review comment

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    e5401e7 View commit details
    Browse the repository at this point in the history

  24. keep the order of input array elements

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    3e21e48 View commit details
    Browse the repository at this point in the history

  25. address review comments

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    3c39506 View commit details
    Browse the repository at this point in the history

  26. fix scala style error

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    6654742 View commit details
    Browse the repository at this point in the history

  27. address review comment 

    refactoring to reduce # of lines
    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    be9f331 View commit details
    Browse the repository at this point in the history

  28. address review comments

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    90e84b3 View commit details
    Browse the repository at this point in the history

  29. address review comments

    @kiszk
    kiszk committed Jun 27, 2018
    Configuration menu
    Copy the full SHA
    6f721f0 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2018

  1. address review comments

    @kiszk
    kiszk committed Jul 8, 2018
    Configuration menu
    Copy the full SHA
    0c0d3ba View commit details
    Browse the repository at this point in the history

  2. cleanup

    @kiszk
    kiszk committed Jul 8, 2018
    Configuration menu
    Copy the full SHA
    4a217bc View commit details
    Browse the repository at this point in the history

  3. eliminate duplicated code

    @kiszk
    kiszk committed Jul 8, 2018
    Configuration menu
    Copy the full SHA
    f5ebbe8 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2018

  1. address review comments

    @kiszk
    kiszk committed Jul 9, 2018
    Configuration menu
    Copy the full SHA
    763a1f8 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2018

  1. address review comment

    @kiszk
    kiszk committed Jul 11, 2018
    Configuration menu
    Copy the full SHA
    7b51564 View commit details
    Browse the repository at this point in the history