Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better Equivalence (ordering and exact equivalence) Propagation through ProjectionExec #8484

Merged
merged 50 commits into from
Dec 11, 2023
Merged

Better Equivalence (ordering and exact equivalence) Propagation through ProjectionExec #8484

merged 50 commits into from
Dec 11, 2023

Commits on Nov 6, 2023

  1. Discover ordering of complex expressions in group by and window parti… 

    …tion by
    @mustafasrepo
    mustafasrepo committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    f990947 View commit details
    Browse the repository at this point in the history

  2. Remove unnecessary tests

    @mustafasrepo
    mustafasrepo committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    ce982f0 View commit details
    Browse the repository at this point in the history

  3. Update comments

    @mustafasrepo
    mustafasrepo committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    8dc081f View commit details
    Browse the repository at this point in the history

  4. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    8560c87 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. Better projection support complex expression support

    @mustafasrepo
    mustafasrepo committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    c31ec8c View commit details
    Browse the repository at this point in the history

  2. Fix failing test

    @mustafasrepo
    mustafasrepo committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    49b1504 View commit details
    Browse the repository at this point in the history

  3. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    4ce3b90 View commit details
    Browse the repository at this point in the history

  4. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    78206ba View commit details
    Browse the repository at this point in the history

  5. Add is end flag

    @mustafasrepo
    mustafasrepo committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    429096a View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    a4a3d7e View commit details
    Browse the repository at this point in the history

  2. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    f6bc4d9 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    20ade77 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'apache_main' into complex_exprs_ordering_support 

    # Conflicts:
#	datafusion/physical-expr/src/equivalence.rs
#	datafusion/sqllogictest/test_files/groupby.slt
    @mustafasrepo
    mustafasrepo committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    2b7a43c View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. Merge branch 'apache_main' into complex_exprs_ordering_support 

    # Conflicts:
#	datafusion/core/src/physical_optimizer/enforce_distribution.rs
#	datafusion/core/src/physical_optimizer/replace_with_order_preserving_variants.rs
    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    fffde03 View commit details
    Browse the repository at this point in the history

  2. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    66d05d9 View commit details
    Browse the repository at this point in the history

  3. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    b78b9d7 View commit details
    Browse the repository at this point in the history

  4. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    20b5f08 View commit details
    Browse the repository at this point in the history

  5. All tests pass

    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    3e1a2b9 View commit details
    Browse the repository at this point in the history

  6. Change implementation of find_longest_permutation

    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    9be89e2 View commit details
    Browse the repository at this point in the history

  7. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    20e96d0 View commit details
    Browse the repository at this point in the history

  8. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    2400a9b View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. Merge branch 'apache_main' into complex_exprs_ordering_support 

    # Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.
    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    0cd8427 View commit details
    Browse the repository at this point in the history

  2. Complex exprs requirement support (#215) 

    * Discover ordering of complex expressions in group by and window partition by

* Remove unnecessary tests

* Update comments

* Minor changes

* Better projection support complex expression support

* Fix failing test

* Simplifications

* Simplifications

* Add is end flag

* Simplifications

* Simplifications

* Simplifications

* Minor changes

* Minor changes

* Minor changes

* All tests pass

* Change implementation of find_longest_permutation

* Minor changes

* Minor changes

* Remove projection section

* Remove projection implementation

* Fix linter errors

* Remove projection sections

* Minor changes

* Add docstring comments

* Add comments

* Minor changes

* Minor changes

* Add comments

* simplifications
    @mustafasrepo
    mustafasrepo authored Nov 17, 2023
    Configuration menu
    Copy the full SHA
    7a1e030 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'complex_exprs_requirement' into complex_exprs_projection 

    # Conflicts:
#	datafusion/physical-expr/src/equivalence.rs
#	datafusion/physical-expr/src/sort_properties.rs
    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    63c1ee5 View commit details
    Browse the repository at this point in the history

  4. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    d39f5b2 View commit details
    Browse the repository at this point in the history

  5. Remove unused methods

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    1120488 View commit details
    Browse the repository at this point in the history

  6. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    d2a2667 View commit details
    Browse the repository at this point in the history

  7. Add random projection test

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    7604c13 View commit details
    Browse the repository at this point in the history

  8. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    792c8e9 View commit details
    Browse the repository at this point in the history

  9. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    b35d343 View commit details
    Browse the repository at this point in the history

  10. Merge branch 'complex_exprs_requirement' into complex_exprs_projection 

    # Conflicts:
#	datafusion/physical-expr/src/equivalence.rs
    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    ad3b2be View commit details
    Browse the repository at this point in the history

  11. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    464c0a0 View commit details
    Browse the repository at this point in the history

  12. Add comments

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    cee9018 View commit details
    Browse the repository at this point in the history

  13. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    4659904 View commit details
    Browse the repository at this point in the history

  14. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    9f32fb7 View commit details
    Browse the repository at this point in the history

  15. Simplifications

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    0f5e7ec View commit details
    Browse the repository at this point in the history

  16. Add new orderings

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    6e2f7ba View commit details
    Browse the repository at this point in the history

  17. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    3a4bb76 View commit details
    Browse the repository at this point in the history

  18. Add comments

    @mustafasrepo
    mustafasrepo committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    39ff152 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. Add new tests

    @mustafasrepo
    mustafasrepo committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    2b8dffc View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. Change project ordering implementation

    @mustafasrepo
    mustafasrepo committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    9afd4b5 View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2023

  1. Change ordering projection implementation

    @mustafasrepo
    mustafasrepo committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    e429e89 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'apache_main' into complex_exprs_projection 

    # Conflicts:
#	datafusion/physical-expr/src/equivalence.rs
#	datafusion/sqllogictest/test_files/groupby.slt
    @mustafasrepo
    mustafasrepo committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    a48a953 View commit details
    Browse the repository at this point in the history

  3. Remove leftover code

    @mustafasrepo
    mustafasrepo committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    f38a9c4 View commit details
    Browse the repository at this point in the history

  4. Add new test

    @mustafasrepo
    mustafasrepo committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    5e86fe6 View commit details
    Browse the repository at this point in the history

  5. Minor changes

    @mustafasrepo
    mustafasrepo committed Nov 23, 2023
    Configuration menu
    Copy the full SHA
    66856ae View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. Review Part 1

    @metesynnada
    metesynnada committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    c2a617e View commit details
    Browse the repository at this point in the history

  2. simplifications

    @mustafasrepo
    mustafasrepo committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    68586e8 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2023

  1. Review

    @ozankabak
    ozankabak committed Dec 8, 2023
    Configuration menu
    Copy the full SHA
    1508964 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. Update join suffix implementation

    @mustafasrepo
    mustafasrepo committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    96f7d3a View commit details
    Browse the repository at this point in the history