New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[VL] Reduce spill in sort-based shuffle #6639

Merged

marin-ma merged 3 commits into apache:main from marin-ma:sort-based-shuffle-spill-op

Jul 31, 2024

Contributor

marin-ma commented Jul 30, 2024 •

edited

Loading

TPCH SF3T 40000 shuffle partitions: 1794s -> 1612s (vs hash 2023s)

Before:

After:


          reduce spill

7e67ecd

github-actions bot commented Jul 30, 2024

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

Other pull requests

marin-ma added 2 commits

July 30, 2024 09:21


          remove log

96a2afd


          fix ut

e60c27e

zhztheplayer approved these changes

View reviewed changes

marin-ma merged commit 2571780 into apache:main

42 of 48 checks passed

marin-ma mentioned this pull request

[VL] Umbrella issue for sort-based shuffle #6896

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet