Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Rust] [DataFusion] Re-implement query execution with an extensible physical query plan #21700

Closed
21 tasks done
asfimport opened this issue Apr 28, 2019 · 0 comments
Closed
21 tasks done

Comments

@asfimport
Copy link
Collaborator

asfimport commented Apr 28, 2019

 This story (maybe it should have been an epic with hindsight) is to re-implement query execution in DataFusion using a physical plan that supports partitions and parallel execution.

This will replace the current query execution which happens directly from the logical plan.

The new physical plan is based on traits and is therefore extensible by other projects that use Arrow. For example, another project could add physical plans for distributed compute.

See design doc at https://docs.google.com/document/d/1ATZGIs8ry_kJeoTgmJjLrg6Ssb5VE7lNzWuz_4p6EWk/edit?usp=sharing for more info

Reporter: Andy Grove / @andygrove
Assignee: Andy Grove / @andygrove

Subtasks:

Related issues:

PRs and other links:

Note: This issue was originally created as ARROW-5227. Please see the migration documentation for further details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants