[DISCUSSION] 2024 Q4 / 2025 Q1 Roadmap

[alamb]

Is your feature request related to a problem or challenge?

The last roadmap discussion we had seems to have worked out well to galvanize and get us organized around some common goals

• 2024 Q3-Q4 Roadmap? #11442

Describe the solution you'd like

Let's collect any projects that people think they are likely to spend time on or projects that the broader community would really like to see done and write them down!

Describe alternatives you've considered

No response

Additional context

No response

[alamb]

BTW my personal plans over the next few months are likely going to be focus on consolidating some of the gains / improvements we have made recently. That includes:

• External communication / documentation
• with @SamSynnada like Enhancing DataFusion's Community Engagement and Visibility #13049
• Blog post with DataFusion July - Sep 2024 #11631

Improve the project's documentation

• [EPIC] Improve examples to make them easier to navigate #11172
• Document DataFusion Threading (and how to separate IO and CPU bound work) #12393
• Epic: Better / Improved Documentation, Tutorials and Examples #7013

Performance wise I plan to

• help work on more advanced parquet predicate pushdown with @XiangpengHao Enable parquet filter pushdown by default #3463
• Continue to flesh out the grouping code: [EPIC] Improvements to GroupColumn multi-column aggregation performance #12680

[matthewmturner]

I am not sure if this is the place for it but I have been putting a lot of work into dft and plan on doing a release before end of year.

[alamb]

I am not sure if this is the place for it but I have been putting a lot of work into dft and plan on doing a release before end of year.

For anyone else following along, dft is https://github.com/datafusion-contrib/datafusion-dft