-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update Clickbench results with DataFusion 28.0.0 #7108
Comments
the readme of https://github.com/ClickHouse/ClickBench/blob/main/datafusion/README.md was updated at Apr this year and is likely still updated. |
I could set it up in weekend for v28 |
the result is nice! Especially previous timeout query 32 now finish in 8s |
Also shall we create an issue to add |
Yes please do @jychen7 -- that would be amazing Note there is at least one query that will fail with the partitioned dataset in datafusion 28.0.0 due to #7039. @jonahgao fixed the problem on main but I don't think the fix is in the 28.0.0 release |
We just released datafusion 33, so I think this ticket is somewhat stale. If someone wants to update ClickBench again with the latest release, that would be great -- perhaps we can open a new ticket |
Is your feature request related to a problem or challenge?
With the release of DataFusion 28, it would be great to update the DataFusion performance reported on https://benchmark.clickhouse.com/
Notably, #6904 and related PRs for faster grouping performance show 2-3x performance improvements
Describe the solution you'd like
Update the results. I am not 100% sure how to do so, but I think the discussions on #5276 contain the answer
The datafusion scripts are in https://github.com/ClickHouse/ClickBench/tree/main/datafusion
maybe @jychen7 knows / can provide some hints
Describe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: