Skip to content

Commit

Permalink
docs: explain why delta-rs depends on datafusion
Browse files Browse the repository at this point in the history
  • Loading branch information
MrPowers authored and rtyler committed Dec 29, 2023
1 parent cb20ad7 commit 6da3b3b
Showing 1 changed file with 7 additions and 2 deletions.
9 changes: 7 additions & 2 deletions docs/integrations/delta-lake-datafusion.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ Delta Lake offers DataFusion users better performance and more features compared

Delta Lake works well with the DataFusion Rust API and the DataFusion Python API. It's a great option for all DataFusion users.

Delta Lake also depends on DataFusion to implement some functionality under the hood. We will also discuss this dependency at the end of this guide in case you're interested in learning more about the symbiotic relationship between the two libraries.
Delta Lake also depends on DataFusion to implement SQL-related functionality under the hood. We will also discuss this dependency at the end of this guide in case you're interested in learning more about the symbiotic relationship between the two libraries.

## Delta Lake performance benefits for DataFusion users

Expand Down Expand Up @@ -67,7 +67,12 @@ Delta Lake also provides other features that are useful for DataFusion users lik

Delta Lake depends on DataFusion to provide some end-user features.

TODO: Explain how Delta Lake uses DataFusion to provide features.
DataFusion is useful in providing SQL-related Delta Lake features. Some examples:

* Update and merge are written in terms of SQL expressions.
* Invariants and constraints are written in terms of SQL expressions.

Anytime we have to evaluate SQL, we need some sort of SQL engine. We use DataFusion for that.

## Conclusion

Expand Down

0 comments on commit 6da3b3b

Please sign in to comment.