-
Notifications
You must be signed in to change notification settings - Fork 406
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update versions to 0.7.0 and update changelog #1083
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change | ||||||||
---|---|---|---|---|---|---|---|---|---|---|
@@ -1 +1,40 @@ | ||||||||||
# Historical Changelog | ||||||||||
|
||||||||||
|
||||||||||
## [rust-v0.6.0](https://github.com/delta-io/delta-rs/tree/rust-v0.6.0) (2022-12-16) | ||||||||||
|
||||||||||
[Full Changelog](https://github.com/delta-io/delta-rs/compare/rust-v0.5.0...rust-v0.6.0) | ||||||||||
|
||||||||||
**Implemented enhancements:** | ||||||||||
|
||||||||||
- Support Apache Arrow DataFusion 15 [\#1020](https://github.com/delta-io/delta-rs/issues/1020) | ||||||||||
- Python package: Loosen version requirements for maturin [\#1004](https://github.com/delta-io/delta-rs/issues/1004) | ||||||||||
- Remove `Cargo.lock` from library crates and add `Cargo.lock` to binary ones [\#1000](https://github.com/delta-io/delta-rs/issues/1000) | ||||||||||
- More frequent Rust releases [\#969](https://github.com/delta-io/delta-rs/issues/969) | ||||||||||
- Thoughts on adding read\_delta to pandas [\#869](https://github.com/delta-io/delta-rs/issues/869) | ||||||||||
- Add the support of the AWS\_PROFILE environment variable for S3 [\#986](https://github.com/delta-io/delta-rs/pull/986) ([fvaleye](https://github.com/fvaleye)) | ||||||||||
|
||||||||||
**Fixed bugs:** | ||||||||||
|
||||||||||
- Azure SAS signatures ending in "=" don't work [\#1003](https://github.com/delta-io/delta-rs/issues/1003) | ||||||||||
- Fail to compile deltalake crate, need to update dynamodb\_lock in crates.io [\#1002](https://github.com/delta-io/delta-rs/issues/1002) | ||||||||||
- error reading delta table to pandas: runtime dropped the dispatch task [\#975](https://github.com/delta-io/delta-rs/issues/975) | ||||||||||
- MacOS arm64 wheels are generated incorrectly [\#972](https://github.com/delta-io/delta-rs/issues/972) | ||||||||||
- Overwrite creates new file [\#960](https://github.com/delta-io/delta-rs/issues/960) | ||||||||||
- The written delta file has corrupted structure [\#956](https://github.com/delta-io/delta-rs/issues/956) | ||||||||||
Comment on lines
+23
to
+24
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
These two issues were just ones where users misunderstood how Delta tables works. They have no change set associated with them. I wonder if the script that generates this could exclude issues that have no linked PRs? |
||||||||||
- Write mode doesn't work with Azure storage [\#955](https://github.com/delta-io/delta-rs/issues/955) | ||||||||||
- Python: We don't error on reader protocol v2 [\#886](https://github.com/delta-io/delta-rs/issues/886) | ||||||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
This one is Python only. |
||||||||||
- Cannot open a deltatable in S3 using AWS\_PROFILE based credentials from a local machine [\#855](https://github.com/delta-io/delta-rs/issues/855) | ||||||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Duplicate of feature above. |
||||||||||
|
||||||||||
**Merged pull requests:** | ||||||||||
|
||||||||||
- Support DataFusion 15 [\#1021](https://github.com/delta-io/delta-rs/pull/1021) ([andrei-ionescu](https://github.com/andrei-ionescu)) | ||||||||||
- fix truncating signature on SAS [\#1007](https://github.com/delta-io/delta-rs/pull/1007) ([damiondoesthings](https://github.com/damiondoesthings)) | ||||||||||
- Loosen version requirement for maturin [\#1005](https://github.com/delta-io/delta-rs/pull/1005) ([gyscos](https://github.com/gyscos)) | ||||||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Python only. |
||||||||||
- Update `.gitignore` and add/remove `Cargo.lock` when appropriate [\#1001](https://github.com/delta-io/delta-rs/pull/1001) ([iajoiner](https://github.com/iajoiner)) | ||||||||||
- fix: get azure client secret from config [\#981](https://github.com/delta-io/delta-rs/pull/981) ([roeap](https://github.com/roeap)) | ||||||||||
- feat: check invariants in write command [\#980](https://github.com/delta-io/delta-rs/pull/980) ([roeap](https://github.com/roeap)) | ||||||||||
- Add a new release github action for Python binding: macos with universal2 wheel [\#976](https://github.com/delta-io/delta-rs/pull/976) ([fvaleye](https://github.com/fvaleye)) | ||||||||||
- Bump version of the Python binding to 0.6.4 [\#970](https://github.com/delta-io/delta-rs/pull/970) ([fvaleye](https://github.com/fvaleye)) | ||||||||||
- Handle pandas timestamps [\#958](https://github.com/delta-io/delta-rs/pull/958) ([hayesgb](https://github.com/hayesgb)) | ||||||||||
- test\(python\): add azure integration tests [\#912](https://github.com/delta-io/delta-rs/pull/912) ([wjones127](https://github.com/wjones127)) | ||||||||||
Comment on lines
+37
to
+40
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Python only. |
Original file line number | Diff line number | Diff line change | ||||
---|---|---|---|---|---|---|
@@ -1,42 +1,56 @@ | ||||||
# Changelog | ||||||
|
||||||
## [rust-v0.6.0](https://github.com/delta-io/delta-rs/tree/rust-v0.6.0) (2022-12-16) | ||||||
## [rust-v0.7.0](https://github.com/delta-io/delta-rs/tree/rust-v0.7.0) (2023-01-19) | ||||||
|
||||||
[Full Changelog](https://github.com/delta-io/delta-rs/compare/rust-v0.5.0...rust-v0.6.0) | ||||||
[Full Changelog](https://github.com/delta-io/delta-rs/compare/rust-v0.6.0...rust-v0.7.0) | ||||||
|
||||||
**Implemented enhancements:** | ||||||
|
||||||
- Support Apache Arrow DataFusion 15 [\#1020](https://github.com/delta-io/delta-rs/issues/1020) | ||||||
- Python package: Loosen version requirements for maturin [\#1004](https://github.com/delta-io/delta-rs/issues/1004) | ||||||
- Remove `Cargo.lock` from library crates and add `Cargo.lock` to binary ones [\#1000](https://github.com/delta-io/delta-rs/issues/1000) | ||||||
- More frequent Rust releases [\#969](https://github.com/delta-io/delta-rs/issues/969) | ||||||
- Thoughts on adding read\_delta to pandas [\#869](https://github.com/delta-io/delta-rs/issues/869) | ||||||
- Add the support of the AWS\_PROFILE environment variable for S3 [\#986](https://github.com/delta-io/delta-rs/pull/986) ([fvaleye](https://github.com/fvaleye)) | ||||||
- Support Statistics in PyArrow [\#1070](https://github.com/delta-io/delta-rs/issues/1070) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Python only |
||||||
- Use existing labels for PRs if possible [\#1051](https://github.com/delta-io/delta-rs/issues/1051) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Dev-facing only |
||||||
- Expose the Delta Log in a DataFrame that's easy for analysis [\#1031](https://github.com/delta-io/delta-rs/issues/1031) | ||||||
- Automatically label PRs [\#1026](https://github.com/delta-io/delta-rs/issues/1026) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
dev-facing only |
||||||
- Provide case-insensitive storage options in backend [\#999](https://github.com/delta-io/delta-rs/issues/999) | ||||||
- Support local file path in CreateBuilder::with\_location\(\) [\#998](https://github.com/delta-io/delta-rs/issues/998) | ||||||
- Upgrade actions to not use deprecated features. [\#978](https://github.com/delta-io/delta-rs/issues/978) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
dev-facing only |
||||||
- Save operational params in the same way with delta io [\#1054](https://github.com/delta-io/delta-rs/pull/1054) ([ismoshkov](https://github.com/ismoshkov)) | ||||||
|
||||||
**Fixed bugs:** | ||||||
|
||||||
- Azure SAS signatures ending in "=" don't work [\#1003](https://github.com/delta-io/delta-rs/issues/1003) | ||||||
- Fail to compile deltalake crate, need to update dynamodb\_lock in crates.io [\#1002](https://github.com/delta-io/delta-rs/issues/1002) | ||||||
- error reading delta table to pandas: runtime dropped the dispatch task [\#975](https://github.com/delta-io/delta-rs/issues/975) | ||||||
- MacOS arm64 wheels are generated incorrectly [\#972](https://github.com/delta-io/delta-rs/issues/972) | ||||||
- Overwrite creates new file [\#960](https://github.com/delta-io/delta-rs/issues/960) | ||||||
- The written delta file has corrupted structure [\#956](https://github.com/delta-io/delta-rs/issues/956) | ||||||
- Write mode doesn't work with Azure storage [\#955](https://github.com/delta-io/delta-rs/issues/955) | ||||||
- Python: We don't error on reader protocol v2 [\#886](https://github.com/delta-io/delta-rs/issues/886) | ||||||
- Cannot open a deltatable in S3 using AWS\_PROFILE based credentials from a local machine [\#855](https://github.com/delta-io/delta-rs/issues/855) | ||||||
- crates.io entry is missing link to rustdoc documentation [\#1076](https://github.com/delta-io/delta-rs/issues/1076) | ||||||
- DeltaTable DataFusion TableProvider does not support filter pushdown [\#1064](https://github.com/delta-io/delta-rs/issues/1064) | ||||||
- DeltaTable DataFusion scan does not prune files properly [\#1063](https://github.com/delta-io/delta-rs/issues/1063) | ||||||
- CI constantly fails for `python_build / Python Build (Python 3.10 PyArrow latest)` [\#1025](https://github.com/delta-io/delta-rs/issues/1025) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
dev facing only |
||||||
- URL Registered with ObjectStore registry is different from url in DeltaScan [\#1018](https://github.com/delta-io/delta-rs/issues/1018) | ||||||
- Transaction log JSON formatting issue when writing data via Python bindings [\#1017](https://github.com/delta-io/delta-rs/issues/1017) | ||||||
- DeltaStorageHandler is not serializable [\#1015](https://github.com/delta-io/delta-rs/issues/1015) | ||||||
- Deltalake 0.5 crate s3 feature dynamodb version mismatch [\#973](https://github.com/delta-io/delta-rs/issues/973) | ||||||
- Use Chrono without default features [\#914](https://github.com/delta-io/delta-rs/issues/914) | ||||||
- Azure SAS authorization fails with `<AuthenticationErrorDetail>Signature fields not well formed.` [\#910](https://github.com/delta-io/delta-rs/issues/910) | ||||||
|
||||||
**Merged pull requests:** | ||||||
|
||||||
- Support DataFusion 15 [\#1021](https://github.com/delta-io/delta-rs/pull/1021) ([andrei-ionescu](https://github.com/andrei-ionescu)) | ||||||
- fix truncating signature on SAS [\#1007](https://github.com/delta-io/delta-rs/pull/1007) ([damiondoesthings](https://github.com/damiondoesthings)) | ||||||
- Loosen version requirement for maturin [\#1005](https://github.com/delta-io/delta-rs/pull/1005) ([gyscos](https://github.com/gyscos)) | ||||||
- Update `.gitignore` and add/remove `Cargo.lock` when appropriate [\#1001](https://github.com/delta-io/delta-rs/pull/1001) ([iajoiner](https://github.com/iajoiner)) | ||||||
- fix: get azure client secret from config [\#981](https://github.com/delta-io/delta-rs/pull/981) ([roeap](https://github.com/roeap)) | ||||||
- feat: check invariants in write command [\#980](https://github.com/delta-io/delta-rs/pull/980) ([roeap](https://github.com/roeap)) | ||||||
- Add a new release github action for Python binding: macos with universal2 wheel [\#976](https://github.com/delta-io/delta-rs/pull/976) ([fvaleye](https://github.com/fvaleye)) | ||||||
- Bump version of the Python binding to 0.6.4 [\#970](https://github.com/delta-io/delta-rs/pull/970) ([fvaleye](https://github.com/fvaleye)) | ||||||
- Handle pandas timestamps [\#958](https://github.com/delta-io/delta-rs/pull/958) ([hayesgb](https://github.com/hayesgb)) | ||||||
- test\(python\): add azure integration tests [\#912](https://github.com/delta-io/delta-rs/pull/912) ([wjones127](https://github.com/wjones127)) | ||||||
- ci: Merge several automatically generated labels [\#1081](https://github.com/delta-io/delta-rs/pull/1081) ([iajoiner](https://github.com/iajoiner)) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
dev-only |
||||||
- Add missing documentation metadata to Cargo.toml [\#1077](https://github.com/delta-io/delta-rs/pull/1077) ([johnbatty](https://github.com/johnbatty)) | ||||||
- Fix typo in delta-inspect [\#1072](https://github.com/delta-io/delta-rs/pull/1072) ([byteink](https://github.com/byteink)) | ||||||
- fix: datafusion predicate pushdown and dependencies [\#1071](https://github.com/delta-io/delta-rs/pull/1071) ([roeap](https://github.com/roeap)) | ||||||
- feat: improve storage location handling [\#1065](https://github.com/delta-io/delta-rs/pull/1065) ([roeap](https://github.com/roeap)) | ||||||
- Expose checkpoint creation for current table state in python [\#1058](https://github.com/delta-io/delta-rs/pull/1058) ([ismoshkov](https://github.com/ismoshkov)) | ||||||
- feat: harmonize and simplify storage configuration [\#1052](https://github.com/delta-io/delta-rs/pull/1052) ([roeap](https://github.com/roeap)) | ||||||
- bump version for dynamodb\_lock crate [\#1047](https://github.com/delta-io/delta-rs/pull/1047) ([houqp](https://github.com/houqp)) | ||||||
- chore: update github actions to latest versions [\#1046](https://github.com/delta-io/delta-rs/pull/1046) ([roeap](https://github.com/roeap)) | ||||||
- refactor: move vacuum command to operations module [\#1045](https://github.com/delta-io/delta-rs/pull/1045) ([roeap](https://github.com/roeap)) | ||||||
- feat: enable passing storage options to Delta table builder via DataFusion's CREATE EXTERNAL TABLE [\#1043](https://github.com/delta-io/delta-rs/pull/1043) ([gruuya](https://github.com/gruuya)) | ||||||
- Add provisional workaround to support CDC \#1039 [\#1042](https://github.com/delta-io/delta-rs/pull/1042) ([Fazzani](https://github.com/Fazzani)) | ||||||
- fix: azure sas key url encoding [\#1036](https://github.com/delta-io/delta-rs/pull/1036) ([roeap](https://github.com/roeap)) | ||||||
- chore: fix new lints from new cargo [\#1034](https://github.com/delta-io/delta-rs/pull/1034) ([wjones127](https://github.com/wjones127)) | ||||||
- feat: expose function to get table of add actions [\#1033](https://github.com/delta-io/delta-rs/pull/1033) ([wjones127](https://github.com/wjones127)) | ||||||
- refactor\(api!\): refactor Python APIs for getting file list [\#1032](https://github.com/delta-io/delta-rs/pull/1032) ([wjones127](https://github.com/wjones127)) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Python-only |
||||||
- Fix to support UTC timezone [\#1022](https://github.com/delta-io/delta-rs/pull/1022) ([andrei-ionescu](https://github.com/andrei-ionescu)) | ||||||
- feat: make `DeltaStorageHandler` pickle serializable [\#1016](https://github.com/delta-io/delta-rs/pull/1016) ([roeap](https://github.com/roeap)) | ||||||
- feat: clean up dependencies and feature flags [\#1014](https://github.com/delta-io/delta-rs/pull/1014) ([roeap](https://github.com/roeap)) | ||||||
- test\(python\): make sure integration tests wait for services to start [\#979](https://github.com/delta-io/delta-rs/pull/979) ([wjones127](https://github.com/wjones127)) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
dev-facing only. |
||||||
- test\(python\): add read / write benchmarks [\#933](https://github.com/delta-io/delta-rs/pull/933) ([wjones127](https://github.com/wjones127)) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
Python-only |
||||||
|
||||||
|
||||||
|
||||||
|
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,6 +1,6 @@ | ||
[package] | ||
name = "delta-inspect" | ||
version = "0.6.0" | ||
version = "0.7.0" | ||
authors = ["Qingping Hou <[email protected]>"] | ||
homepage = "https://github.com/delta-io/delta.rs" | ||
license = "Apache-2.0" | ||
|
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,6 +1,6 @@ | ||
[package] | ||
name = "deltalake" | ||
version = "0.6.0" | ||
version = "0.7.0" | ||
rust-version = "1.64" | ||
authors = ["Qingping Hou <[email protected]>"] | ||
homepage = "https://github.com/delta-io/delta.rs" | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think these apply to the rust release, do they?