Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python: fix: fix minimal test and bump minimum pyarrow version #733

Merged
merged 3 commits into from
Aug 9, 2022

Conversation

wjones127
Copy link
Collaborator

@wjones127 wjones127 commented Aug 9, 2022

Description

I thought we were testing with pyarrow==4, but turns out maturin develop silently upgrades all dependencies 🤦.

It seems that our actual minimum version is pyarrow 7.0.0 (released in February 2022), which was mostly pushed up by my work on the writer. This PR pushes up the minimum version. If that feels to aggressive, I could refactor so that only the writer module requires this more recent version.

Related Issue(s)

Documentation

@wjones127 wjones127 changed the title Python: fix: Actually test on pyarrow==4 Python: fix: fix minimal test and bump minimum pyarrow version Aug 9, 2022
Copy link
Member

@houqp houqp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the version bump is fine. We can revisit this if we start to get complains from our users :) At the current stage of the project, I think it's better to optimize for speed of iteration, which ultimately will benefit our users more.

@wjones127 wjones127 marked this pull request as ready for review August 9, 2022 14:16
@wjones127 wjones127 merged commit 6d69105 into delta-io:main Aug 9, 2022
@wjones127 wjones127 deleted the pyarrow-4 branch August 9, 2022 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants