Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump Apache Arrow to 10.0.0 #1764

Merged
merged 4 commits into from
Dec 13, 2022
Merged

Bump Apache Arrow to 10.0.0 #1764

merged 4 commits into from
Dec 13, 2022

Conversation

Yicong-Huang
Copy link
Collaborator

@Yicong-Huang Yicong-Huang commented Dec 8, 2022

This PR bumps Apache Arrow version from 9.0.0 to 10.0.0.

Main changes related to PyAmber:

Java/Scala side:

  • JDBC Driver for Arrow Flight SQL (13800)
  • Initial implementation of immutable Table API (14316)
  • Substrait, transaction, cancellation for Flight SQL (13492)
  • Read Arrow IPC, CSV, and ORC files by NativeDatasetFactory (13811, 13973, 14182)
  • Add utility to bind Arrow data to JDBC parameters (13589)

Python side:

  • The batch_readahead and fragment_readahead arguments for scanning Datasets are exposed in Python (ARROW-17299).
  • ExtensionArrays can now be created from a storage array through the pa.array(..) constructor (ARROW-17834).
  • Converting ListArrays containing ExtensionArray values to numpy or pandas works by falling back to the storage array (ARROW-17813).
  • Casting Tables to a new schema now honors the nullability flag in the target schema (ARROW-16651).

@Yicong-Huang Yicong-Huang requested a review from zuozhiw December 8, 2022 08:49
@Yicong-Huang Yicong-Huang self-assigned this Dec 8, 2022
@Yicong-Huang Yicong-Huang added the dependencies Pull requests that update a dependency file label Dec 8, 2022
@Yicong-Huang Yicong-Huang merged commit 2ff37bd into master Dec 13, 2022
@Yicong-Huang Yicong-Huang deleted the yicong-update-arrow-10 branch December 13, 2022 04:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants