Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Python] when pyArrow S3FileSystem support force_virtual_addressing in new release #40506

Closed
kadisi opened this issue Mar 13, 2024 · 2 comments
Closed
Labels
Component: Python Type: usage Issue is a user question

Comments

@kadisi
Copy link

kadisi commented Mar 13, 2024

Describe the usage question you have. Please include as many useful details as possible.

I found that the latest pyarrow code already supports the force_virtual_addressing parameter but not in releae 1.15.2.

from @yo1956 pr: #39819

and we test it is ok for other S3 compatible storage.

May I ask in which Release this feature will be released and when? We urgently need this feature to access Alibaba Cloud oss object storage, and do not want to recompile the pyarrow package.

the Alibaba Cloud OSS is an AWS S3 compatible storage: only support virtual hosted style to access.

if we use pyarrow S3FileSystem to access Alibaba Cloud oss , we need force_virtual_addressing parameter.

@chenk008 #38135

Component(s)

Python

@kadisi kadisi added the Type: usage Issue is a user question label Mar 13, 2024
@jorisvandenbossche jorisvandenbossche changed the title when pyArrow S3FileSystem support force_virtual_addressing in new release [Python] when pyArrow S3FileSystem support force_virtual_addressing in new release Mar 13, 2024
@jorisvandenbossche
Copy link
Member

It will be released in the next major release, which will be 16.0 (targetted for second half of April).
(you can also see the milestone on the closed issue #39779)

If you want to test it earlier, you can try to use the nightly packages: https://arrow.apache.org/docs/dev/developers/python.html#installing-nightly-packages

@kadisi
Copy link
Author

kadisi commented Mar 14, 2024

It will be released in the next major release, which will be 16.0 (targetted for second half of April). (you can also see the milestone on the closed issue #39779)

If you want to test it earlier, you can try to use the nightly packages: https://arrow.apache.org/docs/dev/developers/python.html#installing-nightly-packages

@jorisvandenbossche ok, thank you. i have tested it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Component: Python Type: usage Issue is a user question
Projects
None yet
Development

No branches or pull requests

2 participants