Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error: Copy spanning locations and/or storage classes could not complete within 30 seconds. #31

Open
bwalrond opened this issue Jun 10, 2020 · 3 comments

Comments

@bwalrond
Copy link

Hello,

I'm getting the following error message on a client.cp() operation ...

Copy spanning locations and/or storage classes could not complete within 30 seconds. Please use the Rewrite method (https://cloud.google.com/storage/docs/json_api/v1/objects/rewrite) instead.

Is copying between buckets in different regions and/or storage classes supported?

@mristin
Copy link
Collaborator

mristin commented Jun 10, 2020

Hi @bwalrond ,
While we never tried inter-region copying at Parquery since our data resides all in the same region, inter-region copying should work. Copying between buckets indeed has worked without problems so far.

The error message implies that copying takes too long (rather than it is not supported). Have you tried gsutil -- does it complain there as well?

@bwalrond
Copy link
Author

gsutil doesn't complain. The copy_blob method won't work in these cases. According to the error message, the rewrite method is required.

@mristin
Copy link
Collaborator

mristin commented Jun 10, 2020

@bwalrond I see. It would need a special switch, rewrite=True/False.

As I don't have access to Google cloud anymore (I changed my job), could you create two buckets and a big file and then grant me permissions so that I can develop against them and reproduce the error?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants