Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"builder error for url" when creating an instance of a DeltaTable which is located in an azurite blob storage #2815

Closed
pascalrosenberger opened this issue Aug 22, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@pascalrosenberger
Copy link

Environment

Delta-rs version: 0.19.1

Environment:

  • Cloud provider: Azurite
  • OS: Mac OS

Bug

What happened:
When trying to create an instance of a DeltaTable object, I get following error:
"Generic MicrosoftAzure error: Error after 0 retries in 9.625µs, max_retries:10, retry_timeout:180s, source:builder error for url (http://localhost:10000/landing-zone-files/produktfrageboegenLandingZone/0.0.1/eQMAllgemeineArtikelInfos/_delta_log/_last_checkpoint)"

What you expected to happen:
I would expect that the instance of the DataTable has been created and I am able to query or write into the table.

How to reproduce it:
I use following code to create an instance of a DeltaTable:

storage_options = {
                "endpoint": "http://localhost:10000",
                 "account_name": "devstoreaccount1",
                "account_key": "ACCOUNT_KEY",
                "default_endpoints_protocol": "http"
            }
delta_table = DeltaTable(f"az://LandingZone/DataContractName/0.0.1/ModelName", storage_options=storage_options)
@pascalrosenberger pascalrosenberger added the bug Something isn't working label Aug 22, 2024
@g0di
Copy link

g0di commented Sep 23, 2024

Hello, I found out that you actually have to pass a dedicated option for using an Azurite emulated storage account container.

You can do it either from environment variables

AZURE_STORAGE_USE_EMULATOR="1"

Or directly in source code

storage_options = { "azure_storage_use_emulator": "1" }
delta_table = DeltaTable(f"az://LandingZone/DataContractName/0.0.1/ModelName", storage_options=storage_options)

@ion-elgreco ion-elgreco closed this as not planned Won't fix, can't repro, duplicate, stale Sep 23, 2024
@delta-io delta-io locked and limited conversation to collaborators Sep 23, 2024
@rtyler rtyler converted this issue into discussion #2901 Sep 23, 2024

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants