Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ImportError: deltalake/_internal.abi3.so: cannot allocate memory in static TLS block #1380

Closed
bitsofinfo opened this issue May 19, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@bitsofinfo
Copy link

deltars 0.9.0 & python:3.11.3-slim-buster

This program runs fine on osx, but when running in a python:3.11.3-slim-buster image... on import. No idea what to do here.

  File "/opt/scripts/main.py", line 17, in <module>
    from core.threads import *
  File "/opt/scripts/core/threads.py", line 39, in <module>
    from core.fugue.fugue import *
  File "/opt/scripts/core/fugue/fugue.py", line 20, in <module>
    import deltalake
  File "/opt/venv/lib/python3.11/site-packages/deltalake/__init__.py", line 1, in <module>
    from ._internal import PyDeltaTableError, RawDeltaTable, __version__, rust_core_version
ImportError: /opt/venv/lib/python3.11/site-packages/deltalake/_internal.abi3.so: cannot allocate memory in static TLS block
@bitsofinfo bitsofinfo added the bug Something isn't working label May 19, 2023
@wjones127
Copy link
Collaborator

Did you build the wheel yourself?

@bitsofinfo
Copy link
Author

no just pip install w/ reqs file referencing deltalake

@wjones127
Copy link
Collaborator

I was not able to reproduce with:

docker run -it python:3.11.3-slim-buster bash

And then:

pip install deltalake
python -c "import deltalake"

It sounds like "TLS block" is "thread local storage block", and has sometimes had to do with jemalloc. I'm not sure how it could come from our library.

Do you have more specific steps for reproduction?

@rtyler
Copy link
Member

rtyler commented Sep 20, 2023

I'm going through and cleaning up stale looking issues. I haven't seen this pop up anywhere else, but please re-open with reproduction steps if this is still affecting you @bitsofinfo

@rtyler rtyler closed this as completed Sep 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants