[Python][C++] Conda installs of pyarrow pull in snappy 1.2.0, resulting in undefined symbol _ZN6snappy11RawCompressEPKcmPcPm #41058
Labels
Comments
4 tasks
|
See conda-forge/snappy-feedstock#35, though I am not sure if it will be faster to mark the new snappy package as broken, or if the pyarrow feedstock needs to pin the version of snappy |
jorisvandenbossche
changed the title
|
The snappy 1.2.0 package has been marked as broken, and people are working on a correct update. But that should mean that creating a new fresh environment should work again now. |
3 tasks
|
Thanks for marking the build as broken @jorisvandenbossche! |
|
I see this error also in the new build that is not marked as broken: Traceback:/usr/share/miniconda3/envs/modin/lib/python3.9/site-packages/ray/air/config.py:17: in <module>
import pyarrow.fs
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
"""
PyArrow is the python implementation of Apache Arrow.
Apache Arrow is a cross-language development platform for in-memory data.
It specifies a standardized language-independent columnar memory format for
flat and hierarchical data, organized for efficient analytic operations on
modern hardware. It also provides computational libraries and zero-copy
streaming messaging and interprocess communication.
For more information see the official page at https://arrow.apache.org/
"""
import gc as _gc
import importlib as _importlib
import os as _os
import platform as _platform
import sys as _sys
import warnings as _warnings
try:
from ._generated_version import version as __version__
except ImportError:
# Package is not installed, parse git tag at runtime
try:
import setuptools_scm
# Code duplicated from setup.py to avoid a dependency on each other
def parse_git(root, **kwargs):
"""
Parse function for setuptools_scm that ignores tags for non-C++
subprojects, e.g. apache-arrow-js-XXX tags.
"""
from setuptools_scm.git import parse
kwargs['describe_command'] = \
"git describe --dirty --tags --long --match 'apache-arrow-[0-9]*.*'"
return parse(root, **kwargs)
__version__ = setuptools_scm.get_version('../',
parse=parse_git)
except ImportError:
__version__ = None
# ARROW-8684: Disable GC while initializing Cython extension module,
# to workaround Cython bug in https://github.com/cython/cython/issues/3603
_gc_enabled = _gc.isenabled()
_gc.disable()
> import pyarrow.lib as _lib
E ImportError: /usr/share/miniconda3/envs/modin/lib/python3.9/site-packages/pyarrow/../../.././liborc.so: undefined symbol: _ZN6snappy11RawCompressEPKcmPcPm
/usr/share/miniconda3/envs/modin/lib/python3.9/site-packages/pyarrow/__init__.py:65: ImportError |
|
I see same error also |
|
See conda-forge/snappy-feedstock#35 (comment). Should be resolved quickly once the change has been picked up by the CDN |
3 tasks
|
Still getting error _undefined symbol ZN6snappy11RawCompressEPKcmPcPm, is this still a CDN rollout issue, any workaround? @jorisvandenbossche . Thanks |
|
@corticalstack can you show the output of |
|
@jorisvandenbossche just built env now, still same symbol issue, conda env created with conda install --no-cache |
|
Ah, you have installed an older version of pyarrow, I was testing with pyarrow 15.0. Wondering if that might be related (although it still shouldn't happen) |
|
Tried with Can you show the full command that you used to recreate the fresh env? Do you have other libraries / constraints that you are also installing? |
|
|
@jorisvandenbossche thanks to your hints'I've just updated pyarrow with below, and now all resolved. Thanks so much for your support! |
Resolved too! Thanks for your post! |
3 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Describe the bug, including details regarding any error messages, version, and platform.
Hopefully this is the right place to raise this issue! When creating new environments, I've been seeing that installation of pyarrow from conda-forge pulls in the recently released
snappy=1.2.0, which results in a missing symbol_ZN6snappy11RawCompressEPKcmPcPmin both Mac and Linux. Downgrading to snappy 1.1.10 fixes the issue.Reproducing on linux (I am seeing this across Pythons 3.9 to 3.12):
Reproducing on Mac:
Component(s)
Python
The text was updated successfully, but these errors were encountered: