Wheel support for linux aarch64 #1782
Comments
|
Gentle Reminder!!! |
|
gentle but firm reminder |
|
Looking back at this: in general I'm not planning on supporting / distributing wheels for The above is triggered on each commit, and it's quite costly both in terms of build time and maintenance, especially when we get close to a release (I already removed the PYPY matrix because of this). Adding yet another platform/arch (also sort of exotic in this case) to the matrix, make sure it works, fix tests, guarantee that the distributed wheels work etc. is extra work I'm unwilling to take to be honest. |
|
I'd like to point out that ARM is here to stay, Apple is releasing more and more devices with ARM processors and I'm struggling to find a workaround |
Change the build.yml to add aarch64/arm64 builds Closes giampaolo#1782, closes giampaolo#1945, closes giampaolo#1954, closes giampaolo#1966, closes giampaolo#1972, closes giampaolo#2090 Signed-off-by: George Marshall <[email protected]>
|
+1. Affecting YOLOv5 Docker builds |
|
With graviton 1/2/3 and Ampere altra becoming standard on mainstream clouds and with aarch64 being the de-facto android architecture of choice. I vote +1. Maybe it's time to put i686 to rest in lieu? |
Summary: An issue was encountered that prevented build of the `pce_deployment` image against the aarch64/arm64 platform. Building the Docker image against aarch64 fails due to some missing build dependencies: `gcc`, `python3-dev`. This is because a project dependency, the `psutil` wheel, is not distributed with the aarch64 build and instead it is compiled from source (see [Wheel support for linux aarch64 · Issue facebookresearch#1782 · giampaolo/psutil · GitHub](giampaolo/psutil#1782)). This change updates the corresponding Dockerfile to install the dependencies required to compile the wheel. Reviewed By: ajaybhargavb Differential Revision: D38541052 fbshipit-source-id: 9ce75bd3016de062ba601649849840f85d881a6e
…1448) Summary: Pull Request resolved: #1448 An issue was encountered that prevented build of the `pce_deployment` image against the aarch64/arm64 platform. Building the Docker image against aarch64 fails due to some missing build dependencies: `gcc`, `python3-dev`. This is because a project dependency, the `psutil` wheel, is not distributed with the aarch64 build and instead it is compiled from source (see [Wheel support for linux aarch64 · Issue #1782 · giampaolo/psutil · GitHub](giampaolo/psutil#1782)). This change updates the corresponding Dockerfile to install the dependencies required to compile the wheel. Reviewed By: ajaybhargavb Differential Revision: D38541052 fbshipit-source-id: 18b893729f705317b3f3d7ee9ddeff14f1ec5002
|
One more vote to add support of aarch64. It becomes more and more popular with Apple's M1/2 and in major cloud providers including AWS, GCP and Azure. |
|
AWS Panorama is built on it too. |
|
NVIDIA Jetson Nano B01 uses aarch64. We planned to use anomalib. psutil can't be installed on aarch64, affecting anomalib. |
|
why is this closed? |
|
In https://pypi.org/project/psutil/5.9.4/#files I see From that build log: In that environment pip was happy with selecting the manylinux (docs here) From the build log excerpt above it's kind of apparent that we want a manylinux aarch64 wheel for psutil :). |
|
And building it manually results in an error: |
|
Not sure why this was closed as complete, it's not a thing yet as far as I can tell. Would be nice to be able to deploy arm64 Lambdas that use psutil. |
|
@giampaolo reopen this please |
|
Same issue here, Dockerfile with a specific arm64/v8 arch not build because of psutil. Dockerfile build error 109.8 Building wheels for collected packages: psutil
109.8 Building wheel for psutil (pyproject.toml): started
112.2 Building wheel for psutil (pyproject.toml): finished with status 'error'
112.3 error: subprocess-exited-with-error
112.3
112.3 × Building wheel for psutil (pyproject.toml) did not run successfully.
112.3 │ exit code: 1
112.3 ╰─> [43 lines of output]
112.3 running bdist_wheel
112.3 running build
112.3 running build_py
112.3 creating build
112.3 creating build/lib.linux-aarch64-cpython-310
112.3 creating build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_pslinux.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_common.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_pssunos.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_psosx.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_compat.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_pswindows.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_psaix.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/__init__.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_psbsd.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 copying psutil/_psposix.py -> build/lib.linux-aarch64-cpython-310/psutil
112.3 creating build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_process.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_osx.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_linux.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_bsd.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_memleaks.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_testutils.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_system.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_misc.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_contracts.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_windows.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/__main__.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_posix.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_sunos.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/__init__.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_unicode.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/runner.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_connections.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 copying psutil/tests/test_aix.py -> build/lib.linux-aarch64-cpython-310/psutil/tests
112.3 running build_ext
112.3 building 'psutil._psutil_linux' extension
112.3 creating build/temp.linux-aarch64-cpython-310
112.3 creating build/temp.linux-aarch64-cpython-310/psutil
112.3 gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -fPIC -DPSUTIL_POSIX=1 -DPSUTIL_SIZEOF_PID_T=4 -DPSUTIL_VERSION=596 -DPy_LIMITED_API=0x03060000 -DPSUTIL_ETHTOOL_MISSING_TYPES=1 -DPSUTIL_LINUX=1 -I/usr/local/include/python3.10 -c psutil/_psutil_common.c -o build/temp.linux-aarch64-cpython-310/psutil/_psutil_common.o
112.3 psutil could not be installed from sources because gcc is not installed. Try running:
112.3 sudo apt-get install gcc python3-dev
112.3 error: command 'gcc' failed: No such file or directory
112.3 [end of output]
112.3
112.3 note: This error originates from a subprocess, and is likely not a problem with pip.
112.3 ERROR: Failed building wheel for psutil
112.3 Failed to build psutil
112.3 ERROR: Could not build wheels for psutil, which is required to install pyproject.toml-based projects |
|
For those still looking for a solution. This worked for me on a gravaton based EC2 instance: sudo yum install gcc python3-devel https://github.com/giampaolo/psutil/blob/master/INSTALL.rst |
|
aarch64 wheels are now published on PYPI as of psutil 6.0.0. |
Summary
Installing psutil on aarch64 via pip using command "pip3 install psutil" tries to build wheel from source code
Problem description
psutil don't have wheel for aarch64 on PyPI repository. So, while installing psutil via pip on aarch64, pip builds wheel for same resulting in it takes more time to install psutil. Making wheel available for aarch64 will benefit aarch64 users by minimizing psutil installation time.
Expected Output
Pip should be able to download psutil wheel from PyPI repository rather than building it from source code.
@psutil-taem, please let me know if I can help you building wheel/uploading to PyPI repository. I am curious to make psutil wheel available for aarch64. It will be a great opportunity for me to work with you.
The text was updated successfully, but these errors were encountered: