Can't install on linux/arm64 with docker node #2482

gpetrov · 2020-12-12T19:37:54Z

Trying to run a simple Dockerfile to install node together with sharp on linux/arm64 fails.

FROM node:14-slim

RUN npm i detect-libc

RUN node -e "console.log('platform=' + process.platform);console.log('arch='+process.arch);console.log(require('detect-libc'))"

RUN npm i sharp

when ran on arm64 - it produces:

> [4/4] RUN npm i sharp:                                                                                                                                                                                     
#8 3.664                                                                                                                                                                                                      
#8 3.664 > [email protected] install /node_modules/sharp                                                                                                                                                           
#8 3.664 > (node install/libvips && node install/dll-copy && prebuild-install) || (node-gyp rebuild && node install/dll-copy)                                                                                 
#8 3.664                                                                                                                                                                                                      
#8 3.736 ERR! sharp Use with glibc 2.24 requires manual installation of libvips >= 8.10.0
#8 3.736 info sharp Attempting to build from source via node-gyp but this may fail due to the above error
#8 3.736 info sharp Please see https://sharp.pixelplumbing.com/install for required dependencies
#8 3.789 gyp ERR! find Python

while the arch checks gives:

platform=linux
arch=arm64
{
  GLIBC: 'glibc',
  MUSL: 'musl',
  family: 'glibc',
  version: '2.24',
  method: 'getconf',
  isNonGlibcLinux: false
}

There are already prebuild libvips images for arm64v8 - why aren't they used?

Running the same on Windows 10, goes actually just fine. While the arch checks is there pretty much the same:

Step 3/4 : RUN node -e "console.log('platform=' + process.platform);console.log('arch='+process.arch);console.log(require('detect-libc'))"
 ---> Running in 4c7db816aa17
platform=linux
arch=x64
{
  GLIBC: 'glibc',
  MUSL: 'musl',
  family: 'glibc',
  version: '2.24',
  method: 'getconf',
  isNonGlibcLinux: false
}
Removing intermediate container 4c7db816aa17
 ---> 68c8b2d9c3f4
Step 4/4 : RUN npm i sharp
 ---> Running in a617bbed12e4

> [email protected] install /node_modules/sharp
> (node install/libvips && node install/dll-copy && prebuild-install) || (node-gyp rebuild && node install/dll-copy)

info sharp Downloading https://github.com/lovell/sharp-libvips/releases/download/v8.10.0/libvips-8.10.0-linux-x64.tar.br

+ [email protected]
added 73 packages from 173 contributors and audited 74 packages in 7.417s

@lovell I think the glibc check is a bit too hard and doesn't check for prebuild images first.

The text was updated successfully, but these errors were encountered:

lovell · 2020-12-12T20:22:06Z

Hi, the salient part is:

ERR! sharp Use with glibc 2.24 requires manual installation of libvips >= 8.10.0

This is documented at https://sharp.pixelplumbing.com/install#prebuilt-binaries

Ready-compiled sharp and libvips binaries are provided for use with Node.js v10+ on the most common platforms:
...
Linux ARM64 (glibc >= 2.29)

The following platforms require compilation of both libvips and sharp from source:
...
Linux ARM64 (glibc <= 2.28, musl)

gpetrov · 2020-12-12T20:33:44Z

But there is no need to compile anything...?

docker image is linux/arm64 and there is a prebuild binary available.

it runs all fine in linux/x86 - while there is the same glibc 2.24

or does node needs to change all their official docker image to include glibc 2.29+ ?

lovell · 2020-12-12T20:41:19Z

Please see lovell/sharp-libvips@2e4202d for a discussion about why the prebuilt arm64 binaries currently require glibc 2.29+

gpetrov · 2020-12-12T20:57:57Z

Thanks - make sense now. Hope node updates their base images. However even latest buster image is still with glibc 2.28

Maybe you can consider to support musl? Trying docker node:14-alpine, produced:

> [email protected] install /node_modules/sharp                                                                                                                                                           
#8 3.650 > (node install/libvips && node install/dll-copy && prebuild-install) || (node-gyp rebuild && node install/dll-copy)                                                                                 
#8 3.650                                                                                                                                                                                                      
#8 3.758 info sharp Downloading https://github.com/lovell/sharp-libvips/releases/download/v8.10.0/libvips-8.10.0-linuxmusl-arm64v8.tar.br
#8 4.032 ERR! sharp Prebuilt libvips 8.10.0 binaries are not yet available for linuxmusl-arm64v8

gpetrov · 2020-12-13T11:07:32Z

Btw the Linux/arm64 is running natively on the new Apple Silicon M1 arm64 with the upcoming Docker Desktop version for the M1.

So it is essential to have the right binaries ready for easy docker deploy @lovell

gpetrov · 2020-12-18T12:39:34Z

can you clarify @lovell that you need GLIBC 2.29+ - just to run libvips? Not only to compile it?

lovell · 2020-12-18T13:05:34Z

As you hopefully saw from the discussion in lovell/sharp-libvips@2e4202d, gcc 9.2.0+ is required to compile libvips on arm64 without introducing compiler bugs. The oldest OS that provides gcc 9.2.0 is Debian 11, which also provides and therefore requires glibc 2.29.

gpetrov · 2020-12-18T13:20:28Z

Yes I saw that - but I don't need to compile libvips - the precompiled binary from sharp-libvips for arm64v8 is just fine!
https://github.com/lovell/sharp-libvips/releases/download/v8.10.0/libvips-8.10.0-linux-arm64v8.tar.gz

But your check for glibc version prevents it from being downloaded....

lovell · 2020-12-18T13:42:55Z

A binary compiled on Debian 11 will require glibc 2.29+ at runtime.

gpetrov · 2020-12-18T13:53:30Z

ok then we will have to wait for node to be available on debian bullseye ... it might take a while.

maybe there is a better hope for node-alpine with musl?

lovell · 2020-12-18T14:51:06Z

we will have to wait for node to be available on debian bullseye

https://packages.debian.org/bullseye/nodejs

gpetrov · 2020-12-18T15:24:53Z

I mean the official docker node image:

https://hub.docker.com/_/node

It doesn't have bullseye yet, so no docker node installation under arm64 can run sharp ...

gpetrov · 2020-12-18T15:26:12Z

See also:

nodejs/docker-node#1415

lovell · 2021-01-06T13:56:40Z

Let's track this at lovell/sharp-libvips#72

gpetrov · 2021-03-09T14:36:08Z

@lovell are the node-gyp checks already adjusted for the new live builds? I'm still getting errors of not found binaries.
Also on the regular linux/arm64 - the gcc version check is still in place:

Using node-14:slim (GCC)

#13 19.60 npm ERR! path /opt/node_app/node_modules/sharp
#13 19.60 npm ERR! command failed
#13 19.60 npm ERR! command sh -c (node install/libvips && node install/dll-copy && prebuild-install) || (node-gyp rebuild && node install/dll-copy)
#13 19.60 npm ERR! ERR! sharp Use with glibc 2.24 requires manual installation of libvips >= 8.10.5
#13 19.60 npm ERR! info sharp Attempting to build from source via node-gyp but this may fail due to the above error

and using node-14:alpine (MUSL)

#12 19.17 npm ERR! path /opt/node_app/node_modules/sharp
#12 19.17 npm ERR! command failed
#12 19.17 npm ERR! command sh -c (node install/libvips && node install/dll-copy && prebuild-install) || (node-gyp rebuild && node install/dll-copy)
#12 19.17 npm ERR! info sharp Downloading https://github.com/lovell/sharp-libvips/releases/download/v8.10.5/libvips-8.10.5-linuxmusl-arm64v8.tar.br
#12 19.17 npm ERR! ERR! sharp Prebuilt libvips 8.10.5 binaries are not yet available for linuxmusl-arm64v8
#12 19.17 npm ERR! info sharp Attempting to build from source via node-gyp but this may fail due to the above error

lovell · 2021-03-09T15:00:14Z

@gpetrov The linuxmusl-arm64v8 binaries will be made available from sharp v0.28.0+ and will require musl >= 1.1.24 (the linux-arm64v8 binaries will still require glibc >= 2.29).

gpetrov · 2021-03-09T15:15:59Z

ah bummer 😃 well lets hope 0.28 come soon then.

Yes node-14:slim uses unfortunately Debian Buster with glibc 2.28, so no much luck there. I thought you were able to lower that requirement with cross compiling?

Lets hope for the node-14:alpine that can use Alpine 3.13 having musl 1.2

lovell · 2021-03-09T15:27:12Z

Debian Buster with glibc 2.28, so no much luck there. I thought you were able to lower that requirement with cross compiling?

No, sorry, I did some more digging and gcc 9 is required - see lovell/sharp-libvips#86 (comment)

gpetrov · 2021-03-09T15:32:26Z

Correction node-14:slim uses even Debian Stretch with glibc 2.24
We can target specific node-14:buster-slim that uses Debian Buster with glibc 2.28 but that is the max for now as described in: nodejs/docker-node#1415

…pixelplumbing.com/install. More details: lovell/sharp#2482

jeromecovington · 2023-02-28T01:13:32Z

I'm seeing something similar today using the ubuntu-latest image provided by GitHub actions. I have seen the error when installing both with Node.js versions 16.x and 18.x. The tasks usually complete with a successful install after I re-run them. This issue was the closest thing I could find to my issue, so I am appending my comments to it.

sharp: Installation error: Prebuilt libvips 8.13.3 binaries are not yet available for linux-x64

lovell · 2023-02-28T07:24:42Z

@jeromecovington Please open a new installation issue and answer all of the questions if you still require help.

gpetrov added the installation label Dec 12, 2020

lovell closed this as completed Jan 6, 2021

lukasmoellerch mentioned this issue Jan 31, 2021

Build arm64 images gregordr/ImageStore#7

Closed

bpatrik added a commit to bpatrik/pigallery2 that referenced this issue Apr 18, 2021

downgrading sharp to 0.23.4 as 0.28.1 fails build, see https://sharp.…

e5895ff

…pixelplumbing.com/install. More details: lovell/sharp#2482

Izayda mentioned this issue Jun 27, 2021

Some problem with sharp on clean cloned repo vendure-ecommerce/vendure-docker-compose#5

Open

benkaiser mentioned this issue Jul 18, 2021

docker-compose build fails on Apple Silicon (M1) singlelink-co/Singlelink#179

Closed

edrichhans mentioned this issue Jul 27, 2021

How to use in docker environment? #2815

Closed

gaeldestrem mentioned this issue Aug 31, 2021

Expérimentation perfs : Gridsome MTES-MCT/resorption-bidonvilles#273

Closed

5 tasks

CN91 mentioned this issue Jun 17, 2022

In need of help / ideas on installing sharp on cflinuxfs3 - stack #3269

Closed

lmarini mentioned this issue Jun 27, 2022

linux/arm64 frontend github action fails because of sharp dependency clowder-framework/clowder2#34

Closed

Repository owner locked and limited conversation to collaborators Feb 28, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Can't install on linux/arm64 with docker node #2482

Can't install on linux/arm64 with docker node #2482

gpetrov commented Dec 12, 2020

lovell commented Dec 12, 2020

gpetrov commented Dec 12, 2020

lovell commented Dec 12, 2020

gpetrov commented Dec 12, 2020 •

edited

Loading

gpetrov commented Dec 13, 2020

gpetrov commented Dec 18, 2020

lovell commented Dec 18, 2020

gpetrov commented Dec 18, 2020 •

edited

Loading

lovell commented Dec 18, 2020

gpetrov commented Dec 18, 2020

lovell commented Dec 18, 2020

gpetrov commented Dec 18, 2020

gpetrov commented Dec 18, 2020

lovell commented Jan 6, 2021

gpetrov commented Mar 9, 2021

lovell commented Mar 9, 2021

gpetrov commented Mar 9, 2021

lovell commented Mar 9, 2021

gpetrov commented Mar 9, 2021

jeromecovington commented Feb 28, 2023

lovell commented Feb 28, 2023

Can't install on linux/arm64 with docker node #2482

Can't install on linux/arm64 with docker node #2482

Comments

gpetrov commented Dec 12, 2020

lovell commented Dec 12, 2020

gpetrov commented Dec 12, 2020

lovell commented Dec 12, 2020

gpetrov commented Dec 12, 2020 • edited Loading

gpetrov commented Dec 13, 2020

gpetrov commented Dec 18, 2020

lovell commented Dec 18, 2020

gpetrov commented Dec 18, 2020 • edited Loading

lovell commented Dec 18, 2020

gpetrov commented Dec 18, 2020

lovell commented Dec 18, 2020

gpetrov commented Dec 18, 2020

gpetrov commented Dec 18, 2020

lovell commented Jan 6, 2021

gpetrov commented Mar 9, 2021

lovell commented Mar 9, 2021

gpetrov commented Mar 9, 2021

lovell commented Mar 9, 2021

gpetrov commented Mar 9, 2021

jeromecovington commented Feb 28, 2023

lovell commented Feb 28, 2023

gpetrov commented Dec 12, 2020 •

edited

Loading

gpetrov commented Dec 18, 2020 •

edited

Loading