Docker Build Failng - due to checksum issues.

[surapuramakhil]

Description

Clone Apache-Superset and run docker compose up

Surprising you can't reproduce this issue on interactive docker shell, it is only happening on docker build.

This is happening only on current versions of docker, older versions worked fine, I needed to downgrade to version 26.0.0 from 27.2.0

Reproduce

Clone Apache-Superset

run docker compose up

Expected behavior

No response

docker version

(.venv) (base) akhilsurapuram@Akhils-MacBook-Pro superset % docker version
Client:
Version: 27.2.0
API version: 1.47
Go version: go1.21.13
Git commit: 3ab4256
Built: Tue Aug 27 14:14:45 2024
OS/Arch: darwin/arm64
Context: desktop-linux

Server: Docker Desktop 4.34.3 (170107)
Engine:
Version: 27.2.0
API version: 1.47 (minimum version 1.24)
Go version: go1.21.13
Git commit: 3ab5c7d
Built: Tue Aug 27 14:15:41 2024
OS/Arch: linux/arm64
Experimental: false
containerd:
Version: 1.7.20
GitCommit: 8fc6bcff51318944179630522a095cc9dbf9f353
runc:
Version: 1.1.13
GitCommit: v1.1.13-0-g58aa920
docker-init:
Version: 0.19.0
GitCommit: de40ad0

docker info

(.venv) (base) akhilsurapuram@Akhils-MacBook-Pro superset % docker version
Client:
Version: 27.2.0
API version: 1.47
Go version: go1.21.13
Git commit: 3ab4256
Built: Tue Aug 27 14:14:45 2024
OS/Arch: darwin/arm64
Context: desktop-linux

Server: Docker Desktop 4.34.3 (170107)
Engine:
Version: 27.2.0
API version: 1.47 (minimum version 1.24)
Go version: go1.21.13
Git commit: 3ab5c7d
Built: Tue Aug 27 14:15:41 2024
OS/Arch: linux/arm64
Experimental: false
containerd:
Version: 1.7.20
GitCommit: 8fc6bcff51318944179630522a095cc9dbf9f353
runc:
Version: 1.1.13
GitCommit: v1.1.13-0-g58aa920
docker-init:
Version: 0.19.0
GitCommit: de40ad0
(.venv) (base) akhilsurapuram@Akhils-MacBook-Pro superset % docker info
Client:
Version: 27.2.0
Context: desktop-linux
Debug Mode: false
Plugins:
buildx: Docker Buildx (Docker Inc.)
Version: v0.16.2-desktop.1
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-buildx
compose: Docker Compose (Docker Inc.)
Version: v2.29.2-desktop.2
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-compose
debug: Get a shell into any image or container (Docker Inc.)
Version: 0.0.34
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-debug
desktop: Docker Desktop commands (Alpha) (Docker Inc.)
Version: v0.0.15
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-desktop
dev: Docker Dev Environments (Docker Inc.)
Version: v0.1.2
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-dev
extension: Manages Docker extensions (Docker Inc.)
Version: v0.2.25
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-extension
feedback: Provide feedback, right in your terminal! (Docker Inc.)
Version: v1.0.5
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-feedback
init: Creates Docker-related starter files for your project (Docker Inc.)
Version: v1.3.0
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-init
sbom: View the packaged-based Software Bill Of Materials (SBOM) for an image (Anchore Inc.)
Version: 0.6.0
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-sbom
scout: Docker Scout (Docker Inc.)
Version: v1.13.0
Path: /Users/akhilsurapuram/.docker/cli-plugins/docker-scout

Server:
Containers: 0
Running: 0
Paused: 0
Stopped: 0
Images: 5
Server Version: 27.2.0
Storage Driver: overlay2
Backing Filesystem: extfs
Supports d_type: true
Using metacopy: false
Native Overlay Diff: true
userxattr: false
Logging Driver: json-file
Cgroup Driver: cgroupfs
Cgroup Version: 2
Plugins:
Volume: local
Network: bridge host ipvlan macvlan null overlay
Log: awslogs fluentd gcplogs gelf journald json-file local splunk syslog
Swarm: inactive
Runtimes: io.containerd.runc.v2 runc
Default Runtime: runc
Init Binary: docker-init
containerd version: 8fc6bcff51318944179630522a095cc9dbf9f353
runc version: v1.1.13-0-g58aa920
init version: de40ad0
Security Options:
seccomp
Profile: unconfined
cgroupns
Kernel Version: 6.10.4-linuxkit
Operating System: Docker Desktop
OSType: linux
Architecture: aarch64
CPUs: 11
Total Memory: 7.655GiB
Name: docker-desktop
ID: 2672fe68-05c3-4e35-be00-6675c189cef7
Docker Root Dir: /var/lib/docker
Debug Mode: false
HTTP Proxy: http.docker.internal:3128
HTTPS Proxy: http.docker.internal:3128
No Proxy: hubproxy.docker.internal
Labels:
com.docker.desktop.address=unix:///Users/akhilsurapuram/Library/Containers/com.docker.docker/Data/docker-cli.sock
Experimental: false
Insecure Registries:
hubproxy.docker.internal:5555
127.0.0.0/8
Live Restore Enabled: false

WARNING: daemon is not using the default seccomp profile

Diagnostics ID

DAAFF1B8-8EE5-4E0B-ABAD-E65163EC3DE5/20241011024200

Additional Info

---- docker build log

(.venv) (base) akhilsurapuram@Akhils-MacBook-Pro superset % docker compose up
[+] Building 10.3s (25/164) docker:desktop-linux
=> [superset-init internal] load build definition from Dockerfile 0.1s
=> => transferring dockerfile: 8.93kB 0.0s
=> [superset internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 8.93kB 0.0s
=> [superset-node internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 8.93kB 0.0s
=> [superset-worker internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 8.93kB 0.0s
=> [superset-worker-beat internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 8.93kB 0.0s
=> [superset-worker-beat internal] load metadata for docker.io/library/python:3.10-slim-bookworm 0.5s
=> [superset-worker-beat internal] load metadata for docker.io/library/node:20-bullseye-slim 0.6s
=> [superset-node internal] load .dockerignore 0.0s
=> => transferring context: 1.30kB 0.0s
=> [superset-init internal] load .dockerignore 0.0s
=> => transferring context: 1.30kB 0.0s
=> [superset-worker internal] load .dockerignore 0.0s
=> => transferring context: 1.30kB 0.0s
=> [superset internal] load .dockerignore 0.0s
=> => transferring context: 1.30kB 0.0s
=> [superset-worker-beat internal] load .dockerignore 0.0s
=> => transferring context: 1.30kB 0.0s
=> [superset-init superset-node 1/14] FROM docker.io/library/node:20-bullseye-slim@sha256:c121fcd9656dde8ca373d1aa0b596f95af1764e0b7e6d4a212cbc7877 6.2s
=> => resolve docker.io/library/node:20-bullseye-slim@sha256:c121fcd9656dde8ca373d1aa0b596f95af1764e0b7e6d4a212cbc78775c74c97 0.0s
=> => sha256:c121fcd9656dde8ca373d1aa0b596f95af1764e0b7e6d4a212cbc78775c74c97 3.94kB / 3.94kB 0.0s
=> => sha256:36cd2b61ebf8fe484c6338f790b0d3465da31bd3c52abb5c96e489fb80fd4c9c 1.93kB / 1.93kB 0.0s
=> => sha256:20eb11656e2aeae8f48b61cda02bf318bf10f6f5436900b1df21f5e2ed276d78 6.80kB / 6.80kB 0.0s
=> => sha256:2245c7c084558dcf55e2bad9579c63dfdbd831cdbed2e063a1c25322cb793bed 30.08MB / 30.08MB 1.4s
=> => sha256:46dab1f2919788df6dfbe2d965bbcc0f602c1b6b529d472c8b1d3a2f5263c3ce 4.08kB / 4.08kB 0.6s
=> => sha256:d74fec41f951df6837355ec0a74abd0daacf17286ecb4cf0e724b8947ab424d6 40.74MB / 40.74MB 2.7s
=> => sha256:ae715ed9a19b733f23a27b32caab756117b6f521155480f3a14d33ec35434193 1.74MB / 1.74MB 1.3s
=> => sha256:db87ca1e69badf47a59f092270bbd5ae93cea9886cc202045c9c6e564b754d60 449B / 449B 1.4s
=> => extracting sha256:2245c7c084558dcf55e2bad9579c63dfdbd831cdbed2e063a1c25322cb793bed 2.2s
=> => extracting sha256:46dab1f2919788df6dfbe2d965bbcc0f602c1b6b529d472c8b1d3a2f5263c3ce 0.0s
=> => extracting sha256:d74fec41f951df6837355ec0a74abd0daacf17286ecb4cf0e724b8947ab424d6 1.9s
=> => extracting sha256:ae715ed9a19b733f23a27b32caab756117b6f521155480f3a14d33ec35434193 0.1s
=> => extracting sha256:db87ca1e69badf47a59f092270bbd5ae93cea9886cc202045c9c6e564b754d60 0.0s
=> CANCELED [superset-node internal] load build context 9.0s
=> => transferring context: 256.85MB 9.0s
=> [superset] importing cache manifest from apache/superset-cache:3.10-slim-bookworm 0.5s
=> => inferred cache manifest type: application/vnd.oci.image.index.v1+json 0.0s
=> [superset lean 1/16] FROM docker.io/library/python:3.10-slim-bookworm@sha256:1eb5d76bf3e9e612176ebf5eadf8f27ec300b7b4b9a99f5856f8232fd33aa16e 0.0s
=> CANCELED [superset-worker internal] load build context 8.8s
=> => transferring context: 356.58MB 8.8s
=> CACHED [superset-worker-beat lean 2/16] WORKDIR /app 2.1s
=> => pulling sha256:d847ad1879f2202660d37d9bedf1b8986116079d578b010e46b6917facf23dd5 0.3s
=> => pulling sha256:0947c264eb8a114516fca29b30c6ddcf09a52db65ac0638802feaada11321a41 0.6s
=> => pulling sha256:1cd341a0721679457ab8a1007362830a43901644e78835011a23282ffde45529 0.1s
=> => pulling sha256:fcac65dbed5c11adc1709fb2275734d35e8ab504c1d431704e9559d348b955d7 0.1s
=> CANCELED [superset-init internal] load build context 8.8s
=> => transferring context: 380.17MB 8.8s
=> CANCELED [superset-worker-beat internal] load build context 8.7s
=> => transferring context: 367.69MB 8.7s
=> CANCELED [superset internal] load build context 8.7s
=> => transferring context: 352.51MB 8.7s
=> [superset-worker-beat lean 3/16] RUN apt-get clean 0.5s
=> ERROR [superset-worker-beat lean 4/16] RUN mkdir -p /app/pythonpath superset/static requirements superset-frontend apache_superset.egg-info requ 6.3s
=> [superset-worker-beat superset-node 2/14] RUN apt-get clean 0.4s
=> CANCELED [superset-node superset-node 3/14] RUN apt-get update -qq && apt-get install -yqq --no-install-recommends build-ess 2.6s

[superset-worker-beat lean 4/16] RUN mkdir -p /app/pythonpath superset/static requirements superset-frontend apache_superset.egg-info requirements && useradd --user-group -d /app/superset_home -m --no-log-init --shell /bin/bash superset && apt-get update -qq && apt-get install -yqq --no-install-recommends curl libsasl2-dev libsasl2-modules-gssapi-mit libpq-dev libecpg-dev libldap2-dev && touch superset/static/version_info.json && chown -R superset:superset ./* && rm -rf /var/lib/apt/lists/*:
6.058 E: Failed to fetch http://deb.debian.org/debian/pool/main/c/curl/libcurl4_7.88.1-10%2bdeb12u7_arm64.deb Hash Sum mismatch
6.058 Hashes of expected file:
6.058 - SHA256:c30ad8aab9fac6391912f243838fec9f134fd7fc96308be613d29cbfd550bf05
6.058 - MD5Sum:13745fdd6e9d50e68772c5b0b9cfbd2e [weak]
6.058 - Filesize:365384 [weak]
6.058 Hashes of received file:
6.058 - SHA256:86ff2103a5f98455c6c6a63bac1213dbd301de6e6e79e89c2c9c0d0d9c33272b
6.058 - MD5Sum:b676af23f6864f87cc7e3aa4dd0d16f0 [weak]
6.058 - Filesize:365384 [weak]
6.058 Last modification reported: Fri, 23 Aug 2024 11:16:18 +0000
6.058 E: Failed to fetch http://deb.debian.org/debian/pool/main/g/glibc/libc6-dev_2.36-9%2bdeb12u8_arm64.deb Hash Sum mismatch
6.058 Hashes of expected file:
6.058 - SHA256:65725841f8c57eba57627869ed18eaf1f76dd13149a93f92543689d99dc78268
6.058 - MD5Sum:d07b9d28d62bbd17d0a325d70735cd2e [weak]
6.058 - Filesize:1430200 [weak]
6.058 Hashes of received file:
6.058 - SHA256:e58d819cf831397e0bb02b524fa3af734d1b8f0b84c1571c66e0bc6c2cf14e40
6.058 - MD5Sum:b5949bdaadb9e7ffebdc54ce76783e72 [weak]
6.058 - Filesize:1430200 [weak]
6.058 Last modification reported: Fri, 16 Aug 2024 23:03:35 +0000
6.058 E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing?

---

failed to solve: process "/bin/sh -c mkdir -p ${PYTHONPATH} superset/static requirements superset-frontend apache_superset.egg-info requirements && useradd --user-group -d ${SUPERSET_HOME} -m --no-log-init --shell /bin/bash superset && apt-get update -qq && apt-get install -yqq --no-install-recommends curl libsasl2-dev libsasl2-modules-gssapi-mit libpq-dev libecpg-dev libldap2-dev && touch superset/static/version_info.json && chown -R superset:superset ./* && rm -rf /var/lib/apt/lists/*" did not complete successfully: exit code: 100
(.venv) (base) akhilsurapuram@Akhils-MacBook-Pro superset %

[ebriney]

@surapuramakhil Hello, it looks like a dockerd issue and not a Docker Desktop issue, no?
Did you try on a linux machine with the native daemon?

[surapuramakhil]

@ebriney can you share instructions for running with native daemon.