Can not build for front-proxy of examples

[kakaru1331]

Can't build front-proxy example with docker-compose.
It has been failed when pulling python images used in shared resources (flask and tracing).
And I have solved to change the image from 3.10-slim-bullseye to 3.11.0a7-bullseye

I think it could be a docker registry problem rather than the example.
I'll register the issue just in case.
And the detailed error log is below.

=> ERROR [internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye

[internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye:

---

failed to solve with frontend dockerfile.v0: failed to create LLB definition: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorizatio
ERROR: Service 'tracing' failed to build : Build failed

[daixiang0]

It works for me, from the log it says it wants to pull docker.io/library/flask_service:python-3.10-slim-bullseye, which we all know it needs to build.

[phlax]

this seems to be the same issue reported in #20897

im struggling to understand the circumstances under which this is failing - wfm locally, and ci is testing this without issue i think

I think it could be a docker registry problem rather than the example.

im inclined to think the same, but the error messages are confusing

And I have solved to change the image from 3.10-slim-bullseye to 3.11.0a7-bullseye

im trying to understand how that makes a difference, but we need 3.10 anyway

[bryanwux]

Are you behind a corporate proxy? @kakaru1331 You may want to configure your docker to use proxy.

[kakaru1331]

@bryanwux Yes I am. I think you're right.
When I see other people make it without trouble.
Thank you.

[mithuns]

I am running into the same issue I believe,
everything else , i can pull from dockerhub except for envoyproxy:tracing
trying to follow the example mentioned here

❯ docker pull envoyproxy:tracing
Error response from daemon: pull access denied for envoyproxy, repository does not exist or may require 'docker login': denied: requested access to the resource is denied
❯ docker pull flask_service:python-3.10-slim-bullseye
Error response from daemon: pull access denied for flask_service, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

but without making any changes to docker config locally , I can easily pull these other images

❯ docker pull envoyproxy/envoy-debug:v1.21-latest
v1.21-latest: Pulling from envoyproxy/envoy-debug
88736512a147: Pull complete
31b4a15ab3d8: Pull complete
140d66700333: Pull complete
7ffb1f2904d0: Pull complete
2ea894474077: Pull complete
4f4fb700ef54: Pull complete
2f57144d871a: Pull complete
4eafd179850f: Pull complete
Digest: sha256:2a4ef9f4759541ab6b28c030bac5f95568cc031078e91f5bcca41e279aee5a1a
Status: Downloaded newer image for envoyproxy/envoy-debug:v1.21-latest
docker.io/envoyproxy/envoy-debug:v1.21-latest

as well as

❯ docker pull envoyproxy/envoy-debug-dev
Using default tag: latest
latest: Pulling from envoyproxy/envoy-debug-dev
88736512a147: Already exists
a44bc9fc528e: Already exists
45cd4c5b4f89: Already exists
b544f25b87e4: Pull complete
e626fa42a7d5: Pull complete
e39c66366821: Pull complete
b2bb448924cf: Pull complete
74c46a1431a2: Pull complete
Digest: sha256:feacbbc32d02f33e80a0ba62be7645daa5f012cb475102d9494e38a3c95a6ca8
Status: Downloaded newer image for envoyproxy/envoy-debug-dev:latest
docker.io/envoyproxy/envoy-debug-dev:latest

[michael-thoughtworker]

This issue still exists. May I ask is there a plan to fix it?

[phlax]

i think there is some confusion

i see docker pull commands being posted (as opposed to docker-compose)

that wont work for docker-compose defined images

im not sure if there is an actual problem, confusion aside, but as said, it works in CI and for me locally, so not sure, but would need a bit more info as to when it occurs if there is

[mithuns]

Oh , sorry , i meant to bring up that docker pull itself was failing but i see what you mean.
docker-compose build --pull is not the same as docker pull, i agree and please ignore that last comment.

So, trying verbatim instructions from the front-proxy tutorial and no corporate vpn or firewall or proxy in place

❯ docker-compose images
Container           Repository          Tag                 Image Id            Size
❯ docker-compose build --pull
[+] Building 2.6s (18/21)
 => [flask_service:python-3.10-slim-bullseye internal] load build definition from Dockerfile                                                                                                                                             0.0s
 => => transferring dockerfile: 32B                                                                                                                                                                                                      0.0s
 => [envoyproxy:tracing internal] load build definition from Dockerfile                                                                                                                                                                  0.0s
 => => transferring dockerfile: 32B                                                                                                                                                                                                      0.0s
 => [front-proxy_front-envoy internal] load build definition from Dockerfile-frontenvoy                                                                                                                                                  0.0s
 => => transferring dockerfile: 43B                                                                                                                                                                                                      0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load .dockerignore                                                                                                                                                                0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [envoyproxy:tracing internal] load .dockerignore                                                                                                                                                                                     0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [front-proxy_front-envoy internal] load .dockerignore                                                                                                                                                                                0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load metadata for docker.io/library/python:3.10-slim-bullseye                                                                                                                     0.5s
 => [front-proxy_front-envoy internal] load metadata for docker.io/envoyproxy/envoy-dev:latest                                                                                                                                           1.0s
 => ERROR [envoyproxy:tracing internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye                                                                                                                      2.3s
 => [flask_service:python-3.10-slim-bullseye internal] load build context                                                                                                                                                                0.0s
 => => transferring context: 38B                                                                                                                                                                                                         0.0s
 => [flask_service:python-3.10-slim-bullseye 1/4] FROM docker.io/library/python:3.10-slim-bullseye@sha256:ad719a882ac0594bdc92abccff22e5b6713bbf9893320264fd9e8affd8a6f470                                                               0.0s
 => CACHED [flask_service:python-3.10-slim-bullseye 2/4] ADD requirements.txt /tmp/flask-requirements.txt                                                                                                                                0.0s
 => CACHED [flask_service:python-3.10-slim-bullseye 3/4] RUN pip3 install -r /tmp/flask-requirements.txt                                                                                                                                 0.0s
 => CACHED [flask_service:python-3.10-slim-bullseye 4/4] RUN mkdir /code                                                                                                                                                                 0.0s
 => [flask_service:python-3.10-slim-bullseye] exporting to image                                                                                                                                                                         0.0s
 => => exporting layers                                                                                                                                                                                                                  0.0s
 => => writing image sha256:5d1720ed6c341c07d756daf3cc11458d8a7c9595bd7d50ff387523623cfa81ed                                                                                                                                             0.0s
 => => naming to docker.io/library/flask_service:python-3.10-slim-bullseye                                                                                                                                                               0.0s
 => [auth] library/flask_service:pull token for registry-1.docker.io                                                                                                                                                                     0.0s
 => [front-proxy_front-envoy internal] load build context                                                                                                                                                                                0.0s
 => => transferring context: 7.53kB                                                                                                                                                                                                      0.0s
 => CANCELED [front-proxy_front-envoy 1/4] FROM docker.io/envoyproxy/envoy-dev:latest@sha256:d1a3abbdd6b2d22e279d0e1e567163b00a6b9920dd12bd63831dfaf914369fa3                                                                            1.2s
 => => resolve docker.io/envoyproxy/envoy-dev:latest@sha256:d1a3abbdd6b2d22e279d0e1e567163b00a6b9920dd12bd63831dfaf914369fa3                                                                                                             0.0s
 => => sha256:d1a3abbdd6b2d22e279d0e1e567163b00a6b9920dd12bd63831dfaf914369fa3 743B / 743B                                                                                                                                               0.0s
 => => sha256:8a3af097d0aba441bdc1ac127f2131b17e73f149015e95b0b9571e418dad7949 3.24kB / 3.24kB                                                                                                                                           0.0s
 => => sha256:5b00803bf604d4ff96e49a9429626ab8b1bcb408b26849fc2fb909b5326d9c03 3.49MB / 3.49MB                                                                                                                                           0.9s
 => => sha256:911bdf7868835753f088d4544541951228a9f07cb69848f261fa3b13d8d7f8a4 120B / 120B                                                                                                                                               0.2s
 => => sha256:0e506b9cf69eef0b2d16a08a3db1851ffd98db3bf5d95c13846f1adc1a721683 1.99kB / 1.99kB                                                                                                                                           0.0s
 => => sha256:88736512a147458c580cd28c969698561f236abba2ef04dbf0d7940cb3d7375e 13.63MB / 26.71MB                                                                                                                                         1.3s
 => => sha256:31bd94bf0a15a4ac1fa7440287028fef34c64bccd179772f2bc3dd2bef80dbcb 8.39MB / 21.34MB                                                                                                                                          1.3s
 => => sha256:e45b20545c21afbdf8d5ad31336db1b22e390331cb2b180897d0cbe0d4bf1eb5 4.39kB / 4.39kB                                                                                                                                           1.2s
 => => sha256:a3646bb5138b918d6547eb3e6a2e30746bed5a6524df21d3b215d453486b0a95 0B / 797B                                                                                                                                                 1.3s
------
 > [envoyproxy:tracing internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye:
------
failed to solve: failed to solve with frontend dockerfile.v0: failed to create LLB definition: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

It didnt require any kind of authorization before

❯ docker login
Authenticating with existing credentials...
Login Succeeded
❯ vi $HOME/.docker/config.json
{
        "auths": {
                "https://index.docker.io/v1/": {}
        },
        "credsStore": "osxkeychain"
}

trying again with --verbose flag

❯ docker images
REPOSITORY                TAG                         IMAGE ID       CREATED          SIZE
flask_service             python-3.10-slim-bullseye   5d1720ed6c34   13 minutes ago   137MB

❯ docker-compose --verbose build --pull
DEBU[0000] serving grpc connection
DEBU[0000] stopping session                              span="load buildkit capabilities"
DEBU[0000] serving grpc connection
DEBU[0000] serving grpc connection
DEBU[0000] serving grpc connection
[+] Building 0.7s (12/15)
[+] Building 2.5s (16/21)
 => [flask_service:python-3.10-slim-bullseye internal] load build definition from Dockerfile                                                                                                                                             0.0s
[+] Building 2.6s (18/21)
 => [flask_service:python-3.10-slim-bullseye internal] load build definition from Dockerfile                                                                                                                                             0.0s
 => => transferring dockerfile: 32B                                                                                                                                                                                                      0.0s
 => [envoyproxy:tracing internal] load build definition from Dockerfile                                                                                                                                                                  0.0s
 => => transferring dockerfile: 32B                                                                                                                                                                                                      0.0s
 => [front-proxy_front-envoy internal] load build definition from Dockerfile-frontenvoy                                                                                                                                                  0.0s
 => => transferring dockerfile: 43B                                                                                                                                                                                                      0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load .dockerignore                                                                                                                                                                0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [envoyproxy:tracing internal] load .dockerignore                                                                                                                                                                                     0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [front-proxy_front-envoy internal] load .dockerignore                                                                                                                                                                                0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load metadata for docker.io/library/python:3.10-slim-bullseye                                                                                                                     0.5s
 => [front-proxy_front-envoy internal] load metadata for docker.io/envoyproxy/envoy-dev:latest                                                                                                                                           1.1s
 => ERROR [envoyproxy:tracing internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye                                                                                                                      2.2s
 => [flask_service:python-3.10-slim-bullseye internal] load build context                                                                                                                                                                0.0s
 => => transferring context: 38B                                                                                                                                                                                                         0.0s
 => [flask_service:python-3.10-slim-bullseye 1/4] FROM docker.io/library/python:3.10-slim-bullseye@sha256:ad719a882ac0594bdc92abccff22e5b6713bbf9893320264fd9e8affd8a6f470                                                               0.0s
 => CACHED [flask_service:python-3.10-slim-bullseye 2/4] ADD requirements.txt /tmp/flask-requirements.txt                                                                                                                                0.0s
 => CACHED [flask_service:python-3.10-slim-bullseye 3/4] RUN pip3 install -r /tmp/flask-requirements.txt                                                                                                                                 0.0s
 => CACHED [flask_service:python-3.10-slim-bullseye 4/4] RUN mkdir /code                                                                                                                                                                 0.0s
 => [flask_service:python-3.10-slim-bullseye] exporting to image                                                                                                                                                                         0.0s
 => => exporting layers                                                                                                                                                                                                                  0.0s
 => => writing image sha256:5d1720ed6c341c07d756daf3cc11458d8a7c9595bd7d50ff387523623cfa81ed                                                                                                                                             0.0s
 => => naming to docker.io/library/flask_service:python-3.10-slim-bullseye                                                                                                                                                               0.0s
 => [auth] library/flask_service:pull token for registry-1.docker.io                                                                                                                                                                     0.0s
 => CANCELED [front-proxy_front-envoy 1/4] FROM docker.io/envoyproxy/envoy-dev:latest@sha256:d1a3abbdd6b2d22e279d0e1e567163b00a6b9920dd12bd63831dfaf914369fa3                                                                            1.2s
 => => resolve docker.io/envoyproxy/envoy-dev:latest@sha256:d1a3abbdd6b2d22e279d0e1e567163b00a6b9920dd12bd63831dfaf914369fa3                                                                                                             0.0s
 => => sha256:88736512a147458c580cd28c969698561f236abba2ef04dbf0d7940cb3d7375e 19.92MB / 26.71MB                                                                                                                                         1.3s
 => => sha256:5b00803bf604d4ff96e49a9429626ab8b1bcb408b26849fc2fb909b5326d9c03 3.49MB / 3.49MB                                                                                                                                           0.7s
 => => sha256:911bdf7868835753f088d4544541951228a9f07cb69848f261fa3b13d8d7f8a4 120B / 120B                                                                                                                                               0.5s
 => => sha256:d1a3abbdd6b2d22e279d0e1e567163b00a6b9920dd12bd63831dfaf914369fa3 743B / 743B                                                                                                                                               0.0s
 => => sha256:0e506b9cf69eef0b2d16a08a3db1851ffd98db3bf5d95c13846f1adc1a721683 1.99kB / 1.99kB                                                                                                                                           0.0s
 => => sha256:8a3af097d0aba441bdc1ac127f2131b17e73f149015e95b0b9571e418dad7949 3.24kB / 3.24kB                                                                                                                                           0.0s
 => => sha256:31bd94bf0a15a4ac1fa7440287028fef34c64bccd179772f2bc3dd2bef80dbcb 5.24MB / 21.34MB                                                                                                                                          1.3s
 => => sha256:e45b20545c21afbdf8d5ad31336db1b22e390331cb2b180897d0cbe0d4bf1eb5 4.39kB / 4.39kB                                                                                                                                           0.9s
 => => sha256:a3646bb5138b918d6547eb3e6a2e30746bed5a6524df21d3b215d453486b0a95 797B / 797B                                                                                                                                               1.2s
 => [front-proxy_front-envoy internal] load build context                                                                                                                                                                                0.0s
 => => transferring context: 38B                                                                                                                                                                                                         0.0s
------
 > [envoyproxy:tracing internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye:
------
failed to solve: failed to solve with frontend dockerfile.v0: failed to create LLB definition: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

Tried running a different sandbox (mysql) and everything works properly, no errors.

❯ cd ..
❯ ls
BUILD                   cors                    ext_authz               jaeger-native-tracing   lua                     skywalking-tracing      verify-common.sh        win32-front-proxy
DEVELOPER.md            csrf                    fault-injection         jaeger-tracing          mysql                   tls                     vrp-litmus              zipkin-tracing
_extra_certs            double-proxy            front-proxy             load-reporting-service  postgres                tls-inspector           vrp-local               zstd
brotli                  dynamic-config-cp       grpc-bridge             local_ratelimit         redis                   tls-sni                 wasm-cc
cache                   dynamic-config-fs       gzip                    locality-load-balancing shared                  udp                     websocket
❯ cd mysql
❯ docker-compose build --pull
[+] Building 15.9s (14/14) FINISHED
 => [mysql_proxy internal] load build definition from Dockerfile-proxy                                                                                                                                                                   0.0s
 => => transferring dockerfile: 203B                                                                                                                                                                                                     0.0s
 => [mysql_mysql internal] load build definition from Dockerfile-mysql                                                                                                                                                                   0.0s
 => => transferring dockerfile: 58B                                                                                                                                                                                                      0.0s
 => [mysql_proxy internal] load .dockerignore                                                                                                                                                                                            0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [mysql_mysql internal] load .dockerignore                                                                                                                                                                                            0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [mysql_proxy internal] load metadata for docker.io/envoyproxy/envoy-contrib-dev:latest                                                                                                                                               2.8s
 => [mysql_mysql internal] load metadata for docker.io/library/mysql:5.7                                                                                                                                                                 2.7s
 => [auth] envoyproxy/envoy-contrib-dev:pull token for registry-1.docker.io                                                                                                                                                              0.0s
 => [auth] library/mysql:pull token for registry-1.docker.io                                                                                                                                                                             0.0s
 => [mysql_mysql 1/1] FROM docker.io/library/mysql:5.7@sha256:e767595ba3408fbb2dda493be3594b9a148178df58325fafe8b0363662935624                                                                                                          13.0s
 => => resolve docker.io/library/mysql:5.7@sha256:e767595ba3408fbb2dda493be3594b9a148178df58325fafe8b0363662935624                                                                                                                       0.0s
 => => sha256:8aa3ac85066b123f51dc3116666eaa90f904194f8ccbbb38edef3f75382bde5a 4.18MB / 4.18MB                                                                                                                                           0.7s
 => => sha256:4be315f6562fccf08fd6c749557e31e45ab6d987370e20e2c4933ddb04ddd5ff 27.14MB / 27.14MB                                                                                                                                         1.8s
 => => sha256:8aa4b5ffb001f0092b491bdd8a48a83cb2ab2b721646db139d4cda64dea93600 7.08kB / 7.08kB                                                                                                                                           0.0s
 => => sha256:96e2eb237a1b01f5f7102bf13d4d92bc60937a8f75fcfd4bea0d6f37f29e36ad 1.73kB / 1.73kB                                                                                                                                           0.3s
 => => sha256:9519054fe27aa84758d6303f66a6059c47f4bfbfc9d2ce32e4f6fed63cf93a8c 2.62kB / 2.62kB                                                                                                                                           0.0s
 => => sha256:e767595ba3408fbb2dda493be3594b9a148178df58325fafe8b0363662935624 320B / 320B                                                                                                                                               0.0s
 => => sha256:ac7e524f6c89f7c75ef7a9ad752e344967db67ebf0a0a1248a2e40c120290bf8 1.39MB / 1.39MB                                                                                                                                           0.9s
 => => sha256:f6a88631064fc8f7cd0d269d71800a9fe2768e1bf3c32ffd10489e620ab52b32 149B / 149B                                                                                                                                               0.9s
 => => sha256:15bb3ec3ff50c5b6a064dd106f3ece814edc88c72e3d9672434e1c014784585e 14.06MB / 14.06MB                                                                                                                                         3.1s
 => => sha256:ae65dc337dcb723acc14fda695c58c87adbf9e0c85b631185c6158f9c447a0df 2.55kB / 2.55kB                                                                                                                                           1.1s
 => => sha256:a4c4c43adf52f5de087a3de9cbbe44961b77501325a167b6e276b1beb16e0f1d 254B / 254B                                                                                                                                               1.2s
 => => sha256:c6cab33e8f91f2158824d485f04855550f65a994841cdea4496d0a7faf0d299f 115.68MB / 115.68MB                                                                                                                                       8.3s
 => => extracting sha256:4be315f6562fccf08fd6c749557e31e45ab6d987370e20e2c4933ddb04ddd5ff                                                                                                                                                1.9s
 => => sha256:2e1c4f2c43f66ed8d87c2d72149baa14bd693f2decdd241b1df1ae5bb1d84632 5.14kB / 5.14kB                                                                                                                                           2.0s
 => => sha256:2e5ee322af488c94e1fa00b5d075340197f93a00fdbae2e3ac5b9ff68fe8d502 118B / 118B                                                                                                                                               2.1s
 => => extracting sha256:96e2eb237a1b01f5f7102bf13d4d92bc60937a8f75fcfd4bea0d6f37f29e36ad                                                                                                                                                0.1s
 => => extracting sha256:8aa3ac85066b123f51dc3116666eaa90f904194f8ccbbb38edef3f75382bde5a                                                                                                                                                0.3s
 => => extracting sha256:ac7e524f6c89f7c75ef7a9ad752e344967db67ebf0a0a1248a2e40c120290bf8                                                                                                                                                0.1s
 => => extracting sha256:f6a88631064fc8f7cd0d269d71800a9fe2768e1bf3c32ffd10489e620ab52b32                                                                                                                                                0.0s
 => => extracting sha256:15bb3ec3ff50c5b6a064dd106f3ece814edc88c72e3d9672434e1c014784585e                                                                                                                                                1.5s
 => => extracting sha256:ae65dc337dcb723acc14fda695c58c87adbf9e0c85b631185c6158f9c447a0df                                                                                                                                                0.0s
 => => extracting sha256:a4c4c43adf52f5de087a3de9cbbe44961b77501325a167b6e276b1beb16e0f1d                                                                                                                                                0.0s
 => => extracting sha256:c6cab33e8f91f2158824d485f04855550f65a994841cdea4496d0a7faf0d299f                                                                                                                                                4.3s
 => => extracting sha256:2e1c4f2c43f66ed8d87c2d72149baa14bd693f2decdd241b1df1ae5bb1d84632                                                                                                                                                0.0s
 => => extracting sha256:2e5ee322af488c94e1fa00b5d075340197f93a00fdbae2e3ac5b9ff68fe8d502                                                                                                                                                0.0s
 => [mysql_proxy internal] load build context                                                                                                                                                                                            0.0s
 => => transferring context: 1.02kB                                                                                                                                                                                                      0.0s
 => [mysql_proxy 1/3] FROM docker.io/envoyproxy/envoy-contrib-dev:latest@sha256:14e560cd6b9497bfb44e64bce16ccf3b04de7cdf5c5d15995703606ec166fd68                                                                                         9.2s
 => => resolve docker.io/envoyproxy/envoy-contrib-dev:latest@sha256:14e560cd6b9497bfb44e64bce16ccf3b04de7cdf5c5d15995703606ec166fd68                                                                                                     0.0s
 => => sha256:0a9de54728b4c1054ce3c47ce8bcb599202fdd5b7b9ba1cc7e5ab4ba19158972 1.99kB / 1.99kB                                                                                                                                           0.0s
 => => sha256:14e560cd6b9497bfb44e64bce16ccf3b04de7cdf5c5d15995703606ec166fd68 743B / 743B                                                                                                                                               0.0s
 => => sha256:a9af2600710859b152c2f49932e34a7a4442b25b7395ec62765d1d68eac4f1a2 3.24kB / 3.24kB                                                                                                                                           0.0s
 => => sha256:88736512a147458c580cd28c969698561f236abba2ef04dbf0d7940cb3d7375e 26.71MB / 26.71MB                                                                                                                                         4.7s
 => => sha256:5b00803bf604d4ff96e49a9429626ab8b1bcb408b26849fc2fb909b5326d9c03 3.49MB / 3.49MB                                                                                                                                           3.8s
 => => sha256:911bdf7868835753f088d4544541951228a9f07cb69848f261fa3b13d8d7f8a4 120B / 120B                                                                                                                                               3.9s
 => => sha256:832cbcbab2d023839528405a0b805f8d12bdba01a4466f3940675c7e7e37febf 27.01MB / 27.01MB                                                                                                                                         6.1s
 => => sha256:943fc4d9d7e70b68038069d096cfb3c60dac3ba5533b8dcb36dbbd1326f13c02 4.39kB / 4.39kB                                                                                                                                           4.9s
 => => extracting sha256:88736512a147458c580cd28c969698561f236abba2ef04dbf0d7940cb3d7375e                                                                                                                                                2.2s
 => => sha256:be279a5d3358755d10d45cc18950c8d3d432da61695b51b490d4adc6a9d9d742 799B / 799B                                                                                                                                               5.2s
 => => sha256:de37dc9fa1fab445998d6f16dcb8c1ebe1f70cb3e28af76a3c9eeb39b41d2a72 490B / 490B                                                                                                                                               5.4s
 => => sha256:14429aa6c0beba742132d274f1ccbd815d4b3602f9bfd2ef6c48a148e0c3a338 1.46kB / 1.46kB                                                                                                                                           5.7s
 => => extracting sha256:5b00803bf604d4ff96e49a9429626ab8b1bcb408b26849fc2fb909b5326d9c03                                                                                                                                                0.3s
 => => extracting sha256:911bdf7868835753f088d4544541951228a9f07cb69848f261fa3b13d8d7f8a4                                                                                                                                                0.0s
 => => extracting sha256:832cbcbab2d023839528405a0b805f8d12bdba01a4466f3940675c7e7e37febf                                                                                                                                                1.2s
 => => extracting sha256:943fc4d9d7e70b68038069d096cfb3c60dac3ba5533b8dcb36dbbd1326f13c02                                                                                                                                                0.0s
 => => extracting sha256:be279a5d3358755d10d45cc18950c8d3d432da61695b51b490d4adc6a9d9d742                                                                                                                                                0.0s
 => => extracting sha256:de37dc9fa1fab445998d6f16dcb8c1ebe1f70cb3e28af76a3c9eeb39b41d2a72                                                                                                                                                0.0s
 => => extracting sha256:14429aa6c0beba742132d274f1ccbd815d4b3602f9bfd2ef6c48a148e0c3a338                                                                                                                                                0.0s
 => [mysql_proxy 2/3] COPY ./envoy.yaml /etc/envoy.yaml                                                                                                                                                                                  0.6s
 => [mysql_proxy 3/3] RUN chmod go+r /etc/envoy.yaml                                                                                                                                                                                     0.3s
 => [mysql_mysql] exporting to image                                                                                                                                                                                                     0.0s
 => => exporting layers                                                                                                                                                                                                                  0.0s
 => => writing image sha256:29345e830982c0c7eba2edd75bf683782db389ee5e80b9a4702bf4c8de07db5a                                                                                                                                             0.0s
 => => naming to docker.io/library/mysql_proxy                                                                                                                                                                                           0.0s
 => => writing image sha256:3c79753649e111d827af25a1f91251a28b2c1071ab2a9905c3323bb4e636dc02                                                                                                                                             0.0s
 => => naming to docker.io/library/mysql_mysql                                                                                                                                                                                           0.0s
❯ docker-compose ps
NAME                COMMAND             SERVICE             STATUS              PORTS
❯ docker-compose up --build -d
[+] Building 0.7s (12/12) FINISHED
 => [mysql_mysql internal] load build definition from Dockerfile-mysql                                                                                                                                                                   0.0s
 => => transferring dockerfile: 37B                                                                                                                                                                                                      0.0s
 => [mysql_mysql internal] load .dockerignore                                                                                                                                                                                            0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [mysql_proxy internal] load build definition from Dockerfile-proxy                                                                                                                                                                   0.0s
 => => transferring dockerfile: 38B                                                                                                                                                                                                      0.0s
 => [mysql_mysql internal] load metadata for docker.io/library/mysql:5.7                                                                                                                                                                 0.5s
 => [mysql_proxy internal] load .dockerignore                                                                                                                                                                                            0.0s
 => => transferring context: 2B                                                                                                                                                                                                          0.0s
 => [mysql_proxy internal] load metadata for docker.io/envoyproxy/envoy-contrib-dev:latest                                                                                                                                               0.5s
 => CACHED [mysql_mysql 1/1] FROM docker.io/library/mysql:5.7@sha256:e767595ba3408fbb2dda493be3594b9a148178df58325fafe8b0363662935624                                                                                                    0.0s
 => [mysql_proxy] exporting to image                                                                                                                                                                                                     0.0s
 => => exporting layers                                                                                                                                                                                                                  0.0s
 => => writing image sha256:3c79753649e111d827af25a1f91251a28b2c1071ab2a9905c3323bb4e636dc02                                                                                                                                             0.0s
 => => naming to docker.io/library/mysql_mysql                                                                                                                                                                                           0.0s
 => => writing image sha256:29345e830982c0c7eba2edd75bf683782db389ee5e80b9a4702bf4c8de07db5a                                                                                                                                             0.0s
 => => naming to docker.io/library/mysql_proxy                                                                                                                                                                                           0.0s
 => [mysql_proxy internal] load build context                                                                                                                                                                                            0.0s
 => => transferring context: 32B                                                                                                                                                                                                         0.0s
 => [mysql_proxy 1/3] FROM docker.io/envoyproxy/envoy-contrib-dev:latest@sha256:14e560cd6b9497bfb44e64bce16ccf3b04de7cdf5c5d15995703606ec166fd68                                                                                         0.0s
 => CACHED [mysql_proxy 2/3] COPY ./envoy.yaml /etc/envoy.yaml                                                                                                                                                                           0.0s
 => CACHED [mysql_proxy 3/3] RUN chmod go+r /etc/envoy.yaml                                                                                                                                                                              0.0s
[+] Running 3/3
 ⠿ Network envoymesh        Created                                                                                                                                                                                                      0.0s
 ⠿ Container mysql-proxy-1  Started                                                                                                                                                                                                      0.5s
 ⠿ Container mysql-mysql-1  Started                                                                                                                                                                                                      0.5s
❯ docker-compose ps
NAME                COMMAND                  SERVICE             STATUS              PORTS
mysql-mysql-1       "docker-entrypoint.s…"   mysql               running             33060/tcp
mysql-proxy-1       "/docker-entrypoint.…"   proxy               running             0.0.0.0:1999->1999/tcp, 0.0.0.0:8001->8001/tcp

so, may be the issue is not my local terminal 's connection to dockerhub.

docker version

❯ docker version
Client:
 Cloud integration: v1.0.22
 Version:           20.10.13
 API version:       1.41
 Go version:        go1.16.15
 Git commit:        a224086
 Built:             Thu Mar 10 14:08:44 2022
 OS/Arch:           darwin/amd64
 Context:           default
 Experimental:      true

Server: Docker Desktop 4.6.1 (76265)
 Engine:
  Version:          20.10.13
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.16.15
  Git commit:       906f57f
  Built:            Thu Mar 10 14:06:05 2022
  OS/Arch:          linux/amd64
  Experimental:     false
 containerd:
  Version:          1.5.10
  GitCommit:        2a1d4dbdb2a1030dc5b01e96fb110a9d9f150ecc
 runc:
  Version:          1.0.3
  GitCommit:        v1.0.3-0-gf46b6ba
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
❯ docker-compose version
Docker Compose version v2.3.3

❯ uname -v
Darwin Kernel Version 21.4.0: Fri Mar 18 00:45:05 PDT 2022; root:xnu-8020.101.4~15/RELEASE_X86_64

[phlax]

ok, thanks, ill go through the sandbox and see if i can repro

[ramaraochavali]

I ran in to the same problem. I do not think it is related python version.

It is failing while building tracer image and it is trying to pull flask_service:python-3.10-slim-bullseye from docker.io/library/flask_service:python-3.10-slim-bullseye instead of local.

I removed --pull and ran docker-compose build and it seems to work. May be docker desktop version issue?

[phlax]

I removed --pull and ran docker-compose build and it seems to work. May be docker desktop version issue?

i suspect it is something like this - the flask_service:python-3.10-slim-bullseye is not supposed to be pulled, it should be created, but the images it depends on should be pulled - ill check further...

[Neil-Boyle]

same issue

May be, problem raised from cannot find envoyproxy:tracing image in docker hub?

ref: https://hub.docker.com/search?q=%20envoyproxy%3Atracing

[phlax]

yep, same issue - altho dockerhub is not really relevant as the images are expected to be built rather than pulled

ill try and have a look at this today and see if i can figure why it works in some situations and not others

[Neil-Boyle]

thx, docker-compose file ref: https://www.envoyproxy.io/docs/envoy/latest/start/sandboxes/skywalking_tracing

[xu1zhou]

Encountered same error, I found that the flask_service is build from flask_service:python-3.10-slim-bullseye, And I can't find it on dockerhub, is that's the reason? @daixiang0

[phlax]

dockerhub is not really relevant as the images are expected to be built rather than pulled

[xu1zhou]

Sorry, I recheck the problem and found it may due to a feature named "buildkit" which is enabled by default for some version of docker engine, you can find more detail here, and you can use export DOCKER_BUILDKIT=0 to close buildkit.

[phlax]

interesting - apologies i have struggled to find time to follow up on this, ill try to prioritize and check if buildkit is what is causing issue

[rodrigomideac]

I was facing this error when running docker compose build --pull at front-proxy example:

1 error occurred:
	* Status: pull access denied for flask_service, repository does not exist or may require 'docker login': denied: requested access to the resource is denied, Code: 1

In my case, export DOCKER_BUILDKIT=0 proposed solution didn't work, but running first docker compose build and then docker compose up -d solved the issue for me.

[daixiang0]

--pull                  Always attempt to pull a newer version of the image.

Since you specify --pull, docker-compose will always attempt to pull, that is why you can not build.

[phlax]

the point is this - it should only pull for images that can be pulled, and build for the image that should be built

clearly this is an issue, so will prioritize

as it "works" in CI i havent made this a prio so far (apologies) - maybe following the docs never works and only the way its done in CI does - or perhaps something else - will check further...

[phlax]

so when i follow the steps in the docs for the cache sandbox i see the following:

$ docker-compose pull
Pulling flask_service ... done
Pulling front-envoy   ... done
Pulling service1      ... done
Pulling service2      ... done
WARNING: Some service image(s) must be built from source by running:
    docker-compose build flask_service

this is expected - as the warning states one of the images - flask_service cannot be pulled it must be built

if others are seeing this turn into an error im guessing it must be related to the docker or more liikely docker-compose version

please post versions if you are seeing error when following the docs exactly and we can try and figure out when this is happening

it should be noted that the docker-compose pull step is optional and is documented mostly to avoid situations where people have old (envoy) images that dont match the current docs

[dhjack]

docker compose alway build failed. compile separately work fo me

cd ../shared/flask/
sudo docker build -t flask_service:python-3.10-slim-bullseye .

cd ../tracing/
sudo docker build -t envoyproxy:tracing  .

and then

cd ../../front-proxy/
sudo docker compose build

[phlax]

docker compose will not work i think

you need to use docker-compose

[bryanwux]

@dhjack

cd envoy/examples/front-proxy/
docker-compose build

works for me

[phlax]

ive managed to repro this one of the examples (cors) - not sure why exactly - but will try to track down (ci skips the --pull step)

[phlax]

i think i have a fix for this - i need to test further to confirm but looks promising - i will PR some cleanups for the examples and will include there

[phlax]

this will be fixed in #21962

for avoidance of doubt, and contrary to what i said previously

• there was an issue
• docker compose may work altho is untested atm

apologies if it seemed i doubted - not sure why i didnt manage to repro - either way this should be fixed shortly

[SunnyAureliusRichard]

This is still an issue.

Thanks for the easy commands, @dhjack

I think the issue can be fixed by specifying the Dockerfile path in docker-compose. Similar to this: https://github.com/grpc/grpc-web/blob/master/docker-compose.yml

[SunnyAureliusRichard]

To reproduce, open up: https://gitpod.io/#https://github.com/envoyproxy/envoy and run cd examples/front-proxy/ && docker-compose up

[phlax]

@SunnyAureliusRichard i have just followed those steps (again) and it works as expected - the issue raised here creates the following warning:

WARNING: Image for service service2 was built because it did not already exist. To rebuild this image you must use `docker-compose build` or `docker-compose up --build`

previously, in some cases this was throwing an error i believe

my first question is whether you are running from current Envoy main

[phlax]

I think the issue can be fixed by specifying the Dockerfile path in docker-compose

the Dockerfile path should not need to be set as the context is set

[SunnyAureliusRichard]

hi @phlax . Thanks for taking an interest in this.

I've tried a few things, and couldn't get it to work. Turns out that the image "grpcweb/prereqs" mentioned in the link above is in the docker hub as well, therefore their builds don't fail. Their use case seemed very similar to this one.

docker-compose build doesn't work either. I'm happy following the steps layed out by @dhjack , they solve both issues (running build or up first)

logs for docker-compose build:

gitpod /workspace/envoy (main) $ cd examples/front-proxy/
gitpod /workspace/envoy/examples/front-proxy (main) $ docker-compose build
[+] Building 0.9s (8/11)                                                                                                                       
 => [front-proxy-front-envoy internal] load build definition from Dockerfile-frontenvoy                                                   0.0s
 => => transferring dockerfile: 496B                                                                                                      0.0s
 => [front-proxy-service2 internal] load build definition from Dockerfile                                                                 0.0s
 => => transferring dockerfile: 438B                                                                                                      0.0s
 => [front-proxy-service1 internal] load build definition from Dockerfile                                                                 0.0s
 => => transferring dockerfile: 438B                                                                                                      0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load build definition from Dockerfile                                              0.0s
 => => transferring dockerfile: 303B                                                                                                      0.0s
 => [front-proxy-front-envoy internal] load .dockerignore                                                                                 0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => [front-proxy-service2 internal] load .dockerignore                                                                                    0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => [front-proxy-service1 internal] load .dockerignore                                                                                    0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load .dockerignore                                                                 0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => [front-proxy-front-envoy internal] load metadata for docker.io/envoyproxy/envoy-dev:latest                                            0.8s
 => ERROR [front-proxy-service1 internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye                     0.8s
 => [flask_service:python-3.10-slim-bullseye internal] load metadata for docker.io/library/python:3.10.6-slim-bullseye@sha256:2124d4f8cc  0.8s
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0xf0ce38]

goroutine 86 [running]:
github.com/docker/buildx/build.Build.func4.1()
        github.com/docker/[email protected]/build/build.go:769 +0x4d8
golang.org/x/sync/errgroup.(*Group).Go.func1()
        golang.org/x/[email protected]/errgroup/errgroup.go:75 +0x64
created by golang.org/x/sync/errgroup.(*Group).Go
        golang.org/x/[email protected]/errgroup/errgroup.go:72 +0xa5
gitpod /workspace/envoy/examples/front-proxy (main) $ 
gitpod /workspace/envoy/examples/front-proxy (main) $ 
gitpod /workspace/envoy/examples/front-proxy (main) $ 
gitpod /workspace/envoy/examples/front-proxy (main) $ 
gitpod /workspace/envoy/examples/front-proxy (main) $ 
gitpod /workspace/envoy/examples/front-proxy (main) $ docker-compose build
[+] Building 0.6s (11/11) FINISHED                                                                                                             
 => [front-proxy-service1 internal] load build definition from Dockerfile                                                                 0.0s
 => => transferring dockerfile: 438B                                                                                                      0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load build definition from Dockerfile                                              0.0s
 => => transferring dockerfile: 303B                                                                                                      0.0s
 => [front-proxy-front-envoy internal] load build definition from Dockerfile-frontenvoy                                                   0.0s
 => => transferring dockerfile: 496B                                                                                                      0.0s
 => [front-proxy-service2 internal] load build definition from Dockerfile                                                                 0.0s
 => => transferring dockerfile: 438B                                                                                                      0.0s
 => [front-proxy-service1 internal] load .dockerignore                                                                                    0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load .dockerignore                                                                 0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => [front-proxy-front-envoy internal] load .dockerignore                                                                                 0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => [front-proxy-service2 internal] load .dockerignore                                                                                    0.0s
 => => transferring context: 2B                                                                                                           0.0s
 => ERROR [front-proxy-service1 internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye                     0.5s
 => CANCELED [flask_service:python-3.10-slim-bullseye internal] load metadata for docker.io/library/python:3.10.6-slim-bullseye@sha256:2  0.5s
 => CANCELED [front-proxy-front-envoy internal] load metadata for docker.io/envoyproxy/envoy-dev:latest                                   0.5s
------
 > [front-proxy-service1 internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye:
------
failed to solve: rpc error: code = Unknown desc = failed to solve with frontend dockerfile.v0: failed to create LLB definition: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed
gitpod /workspace/envoy/examples/front-proxy (main) $

[phlax]

what version of Envoy are you testing this with (eg commit hash)

[phlax]

looking through the logs it seems as though this already failed with:

panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0xf0ce38]

which is not the original error that was raised here

im not familiar with gitpod - but im wondering if there is some issue there

i would like to reproduce and track down any issue - but i need to know the versions of:

• envoy
• docker
• docker-compose

[SunnyAureliusRichard]

sometimes i get that invalid memory address error, it's only happened with this repo. it could be some issue with their system. Unfortunately it's the only dev environment I have access to at the moment, so I can't reproduce it anywhere else.

envoy main: 9e7fba8
docker: Docker version 20.10.17, build 100c701
docker-compose: Docker Compose version 2.8.0-gitpod.0

If you'd like to reproduce it, I've put a link above.

[phlax]

sometimes i get that invalid memory address error, it's only happened with this repo

i have never seen this issue before so i think it is more to do with gitpod

If you'd like to reproduce it, I've put a link above.

i have tried reproducing and it works as expected in my env

could you try and reproduce the problem somewhere other than on gitpod

docker-compose: Docker Compose version 2.8.0-gitpod.0

this is a docker compose version i think - i dont know if it will work

https://pypi.org/project/docker-compose/

[elicore]

Getting the same error. MacOS 12.6 on M1 using Docker Desktop.

Head: 362e415045
Docker Compose: 2.10.2
Docker: 20.10.17, build 100c701

> docker-compose build
[+] Building 0.3s (14/14) FINISHED
 => [front-proxy-service2 internal] load build definition from Dockerfile                                                                                                                                                               0.0s
 => => transferring dockerfile: 438B                                                                                                                                                                                                    0.0s
 => [front-proxy-service2 internal] load .dockerignore                                                                                                                                                                                  0.0s
 => => transferring context: 2B                                                                                                                                                                                                         0.0s
 => CANCELED [front-proxy-front-envoy internal] load metadata for docker.io/envoyproxy/envoy-dev:latest                                                                                                                                 0.3s
 => ERROR [front-proxy-service2 internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye                                                                                                                   0.3s
 => [front-proxy-front-envoy internal] load .dockerignore                                                                                                                                                                               0.0s
 => => transferring context: 2B                                                                                                                                                                                                         0.0s
 => [front-proxy-front-envoy internal] load build definition from Dockerfile-frontenvoy                                                                                                                                                 0.0s
 => => transferring dockerfile: 496B                                                                                                                                                                                                    0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load .dockerignore                                                                                                                                                               0.0s
 => => transferring context: 2B                                                                                                                                                                                                         0.0s
 => [flask_service:python-3.10-slim-bullseye internal] load build definition from Dockerfile                                                                                                                                            0.0s
 => => transferring dockerfile: 686B                                                                                                                                                                                                    0.0s
 => CANCELED [flask_service:python-3.10-slim-bullseye internal] load metadata for docker.io/library/python:3.10.7-slim-bullseye@sha256:f2ee145f3bc4e061f8dfe7e6ebd427a410121495a0bd26e7622136db060c59e0                                 0.2s
 => [front-proxy-service1 internal] load .dockerignore                                                                                                                                                                                  0.0s
 => => transferring context: 2B                                                                                                                                                                                                         0.0s
 => [front-proxy-service1 internal] load build definition from Dockerfile                                                                                                                                                               0.0s
 => => transferring dockerfile: 438B                                                                                                                                                                                                    0.0s
 => [auth] envoyproxy/envoy-dev:pull token for registry-1.docker.io                                                                                                                                                                     0.0s
 => [auth] library/python:pull token for registry-1.docker.io                                                                                                                                                                           0.0s
 => [auth] library/flask_service:pull token for registry-1.docker.io                                                                                                                                                                    0.0s
------
 > [front-proxy-service2 internal] load metadata for docker.io/library/flask_service:python-3.10-slim-bullseye:
------
failed to solve: flask_service:python-3.10-slim-bullseye: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

Tried to logout and login to docker hub, same results.

[ssccio]

envoy/examples/shared/flask/Dockerfile specifies a specific version of the python container with FROM python:3.10.7-slim-bullseye@sha256:f2ee145f3bc4e061f8dfe7e6ebd427a410121495a0bd26e7622136db060c59e0, which I imagine is an intel image. Removing the @sha* will enable pulling an arm image for Apple Silicon Macs.

[tyroneyu]

so when i follow the steps in the docs for the cache sandbox i see the following:

$ docker-compose pull
Pulling flask_service ... done
Pulling front-envoy   ... done
Pulling service1      ... done
Pulling service2      ... done
WARNING: Some service image(s) must be built from source by running:
    docker-compose build flask_service

this is expected - as the warning states one of the images - flask_service cannot be pulled it must be built

if others are seeing this turn into an error im guessing it must be related to the docker or more liikely docker-compose version

please post versions if you are seeing error when following the docs exactly and we can try and figure out when this is happening

it should be noted that the docker-compose pull step is optional and is documented mostly to avoid situations where people have old (envoy) images that dont match the current docs

Hi, I hit this issue also. I followed the instructions here:(https://www.envoyproxy.io/docs/envoy/latest/start/sandboxes/front_proxy.html).

❯ docker-compose pull
[+] Running 3/4
 ⠿ service2 Skipped                                                                                                         0.0s
 ⠿ front-envoy Skipped                                                                                                      0.0s
 ⠿ service1 Skipped                                                                                                         0.0s
 ⠿ flask_service Error                                                                                                      1.1s
WARNING: Some service image(s) must be built from source by running:
    docker compose build flask_service
Error response from daemon: pull access denied for flask_service, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

Running docker-compose up --build -d also errors out trying the pull the image.
After running docker compose build flask_service, the example runs fine for me.
I'm running docker desktop 4.10.1 on mac, Engine 20.10.17 and Compose v2.6.1. Hope this helps.

Thanks!

[phlax]

it appears your docker-compose is really docker compose from the logs

this is known to not work atm

its on my radar to switch the examples -> docker compose but it will take some time

[phlax]

heads up to anyone tracking the issues discussed here ...

we have finally switched the examples/documentation to using the docker compose (ie buildkit) that comes with Docker rather than the python version - and fixed the CI at least to work with that

i believe that the examples should still work with the python docker-compose but i didnt get to testing that

the documentation is still being updated to reflect the changes, feedback, prs etc appreciated