quay flake: 502 Bad Gateway

[edsantiago]

Seeing this one a lot recently, many different variations across many CI runs:

Error: initializing source docker://quay.io/libpod/alpine:latest: Requesting bearer token: invalid status code from registry 502 (Bad Gateway)

Error: copying system image from manifest list: determining manifest MIME type for docker://quay.io/libpod/testimage:00000004:
    reading manifest sha256:xxx in quay.io/libpod/testimage: received unexpected HTTP status: 502 Bad Gateway

Error: reading blob sha256:xxx: fetching blob: received unexpected HTTP status: 502 Bad Gateway

• debian-12 : int remote debian-12 root host [remote]
  • PR events: no duplicates when streaming during a log rotation #17771
    • 03-14 10:15 in int remote debian-12 root host: unknown failure
• debian-12 : sys remote debian-12 root host [remote]
  • PR DO NOT MERGE: buildah vendor treadmill #13808
    • 03-13 11:14 in [sys] podman load - multi-image archive with redirect
• fedora-36 : int remote fedora-36 root host [remote]
  • PR cgroupns: private cgroupns on cgroupv1 breaks --systemd #17736
    • 03-14 08:04 in int remote fedora-36 root host: unknown failure
• fedora-36 : sys podman fedora-36 root host
  • PR system service --log-level=trace: support hijack #17781
    • 03-14 10:33 in [sys] podman corrupt images - initialize
  • PR DO NOT MERGE: buildah vendor treadmill #13808
    • 03-13 11:27 in [sys] podman load - multi-image archive
• fedora-37 : int podman fedora-37 root host
  • PR events: no duplicates when streaming during a log rotation #17771
    • 03-14 10:15 in int podman fedora-37 root host: unknown failure
• fedora-37 : int podman fedora-37 rootless host
  • PR cgroupns: private cgroupns on cgroupv1 breaks --systemd #17736
    • 03-14 08:03 in int podman fedora-37 rootless host: unknown failure
• fedora-37 : int remote fedora-37 root host [remote]
  • PR podman events: unhide --stream #17772
    • 03-14 07:02 in int remote fedora-37 root host: unknown failure
• fedora-37 : sys podman fedora-37 root host
  • PR events: no duplicates when streaming during a log rotation #17771
    • 03-14 10:41 in [sys] podman run --pull
• fedora-37 : sys podman fedora-37 rootless host
  • PR system service --log-level=trace: support hijack #17781
    • 03-14 10:31 in [sys] podman load - multi-image archive
  • PR podman events: unhide --stream #17772
    • 03-14 07:28 in [sys] podman load - from URL
• fedora-37 : sys remote fedora-37 rootless host [remote]
  • PR events: no duplicates when streaming during a log rotation #17771
    • 03-14 10:30 in [sys] podman load - multi-image archive with redirect
  • PR DO NOT MERGE: buildah vendor treadmill #13808
    • 03-13 11:15 in [sys] podman load - multi-image archive with redirect
• fedora-37-aarch64 : sys podman fedora-37-aarch64 root host
  • PR system service --log-level=trace: support hijack #17781
    • 03-14 10:35 in [sys] podman run --pull

[edsantiago]

This has blown up today. I don't think it's related to #18124 (new VM images) because #18140, if I'm reading git-log correctly, is based on an earlier main that does not include those VMs. So it's something broken in quay today. (Yes, I checked https://status.quay.io/ - nothing reported, but that's always the case even when we're seeing major breakage).

• debian-12 : sys podman debian-12 root host boltdb
  • PR add netavark plugin support #18002
    • 04-11 12:32 in [sys] podman load - from URL
• debian-12 : sys remote debian-12 root host boltdb [remote]
  • PR add netavark plugin support #18002
    • 04-11 11:53 in [sys] podman load - multi-image archive
• fedora-36 : int remote fedora-36 root host sqlite [remote]
  • PR Ed's pet PR with no flake retries #17831
    • 04-11 12:12 in Podman play kube [It] podman play kube with pull always
• fedora-36 : sys podman fedora-36 rootless host boltdb
  • PR Read kube_generate_type from containers.conf #18140
    • 04-11 10:09 in [sys] podman auto-update with multiple services
• fedora-37 : bud remote fedora-37 root host boltdb [remote]
  • PR Read kube_generate_type from containers.conf #18140
    • 04-11 11:32 in [bud] build test optimal cache working for COPY instruction
    • 04-11 10:44 in [bud] bud using gitrepo with .git and branch
• fedora-37 : int podman fedora-37 root container sqlite
  • PR Ed's pet PR with no flake retries #17831
    • 04-11 12:05 in Podman pull [It] podman pull --arch
• fedora-37 : int remote fedora-37 root host sqlite [remote]
  • PR Ed's pet PR with no flake retries #17831
    • 04-11 12:09 in Podman build [It] podman build --isolation && --arch
    • 04-11 12:09 in Podman pull [It] podman pull by digest (image list)
• fedora-37 : sys podman fedora-37 root host boltdb
  • PR add netavark plugin support #18002
    • 04-11 12:05 in [sys] podman run --pull
  • PR Ed's pet PR with no flake retries #17831
    • 04-11 12:05 in [sys] podman load - multi-image archive with redirect
• fedora-37 : sys podman fedora-37 rootless host boltdb
  • PR CI: enable sqlite system tests #17954
    • 04-11 12:35 in [sys] podman corrupt images - initialize
• fedora-37 : sys remote fedora-37 root host sqlite [remote]
  • PR test/system/252-quadlet.bats: fix flake #18144
    • 04-11 10:09 in [sys] podman load - from URL

[github-actions]

A friendly reminder that this issue had no activity for 30 days.