[registry-facade] Manifest generation takes "a long time"

[csweichel]

Bug description

When observing registry-facade manifest assembly in production we notice that it's really rather slow (p50 is blue, p95 is yellow, p99 is green; Y-axis in seconds):

It seems that we're either being rate-limited by the downstream registry, or our manifest caching is broken. We see a lot of cannot get manifest from store warnings in registry-facade.

Steps to reproduce

Run this in production

Workspace affected

No response

Expected behavior

No response

Example repository

No response

Anything else?

No response

[kylos101]

@csweichel was this issue resolved in #9005? I ask because, it just so happens, @utam0k is looking to learn about registry-facade.

If this issue is resolved, another opportunity for @utam0k could be #9162, which @aledbf started recently.

Let us know?