Stress of registry-sandbox.k8s.io

[ameukam]

oci-proxy is currently deployed over the 2 GCP regions: us-central1 and us-west1. We should do some stress tests to build confidence on what we are building and also ensure we can handle k8s.gcr.io traffic.

We should probably ask to GCR team some outdated metrics.

/sig k8s-infra
/priority important-longterm

[BenTheElder]

/assign @BenTheElder @ameukam

[ameukam]

/assign @BobyMCbobs

[k8s-ci-robot]

@ameukam: GitHub didn't allow me to assign the following users: BobyMCbobs.

Note that only kubernetes-sigs members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

In response to this:

/assign @BobyMCbobs

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[BobyMCbobs]

Background

Production Kubernetes artifacts currently serve ~60,000,000 requests every day.

Results

Ran some stress testing against the current registry.k8s.io and the results look pretty good.
The tests were not following redirection and only hitting https://registry.k8s.io/v2/

10,000 requests in 30s

10,000,000 requests in 30s

100,000,000 requests in 60s

Thoughts

Throughout the testing, the service was still accessible and did not appear to have any issues even at 100,000,000 requests per minute.
Given 100,000,000 per-minute running fine and Kubernetes artifacts receiving only 60,000,000 requests per-day, I think that it appears stable

[dims]

that's great news @BobyMCbobs

[hh]

Thanks @BobyMCbobs ! Great work!

[aojea]

impressive,

now, if we want to be paranoid https://groups.google.com/g/golang-nuts/c/MFZd6b8zQTQ/m/ISD96eyXtD4J 😄

[ameukam]

@BobyMCbobs is it possible to disclose/document somewhere how this is was done ? (may be https://git.k8s.io/k8s.io/registry.k8s.io ?). Could be really useful if someone else want to re-do it.

[BobyMCbobs]

@ameukam, of course. I'll get back to you on that

[BobyMCbobs]

Stress test docs merged in kubernetes/k8s.io#3565

[hh]

Do we want to stress test anymore or can we close this ticket.

[dims]

@hh we can close this out

[BenTheElder]

Thanks folks!