Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provision stock e2e projects in anticipation of migrating kubernetes merge-blocking jobs #1078

Closed
spiffxp opened this issue Jul 31, 2020 · 4 comments
Assignees
Labels
area/prow Setting up or working with prow in general, prow.k8s.io, prow build clusters sig/release Categorizes an issue or PR as relevant to SIG Release. sig/testing Categorizes an issue or PR as relevant to SIG Testing.

Comments

@spiffxp
Copy link
Member

spiffxp commented Jul 31, 2020

This is in anticipation of kubernetes/test-infra#18550

Based on visual inspection of https://monitoring.prow.k8s.io/d/wSrfvNxWz/boskos-resource-usage?orgId=1&from=now-90d&to=now

Source:

  • Current k8s-prow-build boskos gce-project pool capacity is 200. Usage peaks just under 100.

Target:

  • Current k8s-infra-prow-build boskos k8s-infra-gce-project pool capacity is 40. Usage peaks just under 30.

Goal:

  • Add at least another 100 projects to k8s-infra-prow-build's boskos instance
  • Add the new projects to a gce-project pool
  • While doing this, merge the k8s-infa-gce-project pool into the gce-project pool, ref: Migrate k8s-infra-prow-build boskos/jobs away from k8s-infra-gce-project to gce-project test-infra#18552
    • Switch jobs away from k8s-infra-gce-project
    • Wait for k8s-infra-gce-project pool usage to be completely clean
    • Merge k8s-infra-gce-project pool into gce-project pool
  • At the end of this, ensure boskos dashboard is setup to display the gce-project pool

/area prow
/sig testing
/sig release
/wg k8s-infra

@k8s-ci-robot k8s-ci-robot added area/prow Setting up or working with prow in general, prow.k8s.io, prow build clusters sig/testing Categorizes an issue or PR as relevant to SIG Testing. sig/release Categorizes an issue or PR as relevant to SIG Release. wg/k8s-infra labels Jul 31, 2020
@spiffxp
Copy link
Member Author

spiffxp commented Jul 31, 2020

/assign

@spiffxp
Copy link
Member Author

spiffxp commented Aug 8, 2020

I've added 40 thus far, so out of 100 that mean 60 remain. Going to add another 40, leaving 20.

It may be that as we're re-evaluating the full set of merge-blocking jobs for kubernetes (ref: kubernetes/test-infra#18729) we may lower demand for the gce-project resource

@spiffxp
Copy link
Member Author

spiffxp commented Sep 1, 2020

/close
OK, I think the gce-project pool is large enough for now.

Over the past 30 days we've migrated over all merge-blocking jobs for kubernetes/kubernetes on top of having migrated most of the release-blocking jobs earlier. We're going to have plenty of headroom for a while.
Screen Shot 2020-09-01 at 10 50 07 AM

@k8s-ci-robot
Copy link
Contributor

@spiffxp: Closing this issue.

In response to this:

/close
OK, I think the gce-project pool is large enough for now.

Over the past 30 days we've migrated over all merge-blocking jobs for kubernetes/kubernetes on top of having migrated most of the release-blocking jobs earlier. We're going to have plenty of headroom for a while.
Screen Shot 2020-09-01 at 10 50 07 AM

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/prow Setting up or working with prow in general, prow.k8s.io, prow build clusters sig/release Categorizes an issue or PR as relevant to SIG Release. sig/testing Categorizes an issue or PR as relevant to SIG Testing.
Projects
None yet
Development

No branches or pull requests

2 participants