Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an n1_highmem_8 nodepool to k8s-infra-prow-build to prep for migration #1172

Merged

Conversation

spiffxp
Copy link
Member

@spiffxp spiffxp commented Aug 24, 2020

There is a suspicion that switching to n1-highmem-16 nodes has caused more jobs-per-node to be scheduled, thus leading to more contention over resources that aren't accounted for by the scheduler (such as IOPS)

This PR is the first step in undoing that change, by moving us back to n1-highmem-8's.

I am concerned that moving back to more, smaller nodes will cause us to hit our quota of IP's, and we'll have to shift jobs off of this cluster until we can find some other way to mitigate (ref: #1132 (comment))

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. wg/k8s-infra size/S Denotes a PR that changes 10-29 lines, ignoring generated files. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Aug 24, 2020
Copy link
Contributor

@hasheddan hasheddan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Aug 24, 2020
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hasheddan, spiffxp

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit ef36669 into kubernetes:master Aug 24, 2020
@hasheddan
Copy link
Contributor

@spiffxp spiffxp deleted the back-to-n1-highmem-8-for-prow-build branch August 24, 2020 18:58
@spiffxp
Copy link
Member Author

spiffxp commented Aug 24, 2020

Will track migration under #1173

# use an UBUNTU image instead. Keep parity with the existing google.com
# k8s-prow-builds/prow cluster by using the CONTAINERD variant
image_type = "UBUNTU_CONTAINERD"
machine_type = "n1-highmem-16"
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Welp. Looks like this is gonna need a redo

@spiffxp spiffxp mentioned this pull request Aug 24, 2020
@spiffxp spiffxp added the area/prow Setting up or working with prow in general, prow.k8s.io, prow build clusters label Aug 25, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/prow Setting up or working with prow in general, prow.k8s.io, prow build clusters cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants