Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCPBUGS-44193: Reduce Server Side Filtering of Resources #9202

Merged

Conversation

barbacbd
Copy link
Contributor

@barbacbd barbacbd commented Nov 13, 2024

The destroy code is using server side filtering on resources. The number of resources that
are filtered out (server side) are causing quota limits to be reached. Moving the filtering
to the client side will limit quota max errors.

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 13, 2024
@openshift-ci-robot openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. labels Nov 13, 2024
@openshift-ci-robot
Copy link
Contributor

@barbacbd: This pull request references Jira Issue OCPBUGS-44193, which is valid.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.18.0) matches configured target version for branch (4.18.0)
  • bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @jianli-wei

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@barbacbd
Copy link
Contributor Author

/cc @patrickdillon

@barbacbd
Copy link
Contributor Author

/uncc @andfasano

@openshift-ci openshift-ci bot removed the request for review from andfasano November 13, 2024 19:58
@barbacbd barbacbd force-pushed the OCPBUGS-44193_client_side branch 3 times, most recently from 0aa2be4 to 54b7290 Compare November 14, 2024 21:06
@barbacbd barbacbd force-pushed the OCPBUGS-44193_client_side branch 8 times, most recently from 3ece7e0 to 9e73bab Compare November 15, 2024 20:57
@barbacbd barbacbd changed the title WIP: OCPBUGS-44193: Reduce Server Side Filtering of Resources OCPBUGS-44193: Reduce Server Side Filtering of Resources Nov 18, 2024
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Nov 18, 2024
@barbacbd barbacbd force-pushed the OCPBUGS-44193_client_side branch from 9e73bab to 5a5e34d Compare November 18, 2024 12:28
Comment on lines 15 to 17
func (o *ClusterUninstaller) hasClusterIDPrefix(itemName string) bool {
return o.isClusterResource(itemName)
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can consolidate this into a single function, either hasClusterIDPrefix or isClusterResource

** The destroy code is using server side filtering on resources. The number of resources that
are filtered out (server side) are causing quota limits to be reached. Moving the filtering
to the client side will limit quota max errors.
@barbacbd barbacbd force-pushed the OCPBUGS-44193_client_side branch from 5a5e34d to 338e0c9 Compare November 19, 2024 20:12
@patrickdillon
Copy link
Contributor

/retest

@barbacbd
Copy link
Contributor Author

/label acknowledge-critical-fixes-only

@openshift-ci openshift-ci bot added the acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. label Nov 20, 2024
@barbacbd
Copy link
Contributor Author

/label platform/google

Copy link
Contributor

@r4f4 r4f4 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Nov 20, 2024
@patrickdillon
Copy link
Contributor

Fortunately, GCP collects quota data for what we delete, so we can compare the quota for the latest run from this PR with, say, another presubmit

Using jd to compare...

$ jd -set pr-quota.json presubmit-quota.json 
@ ["gcp",["set"],{}]
- {"amount":2,"dimensions":{"network_id":"ci-op-46zmsc2l-6a305-8rbkj-network"},"limit":"subnet_ranges_per_vpc_network","service":"compute.googleapis.com"}
- {"amount":1,"dimensions":{"region":"us-central1"},"limit":"internal_addresses","service":"compute.googleapis.com"}
+ {"amount":1,"dimensions":{"region":""},"limit":"addresses","service":"compute.googleapis.com"}
+ {"amount":40,"dimensions":{"region":"us-central1"},"limit":"disks_total_storage","service":"compute.googleapis.com"}
+ {"amount":1,"dimensions":{"region":"us-central1"},"limit":"addresses","service":"compute.googleapis.com"}
+ {"amount":2,"dimensions":{"network_id":"ci-op-23kt0cp6-6a305-sshhv-network"},"limit":"subnet_ranges_per_vpc_network","service":"compute.googleapis.com"}

The first thing that jumps out is it looks like we're leaking disks, so let's

/hold

until we can check that out.

Networks look ok, it's just diffing on the names. Not sure what's going on with addresses. We will need to look more closely.

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 20, 2024
@patrickdillon
Copy link
Contributor

/approve
/hold cancel
The disks question is just that they're deleting different kinds of disks

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 21, 2024
Copy link
Contributor

openshift-ci bot commented Nov 21, 2024

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: patrickdillon

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Nov 21, 2024
@openshift-ci-robot
Copy link
Contributor

/retest-required

Remaining retests: 0 against base HEAD 545c830 and 2 for PR HEAD 338e0c9 in total

Copy link
Contributor

openshift-ci bot commented Nov 22, 2024

@barbacbd: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@openshift-merge-bot openshift-merge-bot bot merged commit e018689 into openshift:master Nov 22, 2024
23 checks passed
@openshift-ci-robot
Copy link
Contributor

@barbacbd: Jira Issue OCPBUGS-44193: Some pull requests linked via external trackers have merged:

The following pull requests linked via external trackers have not merged:

These pull request must merge or be unlinked from the Jira bug in order for it to move to the next state. Once unlinked, request a bug refresh with /jira refresh.

Jira Issue OCPBUGS-44193 has not been moved to the MODIFIED state.

In response to this:

The destroy code is using server side filtering on resources. The number of resources that
are filtered out (server side) are causing quota limits to be reached. Moving the filtering
to the client side will limit quota max errors.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@barbacbd
Copy link
Contributor Author

barbacbd commented Dec 6, 2024

/cherry-pick release-4.17

@openshift-cherrypick-robot

@barbacbd: new pull request created: #9289

In response to this:

/cherry-pick release-4.17

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged. platform/google
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants