Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VMSS e2e test flake during drain #2120

Closed
CecileRobertMichon opened this issue Feb 24, 2022 · 3 comments · Fixed by #2123
Closed

VMSS e2e test flake during drain #2120

CecileRobertMichon opened this issue Feb 24, 2022 · 3 comments · Fixed by #2123
Assignees
Labels
help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/bug Categorizes issue or PR as related to a bug.

Comments

@CecileRobertMichon
Copy link
Contributor

/kind bug

[Before submitting an issue, have you checked the Troubleshooting Guide?]

What steps did you take and what happened:
[A clear and concise description of what the bug is.]

VMSS cluster test sometimes fails with:

1/24 Tests Failed. | expand_less
-- | --
capz-e2e: Workload cluster creation Creating a VMSS cluster [REQUIRED] with a single control plane node and an AzureMachinePool with 2 Linux and 2 Windows worker nodes expand_less23m13s/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/test/e2e/azure_test.go:336 Unexpected error:     <*errors.StatusError \| 0xc00089f4a0>: {         ErrStatus: {             TypeMeta: {Kind: "", APIVersion: ""},             ListMeta: {                 SelfLink: "",                 ResourceVersion: "",                 Continue: "",                 RemainingItemCount: nil,             },             Status: "Failure",             Message: "nodes \"capz-e2e-e987kg-vmss-mp-0000000\" not found",             Reason: "NotFound",             Details: {                 Name: "capz-e2e-e987kg-vmss-mp-0000000",                 Group: "",                 Kind: "nodes",                 UID: "",                 Causes: nil,                 RetryAfterSeconds: 0,             },             Code: 404,         },     }     nodes "capz-e2e-e987kg-vmss-mp-0000000" not found occurred /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/test/e2e/azure_machinepool_drain.go:204 | capz-e2e: Workload cluster creation Creating a VMSS cluster [REQUIRED] with a single control plane node and an AzureMachinePool with 2 Linux and 2 Windows worker nodes expand_less | 23m13s | /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/test/e2e/azure_test.go:336 Unexpected error:     <*errors.StatusError \| 0xc00089f4a0>: {         ErrStatus: {             TypeMeta: {Kind: "", APIVersion: ""},             ListMeta: {                 SelfLink: "",                 ResourceVersion: "",                 Continue: "",                 RemainingItemCount: nil,             },             Status: "Failure",             Message: "nodes \"capz-e2e-e987kg-vmss-mp-0000000\" not found",             Reason: "NotFound",             Details: {                 Name: "capz-e2e-e987kg-vmss-mp-0000000",                 Group: "",                 Kind: "nodes",                 UID: "",                 Causes: nil,                 RetryAfterSeconds: 0,             },             Code: 404,         },     }     nodes "capz-e2e-e987kg-vmss-mp-0000000" not found occurred /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/test/e2e/azure_machinepool_drain.go:204
capz-e2e: Workload cluster creation Creating a VMSS cluster [REQUIRED] with a single control plane node and an AzureMachinePool with 2 Linux and 2 Windows worker nodes expand_less | 23m13s
/home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/test/e2e/azure_test.go:336 Unexpected error:     <*errors.StatusError \| 0xc00089f4a0>: {         ErrStatus: {             TypeMeta: {Kind: "", APIVersion: ""},             ListMeta: {                 SelfLink: "",                 ResourceVersion: "",                 Continue: "",                 RemainingItemCount: nil,             },             Status: "Failure",             Message: "nodes \"capz-e2e-e987kg-vmss-mp-0000000\" not found",             Reason: "NotFound",             Details: {                 Name: "capz-e2e-e987kg-vmss-mp-0000000",                 Group: "",                 Kind: "nodes",                 UID: "",                 Causes: nil,                 RetryAfterSeconds: 0,             },             Code: 404,         },     }     nodes "capz-e2e-e987kg-vmss-mp-0000000" not found occurred /home/prow/go/src/sigs.k8s.io/cluster-api-provider-azure/test/e2e/azure_machinepool_drain.go:204

Example PR where this happened: #2119

What did you expect to happen:

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

Environment:

  • cluster-api-provider-azure version:
  • Kubernetes version: (use kubectl version):
  • OS (e.g. from /etc/os-release):
@k8s-ci-robot k8s-ci-robot added the kind/bug Categorizes issue or PR as related to a bug. label Feb 24, 2022
@CecileRobertMichon
Copy link
Contributor Author

/help

@k8s-ci-robot
Copy link
Contributor

@CecileRobertMichon:
This request has been marked as needing help from a contributor.

Guidelines

Please ensure that the issue body includes answers to the following questions:

  • Why are we solving this issue?
  • To address this issue, are there any code changes? If there are code changes, what needs to be done in the code and what places can the assignee treat as reference points?
  • Does this issue have zero to low barrier of entry?
  • How can the assignee reach out to you for help?

For more details on the requirements of such an issue, please see here and ensure that they are met.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

/help

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot k8s-ci-robot added the help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. label Feb 24, 2022
@CecileRobertMichon
Copy link
Contributor Author

/assign @jackfrancis

to introduce retries

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants