[e2e] Failing test capg-conformance-main-ci-artifacts - No Control Plane machines came into existence

[richardcase]

/kind failing-test
/help
/priority critical-urgent

What steps did you take and what happened:

The capg-conformance-main-ci-artifacts e2e test has been failing for some time and has been raised upstream in k/k as its release informing: kubernetes/kubernetes#120481

https://testgrid.k8s.io/sig-release-master-informing#capg-conformance-main-ci-artifacts

What did you expect to happen:

The test should be passing

[k8s-ci-robot]

@richardcase:
This request has been marked as needing help from a contributor.

Guidelines

Please ensure that the issue body includes answers to the following questions:

• Why are we solving this issue?
• To address this issue, are there any code changes? If there are code changes, what needs to be done in the code and what places can the assignee treat as reference points?
• Does this issue have zero to low barrier of entry?
• How can the assignee reach out to you for help?

For more details on the requirements of such an issue, please see here and ensure that they are met.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-help command.

In response to this:

/kind failing-test
/help
/priority critical-urgent

What steps did you take and what happened:

The capg-conformance-main-ci-artifacts e2e test has been failing for some time and has been raised upstream in k/k as its release informing: kubernetes/kubernetes#120481

https://testgrid.k8s.io/sig-release-master-informing#capg-conformance-main-ci-artifacts

What did you expect to happen:

The test should be passing

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[richardcase]

/assign
/lifecycle active

[richardcase]

Running locally and logging into the control plane machine i am seeing the following failure when bootstrapping:

[2023-09-15 11:14:53] Cloud-init v. 23.2.2-0ubuntu0~22.04.1 running 'modules:config' at Fri, 15 Sep 2023 11:14:53 +0000. Up 27.19 seconds.
[2023-09-15 11:14:56] Cloud-init v. 23.2.2-0ubuntu0~22.04.1 running 'modules:final' at Fri, 15 Sep 2023 11:14:56 +0000. Up 30.16 seconds.
[2023-09-15 11:14:58] [init] Using Kubernetes version: v1.25.7
[2023-09-15 11:14:58] [preflight] Running pre-flight checks
[2023-09-15 11:14:59] error execution phase preflight: [preflight] Some fatal errors occurred:
[2023-09-15 11:14:59]   [ERROR KubeletVersion]: the kubelet version is higher than the control plane version. This is not a supported version skew and may lead to a malfunctional cluster. Kubelet version: "1.26.7" Control plane version: "1.25.7"

Checking if this is spurious with my local setup.

[richardcase]

That was a spurious error...i had an old k8s version set.

[cpanato]

thanks @richardcase i was looking at it as well, have a fix in a min

[richardcase]

Awesome, thanks @cpanato

The boostrapping is failing for me, still trying to get to the bottom of it. But if you have a fix then happy days 🎉

[cpanato]

/assign