Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cluster API: Bump CAPI jobs for k8s 1.27 #29295

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -1,56 +1,5 @@
periodics:

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the following is missing:

For the main branch:

  • periodics & presubmits:
    • Bump KUBEBUILDER_ENVTEST_KUBERNETES_VERSION of the test-mink8s jobs to the new minimum supported management cluster version.
  • periodics:
    • Bump KUBERNETES_VERSION_MANAGEMENT of the e2e-mink8s job to the new minimum supported management cluster version.

Explanation:

With this PR we are supporting a new Kubernetes version v1.27. This moves our entire support range on the main branch up by one.

  • mgmt cluster: v1.24-v1.27
  • workload cluster: v1.22-v1.27

So KUBEBUILDER_ENVTEST_KUBERNETES_VERSION should be set to: v1.24.2

./hack/tools/bin/setup-envtest  list | grep v1.24
(available)  v1.24.2  linux/amd64
(available)  v1.24.1  linux/amd64

(we probably should improve the comment above the KUBEBUILDER_ENVTEST_KUBERNETES_VERSION env var here)

KUBERNETES_VERSION_MANAGEMENT should be set to "stable-1.24"

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sbueringer thanks a lot for detailed explanation and review, I should have addressed all your comments in the last commit(ff2c96a). PTAL.

lgtm pending squash

I will squash all commits once reviewers are happy with the state of the patch.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks perfect, thank you!

I will squash all commits once reviewers are happy with the state of the patch.

Sounds reasonable :)

- name: periodic-cluster-api-e2e-workload-upgrade-1-21-1-22-main
interval: 24h
decorate: true
decoration_config:
gcs_credentials_secret: "" # Use workload identity for uploading artifacts
rerun_auth_config:
github_team_slugs:
- org: kubernetes-sigs
slug: cluster-api-maintainers
labels:
preset-dind-enabled: "true"
preset-kind-volume-mounts: "true"
extra_refs:
- org: kubernetes-sigs
repo: cluster-api
base_ref: main
path_alias: sigs.k8s.io/cluster-api
- org: kubernetes
repo: kubernetes
base_ref: master
path_alias: k8s.io/kubernetes
spec:
serviceAccountName: prowjob-default-sa
containers:
- image: gcr.io/k8s-staging-test-infra/kubekins-e2e:v20230406-23cb1879e3-1.26
args:
- runner.sh
- "./scripts/ci-e2e.sh"
env:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.21"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "stable-1.22"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.3-0"
- name: COREDNS_VERSION_UPGRADE_TO
value: "v1.8.4"
- name: GINKGO_FOCUS
value: "\\[K8s-Upgrade\\]"
# we need privileged mode in order to do docker in docker
securityContext:
privileged: true
resources:
requests:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api
testgrid-tab-name: capi-e2e-main-1-21-1-22
testgrid-alert-email: [email protected]
testgrid-num-failures-to-alert: "4"

- name: periodic-cluster-api-e2e-workload-upgrade-1-22-1-23-main
interval: 24h
decorate: true
Expand Down Expand Up @@ -255,7 +204,7 @@ periodics:
testgrid-alert-email: [email protected]
testgrid-num-failures-to-alert: "4"

- name: periodic-cluster-api-e2e-workload-upgrade-1-26-latest-main
- name: periodic-cluster-api-e2e-workload-upgrade-1-26-1-27-main
interval: 24h
decorate: true
decoration_config:
Expand Down Expand Up @@ -287,7 +236,7 @@ periodics:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.26"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.27"
value: "stable-1.27"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.6-0"
- name: COREDNS_VERSION_UPGRADE_TO
Expand All @@ -302,6 +251,57 @@ periodics:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api
testgrid-tab-name: capi-e2e-main-1-26-latest
testgrid-tab-name: capi-e2e-main-1-26-1-27
testgrid-alert-email: [email protected]
testgrid-num-failures-to-alert: "4"

- name: periodic-cluster-api-e2e-workload-upgrade-1-27-latest-main
interval: 24h
decorate: true
decoration_config:
gcs_credentials_secret: "" # Use workload identity for uploading artifacts
rerun_auth_config:
github_team_slugs:
- org: kubernetes-sigs
slug: cluster-api-maintainers
labels:
preset-dind-enabled: "true"
preset-kind-volume-mounts: "true"
extra_refs:
- org: kubernetes-sigs
repo: cluster-api
base_ref: main
path_alias: sigs.k8s.io/cluster-api
- org: kubernetes
repo: kubernetes
base_ref: master
path_alias: k8s.io/kubernetes
spec:
serviceAccountName: prowjob-default-sa
containers:
- image: gcr.io/k8s-staging-test-infra/kubekins-e2e:v20230406-23cb1879e3-1.26
args:
- runner.sh
- "./scripts/ci-e2e.sh"
env:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.27"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.28"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.7-0"
- name: COREDNS_VERSION_UPGRADE_TO
value: "v1.10.1"
- name: GINKGO_FOCUS
value: "\\[K8s-Upgrade\\]"
# we need privileged mode in order to do docker in docker
securityContext:
privileged: true
resources:
requests:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api
testgrid-tab-name: capi-e2e-main-1-27-latest
testgrid-alert-email: [email protected]
testgrid-num-failures-to-alert: "4"
Original file line number Diff line number Diff line change
Expand Up @@ -51,12 +51,14 @@ periodics:
- ./scripts/ci-test.sh
env:
# This value determines the minimum Kubernetes
# supported version for Cluster API management cluster.
# supported version for Cluster API management cluster
# and can be found by referring to [Supported Kubernetes Version](https://cluster-api.sigs.k8s.io/reference/versions.html#supported-kubernetes-versions)
# docs (look for minimum supported k8s version for management cluster, i.e N-3).
#
# To check the available envtest in Kubebuilder, please
# To check the latest available envtest in Kubebuilder for the minor version we determined above, please
# refer to https://github.com/kubernetes-sigs/kubebuilder/tree/tools-releases.
- name: KUBEBUILDER_ENVTEST_KUBERNETES_VERSION
value: "1.23.5"
value: "1.24.2"
resources:
requests:
cpu: 7300m
Expand Down Expand Up @@ -143,7 +145,7 @@ periodics:
# This value determines the minimum Kubernetes
# supported version for Cluster API management cluster.
- name: KUBERNETES_VERSION_MANAGEMENT
value: "stable-1.23"
value: "stable-1.24"
# we need privileged mode in order to do docker in docker
securityContext:
privileged: true
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -254,7 +254,7 @@ periodics:
testgrid-alert-email: [email protected]
testgrid-num-failures-to-alert: "4"

- name: periodic-cluster-api-e2e-workload-upgrade-1-26-latest-release-1-4
- name: periodic-cluster-api-e2e-workload-upgrade-1-26-1-27-release-1-4
interval: 24h
decorate: true
decoration_config:
Expand Down Expand Up @@ -286,7 +286,7 @@ periodics:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.26"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.27"
value: "stable-1.27"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.6-0"
- name: COREDNS_VERSION_UPGRADE_TO
Expand All @@ -301,6 +301,57 @@ periodics:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.4
testgrid-tab-name: capi-e2e-release-1-4-1-26-latest
testgrid-tab-name: capi-e2e-release-1-4-1-26-1-27
testgrid-alert-email: [email protected]
testgrid-num-failures-to-alert: "4"

- name: periodic-cluster-api-e2e-workload-upgrade-1-27-latest-release-1-4
interval: 24h
decorate: true
decoration_config:
gcs_credentials_secret: "" # Use workload identity for uploading artifacts
rerun_auth_config:
github_team_slugs:
- org: kubernetes-sigs
slug: cluster-api-maintainers
labels:
preset-dind-enabled: "true"
preset-kind-volume-mounts: "true"
extra_refs:
- org: kubernetes-sigs
repo: cluster-api
base_ref: release-1.4
path_alias: sigs.k8s.io/cluster-api
- org: kubernetes
repo: kubernetes
base_ref: master
path_alias: k8s.io/kubernetes
spec:
serviceAccountName: prowjob-default-sa
containers:
- image: gcr.io/k8s-staging-test-infra/kubekins-e2e:v20230406-23cb1879e3-1.26
args:
- runner.sh
- "./scripts/ci-e2e.sh"
env:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.27"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.28"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.7-0"
- name: COREDNS_VERSION_UPGRADE_TO
value: "v1.10.1"
- name: GINKGO_FOCUS
value: "\\[K8s-Upgrade\\]"
# we need privileged mode in order to do docker in docker
securityContext:
privileged: true
resources:
requests:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.4
testgrid-tab-name: capi-e2e-release-1-4-1-27-latest
testgrid-alert-email: [email protected]
testgrid-num-failures-to-alert: "4"
Original file line number Diff line number Diff line change
Expand Up @@ -105,12 +105,14 @@ presubmits:
- ./scripts/ci-test.sh
env:
# This value determines the minimum Kubernetes
# supported version for Cluster API management cluster.
# supported version for Cluster API management cluster
# and can be found by referring to [Supported Kubernetes Version](https://cluster-api.sigs.k8s.io/reference/versions.html#supported-kubernetes-versions)
# docs (look for minimum supported k8s version for management cluster, i.e N-3).
#
# To check the available envtest in Kubebuilder, please
# To check the latest available envtest in Kubebuilder for the minor version we determined above, please
# refer to https://github.com/kubernetes-sigs/kubebuilder/tree/tools-releases.
- name: KUBEBUILDER_ENVTEST_KUBERNETES_VERSION
value: "1.23.5"
value: "1.24.2"
resources:
requests:
cpu: 7300m
Expand Down Expand Up @@ -254,7 +256,7 @@ presubmits:
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api
testgrid-tab-name: capi-pr-e2e-full-main
- name: pull-cluster-api-e2e-workload-upgrade-1-26-latest-main
- name: pull-cluster-api-e2e-workload-upgrade-1-27-latest-main
labels:
preset-dind-enabled: "true"
preset-kind-volume-mounts: "true"
Expand All @@ -281,13 +283,13 @@ presubmits:
- "./scripts/ci-e2e.sh"
env:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.26"
value: "stable-1.27"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.27"
value: "ci/latest-1.28"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.6-0"
value: "3.5.7-0"
- name: COREDNS_VERSION_UPGRADE_TO
value: "v1.9.3"
value: "v1.10.1"
- name: GINKGO_FOCUS
value: "\\[K8s-Upgrade\\]"
# we need privileged mode in order to do docker in docker
Expand All @@ -298,7 +300,7 @@ presubmits:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api
testgrid-tab-name: capi-pr-e2e-main-1-26-latest
testgrid-tab-name: capi-pr-e2e-main-1-27-latest
# This job is experimental for now. Please do not duplicate it to release branches.
- name: pull-cluster-api-e2e-scale-main-experimental
labels:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -250,7 +250,7 @@ presubmits:
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.2
testgrid-tab-name: capi-pr-e2e-full-release-1-2
- name: pull-cluster-api-e2e-workload-upgrade-1-26-latest-release-1-2
- name: pull-cluster-api-e2e-workload-upgrade-1-25-1-26-release-1-2
labels:
preset-dind-enabled: "true"
preset-kind-volume-mounts: "true"
Expand All @@ -277,9 +277,9 @@ presubmits:
- "./scripts/ci-e2e.sh"
env:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.26"
value: "stable-1.25"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.27"
value: "stable-1.26"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.6-0"
- name: COREDNS_VERSION_UPGRADE_TO
Expand All @@ -294,4 +294,4 @@ presubmits:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.2
testgrid-tab-name: capi-pr-e2e-release-1-2-1-26-latest
testgrid-tab-name: capi-pr-e2e-release-1-2-1-25-1-26
Original file line number Diff line number Diff line change
Expand Up @@ -245,7 +245,7 @@ presubmits:
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.3
testgrid-tab-name: capi-pr-e2e-full-release-1-3
- name: pull-cluster-api-e2e-workload-upgrade-1-26-latest-release-1-3
- name: pull-cluster-api-e2e-workload-upgrade-1-25-1-26-release-1-3
labels:
preset-dind-enabled: "true"
preset-kind-volume-mounts: "true"
Expand All @@ -271,9 +271,9 @@ presubmits:
- "./scripts/ci-e2e.sh"
env:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.26"
value: "stable-1.25"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.27"
value: "stable-1.26"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.6-0"
- name: COREDNS_VERSION_UPGRADE_TO
Expand All @@ -288,4 +288,4 @@ presubmits:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.3
testgrid-tab-name: capi-pr-e2e-release-1-3-1-26-latest
testgrid-tab-name: capi-pr-e2e-release-1-3-1-25-1-26
Original file line number Diff line number Diff line change
Expand Up @@ -254,7 +254,7 @@ presubmits:
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.4
testgrid-tab-name: capi-pr-e2e-full-release-1-4
- name: pull-cluster-api-e2e-workload-upgrade-1-26-latest-release-1-4
- name: pull-cluster-api-e2e-workload-upgrade-1-27-latest-release-1-4
labels:
preset-dind-enabled: "true"
preset-kind-volume-mounts: "true"
Expand All @@ -281,13 +281,13 @@ presubmits:
- "./scripts/ci-e2e.sh"
env:
- name: KUBERNETES_VERSION_UPGRADE_FROM
value: "stable-1.26"
value: "stable-1.27"
- name: KUBERNETES_VERSION_UPGRADE_TO
value: "ci/latest-1.27"
value: "ci/latest-1.28"
- name: ETCD_VERSION_UPGRADE_TO
value: "3.5.6-0"
value: "3.5.7-0"
- name: COREDNS_VERSION_UPGRADE_TO
value: "v1.9.3"
value: "v1.10.1"
- name: GINKGO_FOCUS
value: "\\[K8s-Upgrade\\]"
# we need privileged mode in order to do docker in docker
Expand All @@ -298,7 +298,7 @@ presubmits:
cpu: 7300m
annotations:
testgrid-dashboards: sig-cluster-lifecycle-cluster-api-1.4
testgrid-tab-name: capi-pr-e2e-release-1-4-1-26-latest
testgrid-tab-name: capi-pr-e2e-release-1-4-1-27-latest
# This job is experimental for now. Please do not duplicate it to release branches.
- name: pull-cluster-api-e2e-scale-release-1-4-experimental
labels:
Expand Down