Upgrade multus chart to v4.0.2-build2023081100

[thomasferrandiz]

• Bump multus image to v4.0.2-build20230811 to solve: Multus 4.x broken with the lastest rke versions #4568
• Multus chart is now local because upstream was not maintained

Testing

To validate that the image fixes, the linked issue:

• deploy rke2 with multus
• save file /etc/cni/net.d/00-multus.conf
• kill and restart the multus pod for the node
• check that the file /etc/cni/net.d/00-multus.conf did not change after the pod restart

[thomasferrandiz]

/backport v1.26.9+rke2r1

[thomasferrandiz]

/backport v1.25.14+rke2r1

[thomasferrandiz]

/backport v1.24.17+rke2r1

[bguzman-3pillar]

Validated on with /

## RKE2 version used
rke2 version v1.27.5-rc1+rke2r1 (d3f409d4b5d7519a92dba046e47c61d0ed81b49a)
go version go1.20.7 X:boringcrypto

Environment Details

Infrastructure

• Cloud
• Hosted

Node(s) CPU architecture, OS, and Version:

## OS used to validate
PRETTY_NAME="Ubuntu 22.04.2 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.2 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy

Cluster Configuration:

1 server

Config.yaml:

Config file used
debug: true
token: crtesting
cni: multus,cilium

Testing Steps

1. Copy config.yaml

$ sudo mkdir -p /etc/rancher/rke2 && sudo cp config.yaml /etc/rancher/rke2

2. Install RKE2
3. Check pod multus version kubectl describe pod rke2-multus-ds-xw6qj -n kube-system | grep "v4.0.2-build20230811"
4. Check delegates before delete pod sudo cat /etc/cni/net.d/00-multus.conf.cilium_bak
5. Delete pod
6. Check delegates again, should NOT change.

Validation Results:

• rke2 version used for validation:

kubectl describe pod rke2-multus-ds-xw6qj -n kube-system | grep "v4.0.2-build20230811"
    Image:         rancher/hardened-multus-cni:v4.0.2-build20230811
  Normal   Pulling    12m                kubelet            Pulling image "rancher/hardened-multus-cni:v4.0.2-build20230811"
  Normal   Pulled     12m                kubelet            Successfully pulled image "rancher/hardened-multus-cni:v4.0.2-build20230811" in 19.434198332s (19.434208999s including waiting)
  Normal   Pulled     11m (x2 over 12m)  kubelet            Container image "rancher/hardened-multus-cni:v4.0.2-build20230811" already present on machine

## Before delete 

sudo cat /etc/cni/net.d/00-multus.conf.cilium_bak
{
        "cniVersion": "0.3.1",
        "name": "multus-cni-network",
        "type": "multus",
        "capabilities": {"portMappings":true},
        "kubeconfig": "/etc/cni/net.d/multus.d/multus.kubeconfig",
        "delegates": [
                {"cniVersion":"0.3.1","name":"portmap","plugins":[{"enable-debug":false,"log-file":"/var/run/cilium/cilium-cni.log","type":"cilium-cni"},{"capabilities":{"portMappings":true},"type":"portmap"}]}
        ]
}


kubectl delete pod rke2-multus-ds-xw6qj -n kube-system
pod "rke2-multus-ds-xw6qj" deleted


sudo cat /etc/cni/net.d/00-multus.conf.cilium_bak
{
        "cniVersion": "0.3.1",
        "name": "multus-cni-network",
        "type": "multus",
        "capabilities": {"portMappings":true},
        "kubeconfig": "/etc/cni/net.d/multus.d/multus.kubeconfig",
        "delegates": [
                {"cniVersion":"0.3.1","name":"portmap","plugins":[{"enable-debug":false,"log-file":"/var/run/cilium/cilium-cni.log","type":"cilium-cni"},{"capabilities":{"portMappings":true},"type":"portmap"}]}
        ]
}

kubectl get node,pod -A
NAME                    STATUS   ROLES                       AGE   VERSION
node/ip-172-31-30-239   Ready    control-plane,etcd,master   25m   v1.27.5+rke2r1

NAMESPACE     NAME                                                        READY   STATUS      RESTARTS   AGE
kube-system   pod/cilium-operator-564b8bb44-2h4f8                         0/1     Pending     0          24m
kube-system   pod/cilium-operator-564b8bb44-lmjhj                         1/1     Running     0          24m
kube-system   pod/cilium-vgqjh                                            1/1     Running     0          24m
kube-system   pod/cloud-controller-manager-ip-172-31-30-239               1/1     Running     0          25m
kube-system   pod/etcd-ip-172-31-30-239                                   1/1     Running     0          24m
kube-system   pod/helm-install-rke2-cilium-fztqc                          0/1     Completed   0          25m
kube-system   pod/helm-install-rke2-coredns-cn276                         0/1     Completed   0          25m
kube-system   pod/helm-install-rke2-ingress-nginx-b2f6v                   0/1     Completed   0          25m
kube-system   pod/helm-install-rke2-metrics-server-2k8wl                  0/1     Completed   0          25m
kube-system   pod/helm-install-rke2-multus-wq96z                          0/1     Completed   0          25m
kube-system   pod/helm-install-rke2-snapshot-controller-9tf7r             0/1     Completed   1          25m
kube-system   pod/helm-install-rke2-snapshot-controller-crd-52ljw         0/1     Completed   0          25m
kube-system   pod/helm-install-rke2-snapshot-validation-webhook-jsvdz     0/1     Completed   0          25m
kube-system   pod/kube-apiserver-ip-172-31-30-239                         1/1     Running     0          25m
kube-system   pod/kube-controller-manager-ip-172-31-30-239                1/1     Running     0          25m
kube-system   pod/kube-proxy-ip-172-31-30-239                             1/1     Running     0          25m
kube-system   pod/kube-scheduler-ip-172-31-30-239                         1/1     Running     0          25m
kube-system   pod/rke2-coredns-rke2-coredns-5f5d6b54c7-qbgcz              1/1     Running     0          24m
kube-system   pod/rke2-coredns-rke2-coredns-autoscaler-6bf8f59fd5-sfpld   1/1     Running     0          24m
kube-system   pod/rke2-ingress-nginx-controller-pjtrz                     1/1     Running     0          23m
kube-system   pod/rke2-metrics-server-6d79d977db-8qcmq                    1/1     Running     0          23m
kube-system   pod/rke2-multus-ds-m6r9w                                    1/1     Running     0          11m
kube-system   pod/rke2-snapshot-controller-7d6476d7cb-8tcp5               1/1     Running     0          23m
kube-system   pod/rke2-snapshot-validation-webhook-5649fbd66c-nd98m       1/1     Running     0          23m