Policy failed on first attempt

[rabin-io]

What happened:

NMSTATE fails to come together and activate the policy on all servers, several attempts are required until the policy (no change, only an update of the description) succeeds in applying to all servers.

What you expected to happen:

Success on the first try

How to reproduce it (as minimally and precisely as possible):

NNCP yaml is provided

yamls.tar.gz

Anything else we need to know?:

Environment:

• NodeNetworkState on affected nodes (use kubectl get nodenetworkstate <node_name> -o yaml):
• Problematic NodeNetworkConfigurationPolicy:
• kubernetes-nmstate image (use kubectl get pods --all-namespaces -l app=kubernetes-nmstate -o jsonpath='{.items[0].spec.containers[0].image}'):

registry.redhat.io/openshift4/ose-kubernetes-nmstate-handler-rhel9@sha256:412a734bcc0846d38dd336c0240d54c6df92f306d58e850e7f3486754519634d%

• NetworkManager version (use nmcli --version)

nmcli tool, version 1.42.2-24.el9_2

• Kubernetes version (use kubectl version):

OpenShift 4.14.36 / k8s 1.27

• OS (e.g. from /etc/os-release):
• Others:

[qinqon]

@rabin-io what is the error ?

[rabin-io]

Some nodes (randomly), will just fail to configure with FailedToConfigure error.
I captured the DHCP traffic from all the nodes, and the DHCP server itself, if this can help with understanding the issue.