Backport #4162 and #4172 [cluster-autoscaler] "Add a flag to control DaemonSet eviction on non-empty nodes and Allow DaemonSet pods to opt in/out from eviction" into 1.21

[Shubham82]

Which component this PR applies to?

cluster-autoscaler

What type of PR is this?

/kind feature

What this PR does / why we need it:

This PR is actually a backport which backport #4162 and #4172 in cluster-autoscaler-1.21

Which issue(s) this PR fixes:

Fixes #4830

Special notes for your reviewer:

Does this PR introduce a user-facing change?

Backport "Add a flag to control DaemonSet eviction on non-empty nodes and Allow DaemonSet pods to opt in/out from eviction". 

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:

None

[Shubham82]

Hi @feiskyer @towca
Could you please take a look!

[Shubham82]

@MaciekPytel @mwielgus
PTAL!

[Shubham82]

Hi @gjtempleton
PTAL!

[gjtempleton]

Hey, thanks for raising this.

I'm a bit wary on merging this as it appears to be a new feature rather than a bug-fix, and our preference is to backport only bug-fixes. Thoughts @MaciekPytel ?

Edit: FWIW, improving our docs on the release/contribution process, including our cherry-pick policy is on my list of things to do in the future.

[Shubham82]

Hi @gjtempleton, thanks for looking at this
something like this(feature) also backport previously. For ref #4700

[mwielgus]

/lgtm
/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: mwielgus, Shubham82

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• cluster-autoscaler/OWNERS [mwielgus]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment