fix tilt live reload for capz-controller-manager

[nojnhuh]

What type of PR is this?
/kind bug

What this PR does / why we need it: This PR fixes an issue where Tilt was failing to perform live updates of capz-controller-manager due to insufficient permissions on the parent directory of the manager binary. This change moves the Tilt-specific files in the CAPZ container into a new /tilt directory with world-writeable permissions so the non-root user running the container newly specified in #3399 is able to delete the old manager binary.

Which issue(s) this PR fixes (optional, in fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
Fixes #3497

Special notes for your reviewer:

• cherry-pick candidate (add explicit securityContexts to the controller and namespace label for privileged #3399 was not cherry picked so release branches are not affected)

TODOs:

• squashed commits
• includes documentation
• adds unit tests

Release note:

NONE

[mboersma]

/lgtm

Thank you for fixing this! I tested it locally and it seems to work.

I assume this was another victim of the distroless update? We had to do a similar permissions hack for process.txt.

[k8s-ci-robot]

LGTM label has been added.

Git tree hash: a37e8f3d5f42649568b4f6cebcbef2426a8679cc

[nojnhuh]

I assume this was another victim of the distroless update? We had to do a similar permissions hack for process.txt.

What changed in the distroless image? I think this issue was more related to the capz-controller-manager container now running as non-root. But since the Tilt-flavored image is built as root, then the tilt scripts and manager binary are all owned by root and not world-writeable which the live reload steps would need to run as non-root.

[CecileRobertMichon]

/approve

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: CecileRobertMichon

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [CecileRobertMichon]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment