Annotation to protect tenant from accidental deletion

[MaxFedotov]

Now if we delete a tenant all tenant namespaces are deleted automatically by kubernetes garbage collector. To protect critical tenants from accidental deletion (e.g. wrong commit to ci\cd system) it would be good to have some annotation, like
capsule.clastix.io/protected, which will make capsule-controller to ignore tenant deletion and instead add event and message to a log.

@prometherion WDYT?

[bsctl]

@MaxFedotov we have a customer having the same request. We solved by adding a finalizer, so tenant cannot be deleted accidentally.

[MaxFedotov]

@bsctl the tenant won't be deleted. But resources from tenant namespace will be deleted and namespaces would be stuck in Terminating state (I've just verified this in our staging environment by making accidental commit which removed system tenant, where we install all our additional cluster components :) )

[prometherion]

What about using the actual webhook handlers to prevent deletion? We got already /tenant, it's just a matter of adding a new handler.

[MaxFedotov]

yep, can add it there :) are you ok with annotation name?