refactor: optimize flags and SetLabel #4908

Job	Run time
default	14m 57s
push	0s
tag	0s
e2e-docker-short	45s
e2e-iso	3m 16s
integration-aws-nvidia-nonfree	0s
e2e-qemu-short	3m 39s
integration-aws	0s
integration-azure	0s
integration-cilium	0s
integration-aws-nvidia-oss	0s
integration-cloud-images	0s
integration-conformance	0s
integration-equinix-metal	0s
integration-extensions	0s
integration-image-factory	0s
integration-images	0s
integration-gcp	0s
integration-misc-0	0s
integration-misc-1	0s
integration-misc-2	0s
integration-misc-3	0s
integration-misc-4	0s
integration-provision-0	0s
integration-provision-1	0s
integration-provision-2	0s
integration-qemu-csi-rook-ceph	0s
integration-qemu-csi-longhorn	0s
integration-qemu	0s
integration-qemu-encrypted-vip	0s
integration-reproducibility-test	0s
integration-qemu-race	0s
integration-trusted-boot	0s
	22m 37s

Provide feedback