E2E with HCP Consul/Vault

[tgross]

Use HCP Consul and HCP Vault for the Consul and Vault clusters used in E2E testing. This has the following benefits:

• Without the need to support mTLS bootstrapping for Consul and Vault, we can simplify the mTLS configuration by leaning on Terraform instead of janky bash shell scripting.
• Vault bootstrapping is no longer required, so we can eliminate even more janky shell scripting
• Our E2E exercises HCP, which is important to us as an organization
• With the reduction in configurability, we can simplify the Terraform configuration and drop the complicated provision.sh/provision.ps1 scripts we were using previously. We can template Nomad configuration files and upload them with the file provisioner.
• Packer builds for Linux and Windows become much simpler.

tl;dr way less janky shell scripting!

At this point I've tested out most of the E2E suite with this configuration, in particular the Connect and VaultSecrets suite that are the most likely to break. I still need to complete full testing. There was a parallel PR merged in the nomad-e2e repo to set up the infrastructure.

Follow-up issues:

• E2E: TestNodeDrainEphermeralMigrate should work with client ACLs #12314
• E2E: set consul.allow_unauthenticated = false on Nomad config #12315
• E2E: isolate Consul namespaces #12316

There will be a PR in the ENT repo for the ENT-only Consul namespaces test as well.

Tests passing against a current build of main from the Nomad ENT repo (plus a couple patches from this PR):

• affinities
• connect/Connect
• connect/ConnectACLs
• consul/Consul
• consul/ConsulNamespaces
• consultemplate
• csi
• deployment
• eval_priority
• events
• simple
• isolation
• lifecycle
• metrics
• namespaces
• networking
• nodedrain
• nomadexec
• oversubscription
• parameterized
• periodic
• quotas
• rescheduling
• scaling
• scalingpolicies
• scheduler_sysbatch
• scheduler_system
• spread
• taskevents
• vaultsecrets
• volumes

[hashicorp-cla]

All committers have signed the CLA.

[shoenig]

LGTM! My only real question is about the file permissions and maybe the consul user.

Thanks for doing this!

[lgfa29]

Great working getting this done 🎉

[github-actions]

I'm going to lock this pull request because it has been closed for 120 days ⏳. This helps our maintainers find and focus on the active contributions.
If you have found a problem that seems related to this change, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.