Automate Zero Downtime Scaling Test

[mpstefan]

As a maintainer of NGF
I want to automate the zero downtime scaling test
So that I do not need to run it manually in the future.

Acceptance

• The zero downtime scaling test is automated to the point of being able to run the entire test from running a script.
• The relevant results of the test are output as a result of the test.

[github-actions]

This issue is stale because it has been open 14 days with no activity. Remove stale label or comment or this will be closed in 14 days.

[sjberman]

@kate-osborn For the sake of automation, do you think we can adjust this test to use a single cluster? Right now it uses a 10 node cluster to ensure NGF is running multiple Pods on one node, and a 25 node cluster to ensure NGF runs 1 Pod per node.

Maybe we run with a 10 node cluster and run one test with 10 NGF Pods, and one test with 25 NGF pods. This way our pipeline doesn't need to manage two clusters, and we still test the same thing. Does that sound ok?

[kate-osborn]

@sjberman yes, that sounds good