Automate Non-functional Tests

[mpstefan]

After completing our manual non-functional testing and documenting the process, we should proceed to automate our non-functional tests so they do not incur additional toil on the release process.

The below stories are linked to a manual non-functional test. Each test should be automated to the point where a script can be manually ran to execute the test.

Tasks

Preview Give feedback

1. Automate Zero Downtime Upgrades Test #1364
   size/medium tests +2
   
2. Automate Graceful Recovery from Restarts Test #1365
   refined size/large tests +3
   
3. Automate Reconfiguration Performance Test #1367
   refined size/large tests +3
   
4. Automate Scale Test #1368
   refined size/medium tests +3
   
5. Automate Reload Count Test #1369
   tests +1
6. Automate Longevity Test #1366
   refined size/large tests +3
   
7. Automate Data Plane Performance Test #1286
   refined size/medium tests +3
   
8. Automate Zero Downtime Scaling Test #1435
   refined size/large tests +3
   
9. Automate Remaining Graceful-Recovery from Restarts tests #1901
   refined size/large tests +3