CI: refactor how e2e tests are run in github actions #1175
Labels
good first issue
Good for newcomers
scope: testing
Code review, testing, making sure the code is following the specification.
type: tech-debt
Slows down development in the long run
At present e2e tests are part of the
Automated tests
job which runs unit-, integration- and e2e-tests sequentially.It would be beneficial to split e2e tests from unit- and integration-tests to simplify the the result reporting.
e2e happy path should run separately from other tests and have its own workflow file. The job's name should be
e2e-happy-path
and it should run on every push/commit.Sources:
Additionally, the manual-e2e and nightly-e2e test runs should be refactored to include multiple tests runs instead of running all e2e test scenarios sequentially.
e.g. the jobs can be changed to include multiple job sections:
Most of the logic regarding the test starts existis in main.go which the Makefile uses to start the tests. The
Makefile
andmain.go
flags may need to be extended to support running the distinct paths individually.Note:
Check the comments in #1179 and consider splitting happy path into 2 smaller jobs - one with normal downtime and the other with soft opt-out/throttling downtime. That will require changes in the testing suite.
The text was updated successfully, but these errors were encountered: