Parallelize tests run on GitHub Actions #425
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
In addition to being broken down by OS, tests are now also broken down by
major type (ide, api, unit) and browser (chrome, firefox, edge, safari)
for ide and api tests.
Observations:
GitHub Actions UI
of the former ~15m
address, right?
unit windows
has failed, I can rerun it alone via the GitHub UI.The current tests only invoke chrome and firefox for ide testing, so
I've stuck with that. Api testing matches current browser defaults.
I'm liking keeping the brunt of the work out of yaml and in babashka
tasks. The yaml has a setup job which:
bb script/test.clj matrix-for-ci --format=json
The build task then:
launching a virtual display (necessary for GitHub Actions)
Of note:
tests) and the name of the test being run. This feedback is nice
especially for api tests which are long-running. It also helps to
validate we are testing what we think we are testing.
^:unit
metadata to unit test namespaceshow powershell needs a little help in propagating return codes.
the existing
ETAOIN_TEST_DRIVERS
env var for api tests and introducedETAOIN_IDE_TEST_DRIVERS
for ide tests.existing bb tools-versions script accordingly
Closes #420