-
Notifications
You must be signed in to change notification settings - Fork 5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: filteredTests problem from #20974 #21019
Conversation
CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes. |
#20974 introduced a problem where now those filteredTests are not running in any CI step, this fixes it
095da05
to
89fe9ef
Compare
Codecov ReportPatch and project coverage have no change.
Additional details and impacted files@@ Coverage Diff @@
## develop #21019 +/- ##
========================================
Coverage 68.34% 68.34%
========================================
Files 1007 1007
Lines 40254 40254
Branches 10761 10761
========================================
Hits 27508 27508
Misses 12746 12746 ☔ View full report in Codecov by Sentry. |
Builds ready [89fe9ef]
Page Load Metrics (1622 ± 42 ms)
Bundle size diffs
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
@@ -1018,7 +1018,7 @@ jobs: | |||
command: | | |||
if .circleci/scripts/test-run-e2e.sh | |||
then | |||
yarn test:e2e:firefox:snaps --retries 2 --debug | |||
yarn test:e2e:firefox:snaps --retries 2 --debug --build-type=flask |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Interesting, so this missing build-type flag pre-dates #20974 correct? But it was still running the tests before #20974 because the filtering used not take effect if the build type wasn't set. Now it always filters for non-flask.
The way it works now seems better. Pretty confusing for the filtering to happen on main
but not if no build type was set, given that main
is the default. Good catch!
Description
#20974 introduced a problem where now those filteredTests are not running in any CI step, this fixes it
This is the problematic change. I added
--build-type=flask
to lines in config.yml to fix it.Also, there's an enormous amount of spam in the logs with lines like this
I put in something to limit the length of a [driver] log entry to 200 characters.
Manual testing steps
a. Note that, for instance, "Test Snap Lifecycle Hooks" are not being run
b. Note the huge amount of log spam
a. Note that "Test Snap Lifecycle Hooks" are being run (look in parallel run number 2)
b. Note the lack of log spam
Related issues
Fixes problem in #20974
Pre-merge author checklist
Pre-merge reviewer checklist