Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] TestAllJobs - create separate jobs for Auth and Firestore #7353

Merged
merged 21 commits into from
Jun 26, 2023

Conversation

DellaBitta
Copy link
Contributor

@DellaBitta DellaBitta commented Jun 6, 2023

Discussion

Created separate jobs in the Test All workflow for both Auth and Firestore. These two tests have a history of flaking when execute in the same job as the other tests. Breaking them-out into their own jobs may reduce the flake and isolate re-attempts at executing the test.

Also created a step to build the SDK. The various test domains (Auth, Firestore and the rest) no use the results from the build step to run the tests. This reduces the time needed to re-run flakey tests from 40 minutes to:

  • Auth: ~8 minutes
  • Firestore: ~15 minutes
  • Others: ~15 minutes

Testing

Updated the CI Workflow. Test has executed successfully (here's an example).

API Changes

N/A, CI and the addition of new build targets only.

@changeset-bot
Copy link

changeset-bot bot commented Jun 6, 2023

⚠️ No Changeset found

Latest commit: 7652f23

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@google-oss-bot
Copy link
Contributor

google-oss-bot commented Jun 6, 2023

@google-oss-bot
Copy link
Contributor

google-oss-bot commented Jun 6, 2023

@DellaBitta DellaBitta marked this pull request as ready for review June 6, 2023 20:56
@DellaBitta DellaBitta requested review from dwyfrequency, hsubox76 and a team as code owners June 6, 2023 20:56
package.json Outdated Show resolved Hide resolved
package.json Outdated Show resolved Hide resolved
package.json Outdated Show resolved Hide resolved
package.json Outdated
@@ -24,14 +24,18 @@
"dev": "lerna run --parallel --scope @firebase/* --scope firebase dev",
"build": "lerna run --scope @firebase/* --scope firebase build",
"build:changed": "ts-node-script scripts/ci-test/build_changed.ts",
"build:ci:auth": "lerna run build:deps --scope '@firebase/auth*'",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment regarding putting the command directly in the workflow.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

node scripts/print_test_logs.js
env:
FIREBASE_TOKEN: ${{ secrets.FIREBASE_CLI_TOKEN }}
- name: Generate coverage file
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm curious what the coverage step is going to do when it only has a subset of packages to work with but as it apparently currently doesn't work at all https://coveralls.io/github/firebase/firebase-js-sdk?branch=master I don't think it's an immediate concern. Future todo to figure out why it hasn't been working I guess.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I wasn't quite sure about this either.

@DellaBitta DellaBitta requested a review from hsubox76 June 7, 2023 17:08
.github/workflows/test-all.yml Show resolved Hide resolved
.github/workflows/test-all.yml Outdated Show resolved Hide resolved
@DellaBitta DellaBitta requested a review from hsubox76 June 14, 2023 19:55
@DellaBitta DellaBitta merged commit 114bc6e into master Jun 26, 2023
@DellaBitta DellaBitta deleted the ddb-test-all-jobs branch June 26, 2023 21:35
@firebase firebase locked and limited conversation to collaborators Jul 27, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants