Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Refactor e2e tests to be less flaky (no-changelog) #9695

Merged
merged 16 commits into from
Jun 11, 2024
Merged

Conversation

netroy
Copy link
Member

@netroy netroy commented Jun 11, 2024

This PR

  1. improves how we mock /rest/settings, and makes it consistent across the tests, and making one of the tests less flaky (where we had two interceptors racing)
  2. reduces various keystroke delays to make the tests run tiny bit faster
  3. mocks all external api calls, so that external resources don't make e2e tests flaky
  4. brings back some of the e2e tests that we deleted in refactor: Remove skipped tests (no-changelog) #9497 (because they were marked with .skip)
  5. reduces the number of containers to the recommended value by cypress cloud
  6. bumps cypress related dependencies
  7. re-enables all tests in 18-user-management.cy.ts that were accidentally disabled
  8. sets up additional linting for e2e tests with eslint-plugin-cypress , and also blocks .skip and .only on e2e tests

Review / Merge checklist

  • PR title and summary are descriptive
  • Tests included

@netroy netroy requested a review from MiloradFilipovic June 11, 2024 08:02

This comment was marked as outdated.

@n8n-assistant n8n-assistant bot added the n8n team Authored by the n8n team label Jun 11, 2024
@netroy netroy marked this pull request as ready for review June 11, 2024 11:37
Copy link
Member

@alexgrozav alexgrozav left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😍

Copy link
Contributor

✅ All Cypress E2E specs passed

@netroy netroy merged commit 3d0393c into master Jun 11, 2024
27 checks passed
@netroy netroy deleted the e2e-refactor branch June 11, 2024 12:45
MiloradFilipovic added a commit that referenced this pull request Jun 11, 2024
* master:
  ci: Fix custom docker builds (no-changelog) (#9702)
  test: Fix e2e for projects missing instance owner (no-changelog) (#9703)
  ci: Refactor e2e tests to be less flaky (no-changelog) (#9695)
  feat(editor): Add move resources option to workflows and credentials on (#9654)
  fix: Introduce `HooksService` (#8962)
  fix(editor): Improve large data warning in input/output panel (#9671)
  ci(editor): Enforce type-safety in @n8n/chat builds as well (no-changelog) (#9685)
  fix(editor): Un-skip workflow save test (no-changelog) (#9698)
  refactor(core): Remove more dead code from event bus (no-changelog) (#9697)
  ci: Remove unused WaitTracker mocking (no-changelog) (#9694)
  feat: Update NPS Value Survey (#9638)
  refactor(core): Remove event bus channel (no-changelog) (#9663)
  refactor(core): Remove event bus helpers (no-changelog) (#9690)
  refactor(core): Merge event bus controllers and remove dead code (no-changelog) (#9688)
  ci: Fix e2e tests (no-changelog) (#9689)
  refactor(core): Use `@Licensed()` in event bus controller (no-changelog) (#9687)
  fix(editor): Node background for executing nodes in dark mode (#9682)
  fix(editor): Prevent saving already saved workflows (#9670)
  fix(editor): Fix node connection showing incorrect item count during … (#9684)
  refactor: Set up Cypress as pnpm workspace (no-changelog) (#6049)
MiloradFilipovic added a commit that referenced this pull request Jun 12, 2024
* master:
  fix(editor): Add back credential type icon (no-changelog) (#9704)
  feat(editor): Add canvas edge toolbar hover show/hide support (no-changelog) (#9699)
  ci: Fix custom docker builds (no-changelog) (#9702)
  test: Fix e2e for projects missing instance owner (no-changelog) (#9703)
  ci: Refactor e2e tests to be less flaky (no-changelog) (#9695)
  feat(editor): Add move resources option to workflows and credentials on (#9654)
  fix: Introduce `HooksService` (#8962)
  fix(editor): Improve large data warning in input/output panel (#9671)
  ci(editor): Enforce type-safety in @n8n/chat builds as well (no-changelog) (#9685)
  fix(editor): Un-skip workflow save test (no-changelog) (#9698)
  refactor(core): Remove more dead code from event bus (no-changelog) (#9697)
  ci: Remove unused WaitTracker mocking (no-changelog) (#9694)
  feat: Update NPS Value Survey (#9638)
  refactor(core): Remove event bus channel (no-changelog) (#9663)
  refactor(core): Remove event bus helpers (no-changelog) (#9690)
@janober
Copy link
Member

janober commented Jun 12, 2024

Got released with [email protected]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
n8n team Authored by the n8n team Released
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants