Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

E2E: Fix flaky e2e tests #23630

Merged
merged 9 commits into from
Aug 1, 2023
Merged

E2E: Fix flaky e2e tests #23630

merged 9 commits into from
Aug 1, 2023

Conversation

valentinpalkovic
Copy link
Contributor

@valentinpalkovic valentinpalkovic commented Jul 27, 2023

Closes N/A

What I did

This PR attempts to fix the flakyness in the E2E tests, which has been happening quite frequently.
It changes the session storage to make sure that the toolbar and the sidebar are visible before running each test. Most of the flake is related to either of these not being visible when a test is running.

How to test

CI should be green!

Checklist

  • Make sure your changes are tested (stories and/or unit, integration, or end-to-end tests)
  • Make sure to add/update documentation regarding your changes
  • If you are deprecating/removing a feature, make sure to update
    MIGRATION.MD

Maintainers

  • When this PR is ready for testing, make sure to add ci:normal, ci:merged or ci:daily GH label to it to run a specific set of sandboxes. The particular set of sandboxes can be found in code/lib/cli/src/sandbox-templates.ts
  • Make sure this PR contains one of the labels below.

["cleanup", "BREAKING CHANGE", "feature request", "bug", "build", "documentation", "maintenance", "dependencies", "other"]

🦋 Canary release

This PR does not have a canary release associated. You can request a canary release of this pull request by mentioning the @storybookjs/core team here.

core team members can create a canary release here or locally with gh workflow run --repo storybookjs/storybook canary-release-pr.yml --field pr=<PR_NUMBER>

@valentinpalkovic valentinpalkovic added patch:yes Bugfix & documentation PR that need to be picked to main branch build Internal-facing build tooling & test updates ci:daily Run the CI jobs that normally run in the daily job. labels Jul 27, 2023
@valentinpalkovic valentinpalkovic self-assigned this Jul 27, 2023
@valentinpalkovic valentinpalkovic changed the title Fix flaky e2e tests E2E: Fix flaky e2e tests Jul 27, 2023
@valentinpalkovic valentinpalkovic added patch:yes Bugfix & documentation PR that need to be picked to main branch ci:daily Run the CI jobs that normally run in the daily job. and removed patch:yes Bugfix & documentation PR that need to be picked to main branch ci:daily Run the CI jobs that normally run in the daily job. labels Jul 27, 2023
@valentinpalkovic valentinpalkovic force-pushed the valentin/fix-flakiness-in-e2e-tests branch 2 times, most recently from 13aa8c3 to a4e3126 Compare July 27, 2023 11:45
@valentinpalkovic valentinpalkovic force-pushed the valentin/fix-flakiness-in-e2e-tests branch from a4e3126 to 99047dd Compare July 27, 2023 13:37
@yannbf yannbf requested a review from ndelangen as a code owner August 1, 2023 06:54
@yannbf yannbf requested a review from tmeasday as a code owner August 1, 2023 13:53
@yannbf yannbf merged commit a4feb6b into next Aug 1, 2023
15 checks passed
@yannbf yannbf deleted the valentin/fix-flakiness-in-e2e-tests branch August 1, 2023 15:44
@github-actions github-actions bot mentioned this pull request Aug 1, 2023
33 tasks
@github-actions github-actions bot mentioned this pull request Aug 1, 2023
14 tasks
storybook-bot pushed a commit that referenced this pull request Aug 3, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
@github-actions github-actions bot mentioned this pull request Aug 3, 2023
32 tasks
storybook-bot pushed a commit that referenced this pull request Aug 4, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 7, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 7, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 7, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 7, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 8, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 9, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 9, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
storybook-bot pushed a commit that referenced this pull request Aug 9, 2023
…e2e-tests

E2E: Fix flaky e2e tests
(cherry picked from commit a4feb6b)
@kasperpeulen kasperpeulen removed the patch:yes Bugfix & documentation PR that need to be picked to main branch label Aug 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Internal-facing build tooling & test updates ci:daily Run the CI jobs that normally run in the daily job.
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

4 participants