Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove user-data-dir usage in tests on mv3 builds #24696

Merged
merged 1 commit into from
May 22, 2024

Conversation

danjm
Copy link
Contributor

@danjm danjm commented May 21, 2024

Description

"The user data directory contains profile data such as history, bookmarks, and cookies, as well as other per-installation local state."

We are using the user-data-dir command and unnecessarily caching such data in the test-artefacts/ directory. With local testing, and seemingly with test run as part of the same job on CI, it can be seen that this cached data has persistence between test runs, and can thereby cause flakiness. Locally, it seems that old builds of the extension can be cached. On CI, it seems that things like our fetch cache can be persisted between browser sessions.

I do not believe this is actually used for any purpose, and we can reduce flakiness by removing it.

Open in GitHub Codespaces

Manual testing steps

all e2e tests should pass

Pre-merge author checklist

  • I’ve followed MetaMask Coding Standards.
  • I've completed the PR template to the best of my ability
  • I’ve included tests if applicable
  • I’ve documented my code using JSDoc format if applicable
  • I’ve applied the right labels on the PR (see labeling guidelines). Not required for external contributors.

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

@danjm danjm requested a review from a team as a code owner May 21, 2024 20:53
Copy link
Contributor

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@metamaskbot metamaskbot added the INVALID-PR-TEMPLATE PR's body doesn't match template label May 21, 2024
@metamaskbot
Copy link
Collaborator

Builds ready [2af42c8]
Page Load Metrics (793 ± 533 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint631881033316
domContentLoaded97218147
load5231287931110533
domInteractive97218147
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

@DDDDDanica DDDDDanica merged commit 48881d6 into develop May 22, 2024
79 of 87 checks passed
@DDDDDanica DDDDDanica deleted the simplify-chromedriver-arguments branch May 22, 2024 10:57
@github-actions github-actions bot locked and limited conversation to collaborators May 22, 2024
@metamaskbot metamaskbot added release-11.16.6 Issue or pull request that will be included in release 11.16.6 and removed release-11.18.0 labels Jun 4, 2024
@metamaskbot
Copy link
Collaborator

Missing release label release-11.16.6 on PR. Adding release label release-11.16.6 on PR and removing other release labels(release-11.18.0), as PR was cherry-picked in branch 11.16.6.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
INVALID-PR-TEMPLATE PR's body doesn't match template release-11.16.6 Issue or pull request that will be included in release 11.16.6
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

4 participants