Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat/add mm e2e mmi build #20931

Merged
merged 14 commits into from
Sep 22, 2023
Merged

Feat/add mm e2e mmi build #20931

merged 14 commits into from
Sep 22, 2023

Conversation

racitores
Copy link
Contributor

@racitores racitores commented Sep 18, 2023

Explanation

Currently MMI extension is assuming that all general/core MM extension features should work under MMI but this is not been tested in the pipeline.

This PR adds Metamask e2e tests run in the circle ci pipeline for a MMI build generated extension. There are a set failing tests marked as @no-mmi so that when running the tests with yarn test:e2e:chrome:mmi will do SELENIUM_BROWSER=chrome node test/e2e/run-all.js --mmi passing --mmi as param.

This is a first step to improve MMI test coverage and regression. Next steps will be reviewed and updated tests if required

Screenshots/Screencaps

Before

After

Manual Testing Steps

Pre-merge author checklist

  • I've clearly explained:
    • What problem this PR is solving
    • How this problem was solved
    • How reviewers can test my changes
  • Sufficient automated test coverage has been added

Pre-merge reviewer checklist

  • Manual testing (e.g. pull and build branch, run in browser, test code being changed)
  • PR is linked to the appropriate GitHub issue
  • IF this PR fixes a bug in the release milestone, add this PR to the release milestone

If further QA is required (e.g. new feature, complex testing steps, large refactor), add the Extension QA Board label.

In this case, a QA Engineer approval will be be required.

@github-actions
Copy link
Contributor

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@socket-security
Copy link

socket-security bot commented Sep 18, 2023

No top level dependency changes detected. Learn more about Socket for GitHub ↗︎

@socket-security
Copy link

socket-security bot commented Sep 18, 2023

👍 Dependency issues cleared. Learn more about Socket for GitHub ↗︎

This PR previously contained dependency changes with security issues that have been resolved, removed, or ignored.

@racitores racitores added the team-mmi PRs from the MMI team label Sep 18, 2023
@racitores racitores force-pushed the feat/add-mm-e2e-mmi-build branch from aa1d782 to f9f4ae0 Compare September 18, 2023 15:11
@metamaskbot
Copy link
Collaborator

Builds ready [aa1d782]
Page Load Metrics (1877 ± 96 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint1152221643215
domContentLoaded14702270187520096
load14702270187720096
domInteractive14702270187520096
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

@codecov
Copy link

codecov bot commented Sep 18, 2023

Codecov Report

Patch and project coverage have no change.

Comparison is base (97bb2c4) 68.36% compared to head (5255fdf) 68.36%.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop   #20931   +/-   ##
========================================
  Coverage    68.36%   68.36%           
========================================
  Files         1006     1006           
  Lines        40262    40262           
  Branches     10763    10763           
========================================
  Hits         27522    27522           
  Misses       12740    12740           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@racitores racitores marked this pull request as ready for review September 18, 2023 15:18
@racitores racitores requested review from kumavis, brad-decker and a team as code owners September 18, 2023 15:18
@metamaskbot
Copy link
Collaborator

Builds ready [f9f4ae0]
Page Load Metrics (1564 ± 35 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint1112011382311
domContentLoaded1419173715647335
load1419173715647335
domInteractive1419173715647335
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

zone-live
zone-live previously approved these changes Sep 19, 2023
Copy link
Contributor

@zone-live zone-live left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💪🏼

@racitores racitores force-pushed the feat/add-mm-e2e-mmi-build branch from f9f4ae0 to b46600b Compare September 20, 2023 09:28
@metamaskbot
Copy link
Collaborator

Builds ready [b46600b]
Page Load Metrics (1551 ± 78 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint1062101352412
domContentLoaded13411955155116278
load13421955155116278
domInteractive13401955155116278
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

Copy link
Contributor

@brad-decker brad-decker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@PeterYinusa you should probably review this and see if we should include some way of documenting the @no-mmi flag in our E2E documents. Blocking for review but overall the code looks good for me.

Comment on lines 125 to 131
if (mmi) {
extraArgs.push('-g', '@no-mmi', '-i');
}

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you add inline documentation here for what these flags do (grep/invert) and explain the @no-mmi tag on some of the tests

@PeterYinusa
Copy link
Contributor

@PeterYinusa you should probably review this and see if we should include some way of documenting the @no-mmi flag in our E2E documents. Blocking for review but overall the code looks good for me.

Thanks for the heads up @brad-decker, this seems in line with the approach discussed with @racitores.
It looks good to me, but I agree we should add some documentation around the usage of the tags to ensure contributors understand when to use them.

PeterYinusa
PeterYinusa previously approved these changes Sep 21, 2023
Copy link
Contributor

@PeterYinusa PeterYinusa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, please add documentation for contributors

@racitores racitores dismissed stale reviews from PeterYinusa and zone-live via 43fd3db September 22, 2023 07:44
@racitores racitores force-pushed the feat/add-mm-e2e-mmi-build branch from b46600b to 43fd3db Compare September 22, 2023 07:44
Copy link
Contributor

@PeterYinusa PeterYinusa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@metamaskbot
Copy link
Collaborator

Builds ready [43fd3db]
Page Load Metrics (1526 ± 51 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint117172136168
domContentLoaded13811789152610651
load13811789152610651
domInteractive13811789152610651
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

@metamaskbot
Copy link
Collaborator

Builds ready [5255fdf]
Page Load Metrics (1513 ± 46 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint117172146168
domContentLoaded1333170715139546
load1334170715139546
domInteractive1333170715139546
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

@racitores racitores merged commit 439de24 into develop Sep 22, 2023
9 checks passed
@racitores racitores deleted the feat/add-mm-e2e-mmi-build branch September 22, 2023 15:02
@github-actions github-actions bot locked and limited conversation to collaborators Sep 22, 2023
@metamaskbot metamaskbot added the release-11.3.0 Issue or pull request that will be included in release 11.3.0 label Sep 22, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
release-11.3.0 Issue or pull request that will be included in release 11.3.0 team-mmi PRs from the MMI team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants