Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests(smoke): fix flaky perf-diagnostics-third-party #14081

Closed
wants to merge 5 commits into from

Conversation

adamraine
Copy link
Member

@adamraine adamraine commented Jun 3, 2022

🤞 won't be permanent, but can hopefully unblock CI. Should fix the flaky failures on perf-diagnostics-third-party and oopif-scripts

Theory is that one or more of the features enabled by this CL triggered the flakiness.

Related #13861

@adamraine adamraine requested a review from a team as a code owner June 3, 2022 20:56
@adamraine adamraine requested review from brendankenny and removed request for a team June 3, 2022 20:56
# Disabled to fix CI while we investigate what the bug is.
# oopif-scripts
run: yarn smoke --runner devtools --shard=${{ matrix.smoke-test-shard }}/${{ strategy.job-total }} --jobs=3 --retries=2 --invert-match oopif-scripts a11y byte-efficiency byte-gzip dbw errors-expired-ssl errors-infinite-loop lantern-idle-callback-short legacy-javascript metrics-tricky-tti metrics-tricky-tti-late-fcp oopif-requests perf-budgets perf-diagnostics-third-party perf-fonts perf-frame-metrics perf-preload perf-trace-elements pwa redirects-client-paint-server redirects-history-push-state redirects-multiple-server redirects-single-server redirects-single-client redirects-scripts screenshot seo-passing seo-tap-targets
run: yarn smoke --runner devtools --shard=${{ matrix.smoke-test-shard }}/${{ strategy.job-total }} --jobs=3 --retries=2 --invert-match a11y byte-efficiency byte-gzip dbw errors-expired-ssl errors-infinite-loop lantern-idle-callback-short legacy-javascript metrics-tricky-tti metrics-tricky-tti-late-fcp oopif-requests perf-budgets perf-diagnostics-third-party perf-fonts perf-frame-metrics perf-preload perf-trace-elements pwa redirects-client-paint-server redirects-history-push-state redirects-multiple-server redirects-single-server redirects-single-client redirects-scripts screenshot seo-passing seo-tap-targets
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just reenabling oopif-scripts to see where we are at now

@adamraine
Copy link
Member Author

adamraine commented Jun 3, 2022

Hmm at least we got a different failure:
https://github.com/GoogleChrome/lighthouse/runs/6732601347?check_suite_focus=true

Maybe disabling one of the other features would fix this one? oopif-requests failure is harder to reproduce.

@adamraine adamraine changed the title tests(smoke): fix flaky perf-diagnostics-third-party tests(smoke): fix flaky oopif tests Jun 3, 2022
@adamraine adamraine changed the title tests(smoke): fix flaky oopif tests tests(smoke): fix flaky perf-diagnostics-third-party Jun 3, 2022
@connorjclark
Copy link
Collaborator

(closing because we don't want to change the flags we use in our smoke tests)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants