Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Gradle Check Retry] Publish/Record tests which pass after a retry to address flakiness #2797

Open
kotwanikunal opened this issue Apr 6, 2022 · 2 comments
Labels
Build Libraries & Interfaces enhancement Enhancement or improvement to existing feature or request good first issue Good for newcomers hacktoberfest Global event that encourages people to contribute to open-source.

Comments

@kotwanikunal
Copy link
Member

Is your feature request related to a problem? Please describe.

  • gradle check test failures are now retried as a part of Gradle check retry #2638
  • This issue addresses the scenarios where the check passes with retries where the flakey tests are lost under the green status

Describe the solution you'd like

  • As a part of the solution, there should be a record of logs and/or a comment on the PR in case of test failures
  • The generated report has a log of the tests that fail even though the overall job succeeds
  • Record the frequent offenders to address and mitigate the underlying root cause for flakiness

Describe alternatives you've considered

  • Manually keeping track of failed tests from the gradle check bot reports

Additional context

  • N/A
@kotwanikunal kotwanikunal added enhancement Enhancement or improvement to existing feature or request untriaged Build Libraries & Interfaces and removed untriaged labels Apr 6, 2022
@minalsha minalsha added the good first issue Good for newcomers label Jun 14, 2022
@yeohbraddy
Copy link
Contributor

Hi @kotwanikunal,

I'd like to contribute to this issue!

@kotwanikunal
Copy link
Member Author

@yeohbraddy Thanks. Let me know if you have any queries around this.

@owaiskazi19 owaiskazi19 added the hacktoberfest Global event that encourages people to contribute to open-source. label Oct 5, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Build Libraries & Interfaces enhancement Enhancement or improvement to existing feature or request good first issue Good for newcomers hacktoberfest Global event that encourages people to contribute to open-source.
Projects
None yet
Development

No branches or pull requests

4 participants