Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

debug CI retries #4074

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

debug CI retries #4074

wants to merge 3 commits into from

Conversation

Irev-Dev
Copy link
Collaborator

@Irev-Dev Irev-Dev commented Oct 2, 2024

re running CI no longer on runs the previously failed tests, I have no idea why, so trying to add some debug steps to get some insights as to what might be going wrong.

Copy link

qa-wolf bot commented Oct 2, 2024

QA Wolf here! As you write new code it's important that your test coverage is keeping up.
Click here to request test coverage for this PR!

Copy link

vercel bot commented Oct 2, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
modeling-app ✅ Ready (Inspect) Visit Preview Oct 2, 2024 11:12am

@Irev-Dev Irev-Dev changed the title debug retries debug CI retries Oct 2, 2024
@@ -352,8 +364,20 @@ jobs:
if: ${{ !cancelled() && (success() || failure()) }}
continue-on-error: true
with:
name: test-results-${{ matrix.os }}-${{ github.sha }}
name: test-results-electron-${{ matrix.os }}-${{ github.sha }}
Copy link
Collaborator Author

@Irev-Dev Irev-Dev Oct 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was definitely a bug, but I don't know why the non-electron tests retries didn't work.

@jtran
Copy link
Collaborator

jtran commented Oct 2, 2024

I think maybe @nadr0 fixed this in #4062? The --last-failed bit.

@nadr0
Copy link
Collaborator

nadr0 commented Oct 2, 2024

I think maybe @nadr0 fixed this in #4062? The --last-failed bit.

I believe I fixed this yes. For example https://github.com/KittyCAD/modeling-app/blob/main/.github/workflows/playwright.yml#L387 this line of code didn't have --last-failed.

You can see it working here https://github.com/KittyCAD/modeling-app/actions/runs/11151744354/job/30995866650?pr=4062

@nadr0
Copy link
Collaborator

nadr0 commented Oct 3, 2024

@jtran I think I realized what Kurt was fixing.

There are two scenarios, running with last-failed within a job within the 3 retries and running last-failed across an entire job rerun. I fixed this one.

When a job fails after the 3 retries and you need to rerun the entire job it will run the whole suite again, not the last-failed ones. This one is still an issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants