Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CH] Migrate failure annotation page #5803

Merged
merged 3 commits into from
Oct 23, 2024

Conversation

huydhn
Copy link
Contributor

@huydhn huydhn commented Oct 23, 2024

This is more like a refactoring, not a migration, but it's needed to make the query works.

  • failed_workflow_jobs runs OOM on ClickHouse trying to load all failed jobs from commits that are having more than N failures. I rewrite the logic to get rid of N because we only set it to 0 anyway. The simplified logic can be then be run
  • https://hud.pytorch.org/failedjobs/pytorch/pytorch/main has duplicated entries. This is a subtle bug from torchci/components/JobAnnotationToggle.tsx that took me way too long to figure out.
  • There are several React warnings on the page, so I fix them too

Testing

https://torchci-git-fork-huydhn-ch-migrate-job-anno-45acb4-fbopensource.vercel.app/failedjobs/pytorch/pytorch/main

@huydhn huydhn requested a review from clee2000 October 23, 2024 03:48
Copy link

vercel bot commented Oct 23, 2024

@huydhn is attempting to deploy a commit to the Meta Open Source Team on Vercel.

A member of the Team first needs to authorize it.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 23, 2024
Copy link

vercel bot commented Oct 23, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
torchci ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 23, 2024 11:08pm

Copy link
Contributor

@clee2000 clee2000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we consider removing this page?

Also why do you need to group by sha?

@huydhn
Copy link
Contributor Author

huydhn commented Oct 23, 2024

Should we consider removing this page?

Yeah, that's that I'm thinking too. But let merge this, then reap the page later. Maybe we can do a BE task to prune other unused pages too.

Also why do you need to group by sha?

Good catch, I need to remove that part. I was debugging why there are duplications on the page, so I try to group them by sha to make sure they are unique. But that bug has been fixed, so that grouping is not needed anymore.

@huydhn huydhn merged commit c07dbe2 into pytorch:main Oct 23, 2024
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants