Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature: Describe OSCR rating #3854

Closed
zanieb opened this issue Aug 5, 2024 · 9 comments · Fixed by #3857
Closed

Feature: Describe OSCR rating #3854

zanieb opened this issue Aug 5, 2024 · 9 comments · Fixed by #3857

Comments

@zanieb
Copy link

zanieb commented Aug 5, 2024

Suggested solution

e.g. at
Screenshot 2024-08-05 at 12 19 17 PM

I see an OSCR rating but have no clue what the scale is or what it means. A hover tooltip with more information would be nice, as well as a link to more information.

Copy link
Contributor

github-actions bot commented Aug 5, 2024

Thanks for the issue, our team will look into it as soon as possible! If you would like to work on this issue, please wait for us to decide if it's ready. The issue will be ready to work on once we remove the "needs triage" label.

To claim an issue that does not have the "needs triage" label, please leave a comment that says ".take". If you have any questions, please comment on this issue.

For full info on how to contribute, please check out our contributors guide.

@jpmcb jpmcb added the OSCR label Aug 5, 2024
@bdougie
Copy link
Member

bdougie commented Aug 5, 2024

@zanieb you caught us between releases, we will have a blog post and other elements in the UI explaining the OSCR soon.

cc @BekahHW to follow up here.

@BekahHW
Copy link
Member

BekahHW commented Aug 5, 2024

@zanieb here are the initial docs for the OSCR. Feel free to ask questions or give feedback.

@zanieb
Copy link
Author

zanieb commented Aug 5, 2024

Thanks for the prompt replies.

Some small things

  • 30 days seems to short for a rolling metric, e.g., it seems weird that a score would drop significantly if someone went on vacation for a week.
  • There is no mention of the "highest possible" score

@jpmcb
Copy link
Member

jpmcb commented Aug 5, 2024

30 days seems to short for a rolling metric

True! We actually recently updated this to be a rolling 90 day metric. Part of this limitation is compute: if we receive good feedback here, it's likely we'd expand this out to 180 days or even 1 year with more infrastructure behind it.

There is no mention of the "highest possible" score

We also recently updated this: the previous highest score was 100 on a scale from 0-100. Anything above 80 is sublime. This score reflected 2 pillars: contributor quality and contributor "confidence". Quality is a measure of how frequently someone's contributos are accepted (i.e., a high score is contributions that are always accepted). Quality also reflects if someone has PRs frequently marked as spam (where their score will go to zero). Confidence is how often someone stars or forks something and comes back to make a contribution.

We updated this recently where the current highest possible score is 300 and reflects 3 pillars: quality, confidence, and "sway". This new pillar, sway, is a measure of a contributors ability to drive conversation within open source ecosystems. We look at comments, issues, pull requests, and reviews to measure this.

With the new top score, anything above 250 is extremely good. Above 200 is amazing. Above 100 indicates someone is making quality contributions and may be ready for mentorship or maintainership. Above 50 indicates strong, quality contributions. And above 0 is likely someone first starting out.

@zeucapua
Copy link
Contributor

zeucapua commented Aug 5, 2024

I'll add tooltip on the user page to explain what OSCR is; thanks for the issue @zanieb!

Copy link
Contributor

open-sauced bot commented Aug 8, 2024

🎉 This issue has been resolved in version 2.52.0-beta.11 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Copy link
Contributor

open-sauced bot commented Aug 9, 2024

🎉 This issue has been resolved in version 2.52.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

@open-sauced open-sauced bot added the released label Aug 9, 2024
@BekahHW
Copy link
Member

BekahHW commented Aug 12, 2024

@zanieb I wanted to follow up again. Here's the blog post we posted today: https://opensauced.pizza/blog/introducing-OSCR. We'll have more content throughout the week too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants