Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

R-Precision variant of Precision metrics #123

Closed
blondered opened this issue Apr 20, 2024 · 0 comments · Fixed by #155
Closed

R-Precision variant of Precision metrics #123

blondered opened this issue Apr 20, 2024 · 0 comments · Fixed by #155
Assignees
@blondered
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@blondered
Copy link
Collaborator

blondered commented Apr 20, 2024 •
edited
Loading

Feature Description

Add r_precision: bool = False parameter to Precision metric.
When r_precision is set to True, number of True Positives in K recommendations for user are divided by min(K, test items count for user) instead of simple division by K.

Why this feature?

This variant has better interpretation. https://www.shaped.ai/blog/evaluating-recommendation-systems-part-1

Additional context

No response
@blondered blondered added good first issue Good for newcomers enhancement New feature or request and removed good first issue Good for newcomers labels Apr 20, 2024
@blondered blondered moved this to 📋 Backlog in RecTools board Apr 20, 2024
@blondered blondered moved this from 📋 Backlog to 🔖 Next in RecTools board May 23, 2024
@blondered blondered added the help wanted Extra attention is needed label May 30, 2024
@blondered blondered moved this from 🔖 Next to 🏗 In progress in RecTools board Jun 17, 2024
@blondered blondered self-assigned this Jun 17, 2024
@blondered blondered mentioned this issue Jun 23, 2024
Merged
@blondered blondered moved this from 🏗 In progress to 👀 In review in RecTools board Jun 23, 2024
@github-project-automation github-project-automation bot moved this from 👀 In review to ✅ Done in RecTools board Jul 1, 2024
blondered added a commit that referenced this issue Sep 23, 2024
@blondered
Feature/DQ and R-Precision (#155)
5635268 
- Added `r-precision` calculation to `Precision`
- Added DQ metrics: `SufficientReco`, `UnrepeatedReco`, `CoveredUsers`
- Updated authors and links in readme
- Updated model descriptions in readme
Closes #102 
Closes #123
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@blondered blondered

Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
RecTools board
Status: ✅ Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Feature/DQ and R-Precision MobileTeleSystems/RecTools
1 participant
@blondered