Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New metric: Precision at fixed recall #1683

Merged
merged 26 commits into from
Apr 14, 2023
Merged

Conversation

SkafteNicki
Copy link
Member

What does this PR do?

Fixes #1678
Adds PrecisionAtFixedRecall new metric. It is basically a copy-paste of RecallAtFixedPrecision with the logic turned around.

Before submitting
  • Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure to update the docs?
  • Did you write any new necessary tests?
PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

@SkafteNicki SkafteNicki added enhancement New feature or request New metric labels Apr 3, 2023
@SkafteNicki SkafteNicki added this to the v1.0.0 milestone Apr 3, 2023
@Borda
Copy link
Member

Borda commented Apr 3, 2023

@SkafteNicki seems that the docstring examples do not return the correct values...

@Borda Borda requested a review from a team April 4, 2023 18:45
@Borda Borda enabled auto-merge (squash) April 4, 2023 22:08
@codecov
Copy link

codecov bot commented Apr 4, 2023

Codecov Report

Merging #1683 (8e9493d) into master (0d3cd7a) will decrease coverage by 36%.
The diff coverage is 82%.

Additional details and impacted files
@@           Coverage Diff            @@
##           master   #1683     +/-   ##
========================================
- Coverage      88%     52%    -36%     
========================================
  Files         236     238      +2     
  Lines       13200   13331    +131     
========================================
- Hits        11618    6928   -4690     
- Misses       1582    6403   +4821     

@mergify mergify bot added the ready label Apr 11, 2023
@mergify mergify bot removed the has conflicts label Apr 13, 2023
@Borda
Copy link
Member

Borda commented Apr 13, 2023

@SkafteNicki could you pls check the typing? 🐿️

@mergify mergify bot removed the ready label Apr 14, 2023
@mergify mergify bot added the ready label Apr 14, 2023
@Borda Borda disabled auto-merge April 14, 2023 22:04
@Borda Borda merged commit 20f6793 into master Apr 14, 2023
@Borda Borda deleted the metric/precision_at_fixed_recall branch April 14, 2023 22:05
@fcakyon
Copy link

fcakyon commented Apr 14, 2023

@Borda, thanks for this awesome PR! Will it be introduced in v1.0.0 or v0.12.0?

@Borda
Copy link
Member

Borda commented Apr 14, 2023

@Borda, thanks for this awesome PR! Will it be introduced in v1.0.0 or v0.12.0?

will be in v1.0.0 and we can do RC on beginning of next week for early testing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

add Precision At Fixed Recall
5 participants