Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support measure family nicknames #17

Open
cmacdonald opened this issue Feb 19, 2020 · 2 comments
Open

support measure family nicknames #17

cmacdonald opened this issue Feb 19, 2020 · 2 comments

Comments

@cmacdonald
Copy link
Contributor

trec_eval has nicknames for groups of measures, such as "official" and "all_trec". Could you support this also?

See https://github.com/usnistgov/trec_eval/blob/de6a29f8ba9312c73f978aa9739695aa8ebf48eb/measures.c#L204
@seanmacavaney
Copy link
Contributor

@cmacdonald is this what you were looking for? If so, I'll make a PR.

@cmacdonald
Copy link
Contributor Author

bada bing bada boom. Good job @seanmacavaney

@seanmacavaney seanmacavaney mentioned this issue Feb 26, 2020
Merged
cvangysel pushed a commit that referenced this issue Mar 2, 2020
@seanmacavaney
nicknames, metric parameters, empty inputs, and memory leaks (#18)
a9fa754 
* support measure family nicknames #17

* Custom k for cut metrics #12

* support for alternative (nicer) formats for measure params #12. Built wrapper around cpp module which converts alternative formats to trec_eval format.

* plugged memory leak #15

* removed type hints for python<3.5

* removed type hints for python<3.5

* Several fixes
1) Fixed issue with empty qrels on some platforms
2) Exposed the values nicknames expand to and moved logic to wrapper
3) Some cleanupq

* bump version to 0.5

* bump version to 0.5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@cmacdonald @seanmacavaney