Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] What is the label in _rank.csv file and also in test files? #3

Open
rahmanidashti opened this issue Nov 5, 2021 · 1 comment

Comments

@rahmanidashti
Copy link

Hi all,

Can you please explain more on label in both *_rank.csv file and test files in the dataset file? I think you also use this column/attribute for the performance evaluation, however, I thought you should consider iid. For example, to calculate ndcg@k you compute it on label, and in my case, it returns me 1.0 in ndcg@10!

@yunqi-li
Copy link
Collaborator

yunqi-li commented Nov 6, 2021

Sorry for the confusion, we have uploaded the rank files as mentioned in issue #4 for your reference. We compute the scores based on the ranking scores generated by the models and the labels.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants