Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluating on the test set #1

Open
xiang-deng opened this issue Oct 9, 2021 · 4 comments
Open

Evaluating on the test set #1

xiang-deng opened this issue Oct 9, 2021 · 4 comments

Comments

@xiang-deng
Copy link

Hi, seems the data released only contains train and dev data, could you give some instructions about how we could get the testing performance? Thanks

@xiang-deng xiang-deng changed the title Testing on the test set Evaluating on the test set Oct 9, 2021
@TravelLeraLone
Copy link
Collaborator

Thanks for asking, but our test set would not be publicly available. The evaluation system is coming soon. Currently, we can help you access the performance on the test set through manual evaluation, please contact [email protected].

@huizhang0110
Copy link

huizhang0110 commented Sep 5, 2023

Hello @TravelLeraLone,

I sent my prediction file for evaluation to [email protected] and [email protected], as described in the README.md. However, I have not received a response to my email [email protected] yet.

@TravelLeraLone
Copy link
Collaborator

Hello @huizhang0110 ,

We have just finished the evaluation process of your submission and sent the results to you through your email. Thanks for your interest in the WebSRC dataset.

@huizhang0110
Copy link

Thank you for your kind and fast response @TravelLeraLone
Could you please assist in updating the result in the Leaderboard (https://x-lance.github.io/WebSRC/)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants