New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] 请求添加BigCodeBench评测集 #1613

Open

1 task

BinBrent opened this issue Oct 16, 2024 · 1 comment

Assignees

Labels

backlog

BinBrent commented Oct 16, 2024

描述该功能

如题，添加BigCodeBench能方便评测代码在复杂问题的性能，其中包括full和hard子集，能够有complete和instruct两个版本
https://github.com/bigcode-project/bigcodebench

是否希望自己实现该功能？

我希望自己来实现这一功能，并向 OpenCompass 贡献代码！

mm-assistant bot assigned MaiziXiao

Collaborator

tonysy commented Oct 16, 2024

Thanks for the suggestions, we will add bigcodebench in this month.

tonysy added the backlog label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment